Breaking News
March 19, 2018 - AcelRx Announces Receipt of Type A FDA Meeting Minutes and Plans to Resubmit the DSUVIA New Drug Application in Q2 2018
March 19, 2018 - Eye Docs Adopt EHRs Despite Reservations
March 19, 2018 - CRISPR enhances cancer immunotherapy
March 19, 2018 - Study finds first evidence of delayed aging among Americans
March 19, 2018 - Essential oils linked to abnormal breast development in boys
March 19, 2018 - ‘Tummy Tuck’ Relieved Postpartum Back Pain/Incontinence
March 19, 2018 - New biomarkers for neuroblastoma, a type of cancer in children
March 19, 2018 - Hookah Smoking Carries a Poisoning Risk
March 19, 2018 - Do Mood and Anxiety Affect MS Disability?
March 19, 2018 - Mean depth of ultrasonographic penetration greater in autism
March 19, 2018 - Platypus milk may help combat antibiotic resistance
March 19, 2018 - U.S. IDE study of THERMOCOOL SMARTTOUCH SF Catheter completes patient enrollment
March 18, 2018 - E-cigarette use exposes adolescents to potentially cancer-causing chemicals
March 18, 2018 - GOP Senator: Solve Opioid Crisis Through Community, Not Policy
March 18, 2018 - Why is ADHD more common in boys than girls?
March 18, 2018 - Measles alert after two passengers with the disease fly into US
March 18, 2018 - FDA looks to remove nicotine from cigarettes
March 18, 2018 - FDA moves to cut nicotine in cigarettes, helping smokers kick habit
March 18, 2018 - Athenex Announces Phase II Clinical Study Results for KX2-391 Ointment for the Treatment of Actinic Keratosis
March 18, 2018 - Surgery Tied to Better Outcomes in Kids with T2D
March 18, 2018 - Scientists use nanotechnology to detect molecular biomarker for osteoarthritis
March 18, 2018 - Research establishes use of chimeric cells as potential therapy for Duchenne muscular dystrophy
March 18, 2018 - Researcher working to develop improved endoscopic probe for colonoscopies
March 18, 2018 - Researchers develop way to sequence entire fetal genome by modifying prenatal testing method
March 18, 2018 - FDA Approves PDUFA Fee Waiver for Gimoti New Drug Application
March 18, 2018 - P2Y12 Tx Subsidy Yields Positive Response from Docs, Patients
March 18, 2018 - Are Proteins in Formula Linked to Type 1 Diabetes?
March 18, 2018 - Exercise does not seem to increase bone marrow edema in healthy people
March 18, 2018 - Researchers delineate architecture of nuclear pore complex in yeast cells
March 18, 2018 - ‘It’s Just Ghetto-izing People’: What We Heard This Week
March 18, 2018 - Alzheimer’s disease: Neuronal loss very limited
March 18, 2018 - Study reveals impact of intense, changing work schedules experienced by medical interns
March 18, 2018 - Jobs That Keep the Mind Sharp … Even Into Retirement
March 18, 2018 - Facial Scarring Improved with Botulinum Toxin
March 18, 2018 - Data detectives shift suspicions in Alzheimer’s to inside villain
March 18, 2018 - Shorter Preventive TB Tx Effective for HIV+ Patients
March 18, 2018 - New technique for identifying alcoholism puts treatment options at patients’ and providers’ fingertips
March 18, 2018 - Researchers uncover four microRNAs as potential biomarkers for atrial fibrillation
March 18, 2018 - IRX Therapeutics Announces Initiation of Phase 2 Clinical Trial of IRX-2 in Squamous Cervical or Vulvar Intraepithelial Neoplasia 3
March 18, 2018 - OncoBreak: Learning from Silence; ‘Rigged’ Drug System; NCCN Guidelines Questioned
March 18, 2018 - The coffee cannabis connection
March 18, 2018 - Novel centrifugal-flow pump for heart failure patients provides improved long-term outcomes
March 18, 2018 - U.S. FDA Accepts New Drug Application for Prucalopride (SHP555) for Chronic Idiopathic Constipation
March 18, 2018 - Cath Lab Recap: iFR vs FFR $$; Ridaforolimus-Eluting Stent
March 18, 2018 - Tree care workers need better training to handle dangers on the job, study finds
March 18, 2018 - Dementia patients do not undergo diagnostic evaluation at onset of disease, study finds
March 18, 2018 - Transplanting enhanced interneurons restores brain rhythms in mouse model of Alzheimer’s
March 18, 2018 - Gene Therapy Flops for Critical Limb Ischemia
March 17, 2018 - Study spotlights risks in anesthesiologist handoffs
March 17, 2018 - Verb fluency test may be useful tool for differential diagnosis of cognitive failure
March 17, 2018 - Health Tip: Suggestions to Improve Your Cholesterol
March 17, 2018 - Fructans Suspect in Non-Celiac Gluten Sensitivity
March 17, 2018 - Aspirin therapy appears safe before thyroid surgery
March 17, 2018 - Minimally invasive surgical device may one day provide lasting heart repair
March 17, 2018 - UIH and RaySearch enter into new partnership
March 17, 2018 - Is BMI Too Inexact? | Medpage Today
March 17, 2018 - Sleep apnea study finds male-female differences in cerebral cortex thickness, symptoms
March 17, 2018 - Leicester research could help identify people with asthma of different severities
March 17, 2018 - Biosense Webster enrolls and treats first AF patient in clinical study of new RF balloon catheter
March 17, 2018 - Participants in rogue herpes vaccine research take legal action
March 17, 2018 - Imara Doses First Patient in Phase 2a Clinical Trial of IMR-687 for Sickle Cell Disease
March 17, 2018 - AAP: Prevent Medication Errors by Improving Processes
March 17, 2018 - Severe sleep apnea during REM sleep tied to acute CV events
March 17, 2018 - Alzheimer’s disease also affects small blood vessels
March 17, 2018 - Jazz Pharmaceuticals Announces FDA Acceptance of NDA for Solriamfetol (JZP-110) for Excessive Sleepiness Associated with Narcolepsy or Obstructive Sleep Apnea
March 17, 2018 - Switching Biologics in Psoriasis Care
March 17, 2018 - Polygenic risk score may identify alzheimer’s risk in younger populations
March 17, 2018 - Genetic heart mutations account for fewer sudden and unexplained infant deaths
March 17, 2018 - Clinical trial to test efficacy of stem cell transplants in stopping ALS muscle deterioration
March 17, 2018 - Researchers team up to improve life for children with microcephaly
March 17, 2018 - Health guide for young women regarding labiaplasty
March 17, 2018 - Inhaled Nitrite Flops as HFpEF Therapy
March 17, 2018 - California mental health tax providing services to needy in L.A. County, study finds
March 17, 2018 - Cancer survivors become fatigued more quickly than their peers, study finds
March 17, 2018 - Study finds common presence of nightmares among U.S. military personnel
March 17, 2018 - Yellow fever outbreak in Brazil necessitates vaccination for travelers
March 17, 2018 - Health Tip: Waist Size May Help Predict Heart Attack
March 17, 2018 - Low-Dose Combo Pill Successfully Takes Down High BP
March 17, 2018 - Most children with sickle cell anemia not receiving key medication to stay healthy
March 17, 2018 - YCC launches new Yale Center for Immuno-Oncology
Augmented Reality helps surgeons to ‘see through’ tissue and reconnect blood vessels

Augmented Reality helps surgeons to ‘see through’ tissue and reconnect blood vessels

image_pdfDownload PDFimage_print
The surgeon’s view. Credit: ‘Philip Pratt, et al. Eur Radiol Exp, 2018’

Using augmented reality in the operating theatre could help surgeons to improve the outcome of reconstructive surgery for patients.

In a series of procedures carried out by a team at Imperial College London at St Mary’s Hospital, researchers have shown for the first time how surgeons can use Microsoft HoloLens headsets while operating on patients undergoing reconstructive lower limb surgery.

The HoloLens is a self-contained computer headset that immerses the wearer in ‘mixed reality’, enabling them to interact with ‘holograms’ – computer-generated objects made visible through the visor. In the UK, headsets are currently only available for developers.

The Imperial team used the technology to overlay images of CT scans – including the position of bones and key blood vessels – onto each patient’s leg, in effect enabling the surgeon to ‘see through’ the limb during surgery.

According to the team trialling the technology, the approach can help surgeons locate and reconnect key blood vessels during reconstructive surgery, which could improve outcomes for patients.

“We are one of the first groups in the world to use the HoloLens successfully in the operating theatre,” said Dr Philip Pratt, a Research Fellow in the Department of Surgery & Cancer and lead author of the study, published in European Radiology Experimental. “Through this initial series of patient cases we have shown that the technology is practical, and that it can provide a benefit to the surgical team. With the HoloLens, you look at the leg and essentially see inside of it. You see the bones, the course of the blood vessels, and can identify exactly where the targets are located.”

Following a car accident or severe trauma, patients may have tissue damage or open wounds that require reconstructive surgery using fasciocutaneous flaps. These flaps of tissue, which are taken from elsewhere on the body and include the skin and blood vessels, are used to cover the wound and enable it to close and heal properly.

A vital step in the process is connecting the blood vessels of the ‘new’ tissue with those at the site of the wound, so oxygenated blood can reach the new tissue and keep it alive.

The standard approach for this element of reconstructive surgery has been the use of a handheld scanner which uses ultrasound to identify blood vessels under the skin by detecting the movement of blood pulsing through them, enabling the surgeon to approximate where the vessels are and their course through the tissue.

“Augmented reality offers a new way to find these blood vessels under the skin accurately and quickly by overlaying scan images onto the patient during the operation,” explained Dr Pratt.

Making the model

In the procedures used to trial the technology, five patients requiring reconstructive surgery on their legs underwent CT scans to map the structure of the limb, including the position of bones and the location and course of blood vessels.

Images from the scans were then segmented into bone, muscle, fatty tissue and blood vessels by Dr Dimitri Amiras, a consultant radiologist at Imperial College Healthcare NHS Trust (ICHNT), and loaded into intermediary software to create 3D models of the leg.

These models were then fed into specially designed software that renders the images for the HoloLens headset, which in turn overlays the model onto what the surgeon can see in the operating theatre. Clinical staff are able to manipulate these AR images through hand gestures to make any fine adjustments and correctly line up the model with surgical landmarks on the patient’s limbs, such as the knee joint or ankle bone.

Dr Amiras said: “St Mary’s Hospital is a major trauma centre, giving us the opportunity to try and improve the pre-operative planning for reconstructive flaps. Over time, the scanning protocol has been optimised to give excellent images of the anatomy, however, at first we had to rely on rough measurements of anatomical landmarks taken from 3D CT reconstructions to guide surgery.

“Now, using the HoloLens, we can identify where the blood vessels are in 3D space and use virtual 3D arrows to guide the surgeon. Currently, data preparation is a time consuming process, but in the future much of this could be automated, with the consultant radiologist checking the accuracy of the model against the original scan. I think this is a great example of what can be achieved in an Academic Health Science Centre.”

The surgeon’s view

Mr Jon Simmons, a plastic and reconstructive surgeon at ICHNT, led the team who carried out the procedures using the HoloLens headset and augmented reality models. The cases ranged from a 41-year-old man who had sustained leg injuries during a car accident, to an 85-year-old woman with a compound fractured ankle. The surgical teams reported the HoloLens to be a powerful tool in the theatre, with the approach being more reliable and less time-consuming than the ultrasound method of locating blood vessels.

“The application of AR technology in the operating theatre has some really exciting possibilities,” said Mr Simmons. “It could help to simplify and improve the accuracy of some elements of reconstructive procedures. While the technology can’t replace the skill and experience of the clinical team, it could potentially help to reduce the time a patient spends under anaesthetic and reduce the margin for error. We hope that it will allow us to provide more tailored surgical solutions for individual patients.”

The group highlights a few limitations with the technology, which could include errors during the modelling stages as well as the potential for the overlaid model to be misaligned. In addition, the case studies so far have been based on the leg, which has a number of clearly visible surgical ‘landmarks’, such as the ankle or knee. Areas without these rigid landmarks, such as abdomen, may be more complicated with a greater potential for movement of blood vessels.

However, the researchers are confident that, once refined, the approach could be applied to other areas of reconstructive surgery requiring tissue flaps, such as breast reconstruction following mastectomy. The next steps include trialling the technology in a larger set of patients, with procedures carried out by teams at multiple centres.

Dr Pratt added: “In future we hope to automate the process further. We can use software to improve the alignment and will attach markers to the patient when they have the scan, with the same markers present during the operation to use as additional points of reference. There are a number of areas we would like to explore, and further improvements are needed, but the small case series has shown that for reconstructive surgery, this seems to be a valuable tool in the operating theatre.”

Explore further:
Augmented reality technology may help guide plastic and reconstructive surgery

More information:
Philip Pratt et al, Through the HoloLens looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels, European Radiology Experimental (2018). DOI: 10.1186/s41747-017-0033-2

Provided by:
Imperial College London

Tagged with:

About author

Related Articles