Breaking News
September 21, 2018 - Study reveals promising new drug candidate to treat acute renal failure
September 21, 2018 - Neural signal that urges to eat overpowers the one that says to stop
September 21, 2018 - Scientists achieve breakthrough in accelerated diagnosis of multi-resistant hospital pathogens
September 21, 2018 - Researchers simulate how different breast tissues respond to heat from MRIs
September 21, 2018 - Despite red flags at surgery centers, overseers award gold seals
September 21, 2018 - Zapping Airway Nerves May Help COPD Patients Breathe
September 21, 2018 - Researchers find answers as to why some people are at risk of gout
September 21, 2018 - Stars of Stanford Medicine: Genetic counseling and compassion
September 21, 2018 - Health insurance ads have shifted over time due to health plans offered via ACA
September 21, 2018 - Use of transcranial electrical stimulation to bolster creativity has far-reaching implications
September 21, 2018 - Scientists find way to boost efficacy of powerful antimalarial drug with anti-cancer medicines
September 21, 2018 - Weighing the risks and benefits of drug tapering—two patients, two perspectives
September 21, 2018 - The “exposome” revealed: a barrage of bacteria, chemicals, microscopic animals and more
September 21, 2018 - Top three immune boosting recommendations to ward off freshers’ flu
September 21, 2018 - Young children’s oral microbiota could serve as early indicator for obesity
September 21, 2018 - Older individuals with multiple sclerosis report higher quality of life than younger counterparts
September 21, 2018 - LineaRx signs agreement with Takis/Evvivax to develop linear-DNA based anti-cancer vaccines
September 21, 2018 - AbbVie Presents Upadacitinib Longer-Term (32-Week) and Patient-Reported Outcomes Data from Phase 2b Atopic Dermatitis Study at 27th European Academy of Dermatology and Venereology (EADV) Congress
September 21, 2018 - Alzheimer’s drug may stop disease if used before symptoms develop
September 21, 2018 - Human skeletal stem cell can generate cartilage, bone
September 21, 2018 - UK and European research collaborations receive vote of confidence by three major cancer charities
September 21, 2018 - Microbiota in the intestines and cell stress cause colon cancer
September 20, 2018 - Arizona EMTs have 39% higher risk for suicide than general public
September 20, 2018 - Driving and older adults: MedlinePlus Medical Encyclopedia
September 20, 2018 - Brain region for stress control is enlarged in people with depression, finds study
September 20, 2018 - Researchers test autobiographical memory for early Alzheimer’s detection
September 20, 2018 - Organizations join forces to help teens with severe mental health challenges | News Center
September 20, 2018 - Neurons in the human brain can encode numerical information
September 20, 2018 - Potential drugs to treat neurodegenerative diseases garner $3 million grant
September 20, 2018 - Processing speed important to higher order cognitive function in multiple sclerosis patients
September 20, 2018 - Helping a patient survive a hurricane
September 20, 2018 - Tafamidis Treats Transthyretin Amyloid Cardiomyopathy
September 20, 2018 - Low academic achievement can lead to drug abuse decades later, research finds
September 20, 2018 - Study identifies stem cell that gives rise to new bone, cartilage in humans | News Center
September 20, 2018 - Celltrion and Emory University sign ‘Incubation’ agreement to develop new drug candidates for atherosclerosis
September 20, 2018 - TGen and PNOC take part in launch of NIH-supported Kids First Data Resource Portal
September 20, 2018 - Could Household Cleaners Make Your Kid Fat?
September 20, 2018 - Addiction nonprofit makes searching for services simple
September 20, 2018 - We are bombarded by thousands of diverse species and chemicals | News Center
September 20, 2018 - Experts to Present Prostate Cancer Advances at Patient Summit
September 20, 2018 - Alector announces initiation of Phase 1 trial of AL001 for treating frontotemporal dementia
September 20, 2018 - Pfizer’s 20vPnC vaccine receives Breakthrough Therapy designation from FDA
September 20, 2018 - Study could allow doctors to screen patients at risk from Aspergillus
September 20, 2018 - Emergex signs MoU with Brazil’s Fiocruz for development of viral vaccines
September 20, 2018 - The ‘real you’ is a myth – we constantly create false memories to achieve the identity we want
September 20, 2018 - Researchers describe cell mechanism that optimizes proteins production in stressful situations
September 20, 2018 - Cell Medica successfully doses first patient with CMD-501 targeting pediatric neuroblastoma
September 20, 2018 - Sesen Bio to present its three-month Phase 3 VISTA Trial data at Global Congress
September 20, 2018 - Senators unveil legislation to protect patients against surprise medical bills
September 20, 2018 - Study provides insights into development of special-purpose cosmetic products
September 20, 2018 - Research shows enlarged genotype-phenotype correlation for three-base pair deletion in NF1
September 20, 2018 - 91% of people around the world believe medical research will result in dementia cure
September 20, 2018 - DePuy Synthes introduces CONCORDE LIFT Expandable Interbody Device at EUROSPINE 2018
September 20, 2018 - Manx Telecom unveils MT clearSound that improves clarity of mobile phone calls
September 20, 2018 - Mediterranean-style diet appears to reduce stroke risk in women
September 20, 2018 - AbbVie Announces Patient-Reported Outcomes Data from Three Pivotal Phase 3 Studies of Risankizumab, Showing Significant Improvements in Health-Related Quality of Life for Patients with Psoriasis
September 20, 2018 - Characterization of pregnancy microbiome reveals variations in bacterial diversity
September 20, 2018 - New guidance for treatment of bone loss in hematologic stem cell transplant Recipients
September 20, 2018 - Experts to present research on prevention, management of dysphagia at international conference
September 20, 2018 - New study focuses on two-way gene switches controlling gene activity
September 20, 2018 - Zika virus could become a weapon against brain cancer
September 20, 2018 - Home-based video game exercises can reduce chronic low back pain in older people, study finds
September 20, 2018 - Investigators find that bile acids reduce cocaine reward
September 20, 2018 - Cannabinoid drugs reduce perceived unpleasantness of painful stimuli and increase tolerance
September 20, 2018 - Health care companies’ data could enable more accurate flu season forecasts
September 20, 2018 - Geroscience takes center stage in Journal of the American Medical Association
September 20, 2018 - Ambient Particulate Matter Linked to Emergency Asthma Care
September 20, 2018 - Patient satisfaction with plastic surgery—it’s the surgeon, not the practice
September 20, 2018 - Medicine is a team sport – and that’s exactly how it should be
September 20, 2018 - Logos Biosystems releases new electrophoretic tissue clearing system with twice the features in half the space
September 20, 2018 - Novel micro-platform reveals never-before-seen behaviors of cancer cells
September 20, 2018 - PAREXEL partners with Datavant to enhance clinical study design and generate real-world evidence
September 20, 2018 - Robert Koch Institute publishes new data on allergies, mental health problems, and accident injuries
September 20, 2018 - Study finds higher readmission rates in for-profit hospitals
September 20, 2018 - Encouraging youth to do strength-based exercises could help tackle child obesity
September 20, 2018 - Sleep apnea, congenital heart disease in hospitalized infants strongly associated with death
September 20, 2018 - Researchers find way to map mysterious content of non-coding RNA
September 20, 2018 - Air Pollutants Reach Placenta, Might Harm Fetus: Study
September 20, 2018 - Sleep apnea, congenital heart disease may be deadly mix for hospitalized infants
September 20, 2018 - My relative has cancer, should I worry? Encouraging cascade genetic testing
Augmented Reality helps surgeons to ‘see through’ tissue and reconnect blood vessels

Augmented Reality helps surgeons to ‘see through’ tissue and reconnect blood vessels

image_pdfDownload PDFimage_print
The surgeon’s view. Credit: ‘Philip Pratt, et al. Eur Radiol Exp, 2018’

Using augmented reality in the operating theatre could help surgeons to improve the outcome of reconstructive surgery for patients.

In a series of procedures carried out by a team at Imperial College London at St Mary’s Hospital, researchers have shown for the first time how surgeons can use Microsoft HoloLens headsets while operating on patients undergoing reconstructive lower limb surgery.

The HoloLens is a self-contained computer headset that immerses the wearer in ‘mixed reality’, enabling them to interact with ‘holograms’ – computer-generated objects made visible through the visor. In the UK, headsets are currently only available for developers.

The Imperial team used the technology to overlay images of CT scans – including the position of bones and key blood vessels – onto each patient’s leg, in effect enabling the surgeon to ‘see through’ the limb during surgery.

According to the team trialling the technology, the approach can help surgeons locate and reconnect key blood vessels during reconstructive surgery, which could improve outcomes for patients.

“We are one of the first groups in the world to use the HoloLens successfully in the operating theatre,” said Dr Philip Pratt, a Research Fellow in the Department of Surgery & Cancer and lead author of the study, published in European Radiology Experimental. “Through this initial series of patient cases we have shown that the technology is practical, and that it can provide a benefit to the surgical team. With the HoloLens, you look at the leg and essentially see inside of it. You see the bones, the course of the blood vessels, and can identify exactly where the targets are located.”

Following a car accident or severe trauma, patients may have tissue damage or open wounds that require reconstructive surgery using fasciocutaneous flaps. These flaps of tissue, which are taken from elsewhere on the body and include the skin and blood vessels, are used to cover the wound and enable it to close and heal properly.

A vital step in the process is connecting the blood vessels of the ‘new’ tissue with those at the site of the wound, so oxygenated blood can reach the new tissue and keep it alive.

The standard approach for this element of reconstructive surgery has been the use of a handheld scanner which uses ultrasound to identify blood vessels under the skin by detecting the movement of blood pulsing through them, enabling the surgeon to approximate where the vessels are and their course through the tissue.

“Augmented reality offers a new way to find these blood vessels under the skin accurately and quickly by overlaying scan images onto the patient during the operation,” explained Dr Pratt.

Making the model

In the procedures used to trial the technology, five patients requiring reconstructive surgery on their legs underwent CT scans to map the structure of the limb, including the position of bones and the location and course of blood vessels.

Images from the scans were then segmented into bone, muscle, fatty tissue and blood vessels by Dr Dimitri Amiras, a consultant radiologist at Imperial College Healthcare NHS Trust (ICHNT), and loaded into intermediary software to create 3D models of the leg.

These models were then fed into specially designed software that renders the images for the HoloLens headset, which in turn overlays the model onto what the surgeon can see in the operating theatre. Clinical staff are able to manipulate these AR images through hand gestures to make any fine adjustments and correctly line up the model with surgical landmarks on the patient’s limbs, such as the knee joint or ankle bone.

Dr Amiras said: “St Mary’s Hospital is a major trauma centre, giving us the opportunity to try and improve the pre-operative planning for reconstructive flaps. Over time, the scanning protocol has been optimised to give excellent images of the anatomy, however, at first we had to rely on rough measurements of anatomical landmarks taken from 3D CT reconstructions to guide surgery.

“Now, using the HoloLens, we can identify where the blood vessels are in 3D space and use virtual 3D arrows to guide the surgeon. Currently, data preparation is a time consuming process, but in the future much of this could be automated, with the consultant radiologist checking the accuracy of the model against the original scan. I think this is a great example of what can be achieved in an Academic Health Science Centre.”

The surgeon’s view

Mr Jon Simmons, a plastic and reconstructive surgeon at ICHNT, led the team who carried out the procedures using the HoloLens headset and augmented reality models. The cases ranged from a 41-year-old man who had sustained leg injuries during a car accident, to an 85-year-old woman with a compound fractured ankle. The surgical teams reported the HoloLens to be a powerful tool in the theatre, with the approach being more reliable and less time-consuming than the ultrasound method of locating blood vessels.

“The application of AR technology in the operating theatre has some really exciting possibilities,” said Mr Simmons. “It could help to simplify and improve the accuracy of some elements of reconstructive procedures. While the technology can’t replace the skill and experience of the clinical team, it could potentially help to reduce the time a patient spends under anaesthetic and reduce the margin for error. We hope that it will allow us to provide more tailored surgical solutions for individual patients.”

The group highlights a few limitations with the technology, which could include errors during the modelling stages as well as the potential for the overlaid model to be misaligned. In addition, the case studies so far have been based on the leg, which has a number of clearly visible surgical ‘landmarks’, such as the ankle or knee. Areas without these rigid landmarks, such as abdomen, may be more complicated with a greater potential for movement of blood vessels.

However, the researchers are confident that, once refined, the approach could be applied to other areas of reconstructive surgery requiring tissue flaps, such as breast reconstruction following mastectomy. The next steps include trialling the technology in a larger set of patients, with procedures carried out by teams at multiple centres.

Dr Pratt added: “In future we hope to automate the process further. We can use software to improve the alignment and will attach markers to the patient when they have the scan, with the same markers present during the operation to use as additional points of reference. There are a number of areas we would like to explore, and further improvements are needed, but the small case series has shown that for reconstructive surgery, this seems to be a valuable tool in the operating theatre.”


Explore further:
Augmented reality technology may help guide plastic and reconstructive surgery

More information:
Philip Pratt et al, Through the HoloLens looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels, European Radiology Experimental (2018). DOI: 10.1186/s41747-017-0033-2

Provided by:
Imperial College London

Tagged with:

About author

Related Articles