Breaking News
December 11, 2018 - Oral cancer prognostic signature identified
December 11, 2018 - How Can I Find Out What Caused My Miscarriage?
December 11, 2018 - Novel personalized medicine tool for assessing inherited colorectal cancer syndrome risk developed
December 11, 2018 - Study uncovers 11 new genes associated with epilepsy
December 11, 2018 - Cartilage tissue engineering brings good news for patients with cartilage defects
December 11, 2018 - Novel 3D printing workflow helps predict leaky heart valves
December 11, 2018 - Imagination can help overcome fear and anxiety-related disorders, shows study
December 11, 2018 - Are caries linked to political regime?
December 11, 2018 - Leader in Diabetes Clinical Trials Wins Naomi Berrie Award
December 11, 2018 - Scientists discover cellular mechanism that triggers pneumonia in humans
December 11, 2018 - Increasing mental health problems related to drug use in over 55’s
December 11, 2018 - High-intensity interval exercise could help combat cognitive dysfunction in obese people
December 11, 2018 - Annual flu shot can save lives of heart failure patients
December 11, 2018 - Researchers compare health outcomes for VA and non-VA hospitals
December 11, 2018 - Recommendations Developed for Psoriatic Arthritis Treatment
December 11, 2018 - Genetic analysis links obesity with diabetes, coronary artery disease
December 11, 2018 - Study shows that having genetic information can affect how the body responds
December 11, 2018 - UNAIDS Report: 9 Million Are Likely HIV Positive And Don't Know It
December 11, 2018 - Lund University researchers succeed in obtaining dendritic cells by direct reprogramming
December 11, 2018 - Breast tumors recruit bone marrow cells to boost their growth, study reveals
December 11, 2018 - Updated breast cancer screening guideline highlights importance of shared decision-making
December 11, 2018 - EHR-related stress associated with physician burnout
December 11, 2018 - AHA: 12-Year-Old Heart Defect Survivor Inspires NFL Player’s Foundation
December 11, 2018 - Breast cancer patients who take heart drug with trastuzumab have less heart damage
December 11, 2018 - Providing aid to those humans – and animals – affected by the California fires
December 11, 2018 - Even without proof, CBD is finding a niche as a cure-all
December 11, 2018 - Drawing leads to better memory than writing
December 11, 2018 - Researchers report novel findings on plant hormone
December 10, 2018 - A Tale of Two Labels
December 10, 2018 - Triple combination cancer immunotherapy improves outcomes in preclinical melanoma model
December 10, 2018 - A 14-year-old explains what it’s like to get a new heart
December 10, 2018 - Team Players Honored with 2018 Baton Awards
December 10, 2018 - Global report highlights how the changing world is affecting children’s physical activity levels
December 10, 2018 - Genes play a role in physical activity and sleep
December 10, 2018 - DDT in Alaskan fish shown to increase risk of cancer
December 10, 2018 - Laws to curb use of cell phones have greatly reduced fatalities for motorcyclists
December 10, 2018 - Argenx Provides Detailed Data from Phase 2 Clinical Trial of Efgartigimod in Immune Thrombocytopenia and Phase 1/2 Clinical Trial of Cusatuzumab in Acute Myeloid Leukemia
December 10, 2018 - University of Maryland doctors treat first breast cancer patients with GammaPod radiotherapy
December 10, 2018 - The heartbeat seat: Demoing new well-being technologies in a car
December 10, 2018 - Leading Cancer Researcher to Direct Herbert Irving Comprehensive Cancer Center
December 10, 2018 - Researchers explore how glial cells develop in the brain from neural precursor cells
December 10, 2018 - Study compares pain-related diagnoses in First Nations and non-First Nations children, youth
December 10, 2018 - Experts address sleep disorders following traumatic brain injury
December 10, 2018 - Scientists find answers to how cancer spreads
December 10, 2018 - Study explores why older people read more slowly
December 10, 2018 - Smart life-collar could save lives of young children
December 10, 2018 - Asbestos found in most NHS hospitals finds BBC inquiry
December 10, 2018 - Researchers use new technique to probe hydrogen bonds
December 10, 2018 - Music improves social communication in autistic children
December 10, 2018 - Some Brain Tumors May Respond to Immunotherapy, New Study Suggests
December 10, 2018 - Banning junk food ads to combat childhood obesity
December 10, 2018 - Skin Autofluorescence Predicts T2DM, Heart Disease, Mortality
December 10, 2018 - Largest autism sequencing study to date yields 102 genes associated with ASD
December 10, 2018 - Statins associated with low risk of side effects
December 10, 2018 - Episodic memory tests help in predicting brain atrophy and Alzheimer’s disease
December 10, 2018 - Study explores how schools address adolescent self-harming practices
December 10, 2018 - Pregnancy in adolescence linked to increased risks of complications in young mothers
December 10, 2018 - Risk Analysis publishes special issue on communicating about Zika virus
December 10, 2018 - Botox May Help Prevent Post-Op A-Fib
December 10, 2018 - African-American mothers rate boys higher for ADHD
December 10, 2018 - Graphic warning labels cancel out cigarettes’ appeal to young people
December 10, 2018 - Australian researchers to study gas inhalational anaesthetic and likelihood of cancer return
December 10, 2018 - Individual neurons located within the brain have implications for psychiatric diseases
December 10, 2018 - Researchers improve bariatric surgery scoring system to extend prediction time for diabetic remission
December 10, 2018 - HPV type 16 or 18 associated with cervical cancer risk in young women
December 10, 2018 - Cervical cancer risk is higher in women with positive HPV, but no cellular abnormalities
December 10, 2018 - Combo therapy not needed if low RA disease activity achieved
December 10, 2018 - Novel therapeutic targets based on biology of aging show promise for Alzheimer’s disease
December 10, 2018 - UC San Diego professor receives NCI Outstanding Investigator Award for cancer research
December 10, 2018 - Study evaluates placental mesenchymal stem cell sheets for myocardial repair and regeneration
December 10, 2018 - Blueprint Medicines Announces Updated Results from Ongoing EXPLORER Clinical Trial of Avapritinib Demonstrating Broad Clinical Activity and Significant Symptom Reductions in Patients with Systemic Mastocytosis
December 10, 2018 - Study clarifies ApoE4’s role in dementia
December 10, 2018 - Eating disorders now a top priority with Australian Government
December 10, 2018 - Neuronal activity in the brain allows prediction of risky or safe decisions
December 10, 2018 - FDA Alerts Health Care Professionals and Patients Not to Use Drug Products Intended to be Sterile from Promise Pharmacy
December 10, 2018 - Improving dementia care and treatment saves thousands of pounds in care homes
December 10, 2018 - Heroin-assisted treatment can offer benefits, reduce harms
December 10, 2018 - People covered by Michigan’s expanded Medicaid program report improvements in health, finds study
December 10, 2018 - Hazelnuts improve micronutrient levels in older adults
December 9, 2018 - History of Partner Violence Tied to Menopause Symptoms
Augmented Reality helps surgeons to ‘see through’ tissue and reconnect blood vessels

Augmented Reality helps surgeons to ‘see through’ tissue and reconnect blood vessels

image_pdfDownload PDFimage_print
The surgeon’s view. Credit: ‘Philip Pratt, et al. Eur Radiol Exp, 2018’

Using augmented reality in the operating theatre could help surgeons to improve the outcome of reconstructive surgery for patients.

In a series of procedures carried out by a team at Imperial College London at St Mary’s Hospital, researchers have shown for the first time how surgeons can use Microsoft HoloLens headsets while operating on patients undergoing reconstructive lower limb surgery.

The HoloLens is a self-contained computer headset that immerses the wearer in ‘mixed reality’, enabling them to interact with ‘holograms’ – computer-generated objects made visible through the visor. In the UK, headsets are currently only available for developers.

The Imperial team used the technology to overlay images of CT scans – including the position of bones and key blood vessels – onto each patient’s leg, in effect enabling the surgeon to ‘see through’ the limb during surgery.

According to the team trialling the technology, the approach can help surgeons locate and reconnect key blood vessels during reconstructive surgery, which could improve outcomes for patients.

“We are one of the first groups in the world to use the HoloLens successfully in the operating theatre,” said Dr Philip Pratt, a Research Fellow in the Department of Surgery & Cancer and lead author of the study, published in European Radiology Experimental. “Through this initial series of patient cases we have shown that the technology is practical, and that it can provide a benefit to the surgical team. With the HoloLens, you look at the leg and essentially see inside of it. You see the bones, the course of the blood vessels, and can identify exactly where the targets are located.”

Following a car accident or severe trauma, patients may have tissue damage or open wounds that require reconstructive surgery using fasciocutaneous flaps. These flaps of tissue, which are taken from elsewhere on the body and include the skin and blood vessels, are used to cover the wound and enable it to close and heal properly.

A vital step in the process is connecting the blood vessels of the ‘new’ tissue with those at the site of the wound, so oxygenated blood can reach the new tissue and keep it alive.

The standard approach for this element of reconstructive surgery has been the use of a handheld scanner which uses ultrasound to identify blood vessels under the skin by detecting the movement of blood pulsing through them, enabling the surgeon to approximate where the vessels are and their course through the tissue.

“Augmented reality offers a new way to find these blood vessels under the skin accurately and quickly by overlaying scan images onto the patient during the operation,” explained Dr Pratt.

Making the model

In the procedures used to trial the technology, five patients requiring reconstructive surgery on their legs underwent CT scans to map the structure of the limb, including the position of bones and the location and course of blood vessels.

Images from the scans were then segmented into bone, muscle, fatty tissue and blood vessels by Dr Dimitri Amiras, a consultant radiologist at Imperial College Healthcare NHS Trust (ICHNT), and loaded into intermediary software to create 3D models of the leg.

These models were then fed into specially designed software that renders the images for the HoloLens headset, which in turn overlays the model onto what the surgeon can see in the operating theatre. Clinical staff are able to manipulate these AR images through hand gestures to make any fine adjustments and correctly line up the model with surgical landmarks on the patient’s limbs, such as the knee joint or ankle bone.

Dr Amiras said: “St Mary’s Hospital is a major trauma centre, giving us the opportunity to try and improve the pre-operative planning for reconstructive flaps. Over time, the scanning protocol has been optimised to give excellent images of the anatomy, however, at first we had to rely on rough measurements of anatomical landmarks taken from 3D CT reconstructions to guide surgery.

“Now, using the HoloLens, we can identify where the blood vessels are in 3D space and use virtual 3D arrows to guide the surgeon. Currently, data preparation is a time consuming process, but in the future much of this could be automated, with the consultant radiologist checking the accuracy of the model against the original scan. I think this is a great example of what can be achieved in an Academic Health Science Centre.”

The surgeon’s view

Mr Jon Simmons, a plastic and reconstructive surgeon at ICHNT, led the team who carried out the procedures using the HoloLens headset and augmented reality models. The cases ranged from a 41-year-old man who had sustained leg injuries during a car accident, to an 85-year-old woman with a compound fractured ankle. The surgical teams reported the HoloLens to be a powerful tool in the theatre, with the approach being more reliable and less time-consuming than the ultrasound method of locating blood vessels.

“The application of AR technology in the operating theatre has some really exciting possibilities,” said Mr Simmons. “It could help to simplify and improve the accuracy of some elements of reconstructive procedures. While the technology can’t replace the skill and experience of the clinical team, it could potentially help to reduce the time a patient spends under anaesthetic and reduce the margin for error. We hope that it will allow us to provide more tailored surgical solutions for individual patients.”

The group highlights a few limitations with the technology, which could include errors during the modelling stages as well as the potential for the overlaid model to be misaligned. In addition, the case studies so far have been based on the leg, which has a number of clearly visible surgical ‘landmarks’, such as the ankle or knee. Areas without these rigid landmarks, such as abdomen, may be more complicated with a greater potential for movement of blood vessels.

However, the researchers are confident that, once refined, the approach could be applied to other areas of reconstructive surgery requiring tissue flaps, such as breast reconstruction following mastectomy. The next steps include trialling the technology in a larger set of patients, with procedures carried out by teams at multiple centres.

Dr Pratt added: “In future we hope to automate the process further. We can use software to improve the alignment and will attach markers to the patient when they have the scan, with the same markers present during the operation to use as additional points of reference. There are a number of areas we would like to explore, and further improvements are needed, but the small case series has shown that for reconstructive surgery, this seems to be a valuable tool in the operating theatre.”


Explore further:
Augmented reality technology may help guide plastic and reconstructive surgery

More information:
Philip Pratt et al, Through the HoloLens looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels, European Radiology Experimental (2018). DOI: 10.1186/s41747-017-0033-2

Provided by:
Imperial College London

Tagged with:

About author

Related Articles