Breaking News
June 23, 2018 - FDA Alert: Kratom (mitragyna speciosa) powder products by Gaia Ethnobotanical: Recall
June 23, 2018 - CDC chief asks for, and gets, cut to his record $375K pay
June 22, 2018 - Novel cellular pathway may clarify how arterial inflammation develops into atherosclerosis
June 22, 2018 - Rutgers Cancer Institute educates childhood cancer survivors about late effects of treatment
June 22, 2018 - Study tests accuracy of device designed to detect heart dysfunction in childhood cancer survivors
June 22, 2018 - Study links annual haze with increased hospitalizations for respiratory problems
June 22, 2018 - Robotic surgery appears to be as effective as open surgery in treating bladder cancer
June 22, 2018 - Many Drugs Made Available Via FDA Expanded Access Programs
June 22, 2018 - Normal eye dominance is not necessary for restoring visual acuity in amblyopia
June 22, 2018 - Parent-Child Interaction Therapy can reduce depression rates in children
June 22, 2018 - Study provides insights into how components of different cells in the brain are altered
June 22, 2018 - Research does not confirm antidiabetic action of natural fatty acid derivatives
June 22, 2018 - Oxidative stress can be used against tumors to treat cancer
June 22, 2018 - Simple, cost-effective test may help improve early diagnosis of mild cognitive impairment
June 22, 2018 - New guide published to help battle fatal disease caused by kissing bugs
June 22, 2018 - Stigma Adds to Burden of Type 1 Diabetes
June 22, 2018 - In retinoblastoma survivors, oculo-visual issues tied to QoL
June 22, 2018 - Most adults with allergies do not use prescribed epinephrine even in emergency situations
June 22, 2018 - Study provides clues to how cancer cells develop resistance to chemotherapies
June 22, 2018 - New consensus paper serves as basis for uniform medical management of DSD
June 22, 2018 - Researchers work to identify areas of the brain that help us wake up
June 22, 2018 - Alcohol hangovers more significant and costly than people realize, shows research
June 22, 2018 - Targeting cells involved in blood vessel formation could hinder brain tumor growth
June 22, 2018 - Young cancer survivors need more support as they feel dissatisfied with their sexuality
June 22, 2018 - Unusual cell-to-cell communication in glioblastoma promotes aggressiveness and therapy resistance
June 22, 2018 - Turning A Phage – Drug Discovery Today
June 22, 2018 - World-first study links birth interventions and long-term childhood illness
June 22, 2018 - Improving the quality of biomedical research samples
June 22, 2018 - Researchers identify cerebral palsy using AI and DNA sequencing
June 22, 2018 - Administering nitric oxide gas after heart surgery may decrease risk of kidney problems
June 22, 2018 - Measuring levels of ethyl sulphate in hair can help assess alcohol consumption
June 22, 2018 - Researchers develop robot bloodhound that can rapidly detect odors on the ground
June 22, 2018 - AAA doses first patients in two clinical studies with PSMA-R2 for prostate cancer
June 22, 2018 - Researchers discover drug compound that inhibits movement of cancer cells
June 22, 2018 - Normalization of ‘plus-size’ body shapes may prevent recognition of health risks of obesity
June 22, 2018 - UC San Diego launches new bacteriophage therapy center
June 22, 2018 - New review outlines current state of sex-sensitive issues linked to heart failure drugs
June 22, 2018 - Pelvic pain a major issue for women nearing mid-life, research reveals
June 22, 2018 - Researchers develop reliable DNA barcodes for biomedical research
June 22, 2018 - New risk-prediction model may help identify diabetic patients at high risk of pancreatic cancer
June 22, 2018 - Study reveals how mTORC1-driven changes in crowding could influence major diseases
June 22, 2018 - Researchers uncover new therapeutic opportunity in the treatment of malignant melanoma
June 22, 2018 - UC Riverside researcher receives grants to advance cancer, ALS research
June 22, 2018 - Radiation therapy alone may be enough to treat older, sicker patients with anal cancers
June 22, 2018 - Technical report describes how to make accurate particle size measurements on carbon black samples
June 22, 2018 - Nocdurna (desmopressin acetate) Approved by FDA as First Sublingual Tablet to Treat Nocturia due to Nocturnal Polyuria
June 22, 2018 - Neuroscientists locate neurons in the brain that respond when a visual target is found
June 22, 2018 - First human Keystone virus infection reported
June 22, 2018 - New study reveals how ‘good’ bacteria help in regulating our metabolism
June 22, 2018 - Osteopathic manual therapy affecting the diaphragm improves chronic low back pain
June 22, 2018 - Researchers create revolutionary model to study pulmonary diseases
June 22, 2018 - Diagnosing Heart Disease Using AI
June 22, 2018 - Increasing biodefense risks posed by synthetic biology
June 22, 2018 - Many Women Report Vasomotor Symptoms in Their 60s
June 22, 2018 - Rare mutation of gene carried by Quebec family gives insight into how the brain is wired
June 22, 2018 - Chemists find new way to make enzymes do a non-natural reaction
June 22, 2018 - Summer is good time to check for signs of skin cancer
June 22, 2018 - Innovative method can help identify patients with spastic cerebral palsy
June 22, 2018 - Exercise alters characteristics of blood to reduce inflammation in obese people
June 22, 2018 - Researchers examine complications across different types of breast reconstructive surgeries
June 22, 2018 - Rhesus macaque model could be useful to test therapies for congenital Zika virus syndrome
June 22, 2018 - AHA: New Insights Into Sickle Cell and Stroke Risk
June 22, 2018 - Doctors prescribe opioids at high rates to those at increased overdose risk
June 22, 2018 - Reduction in US cigarette smoking rates
June 22, 2018 - Preconception binge drinking may have negative effect on future offspring
June 22, 2018 - FDA expands approval of novel diabetes management device to include younger pediatric patients
June 22, 2018 - Researchers confirm weight loss benefits of the 16:8 diet
June 22, 2018 - FDA approves Eversense CGM system for use in adults with diabetes
June 22, 2018 - State opioid monitoring programs are not created equal
June 22, 2018 - Autistic teens who are bullied have higher rates of depression
June 22, 2018 - Penn Medicine team launches universal stroke awareness program
June 22, 2018 - Scientists discover the molecular trigger of necroptosis
June 22, 2018 - Researchers report unusually high levels of herpesvirus in the brains of people with Alzheimer’s disease
June 22, 2018 - Theoretical models predict how juveniles evolve to be more susceptible than adults to infection
June 22, 2018 - USC study reveals how the cell launches emergency response to repair damaged DNA
June 22, 2018 - $1.9 million grant aims to enhance behavioral health services in community-based settings
June 22, 2018 - New 3D imaging technique could improve arthritis treatment
June 22, 2018 - Cytokinetics Announces Data From Phase 2 Clinical Study of Reldesemtiv in Patients With Spinal Muscular Atrophy
June 22, 2018 - Polarized cells give the heart its fully developed form
June 21, 2018 - Stem cells appear to help fight obesity in animal models
Augmented Reality helps surgeons to ‘see through’ tissue and reconnect blood vessels

Augmented Reality helps surgeons to ‘see through’ tissue and reconnect blood vessels

image_pdfDownload PDFimage_print
The surgeon’s view. Credit: ‘Philip Pratt, et al. Eur Radiol Exp, 2018’

Using augmented reality in the operating theatre could help surgeons to improve the outcome of reconstructive surgery for patients.

In a series of procedures carried out by a team at Imperial College London at St Mary’s Hospital, researchers have shown for the first time how surgeons can use Microsoft HoloLens headsets while operating on patients undergoing reconstructive lower limb surgery.

The HoloLens is a self-contained computer headset that immerses the wearer in ‘mixed reality’, enabling them to interact with ‘holograms’ – computer-generated objects made visible through the visor. In the UK, headsets are currently only available for developers.

The Imperial team used the technology to overlay images of CT scans – including the position of bones and key blood vessels – onto each patient’s leg, in effect enabling the surgeon to ‘see through’ the limb during surgery.

According to the team trialling the technology, the approach can help surgeons locate and reconnect key blood vessels during reconstructive surgery, which could improve outcomes for patients.

“We are one of the first groups in the world to use the HoloLens successfully in the operating theatre,” said Dr Philip Pratt, a Research Fellow in the Department of Surgery & Cancer and lead author of the study, published in European Radiology Experimental. “Through this initial series of patient cases we have shown that the technology is practical, and that it can provide a benefit to the surgical team. With the HoloLens, you look at the leg and essentially see inside of it. You see the bones, the course of the blood vessels, and can identify exactly where the targets are located.”

Following a car accident or severe trauma, patients may have tissue damage or open wounds that require reconstructive surgery using fasciocutaneous flaps. These flaps of tissue, which are taken from elsewhere on the body and include the skin and blood vessels, are used to cover the wound and enable it to close and heal properly.

A vital step in the process is connecting the blood vessels of the ‘new’ tissue with those at the site of the wound, so oxygenated blood can reach the new tissue and keep it alive.

The standard approach for this element of reconstructive surgery has been the use of a handheld scanner which uses ultrasound to identify blood vessels under the skin by detecting the movement of blood pulsing through them, enabling the surgeon to approximate where the vessels are and their course through the tissue.

“Augmented reality offers a new way to find these blood vessels under the skin accurately and quickly by overlaying scan images onto the patient during the operation,” explained Dr Pratt.

Making the model

In the procedures used to trial the technology, five patients requiring reconstructive surgery on their legs underwent CT scans to map the structure of the limb, including the position of bones and the location and course of blood vessels.

Images from the scans were then segmented into bone, muscle, fatty tissue and blood vessels by Dr Dimitri Amiras, a consultant radiologist at Imperial College Healthcare NHS Trust (ICHNT), and loaded into intermediary software to create 3D models of the leg.

These models were then fed into specially designed software that renders the images for the HoloLens headset, which in turn overlays the model onto what the surgeon can see in the operating theatre. Clinical staff are able to manipulate these AR images through hand gestures to make any fine adjustments and correctly line up the model with surgical landmarks on the patient’s limbs, such as the knee joint or ankle bone.

Dr Amiras said: “St Mary’s Hospital is a major trauma centre, giving us the opportunity to try and improve the pre-operative planning for reconstructive flaps. Over time, the scanning protocol has been optimised to give excellent images of the anatomy, however, at first we had to rely on rough measurements of anatomical landmarks taken from 3D CT reconstructions to guide surgery.

“Now, using the HoloLens, we can identify where the blood vessels are in 3D space and use virtual 3D arrows to guide the surgeon. Currently, data preparation is a time consuming process, but in the future much of this could be automated, with the consultant radiologist checking the accuracy of the model against the original scan. I think this is a great example of what can be achieved in an Academic Health Science Centre.”

The surgeon’s view

Mr Jon Simmons, a plastic and reconstructive surgeon at ICHNT, led the team who carried out the procedures using the HoloLens headset and augmented reality models. The cases ranged from a 41-year-old man who had sustained leg injuries during a car accident, to an 85-year-old woman with a compound fractured ankle. The surgical teams reported the HoloLens to be a powerful tool in the theatre, with the approach being more reliable and less time-consuming than the ultrasound method of locating blood vessels.

“The application of AR technology in the operating theatre has some really exciting possibilities,” said Mr Simmons. “It could help to simplify and improve the accuracy of some elements of reconstructive procedures. While the technology can’t replace the skill and experience of the clinical team, it could potentially help to reduce the time a patient spends under anaesthetic and reduce the margin for error. We hope that it will allow us to provide more tailored surgical solutions for individual patients.”

The group highlights a few limitations with the technology, which could include errors during the modelling stages as well as the potential for the overlaid model to be misaligned. In addition, the case studies so far have been based on the leg, which has a number of clearly visible surgical ‘landmarks’, such as the ankle or knee. Areas without these rigid landmarks, such as abdomen, may be more complicated with a greater potential for movement of blood vessels.

However, the researchers are confident that, once refined, the approach could be applied to other areas of reconstructive surgery requiring tissue flaps, such as breast reconstruction following mastectomy. The next steps include trialling the technology in a larger set of patients, with procedures carried out by teams at multiple centres.

Dr Pratt added: “In future we hope to automate the process further. We can use software to improve the alignment and will attach markers to the patient when they have the scan, with the same markers present during the operation to use as additional points of reference. There are a number of areas we would like to explore, and further improvements are needed, but the small case series has shown that for reconstructive surgery, this seems to be a valuable tool in the operating theatre.”


Explore further:
Augmented reality technology may help guide plastic and reconstructive surgery

More information:
Philip Pratt et al, Through the HoloLens looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels, European Radiology Experimental (2018). DOI: 10.1186/s41747-017-0033-2

Provided by:
Imperial College London

Tagged with:

About author

Related Articles