Breaking News
March 21, 2018 - Insurance Company Hurdles Burden Doctors, May Harm Patients
March 21, 2018 - Renal Transplant from HCV-Positive Donors Feasible
March 21, 2018 - Myelodysplastic syndrome: MedlinePlus Medical Encyclopedia
March 21, 2018 - Research reveals brain mechanism involved in language learning
March 21, 2018 - Many parents still hesitate to try early peanut introduction, survey finds
March 21, 2018 - Audiologist urges tinnitus sufferers facing ‘revolving door healthcare’ to seek support
March 21, 2018 - Study reveals impact of prostate cancer on wives and partners of sufferers
March 21, 2018 - ‘Almost a Miracle Drug’: What We Heard This Week
March 21, 2018 - Study shows NIH spent >$100 billion on basic science for new medicines
March 21, 2018 - Columbia researchers identify nerve cells that drive fruit fly’s escape behavior
March 21, 2018 - Sartorius Stedim Biotech selected by ABL Europe to supply single-use process technologies
March 21, 2018 - Increase in coffee consumption may help battle against colon cancer
March 21, 2018 - Hydrogel may accelerate healing of diabetic ulcers
March 21, 2018 - Dermira’s Two Phase 3 Trials Evaluating Olumacostat Glasaretil in Patients with Acne Vulgaris Did Not Meet Co-Primary Endpoints
March 21, 2018 - DePuy Synthes introduces ACTIS Total Hip System for improving initial implant stability
March 21, 2018 - ‘Oh, It Was Nothing’
March 21, 2018 - Herbal drug kratom linked to salmonella illnesses, CDC says
March 21, 2018 - New optical point-of-care device could enhance screening for thyroid nodules
March 21, 2018 - FDA Expands Approval of Adcetris (brentuximab vedotin) for First-Line Treatment of Stage III or IV Classical Hodgkin Lymphoma in Combination with Chemotherapy
March 21, 2018 - Eosinophilic Esophagitis: Late Manifestation of Allergic March
March 21, 2018 - Signaling pathway involving the Golgi apparatus identified in cells with Huntington’s disease
March 21, 2018 - Quintupling inhaled steroid doses may not benefit children with asthma
March 21, 2018 - Study shows clear connection between cardiovascular fitness in middle age and dementia risk
March 21, 2018 - Premature babies have higher risks of health complications in Bangladesh
March 21, 2018 - Child’s temperament and parenting influence weight gain in babies
March 21, 2018 - Researchers find the heart to be capable of arrhythmia termination after local gene therapy
March 21, 2018 - Inhealthcare to provide digital infrastructure for NHS to help protect people from falls
March 21, 2018 - Flu Season Finally Slowing Down
March 21, 2018 - Mixed Results for Shorter DAPT in ACS Patients
March 21, 2018 - Scientists discover fish scale-derived collagen effective for healing wounds
March 21, 2018 - Genomics England announces new partnership to improve efficiency of next-generation sequencing analysis
March 21, 2018 - Adjuvant AC chemotherapy found to be effective in treating HRD-positive breast cancer patients
March 21, 2018 - Researchers identify new treatment targets for lung diseases using big data
March 21, 2018 - Kids see more women in science than five decades ago
March 21, 2018 - Research shows link between chronic fatigue syndrome and lower thyroid hormone levels
March 21, 2018 - Alzheimer’s disease on the rise
March 21, 2018 - Two Agents Equal as Pretreatment for Adrenal Tumor Surgery
March 21, 2018 - ‘Icebreaker’ protein opens genome for T cell development, researchers find
March 21, 2018 - Women in medicine shout #Metoo about sexual harassment at work
March 21, 2018 - Mother’s pre-pregnancy waist size may be linked to child’s autism risk
March 21, 2018 - Second hand marijuana smoke can cause serious damage
March 21, 2018 - International study shows benefits of using MRI at the start of prostate cancer diagnosis
March 20, 2018 - Santhera Reports Outcome of Exploratory Trial with Idebenone in PPMS Conducted at the NIH
March 20, 2018 - ECG Patch Ups At-Home Afib Diagnosis in mSToPS Trial
March 20, 2018 - ROS-scavenging nanozymes for anti-inflammation therapeutics
March 20, 2018 - Genomics England announces appointment of global genomics pioneer as first CEO
March 20, 2018 - Test flight at German Aerospace Center in Cologne demonstrates functionality of deficopter
March 20, 2018 - Music therapy helps treat combat-related psychological injuries in military personnel
March 20, 2018 - Innovative psychotherapeutic treatment protocol for obsessive-compulsive disorders
March 20, 2018 - Weight loss after lap-band surgery alleviates arthritic knee pain
March 20, 2018 - New diabetes drug may help obese people shed body weight
March 20, 2018 - Novel Peanut OIT a Winner in Phase III Trial
March 20, 2018 - Can gene therapy be harnessed to fight the AIDS virus?
March 20, 2018 - Education and academic achievement can lessen effects of child abuse, neglect
March 20, 2018 - Researchers develop new algorithm to make CPR more effective
March 20, 2018 - Diabetes medication reduces chance of late miscarriage, premature birth among women with PCOS
March 20, 2018 - SSRIs may be more effective option for treating anxious youth, UC research shows
March 20, 2018 - Antibiotics could benefit women suffering from chronic bladder pain
March 20, 2018 - Health Highlights: March 16, 2018
March 20, 2018 - Interventional Radiology Has a Problem of ‘Unseen’ Value
March 20, 2018 - Antibodies show effectiveness for HIV prevention and promise for treatment and cure
March 20, 2018 - New 3-D-printed technology will improve radiology training
March 20, 2018 - New study identifies key role for particular gene in 16p11.2 deletion syndrome
March 20, 2018 - Red and processed meat increase the risk of liver disease
March 20, 2018 - 50% of Australians do not brush teeth twice a day
March 20, 2018 - American Gene Technologies receives second immuno-oncology patent
March 20, 2018 - Study finds no link between long-term violent video game play and adult aggression
March 20, 2018 - Weight loss surgery widely underutilized among young patients with severe obesity
March 20, 2018 - Scientists uncover new answers to cell aging in children with rare, fatal disease
March 20, 2018 - The Pistoia Alliance Calls for Greater Life Sciences Collaboration to Build the ‘Lab of the Future’
March 20, 2018 - Morning Break: Psychopathic Thought; Americans Flout Zzz’s; Farm to Pharma
March 20, 2018 - Perceptions of old age change as we age
March 20, 2018 - New standards for public involvement in research launched across the UK
March 20, 2018 - Whole Genome Sequencing used as diagnostic solution for TB
March 20, 2018 - Researchers show how two cancer genes work together to trigger leukemia
March 20, 2018 - Scientists discover basic molecular mechanism that helps understand how ALS works
March 20, 2018 - Multi-center study to evaluate promising new intervention for upper limb dysfunction after SCI
March 20, 2018 - Researchers develop technology to program DNA for delivering cancer drugs
March 20, 2018 - Northwestern scientists bring precision medicine to rheumatoid arthritis
March 20, 2018 - Research suggests possible link between heading a soccer ball and brain imbalance
Augmented Reality helps surgeons to ‘see through’ tissue and reconnect blood vessels

Augmented Reality helps surgeons to ‘see through’ tissue and reconnect blood vessels

image_pdfDownload PDFimage_print
The surgeon’s view. Credit: ‘Philip Pratt, et al. Eur Radiol Exp, 2018’

Using augmented reality in the operating theatre could help surgeons to improve the outcome of reconstructive surgery for patients.

In a series of procedures carried out by a team at Imperial College London at St Mary’s Hospital, researchers have shown for the first time how surgeons can use Microsoft HoloLens headsets while operating on patients undergoing reconstructive lower limb surgery.

The HoloLens is a self-contained computer headset that immerses the wearer in ‘mixed reality’, enabling them to interact with ‘holograms’ – computer-generated objects made visible through the visor. In the UK, headsets are currently only available for developers.

The Imperial team used the technology to overlay images of CT scans – including the position of bones and key blood vessels – onto each patient’s leg, in effect enabling the surgeon to ‘see through’ the limb during surgery.

According to the team trialling the technology, the approach can help surgeons locate and reconnect key blood vessels during reconstructive surgery, which could improve outcomes for patients.

“We are one of the first groups in the world to use the HoloLens successfully in the operating theatre,” said Dr Philip Pratt, a Research Fellow in the Department of Surgery & Cancer and lead author of the study, published in European Radiology Experimental. “Through this initial series of patient cases we have shown that the technology is practical, and that it can provide a benefit to the surgical team. With the HoloLens, you look at the leg and essentially see inside of it. You see the bones, the course of the blood vessels, and can identify exactly where the targets are located.”

Following a car accident or severe trauma, patients may have tissue damage or open wounds that require reconstructive surgery using fasciocutaneous flaps. These flaps of tissue, which are taken from elsewhere on the body and include the skin and blood vessels, are used to cover the wound and enable it to close and heal properly.

A vital step in the process is connecting the blood vessels of the ‘new’ tissue with those at the site of the wound, so oxygenated blood can reach the new tissue and keep it alive.

The standard approach for this element of reconstructive surgery has been the use of a handheld scanner which uses ultrasound to identify blood vessels under the skin by detecting the movement of blood pulsing through them, enabling the surgeon to approximate where the vessels are and their course through the tissue.

“Augmented reality offers a new way to find these blood vessels under the skin accurately and quickly by overlaying scan images onto the patient during the operation,” explained Dr Pratt.

Making the model

In the procedures used to trial the technology, five patients requiring reconstructive surgery on their legs underwent CT scans to map the structure of the limb, including the position of bones and the location and course of blood vessels.

Images from the scans were then segmented into bone, muscle, fatty tissue and blood vessels by Dr Dimitri Amiras, a consultant radiologist at Imperial College Healthcare NHS Trust (ICHNT), and loaded into intermediary software to create 3D models of the leg.

These models were then fed into specially designed software that renders the images for the HoloLens headset, which in turn overlays the model onto what the surgeon can see in the operating theatre. Clinical staff are able to manipulate these AR images through hand gestures to make any fine adjustments and correctly line up the model with surgical landmarks on the patient’s limbs, such as the knee joint or ankle bone.

Dr Amiras said: “St Mary’s Hospital is a major trauma centre, giving us the opportunity to try and improve the pre-operative planning for reconstructive flaps. Over time, the scanning protocol has been optimised to give excellent images of the anatomy, however, at first we had to rely on rough measurements of anatomical landmarks taken from 3D CT reconstructions to guide surgery.

“Now, using the HoloLens, we can identify where the blood vessels are in 3D space and use virtual 3D arrows to guide the surgeon. Currently, data preparation is a time consuming process, but in the future much of this could be automated, with the consultant radiologist checking the accuracy of the model against the original scan. I think this is a great example of what can be achieved in an Academic Health Science Centre.”

The surgeon’s view

Mr Jon Simmons, a plastic and reconstructive surgeon at ICHNT, led the team who carried out the procedures using the HoloLens headset and augmented reality models. The cases ranged from a 41-year-old man who had sustained leg injuries during a car accident, to an 85-year-old woman with a compound fractured ankle. The surgical teams reported the HoloLens to be a powerful tool in the theatre, with the approach being more reliable and less time-consuming than the ultrasound method of locating blood vessels.

“The application of AR technology in the operating theatre has some really exciting possibilities,” said Mr Simmons. “It could help to simplify and improve the accuracy of some elements of reconstructive procedures. While the technology can’t replace the skill and experience of the clinical team, it could potentially help to reduce the time a patient spends under anaesthetic and reduce the margin for error. We hope that it will allow us to provide more tailored surgical solutions for individual patients.”

The group highlights a few limitations with the technology, which could include errors during the modelling stages as well as the potential for the overlaid model to be misaligned. In addition, the case studies so far have been based on the leg, which has a number of clearly visible surgical ‘landmarks’, such as the ankle or knee. Areas without these rigid landmarks, such as abdomen, may be more complicated with a greater potential for movement of blood vessels.

However, the researchers are confident that, once refined, the approach could be applied to other areas of reconstructive surgery requiring tissue flaps, such as breast reconstruction following mastectomy. The next steps include trialling the technology in a larger set of patients, with procedures carried out by teams at multiple centres.

Dr Pratt added: “In future we hope to automate the process further. We can use software to improve the alignment and will attach markers to the patient when they have the scan, with the same markers present during the operation to use as additional points of reference. There are a number of areas we would like to explore, and further improvements are needed, but the small case series has shown that for reconstructive surgery, this seems to be a valuable tool in the operating theatre.”

Explore further:
Augmented reality technology may help guide plastic and reconstructive surgery

More information:
Philip Pratt et al, Through the HoloLens looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels, European Radiology Experimental (2018). DOI: 10.1186/s41747-017-0033-2

Provided by:
Imperial College London

Tagged with:

About author

Related Articles