Breaking News
March 23, 2019 - Trigger warnings have minimal impact on how people respond to content, shows research
March 23, 2019 - Gilead Announces Data From Two Studies Supporting Further Development of GS-6207, a Novel, Investigational HIV-1 Capsid Inhibitor as a Component of Future Long-Acting HIV Therapies
March 23, 2019 - Selfish genetic elements amplify inflammation and age-related diseases
March 23, 2019 - Study provides new understanding of how the brain recovers from damage caused by stroke
March 23, 2019 - CRISPR/Cas libraries could revolutionize drug discovery
March 23, 2019 - Allergic reaction during pregnancy may alter sexual-development in offspring’s brain
March 23, 2019 - Seeing through a robot’s eyes helps those with profound motor impairments
March 23, 2019 - Recent research shows that ease of breastfeeding after C-section differs culturally
March 23, 2019 - Newly discovered parameters offer more control over efficient release of drugs
March 23, 2019 - ‘De-tabooing’ of abortion- Women would like more support from health care community
March 23, 2019 - Anti-TB drugs can increase susceptibility to Mtb reinfection
March 23, 2019 - New survey indicates need of attention to neglected tropical diseases
March 23, 2019 - Innovative in vitro method to develop easy-to-swallow medicine for children and older people
March 23, 2019 - Sugary drinks could raise risk of early deaths finds study
March 23, 2019 - Lian wins ENGINE grant for stem-cell-based therapy to treat Type 1 diabetes
March 23, 2019 - Overall, Physicians Are Happy and Enjoy Their Lives
March 23, 2019 - Researchers discover how blood vessels protect the brain during inflammation
March 23, 2019 - CDC study shows modest improvement in optimal hospital breastfeeding policy
March 23, 2019 - Family-based prevention program to reduce alcohol use among older teens
March 23, 2019 - Remote monitoring of implanted defibrillators in heart failure patients prevents hospitalizations
March 23, 2019 - Appropriate doffing of personal protective equipment may reduce healthcare worker contamination
March 23, 2019 - Window screens can suppress mosquito populations, reduce malaria in Tanzania
March 23, 2019 - Researchers discover new biomarker for postoperative liver dysfunction
March 23, 2019 - Pregnancy history may be linked to cognitive function in older women, finds study
March 23, 2019 - Study shows ticagrelor is equally safe and effective as clopidogrel after heart attack
March 23, 2019 - FDA Approves First Drug for Postpartum Depression, Zulresso (brexanolone)
March 23, 2019 - New guidelines outline new treatment management for psoriasis
March 23, 2019 - Thermally abused cooking oil may promote progression of breast cancer
March 23, 2019 - High-fructose corn syrup fuels growth of colon tumors in mice
March 23, 2019 - Partnership aims at establishing best practices to promote diversity in clinical trials
March 23, 2019 - New study examines presence of microbes in tap water from residences, office buildings
March 23, 2019 - Early life trauma may affect brain structure, contribute to major depressive disorder
March 23, 2019 - NIH starts clinical trial of drug to treat cravings associated with opioid use disorder
March 23, 2019 - Cervix bacteria, immune factors could be a warning signal of premature birth, reports new research
March 23, 2019 - Worst-ever emergency care performance figures underscore the need to focus on staffing
March 23, 2019 - The Current issue of “The view from here” is concerned with Cancer
March 23, 2019 - Mouse model validates how ‘good’ and ‘bad’ bacteria affect acne
March 23, 2019 - Individual amygdala neurons respond to touch, imagery and sounds
March 23, 2019 - Combination of two topical creams can prevent cancer
March 23, 2019 - Study suggests depression screening when assessing African-Americans for schizophrenia
March 23, 2019 - New electronic support system for choosing drug treatment based on patient’s genotype
March 23, 2019 - First-of-its-kind study provides pregnancy statistics of imprisoned U.S. women
March 23, 2019 - Marinus Pharmaceuticals Initiates Phase 3 Study in Children with PCDH19-Related Epilepsy
March 23, 2019 - Laparoscopy: MedlinePlus Lab Test Information
March 23, 2019 - Shellfish allergies: can they be treated?
March 23, 2019 - Toilet seat heart monitoring system
March 23, 2019 - Researchers identify way to improve common treatment for PTSD
March 23, 2019 - High potency cannabis use linked to psychosis finds study
March 23, 2019 - Evoke Pharma Submits Response to FDA Review Letter for Gimoti NDA
March 23, 2019 - Tracking HIV’s ever-evolving genome in effort to prioritize public health resources
March 23, 2019 - Scientists grow most sophisticated brain organoid to date
March 23, 2019 - ADHD drug raising risk of psychosis
March 22, 2019 - FDA approves brexanolone, first drug developed to treat postpartum depression
March 22, 2019 - Gruesome cat and dog experiments by the USDA exposed
March 22, 2019 - Ball pits used in children’s physical therapy may contribute to germ transmission
March 22, 2019 - Long-term use of inexpensive weight-loss drug may be safe and effective
March 22, 2019 - FDA Approves Sunosi (solriamfetol) for Excessive Daytime Sleepiness Associated with Narcolepsy or Obstructive Sleep Apnea
March 22, 2019 - Anti-Müllerian Hormone Test: MedlinePlus Lab Test Information
March 22, 2019 - Finding the right exercise, diet aids for HIV patients
March 22, 2019 - Health Plans For State Employees Use Medicare’s Hammer On Hospital Bills
March 22, 2019 - Researchers develop new tool for imaging large groups of neurons in living animals
March 22, 2019 - Certain bacteria and immune factors in vagina may cause or protect against preterm birth
March 22, 2019 - Research identifies guidelines for prioritizing hepatitis C treatment in U.S. prisons
March 22, 2019 - Novel breath test could pave new way to non-invasively measure gut health
March 22, 2019 - Pharmaceutical and personal care products may result in new contaminants in waterways
March 22, 2019 - New model could revolutionize the way researchers investigate spread of pathogens
March 22, 2019 - MSU professor receives NSF CAREER grant for biosensor diagnostics
March 22, 2019 - High-fat, high-sugar diet in mouse mothers causes problems in the hearts of offspring
March 22, 2019 - ACC: Catheter Ablation Does Not Cut Mortality, Stroke in A-Fib
March 22, 2019 - Wiedemann-Rautenstrauch syndrome – Genetics Home Reference
March 22, 2019 - Health insurance is not assurance of healthcare
March 22, 2019 - Supporting “curiosity-driven research” at the Discovery Innovation Awards
March 22, 2019 - Must-Reads Of The Week (Some Flying Below The Radar)
March 22, 2019 - Newly engineered nanoscale protein micelles can be tracked by MRI
March 22, 2019 - New model more effective in predicting risk of opioid overdose than traditional models
March 22, 2019 - Mayo Clinic study identifies potential new drug therapy for liver diseases
March 22, 2019 - Pitt engineers win $550,000 NSF CAREER award to develop new intervention for people with ASD
March 22, 2019 - Early discharge does not increase readmission risk for patients after lung surgery
March 22, 2019 - Creating diverse pool of trained scientists to address Alzheimer’s research needs
March 22, 2019 - Surprising discovery offers clues to limit graft-vs.-host disease
AI in medical space must be carefully tested for performance across wide range of populations

AI in medical space must be carefully tested for performance across wide range of populations

image_pdfDownload PDFimage_print

Artificial intelligence (AI) tools trained to detect pneumonia on chest X-rays suffered significant decreases in performance when tested on data from outside health systems, according to a study conducted at the Icahn School of Medicine at Mount and published in a special issue of PLOS Medicine on machine learning and health care. These findings suggest that artificial intelligence in the medical space must be carefully tested for performance across a wide range of populations; otherwise, the deep learning models may not perform as accurately as expected.

As interest in the use of computer system frameworks called convolutional neural networks (CNN) to analyze medical imaging and provide a computer-aided diagnosis grows, recent studies have suggested that AI image classification may not generalize to new data as well as commonly portrayed.

Researchers at the Icahn School of Medicine at Mount Sinai assessed how AI models identified pneumonia in 158,000 chest X-rays across three medical institutions: the National Institutes of Health; The Mount Sinai Hospital; and Indiana University Hospital. Researchers chose to study the diagnosis of pneumonia on chest X-rays for its common occurrence, clinical significance, and prevalence in the research community.

In three out of five comparisons, CNNs’ performance in diagnosing diseases on X-rays from hospitals outside of its own network was significantly lower than on X-rays from the original health system. However, CNNs were able to detect the hospital system where an X-ray was acquired with a high-degree of accuracy, and cheated at their predictive task based on the prevalence of pneumonia at the training institution. Researchers found that the difficulty of using deep learning models in medicine is that they use a massive number of parameters, making it challenging to identify specific variables driving predictions, such as the types of CT scanners used at a hospital and the resolution quality of imaging.

“Our findings should give pause to those considering rapid deployment of artificial intelligence platforms without rigorously assessing their performance in real-world clinical settings reflective of where they are being deployed,” says senior author Eric Oermann, MD, Instructor in Neurosurgery at the Icahn School of Medicine at Mount Sinai. “Deep learning models trained to perform medical diagnosis can generalize well, but this cannot be taken for granted since patient populations and imaging techniques differ significantly across institutions.”

“If CNN systems are to be used for medical diagnosis, they must be tailored to carefully consider clinical questions, tested for a variety of real-world scenarios, and carefully assessed to determine how they impact accurate diagnosis,” says first author John Zech, a medical student at the Icahn School of Medicine at Mount Sinai.

This research builds on papers published earlier this year in the journals Radiology and Nature Medicine, which laid the framework for applying computer vision and deep learning techniques, including natural language processing algorithms, for identifying clinical concepts in radiology reports for CT scans.

Source:

https://www.mountsinai.org/

Tagged with:

About author

Related Articles