Breaking News
February 22, 2019 - Researchers create new map of the brain’s own immune system
February 22, 2019 - ICHE’s reviews on surgical infections, unnecessary urine tests, and nurses’ role in antibiotic stewardship
February 22, 2019 - UK Research and Innovation invests £200 million to create new generation of AI leaders
February 22, 2019 - Takeda collaboration to boost fight against Alzheimer’s and other neurodegenerative diseases
February 22, 2019 - Heavy drinking may change DNA, leading to increased craving for alcohol
February 22, 2019 - U.S. opioid deaths jump fourfold in 20 years; epidemic shifts to Eastern states | News Center
February 22, 2019 - 5 Questions with William Turner on Diversity in Medicine
February 22, 2019 - HHS Finalizes Rule Seeking To Expel Planned Parenthood From Family Planning Program
February 22, 2019 - Researchers uncover biochemical pathway that may help identify drugs to treat Alzheimer’s
February 22, 2019 - Biologist uses new grant to find ways to eliminate schistosomiasis
February 22, 2019 - Bag-mask ventilation to help patients breathe during intubation prevents complications
February 22, 2019 - AbbVie Announces New Drug Application Accepted for Priority Review by FDA for Upadacitinib for Treatment of Moderate to Severe Rheumatoid Arthritis
February 22, 2019 - Nature versus nurture and addiction
February 22, 2019 - New website connects researchers with data experts, resources | News Center
February 22, 2019 - Today’s Concerns About Drug Prices Echo The Past
February 22, 2019 - CT and Doppler equipment have low accuracy in detecting cerebral vasospasm and ischemia
February 22, 2019 - Study finds out similarity in function between healthy retina cell and tumor cell
February 22, 2019 - CWRU awarded NIH grant to identify effective treatments for intimate partner violence
February 22, 2019 - Oncotype DX Not Cost-Effective for Low-Risk Breast Cancer
February 22, 2019 - Scientists discover new type of immune cells that are essential for forming heart valves
February 22, 2019 - Talk About Déjà Vu: Senators Set To Re-Enact Drug Price Hearing Of 60 Years Ago
February 22, 2019 - Genetic defect linked to pediatric liver disease identified
February 22, 2019 - New cellular atlas could provide a deeper insight into blinding diseases
February 22, 2019 - Growing number of cancer survivors, fewer providers point to challenge in meeting care needs
February 22, 2019 - Innovative compound offers a new therapeutic approach to treat multiple sclerosis
February 22, 2019 - $1.5 million grant to develop opioid treatment program for jail detainees
February 22, 2019 - FDA’s new proposed rule would update regulatory requirements for sunscreen products in the U.S
February 22, 2019 - Most Hip, Knee Replacements Last Decades, Study Finds
February 22, 2019 - Wellness problems prevalent among ob-gyn residents
February 22, 2019 - In the Spotlight: “The world is your oyster in geriatrics”
February 22, 2019 - Successful testing of multi-organ “human-on-a-chip” could replace animals as test subjects
February 22, 2019 - Analysis of cervical precancer shows decline in two strains of HPV
February 22, 2019 - Sugary stent eases suturing of blood vessels
February 22, 2019 - From surgery to psychiatry: A medical student reevaluates his motivations
February 22, 2019 - Is New App From Feds Your Answer To Navigating Medicare Coverage? Yes And No
February 22, 2019 - New pacemakers powered by heartbeats could reduce need for surgery
February 22, 2019 - The United States records highest drug overdose death rates
February 22, 2019 - Phase 1 data reinforce safety profile of new drug for treating Duchenne muscular dystrophy
February 22, 2019 - Vitamin D supplementation less effective in the presence of obesity, shows study
February 22, 2019 - Novostia raises CHF 6.5 million to advance its aortic, mitral heart valve to clinical trials
February 22, 2019 - CPRIT awards nearly $20 million to The University of Texas MD Anderson Cancer Center
February 22, 2019 - Sarepta Announces FDA Acceptance of Golodirsen (SRP-4053) New Drug Application for Patients with Duchenne Muscular Dystrophy Amenable to Skipping Exon 53
February 22, 2019 - An institutional effort to reduce the amount of opioids prescribed following lumbar surgery
February 22, 2019 - Family-history-based models perform better than non-family-history based models
February 22, 2019 - Failure to take statins leads to higher mortality rates | News Center
February 22, 2019 - New study explains why some patients report phantom sensations after limb amputation
February 22, 2019 - First motor-controlled heart valves implanted by Mainz University Medical Center
February 22, 2019 - Novel preclinical model mimics persistent interneuron loss seen in preterm infants
February 22, 2019 - Global health burden of glaucoma has increased, study reveals
February 22, 2019 - A holistic approach key to minimize treatment complexity in patients with interstitial lung disease
February 22, 2019 - 1 in 10 middle-aged Chinese adults are at high risk for heart disease, finds study
February 22, 2019 - More than half a million breast cancer patient’s lives saved by improvements in treatment
February 22, 2019 - Study finds no evidence that tougher policies prevent teenage cannabis use
February 22, 2019 - New blood test detects genetic disorders in fetuses
February 22, 2019 - Lower Self-Perception Observed in Children With Amblyopia
February 22, 2019 - Up to 15 percent of children have sleep apnea, yet 90 percent go undiagnosed
February 22, 2019 - Rare pulmonary defect prompts parents’ nationwide search for answers | News Center
February 22, 2019 - Lesbian and bisexual women at greater risk of being overweight, study finds
February 22, 2019 - UQ research may explain why vitamin D is essential for brain health
February 22, 2019 - Heart Attacks Rising Among Younger Women
February 22, 2019 - How your smartphone is affecting your relationship
February 22, 2019 - Orthopaedic surgeon receives prestigious award, $10 million grant | News Center
February 22, 2019 - New sepsis test could save thousands of lives
February 22, 2019 - Cervical cancer could be eradicated by 2100
February 21, 2019 - Sustained smoking cessation can lower risk of seropositive RA
February 21, 2019 - Thousands with chronic UTIs are not receiving the treatment they need
February 21, 2019 - Are teens getting high on social media? The surprising study seeking the pot-Instagram link
February 21, 2019 - Stanford expands biobank services | News Center
February 21, 2019 - Scientists identify link between drinking contexts and early onset intoxication among adolescents
February 21, 2019 - Strong social support may reduce cardiovascular disease risk in postmenopausal women
February 21, 2019 - Rapid expansion of interventions could prevent up to 13 million cases of cervical cancer within 50 years
February 21, 2019 - Motif Bio Receives Complete Response Letter From The FDA
February 21, 2019 - Researchers map previously unknown disease in children
February 21, 2019 - A skeptical look at popular diets: Going gluten-free
February 21, 2019 - Podcast: KHN’s ‘What The Health?’ How Safe Are Your Supplements?
February 21, 2019 - Factors associated with increased risk of developing surgical site infections
February 21, 2019 - Anticipatory signals in eye movements can help measure attentive capacity, learning with greater precision
February 21, 2019 - Study explores daily exposure to indoor air pollutants
February 21, 2019 - Evening exercise does not negatively affect sleep, may also reduce hunger
February 21, 2019 - Artificial intelligence technique can be used to identify alcohol misuse in trauma setting
How should an algorithm generate recommendations for patient care?

How should an algorithm generate recommendations for patient care?

image_pdfDownload PDFimage_print

Say you’re a doctor. You’d like guidance on how to treat a particular patient, and you have the opportunity to query a group of physicians about what they’d do next.

Who do you include in that group? All doctors who have seen similar patients? A smaller number of doctors who are considered the best?

These questions are at the root of recent Stanford research.

The study, published in the Journal of Biomedical Informatics, examines a key aspect of medical artificial intelligence: If machines are to provide advice for patient care, who should those machines be learning from?

Jonathan Chen, MD, PhD, tackled this question as the latest step in his quest to build OrderRex, a tool that will mine data from electronic health records to inform medical decisions. In a prototype, an algorithm that works like Amazon’s recommendation feature supplied information to doctors on how their peers managed similar patient cases — i.e., it tells users that other doctors in this situation ordered this medication or this test.

Now, Chen and his colleagues are working through logistics of how the computer decides what to recommend. Research assistant Jason K. Wang is the study’s lead author. Chen, the senior author, told me,

The distinguishing question was, if you had to learn medical practices, should you just try to get everybody’s data and learn from everybody? Or should you try to find the ‘good’ doctors? Then that evokes some really deep follow-up questions, such as, what is a preferred doctor or a good expert? What does that mean? How would we define that?

He asked multiple doctors a simplified version of these questions — if you had to grade each doctor by a number, how would you come by that number? — and tumbled into the usual thicket surrounding physician evaluations. Which outcomes should be considered? What if you see sicker patients? What about hospital readmission, length of stay, and patient satisfaction?

Ultimately, Chen and his colleagues settled on the measure of 30-day patient mortality rate: actual number of deaths compared to expected deaths, as reliably calculated by a computer using three years of electronic health record data.

“We tried a couple of things, but found they were correlated enough that it basically didn’t matter. The doctors who rose to the top of the list versus the bottom — it was a pretty stable list,” Chen said. “Plus, you can’t really game mortality: it’s the most patient-centered outcome there is.”

With “expert” doctors identified as those with low patient mortality rates, the researchers turned to defining “optimal” care to compare with recommendations that the algorithm would produce. They decided to try two different options. One was care that followed standards from clinical practice guidelines based on literature available through such venues as the National Guideline Clearinghouse. The second was care reflecting patterns that typically led to better-than-expected patient outcomes — calculated by the computer from data in the electronic patient records.

With this established, they tested the algorithm to see how its recommendations for care for a condition such as pneumonia compared to both standard clinical practice guidelines and to computer-generated above-average patient care. First, they fed the algorithm information from patients seen by expert doctors. Then, separately, the algorithm looked at patients seen by all doctors.

The result? Not much difference between recommendations derived from care in the expert group versus all of the doctors.

Essentially, Chen said, outlier behavior from specific doctors was neutralized. And without significant differences in the results, the findings argue for building machine-learning models around data from more physicians rather than a curated bunch. The logic is similar to calculating an average: with more numbers in the equation, each number carries less weight and the average is less influenced by individual numbers — including anomalies.

Chen summed it up:

As a human, it’s not feasible to interview thousands of people to help learn medical practice, so I’m going to seek out a few key mentors and experts. What large datasets and computational algorithms enable us to do is to essentially learn from ‘everybody,’ rather than being constrained to learn from a small number of “experts.”

With this question resolved, Chen and his colleagues have now built a prototype user interface incorporating the suggestion system, and they plan to bring in doctors to test it with simulated patient cases.

“The next big challenge to closing the loop on a learning health care system,” he said, “is… where we don’t just learn interesting things from clinical data, but we design, study, and evaluate how to deliver that information back to clinicians and patients.”

Photo by Markus Spiske

Tagged with:

About author

Related Articles