Breaking News
October 18, 2018 - Researchers to develop new stem cell-based strategies for treating vision disorders
October 18, 2018 - Detecting epigenetic signature may help people stay ahead of inflammatory bowel disease
October 18, 2018 - Understanding AFib: Slowing down the dancing heart
October 18, 2018 - Using NMR to Reduce Fraud
October 18, 2018 - New automated model identifies dense breast tissue in mammograms
October 18, 2018 - Mysterious polio-like illness baffles medical experts while frightening parents
October 18, 2018 - Cases of Acute Flaccid Myelitis on the rise across U.S.
October 18, 2018 - Dietary fiber reduces brain inflammation during aging
October 18, 2018 - New tool could help prioritize recovery efforts for the poorest hit by natural disasters
October 18, 2018 - Hundreds of dietary supplements shown to contain unapproved drugs
October 18, 2018 - Active Pharmaceuticals ID’d in >700 Dietary Supplements
October 18, 2018 - Cell death protein also damps inflammation
October 18, 2018 - Health Highlights: Oct. 15, 2018
October 18, 2018 - Largest study of ‘post-treatment controllers’ reveals clues about HIV remission
October 18, 2018 - Bad Blood in Silicon Valley: A conversation with John Carreyrou
October 18, 2018 - ANTRUK’s Annual Lecture sends out message on shortage of funds for antibiotic research
October 18, 2018 - NAM special publication outlines steps to ensure interoperability of health care systems
October 18, 2018 - Novel method uses just a drop of blood to monitor effect of lung cancer therapy
October 18, 2018 - New blood test could spare cancer patients from unnecessary chemotherapy
October 18, 2018 - Training young researchers to work with data volumes arising in the health sector
October 18, 2018 - New Metrohm IC method is reliable and convenient to use for zinc oxide assay
October 18, 2018 - Global AIDS, TB fight needs more money: health fund
October 18, 2018 - Understanding the forces that cause sports concussions
October 18, 2018 - Research points to new target for treating periodontitis
October 18, 2018 - New tool improves assessment of postpartum depression symptoms
October 18, 2018 - From Biopsy to Diagnosis
October 18, 2018 - Sexual harassment and assault linked to worse physical/mental health among midlife women
October 18, 2018 - Stumped by medical school? A Q&A with a learning specialist
October 18, 2018 - Self-lubricating condoms may help raise condom usage
October 18, 2018 - Targeting immune checkpoints in microglia could reduce out-of-control neuroinflammation
October 18, 2018 - Study finds changes in antiepileptic drug metabolism during different trimesters of pregnancy
October 18, 2018 - Autonomic nervous system directly controls stem cell proliferation, study shows
October 18, 2018 - FDA Approves Talzenna (talazoparib) for gBRCAm HER2-Negative Locally Advanced or Metastatic Breast Cancer
October 18, 2018 - Sleeping Beauty technique helps identify genes responsible for NAFLD-associated liver cancer
October 18, 2018 - Many U.S. adults confused about primary care, study shows
October 18, 2018 - UC researcher focuses on light-mediated therapies to target breast cancer
October 18, 2018 - With philanthropic gifts, Stanford poised to make major advances in neurosciences | News Center
October 18, 2018 - Mice study shows antibiotics are not always necessary to cure sepsis
October 18, 2018 - Researchers discover why heart contractions are weaker in individuals with HCM
October 18, 2018 - Participation in organized sport during childhood may have long-term skeletal benefits
October 18, 2018 - Probiotic/antibiotic combination could eradicate drug-resistant bacteria
October 17, 2018 - More Socioeconomic Challenges for Hispanic Women With HIV
October 17, 2018 - 49,XXXXY syndrome – Genetics Home Reference
October 17, 2018 - Scientists uncover possible new causes of Tourette syndrome
October 17, 2018 - Girl undergoes unusual heart surgery after compassionate-use exemption | News Center
October 17, 2018 - Health Issues That Are Sometimes Mistaken for Gluten Sensitivity
October 17, 2018 - Elective induction of labor at 39 weeks may be beneficial option for women and their babies
October 17, 2018 - New smart watch algorithms can accurately monitor wearers’ sleep patterns
October 17, 2018 - Researchers demonstrate epigenetic memory transmission via sperm
October 17, 2018 - FDA, DHS announce memorandum of agreement to address cybersecurity in medical devices
October 17, 2018 - Health Tip: Know the Risks of Chicken Pox
October 17, 2018 - Immunotherapy effective against hereditary melanoma
October 17, 2018 - Researchers reveal new mechanism for how animal cells stay intact | News Center
October 17, 2018 - Alzheimer's Goes Under the Cryo-Electron Microscope
October 17, 2018 - Medicare for all? CMS chief warns program has enough problems already
October 17, 2018 - Metrohm Raman introduces Mira P handheld Raman system
October 17, 2018 - Expanding the knowledge about hippocampus to better understand cognitive deficits in MS
October 17, 2018 - Study of Nigerian breast cancer patients reveals prevalence of aggressive molecular features
October 17, 2018 - Many healthy children may have metabolic risk factors, finds study
October 17, 2018 - A new antibiotic could be a better, faster treatment for tuberculosis
October 17, 2018 - “I will not become a Robot Doctor”: A medical student vows to practice compassion
October 17, 2018 - Study findings may explain sporadic outbreaks of C. difficile infections in hospitals
October 17, 2018 - Purdue researchers develop new chemical process to find better drug ‘fits’ for patients
October 17, 2018 - Yale researchers develop way to attack RNA with small-molecule drugs
October 17, 2018 - New pragmatic study launched to understand the effectiveness of new type 2 diabetes drug
October 17, 2018 - Alnylam Announces Plan to Initiate Rolling Submission of a New Drug Application and Pursue Full Approval for Givosiran
October 17, 2018 - Nine cases of polio-like illness suspected in children in illinois
October 17, 2018 - Eisai enters into agreement with Eurofarma for development and sales of lorcaserin in 17 countries
October 17, 2018 - Patients once thought incurable can benefit from high-dose radiation therapy
October 17, 2018 - Researchers awarded grant to advance testing of experimental heroin vaccine
October 17, 2018 - Researchers examine SSRI use during pregnancy and major gestational malformations
October 17, 2018 - FDA grants Rare Pediatric Disease Designation for Immusoft’s Iduronicrin genleukocel-T
October 17, 2018 - Reliable Respiratory announces acquisition of Attleboro Area Medical Equipment
October 17, 2018 - Study reveals link between childhood abuse and higher arthritis risk in adulthood
October 17, 2018 - Research shows people over 65 are not performing enough physical activity
October 17, 2018 - FDA Approves Liletta (levonorgestrel-releasing intrauterine system) 52 mg to Prevent Pregnancy for up to Five Years
October 17, 2018 - Weight gain after smoking cessation linked to increased short-term diabetes risk
October 17, 2018 - Researchers find opportunity to control salt-sensitive hypertension without exercising
October 17, 2018 - Women not warned about cancer associated with breast implants
October 17, 2018 - Metrohm offers robust handheld Raman analyzer for Defense and Security
How should an algorithm generate recommendations for patient care?

How should an algorithm generate recommendations for patient care?

image_pdfDownload PDFimage_print

Say you’re a doctor. You’d like guidance on how to treat a particular patient, and you have the opportunity to query a group of physicians about what they’d do next.

Who do you include in that group? All doctors who have seen similar patients? A smaller number of doctors who are considered the best?

These questions are at the root of recent Stanford research.

The study, published in the Journal of Biomedical Informatics, examines a key aspect of medical artificial intelligence: If machines are to provide advice for patient care, who should those machines be learning from?

Jonathan Chen, MD, PhD, tackled this question as the latest step in his quest to build OrderRex, a tool that will mine data from electronic health records to inform medical decisions. In a prototype, an algorithm that works like Amazon’s recommendation feature supplied information to doctors on how their peers managed similar patient cases — i.e., it tells users that other doctors in this situation ordered this medication or this test.

Now, Chen and his colleagues are working through logistics of how the computer decides what to recommend. Research assistant Jason K. Wang is the study’s lead author. Chen, the senior author, told me,

The distinguishing question was, if you had to learn medical practices, should you just try to get everybody’s data and learn from everybody? Or should you try to find the ‘good’ doctors? Then that evokes some really deep follow-up questions, such as, what is a preferred doctor or a good expert? What does that mean? How would we define that?

He asked multiple doctors a simplified version of these questions — if you had to grade each doctor by a number, how would you come by that number? — and tumbled into the usual thicket surrounding physician evaluations. Which outcomes should be considered? What if you see sicker patients? What about hospital readmission, length of stay, and patient satisfaction?

Ultimately, Chen and his colleagues settled on the measure of 30-day patient mortality rate: actual number of deaths compared to expected deaths, as reliably calculated by a computer using three years of electronic health record data.

“We tried a couple of things, but found they were correlated enough that it basically didn’t matter. The doctors who rose to the top of the list versus the bottom — it was a pretty stable list,” Chen said. “Plus, you can’t really game mortality: it’s the most patient-centered outcome there is.”

With “expert” doctors identified as those with low patient mortality rates, the researchers turned to defining “optimal” care to compare with recommendations that the algorithm would produce. They decided to try two different options. One was care that followed standards from clinical practice guidelines based on literature available through such venues as the National Guideline Clearinghouse. The second was care reflecting patterns that typically led to better-than-expected patient outcomes — calculated by the computer from data in the electronic patient records.

With this established, they tested the algorithm to see how its recommendations for care for a condition such as pneumonia compared to both standard clinical practice guidelines and to computer-generated above-average patient care. First, they fed the algorithm information from patients seen by expert doctors. Then, separately, the algorithm looked at patients seen by all doctors.

The result? Not much difference between recommendations derived from care in the expert group versus all of the doctors.

Essentially, Chen said, outlier behavior from specific doctors was neutralized. And without significant differences in the results, the findings argue for building machine-learning models around data from more physicians rather than a curated bunch. The logic is similar to calculating an average: with more numbers in the equation, each number carries less weight and the average is less influenced by individual numbers — including anomalies.

Chen summed it up:

As a human, it’s not feasible to interview thousands of people to help learn medical practice, so I’m going to seek out a few key mentors and experts. What large datasets and computational algorithms enable us to do is to essentially learn from ‘everybody,’ rather than being constrained to learn from a small number of “experts.”

With this question resolved, Chen and his colleagues have now built a prototype user interface incorporating the suggestion system, and they plan to bring in doctors to test it with simulated patient cases.

“The next big challenge to closing the loop on a learning health care system,” he said, “is… where we don’t just learn interesting things from clinical data, but we design, study, and evaluate how to deliver that information back to clinicians and patients.”

Photo by Markus Spiske

Tagged with:

About author

Related Articles