Breaking News
December 15, 2018 - 2017 Saw Slowing in National Health Care Spending
December 15, 2018 - Monitoring movement reflects efficacy of mandibular splint
December 15, 2018 - Study supports BMI as useful tool for assessing obesity and health
December 15, 2018 - Self-guided, internet-based therapy platforms effectively reduce depression
December 15, 2018 - Organically farmed food has bigger climate impact than conventional food production
December 15, 2018 - Faster, cheaper test has potential to enhance prostate cancer evaluation
December 15, 2018 - Researchers study abnormal blood glucose levels of patients after hospital discharge
December 15, 2018 - Swedish scientists explore direct association of dementia and ischemic stroke deaths
December 15, 2018 - Study finds 117% increase in number of dementia sufferers in 26 years
December 15, 2018 - Eczema Can Drive People to Thoughts of Suicide: Study
December 15, 2018 - Link between neonatal vitamin D deficiency and schizophrenia confirmed
December 15, 2018 - Nurse denied life insurance because she carries naloxone
December 15, 2018 - Ritalin drug affects organization of pathways that build brain networks used in attention, learning
December 15, 2018 - Research pinpoints two proteins involved in creation of stem cells
December 15, 2018 - Gut bacteria may modify effectiveness of anti-diabetes drugs
December 15, 2018 - Using machine learning to predict risk of developing life-threatening infections
December 15, 2018 - How imaginary friends could boost children’s development
December 15, 2018 - Folate deficiency creates more damaging chromosomal abnormalities than previously known
December 15, 2018 - Study provides new insights into molecular mechanisms underlying role of amyloid in Alzheimer’s disease
December 15, 2018 - For the asking, a check is in the mail to help pay for costly drugs
December 15, 2018 - UA scientists uncover biological processes leading to rare brain disorder in babies
December 15, 2018 - The largest database on industrial poisons
December 15, 2018 - ESMO Immuno-Oncology Congress showcases novel technologies set to benefit many cancer patients
December 15, 2018 - Ovid Therapeutics Announces Plans to Move into a Phase 3 Trial in Pediatric Patients Based on End-of-Phase 2 Meeting for OV101 in Angelman Syndrome
December 15, 2018 - Left ventricular noncompaction – Genetics Home Reference
December 15, 2018 - Children’s sleep not significantly affected by screen time, new study finds
December 15, 2018 - When should dementia patients stop driving? A new guidance for clinicians
December 15, 2018 - Researchers use INTEGRA’s VIAFLO 96/384 to streamline the experimental workflow
December 15, 2018 - Researchers discover protein involved in nematode stress response
December 15, 2018 - Cancer patients have greater risk of developing shingles, study shows
December 14, 2018 - UAlberta scientists identify biomarkers for detecting Alzheimer’s disease in saliva samples
December 14, 2018 - Study uncovers link between tube travel and spread of flu-like illnesses
December 14, 2018 - Caffeine plus another compound in coffee may fight Parkinson’s disease
December 14, 2018 - GW researchers review studies on treatments for prurigo nodularis
December 14, 2018 - Lack of peds preventive care ups unplanned hospital admissions
December 14, 2018 - Miscarriage: When Language Deepens Pain
December 14, 2018 - New method helps better understand pathological development of ALS
December 14, 2018 - Intellectually active lifestyle confers protection against neurodegeneration in Huntington’s patients
December 14, 2018 - Mammalian collagen nanofibrils become stronger and tougher with exercise
December 14, 2018 - Considerable Morbidity, Mortality Due to Animal Encounters
December 14, 2018 - Researchers find inhibiting one protein destroys toxic clumps seen in Parkinson’s disease
December 14, 2018 - How early physical therapy can lessen the long-term need for opioids
December 14, 2018 - Depression, suicide rates highest in Mountain West states
December 14, 2018 - New model could cure the potential to underestimate how quickly diseases spread
December 14, 2018 - Exercise-induced hormone activates cells critical for bone remodeling in mice
December 14, 2018 - Researchers discover new mechanism behind spread of malignant pleural mesothelioma
December 14, 2018 - Health Tip: Celebrate a Healthier Holiday
December 14, 2018 - Scalpel-free surgery enhances quality of life for Parkinson’s patients, study finds
December 14, 2018 - Early physical therapy can reduce risk, amount of long-term opioid use | News Center
December 14, 2018 - Genetic marker, predictor of early relapse in common childhood cancer discovered
December 14, 2018 - Study could lead to a potential new way of treating sepsis
December 14, 2018 - New protein complex helps embryonic stem cells to maintain their indefinite potential
December 14, 2018 - Salk professor receives $1.8 million from NOMIS Foundation for research on mechanisms to promote health
December 14, 2018 - New discovery will improve the safety and predictability of CRISPR
December 14, 2018 - Geneticists discover how sex-linked disorders arise
December 14, 2018 - New method to visualize small-molecule interactions inside cells
December 14, 2018 - Study describes mechanism that makes people more vulnerable to hunger-causing stimuli
December 14, 2018 - Chronic opioid therapy associated with increased healthcare spending and hospital stays
December 14, 2018 - Blood Types
December 14, 2018 - Obesity linked to increased risk of early-onset colorectal cancer
December 14, 2018 - Blood test helps identify distinct molecular signatures in children with cystic fibrosis
December 14, 2018 - In California, doctors accused of sexual misconduct often get second chances
December 14, 2018 - Scientists use water to track electrical activity of nerve cells
December 14, 2018 - Recurrence of urinary tract infection may depend on bacterial strain, study shows
December 14, 2018 - GBT Announces U.S. FDA Agrees with its Proposal Relating to Accelerated Approval Pathway for Voxelotor for the Treatment of Sickle Cell Disease and GBT Plans to Submit New Drug Application (NDA)
December 14, 2018 - Partial Thromboplastin Time (PTT) Test: MedlinePlus Lab Test Information
December 14, 2018 - Common tactics for health promotion at work may be detrimental to employees with obesity
December 14, 2018 - Myths about migration and health not supported by available evidence
December 14, 2018 - Recent findings on rare genetic disorder may help develop new treatment options
December 14, 2018 - New drug shows promise in treating sarcomas
December 14, 2018 - Scientists perform lung lavage as new approach for tuberculosis diagnosis in rhinoceros
December 14, 2018 - Answering the Biggest Neurological Research Questions of Today
December 14, 2018 - Recent winners of the Nobel Medicine Prize
December 14, 2018 - KHN’s ‘What the Health?’ Insurance enrollment is lagging — and there are lots of reasons why
December 14, 2018 - Study assesses safety and efficacy of new treatment for pancreatic cancer
December 14, 2018 - Weakened metabolism of immune T cells may account for serious complications in elderly
December 14, 2018 - Study finds drug targets for Ebola, Dengue, and Zika viruses
December 14, 2018 - Face masks may offer protection against staph bacteria for hog farm workers and their household members
December 14, 2018 - Shining new light on neuron firing
December 14, 2018 - Study highlights need for personalized approach to treat ICU acquired delirium
Researchers find that sample size is key factor determining accuracy of study results

Researchers find that sample size is key factor determining accuracy of study results

image_pdfDownload PDFimage_print

The accuracy and reproducibility of research studies are a major concern of the scientific community. Researchers at Baylor College of Medicine have examined this problem in the field of multisensory integration to understand how it affects both basic research and the development of therapies. They determined that sample size (the number of individuals examined for a study) is the most important factor determining the accuracy of the study results. They report in the journal PLOS ONE that studies with sample sizes of 20 individuals overestimate true effects and that sample sizes of 100 or more individuals generally are necessary to reliably measure population differences or experimental effects.

“It started when we tried to reproduce our own work,” said first author Dr. John Magnotti, assistant professor of neurosurgery at Baylor. “We had conducted multisensory integration experiments about the McGurk effect using common sample sizes but when we tried to replicate our results, we were unable to do so. We were also unable to replicate other groups’ results.”

Multisensory integration studies allow scientists to better understand how integrating information captured by different senses helps us perceive the world around us. For example, in speech perception, integrating auditory information from the talker’s voice and visual information from the talker’s face enhances the accuracy of speech recognition.

But there are instances when the integration of auditory and visual information does not work as expected. The result is the perception of a sound that is different from what actually is being said. For example, the visual “ga” combined with the auditory “ba” results in the perception of “da.” (See link for examples.) This is called the McGurk effect.

Multisensory integration researchers have been studying whether the susceptibility to the McGurk effect varies between genders, typical and atypical human development and different cultural or linguistic backgrounds.

“Recent studies on the McGurk effect have shown large variability in their results; some studies report completely opposite results,” said senior author Dr. Michael Beauchamp, professor of neurosurgery and neuroscience, vice chair of neurosurgery basic research and director of the Core for Advanced MRI at Baylor. “There have been failures to replicate reported differences in the McGurk effect between different cultures, different genders and children with or without developmental disorders. So we started to suspect that maybe this was a bigger issue than just a couple of isolated studies.”

Size matters

“We tried to understand how the way we do our experiments could be causing these highly variable and conflicting results in the literature,” Magnotti said. “We took a large data set that we had collected for the McGurk effect and asked, what would the consequences be if we modeled group differences using a variety of sample sizes?

The researchers determined group differences in the McGurk effect in groups of 150 subjects, and also in groups of 20 or 40, and so on. Magnotti and Beauchamp discovered that when they used small sample sizes, the magnitude of the differences between groups can be greatly exaggerated.

“We showed that a true difference of 10 percent between populations, as determined with the largest group, would be vastly overestimated using smaller samples,” said Beauchamp. “In one case, the differences estimated for the McGurk effect between groups of 25 subjects were three times larger than those determined with the largest group. Also, the inflation of the results is most extreme when true population differences are small.”

“We were surprised that just the normal way people conduct their studies in multisensory integration could be problematic,” Magnotti said. “We concluded that reducing inflated results and increasing replicability requires increasing the number of participants compared with current practice. For our studies, a sample of 100 to 200 subjects is a good sample size to detect a difference for McGurk effect.”

These findings have relevant medical implications. If a study conducted with small groups of subjects – for instance comparing subjects with an autism spectrum disorder to individuals without the disorder – shows a large difference between the groups, then it would seem worth attempting to develop therapies to correct the difference. But, if the difference looks large only because of the way the study was designed using small samples, but in reality the difference is not significant, then trying to develop treatments to correct the difference would likely not benefit the patients.

“In this study, we contribute specific suggestions to improve accuracy and reproducibility in multisensory integration studies,” Beauchamp said. “We provide general guidelines about using good stimuli, releasing your data and collecting adequate sample sizes. We think that our findings would help researchers to do better studies. Our study supports 15 years of general scientific literature and research specific to multisensory integration that warns about inaccurate results produced by sample sizes that are too small.”

Tagged with:

About author

Related Articles