Breaking News
February 20, 2019 - Gene therapy restores hearing in mice with congenital genetic deafness
February 20, 2019 - First molecular test predicts treatment response for kidney cancer
February 20, 2019 - New method for improved visualization of single-cell RNA- sequencing data
February 20, 2019 - A possible blood test for detecting Alzheimer’s disease before symptoms show
February 20, 2019 - Primary care physicians associated with longevity, new research finds
February 19, 2019 - New study identifies many key lessons to establish sanctioned safe consumption sites
February 19, 2019 - Single CRISPR treatment can safely and stably correct genetic disease
February 19, 2019 - Multinational initiative to study familial primary distal renal tubular acidosis
February 19, 2019 - Breakthrough study highlights the promise of cell therapies for muscular dystrophy
February 19, 2019 - Subsymptom Threshold Exercise Speeds Concussion Recovery
February 19, 2019 - Midline venous catheters – infants: MedlinePlus Medical Encyclopedia
February 19, 2019 - Searching for side effects
February 19, 2019 - Humanity is all right, probably, although human extinction remains quite possible, researcher says
February 19, 2019 - Having Anesthesia Once as a Baby Does Not Cause Learning Disabilities, New Research Shows
February 19, 2019 - Anti-cancer immunotherapy could be used to fight HIV
February 19, 2019 - Customized Micropatterning for Improved Physiological Relevance
February 19, 2019 - Unique gene therapy approach paves new way to tackle rare, inherited diseases
February 19, 2019 - Activating gene that helps excite neurons reverses depression in male mice
February 19, 2019 - Science Puzzling Out Differences in Gut Bacteria Around the World
February 19, 2019 - Cells that destroy the intestine
February 19, 2019 - On recovery, vulnerability and ritual: An exhibit in white
February 19, 2019 - Scientific Duo Gets Back To Basics To Make Childbirth Safer
February 19, 2019 - COPD patients need more support when understanding new chest symptoms
February 19, 2019 - Using light-based method for production of pharmaceutical molecules
February 19, 2019 - Scientists find link between inflammation and cancer
February 19, 2019 - The High Cost Of Sex: Insurers Often Don’t Pay For Drugs To Treat Problems
February 19, 2019 - Hearing impairment associated with accelerated cognitive decline with age
February 19, 2019 - Researchers identify multiple genetic variants associated with body fat distribution
February 19, 2019 - Influenza and common cold are completely different diseases, study shows
February 19, 2019 - Scientists untangle how microbes manufacture key antibiotic compound
February 19, 2019 - Greater primary care physician supply associated with longer life spans
February 19, 2019 - HIV-1 protein suppresses immune response more broadly than thought
February 19, 2019 - Brain imaging indicates potential success of drug therapy in depressive patients
February 19, 2019 - For 2020 Dem Hopefuls, ‘Medicare-For-All’ Is A Defining Issue, However They Define It
February 19, 2019 - Specialized lung cells appear in the developing fetus much earlier than previously thought
February 19, 2019 - KU professor discusses promise of brain-computer interface to aid, restore communication
February 19, 2019 - Highly effective solution for detecting onset of aggregation in nanoparticles
February 19, 2019 - Early marker of cardiac damage triggered by cancer treatment identified
February 19, 2019 - Antidepressant drug could save people from deadly sepsis, research suggests
February 19, 2019 - CRISPR technology creates pluripotent stem cells that are ‘invisible’ to the immune system
February 19, 2019 - New study establishes how stress favors breast cancer growth and spread
February 19, 2019 - Midlife Systemic Inflammation Linked to Later Cognitive Decline
February 19, 2019 - Therapy derived from parasitic worms downregulates proinflammatory pathways
February 19, 2019 - Antimicrobial reusable coffee cups are less likely to become contaminated with bacteria, study shows
February 19, 2019 - Harnessing the evolutionary games played by cancer cells to advance therapies
February 19, 2019 - AHA News: Heart Transplant Survivor Gets Wedding Proposal at Finish Line
February 19, 2019 - HIV hidden in patients’ cells can now be accurately measured
February 19, 2019 - Research finds reasons for sudden cardiac death in patients with stable ischemic disease
February 19, 2019 - New protocol could help physicians to rule out bacterial infections in infants
February 19, 2019 - Women experiencing miscarriage should be offered treatment choices
February 19, 2019 - New protocol can help identify febrile infants at low risk for serious bacterial infections
February 19, 2019 - Innovative way to block HIV runs into a roadblock
February 19, 2019 - Springer Nature with BCRF conduct pilot project to make their research datasets more accessible
February 19, 2019 - Study finds neuromelanin-sensitive MRI as potential biomarker for psychosis
February 19, 2019 - Improvements in cardiovascular care for elderly save billions in health care costs
February 19, 2019 - Chilean food regulations are changing food perceptions and purchasing habits, study suggests
February 19, 2019 - Index endoscopy results are crucial for assessment of Barrett’s patients
February 18, 2019 - Breast cancer screening age should be lowered to 35
February 18, 2019 - Brain synchronization depends on the language of communication
February 18, 2019 - Drug Company Payments Over Time May Influence Rx Practices
February 18, 2019 - Despite socioeconomic gains, black-white ‘health gap’ remains
February 18, 2019 - Researchers report progress in the treatment of aggressive brain tumors
February 18, 2019 - Scientists discover trigger that turns strep infections into devastating disease
February 18, 2019 - Scanning children’s teeth may predict future mental health issues
February 18, 2019 - Health Highlights: Feb. 14, 2019
February 18, 2019 - New knowledge could help predict and prevent depression
February 18, 2019 - More primary care physicians leads to longer life spans | News Center
February 18, 2019 - Study examines link between supply of primary care physicians and life expectancy
February 18, 2019 - New study assesses screen time in young children
February 18, 2019 - Patented IU discovery to treat ARDS has been optioned to Theratome Bio
February 18, 2019 - Software found to be four times better at monitoring ovarian cancer
February 18, 2019 - Male Y chromosomes not ‘genetic wastelands’
February 18, 2019 - Hormone therapy during gender transition may increase risk for cardiovascular events
February 18, 2019 - NICE renews accreditation for Advanced
February 18, 2019 - FDA Grants Orphan Drug Designation to Amplyx Pharmaceuticals for APX001 for Treatment of Cryptococcosis
February 18, 2019 - Molecule effective in killing tuberculosis bacteria
February 18, 2019 - Columbia researchers unravel why some glioblastomas respond to immunotherapy
February 18, 2019 - Men who are able to do ten push-ups are less likely to have a stroke
February 18, 2019 - Blood-brain barrier disruption could lead to age-related cognitive decline
February 18, 2019 - Combination of PARP inhibitor and immunotherapy results in tumor regression in SCLC mouse models
Researchers find that sample size is key factor determining accuracy of study results

Researchers find that sample size is key factor determining accuracy of study results

image_pdfDownload PDFimage_print

The accuracy and reproducibility of research studies are a major concern of the scientific community. Researchers at Baylor College of Medicine have examined this problem in the field of multisensory integration to understand how it affects both basic research and the development of therapies. They determined that sample size (the number of individuals examined for a study) is the most important factor determining the accuracy of the study results. They report in the journal PLOS ONE that studies with sample sizes of 20 individuals overestimate true effects and that sample sizes of 100 or more individuals generally are necessary to reliably measure population differences or experimental effects.

“It started when we tried to reproduce our own work,” said first author Dr. John Magnotti, assistant professor of neurosurgery at Baylor. “We had conducted multisensory integration experiments about the McGurk effect using common sample sizes but when we tried to replicate our results, we were unable to do so. We were also unable to replicate other groups’ results.”

Multisensory integration studies allow scientists to better understand how integrating information captured by different senses helps us perceive the world around us. For example, in speech perception, integrating auditory information from the talker’s voice and visual information from the talker’s face enhances the accuracy of speech recognition.

But there are instances when the integration of auditory and visual information does not work as expected. The result is the perception of a sound that is different from what actually is being said. For example, the visual “ga” combined with the auditory “ba” results in the perception of “da.” (See link for examples.) This is called the McGurk effect.

Multisensory integration researchers have been studying whether the susceptibility to the McGurk effect varies between genders, typical and atypical human development and different cultural or linguistic backgrounds.

“Recent studies on the McGurk effect have shown large variability in their results; some studies report completely opposite results,” said senior author Dr. Michael Beauchamp, professor of neurosurgery and neuroscience, vice chair of neurosurgery basic research and director of the Core for Advanced MRI at Baylor. “There have been failures to replicate reported differences in the McGurk effect between different cultures, different genders and children with or without developmental disorders. So we started to suspect that maybe this was a bigger issue than just a couple of isolated studies.”

Size matters

“We tried to understand how the way we do our experiments could be causing these highly variable and conflicting results in the literature,” Magnotti said. “We took a large data set that we had collected for the McGurk effect and asked, what would the consequences be if we modeled group differences using a variety of sample sizes?

The researchers determined group differences in the McGurk effect in groups of 150 subjects, and also in groups of 20 or 40, and so on. Magnotti and Beauchamp discovered that when they used small sample sizes, the magnitude of the differences between groups can be greatly exaggerated.

“We showed that a true difference of 10 percent between populations, as determined with the largest group, would be vastly overestimated using smaller samples,” said Beauchamp. “In one case, the differences estimated for the McGurk effect between groups of 25 subjects were three times larger than those determined with the largest group. Also, the inflation of the results is most extreme when true population differences are small.”

“We were surprised that just the normal way people conduct their studies in multisensory integration could be problematic,” Magnotti said. “We concluded that reducing inflated results and increasing replicability requires increasing the number of participants compared with current practice. For our studies, a sample of 100 to 200 subjects is a good sample size to detect a difference for McGurk effect.”

These findings have relevant medical implications. If a study conducted with small groups of subjects – for instance comparing subjects with an autism spectrum disorder to individuals without the disorder – shows a large difference between the groups, then it would seem worth attempting to develop therapies to correct the difference. But, if the difference looks large only because of the way the study was designed using small samples, but in reality the difference is not significant, then trying to develop treatments to correct the difference would likely not benefit the patients.

“In this study, we contribute specific suggestions to improve accuracy and reproducibility in multisensory integration studies,” Beauchamp said. “We provide general guidelines about using good stimuli, releasing your data and collecting adequate sample sizes. We think that our findings would help researchers to do better studies. Our study supports 15 years of general scientific literature and research specific to multisensory integration that warns about inaccurate results produced by sample sizes that are too small.”

Tagged with:

About author

Related Articles