Breaking News
May 3, 2019 - Vaping and Smoking May Signal Greater Motivation to Quit
May 3, 2019 - Dementia looks different in brains of Hispanics
May 3, 2019 - Short-Staffed Nursing Homes See Drop In Medicare Ratings
May 3, 2019 - Study of teens with eating disorders explores how substance users differ from non-substance users
May 3, 2019 - Scientists develop new video game that may help in the study of Alzheimer’s
May 3, 2019 - Arc Bio introduces Galileo Pathogen Solution product line at ASM Clinical Virology Symposium
May 3, 2019 - Cornell University study uncovers relationship between starch digestion gene and gut bacteria
May 3, 2019 - How to Safely Use Glucose Meters and Test Strips for Diabetes
May 3, 2019 - Anti-inflammatory drugs ineffective for prevention of Alzheimer’s disease
May 3, 2019 - Study tracks Pennsylvania’s oil and gas waste-disposal practices
May 3, 2019 - Creating a better radiation diagnostic test for astronauts
May 3, 2019 - Vegans are often deficient in these four nutrients
May 3, 2019 - PPDC announces seed grants to develop medical devices for children
May 3, 2019 - Study maps out the frequency and impact of water polo head injuries
May 3, 2019 - Research on Reddit identifies risks associated with unproven treatments for opioid addiction
May 3, 2019 - Good smells may help ease tobacco cravings
May 3, 2019 - Medical financial hardship found to be very common among people in the United States
May 3, 2019 - Researchers develop multimodal system for personalized post-stroke rehabilitation
May 3, 2019 - Study shows significant mortality benefit with CABG over percutaneous coronary intervention
May 3, 2019 - Will gene-editing of human embryos ever be justifiable?
May 3, 2019 - FDA Approves Dengvaxia (dengue vaccine) for the Prevention of Dengue Disease in Endemic Regions
May 3, 2019 - Why Tonsillitis Keeps Coming Back
May 3, 2019 - Fighting the opioid epidemic with data
May 3, 2019 - Maggot sausages may soon be a reality
May 3, 2019 - Deletion of ATDC gene prevents development of pancreatic cancer in mice
May 2, 2019 - Targeted Therapy Promising for Rare Hematologic Cancer
May 2, 2019 - Alzheimer’s disease is a ‘double-prion disorder,’ study shows
May 2, 2019 - Reservoir bugs: How one bacterial menace makes its home in the human stomach
May 2, 2019 - Clinical, Admin Staff From Cardiology Get Sneak Peek at Epic
May 2, 2019 - Depression increases hospital use and mortality in children
May 2, 2019 - Vicon and NOC support CURE International to create first gait lab in Ethiopia
May 2, 2019 - Researchers use 3D printer to make paper organs
May 2, 2019 - Viral infection in utero associated with behavioral abnormalities in offspring
May 2, 2019 - U.S. Teen Opioid Deaths Soaring
May 2, 2019 - Opioid distribution data should be public
May 2, 2019 - In the Spotlight: “I’m learning every single day”
May 2, 2019 - 2019 Schaefer Scholars Announced
May 2, 2019 - Podcast: KHN’s ‘What The Health?’ Bye-Bye, ACA, And Hello ‘Medicare-For-All’?
May 2, 2019 - Study describes new viral molecular evasion mechanism used by cytomegalovirus
May 2, 2019 - SLU study suggests a more equitable way for Medicare reimbursement
May 2, 2019 - Scientists discover first gene involved in lower urinary tract obstruction
May 2, 2019 - Researchers identify 34 genes associated with increased risk of ovarian cancer
May 2, 2019 - Many low-income infants receive formula in the first few days of life, finds study
May 2, 2019 - Global study finds high success rate for hip and knee replacements
May 2, 2019 - Taking depression seriously: What is it?
May 2, 2019 - With Head Injuries Mounting, Will Cities Put Their Feet Down On E-Scooters?
May 2, 2019 - Scientists develop small fluorophores for tracking metabolites in living cells
May 2, 2019 - Study casts new light into how mothers’ and babies’ genes influence birth weight
May 2, 2019 - Researchers uncover new brain mechanisms regulating body weight
May 2, 2019 - Organ-on-chip systems offered to Asia-Pacific regions by Sydney’s AXT
May 2, 2019 - Adoption of new rules drops readmission penalties against safety net hospitals
May 2, 2019 - Kids and teens who consume zero-calorie sweetened beverages do not save calories
May 2, 2019 - Improved procedure for cancer-related erectile dysfunction
May 2, 2019 - Hormone may improve social behavior in autism
May 2, 2019 - Alzheimer’s disease may be caused by infectious proteins called prions
May 2, 2019 - Even Doctors Can’t Navigate Our ‘Broken Health Care System’
May 2, 2019 - Study looks at the impact on criminal persistence of head injuries
May 2, 2019 - Honey ‘as high in sugars as table sugar’
May 2, 2019 - Innovations to U.S. food system could help consumers in choosing healthy foods
May 2, 2019 - FDA Approves Mavyret (glecaprevir and pibrentasvir) as First Treatment for All Genotypes of Hepatitis C in Pediatric Patients
May 2, 2019 - Women underreport prevalence and intensity of their own snoring
May 2, 2019 - Concussion summit focuses on science behind brain injury
May 2, 2019 - Booker’s Argument For Environmental Justice Stays Within The Lines
May 2, 2019 - Cornell research explains increased metastatic cancer risk in diabetics
May 2, 2019 - Mount Sinai study provides fresh insights into cellular pathways that cause cancer
May 2, 2019 - Researchers to study link between prenatal pesticide exposures and childhood ADHD
May 2, 2019 - CoGEN Congress 2019: Speakers’ overviews
May 2, 2019 - A new strategy for managing diabetic macular edema in people with good vision
May 2, 2019 - Sagent Pharmaceuticals Issues Voluntary Nationwide Recall of Ketorolac Tromethamine Injection, USP, 60mg/2mL (30mg per mL) Due to Lack of Sterility Assurance
May 2, 2019 - Screen time associated with behavioral problems in preschoolers
May 2, 2019 - Hormone reduces social impairment in kids with autism | News Center
May 2, 2019 - Researchers synthesize peroxidase-mimicking nanozyme with low cost and superior catalytic activity
May 2, 2019 - Study results of a potential drug to treat Type 2 diabetes in children announced
May 2, 2019 - Multigene test helps doctors to make effective treatment decisions for breast cancer patients
May 2, 2019 - UNC School of Medicine initiative providing unique care to dementia patients
May 2, 2019 - Nestlé Health Science and VHP join forces to launch innovative COPES program for cancer patients
May 2, 2019 - Study examines how our brain generates consciousness and loses it during anesthesia
May 2, 2019 - Transition Support Program May Aid Young Adults With Type 1 Diabetes
May 2, 2019 - Study shows how neutrophils exacerbate atherosclerosis by inducing smooth muscle-cell death
May 2, 2019 - Research reveals complexity of how we make decisions
Researchers find that sample size is key factor determining accuracy of study results

Researchers find that sample size is key factor determining accuracy of study results

The accuracy and reproducibility of research studies are a major concern of the scientific community. Researchers at Baylor College of Medicine have examined this problem in the field of multisensory integration to understand how it affects both basic research and the development of therapies. They determined that sample size (the number of individuals examined for a study) is the most important factor determining the accuracy of the study results. They report in the journal PLOS ONE that studies with sample sizes of 20 individuals overestimate true effects and that sample sizes of 100 or more individuals generally are necessary to reliably measure population differences or experimental effects.

“It started when we tried to reproduce our own work,” said first author Dr. John Magnotti, assistant professor of neurosurgery at Baylor. “We had conducted multisensory integration experiments about the McGurk effect using common sample sizes but when we tried to replicate our results, we were unable to do so. We were also unable to replicate other groups’ results.”

Multisensory integration studies allow scientists to better understand how integrating information captured by different senses helps us perceive the world around us. For example, in speech perception, integrating auditory information from the talker’s voice and visual information from the talker’s face enhances the accuracy of speech recognition.

But there are instances when the integration of auditory and visual information does not work as expected. The result is the perception of a sound that is different from what actually is being said. For example, the visual “ga” combined with the auditory “ba” results in the perception of “da.” (See link for examples.) This is called the McGurk effect.

Multisensory integration researchers have been studying whether the susceptibility to the McGurk effect varies between genders, typical and atypical human development and different cultural or linguistic backgrounds.

“Recent studies on the McGurk effect have shown large variability in their results; some studies report completely opposite results,” said senior author Dr. Michael Beauchamp, professor of neurosurgery and neuroscience, vice chair of neurosurgery basic research and director of the Core for Advanced MRI at Baylor. “There have been failures to replicate reported differences in the McGurk effect between different cultures, different genders and children with or without developmental disorders. So we started to suspect that maybe this was a bigger issue than just a couple of isolated studies.”

Size matters

“We tried to understand how the way we do our experiments could be causing these highly variable and conflicting results in the literature,” Magnotti said. “We took a large data set that we had collected for the McGurk effect and asked, what would the consequences be if we modeled group differences using a variety of sample sizes?

The researchers determined group differences in the McGurk effect in groups of 150 subjects, and also in groups of 20 or 40, and so on. Magnotti and Beauchamp discovered that when they used small sample sizes, the magnitude of the differences between groups can be greatly exaggerated.

“We showed that a true difference of 10 percent between populations, as determined with the largest group, would be vastly overestimated using smaller samples,” said Beauchamp. “In one case, the differences estimated for the McGurk effect between groups of 25 subjects were three times larger than those determined with the largest group. Also, the inflation of the results is most extreme when true population differences are small.”

“We were surprised that just the normal way people conduct their studies in multisensory integration could be problematic,” Magnotti said. “We concluded that reducing inflated results and increasing replicability requires increasing the number of participants compared with current practice. For our studies, a sample of 100 to 200 subjects is a good sample size to detect a difference for McGurk effect.”

These findings have relevant medical implications. If a study conducted with small groups of subjects – for instance comparing subjects with an autism spectrum disorder to individuals without the disorder – shows a large difference between the groups, then it would seem worth attempting to develop therapies to correct the difference. But, if the difference looks large only because of the way the study was designed using small samples, but in reality the difference is not significant, then trying to develop treatments to correct the difference would likely not benefit the patients.

“In this study, we contribute specific suggestions to improve accuracy and reproducibility in multisensory integration studies,” Beauchamp said. “We provide general guidelines about using good stimuli, releasing your data and collecting adequate sample sizes. We think that our findings would help researchers to do better studies. Our study supports 15 years of general scientific literature and research specific to multisensory integration that warns about inaccurate results produced by sample sizes that are too small.”

Tagged with:

About author

Related Articles