Breaking News
February 20, 2019 - Health Tip: Eat Less Saturated Fat
February 20, 2019 - Sleeping in contact lenses puts you at risk of dangerous infection
February 20, 2019 - “We should study that!”: How a nurse-scientist found her passion
February 20, 2019 - Cervical microbiome may influence HPV infection more than previously thought
February 20, 2019 - Sausage mislabeling in Canada is down, new study finds
February 20, 2019 - Study shows blood pressure benefits of morning exercise for older overweight/obese adults
February 20, 2019 - New screening method could catch organ rejection much earlier without a biopsy needle
February 20, 2019 - Study may have important implications for refining parenting during child’s adolescence
February 20, 2019 - Study sheds new light on how antibiotic resistance genes are transferred between bacteria
February 20, 2019 - Chronic Wasting Disease may soon spread to humans, warns CDC
February 20, 2019 - Scientists identify new genetic causes linked to abnormal pregnancies and miscarriages
February 20, 2019 - Using LyoSpeed technology to avoid residual solvent when drying HPLC fractions
February 20, 2019 - New screening tool more likely to identify sexual and labor exploitation of youth
February 20, 2019 - Newly licensed nurses work for long hours, also have a second paid job
February 20, 2019 - Physicists identify simple mechanism used by deadly bacteria to fend off antibiotics
February 20, 2019 - FDA Grants Priority Review to Genentech’s Personalized Medicine Entrectinib
February 20, 2019 - Exposure to chemicals before and after birth is associated with a decrease in lung function
February 20, 2019 - Neuroscientists reveal that simple brain region can guide complex feats of mental activity
February 20, 2019 - Study finds new link between food allergies and multiple sclerosis
February 20, 2019 - First gene therapy operation for macular degeneration is a success
February 20, 2019 - Physicians graduated outside the U.S. offer better care for Medicare patients with complex needs
February 20, 2019 - Study shows therapeutic potential of VEGF-A mRNA for regenerative angiogenesis in humans
February 20, 2019 - FDA Approves Keytruda (pembrolizumab) for the Adjuvant Treatment of Patients with Melanoma with Involvement of Lymph Node(s) Following Complete Resection
February 20, 2019 - Study identifies brain cells that modulate behavioral response to threats
February 20, 2019 - Researchers take closer look at how viruses bind cells and cause infection
February 20, 2019 - Newly developed gene therapy helps decelerate aging process
February 20, 2019 - Study suggests new treatment strategy for deadly brain cancer
February 20, 2019 - Scientists develop unique hybrid implant that imitates bone structure
February 20, 2019 - Push-ups can be tailored to meet specific needs of individuals
February 20, 2019 - Early-career job loss has long term health implications
February 20, 2019 - CVD Does Not Modify Depression-Mortality Link in Elderly
February 20, 2019 - Electrical activity early in fruit flies’ brain development could shed light on how neurons wire the brain
February 20, 2019 - Machine learning technique helps predict which asthma patients respond to corticosteroid therapy
February 20, 2019 - Self-reported sleep duration is a useful tool to measure sleep in children, study suggests
February 20, 2019 - T-cells play key role in how the body fights follicular lymphoma
February 20, 2019 - Study shows how 3D organization of genetic material helps perpetuate the species
February 20, 2019 - Researchers engineer stem cell with ‘suicide genes’ to induce cell death in all but beta cells
February 20, 2019 - Study reveals major sex differences in management of cardiovascular risk factors among U.S. adults
February 20, 2019 - Health Tip: Get Your Child to School on Time
February 20, 2019 - Shortcut strategy for screening compounds with clinical potentials for drug development
February 20, 2019 - Common acid reflux drugs tied to elevated risk for kidney disease
February 20, 2019 - Microbiome could be culprit when good drugs do harm
February 20, 2019 - Prenatal exposure to forest fires causes stunted growth in children
February 20, 2019 - Gene therapy restores hearing in mice with congenital genetic deafness
February 20, 2019 - First molecular test predicts treatment response for kidney cancer
February 20, 2019 - New method for improved visualization of single-cell RNA- sequencing data
February 20, 2019 - Researchers capture altered brain activity patterns of Parkinson’s in mice
February 20, 2019 - A possible blood test for detecting Alzheimer’s disease before symptoms show
February 20, 2019 - Primary care physicians associated with longevity, new research finds
February 19, 2019 - New study identifies many key lessons to establish sanctioned safe consumption sites
February 19, 2019 - Single CRISPR treatment can safely and stably correct genetic disease
February 19, 2019 - Multinational initiative to study familial primary distal renal tubular acidosis
February 19, 2019 - Breakthrough study highlights the promise of cell therapies for muscular dystrophy
February 19, 2019 - Subsymptom Threshold Exercise Speeds Concussion Recovery
February 19, 2019 - Midline venous catheters – infants: MedlinePlus Medical Encyclopedia
February 19, 2019 - Searching for side effects
February 19, 2019 - Humanity is all right, probably, although human extinction remains quite possible, researcher says
February 19, 2019 - Having Anesthesia Once as a Baby Does Not Cause Learning Disabilities, New Research Shows
February 19, 2019 - Anti-cancer immunotherapy could be used to fight HIV
February 19, 2019 - Customized Micropatterning for Improved Physiological Relevance
February 19, 2019 - Unique gene therapy approach paves new way to tackle rare, inherited diseases
February 19, 2019 - Activating gene that helps excite neurons reverses depression in male mice
February 19, 2019 - Science Puzzling Out Differences in Gut Bacteria Around the World
February 19, 2019 - Cells that destroy the intestine
February 19, 2019 - On recovery, vulnerability and ritual: An exhibit in white
February 19, 2019 - Scientific Duo Gets Back To Basics To Make Childbirth Safer
February 19, 2019 - COPD patients need more support when understanding new chest symptoms
February 19, 2019 - Using light-based method for production of pharmaceutical molecules
February 19, 2019 - Scientists find link between inflammation and cancer
February 19, 2019 - The High Cost Of Sex: Insurers Often Don’t Pay For Drugs To Treat Problems
February 19, 2019 - Hearing impairment associated with accelerated cognitive decline with age
February 19, 2019 - Researchers identify multiple genetic variants associated with body fat distribution
February 19, 2019 - Influenza and common cold are completely different diseases, study shows
February 19, 2019 - Scientists untangle how microbes manufacture key antibiotic compound
February 19, 2019 - Greater primary care physician supply associated with longer life spans
February 19, 2019 - HIV-1 protein suppresses immune response more broadly than thought
February 19, 2019 - Brain imaging indicates potential success of drug therapy in depressive patients
February 19, 2019 - For 2020 Dem Hopefuls, ‘Medicare-For-All’ Is A Defining Issue, However They Define It
February 19, 2019 - Specialized lung cells appear in the developing fetus much earlier than previously thought
February 19, 2019 - KU professor discusses promise of brain-computer interface to aid, restore communication
Researchers find that sample size is key factor determining accuracy of study results

Researchers find that sample size is key factor determining accuracy of study results

image_pdfDownload PDFimage_print

The accuracy and reproducibility of research studies are a major concern of the scientific community. Researchers at Baylor College of Medicine have examined this problem in the field of multisensory integration to understand how it affects both basic research and the development of therapies. They determined that sample size (the number of individuals examined for a study) is the most important factor determining the accuracy of the study results. They report in the journal PLOS ONE that studies with sample sizes of 20 individuals overestimate true effects and that sample sizes of 100 or more individuals generally are necessary to reliably measure population differences or experimental effects.

“It started when we tried to reproduce our own work,” said first author Dr. John Magnotti, assistant professor of neurosurgery at Baylor. “We had conducted multisensory integration experiments about the McGurk effect using common sample sizes but when we tried to replicate our results, we were unable to do so. We were also unable to replicate other groups’ results.”

Multisensory integration studies allow scientists to better understand how integrating information captured by different senses helps us perceive the world around us. For example, in speech perception, integrating auditory information from the talker’s voice and visual information from the talker’s face enhances the accuracy of speech recognition.

But there are instances when the integration of auditory and visual information does not work as expected. The result is the perception of a sound that is different from what actually is being said. For example, the visual “ga” combined with the auditory “ba” results in the perception of “da.” (See link for examples.) This is called the McGurk effect.

Multisensory integration researchers have been studying whether the susceptibility to the McGurk effect varies between genders, typical and atypical human development and different cultural or linguistic backgrounds.

“Recent studies on the McGurk effect have shown large variability in their results; some studies report completely opposite results,” said senior author Dr. Michael Beauchamp, professor of neurosurgery and neuroscience, vice chair of neurosurgery basic research and director of the Core for Advanced MRI at Baylor. “There have been failures to replicate reported differences in the McGurk effect between different cultures, different genders and children with or without developmental disorders. So we started to suspect that maybe this was a bigger issue than just a couple of isolated studies.”

Size matters

“We tried to understand how the way we do our experiments could be causing these highly variable and conflicting results in the literature,” Magnotti said. “We took a large data set that we had collected for the McGurk effect and asked, what would the consequences be if we modeled group differences using a variety of sample sizes?

The researchers determined group differences in the McGurk effect in groups of 150 subjects, and also in groups of 20 or 40, and so on. Magnotti and Beauchamp discovered that when they used small sample sizes, the magnitude of the differences between groups can be greatly exaggerated.

“We showed that a true difference of 10 percent between populations, as determined with the largest group, would be vastly overestimated using smaller samples,” said Beauchamp. “In one case, the differences estimated for the McGurk effect between groups of 25 subjects were three times larger than those determined with the largest group. Also, the inflation of the results is most extreme when true population differences are small.”

“We were surprised that just the normal way people conduct their studies in multisensory integration could be problematic,” Magnotti said. “We concluded that reducing inflated results and increasing replicability requires increasing the number of participants compared with current practice. For our studies, a sample of 100 to 200 subjects is a good sample size to detect a difference for McGurk effect.”

These findings have relevant medical implications. If a study conducted with small groups of subjects – for instance comparing subjects with an autism spectrum disorder to individuals without the disorder – shows a large difference between the groups, then it would seem worth attempting to develop therapies to correct the difference. But, if the difference looks large only because of the way the study was designed using small samples, but in reality the difference is not significant, then trying to develop treatments to correct the difference would likely not benefit the patients.

“In this study, we contribute specific suggestions to improve accuracy and reproducibility in multisensory integration studies,” Beauchamp said. “We provide general guidelines about using good stimuli, releasing your data and collecting adequate sample sizes. We think that our findings would help researchers to do better studies. Our study supports 15 years of general scientific literature and research specific to multisensory integration that warns about inaccurate results produced by sample sizes that are too small.”

Tagged with:

About author

Related Articles