Breaking News
April 23, 2019 - Sensory Sensitivity Tied to Constipation in Young Children
April 23, 2019 - More than half of internal medicine graduates choosing primary care
April 22, 2019 - Researchers discover good news for fish populations living on bleached coral reefs
April 22, 2019 - Plant-based diets associated with lower risk of heart failure
April 22, 2019 - Food Allergies Can Strike at Any Age
April 22, 2019 - Cerebro-facio-thoracic dysplasia – Genetics Home Reference
April 22, 2019 - Poverty leaves a mark on our genes
April 22, 2019 - Countdown to Big Data in Precision Health: When industry and academia converge
April 22, 2019 - The U.S government may account for up to $37.8 billion due to opioid epidemic
April 22, 2019 - Improving ACA’s Insurance Coverage Provisions will lead to better care for patients
April 22, 2019 - Study identifies possible therapeutic effects of curcumin on stomach cancer
April 22, 2019 - Hyaline fibromatosis syndrome – Genetics Home Reference
April 22, 2019 - Scientists use CRISPR for possible ‘bubble boy’ therapy
April 22, 2019 - Hematologist (and a mom, singer, actress and much more) stands up for diversity
April 22, 2019 - Novel AI voice tool can help diagnose PTSD
April 22, 2019 - Overlooked part of cell’s internal machinery may hold key to treating acute myeloid leukemia
April 22, 2019 - Soft bedding responsible for majority of sleep-related infant deaths, study reveals
April 22, 2019 - Study finds worse health-related quality of life among transgender adults
April 22, 2019 - MIT scientists reverse some behavioral symptoms of rare neurodevelopmental disorder
April 22, 2019 - Scientists find new therapy target for drug-induced liver failure
April 22, 2019 - Opioid dose variability could lead to increased risk of overdose, study suggests
April 22, 2019 - Newly developed model predicts salmonella outbreaks several months in advance
April 22, 2019 - Deep-learning model better predicts survival outcomes for lung cancer
April 22, 2019 - One in Three U.S. Adults Aged 35 to 44 May Have Drinking Problem
April 22, 2019 - Why the measles virus is so contagious
April 22, 2019 - Magnet ‘Zap’ to the Brain Might Jumpstart Aging Memory
April 22, 2019 - Immune response to gut microbes may be early indicator of type 1 diabetes
April 22, 2019 - Destination Limbo: Health Suffers Among Asylum Seekers In Crowded Border Shelter
April 22, 2019 - Research shows how dopamine contributes to sex differences in worms
April 22, 2019 - Marijuana users weigh less compared to non-users
April 22, 2019 - Research uncovers critical RNA processing aberrations in ALS and FTD
April 22, 2019 - Many cancer patients use marijuana and prescription opioids, study reveals
April 22, 2019 - Frailty may up fracture risk in patients with type 2 diabetes
April 22, 2019 - Study provides new insight into how obesity, insulin resistance can affect cognition
April 22, 2019 - Study seeks to better understand the genetic causes for hypospadias
April 22, 2019 - FDA grants approval of first generic naloxone nasal spray to treat opioid overdose
April 22, 2019 - FDA authorizes marketing of first medical device to treat ADHD
April 22, 2019 - Vanderbilt researchers to develop and test ‘safe harbor’ standards of care
April 22, 2019 - You’re probably brushing your teeth wrong – here are four tips for better dental health
April 22, 2019 - Pharmacy closures contribute to medication non-adherence among heart patients
April 22, 2019 - Using Edge AI technology to observe behavior of cattle
April 22, 2019 - Bacteria play a role in the development of stomach ulcers in pigs
April 22, 2019 - Hand Hygiene Compliance Poor in Task Transitions
April 22, 2019 - smoking could harm your baby
April 22, 2019 - Scientists identify rare, paradoxical response to antiretroviral therapy
April 21, 2019 - More TV, Tablets, More Attention Issues at Age 5
April 21, 2019 - Drug reduces risk of kidney failure in people with diabetes, study finds
April 21, 2019 - New research identifies novel link between antibiotic resistance and climate change
April 21, 2019 - Simple intervention can provide lasting protection for teens against junk food marketing
April 21, 2019 - The protein p38-gamma identified as a new therapeutic target in liver cancer
April 21, 2019 - Novel system enables researchers to study bacteria within mini-tissues in a dish
April 21, 2019 - Discovery of oral cancer biomarkers could save thousands of lives
April 21, 2019 - Geneva Exhibition committee gives gold medals to two medications developed by Kazan
April 21, 2019 - Scientists aim to minimize or eliminate hair loss during cancer treatment
April 21, 2019 - WiFi interacts with signaling pathways in the human brain
April 21, 2019 - Stroke Hospitalizations Down in Black, White Medicare Enrollees
April 21, 2019 - First common risk genes discovered for autism
April 21, 2019 - Researchers map auditory sensory system of the mouse brain
April 21, 2019 - Scientists Bring Pig’s Brain, Dead 4 Hours, Back to ‘Cellular Activity’
April 21, 2019 - Virtual reality a promising tool for reducing fears and phobia in autism
April 21, 2019 - New analysis lists out opportunities for U.S. medical schools to advance population health
April 21, 2019 - More sleep may help teens with ADHD focus and organize
April 21, 2019 - Breakthrough antibody treatment suppresses HIV without antivirals
April 21, 2019 - AveXis Data Reinforce Effectiveness of Zolgensma in Treating Spinal Muscular Atrophy (SMA) Type 1
April 21, 2019 - Is your hand pain arthritis, carpal tunnel or something else?
April 21, 2019 - Measles outbreaks may become more frequent if vaccination rates continue to decline
April 21, 2019 - Researchers succeed in accelerating process of creating 3D images
April 21, 2019 - Tiny worm mimics key genetic risk for Alzheimer’s
April 21, 2019 - Angry dreams explained by brain waves
April 20, 2019 - Parenteral Antimicrobial Tx at Home Burdens Children’s Caregivers
April 20, 2019 - Diabetes treatment may keep dementia, Alzheimer’s at bay
April 20, 2019 - New bandage-like biosensor collects and analyzes sweat
April 20, 2019 - A comprehensive, centralized database of bovine milk compounds
April 20, 2019 - Two new epigenetic regulators maintain self-renewal of embryonic stem cells
April 20, 2019 - New Evidence That Veggies Beat Steak for Heart Health
April 20, 2019 - Study reveals genes associated with heavy drinking and alcoholism
April 20, 2019 - Texas A&M AgriLife becomes the newest member of NutriRECS international consortium
April 20, 2019 - In most states, insurance won’t cover addiction treatments
April 20, 2019 - Computer-based memory games may be beneficial for individuals with fragile X syndrome
April 20, 2019 - Timing of food intake influences molecular clock in the liver of mice
Artificial neural networks can predict how different areas in the brain respond to words

Artificial neural networks can predict how different areas in the brain respond to words

image_pdfDownload PDFimage_print

Can artificial intelligence (AI) help us understand how the brain understands language? Can neuroscience help us understand why AI and neural networks are effective at predicting human perception?

Research from Alexander Huth and Shailee Jain from The University of Texas at Austin (UT Austin) suggests both are possible.

In a paper presented at the 2018 Conference on Neural Information Processing Systems (NeurIPS), the scholars described the results of experiments that used artificial neural networks to predict with greater accuracy than ever before how different areas in the brain respond to specific words.

“As words come into our heads, we form ideas of what someone is saying to us, and we want to understand how that comes to us inside the brain,” said Huth, assistant professor of Neuroscience and Computer Science at UT Austin. “It seems like there should be systems to it, but practically, that’s just not how language works. Like anything in biology, it’s very hard to reduce down to a simple set of equations.”

The work employed a type of recurrent neural network called long short-term memory (LSTM) that includes in its calculations the relationships of each word to what came before to better preserve context.

“If a word has multiple meanings, you infer the meaning of that word for that particular sentence depending on what was said earlier,” said Jain, a PhD student in Huth’s lab at UT Austin. “Our hypothesis is that this would lead to better predictions of brain activity because the brain cares about context.”

It sounds obvious, but for decades neuroscience experiments considered the response of the brain to individual words without a sense of their connection to chains of words or sentences. (Huth describes the importance of doing “real-world neuroscience” in a March 2019 paper in the Journal of Cognitive Neuroscience.)

In their work, the researchers ran experiments to test, and ultimately predict, how different areas in the brain would respond when listening to stories (specifically, the Moth Radio Hour). They used data collected from fMRI (functional magnetic resonance imaging) machines that capture changes in the blood oxygenation level in the brain based on how active groups of neurons are. This serves as a correspondent for where language concepts are “represented” in the brain.

Using powerful supercomputers at the Texas Advanced Computing Center (TACC), they trained a language model using the LSTM method so it could effectively predict what word would come next – a task akin to Google auto-complete searches, which the human mind is particularly adept at.

“In trying to predict the next word, this model has to implicitly learn all this other stuff about how language works,” said Huth, “like which words tend to follow other words, without ever actually accessing the brain or any data about the brain.”

Based on both the language model and fMRI data, they trained a system that could predict how the brain would respond when it hears each word in a new story for the first time.

Past efforts had shown that it is possible to localize language responses in the brain effectively. However, the new research showed that adding the contextual element – in this case up to 20 words that came before – improved brain activity predictions significantly. They found that their predictions improve even when the least amount of context was used. The more context provided, the better the accuracy of their predictions.

“Our analysis showed that if the LSTM incorporates more words, then it gets better at predicting the next word,” said Jain, “which means that it must be including information from all the words in the past.”

The research went further. It explored which parts of the brain were more sensitive to the amount of context included. They found, for instance, that concepts that seem to be localized to the auditory cortex were less dependent on context.

“If you hear the word dog, this area doesn’t care what the 10 words were before that, it’s just going to respond to the sound of the word dog”, Huth explained.

On the other hand, brain areas that deal with higher-level thinking were easier to pinpoint when more context was included. This supports theories of the mind and language comprehension.

“There was a really nice correspondence between the hierarchy of the artificial network and the hierarchy of the brain, which we found interesting,” Huth said.

Natural language processing — or NLP — has taken great strides in recent years. But when it comes to answering questions, having natural conversations, or analyzing the sentiments in written texts, NLP still has a long way to go. The researchers believe their LSTM-developed language model can help in these areas.

The LSTM (and neural networks in general) works by assigning values in high-dimensional space to individual components (here, words) so that each component can be defined by its thousands of disparate relationships to many other things.

The researchers trained the language model by feeding it tens of millions of words drawn from Reddit posts. Their system then made predictions for how thousands of voxels (three-dimensional pixels) in the brains of six subjects would respond to a second set of stories that neither the model nor the individuals had heard before. Because they were interested in the effects of context length and the effect of individual layers in the neural network, they essentially tested 60 different factors (20 lengths of context retention and three different layer dimensions) for each subject.

All of this leads to computational problems of enormous scale, requiring massive amounts of computing power, memory, storage, and data retrieval. TACC’s resources were well suited to the problem. The researchers used the Maverick supercomputer, which contains both GPUs and CPUs for the computing tasks, and Corral, a storage and data management resource, to preserve and distribute the data. By parallelizing the problem across many processors, they were able to run the computational experiment in weeks rather than years.

“To develop these models effectively, you need a lot of training data,” Huth said. “That means you have to pass through your entire dataset every time you want to update the weights. And that’s inherently very slow if you don’t use parallel resources like those at TACC.”

If it sounds complex, well — it is.

This is leading Huth and Jain to consider a more streamlined version of the system, where instead of developing a language prediction model and then applying it to the brain, they develop a model that directly predicts brain response. They call this an end-to-end system and it’s where Huth and Jain hope to go in their future research. Such a model would improve its performance directly on brain responses. A wrong prediction of brain activity would feedback into the model and spur improvements.

“If this works, then it’s possible that this network could learn to read text or intake language similarly to how our brains do,” Huth said. “Imagine Google Translate, but it understands what you’re saying, instead of just learning a set of rules.”

With such a system in place, Huth believes it is only a matter of time until a mind-reading system that can translate brain activity into language is feasible. In the meantime, they are gaining insights into both neuroscience and artificial intelligence from their experiments.

“The brain is a very effective computation machine and the aim of artificial intelligence is to build machines that are really good at all the tasks a brain can do,” Jain said. “But, we don’t understand a lot about the brain. So, we try to use artificial intelligence to first question how the brain works, and then, based on the insights we gain through this method of interrogation, and through theoretical neuroscience, we use those results to develop better artificial Intelligence.

“The idea is to understand cognitive systems, both biological and artificial, and to use them in tandem to understand and build better machines.”

Source:

https://www.tacc.utexas.edu/-/brain-inspired-ai-inspires-insights-about-the-brain-and-vice-versa-

Tagged with:

About author

Related Articles