Breaking News
April 22, 2019 - The U.S government may account for up to $37.8 billion due to opioid epidemic
April 22, 2019 - Improving ACA’s Insurance Coverage Provisions will lead to better care for patients
April 22, 2019 - Study identifies possible therapeutic effects of curcumin on stomach cancer
April 22, 2019 - Hyaline fibromatosis syndrome – Genetics Home Reference
April 22, 2019 - Scientists use CRISPR for possible ‘bubble boy’ therapy
April 22, 2019 - Hematologist (and a mom, singer, actress and much more) stands up for diversity
April 22, 2019 - Novel AI voice tool can help diagnose PTSD
April 22, 2019 - Overlooked part of cell’s internal machinery may hold key to treating acute myeloid leukemia
April 22, 2019 - MIT scientists reverse some behavioral symptoms of rare neurodevelopmental disorder
April 22, 2019 - Scientists find new therapy target for drug-induced liver failure
April 22, 2019 - Opioid dose variability could lead to increased risk of overdose, study suggests
April 22, 2019 - Newly developed model predicts salmonella outbreaks several months in advance
April 22, 2019 - Deep-learning model better predicts survival outcomes for lung cancer
April 22, 2019 - One in Three U.S. Adults Aged 35 to 44 May Have Drinking Problem
April 22, 2019 - Why the measles virus is so contagious
April 22, 2019 - Magnet ‘Zap’ to the Brain Might Jumpstart Aging Memory
April 22, 2019 - Immune response to gut microbes may be early indicator of type 1 diabetes
April 22, 2019 - Destination Limbo: Health Suffers Among Asylum Seekers In Crowded Border Shelter
April 22, 2019 - Research shows how dopamine contributes to sex differences in worms
April 22, 2019 - Marijuana users weigh less compared to non-users
April 22, 2019 - Research uncovers critical RNA processing aberrations in ALS and FTD
April 22, 2019 - Many cancer patients use marijuana and prescription opioids, study reveals
April 22, 2019 - Frailty may up fracture risk in patients with type 2 diabetes
April 22, 2019 - Study provides new insight into how obesity, insulin resistance can affect cognition
April 22, 2019 - Study seeks to better understand the genetic causes for hypospadias
April 22, 2019 - FDA grants approval of first generic naloxone nasal spray to treat opioid overdose
April 22, 2019 - FDA authorizes marketing of first medical device to treat ADHD
April 22, 2019 - Vanderbilt researchers to develop and test ‘safe harbor’ standards of care
April 22, 2019 - You’re probably brushing your teeth wrong – here are four tips for better dental health
April 22, 2019 - Pharmacy closures contribute to medication non-adherence among heart patients
April 22, 2019 - Using Edge AI technology to observe behavior of cattle
April 22, 2019 - Bacteria play a role in the development of stomach ulcers in pigs
April 22, 2019 - Hand Hygiene Compliance Poor in Task Transitions
April 22, 2019 - smoking could harm your baby
April 22, 2019 - Scientists identify rare, paradoxical response to antiretroviral therapy
April 21, 2019 - More TV, Tablets, More Attention Issues at Age 5
April 21, 2019 - Drug reduces risk of kidney failure in people with diabetes, study finds
April 21, 2019 - New research identifies novel link between antibiotic resistance and climate change
April 21, 2019 - Simple intervention can provide lasting protection for teens against junk food marketing
April 21, 2019 - The protein p38-gamma identified as a new therapeutic target in liver cancer
April 21, 2019 - Novel system enables researchers to study bacteria within mini-tissues in a dish
April 21, 2019 - Discovery of oral cancer biomarkers could save thousands of lives
April 21, 2019 - Geneva Exhibition committee gives gold medals to two medications developed by Kazan
April 21, 2019 - Scientists aim to minimize or eliminate hair loss during cancer treatment
April 21, 2019 - WiFi interacts with signaling pathways in the human brain
April 21, 2019 - Stroke Hospitalizations Down in Black, White Medicare Enrollees
April 21, 2019 - First common risk genes discovered for autism
April 21, 2019 - Researchers map auditory sensory system of the mouse brain
April 21, 2019 - Scientists Bring Pig’s Brain, Dead 4 Hours, Back to ‘Cellular Activity’
April 21, 2019 - Virtual reality a promising tool for reducing fears and phobia in autism
April 21, 2019 - New analysis lists out opportunities for U.S. medical schools to advance population health
April 21, 2019 - More sleep may help teens with ADHD focus and organize
April 21, 2019 - Breakthrough antibody treatment suppresses HIV without antivirals
April 21, 2019 - AveXis Data Reinforce Effectiveness of Zolgensma in Treating Spinal Muscular Atrophy (SMA) Type 1
April 21, 2019 - Is your hand pain arthritis, carpal tunnel or something else?
April 21, 2019 - Measles outbreaks may become more frequent if vaccination rates continue to decline
April 21, 2019 - Researchers succeed in accelerating process of creating 3D images
April 21, 2019 - Tiny worm mimics key genetic risk for Alzheimer’s
April 21, 2019 - Angry dreams explained by brain waves
April 20, 2019 - Parenteral Antimicrobial Tx at Home Burdens Children’s Caregivers
April 20, 2019 - Diabetes treatment may keep dementia, Alzheimer’s at bay
April 20, 2019 - New bandage-like biosensor collects and analyzes sweat
April 20, 2019 - A comprehensive, centralized database of bovine milk compounds
April 20, 2019 - Two new epigenetic regulators maintain self-renewal of embryonic stem cells
April 20, 2019 - New Evidence That Veggies Beat Steak for Heart Health
April 20, 2019 - Study reveals genes associated with heavy drinking and alcoholism
April 20, 2019 - Texas A&M AgriLife becomes the newest member of NutriRECS international consortium
April 20, 2019 - In most states, insurance won’t cover addiction treatments
April 20, 2019 - Computer-based memory games may be beneficial for individuals with fragile X syndrome
April 20, 2019 - Timing of food intake influences molecular clock in the liver of mice
April 20, 2019 - Precise decoding of breast cancer cells paves way for new treatment option
April 20, 2019 - Scientists use 3D imaging to help model complex processes performed by placenta
April 20, 2019 - MediciNova Announces Plans to Move Forward with a Phase 3 Trial of MN-166 (ibudilast) in ALS
April 20, 2019 - Genetic variants that protect against obesity could aid new weight loss medicines
April 20, 2019 - New technology developed for microscopic imaging in living organisms
April 20, 2019 - when quitting cigarettes, consider using more nicotine, not less
April 20, 2019 - Key proteins can block Listeria without triggering the death of host cells
April 20, 2019 - Researchers create a working model of cerebral tract to study brain function
April 20, 2019 - New study shows that microbes can help break toxic chemical in dust
April 20, 2019 - Scientists use NIR light and injected DNA nanodevice to guide stem cells to injury
Seeing through a robot’s eyes helps those with profound motor impairments

Seeing through a robot’s eyes helps those with profound motor impairments

image_pdfDownload PDFimage_print
Seeing through a robot's eyes helps those with profound motor impairments
Robotic body surrogates can help people with profound motor deficits interact with the world. Here, Henry Evans, a California man who helped Georgia Tech researchers with improvements to a web-based interface, uses the robot to shave himself. Credit: Henry Clever/Phillip Grice

An interface system that uses augmented reality technology could help individuals with profound motor impairments operate a humanoid robot to feed themselves and perform routine personal care tasks such as scratching an itch and applying skin lotion. The web-based interface displays a “robot’s eye view” of surroundings to help users interact with the world through the machine.

The system, described March 15 in the journal PLOS ONE, could help make sophisticated robots more useful to people who do not have experience operating complex robotic systems. Study participants interacted with the robot interface using standard assistive computer access technologies—such as eye trackers and head trackers—that they were already using to control their personal computers.

The paper reported on two studies showing how such “robotic body surrogates—which can perform tasks similar to those of humans—could improve the quality of life for users. The work could provide a foundation for developing faster and more capable assistive robots.

“Our results suggest that people with profound motor deficits can improve their quality of life using robotic body surrogates,” said Phillip Grice, a recent Georgia Institute of Technology Ph.D. graduate who is first author of the paper. “We have taken the first step toward making it possible for someone to purchase an appropriate type of robot, have it in their home and derive real benefit from it.”

Grice and Professor Charlie Kemp from the Wallace H. Coulter Department of Biomedical Engineering at Georgia Tech and Emory University used a PR2 mobile manipulator manufactured by Willow Garage for the two studies. The wheeled robot has 20 degrees of freedom, with two arms and a “head,” giving it the ability to manipulate objects such as water bottles, washcloths, hairbrushes and even an electric shaver.

“Our goal is to give people with limited use of their own bodies access to robotic bodies so they can interact with the world in new ways,” said Kemp.

Seeing through a robot's eyes helps those with profound motor impairments
Showing its capabilities as a body surrogate, a PR2 controlled remotely by an individual with profound motor deficits picks up a cup in a research laboratory at the Georgia Institute of Technology. Credit: Phillip Grice, Georgia Tech

In their first study, Grice and Kemp made the PR2 available across the internet to a group of 15 participants with severe motor impairments. The participants learned to control the robot remotely, using their own assistive equipment to operate a mouse cursor to perform a personal care task. Eighty percent of the participants were able to manipulate the robot to pick up a water bottle and bring it to the mouth of a mannequin.

“Compared to able-bodied persons, the capabilities of the robot are limited,” Grice said. “But the participants were able to perform tasks effectively and showed improvement on a clinical evaluation that measured their ability to manipulate objects compared to what they would have been able to do without the robot.”

In the second study, the researchers provided the PR2 and interface system to Henry Evans, a California man who has been helping Georgia Tech researchers study and improve assistive robotic systems since 2011. Evans, who has very limited control of his body, tested the robot in his home for seven days and not only completed tasks, but also devised novel uses combining the operation of both robot arms at the same time—using one arm to control a washcloth and the other to use a brush.

“The system was very liberating to me, in that it enabled me to independently manipulate my environment for the first time since my stroke,” said Evans. “With respect to other people, I was thrilled to see Phil get overwhelmingly positive results when he objectively tested the system with 15 other people.”

The researchers were pleased that Evans developed new uses for the robot, combining motion of the two arms in ways they had not expected.

“When we gave Henry free access to the robot for a week, he found new opportunities for using it that we had not anticipated,” said Grice. “This is important because a lot of the assistive technology available today is designed for very specific purposes. What Henry has shown is that this system is powerful in providing assistance and empowering users. The opportunities for this are potentially very broad.”

Seeing through a robot's eyes helps those with profound motor impairments
The view through the PR2’s cameras showing the environment around the robot. Clicking the yellow disc allows users the control the arm. Credit: Phillip Grice, Georgia Tech

The interface allowed Evans to care for himself in bed over an extended period of time. “The most helpful aspect of the interface system was that I could operate the robot completely independently, with only small head movements using an extremely intuitive graphical user interface,” Evans said.

The web-based interface shows users what the world looks like from cameras located in the robot’s head. Clickable controls overlaid on the view allow the users to move the robot around in a home or other environment and control the robot’s hands and arms. When users move the robot’s head, for instance, the screen displays the mouse cursor as a pair of eyeballs to show where the robot will look when the user clicks. Clicking on a disc surrounding the robotic hands allows users to select a motion. While driving the robot around a room, lines following the cursor on the interface indicate the direction it will travel.

Building the interface around the actions of a simple single-button mouse allows people with a range of disabilities to use the interface without lengthy training sessions.

“Having an interface that individuals with a wide range of physical impairments can operate means we can provide access to a broad range of people, a form of universal design,” Grice noted. “Because of its capability, this is a very complex system, so the challenge we had to overcome was to make it accessible to individuals who have very limited control of their own bodies.”

While the results of the study demonstrated what the researchers had set out to do, Kemp agrees that improvements can be made. The existing system is slow, and mistakes made by users can create significant setbacks. Still, he said, “People could use this technology today and really benefit from it.”

The cost and size of the PR2 would need to be significantly reduced for the system to be commercially viable, Evans suggested. Kemp says these studies point the way to a new type of assistive technology.

“It seems plausible to me based on this study that robotic body surrogates could provide significant benefits to users,” Kemp added.


How game theory can bring humans and robots closer together


More information:
Phillip M. Grice et al, In-home and remote use of robotic body surrogates by people with profound motor deficits, PLOS ONE (2019). DOI: 10.1371/journal.pone.0212904


Provided by
Georgia Institute of Technology

Citation:
Seeing through a robot’s eyes helps those with profound motor impairments (2019, March 15)
retrieved 23 March 2019
from https://medicalxpress.com/news/2019-03-robot-eyes-profound-motor-impairments.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.

Tagged with:

About author

Related Articles