Breaking News
December 16, 2018 - Young Breast Cancer Patients Face Higher Risk for Osteoporosis
December 16, 2018 - 3-D printing offers helping hand to people with arthritis
December 16, 2018 - Community Health Choice helps manage complex and chronic care conditions
December 16, 2018 - Regular trips out could dramatically reduce depression in older age
December 16, 2018 - CWRU to use VivaLNK’s Vital Scout device for stress study in student athletes
December 16, 2018 - ‘Easy Way Out’? Stigma May Keep Many From Weight Loss Surgery
December 16, 2018 - Gout drug may protect against chronic kidney disease
December 16, 2018 - Talking about memories enhances the wellbeing of older and younger people
December 16, 2018 - Occupational exposure to pesticides increases risk for cardiovascular disease among Latinos
December 16, 2018 - A biomarker in the brain’s circulation system may be Alzheimer’s earliest warning
December 16, 2018 - Magnesium may play important role in optimizing vitamin D levels, study shows
December 16, 2018 - The effect of probiotics on intestinal flora of premature babies
December 16, 2018 - Parents spend more time talking with kids about mechanics of using mobile devices
December 16, 2018 - Biohaven Announces Positive Results from Ongoing Rimegepant Long-Term Safety Study
December 16, 2018 - Arterial stiffness may predict dementia risk
December 16, 2018 - Study explores link between work stress and increased cancer risk
December 16, 2018 - Sex work criminalization linked to incidences of violence finds study
December 16, 2018 - Johns Hopkins researchers discover swarming behavior in fish-dwelling parasite
December 16, 2018 - Schistosomiasis prevention and treatment could help control HIV
December 16, 2018 - Early postpartum opioids linked with persistent usage
December 16, 2018 - Johns Hopkins researchers identify molecular causes of necrotizing enterocolitis in preemies
December 16, 2018 - Advanced illumination expands capabilities of light-sheet microscopy
December 16, 2018 - Alzheimer’s could possibly be spread via contaminated neurosurgery
December 16, 2018 - Unraveling the complexity of cancer biology can prompt new avenues for drug development
December 16, 2018 - Inflammatory Bowel Disease, Prostate Cancer Linked
December 16, 2018 - Cannabis youth prevention strategy should target mental wellbeing
December 15, 2018 - Recent developments and challenges in hMAT inhibitors
December 15, 2018 - Sewage bacteria found lurking in Hudson River sediments
December 15, 2018 - CDC selects UMass Amherst biostatistician model that helps predict influenza outbreaks
December 15, 2018 - Researchers reveal brain mechanism that drives itch-evoked scratching behavior
December 15, 2018 - New computer model helps predict course of the disease in prostate cancer patients
December 15, 2018 - Obesity to Blame for Almost 1 in 25 Cancers Worldwide
December 15, 2018 - How the brain tells you to scratch that itch
December 15, 2018 - New findings could help develop new immunotherapies against cancer
December 15, 2018 - World’s largest AI-powered medical research network launched by OWKIN
December 15, 2018 - Young people suffering chronic pain battle isolation and stigma as they struggle to forge their identities
December 15, 2018 - Lifespan extension at low temperatures depends on individual’s genes, study shows
December 15, 2018 - New ingestible capsule can be controlled using Bluetooth wireless technology
December 15, 2018 - Researchers uncover microRNAs involved in the control of social behavior
December 15, 2018 - Research offers hope for patients with serious bone marrow cancer
December 15, 2018 - Link between poverty and obesity is only about 30 years old, study shows
December 15, 2018 - Mass spectrometry throws light on old case of intentional heavy metal poisoning
December 15, 2018 - BeyondSpring Announces Phase 3 Study 105 of its Lead Asset Plinabulin for Chemotherapy-Induced Neutropenia Meets Primary Endpoint at Interim Analysis
December 15, 2018 - Study finds that in treating obesity, one size does not fit all
December 15, 2018 - Tenacity and flexibility help maintain psychological well-being, mobility in older people
December 15, 2018 - Study reveals role of brain mechanism in memory recall
December 15, 2018 - High levels of oxygen encourage the brain to remain in deep, restorative sleep
December 15, 2018 - Experimental HIV vaccine strategy works in non-human primates, research shows
December 15, 2018 - Genetically modified pigs could limit replication of classical swine fever virus, study shows
December 15, 2018 - FDA Approves Herzuma (trastuzumab-pkrb), a Biosimilar to Herceptin
December 15, 2018 - Cost and weight-loss potential matter most to bariatric surgery patients
December 15, 2018 - Cancer Research UK and AstraZeneca open new Functional Genomics Centre
December 15, 2018 - New research lays out potential path for treatment of Huntington’s disease
December 15, 2018 - Prestigious R&D 100 Award presented to Leica Microsystems
December 15, 2018 - Study shows septin proteins detect and kill gut pathogen, Shigella
December 15, 2018 - Study sheds new light on disease-spreading mosquitoes
December 15, 2018 - 2017 Saw Slowing in National Health Care Spending
December 15, 2018 - Monitoring movement reflects efficacy of mandibular splint
December 15, 2018 - Study supports BMI as useful tool for assessing obesity and health
December 15, 2018 - Self-guided, internet-based therapy platforms effectively reduce depression
December 15, 2018 - Organically farmed food has bigger climate impact than conventional food production
December 15, 2018 - Faster, cheaper test has potential to enhance prostate cancer evaluation
December 15, 2018 - Researchers study abnormal blood glucose levels of patients after hospital discharge
December 15, 2018 - Swedish scientists explore direct association of dementia and ischemic stroke deaths
December 15, 2018 - Study finds 117% increase in number of dementia sufferers in 26 years
December 15, 2018 - Eczema Can Drive People to Thoughts of Suicide: Study
December 15, 2018 - Link between neonatal vitamin D deficiency and schizophrenia confirmed
December 15, 2018 - Nurse denied life insurance because she carries naloxone
December 15, 2018 - Ritalin drug affects organization of pathways that build brain networks used in attention, learning
December 15, 2018 - Research pinpoints two proteins involved in creation of stem cells
December 15, 2018 - Gut bacteria may modify effectiveness of anti-diabetes drugs
December 15, 2018 - A new type of ‘painless’ adhesive for biomedical applications
December 15, 2018 - Early physical therapy associated with reduction in opioid use
December 15, 2018 - Breast cancer protection from pregnancy begins many decades later, study finds
December 15, 2018 - How often pregnant women follow food avoidance strategy to prevent allergy in offspring?
December 15, 2018 - Using machine learning to predict risk of developing life-threatening infections
December 15, 2018 - How imaginary friends could boost children’s development
December 15, 2018 - Folate deficiency creates more damaging chromosomal abnormalities than previously known
December 15, 2018 - Study provides new insights into molecular mechanisms underlying role of amyloid in Alzheimer’s disease
December 15, 2018 - For the asking, a check is in the mail to help pay for costly drugs
New system uses algorithm to convert 2D videos into 3D printed ‘motion sculptures’

New system uses algorithm to convert 2D videos into 3D printed ‘motion sculptures’

image_pdfDownload PDFimage_print

Patriots quarterback Tom Brady has often credited his success to spending countless hours studying his opponent’s movements on film. This understanding of movement is necessary for all living species, whether it’s figuring out what angle to throw a ball at, or perceiving the motion of predators and prey. But simple videos can’t actually give us the full picture.

That’s because traditional videos and photos for studying motion are two-dimensional, and don’t show us the underlying 3-D structure of the person or subject of interest. Without the full geometry, we can’t inspect the small and subtle movements that help us move faster, or make sense of the precision needed to perfect our athletic form.

Recently, though, researchers from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) have come up with a way to get a better handle on this understanding of complex motion.

The new system uses an algorithm that can take 2-D videos and turn them into 3-D printed “motion sculptures” that show how a human body moves through space. In addition to being an intriguing aesthetic visualization of shape and time, the team envisions that their “MoSculp” system could enable a much more detailed study of motion for professional athletes, dancers, or anyone who wants to improve their physical skills.

“Imagine you have a video of Roger Federer serving a ball in a tennis match, and a video of yourself learning tennis,” says PhD student Xiuming Zhang, lead author of a new paper about the system. “You could then build motion sculptures of both scenarios to compare them and more comprehensively study where you need to improve.”

Because motion sculptures are 3-D, users can use a computer interface to navigate around the structures and see them from different viewpoints, revealing motion-related information inaccessible from the original viewpoint.

Zhang wrote the paper alongside MIT professors William Freeman and Stefanie Mueller, PhD student Jiajun Wu, Google researchers Qiurui He and Tali Dekel, as well as U.C. Berkeley postdoc and former CSAIL PhD Andrew Owens.

How it works

Artists and scientists have long struggled to gain better insight into movement, limited by their own camera lens and what it could provide.

Previous work has mostly used so-called “stroboscopic” photography techniques, which look a lot like the images in a flip book stitched together. But since these photos only show snapshots of movement, you wouldn’t be able to see as much of the trajectory of a person’s arm when they’re hitting a golf ball, for example.

What’s more, these photographs also require laborious pre-shoot setup, such as using a clean background and specialized depth cameras and lighting equipment. All MoSculp needs is a video sequence.

Given an input video, the system first automatically detects 2-D key points on the subject’s body, such as the hip, knee, and ankle of a ballerina while she’s doing a complex dance sequence. Then, it takes the best possible poses from those points to be turned into 3-D “skeletons.”

After stitching these skeletons together, the system generates a motion sculpture that can be 3-D printed, showing the smooth, continuous path of movement traced out by the subject. Users can customize their figures to focus on different body parts, assign different materials to distinguish among parts, and even customize lighting.

In user studies, the researchers found that over 75 percent of subjects felt that MoSculp provided a more detailed visualization for studying motion than the standard photography techniques.

“Dance and highly-skilled athletic motions often seem like ‘moving sculptures’ but they only create fleeting and ephemeral shapes,” says Courtney Brigham, communications lead at Adobe. “This work shows how to take motions and turn them into real sculptures with objective visualizations of movement, providing a way for athletes to analyze their movements for training, requiring no more equipment than a mobile camera and some computing time.”

The system works best for larger movements, like throwing a ball or taking a sweeping leap during a dance sequence. It also works for situations that might obstruct or complicate movement, such as people wearing loose clothing or carrying objects.

Currently, the system only uses single-person scenarios, but the team soon hopes to expand to multiple people. This could open up the potential to study things like social disorders, interpersonal interactions, and team dynamics.​

Source:

https://www.csail.mit.edu/

Tagged with:

About author

Related Articles