Breaking News
December 19, 2018 - Researchers uncover genes that play a key role in the inactivation of X chromosomes
December 19, 2018 - The case for the federal minister of health to recall them
December 19, 2018 - Regular theatre and cinema visits keeps depression away in seniors finds study
December 19, 2018 - Personalization techniques give a new lease of life to anticancer vaccines
December 19, 2018 - Research opens door to development of drug or vaccine for late-onset Alzheimer’s
December 19, 2018 - Single workout can boost metabolism for days
December 19, 2018 - UI study leads to better understanding of signaling capacity between neurons
December 19, 2018 - Gut microbiome plays role in immune system regulation, study finds
December 19, 2018 - How MAPK translocation leads to drug resistance in melanoma
December 19, 2018 - Increasing prevalence of antibiotic resistance in the U.S. linked with occasional use
December 19, 2018 - Mind-body exercises may improve cognition in older adults
December 19, 2018 - Hepatitis C drug can eliminate chikungunya, yellow fever virus
December 19, 2018 - Separating male and female mice changes the way they smell, shows study
December 19, 2018 - FDA Approves Genentech’s Tecentriq in Combination With Avastin and Chemotherapy for the Initial Treatment of Metastatic Non-Squamous Non-Small Cell Lung Cancer
December 19, 2018 - Mediterranean Diet for Osteoarthritis | About OA
December 19, 2018 - Successful bladder repair using silk fibroid scaffolds
December 19, 2018 - Quidel receives CE mark to use Sofia 2 Lyme+ Fluorescent Immunoassay with Sofia 2 analyzer
December 19, 2018 - Horizon Discovery partners with C4XD to validate novel synthetic lethal oncology targets
December 19, 2018 - Research suggests a promising therapeutic target to treat or prevent metabolic disorders
December 19, 2018 - Split liver transplants could save children on wait list finds study
December 19, 2018 - Michigan-based food manufacturer ordered to discontinue operations after recurrent food safety violations
December 19, 2018 - HPV discovery could lead to new treatments for cervical cancer
December 19, 2018 - Real-time neurofeedback controls Parkinson’s brainwaves
December 19, 2018 - Incorrect prescribing warnings in electronic prescribing systems
December 19, 2018 - New $1.6 million NIH grant supports study on a gene vital to circadian rhythms
December 19, 2018 - Racial Disparities Seen Among Teens Undergoing Flu Vaccination
December 19, 2018 - To resolve inflammation, location matters
December 19, 2018 - Dancing could help older women to perform their daily tasks
December 19, 2018 - Research identifies new therapeutic target for cancer treatment and tissue regeneration
December 19, 2018 - Energy costs, social isolation contribute to health risk of older adults in extreme weather
December 19, 2018 - Potential combination therapy against rare disease of the bone marrow could improve treatment
December 19, 2018 - Researchers aim to improve cognition, reverse weight gain in schizophrenia
December 19, 2018 - UC San Diego Health offers new DRG stimulation device for phantom limb pain
December 19, 2018 - Study examines relationship between growth restriction and risk of childhood mortality
December 19, 2018 - New study provides insights on increased risk of suicide in young patients visiting ED
December 19, 2018 - AHA: Thyroid Problems Linked to Worsening Heart Failure
December 19, 2018 - World-first coeliac disease vaccine enters Phase 2 trials
December 19, 2018 - RNA sequencing offers novel insights into the microbiome
December 19, 2018 - A promising, effective vaccine for common respiratory disease
December 19, 2018 - Protein may slow progression of emphysema, study finds
December 19, 2018 - Studying atrial fibrillation — and exploring new frontiers in precision health
December 19, 2018 - A New Way To Get College Students Through A Psychiatric Crisis — And Back To School
December 19, 2018 - Optum, UnitedHealthcare take action to help people affected by North Carolina winter storms
December 18, 2018 - Weight change in middle-aged, elderly Chinese Singaporeans related to increased risk of death
December 18, 2018 - Immune cells sacrifice themselves to protect us from invading bacteria
December 18, 2018 - Watching brain cells fire, with a twist of gravitational waves
December 18, 2018 - 2018 in Review
December 18, 2018 - Getting the Most Out of the CLARITY Technique
December 18, 2018 - NVF shoes provide a viable option for track and road racing
December 18, 2018 - CRISPR may restore effectiveness of chemotherapies used to treat lung cancer
December 18, 2018 - New app accurately measures and charts progression of skin wounds
December 18, 2018 - Persistent Discrimination ID’d Among Physician Mothers
December 18, 2018 - Cellphone technology developed to detect HIV
December 18, 2018 - A Stanford doctor hits the field with the 49ers — as their airway management physician
December 18, 2018 - The Rise of Anxiety Baking
December 18, 2018 - Just one night of sleep deprivation increases the urge to eat
December 18, 2018 - Study reveals mechanism behind failed remyelination in MS
December 18, 2018 - New genetic testing method increases the precision of biomarker analysis
December 18, 2018 - Simple technique to effectively treat underdiagnosed cause of debilitating chest pain
December 18, 2018 - Barbershop-based medical intervention can successfully lower blood pressure, new data shows
December 18, 2018 - Food labels have caused changes in consumers’ intake and industry’s use of key additives
December 18, 2018 - Sickest children could benefit from split liver transplants
December 18, 2018 - Scientists create patient-specific model to identify most effective treatment for appendix cancer
December 18, 2018 - ‘Little Foot’ endocast reveals a small brain combining ape-like and human-like features
December 18, 2018 - New therapy for childhood blindness shows ‘very promising’ results
December 18, 2018 - Researchers discover promising new compound against Buruli ulcer
December 18, 2018 - Study finds significant use of traditional, complementary and alternative medicines in Sub-Saharan Africa
December 18, 2018 - California Farm Implicated in Outbreak of E. coli Tied to Romaine Lettuce
December 18, 2018 - Mobile health has power to transform HIV/AIDS nursing
December 18, 2018 - Celiac Vaccine in Clinical Trials at Columbia
December 18, 2018 - Research into mental health first aid prompts practical guidance and resources for workplace
December 18, 2018 - Researcher conducts study to investigate peripheral blood markers of Alzheimer’s disease
December 18, 2018 - Researchers identify link between mucus in the small airways and pulmonary fibrosis
December 18, 2018 - EU Commission’s Health Policy Platform to host EKHA program on transplantation
December 18, 2018 - Survivors of childhood Hodgkin lymphoma have high risk of developing solid tumors
December 18, 2018 - Small changes to cafeteria design can get kids to eat healthier, new assessment tool finds
December 18, 2018 - From Machines to Cyclic Compounds
December 18, 2018 - New study reveals best assessment tools to establish delirium severity
December 18, 2018 - Rice University scientists develop synthetic protein switches to control electron flow
December 18, 2018 - Home-based pulmonary function monitoring for teens with Duchenne muscular dystrophy
New system uses algorithm to convert 2D videos into 3D printed ‘motion sculptures’

New system uses algorithm to convert 2D videos into 3D printed ‘motion sculptures’

image_pdfDownload PDFimage_print

Patriots quarterback Tom Brady has often credited his success to spending countless hours studying his opponent’s movements on film. This understanding of movement is necessary for all living species, whether it’s figuring out what angle to throw a ball at, or perceiving the motion of predators and prey. But simple videos can’t actually give us the full picture.

That’s because traditional videos and photos for studying motion are two-dimensional, and don’t show us the underlying 3-D structure of the person or subject of interest. Without the full geometry, we can’t inspect the small and subtle movements that help us move faster, or make sense of the precision needed to perfect our athletic form.

Recently, though, researchers from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) have come up with a way to get a better handle on this understanding of complex motion.

The new system uses an algorithm that can take 2-D videos and turn them into 3-D printed “motion sculptures” that show how a human body moves through space. In addition to being an intriguing aesthetic visualization of shape and time, the team envisions that their “MoSculp” system could enable a much more detailed study of motion for professional athletes, dancers, or anyone who wants to improve their physical skills.

“Imagine you have a video of Roger Federer serving a ball in a tennis match, and a video of yourself learning tennis,” says PhD student Xiuming Zhang, lead author of a new paper about the system. “You could then build motion sculptures of both scenarios to compare them and more comprehensively study where you need to improve.”

Because motion sculptures are 3-D, users can use a computer interface to navigate around the structures and see them from different viewpoints, revealing motion-related information inaccessible from the original viewpoint.

Zhang wrote the paper alongside MIT professors William Freeman and Stefanie Mueller, PhD student Jiajun Wu, Google researchers Qiurui He and Tali Dekel, as well as U.C. Berkeley postdoc and former CSAIL PhD Andrew Owens.

How it works

Artists and scientists have long struggled to gain better insight into movement, limited by their own camera lens and what it could provide.

Previous work has mostly used so-called “stroboscopic” photography techniques, which look a lot like the images in a flip book stitched together. But since these photos only show snapshots of movement, you wouldn’t be able to see as much of the trajectory of a person’s arm when they’re hitting a golf ball, for example.

What’s more, these photographs also require laborious pre-shoot setup, such as using a clean background and specialized depth cameras and lighting equipment. All MoSculp needs is a video sequence.

Given an input video, the system first automatically detects 2-D key points on the subject’s body, such as the hip, knee, and ankle of a ballerina while she’s doing a complex dance sequence. Then, it takes the best possible poses from those points to be turned into 3-D “skeletons.”

After stitching these skeletons together, the system generates a motion sculpture that can be 3-D printed, showing the smooth, continuous path of movement traced out by the subject. Users can customize their figures to focus on different body parts, assign different materials to distinguish among parts, and even customize lighting.

In user studies, the researchers found that over 75 percent of subjects felt that MoSculp provided a more detailed visualization for studying motion than the standard photography techniques.

“Dance and highly-skilled athletic motions often seem like ‘moving sculptures’ but they only create fleeting and ephemeral shapes,” says Courtney Brigham, communications lead at Adobe. “This work shows how to take motions and turn them into real sculptures with objective visualizations of movement, providing a way for athletes to analyze their movements for training, requiring no more equipment than a mobile camera and some computing time.”

The system works best for larger movements, like throwing a ball or taking a sweeping leap during a dance sequence. It also works for situations that might obstruct or complicate movement, such as people wearing loose clothing or carrying objects.

Currently, the system only uses single-person scenarios, but the team soon hopes to expand to multiple people. This could open up the potential to study things like social disorders, interpersonal interactions, and team dynamics.​

Source:

https://www.csail.mit.edu/

Tagged with:

About author

Related Articles