Breaking News
February 22, 2019 - New sepsis test could save thousands of lives
February 22, 2019 - Cervical cancer could be eradicated by 2100
February 21, 2019 - Sustained smoking cessation can lower risk of seropositive RA
February 21, 2019 - Thousands with chronic UTIs are not receiving the treatment they need
February 21, 2019 - Are teens getting high on social media? The surprising study seeking the pot-Instagram link
February 21, 2019 - Stanford expands biobank services | News Center
February 21, 2019 - Scientists identify link between drinking contexts and early onset intoxication among adolescents
February 21, 2019 - Strong social support may reduce cardiovascular disease risk in postmenopausal women
February 21, 2019 - Rapid expansion of interventions could prevent up to 13 million cases of cervical cancer within 50 years
February 21, 2019 - Motif Bio Receives Complete Response Letter From The FDA
February 21, 2019 - Researchers map previously unknown disease in children
February 21, 2019 - A skeptical look at popular diets: Going gluten-free
February 21, 2019 - Podcast: KHN’s ‘What The Health?’ How Safe Are Your Supplements?
February 21, 2019 - Anticipatory signals in eye movements can help measure attentive capacity, learning with greater precision
February 21, 2019 - Evening exercise does not negatively affect sleep, may also reduce hunger
February 21, 2019 - Artificial intelligence technique can be used to identify alcohol misuse in trauma setting
February 21, 2019 - Overweight, obesity in adolescence associated with increased risk of renal cancer later in life
February 21, 2019 - BGU develops new AI platform for monitoring and predicting ALS progression
February 21, 2019 - Researchers discover a new promising target to improve HIV vaccines
February 21, 2019 - Brief Anesthesia in Infancy Does Not Mar Neurodevelopment
February 21, 2019 - Gaming system helps with autism diagnosis
February 21, 2019 - Heart Disease: Six Things Women Should Know
February 21, 2019 - More States Say Doctors Must Offer Overdose Reversal Drug Along With Opioids
February 21, 2019 - Researchers explore case studies focused on industries that kill more people than employed
February 21, 2019 - Only half of GP practice buildings are fit for purpose
February 21, 2019 - Intense exercise, fasting and hormones can enhance waste-protein removal, study shows
February 21, 2019 - Scientists can monitor brain activity to predict epileptic seizures few minutes in advance
February 21, 2019 - Study quantifies hepatic and intestinal mRNA expression of Ugt isoforms in rats
February 21, 2019 - ‘Apple-Shaped’ Body? ‘Pear-Shaped’? Your Genes May Tell
February 21, 2019 - Can we repair the brain? The promise of stem cell technologies for treating Parkinson’s disease
February 21, 2019 - Trump Plan To Beat HIV Hits Rough Road In Rural America
February 21, 2019 - PENTAX Medical introduces new electrosurgical and argon plasma coagulation platforms
February 21, 2019 - Trump plan to beat HIV hits rough road in rural America
February 21, 2019 - Eating blueberries every day could help decrease blood pressure
February 21, 2019 - ‘No Second Chances’ report calls for new measures to combat cardiovascular disease in Australia
February 21, 2019 - Mayo clinic researchers discuss local case studies of leprosy
February 21, 2019 - Scientists demonstrate key role of salt in allergic immune reactions
February 21, 2019 - Experts propose revising the criteria for diagnosis of Parkinson’s disease
February 21, 2019 - The med student and the machine
February 21, 2019 - Hey, Hey! Ho, Ho! Is Striking For School Nurses The Way To Go?
February 21, 2019 - Latest research encourages children to move out and learn through physical activity
February 21, 2019 - Proper oral hygiene and regular visits to dentist can promote heart health
February 21, 2019 - New, versatile technique for remote control of transplanted cells in Parkinson’s
February 21, 2019 - Why melanoma tumors in the brain may be worse?
February 21, 2019 - New project aims to improve lung disease care in Appalachia
February 21, 2019 - Drug increases melanin production in some people with albinism
February 21, 2019 - Over 1 in 3 adults miss the mark on protein, finds study
February 21, 2019 - CymaBay Therapeutics Announces Seladelpar Granted Breakthrough Therapy Designation by the FDA for the Treatment of Primary Biliary Cholangitis
February 21, 2019 - A correlation between obesity and income has only developed in the past 30 years
February 21, 2019 - Baby, then work: An effort to help resident-parents in emergency medicine
February 21, 2019 - Heavy cigarette smoking could damage vision, say researchers
February 21, 2019 - Some drug combinations may be more effective than others for schizophrenic patients
February 21, 2019 - Combination of common antibiotics can eliminate multi-drug resistant E. coli
February 21, 2019 - Number of calls to U.S. Poison Control regarding kratom exposure increased
February 21, 2019 - New computational tool searches for factors that cause specific diseases
February 21, 2019 - New method to assess effectiveness of psychotherapies for social anxiety disorder
February 21, 2019 - New technology measures hormones that influence reproductive health efficiently
February 21, 2019 - Bat influenza viruses could potentially attack the cells of humans and livestock
February 21, 2019 - Immunotherapeutic antibody therapy to kill cancer has now progressed to patient testing
February 21, 2019 - Johns Hopkins scientists find new compound that may prevent reperfusion injury
February 21, 2019 - Researchers develop new way to deliver treatment for cartilage regeneration
February 21, 2019 - Study sheds new light on left ventricular dysfunction in ischemic heart disease
February 21, 2019 - New technique could expedite cancer diagnosis, lead to better patient outcomes
February 21, 2019 - New map of infant brain may aid early diagnosis of autism
February 21, 2019 - Human consciousness depends on the brain’s ability to maintain dynamics of neural activity
February 21, 2019 - Harmony Biosciences Announces File Acceptance Of Its New Drug Application For Pitolisant
February 21, 2019 - Medications could fill treatment gap for adolescents with obesity
February 21, 2019 - New antibiotics are desperately needed: Machine learning could help | News Center
February 21, 2019 - Researchers develop new computer game for dementia carers
February 21, 2019 - University of Dundee partners with Takeda to develop new treatments for tau pathology
February 21, 2019 - Influenza vaccine may be less effective in elderly patients, finds study
February 21, 2019 - Researchers explain why T cells lose their protective ability in inflamed tissues
February 21, 2019 - New optimization method rapidly analyzes nanomedicines for cancer treatment
February 21, 2019 - Viruses in the intestinal tracts can lead to islet autoimmunity and Type 1 diabetes
February 21, 2019 - Link between dietary fatty acid intake and hypertension found to be influenced by diabetes status
February 21, 2019 - FDA Approves Esperoct (turoctocog alfa pegol, N8-GP) for Hemophilia A
February 21, 2019 - ‘Boy erased’—why conversion therapies and ex-gay ministries should be outlawed
February 21, 2019 - Titia de Lange to give annual McCormick Lecture on March 8 | News Center
February 21, 2019 - Study reveals how helper T cells support memory cells to function optimally
February 21, 2019 - Autistic children with co-occurring ADHD have greater adaptive behavior impairments
New system uses algorithm to convert 2D videos into 3D printed ‘motion sculptures’

New system uses algorithm to convert 2D videos into 3D printed ‘motion sculptures’

image_pdfDownload PDFimage_print

Patriots quarterback Tom Brady has often credited his success to spending countless hours studying his opponent’s movements on film. This understanding of movement is necessary for all living species, whether it’s figuring out what angle to throw a ball at, or perceiving the motion of predators and prey. But simple videos can’t actually give us the full picture.

That’s because traditional videos and photos for studying motion are two-dimensional, and don’t show us the underlying 3-D structure of the person or subject of interest. Without the full geometry, we can’t inspect the small and subtle movements that help us move faster, or make sense of the precision needed to perfect our athletic form.

Recently, though, researchers from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) have come up with a way to get a better handle on this understanding of complex motion.

The new system uses an algorithm that can take 2-D videos and turn them into 3-D printed “motion sculptures” that show how a human body moves through space. In addition to being an intriguing aesthetic visualization of shape and time, the team envisions that their “MoSculp” system could enable a much more detailed study of motion for professional athletes, dancers, or anyone who wants to improve their physical skills.

“Imagine you have a video of Roger Federer serving a ball in a tennis match, and a video of yourself learning tennis,” says PhD student Xiuming Zhang, lead author of a new paper about the system. “You could then build motion sculptures of both scenarios to compare them and more comprehensively study where you need to improve.”

Because motion sculptures are 3-D, users can use a computer interface to navigate around the structures and see them from different viewpoints, revealing motion-related information inaccessible from the original viewpoint.

Zhang wrote the paper alongside MIT professors William Freeman and Stefanie Mueller, PhD student Jiajun Wu, Google researchers Qiurui He and Tali Dekel, as well as U.C. Berkeley postdoc and former CSAIL PhD Andrew Owens.

How it works

Artists and scientists have long struggled to gain better insight into movement, limited by their own camera lens and what it could provide.

Previous work has mostly used so-called “stroboscopic” photography techniques, which look a lot like the images in a flip book stitched together. But since these photos only show snapshots of movement, you wouldn’t be able to see as much of the trajectory of a person’s arm when they’re hitting a golf ball, for example.

What’s more, these photographs also require laborious pre-shoot setup, such as using a clean background and specialized depth cameras and lighting equipment. All MoSculp needs is a video sequence.

Given an input video, the system first automatically detects 2-D key points on the subject’s body, such as the hip, knee, and ankle of a ballerina while she’s doing a complex dance sequence. Then, it takes the best possible poses from those points to be turned into 3-D “skeletons.”

After stitching these skeletons together, the system generates a motion sculpture that can be 3-D printed, showing the smooth, continuous path of movement traced out by the subject. Users can customize their figures to focus on different body parts, assign different materials to distinguish among parts, and even customize lighting.

In user studies, the researchers found that over 75 percent of subjects felt that MoSculp provided a more detailed visualization for studying motion than the standard photography techniques.

“Dance and highly-skilled athletic motions often seem like ‘moving sculptures’ but they only create fleeting and ephemeral shapes,” says Courtney Brigham, communications lead at Adobe. “This work shows how to take motions and turn them into real sculptures with objective visualizations of movement, providing a way for athletes to analyze their movements for training, requiring no more equipment than a mobile camera and some computing time.”

The system works best for larger movements, like throwing a ball or taking a sweeping leap during a dance sequence. It also works for situations that might obstruct or complicate movement, such as people wearing loose clothing or carrying objects.

Currently, the system only uses single-person scenarios, but the team soon hopes to expand to multiple people. This could open up the potential to study things like social disorders, interpersonal interactions, and team dynamics.​

Source:

https://www.csail.mit.edu/

Tagged with:

About author

Related Articles