Breaking News
February 17, 2019 - Support from trusted adults can reduce risk of dying in suicidal teens, finds study
February 17, 2019 - Heart attack awareness improved since 2008
February 17, 2019 - Exercise gives a better brain boost to older men than women
February 17, 2019 - New research disproves previous assumptions of how looks influence personality
February 17, 2019 - Cannabis use as a teenager linked to depression later in life
February 17, 2019 - Sinks by Toilets in ICU Patient Rooms Harbor Harmful Bacteria
February 17, 2019 - Cancer cells’ plasticity makes them harder to stop
February 17, 2019 - Young cannabis users have increased risk of depression and suicidal behavior
February 17, 2019 - Tasmanian Devils Likely to Survive Cancer Scourge
February 17, 2019 - Neoadjuvant PD-1 blockade seems effective in glioblastoma
February 17, 2019 - Personal, social factors play role in enabling sustainable return to work after ill health
February 17, 2019 - Mouse studies show ‘inhibition’ theory of autism wrong
February 17, 2019 - Study shows how neuroactive steroids inhibit activity of pro-inflammatory proteins
February 17, 2019 - Use of liver grafts from older donors decreased despite better outcomes in recipients
February 17, 2019 - MUSC researchers discover new mechanism for a class of anti-cancer drugs
February 17, 2019 - HPV misconceptions are causing women to miss smear tests
February 17, 2019 - Sanofi and Regeneron Offer Praluent (alirocumab) at a New Reduced U.S. List Price
February 17, 2019 - Researchers say auditory testing can identify children for autism screening
February 17, 2019 - New method analyzes how single biological cells react to stressful situations
February 17, 2019 - WVU gynecologic oncologist investigates novel treatment for cervical and vaginal cancers
February 17, 2019 - ADHD diagnoses poorly documented
February 17, 2019 - Majority of gender minority youth do not identify with traditional sexual identity labels
February 17, 2019 - AbbVie, Teneobio enter into strategic transaction to develop potential treatment for multiple myeloma
February 17, 2019 - Lower Birth Weight May Up Risk for Psychiatric Disorders
February 17, 2019 - Scientists identify reversible molecular defect underlying rheumatoid arthritis
February 17, 2019 - Moffitt researchers shed light on how CAR T cells function mechanistically
February 16, 2019 - Female Anatomy May Play Big Role in Sperm’s Success
February 16, 2019 - BMI may mediate inverse link between fiber intake, knee OA
February 16, 2019 - Movement impairments in autism can be reversed through behavioral training
February 16, 2019 - Studies address racial disparities in postpartum period and cardiovascular health
February 16, 2019 - Scientists implicate hidden genes in the severity of autism symptoms
February 16, 2019 - Decreased deep sleep linked to early signs of Alzheimer’s disease
February 16, 2019 - Neuroscientists show how the brain responds to texture
February 16, 2019 - Gilead Announces Topline Data From Phase 3 STELLAR-4 Study of Selonsertib in Compensated Cirrhosis (F4) Due to Nonalcoholic Steatohepatitis (NASH)
February 16, 2019 - What Can I Do About Sweating? (for Teens)
February 16, 2019 - Companies navigate dementia conversations with older workers
February 16, 2019 - Newly developed stem cell technologies show promise for treating PD patients
February 16, 2019 - Collaborative material research could advance self-assembling nanomaterials
February 16, 2019 - Researchers take major step in creating technology that mimics the human brain
February 16, 2019 - Erasing memories associated with cocaine use reduces drug seeking behavior
February 16, 2019 - Artificial intelligence can accurately predict prognosis of ovarian cancer patients
February 16, 2019 - Racial disparities in cancer deaths on the decline for America
February 16, 2019 - FDA authorizes new interoperable insulin pump for children, adults with diabetes
February 16, 2019 - Coexisting Medical Conditions, Smoking Explain PTSD-CVD Link
February 16, 2019 - Skin Cancer Screening: MedlinePlus Lab Test Information
February 16, 2019 - ‘Happiness’ exercises can boost mood in those recovering from substance use disorder
February 16, 2019 - Cell manipulation could soon halt or reverse aging
February 16, 2019 - Pumped Breast Milk Falls Short of Breastfed Version
February 16, 2019 - Men’s porn habits could fuel partners’ eating disorders, study suggests
February 16, 2019 - Rapid progression of age-related diseases may result from formation of vicious cycles
February 16, 2019 - Immune checkpoint molecule protects against future development of cancer
February 16, 2019 - New method produces hydrogels that have properties similar to cells’ environment
February 16, 2019 - $4.1 million funding for heart research on Valentine’s Day
February 16, 2019 - General anesthesia in early infancy unlikely to have lasting effects on developing brains
February 16, 2019 - New breakthroughs for muscular dystrophy research
February 16, 2019 - First Opinion: Embryo editing for higher IQ is a fantasy. Embryo profiling for it is almost here
February 16, 2019 - Vapers develop cancer-related gene deregulation as cigarette smokers
February 16, 2019 - Bringing Antimicrobial Susceptibility Testing (AST) to the Community
February 16, 2019 - Decolonization protocol after hospital discharge can prevent dangerous infections
February 16, 2019 - Children with ASD more likely to face maltreatment, study finds
February 16, 2019 - Study finds genetic vulnerability to use of menthol cigarettes
February 16, 2019 - Promising drug developed to rejuvenate muscle cells
February 16, 2019 - H-RT should be the standard of care for men with low risk prostate cancer, study shows
February 16, 2019 - New technique using patients’ own modified cells could help treat Crohn’s disease
February 16, 2019 - Therapeutic endoscopy has an expanding role in the treatment of IBD
February 16, 2019 - Blood clot discovery could lead to development of better treatments for blood diseases
February 16, 2019 - Intervention can increase exclusive breastfeeding rates
February 16, 2019 - New project explores how gaming technologies can help cancer patients communicate better
February 16, 2019 - Catalyst Biosciences Presents Updated Data from Its Phase 2/3 Trial of Subcutaneous Marzeptacog Alfa (Activated) in Individuals with Hemophilia A or B with Inhibitors at the 12th Annual EAHAD Congress
February 16, 2019 - Rerouting nerves during amputation reduces phantom limb pain before it starts
February 16, 2019 - A Hormone Produced When We Exercise Might Help Fight Alzheimer’s
February 16, 2019 - Millions of British people breathe toxic air travelling to GPs
February 16, 2019 - Conformance of genetic characteristics found to be crucial for longer preservation of kidney graft
February 16, 2019 - Researchers use optogenetic tool to control, visualize receptor signals in neural cells
February 16, 2019 - New reversible antiplatelet therapy could reduce risk of blood clots, prevent cancer metastasis
February 16, 2019 - Testosterone is not the only hormone needed for penis development
February 16, 2019 - FDA Advisory Committee Recommends Approval of Spravato (esketamine) Nasal Spray for Adults with Treatment-Resistant Depression
February 15, 2019 - Heart surgery technology developed at Baptist Health debuts after years of secrecy
February 15, 2019 - Prescription Opioids Double Risk of Triggering Fatal Car Crash
February 15, 2019 - New study helps doctors better understand high blood pressure in pregnant women
New system uses algorithm to convert 2D videos into 3D printed ‘motion sculptures’

New system uses algorithm to convert 2D videos into 3D printed ‘motion sculptures’

image_pdfDownload PDFimage_print

Patriots quarterback Tom Brady has often credited his success to spending countless hours studying his opponent’s movements on film. This understanding of movement is necessary for all living species, whether it’s figuring out what angle to throw a ball at, or perceiving the motion of predators and prey. But simple videos can’t actually give us the full picture.

That’s because traditional videos and photos for studying motion are two-dimensional, and don’t show us the underlying 3-D structure of the person or subject of interest. Without the full geometry, we can’t inspect the small and subtle movements that help us move faster, or make sense of the precision needed to perfect our athletic form.

Recently, though, researchers from MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) have come up with a way to get a better handle on this understanding of complex motion.

The new system uses an algorithm that can take 2-D videos and turn them into 3-D printed “motion sculptures” that show how a human body moves through space. In addition to being an intriguing aesthetic visualization of shape and time, the team envisions that their “MoSculp” system could enable a much more detailed study of motion for professional athletes, dancers, or anyone who wants to improve their physical skills.

“Imagine you have a video of Roger Federer serving a ball in a tennis match, and a video of yourself learning tennis,” says PhD student Xiuming Zhang, lead author of a new paper about the system. “You could then build motion sculptures of both scenarios to compare them and more comprehensively study where you need to improve.”

Because motion sculptures are 3-D, users can use a computer interface to navigate around the structures and see them from different viewpoints, revealing motion-related information inaccessible from the original viewpoint.

Zhang wrote the paper alongside MIT professors William Freeman and Stefanie Mueller, PhD student Jiajun Wu, Google researchers Qiurui He and Tali Dekel, as well as U.C. Berkeley postdoc and former CSAIL PhD Andrew Owens.

How it works

Artists and scientists have long struggled to gain better insight into movement, limited by their own camera lens and what it could provide.

Previous work has mostly used so-called “stroboscopic” photography techniques, which look a lot like the images in a flip book stitched together. But since these photos only show snapshots of movement, you wouldn’t be able to see as much of the trajectory of a person’s arm when they’re hitting a golf ball, for example.

What’s more, these photographs also require laborious pre-shoot setup, such as using a clean background and specialized depth cameras and lighting equipment. All MoSculp needs is a video sequence.

Given an input video, the system first automatically detects 2-D key points on the subject’s body, such as the hip, knee, and ankle of a ballerina while she’s doing a complex dance sequence. Then, it takes the best possible poses from those points to be turned into 3-D “skeletons.”

After stitching these skeletons together, the system generates a motion sculpture that can be 3-D printed, showing the smooth, continuous path of movement traced out by the subject. Users can customize their figures to focus on different body parts, assign different materials to distinguish among parts, and even customize lighting.

In user studies, the researchers found that over 75 percent of subjects felt that MoSculp provided a more detailed visualization for studying motion than the standard photography techniques.

“Dance and highly-skilled athletic motions often seem like ‘moving sculptures’ but they only create fleeting and ephemeral shapes,” says Courtney Brigham, communications lead at Adobe. “This work shows how to take motions and turn them into real sculptures with objective visualizations of movement, providing a way for athletes to analyze their movements for training, requiring no more equipment than a mobile camera and some computing time.”

The system works best for larger movements, like throwing a ball or taking a sweeping leap during a dance sequence. It also works for situations that might obstruct or complicate movement, such as people wearing loose clothing or carrying objects.

Currently, the system only uses single-person scenarios, but the team soon hopes to expand to multiple people. This could open up the potential to study things like social disorders, interpersonal interactions, and team dynamics.​

Source:

https://www.csail.mit.edu/

Tagged with:

About author

Related Articles