Animating Characters: Data-driven simulation and biped motion capture
The animation and simulation of human behavior, as well as garments and hair, for humanoid characters are important issues in the context of computer animation and interactive applications like games and social VR. On the simulation side, the challenges are largely computational and of intuitive control. While algorithms exist that can realistically simulate highly complex fabric/garment or hair behaviors (even at a yarn or strand granularity), those approaches are typically computationally expensive and cannot be applied in real-time. Over the last 5-7 years we looked at data-driven proxy models that are able to approximate the simulation behaviors of arbitrarily complex simulators using lower-dimensional learned sub-spaces; as well as utilizing similar techniques coupled with perceptual experiments to re-parametrize traditional simulators in terms of simple and more intuitive controls.
On the biped humanoid behavior capture side, we experimented with a variety of prototypes that are able to capture human motion in (largely) unconstrained environments or with little to no instrumentation of the actor. Our solutions relied on various physics-based models and control to alleviate fundamental ambiguities and undesired properties (e.g., ground or segment penetration) of traditional video-based motion capture methods. In this talk I will present overview of the approaches and findings we discovered along the way.
Leonid Sigal is an Associate Professor in the Department of Computer Science at the University of British Columbia. Prior to this he was a Senior Research Scientist at Disney Research Pittsburgh and an adjunct faculty at Carnegie Mellon University. He completed his Ph.D. at Brown University in 2008; received his B.Sc. degrees in Computer Science and Mathematics from Boston University in 1999, his M.A. from Boston University in 1999, and his M.S. from Brown University in 2003. Leonid’s research interests lie in the areas of computer vision, machine learning, and computer graphics. Leonid’s research emphasis is on machine learning and statistical approaches for visual recognition, understanding, analytics and simulation. He has published more than 70 papers in venues and journals in these fields (including in PAMI, IJCV, CVPR, ICCV, ECCV, NIPS and ACM SIGGRAPH).