Video Based Motion Synthesis by Splicing and Morphing

Greg Mori, Alex Berg, Alyosha Efros, Ashley Eden and Jitendra Malik

EECS Department
University of California, Berkeley
Technical Report No. UCB/CSD-04-1337
June 2004

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2004/CSD-04-1337.pdf

In this paper we present a method for synthesizing videos of human motion by splicing together clips of input video. There are two main contributions in this work. The first is developing a method for "kinematically correct morphing" of images of human figure, which is used to splice together the clips in input video in a manner that produces smooth output sequences. The second contribution of this work is the application of activity recognition algorithms to our input data in order to automatically extract action labels, which allow us to control the synthesized video by issuing high-level action commands. We present results of synthetic sequences on two domains: ballet and tennis.


BibTeX citation:

@techreport{Mori:CSD-04-1337,
    Author = {Mori, Greg and Berg, Alex and Efros, Alyosha and Eden, Ashley and Malik, Jitendra},
    Title = {Video Based Motion Synthesis by Splicing and Morphing},
    Institution = {EECS Department, University of California, Berkeley},
    Year = {2004},
    Month = {Jun},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2004/5536.html},
    Number = {UCB/CSD-04-1337},
    Abstract = {In this paper we present a method for synthesizing videos of human motion by splicing together clips of input video. There are two main contributions in this work. The first is developing a method for "kinematically correct morphing" of images of human figure, which is used to splice together the clips in input video in a manner that produces smooth output sequences. The second contribution of this work is the application of activity recognition algorithms to our input data in order to automatically extract action labels, which allow us to control the synthesized video by issuing high-level action commands. We present results of synthetic sequences on two domains: ballet and tennis.}
}

EndNote citation:

%0 Report
%A Mori, Greg
%A Berg, Alex
%A Efros, Alyosha
%A Eden, Ashley
%A Malik, Jitendra
%T Video Based Motion Synthesis by Splicing and Morphing
%I EECS Department, University of California, Berkeley
%D 2004
%@ UCB/CSD-04-1337
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2004/5536.html
%F Mori:CSD-04-1337