Narayanan Sundaram and Thomas Brox and Kurt Keutzer

EECS Department, University of California, Berkeley

Technical Report No. UCB/EECS-2010-104

July 1, 2010

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2010/EECS-2010-104.pdf

Dense and accurate motion tracking is an important requirement for many video feature extraction algorithms. In this paper we provide a method for computing point trajectories based on a fast parallel implementation of a recent optical flow algorithm that tolerates fast motion. The parallel implementation of large displacement optical flow runs about 78x faster than the serial C++ version. This makes it practical to use in a variety of applications, among them point tracking. In the course of obtaining the fast implementation, we also proved that the fixed point matrix obtained in the optical flow technique is positive semi-definite. We compare the point tracking to the most commonly used motion tracker - the KLT tracker - on a number of sequences with ground truth motion. Our resulting technique tracks up to three orders of magnitude more points and is 46% more accurate than the KLT tracker. It also provides a tracking density of 48% and has an occlusion error of 3% compared to a density of 0.1% and occlusion error of 8% for the KLT tracker. Compared to the Particle Video tracker, we achieve 66% better accuracy while retaining the ability to handle large displacements while running an order of magnitude faster.

---

BibTeX citation:

@techreport{Sundaram:EECS-2010-104,
    Author= {Sundaram, Narayanan and Brox, Thomas and Keutzer, Kurt},
    Title= {Dense Point Trajectories by GPU-accelerated Large Displacement Optical Flow},
    Year= {2010},
    Month= {Jul},
    Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2010/EECS-2010-104.html},
    Number= {UCB/EECS-2010-104},
    Abstract= {Dense and accurate motion tracking is an important requirement for many video feature extraction algorithms. In this paper we provide a method for computing point trajectories based on a fast parallel implementation of a recent optical flow algorithm that tolerates fast motion. The parallel implementation of large displacement optical flow runs about 78x faster than the serial C++ version. This makes it practical to use in a variety of applications, among them point tracking. In the course of obtaining the fast implementation, we also proved that the fixed point matrix obtained in the optical flow technique is positive semi-definite. We compare the point tracking to the most commonly used motion tracker - the KLT tracker - on a number of sequences with ground truth motion. Our resulting technique tracks up to three orders of magnitude more points and is 46% more accurate than the KLT tracker. It also provides a tracking density of 48% and has an occlusion error of 3% compared to a density of 0.1% and occlusion error of 8% for the KLT tracker. Compared to the Particle Video tracker, we achieve 66% better accuracy while retaining the ability to handle large displacements while running an order of magnitude faster.},
}

EndNote citation:

%0 Report
%A Sundaram, Narayanan 
%A Brox, Thomas 
%A Keutzer, Kurt 
%T Dense Point Trajectories by GPU-accelerated Large Displacement Optical Flow
%I EECS Department, University of California, Berkeley
%D 2010
%8 July 1
%@ UCB/EECS-2010-104
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2010/EECS-2010-104.html
%F Sundaram:EECS-2010-104