Mid-level Cues Improve Boundary Detection

Xiaofeng Ren, Charless Fowlkes and Jitendra Malik

EECS Department
University of California, Berkeley
Technical Report No. UCB/CSD-05-1382
March 2005

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2005/CSD-05-1382.pdf

While mid-level perceptual cues have long been of interest in the human vision community, their role in computer vision has remained limited. In this report, we evaluate several algorithms which make use of mid-level processing in order to improve boundary detection. Our first technique builds a probabilistic model of the relation between prototypical local shapes of edges and the presence or absence of a boundary. We also present a more explicit local model of curvilinear continuity using piecewise linear representations of contours and the Constrained Delaunay Triangulation (CDT). Lastly we consider a global random field on the whole CDT which captures continuity along with the frequency of different of junction types. All three models are trained on human labeled groundtruth. We measure how each model, by incorporating mid-level structure, improves boundary detection. To our knowledge, this is the first time that such cues have been shown quantitatively useful for a large set of natural images. Better boundary detection has immediate application in the problem of object recognition.


BibTeX citation:

@techreport{Ren:CSD-05-1382,
    Author = {Ren, Xiaofeng and Fowlkes, Charless and Malik, Jitendra},
    Title = {Mid-level Cues Improve Boundary Detection},
    Institution = {EECS Department, University of California, Berkeley},
    Year = {2005},
    Month = {Mar},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2005/5226.html},
    Number = {UCB/CSD-05-1382},
    Abstract = {While mid-level perceptual cues have long been of interest in the human vision community, their role in computer vision has remained limited. In this report, we evaluate several algorithms which make use of mid-level processing in order to improve boundary detection. Our first technique builds a probabilistic model of the relation between prototypical local shapes of edges and the presence or absence of a boundary. We also present a more explicit local model of curvilinear continuity using piecewise linear representations of contours and the Constrained Delaunay Triangulation (CDT). Lastly we consider a global random field on the whole CDT which captures continuity along with the frequency of different of junction types. All three models are trained on human labeled groundtruth. We measure how each model, by incorporating mid-level structure, improves boundary detection. To our knowledge, this is the first time that such cues have been shown quantitatively useful for a large set of natural images. Better boundary detection has immediate application in the problem of object recognition.}
}

EndNote citation:

%0 Report
%A Ren, Xiaofeng
%A Fowlkes, Charless
%A Malik, Jitendra
%T Mid-level Cues Improve Boundary Detection
%I EECS Department, University of California, Berkeley
%D 2005
%@ UCB/CSD-05-1382
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2005/5226.html
%F Ren:CSD-05-1382