Daisy Zhe Wang and Eirinaios Chrysovalantis Michelakis and Michael Franklin and Joseph M. Hellerstein and Minos Garofalakis

EECS Department, University of California, Berkeley

Technical Report No. UCB/EECS-2009-120

August 15, 2009

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2009/EECS-2009-120.pdf

Full-text documents represent a large fraction of the world's data. Although not structured per se, they often contain snippets of structured information within them: e.g., names, addresses, and document titles. Information Extraction (IE) techniques identify such structured information in text. In recent years, database research has pursued IE on two fronts: declarative languages and systems for managing IE tasks, and IE as an uncertain data source for Probabilistic Databases. It is natural to consider merging these two directions, but efforts to do so have had to compromise on the statistical robustness of IE algorithms in order to fit with early Probabilistic Database models.

In this paper, we bridge the gap between these ideas by implementing a state-of-the-art statistical IE approach – Conditional Random Fields (CRFs) – in the setting of Probabilistic Databases that treat statistical models as first-class data objects. Using standard relational tables to capture CRF parameters, and inverted-file representations of text, we show that the Viterbi algorithm for CRF inference can be specified declaratively in recursive SQL, in a manner that can both choose likely segmentations, and provide detailed marginal distributions for label assignment. Given this implementation, we propose query processing optimizations that effectively combine probabilistic inference and relational operators such as selections and joins. In an experimental study with two data sets, we demonstrate the efficiency of our in-database Viterbi implementation in PostgreSQL relative to an open-source CRF library, and show the performance benefits of our optimizations.

---

BibTeX citation:

@techreport{Wang:EECS-2009-120,
    Author= {Wang, Daisy Zhe and Michelakis, Eirinaios Chrysovalantis and Franklin, Michael and Hellerstein, Joseph M. and Garofalakis, Minos},
    Title= {Declarative Information Extraction in a Probabilistic Database System},
    Year= {2009},
    Month= {Aug},
    Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2009/EECS-2009-120.html},
    Number= {UCB/EECS-2009-120},
    Abstract= {Full-text documents represent a large fraction of the world's data. Although not structured per se, they often contain snippets of structured information within them: e.g., names, addresses, and document titles. Information Extraction (IE) techniques identify such structured information in text. In recent years, database research
has pursued IE on two fronts: declarative languages and systems for managing IE tasks, and IE as an uncertain data source for Probabilistic Databases. It is natural to consider merging these two directions, but efforts to do so have had to compromise on the statistical robustness of IE algorithms in order to fit with early Probabilistic
Database models.

In this paper, we bridge the gap between these ideas by implementing a state-of-the-art statistical IE approach – Conditional Random Fields (CRFs) – in the setting of Probabilistic Databases that treat statistical models as first-class data objects. Using standard relational tables to capture CRF parameters, and inverted-file representations
of text, we show that the Viterbi algorithm for CRF
inference can be specified declaratively in recursive SQL, in a manner that can both choose likely segmentations, and provide detailed marginal distributions for label assignment. Given this implementation, we propose query processing optimizations that effectively combine probabilistic inference and relational operators such as selections and joins. In an experimental study with two data sets, we demonstrate the efficiency of our in-database Viterbi implementation in PostgreSQL relative to an open-source CRF library, and show the performance benefits of our optimizations.},
}

EndNote citation:

%0 Report
%A Wang, Daisy Zhe 
%A Michelakis, Eirinaios Chrysovalantis 
%A Franklin, Michael 
%A Hellerstein, Joseph M. 
%A Garofalakis, Minos 
%T Declarative Information Extraction in a Probabilistic Database System
%I EECS Department, University of California, Berkeley
%D 2009
%8 August 15
%@ UCB/EECS-2009-120
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2009/EECS-2009-120.html
%F Wang:EECS-2009-120