John Alexander Edwards

EECS Department, University of California, Berkeley

Technical Report No. UCB/EECS-2007-76

May 29, 2007

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2007/EECS-2007-76.pdf

As libraries increasingly digitize their collections, there are growing numbers of scanned manuscripts that current OCR and handwriting recognition techniques cannot transcribe, because the systems are not trained for the scripts in which these manuscripts are written. Documents in this category range from illuminated medieval manuscripts to handwritten letters to early printed works. Without transcriptions, these documents remain unsearchable. Unfortunately with existing methods, a user must manually label large amounts of text in the target font to adapt the system to a new script. Some systems require that a user manually segment and label instances of each glyph. Others provide for less costly training, allowing a user to segment and label entire lines of text instead of individual characters. Still, the collections we consider are extremely diverse, to the extent that in some cases almost every document may be in a different style. Because of this, the cost of manually transcribing dozens of lines of text for each font is prohibitively high. <p> In this dissertation, we introduce methods that significantly reduce the manual labor involved in training a character recognizer to new scripts. Rather than forcing a user to transcribe portions of each target document, our system leverages general language statistics to identify regions of the document from which it may automatically extract new training exemplars. Unlike document specific transcriptions, these language statistics may be generated in a largely unsupervised manner, allowing our system to automate the process of building a model of scripts. We demonstrate the effectiveness of the model thus generated by using it to build a search engine for a Medieval illuminated manuscript.

Advisors: David Forsyth

---

BibTeX citation:

@phdthesis{Edwards:EECS-2007-76,
    Author= {Edwards, John Alexander},
    Title= {Easily Adaptable Handwriting Recognition in Historical Manuscripts},
    School= {EECS Department, University of California, Berkeley},
    Year= {2007},
    Month= {May},
    Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2007/EECS-2007-76.html},
    Number= {UCB/EECS-2007-76},
    Abstract= {As libraries increasingly digitize their collections, there are growing numbers of scanned manuscripts that current OCR and handwriting recognition techniques cannot transcribe, because the systems are not trained for the scripts in which these manuscripts are written. Documents in this category range from illuminated medieval manuscripts to handwritten letters to early printed works. Without transcriptions, these documents remain unsearchable. Unfortunately with existing methods, a user must manually label large amounts of text in the target font to adapt the system to a new script. Some systems require that a user manually segment and label instances of each glyph. Others provide for less costly training, allowing a user to segment and label entire lines of text instead of individual characters. Still, the collections we consider are extremely diverse, to the extent that in some cases almost every document may be in a different style. Because of this, the cost of manually transcribing dozens of lines of text for each font is prohibitively high.
<p>
In this dissertation, we introduce methods that significantly reduce the manual labor involved in training a character recognizer to new scripts. Rather than forcing a user to transcribe portions of each target document, our system leverages general language statistics to identify regions of the document from which it may automatically extract new training exemplars. Unlike document specific transcriptions, these language statistics may be generated in a largely unsupervised manner, allowing our system to automate the process of building a model of scripts. We demonstrate the effectiveness of the model thus generated by using it to build a search engine for a Medieval illuminated manuscript.},
}

EndNote citation:

%0 Thesis
%A Edwards, John Alexander 
%T Easily Adaptable Handwriting Recognition in Historical Manuscripts
%I EECS Department, University of California, Berkeley
%D 2007
%8 May 29
%@ UCB/EECS-2007-76
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2007/EECS-2007-76.html
%F Edwards:EECS-2007-76