| Year: 2005 | 
Download Free Adobe Acrobat Reader |
| LHNCBC-2005-051 |
| The Importance of the Lexicon in Tagging Biological Text |
| Smith LH, Rindflesch TC, Wilbur WJ |
| Natural Language Engineering 2005. |
| Motivation: A part-of-speech tagger is a fundamental and indispensable tool in computational linguistics, typically employed at the critical early stages of processing. Although taggers are widely available that achieve high accuracy in very general domains, these do not perform nearly as well when applied to novel specialized domains, and this is especially true with biological text. Results: We present a stochastic tagger that achieves over 97.44% accuracy on MEDLINE abstracts. A primary component of the tagger is its lexicon which enumerates the permitted parts-of-speech for the 10,000 words most frequently occurring in MEDLINE. We present evidence for the conclusion that the lexicon is as vital to tagger accuracy as a training corpus, and more important than previously thought. |
| PDF |
