Hostname: page-component-5d59c44645-7l5rh Total loading time: 0 Render date: 2024-02-29T16:38:34.698Z Has data issue: false hasContentIssue false

The Penn Chinese TreeBank: Phrase structure annotation of a large corpus

Published online by Cambridge University Press:  19 May 2005

NAIWEN XUE
Affiliation:
University of Pennsylvania, Philadelphia, PA 19104, USA e-mail: xueniwen@linc.cis.upenn.edu,fxia@linc.cis.upenn.edu,chioufd@linc.cis.upenn.edu,mpalmer@linc.cis.upenn.edu
FEI XIA
Affiliation:
University of Pennsylvania, Philadelphia, PA 19104, USA e-mail: xueniwen@linc.cis.upenn.edu,fxia@linc.cis.upenn.edu,chioufd@linc.cis.upenn.edu,mpalmer@linc.cis.upenn.edu
FU-DONG CHIOU
Affiliation:
University of Pennsylvania, Philadelphia, PA 19104, USA e-mail: xueniwen@linc.cis.upenn.edu,fxia@linc.cis.upenn.edu,chioufd@linc.cis.upenn.edu,mpalmer@linc.cis.upenn.edu
MARTA PALMER
Affiliation:
University of Pennsylvania, Philadelphia, PA 19104, USA e-mail: xueniwen@linc.cis.upenn.edu,fxia@linc.cis.upenn.edu,chioufd@linc.cis.upenn.edu,mpalmer@linc.cis.upenn.edu

Abstract

With growing interest in Chinese Language Processing, numerous NLP tools (e.g., word segmenters, part-of-speech taggers, and parsers) for Chinese have been developed all over the world. However, since no large-scale bracketed corpora are available to the public, these tools are trained on corpora with different segmentation criteria, part-of-speech tagsets and bracketing guidelines, and therefore, comparisons are difficult. As a first step towards addressing this issue, we have been preparing a large bracketed corpus since late 1998. The first two installments of the corpus, 250 thousand words of data, fully segmented, POS-tagged and syntactically bracketed, have been released to the public via LDC (www.ldc.upenn.edu). In this paper, we discuss several Chinese linguistic issues and their implications for our treebanking efforts and how we address these issues when developing our annotation guidelines. We also describe our engineering strategies to improve speed while ensuring annotation quality.

Type
Papers
Copyright
2005 Cambridge University Press

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)