Apportioning development effort in a probabilistic LR parsing system through evaluation

Carroll, John and Briscoe, Ted (1996) Apportioning development effort in a probabilistic LR parsing system through evaluation. Conference on Empirical Methods in Natural Language Processing, Philadelphia, Pa. USA, 17-18 May 1996. Published in: Conference on Empirical Methods in Natural Language Processing. 92-100. ACL Anthology

[img] PDF - Published Version
Available under License Creative Commons Attribution-NonCommercial ShareAlike.

Download (891kB)

Abstract

We describe an implemented system for robust domain-independent syntactic parsing of English, using a unification-based grammar of part-of speech and punctuation labels coupled with a probabilistic LR parser. We present evaluations of the system's performance along several different dimensions; these enable us to assess the contribution that each individual part is making to the success of the system as a whole, and thus prioritise the effort to be devoted to its further enhancement. Currently, the system is able to parse around 80% of sentences in a substantial corpus of general text containing a number of distinct genres. On a random sample of 250 such sentences the system has a mean crossing bracket rate of 0.71 and recall and precision of 83% and 84~0 respectively when evaluated against manually-disambiguated analyses.

Item Type: Conference Proceedings
Schools and Departments: School of Engineering and Informatics > Informatics
SWORD Depositor: Mx Elements Account
Depositing User: Mx Elements Account
Date Deposited: 05 Aug 2021 11:27
Last Modified: 05 Aug 2021 11:27
URI: http://sro.sussex.ac.uk/id/eprint/100957

View download statistics for this item

📧 Request an update