Recall is the Proper Evaluation Metric for Word Segmentation
- Yan Shao,
- ,
- Joakim Nivre
- Uppsala University
Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-reviewOpen access
Publication Information
Output type
Research Output:
Conference Article in Proceeding or Book/Report chapter
Article in proceedings
Peer-reviewOriginal language
EnglishPages from-to (Number of pages)
Pages 86–90 (5 pages)Publication milestones
- Published - 01/12/2017
Publication status
Published - 01/12/2017
ISBN (Print)
978-1-948087-01-8 Publication IDs
- ORCID: /0000-0002-6103-7275/work/106363237
- Scopus: 85018397031
Host publication title
Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers)Abstract
We extensively analyse the correlations and drawbacks of conventionally employed evaluation metrics for word segmentation. Unlike in standard information retrieval, precision favours under-splitting systems and therefore can be misleading in word segmentation. Overall, based on both theoretical and experimental analysis, we propose that precision should be excluded from the standard evaluation metrics and that the evaluation score obtained by using only recall is sufficient and better correlated with the performance of word segmentation systems.
Access to documents
Final published version
