- Abstract:
- This article considers the automatic evaluation of information ordering, a task underlying many text-based applications such as concept-to-text generation and multidocument summarization. We propose an evaluation method based on Kendall's tau, a metric of rank correlation. The method is inexpensive, robust, and representation independent. We show that Kendall's tau correlates reliably with human ratings and reading times.
- Links To Paper
- No links available
- Bibtex format
- @Article{EDI-INF-RR-1037,
- author = {
Mirella Lapata
},
- title = {Automatic Evaluation of Information Ordering: Kendall's Tau},
- journal = {Computational Linguistics},
- publisher = {MIT Press},
- year = 2006,
- month = {Dec},
- volume = {32 (4)},
- pages = {471-484},
- doi = {10.1162/coli.2006.32.4.471},
- }
|
