New tool ROUGE revolutionizes automatic evaluation of text summaries.
The ROUGE package helps evaluate how good a computer-generated summary is by comparing it to ideal human-made summaries. It uses measures like counting overlapping words and phrases. The package includes four different ROUGE measures: ROUGE-N, ROUGE-L, ROUGE-W, and ROUGE-S. These measures were used in a big summarization evaluation called DUC 2004.