Information Retrieval Evaluation (Synthesis Lectures on Information Concepts, Retrieval, and Services)
Donna Harman
- 出版商: Morgan & Claypool
- 出版日期: 2011-06-03
- 售價: $1,410
- 貴賓價: 9.5 折 $1,340
- 語言: 英文
- 頁數: 120
- 裝訂: Paperback
- ISBN: 1598299719
- ISBN-13: 9781598299717
海外代購書籍(需單獨結帳)
相關主題
商品描述
The lecture starts with a discussion of the early evaluation of information retrieval systems, starting with the Cranfield testing in the early 1960s, continuing with the Lancaster "user" study for MEDLARS, and presenting the various test collection investigations by the SMART project and by groups in Britain. The emphasis in this chapter is on the how and the why of the various methodologies developed. The second chapter covers the more recent "batch" evaluations, examining the methodologies used in the various open evaluation campaigns such as TREC, NTCIR (emphasis on Asian languages), CLEF (emphasis on European languages), INEX (emphasis on semi-structured data), etc. Here again the focus is on the how and why, and in particular on the evolving of the older evaluation methodologies to handle new information access techniques. This includes how the test collection techniques were modified and how the metrics were changed to better reflect operational environments. The final chapters look at evaluation issues in user studies -- the interactive part of information retrieval, including a look at the search log studies mainly done by the commercial search engines. Here the goal is to show, via case studies, how the high-level issues of experimental design affect the final evaluations.
Table of Contents: Introduction and Early History / "Batch" Evaluation Since 1992 / Interactive Evaluation / Conclusion