Automated Essay Scoring
暫譯: 自動化論文評分
Beata Beigman Klebanov , Nitin Madnani
- 出版商: Morgan & Claypool
- 出版日期: 2021-11-12
- 售價: $3,210
- 貴賓價: 9.5 折 $3,050
- 語言: 英文
- 頁數: 314
- 裝訂: Quality Paper - also called trade paper
- ISBN: 1636392229
- ISBN-13: 9781636392226
海外代購書籍(需單獨結帳)
相關主題
商品描述
This book discusses the state of the art of automated essay scoring, its challenges and its potential. One of the earliest applications of artificial intelligence to language data (along with machine translation and speech recognition), automated essay scoring has evolved to become both a revenue-generating industry and a vast field of research, with many subfields and connections to other NLP tasks. In this book, we review the developments in this field against the backdrop of Elias Page's seminal 1966 paper titled "The Imminence of Grading Essays by Computer."
Part 1 establishes what automated essay scoring is about, why it exists, where the technology stands, and what are some of the main issues.In Part 2, the book presents guided exercises to illustrate how one would go about building and evaluating a simple automated scoring system, while Part 3 offers readers a survey of the literature on different types of scoring models, the aspects of essay quality studied in prior research, and the implementation and evaluation of a scoring engine. Part 4 offers a broader view of the field inclusive of some neighboring areas, and Part \ref{part5} closes with summary and discussion.
This book grew out of a week-long course on automated evaluation of language production at the North American Summer School for Logic, Language, and Information (NASSLLI), attended by advanced undergraduates and early-stage graduate students from a variety of disciplines. Teachers of natural language processing, in particular, will find that the book offers a useful foundation for a supplemental module on automated scoring. Professionals and students in linguistics, applied linguistics, educational technology, and other related disciplines will also find the material here useful.
商品描述(中文翻譯)
這本書探討了自動化作文評分的最新技術、挑戰及其潛力。自動化作文評分是人工智慧在語言數據上的早期應用之一(與機器翻譯和語音識別並列),它已發展成為一個創造收入的產業和一個廣泛的研究領域,擁有許多子領域並與其他自然語言處理(NLP)任務相連。在本書中,我們回顧了這一領域的發展,背景是Elias Page於1966年發表的開創性論文《電腦評分作文的迫切性》。
第一部分確立了自動化作文評分的概念、存在的原因、技術的現狀以及一些主要問題。在第二部分中,本書提供了指導性練習,以說明如何構建和評估一個簡單的自動評分系統,而第三部分則為讀者提供了不同類型評分模型的文獻調查、先前研究中探討的作文質量方面,以及評分引擎的實施和評估。第四部分則提供了該領域的更廣泛視角,包括一些相鄰領域,而第五部分則以總結和討論作結。
這本書源於北美邏輯、語言與信息夏季學校(NASSLLI)上關於語言產出自動評估的一周課程,參加者包括來自各個學科的高年級本科生和早期研究生。特別是自然語言處理的教師會發現這本書為自動評分的補充模組提供了有用的基礎。語言學、應用語言學、教育科技及其他相關學科的專業人士和學生也會發現這裡的材料非常有用。
作者簡介
Beata Beigman Klebanov is a Senior Research Scientist at Educational Testing Service, Princeton, NJ. She specializes in development of language technology for education in the subfields of reading and writing. She has led projects on developing automated methods for assessing quality of arguments, topic development, use of figurative language, as well as worked on methods for estimating text complexity and predicting the rate of oral reading of a given text. She has also worked on the effect of noise in language data on the performance of statistical models, as well as on characteristics of class vs test performance. She is the principal investigator behind Relay Reader(TM) - innovative technology to support development of reading fluency. Dr. Beigman Klebanov's research appeared in leading journals, such as Computational Linguistics, Transactions of the ACL, ACM Transactions on Speech and Language Processing, Journal of AI in Education, Language Testing, Journal of Educational Psychology, as well as in proceedings of top-tier conferences such as Association for Computational Linguistics' annual meetings (ACL), Learning Analytics and Knowledge conferences (LAK), and the annual meetings of the National Council on Measurement in Education (NCME). She has co-organized a series of ACL workshops and shared tasks on processing of metaphor and other types of figurative language. Beata is currently serving as an action editor for the Transactions of the ACL journal and has served as an area chair or senior area chair for the NAACL/ACL conferences in 2019-2022.
Nitin Madnani is a Distinguished Research Engineer in the AI Research Labs at the Educational Testing Service (ETS) in Princeton. His NLP adventures began with an elective course on computational linguistics he took while studying computer architecture at the University of Maryland, College Park. As a Ph.D. student at the Institute of Advanced Computer Studies (UMIACS), he worked on automated document summarization, statistical machine translation, and paraphrase generation. After earning his Ph.D. in 2010, he joined the NLP & Speech research group at ETS where he led--and continues to lead--a wide variety of projects that use NLP to build useful educational applications and technologies. Examples include mining Wikipedia revision history to correct grammatical errors, automatically detecting organizational elements in argumentative discourse, creating a service-based, polyglot framework for implementing robust, high-performance automated scoring & feedback systems, and building the first-ever, fully open-source, comprehensive evaluation toolkit for automated scoring.
作者簡介(中文翻譯)
**Beata Beigman Klebanov** 是位於新澤西州普林斯頓的教育測試服務(Educational Testing Service)資深研究科學家。她專注於教育領域的語言技術開發,特別是在閱讀和寫作的子領域。她主導了多個專案,開發自動化方法來評估論點的質量、主題發展、比喻語言的使用,並研究文本複雜度的估算及預測特定文本的口語閱讀速度。她還研究了語言數據中的噪音對統計模型表現的影響,以及班級與測試表現的特徵。她是 Relay Reader(TM) 的主要研究者,這是一項支持閱讀流暢性發展的創新技術。Beigman Klebanov 博士的研究發表在多個領先的期刊上,如《計算語言學》(Computational Linguistics)、《ACL 會議論文集》(Transactions of the ACL)、《ACM 語音與語言處理期刊》(ACM Transactions on Speech and Language Processing)、《人工智慧在教育中的應用期刊》(Journal of AI in Education)、《語言測試》(Language Testing)、《教育心理學期刊》(Journal of Educational Psychology),以及在頂尖會議的會議論文集中,如計算語言學協會的年會(ACL)、學習分析與知識會議(LAK)和全國教育測量委員會的年會(NCME)。她共同組織了一系列 ACL 研討會和關於隱喻及其他類型比喻語言處理的共享任務。Beata 目前擔任《ACL 會議論文集》的行動編輯,並在 2019-2022 年期間擔任 NAACL/ACL 會議的區域主席或資深區域主席。
**Nitin Madnani** 是位於普林斯頓的教育測試服務(ETS)人工智慧研究實驗室的傑出研究工程師。他的自然語言處理(NLP)冒險始於他在馬里蘭大學(University of Maryland, College Park)學習計算機架構時選修的計算語言學課程。作為馬里蘭大學高級計算機研究所(UMIACS)的博士生,他專注於自動文檔摘要、統計機器翻譯和同義句生成。2010 年獲得博士學位後,他加入了 ETS 的 NLP 和語音研究小組,並主導了多個使用 NLP 建立有用教育應用和技術的專案,並持續領導這些專案。例子包括挖掘維基百科的修訂歷史以糾正語法錯誤、自動檢測論證話語中的組織元素、創建一個基於服務的多語言框架以實現穩健的高效自動評分和反饋系統,以及建立首個完全開源的綜合評估工具包,用於自動評分。