Automated Essay Scoring

This new volume is the first to focus entirely on automated essay scoring and evaluation. It is intended to provide a comprehensive overview of the evolution and state-of-the-art of automated essay scoring and evaluation technology across several disciplines, including education, testing and measurement, cognitive science, computer science, and computational linguistics. The development of this technology has led to many questions and concerns. Automated Essay Scoring attempts to address some of these questions including: *How can automated scoring and evaluation supplement classroom instruction? *How does the technology actually work? *Can it improve students' writing? *How reliable is the technology? *How can these computing methods be used to develop evaluation tools? *What are the state-of the-art essay evaluation technologies and automated scoring systems? Divided into four parts, the first part reviews the teaching of writing and how computers can contribute to it. Part II analyzes actual automated essay scorers including e-raterTM, Intellimetric, and the Intelligent Essay Assessor. The third part analyzes related psychometric issues, and the final part reviews innovations in the field. This book is ideal for researchers and advanced students interested in automated essay scoring from the fields of testing and measurement, education, cognitive science, language, and computational linguistics.

Jill C. Burstein Mark D. Shermis

Contents: C. Bereiter, Foreword. M.D. Shermis, J.C. Burstein, Preface. Introduction. Part I:Teaching of Writing.M. Myers, What Can Computers Contribute to a K-12 Writing Program? Part II:Psychometric Issues in Performance Assessment.G.K.W.K. Chung, E.L. Baker, Issues in the Reliability and Validity of Automated Scoring of Constructed Responses. Part III:Automated Essay Scorers.E.B. Page, Project Essay Grade: PEG. L.S. Larkey, W.B. Croft, A Text Categorization Approach to Automated Essay Grading. S. Elliot, Intellimetric(TM): From Here to Validity. T.K. Landauer, D. Laham, P.W. Foltz, Automated Scoring and Annotation of Essays With the Intelligent Essay Assessor. J. Burstein, The E-Rater(R) Scoring Engine: Automated Essay Scoring With Natural Language Processing. Part IV:Psychometric Issues in Automated Essay Scoring.G.J. Cizek, B.A. Page, The Concept of Reliability in the Context of Automated Essay Scoring. T.Z. Keith, Validity and Automated Essay Scoring Systems. M.D. Shermis, K.E. Daniels, Norming and Scaling for Automated Essay Scoring. S. Ponisciak, V. Johnson, Bayesian Analysis of Essay Grading. Part V:Current Innovation in Automated Essay Evaluation.C. Leacock, M. Chodorow, Automated Grammatical Error Detection. J.C. Burstein, D. Marcu, Automated Evaluation of Discourse Structure in Student Essays.