Full Description
Language tests play pivotal roles in education, research on learning, and gate-keeping decisions. The central concern for language testing professionals is how to investigate whether or not tests are appropriate for their intended purposes. This book introduces an argument-based validity framework to help with the design of research that investigates the validity of language test interpretation and use. The book presents the principal concepts and technical terms, then shows how they can be implemented successfully in practice through a variety of validation studies. It also demonstrates how argument-based validity intersects with technology in language testing research and highlights the use of validity argument for identifying research questions and interpreting the results of validation research. Use of the framework helps researchers in language testing to communicate clearly and consistently about technical issues with each other and with researchers of other types of tests.
Contents
1. Introduction to Validity Argument in Language Testing and Assessment Carol A. Chapelle, Erik Voss; 2. Understanding Argument-based Validity in Language Testing Carol A. Chapelle, Hye-won Lee; 3. A Systematic Review of Argument-based Validation Studies in the Field of Language Testing (2000-2018) Ahmet Dursun, Zhi Li; 4. Domain Definition Inference for a Virtual Interactive Aviation English Test (VIAET) for Military Air Traffic Controllers Moonyoung Park; 5. Support for the Evaluation Inference: Investigating Conditions for Rating Responses on a Test of Academic Oral Language Hyejin Yang; 6. Generalization Inference for a Computer-mediated Graphic-prompt Writing Test for ESL Placement YunDeok Choi; 7. The Telephone Standard Speaking Test: an Outside Evaluator's Investigation of a Rebuttal to the Generalization Inference Rie Koizumi; 8. The Explanation Inference for a Test of Academic English Collocational Ability Erik Voss; 9. Extrapolation of the Meaning of Grades on Writing Tasks in an ESL Writing Class to Success on Tasks in University Courses Jooyoung Lee; 10. Justifying the Interpretation and Use of an ESL Writing Final Examination Heesung Jun; 11. An Argument for Use of a Test of Productive Grammatical Ability for Placement into Writing Classes Yoo-Ree Chung; 12. Investigating the Consequences of an ESL Placement Test Zhi Li; 13. Validation Research and its Limits Carol A. Chapelle, Erik Voss.
