Mapping the 'TOEFL iBT'® Test Scores to China's Standards of English Language Ability: Implications for Score Interpretation and Use. TOEFL® Research Report. RR-89. ETS RR-19-44

Educational Testing Service. Rosedale Road, MS19-R Princeton, NJ 08541. Tel: 609-921-9000; Fax: 609-734-5410; e-mail: [email protected]; Web site: https://www.ets.org/research/policy_research_reports/ets

Y

49

English (Second Language); Language Tests; Second Language Learning; Computer Assisted Testing; Scores; Language Proficiency; Correlation; Guidelines; Rating Scales; Standards; Classification; Context Effect; Foreign Countries; Decision Making; Standard Setting; Cutting Scores; Alignment (Education); Test Validity; Comparative Analysis

2330-8516

The past decade has seen an emerging interest in mapping (aligning or linking) test scores to language proficiency levels of external performance scales or frameworks, such as the Common European Framework of Reference (CEFR), as well as locally developed frameworks, such as China's Standards of English Language Ability (CSE). Such alignment is ultimately a claim about the interpretation of test scores in relation to external levels of language proficiency. To support such a claim, established procedures should be carefully implemented and multiple sources of evidence should be collected. In this research report, we demonstrate the application of a series of steps in building an argument for aligning the scores of the "TOEFL iBT"® test, an international, large-scale language proficiency test of English as a foreign language (EFL), to the levels of the CSE. The alignment process comprised the following steps: (a) establishing construct congruence between the TOEFL iBT test and the CSE; (b) establishing recommended minimum test scores (cut scores), set by local experts, to classify language learners into the local proficiency levels; (c) collection of scores by test takers (N = 1,326) and evaluations of the test takers' proficiency levels by their teachers, based on the local framework; and (d) consideration of the results of other alignment studies in the local context as well as the link between the CEFR and the CSE levels. We conclude with a discussion of the contextual issues that should be considered when interpreting test scores in relation to external proficiency levels. These contextual issues are important considerations because they have the potential to impact score-based decisions on individuals and institutions. We also discuss the implications for similar alignment research.

As Provided

2019

EJ1238353