Published:

2021-04-10

Issue:

Vol. 22 No. 2 (2020): July-December

Section:

Reflections on Praxis

Validity and Classroom Language Testing: A Practical Approach

La validez y la evaluación de lenguas en el aula de idiomas: un enfoque práctico

Authors

Keywords:

classroom language testing, language testing, validation, validity (en).

Keywords:

evaluación en el aula de clases, evaluación de lenguas extranjeras, validación, validez (es).

Downloads

Abstract (en)

Validity and validation are common in large-scale language testing. These topics are fundamental because they help stakeholders in testing systems make accurate interpretations of individuals’ language ability and related ensuing decisions. However, there is limited information on validity and validation for classroom language testing, for which interpretations and decisions based on curriculum objectives are paramount, too. In this reflection article, I provide a critical account of these two issues as they are applied in large-scale testing. Next, I use this background to discuss and provide possible applications for classroom language education through a proposed approach for validating classroom language tests. The approach comprises the analyses of curriculum objectives, design of test specifications, analysis of test items, professional design of instruments, statistical calculations, cognitive validation and consequential analyses. I close the article with implications and recommendations for such endeavours and highlight why they are fundamental for high-quality language testing systems in classroom contexts.

Abstract (es)

La validez y la validación son temas de discusión comunes en la evaluación de lenguas a gran escala. Estos temas son fundamentales porque permiten que aquellos involucrados en estos sistemas de evaluación puedan hacer interpretaciones claras, junto con las decisiones que de ellas se desprendan. No obstante, hay poca información en la literatura relacionada con la validez y la validación en contextos de aprendizaje de lenguas, donde las interpretaciones y decisiones basadas en objetivos curriculares también son fundamentales. En este artículo de reflexión, hago una revisión crítica de cómo estos dos temas son utilizados en evaluación a gran escala. Luego uso este contexto para discutir y presentar posibles aplicaciones para el aula de idiomas a través de una propuesta de enfoque para la validación de instrumentos de evaluación en este contexto. El enfoque incluye un análisis de objetivos curriculares, el diseño de especificaciones, el análisis de ítems en instrumentos de evaluación, el diseño profesional de evaluaciones, cálculos estadísticos, la validación cognitiva y, por último, análisis de consecuencias. El artículo lo concluyo con implicaciones y recomendaciones pertinentes para este proceso, además de enfatizar las razones por las cuales es vital para tener sistemas de evaluación de alta calidad.

Author Biography

Frank D. Giraldo, Universidad de Caldas

Universidad de Caldas

References

Alderson, C., Clapham, C., & Wall, D. (1995). Language test construction and evaluation.

Cambridge University Press.

American Educational Research Association, American Psychological Association, & National

Council on Measurement in Education (2014). Standards for educational and psychological testing. American Psychological Association.

Bachman, L. F. (2004). Statistical analyses for language assessment. Cambridge University

Press.

Bachman, L. F. (2005). Building and supporting a case for test use. Language Assessment

Quarterly, 2(1), 1-34. https://doi.org/10.1207/s15434311laq0201_1

Bachman, L. F., & Damböck, B. (2018). Language assessment for classroom teachers. Oxford

University Press.

Bonner, S. M. (2013). Validity in classroom assessment: Purposes, properties, and principles. In

J. H. McMillan (Ed.), Sage handbook of research on classroom assessment (pp. 87–106). Sage.

Brookhart, S. M. (2003). Developing measurement theory for classroom assessment purposes

and uses. Educational Measurement: Issues and Practice, 22(4), 5–12. https://doi.org/10.1111/j.1745-3992.2003.tb00139.x

Brown, H. D., & Abeywickrama, P. (2010). Language assessment: Principles and classroom

practice. Pearson Longman.

Brown, J. D. (2011). Testing in language programs: A comprehensive guide to English language

assessment. McGraw Hill.

Brown, J. D., & Hudson, T. (2002). Criterion-referenced language testing. Cambridge

University Press.

Carr, N. T. (2008). Using Microsoft Excel® to calculate descriptive statistics and create graphs.

Language Assessment Quarterly, 5(1), 43-62. https://doi.org/10.1080/15434300701776336

Carr, N. T. (2011). Designing and analyzing language tests. Oxford University

Press.

Chapelle, C. A. (1999). Validity in language assessment. Annual Review of Applied Linguistics,

, 254-272. https://doi.org/10.1017/S0267190599190135

Chapelle, C. A., Enright, M. K., Jamieson, J. (Eds.) (2008). Building a validity argument for the

test of English as a foreign language. Routledge.

Chapelle, C. A. (2012). Conceptions of validity. In G. Fulcher & F. Davidson (Eds.), The

Routledge handbook of language testing (pp. 21-33). Routledge.

Chapelle, C. A., & Voss, E. (2013). Evaluation of language tests through validation research. In

A. J. Kunnan (Ed.), The Companion to Language Assessment (pp. 1079–1097). John Wiley and Sons, Inc.

Davidson, F., & Lynch, B. (2002). Testcraft: A teacher’s guide to writing and using language

test specifications. Yale University Press.

Douglas, D. (2010). Understanding language testing. Routledge.

Farnsworth, T. (2013). An investigation into the validity of the TOEFL iBT speaking test for

international teaching assistant certification. Language Assessment Quarterly, 10(3), 274-291. https://doi.org/10.1080/15434303.2013.769548

Fulcher, G. (2010). Practical language testing. Hodder Education.

Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment

Quarterly, 9(2), 113-132. https://doi.org/10.1080/15434303.2011.642041

Giraldo, F. (2018). Language assessment literacy: Implications for language teachers. Profile:

Issues in Teachers’ Professional Development, 20(1), 179-195. https://doi.org/10.15446/profile.v20n1.62089

Giraldo, F. (2019). Designing language assessments in context: Theoretical, technical, and

institutional considerations. HOW Journal, 26(2), 123-143. https://doi.org/10.19183/how.26.2.512

Green, A. (2014). Exploring language assessment and testing. New York, USA: Routledge.

Herrera, L., & Macías, D. (2015). A call for language assessment literacy in the education and

development of Teachers of English as a foreign language. Colombian Applied Linguistics Journal, 17(2), 302-312. https://doi.org/10.14483/udistrital.jour.calj.2015.2.a09

Hughes, A. (2002). Testing for language teachers: Second edition. Cambridge

University Press.

Inbar-Lourie, O. (2017). Language assessment literacy. In E. Shohamy, S. May, & I. Or (Eds.),

Language Testing and Assessment (3rd ed., pp. 257-268). Springer.

Kane, M. (2006). Validation. In Brennan, R. (Ed.), Educational measurement (4th ed. pp. 17–

. American Council on Education and Praeger.

Kane, M. (2012). Articulating a validity argument. In G. Fulcher & F. Davidson (Eds.), The

Routledge handbook of language testing (pp. 34-47). Routledge.

Kane, M., & Wools, S. (2019). Perspectives on the validity of classroom assessments. In S.

Brookhart & J. McMillan (Eds.), Classroom assessment and educational measurement (pp. 11-26). Routledge.

Lado, R. (1961). Language testing: The construction and use of foreign language tests.

McGraw Hill.

Llosa, L. (2007). Validating a standards-based classroom assessment of English proficiency: A

multitrait-multimethod approach. Language Testing, 24(4), 489-515. https://doi.org/10.1177/0265532207080770

Long, M. (2015). Second language acquisition and task-based language teaching. John Wiley

and Sons, Inc.

López, A., & Bernal, R. (2009). Language testing in Colombia: A call for more teacher

education and teacher training in language assessment. Profile: Issues in Teachers’ Professional Development, 11(2), 55-70.

Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement. (3rd ed., pp.

-103). Macmillan.

Messick, S. (1994). The interplay of evidence and consequences in the validation of performance

assessments. Educational Researcher, 23, 13–23. https://doi.org/10.3102/0013189X023002013

Ministerio de Educación Nacional de Colombia (2006). Estándares básicos de competencias en

lenguas extranjeras: Inglés. Formar en lenguas extranjeras: ¡el reto! Lo que necesitamos saber y saber hacer. Imprenta Nacional.

Norris, J. (2016). Current uses for task-based language assessment. Annual Review of Applied

Linguistics, 36, 230–244. https://doi.org/10.1017/S0267190516000027

Pardo-Ballester, C. (2010). The validity argument of a web-based Spanish listening exam: Test

usefulness evaluation. Language Assessment Quarterly, 7(2), 137-159. https://doi.org/10.1080/15434301003664188

Popham, J. (2003). Test better, teach better. The instructional role of assessment. Association for

Supervision and Curriculum Development.

Popham, J. (2017). Classroom assessment: What teachers need to know. Eighth edition.

Pearson.

Tsagari, D., Vogt, K., Froelich, V., Csépes, I., Fekete, A., Green A., Hamp-Lyons, L., Sifakis, N.

&, Kordia, S. (2018). Handbook of assessment for language teachers. Retrieved from: http://taleproject.eu/

Vogt, K., & Tsagari, D. (2014). Assessment literacy of foreign language teachers: Findings of a

European study. Language Assessment Quarterly, 11(4), 374-402. https://doi.org/10.1080/15434303.2014.960046

Xi, X., & Sawaki, Y. (2017). Methods of test validation. In E. Shohamy, I. G. Or, & S. May

(Eds.), Language testing and assessment: Encyclopedia of language and education (3rd ed., pp. 193-210). Cham, Switzerland: Springer. https://doi.org/10.1007/978-3-319-02261-1_19

How to Cite

APA

Giraldo, F. D. (2021). Validity and Classroom Language Testing: A Practical Approach. Colombian Applied Linguistics Journal, 22(2), 194–206. Retrieved from https://revistas.udistrital.edu.co/index.php/calj/article/view/15998

ACM

[1]
Giraldo, F.D. 2021. Validity and Classroom Language Testing: A Practical Approach. Colombian Applied Linguistics Journal. 22, 2 (Apr. 2021), 194–206.

ACS

(1)
Giraldo, F. D. Validity and Classroom Language Testing: A Practical Approach. Colomb. appl. linguist. j 2021, 22, 194-206.

ABNT

GIRALDO, F. D. Validity and Classroom Language Testing: A Practical Approach. Colombian Applied Linguistics Journal, [S. l.], v. 22, n. 2, p. 194–206, 2021. Disponível em: https://revistas.udistrital.edu.co/index.php/calj/article/view/15998. Acesso em: 11 apr. 2021.

Chicago

Giraldo, Frank D. 2021. “Validity and Classroom Language Testing: A Practical Approach”. Colombian Applied Linguistics Journal 22 (2):194-206. https://revistas.udistrital.edu.co/index.php/calj/article/view/15998.

Harvard

Giraldo, F. D. (2021) “Validity and Classroom Language Testing: A Practical Approach”, Colombian Applied Linguistics Journal, 22(2), pp. 194–206. Available at: https://revistas.udistrital.edu.co/index.php/calj/article/view/15998 (Accessed: 11April2021).

IEEE

[1]
F. D. Giraldo, “Validity and Classroom Language Testing: A Practical Approach”, Colomb. appl. linguist. j, vol. 22, no. 2, pp. 194–206, Apr. 2021.

MLA

Giraldo, F. D. “Validity and Classroom Language Testing: A Practical Approach”. Colombian Applied Linguistics Journal, vol. 22, no. 2, Apr. 2021, pp. 194-06, https://revistas.udistrital.edu.co/index.php/calj/article/view/15998.

Turabian

Giraldo, Frank D. “Validity and Classroom Language Testing: A Practical Approach”. Colombian Applied Linguistics Journal 22, no. 2 (April 10, 2021): 194–206. Accessed April 11, 2021. https://revistas.udistrital.edu.co/index.php/calj/article/view/15998.

Vancouver

1.
Giraldo FD. Validity and Classroom Language Testing: A Practical Approach. Colomb. appl. linguist. j [Internet]. 2021Apr.10 [cited 2021Apr.11];22(2):194-206. Available from: https://revistas.udistrital.edu.co/index.php/calj/article/view/15998

Download Citation

Visitas

169

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...