Resourses to assess narrative texts in Primary Education and teacher feedback analysis
DOI:
https://doi.org/10.35575/rvucn.n64a5Keywords:
Feedback, Checklist, Rubric, Narrative writingAbstract
The present investigation has a twin objective; exploring if both rubric and checklist have criterion validity, being able to assess same elements, minimizing differences between marks, and analyzing the feedbacks, given by the raters, to elementary students´ writing competence. For that purpose, 56 future primary teachers assessed two different narrative text, using the two mentioned assessments instrument, and coming up with a feedback for each of the considered criteria. These latter feedbacks were categorized according to their amplitude and their evaluative and meta-textual content. Afterwards, a factorial and descriptive analysis were carried out to examine the data. Results show how global points, assigned by both instruments, rubric and checklist, are significantly related and how feedbacks given by future teachers using the rubric are meta-textually variated and complete. Thus, it could be concluded that both examined assessment instrument can be used by teachers to produce a fair judgement; as well as using rubric generates specific feedbacks, related to varied language aspects and characteristics.
Downloads
References
Applebee, A. (1984). Writing and reasoning. Review of Educational Research, 54(4), 577–596. https://www.jstor.org/stable/1170176?seq=1
Bazerman, C. (2013). Understanding the lifelong journey of writing development. Infancia y Aprendizaje, 36(4), 421-441. https://doi.org/10.1174/021037013808200320
Contreras, L. A., González, M., y Urías, E. (2009). Evaluación de la escritura mediante rúbrica en la educación primaria en México. Interamerican Journal of Psychology, 43(3), 518-531. https://www.redalyc.org/pdf/284/28412903011.pdf
Fang, Z., & Wang, Z. (2011). Beyond rubrics: Using functional language analysis to evaluate student writing. Australian Journal of Language and Literacy, The, 34(2), 147-165. https://search.informit.org/doi/10.3316/ielapa.112929734219836
Fernández, M. J. (2017). Co-evaluación de textos narrativos en la Educación Obligatoria (Tesis de doctorado). Universidad de Extremadura.
Fernández, M. J., Lucero, M., y Montanero, M. (2016). Rojo sobre negro. ¿Cómo evalúan los maestros las redacciones de sus estudiantes? Revista de Educación, (372), 63-82. https://dialnet-unirioja-es.ezproxy.nebrija.es/servlet/articulo?codigo=5399659
Fernández, M. J., Montanero, M., y Lucero, M. (2019). La evaluación de la competencia narrativa en la educación básica. The assessment of narrative competence during compulsory schooling. Revista de Educación, (383), 85-112. 4. https://www.doi.org/10.4438/1988-592X-RE-2019-383-402
Gallego, T. M., y Muñoz, M. T. (enero-abril, 2020). Construcción de la lengua escrita en preescolar, a través de la variedad textual, en una zona rural de Antioquia. Revista Virtual Universidad Católica del Norte, (59), 111-132. https://doi.org/10.35575/rvucn.n59a7
Ghaffar, M. A., Khairallah, M., & Salloum, S. (2020). Co-constructed rubrics and assessment for learning: The impact on middle school students´ attitudes and writing skills. Assessing Writing, 45, 1-12. https://doi.org/10.1016/j.asw.2020.100468
Graham, S. (2006). Writing. In P. Alexander y P. Winne (Eds.), Handbook of educational psychology (pp. 457–478). Erlbaum.
Graham, S., Gillespie, A., & McKeown, D. (2013). Writing: Importance, development, and instruction. Reading and Writing, 26(1), 1-15. https://doi.org/10.1007/s11145-012-9395-2
Graham, S., & Hebert, M. (2010). Writing to Read. Alliance for Excellent Education.
Graham, S., & Hebert, M. (2011). Writing-to-read: A meta-analysis of the impact of writing and writing instruction on reading. Harvard Educational Review, 81(4), 710–744. https://doi.org/10.17763/haer.81.4.t2k0m13756113566
Heldsinger, S., & Humphry, S. (2010). Using the method of pairwise comparison to obtain reliable teacher assessments. The Australian Educational Researcher, 37(2), 1-19. https://doi.org/10.1007/BF03216919
Hyland, K. (2003). Second Language Writing. Cambridge University Press.
Jølle, L. (2014). Pair assessment of pupil writing: A dialogic approach for studying the development of rater competence. Assessing Writing, 20, 37–52. https://doi.org/10.1016/j.asw.2014.01.002
Kayapinar, U. (2014). Measuring essay assessment: Intra-rater and inter-rater reliability. Eurasian Journal of Educational Research, 14(57), 113-136. https://doi.org/10.14689/ejer.2014.57.2
Ministry of Education of Ontario. (2006). A guide to effective literacy instruction. Volume two. Assessment. http://www.eworkshop.on.ca/edu/resources/guides/Guide_Lit_456_Vol_2_Assessement.pdf
Montanero, M. (2019). Didáctica General. Universidad de Extremadura.
Montanero, M., Lucero, M., y Fernández, M. J. (2014). Iterative co-evaluation with a rubric of narrative texts in primary education. Infancia y Aprendizaje: Journal for the Study of Education and Development, 37, 184–220. https://doi.org/10.1080/02103702.2014.881653
OCDE. (2018). Programa para la evaluación internacional de estudiantes (PISA). https://www.oecd.org/pisa/publications/PISA2018_CN_esp_ESP.pdf
Otnes, H., & Solheim, R. (2019). Acts of responding. Teachers´ written comments and students´ text revisions. Assessment in Education: Principles, Policy & Practice, 26(6), 700-720. https://doi.org/10.1080/0969594X.2019.1595524
Parr, J., & Timperley, H. (2008). Teachers, schools and using evidence: Considerations of preparedness. Assessment in Education: Principles, Policy and Practice, 15(1), 57-71. https://doi.org/10.1080/09695940701876151
Pérez, P. (2008). La comprensión lectora y la competencia en comunicación lingüística en el nuevo marco curricular: algunas claves para su desarrollo. Participación Educativa, 8, 41-56. https://revistas-um-es.ezproxy.nebrija.es/educatio/article/view/71081
Popham, W. J. (1990). Modern Educational Measurement: A Practitioner´s Perspective (2nd Ed.). Prentice-Hall.
Romero, M. A., Edna, L., y Silva, A. (2002). Evaluación de las aptitudes para el aprendizaje escolar. En L. Edna y A. Silva, Evaluación psicológicas en el área educativa (pp. 37-81). Pax México.
Sandiford, C., & Macken-Horarik, M. (2020). Changing stories: Linguistically-informed assessment of development in narrative writing. Assessing Writing, 45, 1-15. https://doi.org/10.1016/j.asw.2020.100471
Schleppegrell, M. (2004). The language of schooling: A functional linguistics perspective. Erlbaum.
Scull, J., Mackenzie, N. M., & Bowles, T. (2020). Assessing early writing: a six-factor model to inform assessment and teaching. Educational Research for Policy and Practice, 1-21. https://doi.org/10.1007/s10671-020-09257-7
Skar, G. B., & Jølle, L. J. (2017). Teachers as raters: Investigation of a long term writing assessment program. L1 Educational Studies in Language and Literature, 17, 1-30. https://doi.org/10.17239/L1ESLL-2017.17.01.06
Smyth, J. (1998). Written emotional expression: Effect sizes, outcome types, and moderating variables. Journal of Consulting and Clinical Psychology, 66(1), 174–184. https://doi.org/10.1037/0022-006X.66.1.174
Uribe-Enciso, O. L., y Carrillo-García, S. (2014). Relación entre la lecto-escritura, el desempeño académico y la deserción estudiantil. Entramado, 10(2), 272-285. https://revistas.unilibre.edu.co/index.php/entramado/article/view/3509
Uzun, N. B., Alici, D., & Aktas, M. (2019). Reliability of the Analytic Rubric and Checklist for the Assessment of Story Writing Skills: G and Decision Study in Generalizability Theory. European Journal of Educational Research, 8(1), 169-180. https://doi.org/10.12973/eu-jer.8.1.169