Digital rubric-based assessment of oral presentation competence with technological resources for preservice teachers
Contenido principal del artículo
Resumen
Evaluación basada en rúbricas digitales de la competencia de presentación oral con recursos tecnológicos para profesorado en formación
Este estudio está dirigido a la e-evaluación de la competencia de presentación oral utilizando recursos tecnológicos en un modelo activo que combina aprendizaje basado en proyectos y aula invertida. Este estudio aplica el uso de una rúbrica digital para la evaluación de la competencia en presentación oral en diferentes situaciones de evaluación activa y progresiva de 99 futuros docentes en las que la participación es opcional u obligatoria. Los resultados muestran que la rúbrica digital empleada en varios momentos es una metodología y una tecnología que facilita el proceso de retroalimentación y diálogo entre docentes y estudiantes sobre los criterios de evaluación. Los resultados apoyan futuras decisiones de diseño metodológico de evaluación formativa apropiadas en entornos de aprendizaje online.
Palabras clave
Referencias
Biggs, J. B. (2003). Teaching for quality learning at university: What the student does. Open University Press.
Bower, M., Cavanagh, M., Moloney, R., and Dao, M. (2011). Developing communication competence using an online video reflection system: Pre-service teachers' experiences. Asia-Pacific Journal of Teacher Education, 39(4), 311-326. https://doi.org/10.1080/1359866X.2011.614685
Campbell, K. S., Mothersbaugh, D. L., Brammer, C., and Taylor, T. (2001). Peer versus self assessment of oral business presentation performance. Business Communication Quarterly, 64(3), 23-40. https://doi.org/10.1177/108056990106400303
Cebrián-de-la-Serna, M., and Bergman, M. E. (2014). Formative Assessment with eRubrics: an Approach to the State of the Art. REDU. Revista de Docencia Universitaria, 12(1). 15-29. https://doi.org/10.4995/redu.2014.6427
Cohen, L. M., Mannion, L. L., and Morrison, K. (2011). Research methods in education. New York.
Crawford, A. R., Johnson, E. S., Zheng, Y. Z., and Moylan, L. A. (2020). Developing an understanding procedures observation rubric for mathematics intervention teachers. School Science and Mathematics, 120(3), 153-164. https://doi.org/10.1111/ssm.12393
Creswell, J. W., and Creswell, J. D. (2018). Research design: qualitative, quantitative, and mixed methods approaches. SAGE.
De Grez, L., Valcke, M., and Roozen, I. (2009a). The impact of an innovative instructional intervention on the acquisition of oral presentation skills in higher education. Computers and Education, 53(1), 112-120. https://doi.org/10.1016/j.compedu.2009.01.005
De Grez, L., Valcke, M., and Roozen, I. (2009b). The impact of goal orientation, self-reflection and personal characteristics on the acquisition of oral presentation skills. European Journal of Psychology of Education, 24(3), 293-306. https://doi.org/10.1007/BF03174762
De Grez, L., Valcke, M., and Roozen, I. (2012). How effective are self-and peer assessment of oral presentation skills compared with teachers' assessments? Active Learning in Higher Education, 13(2), 129-142. https://doi.org/10.1177/1469787412441284
Delgado, M. A., and Fonseca-Mora, M. C. (2010). The use of co-operative work and rubrics to develop competences. Education for Chemical Engineers, 5(3), e33-e39. https://doi.org/10.1016/j.ece.2010.05.002
Dunbar, N. E., Brooks, C. F., and Kubicka-Miller, T. (2006). Oral communication skills in higher education: Using a performance-based evaluation rubric to assess communication skills. Innovative Higher Education, 31(2), 115-128. https://doi.org/10.1007/s10755-006-9012-x
Falchikov, N., and Goldfinch, J. (2000). Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks. Review of Educational Research, 70(3), 287-322. https://doi.org/10.3102/00346543070003287
Fernández-Medina, C., Luque-Guerrero, C., Ruiz-Rey, F., Rivera-Rogel, D., Andrade Vargas, L., and Cebrián-de-la-Serna, M. (2021). Assessment oral competence with digital rubrics for the Ibero-American Knowledge Space. Pixel-Bit. Revista de Medios y Educación, 62, 71-106. https://doi.org/10.12795/pixelbit.83050
Galván-Sánchez, I., Verano-Tacoronte, D., González-Betancor, S. M., Fernández- Monroy, M., and Bolívar-Cruz, A. (2017). Assessing oral presentation skills in Electrical Engineering: Developing a valid and reliable rubric. International Journal of Electrical Engineering Education, 54(1), 17-34. https://doi.org/10.1177/0020720916659501
Haanstad, E. J. (2020). Collaborative Ethnographic Assessment: An Anthropological Rubric for a Community Ecosystem. Teaching Anthropology, 9(2), 1-8. https://doi.org/10.22582/ta.v9i2.528
Houston, D., and Thompson, J. N. (2017). Blending Formative and Summative Assessment in a Capstone Subject:'It's not your tools, it's how you use them'. Journal of University Teaching and Learning Practice, 14(3), 2. https://doi.org/10.53761/1.14.3.2
Jönsson, A., and Panadero, E. (2017). The use and design of rubrics to support assessment for learning. In D. Carless, S.M. Bridges, C.K.Y. Chan and R. Glofcheski R (Eds.), Scaling up assessment for learning in higher education (pp. 99-111). Springer. https://doi.org/10.1007/978-981-10-3045-1_7
Li, H., Xiong, Y., Zang, X., L. Kornhaber, M., Lyu, Y., Chung, K. S., and K. Suen, H. (2016). Peer assessment in the digital age: A meta-analysis comparing peer and teacher ratings. Assessment and Evaluation in Higher Education, 41(2), 245- 264. https://doi.org/10.1080/02602938.2014.999746
Madruga, T., Thiam, S., Vasquez, A., Kothari, R., and Krauss, G. G. (2020). Reviewer perspective impact on design review feedback. The International Journal of Engineering Education, 36(2), 675-686.
Magin, D., and Helmore, P. (2001). Peer and teacher assessments of oral presentation skills: how reliable are they? Studies in Higher Education, 26(3), 287-298. https://doi.org/10.1080/03075070120076264
Menéndez-Varela, J. L., and Gregori-Giralt, E. (2016). The contribution of rubrics to the validity of performance assessment: a study of the conservationrestoration and design undergraduate degrees. Assessment and Evaluation in Higher Education, 41(2), 228-244. https://doi.org/10.1080/02602938.2014.998169
Meyers, N. M., and Nulty, D. D. (2009). How to use (five) curriculum design principles to align authentic learning environments, assessment, students' approaches to thinking and learning outcomes. Assessment and Evaluation in Higher Education, 34(5), 565-577. https://doi.org/10.1080/02602930802226502
Morreale, S. P., Valenzano, J. M., and Bauer, J. A. (2017). Why communication education is important: A third study on the centrality of the discipline's content and pedagogy. Communication Education, 66(4), 402-422. https://doi.org/10.1080/03634523.2016.1265136
Montalvão, D., and Baker, T. (2015). Correlating peer and tutor assessment on a lowstakes engineering assignment. International Journal of Mechanical Engineering Education, 43(3), 168-179. https://doi.org/10.1177/0306419015603008
Mulder, M. (2014). Conceptions of professional competence. In S. Billett, C. Harteis, and H. Gruber (Eds.), International handbook of research in professional and practice-based learning (pp. 107-137). Springer. https://doi.org/10.1007/978-94-017-8902-8_5
Nordrum, L., Evans, K., and Gustafsson, M. (2013). Comparing student learning experiences of in-text commentary and rubric-articulated feedback: strategies for formative assessment. Assessment and Evaluation in Higher Education, 38(8), 919-940. https://doi.org/10.1080/02602938.2012.758229
Pathak, A., and Le Vasan, M. (2015). Developing Oral Presentation Competence in Professional Contexts: A Design-Based Collaborative Approach. International Journal of Evaluation and Research in Education, 4(4), 179-184. https://doi.org/10.11591/ijere.v4i4.4509
Redecker, C. (2017). European framework for the digital competence of educators: Dig- CompEdu. Report for the European Union no. JRC107466. Joint Research Centre.
Romero-García, C., Buzón-García, O., Sacristán-San-Cristóbal, M., and Navarro- Asencio, E. (2020). Evaluation of a Program for the Improvement of Learning and Digital Competence in Future Teachers Utilizing Active Methodologies. Estudios sobre Educación, 39, 179-205. https://doi.org/10.15581/004.39.179-205
Skovholt, K., Nordenström, E., and Stokoe, E. (2019). Evaluative conduct in teacher- student supervision: When students assess their own performance. Linguistics and Education, 50, 46-55. https://doi.org/10.1016/j.linged.2019.03.001
van Ginkel, S., Gulikers, J., Biemans, H., and Mulder, M. (2015). Towards a set of design principles for developing oral presentation competence: A synthesis of research in higher education. Educational Research Review, 14, 62-80. https://doi.org/10.1016/j.edurev.2015.02.002
van Ginkel, S., Gulikers, J., Biemans, H., and Mulder, M. (2017). The impact of the feedback source on developing oral presentation competence. Studies in Higher Education, 42(9), 1671-1685. https://doi.org/10.1080/03075079.2015.1117064
van Ginkel, S., Laurentzen, R., Mulder, M., Mononen, A., Kyttä, J., and Kortelainen, M. J. (2017). Assessing oral presentation performance: Designing a rubric and testing its validity with an expert group. Journal of Applied Research in Higher Education, 9(3), 474-486. https://doi.org/10.1108/JARHE-02-2016-0012
Zheng, L., Chen, N. S., Cui, P., and Zhang, X. (2019). A Systematic Review of Technology-Supported Peer Assessment Research: An Activity Theory Approach. International Review of Research in Open and Distributed Learning, 20(5), 168-191. https://doi.org/10.19173/irrodl.v20i5.4333
Detalles
Detalles del artículo
Esta obra está bajo licencia internacional Creative Commons Reconocimiento-NoComercial-SinObrasDerivadas 4.0.
CESIÓN DE DERECHOS
Al enviar el artículo para su evaluación y posterior publicación en la revista Estudios sobre Educación, el AUTOR cede de manera exclusiva los derechos de comunicación pública, reproducción, distribución y venta para su explotación comercial a la Universidad de Navarra a través de su Servicio de Publicaciones, por el plazo máximo legal vigente -toda la vida del autor y setenta años después de su muerte o declaración de fallecimiento-, en cualquier país, y en cualquiera de las actuales y futuras modalidades de edición tanto en versión impresa como electrónica.
En el caso de que el artículo no fuera aceptado para su publicación, esta cesión de derechos decae con la comunicación de la negativa al AUTOR.
El AUTOR afirma que el artículo es inédito, que no ha sido enviado simultáneamente a otro medio de publicación y que los derechos no han sido cedidos de forma exclusiva con anterioridad. Se hace responsable frente a la Universidad de Navarra a través de su Servicio de Publicaciones de la autoría y originalidad de su obra, así como de todas las cargas pecuniarias que pudieran derivarse para Universidad de Navarra a través de su Servicio de Publicaciones, a favor de terceros con motivo de acciones, reclamaciones o conflictos derivados del incumplimiento de obligaciones por parte del AUTOR.