Article Alerts

Goh, R., & Tan, K. H. K. (2023). Teachers’ qualitatively different ways of experiencing assessment feedback: Implications for teacher assessment literacy. Chinese Journal of Applied Linguistics, 46(2), 253-269.

https://www.degruyter.com/journal/key/cjal/html?lang=en#latestIssue

 Assessment feedback is an important aspect of teacher assessment literacy which can be understood along three interrelated dimensions: conceptual in terms of conceptions teachers have of feedback, praxeological regarding feedback practice, and socio-emotional which relates to how teachers attend to the emotional dynamics of assessment from the student’s perspective (Pastore & Andrade, 2019). This paper presents the findings of a phenomenographic study involving 15 teachers in Singapore schools that explored their qualitatively different ways of experiencing assessment feedback. Drawing on the variation theory perspective, the analysis of interview data resulted in five teachers’ conceptions of assessment feedback that shed light on the non-static nature of feedback engagement. These conceptions represent the variation in teachers’ qualitatively different ways of experiencing assessment feedback and range from feedback as inspection of students (emphasizing mistakes) to feedback as introspection for students (emphasizing reflection on feedback). The findings show the potential that teachers can aspire to move from level to level, depending on contexts and students. Insights on the continuum of teacher assessment feedback literacy are drawn. Implications for developing teacher assessment literacy are discussed to assist teachers in reviewing their conceptions of assessment feedback beliefs and enhancing assessment feedback practices beyond improving academic learning.

Willis, J., Arnold, J., & DeLuca, C. (2023, May). Accessibility in assessment for learning: sharing criteria for success. In Frontiers in Education (Vol. 8, p. 1170454). Frontiers.

http://dx.doi.org/10.3389/feduc.2023.1170454

Assessment for learning (AfL) practices in secondary schools are intended to help learners understand what expert performances in disciplines look like, and then apply this understanding to their own learning and assessment performances. Common AfL practices such as sharing criteria for success through rubrics and students using them to interrogate exemplars and give feedback rely heavily on the students’ language and attention. Students need to understand and draw on conceptual and collaborative language, and to make connections across several activity stages. Consequently, students with language and/or attentional difficulties and their teachers face a dilemma. On the one hand, AfL practices can provide access to developmentally appropriate curriculum. On the other, AfL practices may present additional barriers to learning. This article identifies some of the barriers students with language and/or attentional difficulties may encounter in common AfL practices, and how teachers adapted sharing of success criteria to design for greater accessibility. Access to learning is conceptualized by referring to Dewey’s principles of continuity and interaction. Interviews with 20 teachers were analyzed to find out how they adapted AfL to be more accessible in an 8 week AfL pedagogical intervention focused on success criteria. Ideas for designing accessible AfL practices from the outset are outlined as teachers realized the role of their language, small steps, visual tools, and regular opportunities for connection and interactions in making it more likely for students to benefit from AfL practices. Given that students with language and/or attentional difficulties represent some of the highest occurrences of disability in student populations, these ideas have immediate relevance for teachers and those who support AfL practices in educational policy and research.

Bouwer, R., & Dirkx, K. (2023). The eye-mind of processing written feedback: Unraveling how students read and use feedback for revision. Learning and Instruction, 85, 101745. 

https://www.sciencedirect.com/science/article/pii/S0959475223000142

 This research aims to promote our understanding of feedback engagement processes in writing tasks using a combination of online and offline measures, including eye-tracking, thinking-aloud, and text-analyses. Study 1 explored how sixteen students read, evaluate, and use feedback for revision. Results revealed three feedback processing strategies: (1) superficial processing (n = 6), which is characterized by reading feedback in a linear way, without critically rereading or revising the text, (2) local processing (n = 6) in which students switched between reading the comments and the commented text, and (3) deep processing (n = 4) in which students integrated the feedback with both commented and uncommented parts of the text and made more substantial revisions. In Study 2, we investigated the local and deep feedback reading strategy in more detail with 41 students using a within-subject design with different types of feedback. Results demonstrated the same strategies among students, but also that the focus of feedback affected students’ revision behavior, above and beyond an individual feedback processing strategy. This finding is in line with previous research that emphasized the effects of feedback characteristics on students’ use of feedback. By triangulating various process measures, this research is one of the first that provides empirical evidence for different feedback processing strategies among students. These novel insights in individual feedback engagement processing can be used to extend and refine current theories on how, when, and why feedback works and for whom.

Dawson, S., Pardo, A., Salehian Kia, F., & Panadero, E. (2023, March). An Integrated Model of Feedback and Assessment: From fine grained to holistic programmatic review. In LAK23: 13th International Learning Analytics and Knowledge Conference (pp. 579-584).

https://dl.acm.org/doi/abs/10.1145/3576050.3576074

Research in learning analytics (LA) has long held a strong interest in improving student self-regulated learning and measuring the impact of feedback on student outcomes. Despite more than a decade of work in this space very little is known around the contextual factors that influence the topics and diversity of feedback and assessment a student encounters during their full program of study. This paper presents research investigating the institutional adoption of a personalized feedback tool. The reported findings illustrate an association between the topics of feedback, student performance, year level of the course and discipline. The results highlight the need for LA research to capture feedback, assessment and learning outcomes over an entire program of study. Herein we propose a more integrated model drawing on contemporary understandings of feedback with current research findings. The goal is to push LA towards addressing more complex teaching and learning processes from a systems lens. The model posed in this paper begins to illustrate where and how LA can address noted deficits in education practice to better understand how feedback and assessment are enacted by instructors and interpreted by students.

Panadero, E. (2023). Toward a paradigm shift in feedback research: Five further steps influenced by self-regulated learning theory. Educational Psychologist, 58(3), 193-204

https://doi.org/10.1080/00461520.2023.2223642 

As the articles in this special issue on “Psychological Perspectives on the Effects and Effectiveness of Assessment Feedback” have shown, feedback is a key factor in education. Although there exists a substantial body of research on the topic, it is imperative to continue advancing the field. My aim is to outline five steps to solidify the potential paradigm shift that the feedback field may already be experiencing, while incorporating the insights gleaned from the articles within this special issue. Firstly, there is a need to develop new models that thoroughly explore and operationalize the intricacies of the feedback phenomenon. Secondly, it is essential to conceptualize feedback as a dynamic process and collect data that directly investigates this process. Thirdly, it would be advantageous to leverage insights from the self-regulated learning field, which has made significant strides in advancing measurement methods applicable to feedback research. Fourthly, employing multimodal methods can enrich our comprehension of the multifaceted nature of the feedback process. Lastly, placing the feedback agent at the core of the feedback process, with particular attention to individual differences, is of utmost importance.

Buckingham Shum, S., Lim, L. A., Boud, D., Bearman, M., & Dawson, P. (2023). A comparative analysis of the skilled use of automated feedback tools through the lens of teacher feedback literacy. International Journal of Educational Technology in Higher Education, 20(1), 40.

https://link.springer.com/article/10.1186/s41239-023-00410-9 

Effective learning depends on effective feedback, which in turn requires a set of skills, dispositions and practices on the part of both students and teachers which have been termed feedback literacy. A previously published teacher feedback literacy competency framework has identified what is needed by teachers to implement feedback well. While this framework refers in broad terms to the potential uses of educational technologies, it does not examine in detail the new possibilities of automated feedback (AF) tools, especially those that are open by offering varying degrees of transparency and control to teachers. Using analytics and artificial intelligence, open AF tools permit automated processing and feedback with a speed, precision and scale that exceeds that of humans. This raises important questions about how human and machine feedback can be combined optimally and what is now required of teachers to use such tools skillfully. The paper addresses two research questions: Which teacher feedback competencies are necessary for the skilled use of open AF tools? and What does the skilled use of open AF tools add to our conceptions of teacher feedback competencies? We conduct an analysis of published evidence concerning teachers’ use of open AF tools through the lens of teacher feedback literacy, which produces summary matrices revealing relative strengths and weaknesses in the literature, and the relevance of the feedback literacy framework. We conclude firstly, that when used effectively, open AF tools exercise a range of teacher feedback competencies. The paper thus offers a detailed account of the nature of teachers’ feedback literacy practices within this context. Secondly, this analysis reveals gaps in the literature, signalling opportunities for future work. Thirdly, we propose several examples of automated feedback literacy, that is, distinctive teacher competencies linked to the skilled use of open AF tools.