Igler, J., Ohle-Peters, A. & McElvany, N. (2022). Unterrichtsqualität aus der Sicht von externen Raterinnen und Ratern – Analysen zum Reihenfolgeeffekt. Zeitschrift für Erziehungswissenschaft. doi.org/10.1007/s11618-022-01121-z
Ratings of external observers are often used for measuring instructional quality. These ratings can be influenced by the order of presentation and individual characteristics such as observers’ experience and mental state (tiredness). The present study examined the influence of the presentation order of videos with varying levels of teaching quality and of individual factors such as previous experience and mental state (tiredness) on differences in observer ratings and interactions in a sample of 69 students. Results suggest a bias of external judgements, especially concerning motivational quality.