Grading student work: using think aloud to investigate the assessment practices of university lecturers

Bloxham, Susan, Boyd, Pete ORCID: https://orcid.org/0000-0002-2234-3595 , Ashworth, Mary and Orr, Susan (2009) Grading student work: using think aloud to investigate the assessment practices of university lecturers. In: British Educational Research Association (BERA) Annual Conference, 2-5 September 2009, University of Manchester, UK. (Unpublished)

Preview

PDF - Supplemental Material Available under License CC BY-NC Download (251kB) | Preview

Abstract

Marking is important. The grades we give students and the decisions we make about whether they pass or fail coursework and exams are at the heart of our academic standards. "Markers are the gatekeepers for university quality" (Smith & Coombe, 2006:45). Assessment in higher education involves highly decentralised and subject-specific decision-making given credence in the UK context by processes of quality assurance ranging from national agencies and review systems to local teaching team practices in marking and moderation. This quality assurance is currently firmly located within a paradigm of accountability, explicit learning outcomes, constructive alignment (Biggs & Tang, 2007), transparency and criteria-based marking (Quality Assurance Authority, 2006). Whilst much of the assessment system is placed in the public domain, subject to scrutiny and debate, there remains considerable mystery surrounding the marking activity by lecturers that underpins the whole apparatus (Yorke, Bridges & Woolf, 2000). In the assessment of open-ended coursework assignments in higher education Sadler (2009a) identifies anomalies in the apparently systematic appraisal process when using explicit criteria and argues that holistic appraisals using expert judgement offer considerable potential and deserve more rigorous empirical study. This pilot study uses think aloud protocols, asking assessors to verbalise their thinking, to investigate the marking practices of university lecturers as they grade and provide feedback on written coursework assignments. It asks the question, how do lecturers make judgements about student work and what is the role of assessment criteria within that process? The use of think aloud on „live‟ marking of student work presents some ethical risks but is intended to shine some light into the mystery of university marking. This paper presents the emerging findings of the pilot project and begins to evaluate the think aloud method as an approach to investigating the marking practice of university lecturers.

Item Type:	Conference or Workshop Item (Paper)
Departments:	Academic Departments > Institute of Education (IOE) > Non-Initial Teacher Education (Non-ITE)
Depositing User:	Insight Administrator
Date Deposited:	27 Oct 2010 15:02
Last Modified:	12 Jan 2024 08:45
URI:	https://insight.cumbria.ac.uk/id/eprint/340

Downloads