In criterion-referenced tests, what does reliability refer to?

In criterion-referenced tests, reliability refers to the consistency of results in classifying mastery. This means that when a test is administered multiple times under similar conditions, it should yield similar results regarding a learner’s performance. High reliability ensures that students are accurately assessed on their knowledge or skills in relation to the established criteria, rather than being influenced by varying test conditions or random factors.

When a test is reliable, it gives educators confidence that students who demonstrate mastery on one occasion will demonstrate mastery on future occasions as well, assuming no significant changes in their understanding or abilities. This consistency is crucial in educational settings, as it impacts grading, course placements, and instructional decisions.