When several teachers in an English department assign essays on The Bridge on the Drina, they often discover that the same paper would earn different grades depending on who reads it. One teacher may reward ambitious but loosely supported arguments, while another prizes tight organization and accurate quotation. These differences are rarely intentional, but they affect students, who sense the inconsistency and sometimes request transfers or regrades. Calibration is the process of bringing graders into alignment so that scores mean the same thing across classrooms.

The foundation of calibration is a shared rubric with clear descriptors at each level. Departments should agree on the criteria, the weighting, and the meaning of terms such as strong analysis or adequate evidence. Without that foundation, even a lengthy norming session will not yield consistent results. Investing time in the rubric before the assignment is distributed pays off throughout the grading period.

Once the rubric is set, select a small set of anchor essays that represent different levels of performance. These can come from previous years, with identifying information removed, or from sample responses written by teachers. Each teacher scores the anchors independently before the group meets. The comparison of scores reveals where interpretations of the rubric diverge.

Running a Norming Session

A norming session should be structured and time-limited, typically lasting about an hour. Begin by having each teacher share their scores for one anchor essay and explain their reasoning, focusing on the language of the rubric. Discuss disagreements until the group reaches consensus on the appropriate score and the evidence that supports it. Repeat with two or three more anchors until the group's judgments largely converge.

• Distribute anchor essays and the rubric ahead of time for independent scoring.
• Compare scores and discuss only essays where graders differ by more than one level.
• Reference specific rubric language when justifying each score.
• Record decisions and annotated anchors for future use.
• Schedule a brief check-in midway through grading to catch drift.

Maintaining Consistency During Grading

Calibration is not a one-time event, because graders drift as fatigue sets in and as they encounter unusual responses. Many departments build in a mid-grading check, in which teachers each score two or three common papers and compare results. If differences have crept in, a brief discussion can realign everyone. This small investment prevents large discrepancies in final scores.

Some departments also use double marking on a sample of essays, in which a second teacher independently grades a random subset. Large disagreements trigger a conversation, and persistent patterns signal the need to revisit the rubric. While double marking adds work, it also builds a culture of shared professional judgment. Teachers often report that the process improves their own grading.

Documenting and Reusing Calibration Materials

The annotated anchors and discussion notes from a norming session are valuable resources for future years. Store them in a shared folder with brief explanations of why each essay earned its score. New teachers can use these materials to learn the department's standards quickly. Over time, the collection becomes an institutional memory that survives staff turnover.

When a department uses an AI grading tool, the same anchors can help configure and verify its performance. Run the tool on the anchor essays and compare its scores and comments to the group consensus. Adjust the rubric language or settings until the tool aligns closely with the department's standards. This gives teachers confidence that the tool supports, rather than undermines, shared expectations.

Communicating Standards to Students

Consistency is most meaningful when students understand what the standards are. Share the rubric and, where possible, anchor examples with every class so that students see the same expectations regardless of their teacher. A common vocabulary for feedback also helps, since students who move between teachers will encounter familiar language. This clarity reduces confusion and supports a sense of fairness.

Finally, invite student feedback about the clarity of the rubric after the assignment. If students consistently misunderstand a criterion, it may need rewording. Treating the rubric as a living document, revised in light of experience, models the reflective practice that departments hope to cultivate in students. Calibrated grading becomes part of a broader culture of continuous improvement.