Assessment teams tasked with standardizing essay scoring across a school or district face a particular challenge with drama texts, since the analytical demands of a play differ somewhat from those of a novel or poem, and scoring guides built primarily around prose fiction may not translate cleanly to essays on a text like Earnest.

Because The Importance of Being Earnest is widely taught across grade levels and school types, it makes a useful common text for calibration sessions, where teachers from different classrooms or schools score the same sample set of essays and then discuss discrepancies in their scoring before finalizing a shared standard.

A calibration session works best with a small set of anchor essays, typically five to eight, representing a range of quality from weak to strong, that the assessment team has already scored carefully and can use as a reference point when other teachers' scores are compared against them.

Discrepancies that emerge during calibration often reveal genuine ambiguity in the rubric language itself, and revising rubric wording based on these discussions tends to improve scoring consistency far more than simply asking teachers to try harder to agree with each other.

Running an Effective Calibration Session

Before the session, distribute the rubric and anchor essays to all participating teachers with time to score independently. During the session, compare scores on each anchor essay one at a time, discussing specifically where and why scores diverge before moving to the next essay in the set.

• Select five to eight anchor essays representing a clear range of quality from weak to strong
• Have all participating teachers score the anchor set independently before the calibration meeting
• Compare scores essay by essay, focusing discussion on the specific rubric language causing disagreement
• Revise ambiguous rubric wording based on where the most significant scoring discrepancies occurred
• Document the finalized anchor essays and revised rubric for use in future calibration sessions

Building Rubric Language Specific to Drama Analysis

Assessment teams should consider whether their general essay rubric adequately addresses drama-specific skills, such as analyzing dialogue as a primary tool of characterization, or interpreting stage direction and dramatic irony, both of which function differently than similar elements in prose fiction.

Including explicit rubric language for these drama-specific skills, rather than assuming a generic literary analysis rubric will capture them adequately, tends to produce more consistent scoring across teachers who may have varying levels of comfort teaching drama compared to prose.

Applying Calibration Results District-Wide

Once a calibration session using this play has produced a clear, tested rubric, districts can use the same process as a model for calibrating scoring on other commonly taught texts, building a library of anchor essays and refined rubrics that support consistent scoring across schools over time.

Revisiting calibration periodically, particularly as new teachers join a department or as a rubric is used across several school years, helps maintain the scoring consistency that the initial calibration session worked to establish.