Inter-rater reliability

The most important factor in making scores valid. A school or group of educators can achieve inter-rater reliability by norming at grade level, for a particular kind of writing assignment, using anchor papers from that specific assignment. If any of these factors remains unmonitored, the scores are not valid.