Build a judge: one criterion, evidence first, binary verdict

Build lab: L5.1 wrote a contract for the 3 rows a judge is entitled to read; this lesson builds it and finds the hard part is not the prompt. Nine replies on a five-point scale use 4 of the 5 points and repeat on 0 of 3 rows, and the pass floor is the decision — floors 2/3/4/5 get 9/8/6/2 of the nine replies wrong, and the best floor still misses both replies on the split-card row. Both binary designs get 3 of 3 rows right, but verdict-first quotes something decisive in only 2 of its 6 replies, so 4 of its 6 verdicts stand on evidence that does not support them — and all 4 are correct. A single-field reading of "a 13-19 digit run" catches 2 of 3 graded payloads; joining fields that share a stem catches 3 of 3 and accuses neither control. Two replays repeat a verdict on 3 of 3 rows where three replays repeat a score on 0 of 3. Five malformed replies are refused by name, and the fifth parses perfectly — an unsupported verdict the parser only catches by reading the quotation.

This Evals Engineering lesson is part of a paid plan. Sign in with a plan that includes this course to read it.