The gym-building agent

Build lab (Module 13, L13.5): an environment is admitted only when its tests fail on buggy code and pass on fixed code, and a load error fails closed. Of the core four, 3 are ACCEPTED (sort_desc, flatten, join_path) and 1 is REJECTED (sort_desc_weak, whose only test passes on the bug). Flatten fails only 1 of 2 on the bug, so the gate is at least one failure, not all of them. sort_desc_half passes 1 of 2 on the fix and is REJECTED; most-pass would have accepted it. sort_desc_error is REJECTED with RuntimeError: import blew up. The log has 3 rows of env_id, gate, and reason. The draft figure 61 of 200 is an illustration this cell does not compute. In-memory only; snippets run in a fresh dict, no files or provider call.

This Harness Engineering lesson is part of a paid plan. Sign in with a plan that includes this course to read it.