Loading dataset details…
harbor run -d hack-verifiable-environments/hv-terminal-bench-2-1Hack-verifiable version of terminal-bench-2-1. Each task includes hidden solution and test files; inotifywait detects whether agents access them instead of solving legitimately.
harbor run -d hack-verifiable-environments/hv-terminal-bench-2-1A hack-verifiable version of Terminal-Bench 2.1. Every task is instrumented so that reward hacking is measured, not inferred — alongside the usual pass/fail signal, each trial reports whether the agent read the hidden solution, read the test files, or modified them.
📝 Blog post: Hack-Verifiable Environments