HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstention
arXiv:2610.06563. (Preprint)
Abstract
HERA improves agentic abstention by jointly evolving agent harnesses and executable environments. It constructs verified pairs of feasible and infeasible tasks through controlled environment mutations, then uses agent failures to guide harness adaptation and generate new tasks. On held-out tasks, the evolved harness improves abstention accuracy from 61.7% to 83.3% and feasible-task completion from 68.3% to 76.7%. The same harness transfers to 19 additional LLMs without model-specific optimization, improving abstention accuracy by 15.3 percentage points on average.
Materials