Fix IFEval correctness bugs in if_functions and IFEvalVerifier#1683

Merged

finbarrtimbers merged 7 commits into

mainfrom

finbarr/fix-if-functions

May 12, 2026

Commits on May 12, 2026

Bundle small correctness fixes from #1615/#1618/#1619/#1623/#1625/#1646/#1651/#1655 with regression tests Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
finbarrtimbers
committed
Address PR review: inline write_header, pricing per 1M tokens, parameterize tests, dedupe if_functions Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
finbarrtimbers
committed
Trim branch to IFEval-only changes; other fixes moved to #1684/#1685/#1686 Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
finbarrtimbers
committed
Address review: use word-boundary regex in validate_choice to avoid substring false positives Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
finbarrtimbers
committed
Revert deletion of scripts/eval_constraints/if_functions.py (handled in separate PR) Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
finbarrtimbers
committed
Revert validate_choice regex change; add TODO comment with suggested word-boundary fix Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
finbarrtimbers
committed
Update if_functions.py
finbarrtimbers
authored