Anthropic released a new eval plugin for Claude Code that includes build_eval and hill-climb commands for creating and iterating on evaluations.

Testing revealed the tool forces eval creation before data review, bundles multiple failure checks into single evaluators, and requests judgment approval without adequate context. It showed strong one-shot issue discovery, but the author recommends waiting for planned updates before adoption.