WebBench Task Evaluator
Evaluates the success of web automation tasks by analyzing execution traces and page states against original requirements using LLM-as-judge scoring.
The WebBench Task Evaluator provides a standardized framework for grading the performance of AI agents performing browser-based tasks. By acting as an automated judge, it examines execution traces, final page states, and extracted data to deliver a structured verdict (PASS, PARTIAL, or FAIL). This skill is essential for benchmarking web agents, offering deep insights into navigation accuracy, data extraction completeness, and infrastructure blockers like CAPTCHAs or authentication walls. It ensures objective evaluation of READ, CREATE, UPDATE, and DELETE operations without requiring manual oversight.