Evaluation & Reliability
Task Success Rate
The proportion of evaluated task attempts meeting a predefined completion rule. The denominator, time limit, retry policy and handling of incomplete attempts must be explicit. A success claim in the assistant's response is not the completion rule.
Reviewed
Sources
Member lesson
The definition and sources are public. The complete practical lesson is for members.