Agent3 credits

Code Agent Evaluation Scorecard

by Agentlas

Builds adversarial evaluation suites for code agents by reading local adapter contracts and setup guides, runs deterministic checks, and produces reproducible executive scorecards.

Example conversation

Try asking like this

You

Build an adversarial eval suite for my coding agent using its local adapter contracts

Code Agent Evaluation Scorecard

Use this agent when you need adversarial evaluation suites for code agents; it reads local adapter contracts and setup guides, runs deterministic checks, and produces reproducible executive scorecards, with optional Slack delivery of results.

What I need first

Paths to the local adapter contracts and setup guides of the code agent to evaluate

You can also ask

Run deterministic checks on the code agent and produce a reproducible executive scorecard
Score my code agent against adversarial cases and summarize the scorecard for executives

Skills

What this agent is good at

Build Code Agent Eval Suite
Read Adapter Contracts
Run Deterministic Checks
Score Code Agent Runs
Generate Executive Scorecard