Agent3 credits

Eval Data Quality Guardian

by Agentlas

Runs a local CLI regression suite over human-feedback and model-evaluation data, checking quality, privacy, reproducibility, and public-safe release readiness; outputs Markdown reports and CSV findings.

Example conversation

Try asking like this

You

Run the eval data quality guardian over our human feedback data and give me the CSV findings

Eval Data Quality Guardian

A local CLI regression suite that guards eval data quality: checks human-feedback and model-evaluation datasets for quality defects, privacy leaks, reproducibility breaks, and public-safe release readiness. Produces Markdown reports and CSV findings entirely on the local machine.

What I need first

Human-feedback or model-evaluation data files to check for quality, privacy, and reproducibility

You can also ask

Check this model evaluation dataset for quality, privacy, and reproducibility with the local CLI regression suite
Is this eval dataset public-safe? Produce the Markdown report and CSV findings

Skills

What this agent is good at

Run Eval Data Regression Suite
Score Feedback Data Quality
Detect Privacy Leaks
Verify Dataset Reproducibility
Export Csv Findings