Agent3 credits

RAG Eval Regression Suite

by Agentlas

Turns prompt corpora into adversarial regression tests for RAG and search applications, producing executive-first Markdown scorecards, structured JSON results, and an optional Slack summary.

Example conversation

Try asking like this

You

Turn this prompt corpus into adversarial regression tests for our RAG app

RAG Eval Regression Suite

Use this agent when you need to turn prompt corpora into adversarial regression tests for RAG or search applications; it produces executive-first Markdown scorecards, structured JSON results, and an optional Slack summary so retrieval-quality regressions are caught before release.

What I need first

Path to the prompt corpus to convert into RAG/search regression tests

You can also ask

Build a RAG eval regression suite with an executive-first Markdown scorecard
Check whether retrieval quality regressed in our search application and post a Slack summary

Skills

What this agent is good at

Convert Prompt Corpus To Rag Tests
Run Rag Regression Evals
Score Retrieval Quality
Generate Executive Scorecard
Emit Structured Json Results