70 pre-built scenarios

Test Case Library

Browse, filter, and select from curated test cases for evaluating AI systems across all dimensions.

Sign in

Access your evaluation projects.

or

Forgot your password?

Don't have an account? Create one

Create account

Start evaluating your AI systems.

or skip the password

Already have an account? Sign in

Reset password

Enter your email and we'll send you a reset link.

Back to sign in

Choose a new password

Enter and confirm your new password below.

Evaluation Builder

Define your system, select criteria, choose test cases, and run your evaluation.

1
System
2
Criteria
3
Test Cases
4
Evaluate
5
Results

Define Your System

Select Evaluation Criteria

These five dimensions define what "good" looks like for your AI system. We've pre-set the weights based on your system type - higher weight means that dimension counts more toward your overall score.

Hover the ⓘ icon next to each criterion to learn what it measures and when you might want to adjust its weight.

Select Test Cases

We've suggested test cases based on your system type. Select the ones you want to include, or add your own.

Run Evaluation

For each test case, paste the actual system output and score the result.

0 / 0 scored

Your Projects

+ New Evaluation
EU AI Act

EU AI Act Compliance Audit

Pre-configured evaluation template with all high-risk test cases mapped to EU AI Act obligations. Produces structured test evidence to support the testing and accuracy parts of your Articles 9-15 technical documentation.

Includes 54+ high-risk test cases across all 5 evaluation dimensions

Back to Dashboard

Compare Evaluations

Session Activity

Your wizard activity in this tab. This log stays in your browser and clears when you refresh or close the page. See our Privacy Policy for the site analytics we do collect.

Blog

Insights on AI evaluation

Practical guides, frameworks, and best practices for testing AI systems before production.

Views expressed in these articles reflect the EvalSpec team's experience and research. They do not constitute professional, legal, or regulatory advice.

← Back to all posts

The experts and the evidence disagreed. OWASP's 2026 list shows where.

For years, the OWASP Top 10 for LLM Applications ran on expert judgement. Hundreds of practitioners voted on what worried them most. This year, OWASP did something new. It checked that vote against the record of what has actually gone wrong. The 2026 edition, published on 3 August, draws on a corpus of 7,714 real incidents. The lesson for anyone testing AI is simple. What we fear and what breaks are not always the same.

Belief versus evidence

OWASP pulled incidents from public vulnerability databases and an AI harm database. Classifiers sorted the 6,639 that had enough detail. Then it compared that record with the vote.

They did not always match. Ranked on raw incidents alone, prompt injection would drop out of the top 10. OWASP kept it at number one anyway. Its reasoning is that teams defend hard against injection, so fewer clean exploits reach public databases. A low count can mean the defences are working, not that the risk is small.

Misinformation went the other way. Voters placed it near the bottom. The incident record placed it near the top. It now sits seventh, up from ninth. OWASP's point is simple. When a confident wrong answer drives a decision or a tool call, it becomes a wrong action.

The final list gives the vote three quarters of the weight and the evidence one quarter.

Excessive Agency climbs to third

Excessive Agency was sixth in 2025. It is now third, behind prompt injection and sensitive information disclosure. OWASP calls it the most consequential move on the list. This is where the vote and the record agree. Agents are where real harm is turning up.

Excessive agency means an AI system can take damaging actions when its output is wrong, ambiguous or manipulated. OWASP names three root causes:

  • Excessive functionality: tools the system does not need, such as a document reader that can also delete.
  • Excessive permissions: tools that connect with more access than the task requires.
  • Excessive autonomy: high-impact actions that go ahead with no human approval.

One note for QA teams. Cleaning up model inputs and outputs is not a root control here. You cannot filter your way out of a tool that should never have had delete rights.

What to test now

If your AI system can call tools, your test plan needs to cover what it can do, not just what it says.

  1. Map what each agent can reach. List every tool, data source and downstream system each agent can reach. Remove anything unused.
  2. Check permissions at the source. Test them at the database or API level, not just in the agent's configuration.
  3. Run actions as the user. Confirm actions run in the user's own context, not under a shared high-privilege account.
  4. Gate irreversible actions. Test that payments, deletions and anything else you cannot undo stop for human approval.
  5. Test misinformation where it acts. Run misinformation tests where wrong answers trigger actions, not just where they appear on screen.

OWASP is also moving towards runtime control. On 1 September it brought the Agent Control Standard into its GenAI Security Project. It is an early open standard for making agents inspectable and traceable, and for controlling their behaviour while they run. It is young, but the direction is clear.

Start with the evidence

Belief is a starting point. Evidence is what moves the ranking.

EvalSpec gives you that evidence for how your AI system behaves. It scores your system across five quality dimensions, including accuracy, safety and robustness, using 70 ready-made test cases. Results map to the EU AI Act, NIST AI RMF and ISO 42001.

Try EvalSpec free - evaluate your AI system across all 5 dimensions. No code required.

Start your free evaluation

Testing an AI system yourself?

Get the 70 test cases behind this framework, indexed by dimension and difficulty, or run a free evaluation with your own AI system.

The information in this article is provided for general guidance only. EvalSpec is a diagnostic evaluation tool and does not provide legal advice, regulatory certification, or compliance guarantees. For legal or regulatory questions, consult a qualified professional.

404

Page not found

The page you're looking for doesn't exist.

Back to home