70 pre-built scenarios

Test Case Library

Browse, filter, and select from curated test cases for evaluating AI systems across all dimensions.

Sign in

Access your evaluation projects.

or

Forgot your password?

Don't have an account? Create one

Create account

Start evaluating your AI systems.

or skip the password

Already have an account? Sign in

Reset password

Enter your email and we'll send you a reset link.

Back to sign in

Choose a new password

Enter and confirm your new password below.

Evaluation Builder

Define your system, select criteria, choose test cases, and run your evaluation.

1
System
2
Criteria
3
Test Cases
4
Evaluate
5
Results

Define Your System

Select Evaluation Criteria

These five dimensions define what "good" looks like for your AI system. We've pre-set the weights based on your system type - higher weight means that dimension counts more toward your overall score.

Hover the ⓘ icon next to each criterion to learn what it measures and when you might want to adjust its weight.

Select Test Cases

We've suggested test cases based on your system type. Select the ones you want to include, or add your own.

Run Evaluation

For each test case, paste the actual system output and score the result.

0 / 0 scored

Your Projects

+ New Evaluation
EU AI Act

EU AI Act Compliance Audit

Pre-configured evaluation template with all high-risk test cases mapped to EU AI Act obligations. Produces structured test evidence to support the testing and accuracy parts of your Articles 9-15 technical documentation.

Includes 54+ high-risk test cases across all 5 evaluation dimensions

Back to Dashboard

Compare Evaluations

Session Activity

Your wizard activity in this tab. This log stays in your browser and clears when you refresh or close the page. See our Privacy Policy for the site analytics we do collect.

EU AI Act readiness

Test your AI system against the EU AI Act

A no-code AI evaluation tool with pre-built test cases mapped directly to EU AI Act risk tiers and article references. Structured scoring and exportable test evidence, in your browser.

EvalSpec produces test evidence to support your compliance work. It is not legal advice and does not certify conformity with the EU AI Act.

See the test case library

Grounded in NIST AI RMF, EU AI Act (Regulation 2024/1689), ISO/IEC 42001:2023, and OWASP Top 10 for LLMs.

The compliance gap most SMEs are facing

The EU AI Act's high-risk system provisions enter full enforcement on 2 December 2027 for Annex III stand-alone systems and 2 August 2028 for Annex I product-embedded systems. Article 50 transparency obligations have applied since 2 August 2026, and systems already on the market before that date have until 2 December 2026 to meet the Article 50(2) content marking requirement. Breaches of high-risk and transparency obligations carry fines of up to EUR 15 million or 3% of global annual turnover, rising to EUR 35 million or 7% for banned AI practices. For SMEs, the lower of the two amounts applies.

Most AI evaluation tools - Braintrust, Maxim, Arize, Galileo - require Python, API integration, and dedicated engineering time. They were built for ML teams, not compliance officers.

If you are a product manager, compliance officer, CTO, or governance lead at an SME, you need structured evaluation evidence - not a Python notebook.

Only 8 of 27 EU member states have designated national competent authorities. Harmonised standards are still in draft. The regulatory infrastructure is incomplete, but the deadlines are now set.

Understanding the EU AI Act risk tiers

The EU AI Act classifies AI systems into four risk tiers. Your tier determines what obligations apply to you.

Tier What it means
Unacceptable Risk Banned AI uses - social scoring, real-time biometric surveillance, manipulation of vulnerable groups.
High Risk Requires full conformity assessment - includes AI in hiring, credit scoring, healthcare, critical infrastructure, and law enforcement.
Limited Risk Transparency obligations only - users must be told they are interacting with AI (chatbots, deepfakes).
Minimal Risk No specific obligations - spam filters, AI in video games, most recommendation systems.

What compliance-ready AI evaluation looks like

70 pre-built test cases

Mapped to EU AI Act risk tiers - Unacceptable, High-Risk, Limited, Minimal - with specific article references (Articles 9-15, Annex III, Article 26, Article 27).

5-dimension scoring

Accuracy, Consistency, Safety, Alignment, and Robustness - each scored independently with configurable weights by system type and risk level.

Exportable evidence reports

Dimension scores, radar charts, Readiness Status indicators, critical issues list, and deployment readiness assessment. Export as CSV or PDF for audit trails.

No code required

Run evaluations entirely in your browser. Upload AI system output by CSV for LLM-judge scoring you can review and override, or paste it in and score it 1-5 yourself. Flag issues and build your evidence trail. No Python, no pipelines, no engineering dependency.

Built for the people who actually own AI compliance

  • Compliance and Governance Officers - Produce structured evidence that your AI systems meet EU AI Act obligations ahead of the enforcement deadlines.
  • Product Managers - Evaluate AI features across 5 quality dimensions without waiting for engineering capacity.
  • CTOs and VP Engineering at SMEs - Get a systematic view of AI system readiness across your organisation without building internal evaluation infrastructure.
  • QA Leads and Test Managers - Apply structured evaluation methodology to non-deterministic AI systems where traditional pass/fail testing does not work.

Start your compliance audit today

Your first evaluation is free. No credit card required. Run the EU AI Act Compliance Audit template against your AI system.

or download the EU AI Act Compliance Checklist for SMEs

Blog

Insights on AI evaluation

Practical guides, frameworks, and best practices for testing AI systems before production.

Views expressed in these articles reflect the EvalSpec team's experience and research. They do not constitute professional, legal, or regulatory advice.

404

Page not found

The page you're looking for doesn't exist.

Back to home