70 pre-built scenarios
Test Case Library
Browse, filter, and select from curated test cases for evaluating AI systems across all dimensions.
Choose a new password
Enter and confirm your new password below.
Evaluation Builder
Define your system, select criteria, choose test cases, and run your evaluation.
Define Your System
Select Evaluation Criteria
These five dimensions define what "good" looks like for your AI system. We've pre-set the weights based on your system type - higher weight means that dimension counts more toward your overall score.
Hover the ⓘ icon next to each criterion to learn what it measures and when you might want to adjust its weight.
Select Test Cases
We've suggested test cases based on your system type. Select the ones you want to include, or add your own.
Run Evaluation
For each test case, paste the actual system output and score the result.
Your Projects
EU AI Act Compliance Audit
Pre-configured evaluation template with all high-risk test cases mapped to EU AI Act obligations. Produces structured test evidence to support the testing and accuracy parts of your Articles 9-15 technical documentation.
Session Activity
Your wizard activity in this tab. This log stays in your browser and clears when you refresh or close the page. See our Privacy Policy for the site analytics we do collect.
EU AI Act readiness
Test your AI system against the EU AI Act
A no-code AI evaluation tool with pre-built test cases mapped directly to EU AI Act risk tiers and article references. Structured scoring and exportable test evidence, in your browser.
EvalSpec produces test evidence to support your compliance work. It is not legal advice and does not certify conformity with the EU AI Act.
See the test case libraryGrounded in NIST AI RMF, EU AI Act (Regulation 2024/1689), ISO/IEC 42001:2023, and OWASP Top 10 for LLMs.
The compliance gap most SMEs are facing
The EU AI Act's high-risk system provisions enter full enforcement on 2 December 2027 for Annex III stand-alone systems and 2 August 2028 for Annex I product-embedded systems. Article 50 transparency obligations have applied since 2 August 2026, and systems already on the market before that date have until 2 December 2026 to meet the Article 50(2) content marking requirement. Breaches of high-risk and transparency obligations carry fines of up to EUR 15 million or 3% of global annual turnover, rising to EUR 35 million or 7% for banned AI practices. For SMEs, the lower of the two amounts applies.
Most AI evaluation tools - Braintrust, Maxim, Arize, Galileo - require Python, API integration, and dedicated engineering time. They were built for ML teams, not compliance officers.
If you are a product manager, compliance officer, CTO, or governance lead at an SME, you need structured evaluation evidence - not a Python notebook.
Only 8 of 27 EU member states have designated national competent authorities. Harmonised standards are still in draft. The regulatory infrastructure is incomplete, but the deadlines are now set.
Understanding the EU AI Act risk tiers
The EU AI Act classifies AI systems into four risk tiers. Your tier determines what obligations apply to you.
What compliance-ready AI evaluation looks like
70 pre-built test cases
Mapped to EU AI Act risk tiers - Unacceptable, High-Risk, Limited, Minimal - with specific article references (Articles 9-15, Annex III, Article 26, Article 27).
5-dimension scoring
Accuracy, Consistency, Safety, Alignment, and Robustness - each scored independently with configurable weights by system type and risk level.
Exportable evidence reports
Dimension scores, radar charts, Readiness Status indicators, critical issues list, and deployment readiness assessment. Export as CSV or PDF for audit trails.
No code required
Run evaluations entirely in your browser. Upload AI system output by CSV for LLM-judge scoring you can review and override, or paste it in and score it 1-5 yourself. Flag issues and build your evidence trail. No Python, no pipelines, no engineering dependency.
Built for the people who actually own AI compliance
- Compliance and Governance Officers - Produce structured evidence that your AI systems meet EU AI Act obligations ahead of the enforcement deadlines.
- Product Managers - Evaluate AI features across 5 quality dimensions without waiting for engineering capacity.
- CTOs and VP Engineering at SMEs - Get a systematic view of AI system readiness across your organisation without building internal evaluation infrastructure.
- QA Leads and Test Managers - Apply structured evaluation methodology to non-deterministic AI systems where traditional pass/fail testing does not work.
Start your compliance audit today
Your first evaluation is free. No credit card required. Run the EU AI Act Compliance Audit template against your AI system.
Blog
Insights on AI evaluation
Practical guides, frameworks, and best practices for testing AI systems before production.
Views expressed in these articles reflect the EvalSpec team's experience and research. They do not constitute professional, legal, or regulatory advice.