70 pre-built scenarios

Test Case Library

Browse, filter, and select from curated test cases for evaluating AI systems across all dimensions.

Sign in

Access your evaluation projects.

or

Forgot your password?

Don't have an account? Create one

Create account

Start evaluating your AI systems.

or skip the password

Already have an account? Sign in

Reset password

Enter your email and we'll send you a reset link.

Back to sign in

Choose a new password

Enter and confirm your new password below.

Evaluation Builder

Define your system, select criteria, choose test cases, and run your evaluation.

1
System
2
Criteria
3
Test Cases
4
Evaluate
5
Results

Define Your System

Select Evaluation Criteria

These five dimensions define what "good" looks like for your AI system. We've pre-set the weights based on your system type - higher weight means that dimension counts more toward your overall score.

Hover the ⓘ icon next to each criterion to learn what it measures and when you might want to adjust its weight.

Select Test Cases

We've suggested test cases based on your system type. Select the ones you want to include, or add your own.

Run Evaluation

For each test case, paste the actual system output and score the result.

0 / 0 scored

Your Projects

+ New Evaluation
EU AI Act

EU AI Act Compliance Audit

Pre-configured evaluation template with all high-risk test cases mapped to EU AI Act obligations. Produces structured test evidence to support the testing and accuracy parts of your Articles 9-15 technical documentation.

Includes 54+ high-risk test cases across all 5 evaluation dimensions

Back to Dashboard

Compare Evaluations

Session Activity

Your wizard activity in this tab. This log stays in your browser and clears when you refresh or close the page. See our Privacy Policy for the site analytics we do collect.

Legal

Terms of Service

Last updated: 13 November 2026

1. Acceptance of terms

By creating an account or using EvalSpec at evalspec.ai, you agree to these Terms of Service. If you do not agree, do not use the service. These terms form a binding agreement between you and EvalSpec ("we", "us", "our").

2. What EvalSpec is

EvalSpec is a browser-based diagnostic tool that provides a structured framework for evaluating AI systems across five dimensions: Accuracy & Groundedness, Consistency & Reliability, Safety & Compliance, Alignment & Usefulness, and Robustness & Edge Cases.

EvalSpec is a diagnostic tool, not a certification service. Evaluation results are generated based entirely on the test cases, scores, and weightings you provide. Results represent a structured assessment of the inputs you supplied - they are not a guarantee, certification, or assurance that your AI system is fit for purpose in any particular context, free from defects, or compliant with any regulation. You remain solely responsible for all decisions regarding the development, testing, deployment, and operation of your AI systems.

No two AI systems or deployment contexts are identical. EvalSpec provides a consistent framework, but results will vary depending on the test cases selected, the scores assigned, and the risk profile chosen. We strongly recommend using EvalSpec as one input among several in your quality assurance process.

3. Accounts

  • You must provide a valid email address to create an account.
  • You are responsible for maintaining the security of your account credentials.
  • You must not share your account with others or allow unauthorised access.
  • You must be at least 13 years old to use EvalSpec.
  • We reserve the right to suspend or terminate accounts that violate these terms.

4. Credits, payments & refunds

EvalSpec operates on a credit system. One credit pays for one evaluation of one AI system with up to 80 test cases.

  • Every account receives one free evaluation credit on registration. No payment is required to get started.
  • Additional credits are purchased in the tiers listed on the pricing page. Prices are in GBP and include VAT where applicable.
  • Payments are processed securely by Stripe. EvalSpec does not store your card details.
  • A credit is used when you start an automated evaluation, or when you first save a manual one, whether or not every test case is then scored.
  • When the credit is used, the system details, selected test cases and dimension weights for that evaluation are fixed. Testing a different system, different test cases or different weights needs a new evaluation and a new credit.
  • Resuming an interrupted run, retrying test cases the judge could not score (up to three attempts each), changing scores, and viewing, printing or exporting results do not use further credits.
  • Credits do not expire.
  • All purchases are non-refundable. Once a credit purchase is completed, it cannot be refunded, whether or not the credits have been used. If you experience a technical issue that prevents you from using a credit you have paid for, contact us at hello@evalspec.ai and we will investigate.

5. Acceptable use

You agree not to use EvalSpec to:

  • Attempt to gain unauthorised access to any part of the service or its infrastructure.
  • Reverse engineer, decompile, or attempt to extract the source code of the service.
  • Use automated tools to scrape, crawl, or stress-test the service.
  • Submit content that is unlawful, harmful, or infringes third-party rights.
  • Resell or sublicense access to the service without written permission.
  • Circumvent the free-tier credit limit through multiple account creation or other means.

6. Your content

You retain ownership of any AI system descriptions, test cases, and evaluation data you submit to EvalSpec. By submitting content, you grant us a limited licence to store and process it solely for the purpose of providing the service to you. We do not use your evaluation data for any other purpose, and we do not share it with third parties.

7. Intellectual property

EvalSpec, its framework, methodology, design, and software are owned by EvalSpec and protected by applicable intellectual property laws. You may not copy, reproduce, or distribute any part of the service without written permission.

8. Disclaimer of warranties

EvalSpec is provided "as is" and "as available" without warranties of any kind, express or implied. We do not warrant that the service will be uninterrupted, error-free, or that results will be accurate, complete, or suitable for any particular purpose. The evaluation framework is based on established standards (NIST, EU AI Act, ISO 42001, OWASP) but its application depends entirely on the inputs and configuration you provide.

9. Limitation of liability

To the fullest extent permitted by law, EvalSpec shall not be liable for any indirect, incidental, special, consequential, or punitive damages arising from your use of the service, including but not limited to losses arising from reliance on evaluation results in deployment decisions. Our total liability to you for any claim shall not exceed the amount you paid to us in the 12 months preceding the claim.

10. Service availability & changes

We reserve the right to modify, suspend, or discontinue any part of the service at any time. We will provide reasonable notice of material changes where possible. We may update these terms from time to time - continued use of the service after changes are posted constitutes acceptance of the updated terms.

11. Governing law

These terms are governed by the laws of England and Wales. Any disputes arising from these terms or your use of EvalSpec shall be subject to the exclusive jurisdiction of the courts of England and Wales.

12. Contact

For any questions about these terms, contact us at hello@evalspec.ai.

Blog

Insights on AI evaluation

Practical guides, frameworks, and best practices for testing AI systems before production.

Views expressed in these articles reflect the EvalSpec team's experience and research. They do not constitute professional, legal, or regulatory advice.

404

Page not found

The page you're looking for doesn't exist.

Back to home