70 pre-built scenarios

Test Case Library

Browse, filter, and select from curated test cases for evaluating AI systems across all dimensions.

Sign in

Access your evaluation projects.

or

Forgot your password?

Don't have an account? Create one

Create account

Start evaluating your AI systems.

or skip the password

Already have an account? Sign in

Reset password

Enter your email and we'll send you a reset link.

Back to sign in

Choose a new password

Enter and confirm your new password below.

Evaluation Builder

Define your system, select criteria, choose test cases, and run your evaluation.

1
System
2
Criteria
3
Test Cases
4
Evaluate
5
Results

Define Your System

Select Evaluation Criteria

These five dimensions define what "good" looks like for your AI system. We've pre-set the weights based on your system type - higher weight means that dimension counts more toward your overall score.

Hover the ⓘ icon next to each criterion to learn what it measures and when you might want to adjust its weight.

Select Test Cases

We've suggested test cases based on your system type. Select the ones you want to include, or add your own.

Run Evaluation

For each test case, paste the actual system output and score the result.

0 / 0 scored

Your Projects

+ New Evaluation
EU AI Act

EU AI Act Compliance Audit

Pre-configured evaluation template with all high-risk test cases mapped to EU AI Act obligations. Produces structured test evidence to support the testing and accuracy parts of your Articles 9-15 technical documentation.

Includes 54+ high-risk test cases across all 5 evaluation dimensions

Back to Dashboard

Compare Evaluations

Session Activity

Your wizard activity in this tab. This log stays in your browser and clears when you refresh or close the page. See our Privacy Policy for the site analytics we do collect.

Legal

Privacy Policy

Last updated: 15 November 2026

1. Who we are

EvalSpec ("we", "us", "our") operates the website at evalspec.ai and provides a structured AI systems evaluation framework. We are the data controller for personal data collected through this service.

Contact: hello@evalspec.ai

2. What data we collect

We collect the minimum data necessary to provide the service:

Data Why we collect it
Email address Account creation, login, and password reset
Evaluation data AI system descriptions, test cases, and scores you enter while using EvalSpec. Stored to your account so you can retrieve them later.
Payment confirmation When you purchase credits, Stripe notifies us that a payment was completed and which credit tier to apply. We do not receive or store your card details.

Verify a report page - to prevent abuse of the public verify a report page, we count how many checks come from each visitor. We do this with a scrambled form of your IP address (a one-way hash with a random value that changes every day), which cannot be turned back into your IP address. We do not store the IP address itself, and the scrambled value is deleted within a day.

Product analytics - to see where people get stuck, we record which steps of EvalSpec are reached: for example that the test case library was viewed, a sign-up was started or an evaluation was run. Each record is the name of the step and, for a few steps, a fixed option such as the credit bundle chosen. It never includes your email address, your AI system's name or anything you type. If you arrived through a campaign link, its campaign tags (utm_source, utm_medium and utm_campaign) are kept in your browser for the current tab and recorded with a sign-up. These records are sent to Vercel Analytics, which uses no cookies. How long you spend on each wizard step is held only in your browser's memory for the current tab and is never sent anywhere.

3. Legal basis for processing

We process your personal data on the following legal bases under UK GDPR:

  • Contract - email address is required to provide the account and service you signed up for.
  • Contract - processing payment confirmation to deliver the credits you purchased.
  • Legitimate interests - keeping a short-lived, scrambled form of your IP address when you use the verify a report page, so the page cannot be abused.

4. Third-party services

We use a small number of trusted third-party services to operate EvalSpec:

  • Supabase - provides our database and authentication infrastructure. Your email address and evaluation data are stored on Supabase servers. Supabase is SOC 2 Type II certified. Supabase Privacy Policy ↗
  • Stripe - processes all payments. When you purchase credits you are redirected to a Stripe-hosted payment page. EvalSpec never sees your card number or billing address. Stripe Privacy Policy ↗
  • Vercel - hosts and serves the EvalSpec application. Vercel may process standard server logs (IP address, browser type) as part of normal web hosting. Vercel Privacy Policy ↗
  • Cloudflare Web Analytics - provides privacy-friendly website analytics. Cloudflare Web Analytics uses no cookies and collects no personal data. It measures aggregate page views and referrers without tracking individual users or building profiles. Cloudflare Privacy Policy ↗
  • Vercel Analytics - provides privacy-friendly website analytics. Vercel Analytics uses no cookies and collects no personal data. It measures aggregate page views, web vitals, visitor counts and the product steps described in section 2, without tracking individual users or building profiles. Vercel Privacy Policy ↗

We do not use any advertising networks, social media trackers, or behavioural tracking tools.

5. Cookies

EvalSpec does not use advertising or tracking cookies. Supabase Auth uses a session token stored in localStorage to keep you logged in. This token is essential for the service to function and does not track you across other websites.

6. How long we keep your data

  • Account data - retained for as long as your account is active.
  • Evaluation data - retained for as long as your account is active, or until you delete individual evaluations.
  • Device fingerprint - retained for as long as your account is active.
  • Payment records - retained for 7 years to meet UK financial record-keeping obligations.
  • Verify a report checks - the scrambled form of your IP address is deleted within a day.

When you delete your account, all personal data is removed from our systems within 30 days, except where retention is required by law.

7. Your rights

Under UK GDPR you have the right to:

  • Access - request a copy of the personal data we hold about you.
  • Rectification - ask us to correct inaccurate data.
  • Erasure - ask us to delete your personal data ("right to be forgotten").
  • Restriction - ask us to limit how we process your data.
  • Portability - receive your data in a structured, machine-readable format.
  • Object - object to processing based on legitimate interests (including the device fingerprint).

To exercise any of these rights, email us at hello@evalspec.ai. We will respond within 30 days. You also have the right to lodge a complaint with the Information Commissioner's Office (ICO) ↗.

8. Data security

All data is transmitted over HTTPS. Access to the database is restricted by Supabase Row Level Security (RLS) policies, ensuring each user can only access their own data. Passwords are hashed by Supabase Auth and never stored in plain text.

9. Children

EvalSpec is not directed at children under 13. We do not knowingly collect personal data from children. If you believe a child has provided us with personal data, please contact us and we will delete it promptly.

10. Changes to this policy

If we make material changes to this policy we will update the "Last updated" date at the top of this page and, where appropriate, notify registered users by email.

11. Contact

For any privacy-related questions or requests, contact us at hello@evalspec.ai.

Blog

Insights on AI evaluation

Practical guides, frameworks, and best practices for testing AI systems before production.

Views expressed in these articles reflect the EvalSpec team's experience and research. They do not constitute professional, legal, or regulatory advice.

404

Page not found

The page you're looking for doesn't exist.

Back to home