1. Acceptance of terms
By creating an account or using EvalSpec at evalspec.ai, you agree to these Terms of Service. If you do not agree, do not use the service. These terms form a binding agreement between you and EvalSpec ("we", "us", "our").
2. What EvalSpec is
EvalSpec is a browser-based diagnostic tool that provides a structured framework for evaluating AI systems across five dimensions: Accuracy & Groundedness, Consistency & Reliability, Safety & Compliance, Alignment & Usefulness, and Robustness & Edge Cases.
EvalSpec is a diagnostic tool, not a certification service. Evaluation results are generated based entirely on the test cases, scores, and weightings you provide. Results represent a structured assessment of the inputs you supplied - they are not a guarantee, certification, or assurance that your AI system is fit for purpose in any particular context, free from defects, or compliant with any regulation. You remain solely responsible for all decisions regarding the development, testing, deployment, and operation of your AI systems.
No two AI systems or deployment contexts are identical. EvalSpec provides a consistent framework, but results will vary depending on the test cases selected, the scores assigned, and the risk profile chosen. We strongly recommend using EvalSpec as one input among several in your quality assurance process.
3. Accounts
- You must provide a valid email address to create an account.
- You are responsible for maintaining the security of your account credentials.
- You must not share your account with others or allow unauthorised access.
- You must be at least 13 years old to use EvalSpec.
- We reserve the right to suspend or terminate accounts that violate these terms.
4. Credits, payments & refunds
EvalSpec operates on a credit system. One credit pays for one evaluation of one AI system with up to 80 test cases.
- Every account receives one free evaluation credit on registration. No payment is required to get started.
- Additional credits are purchased in the tiers listed on the pricing page. Prices are in GBP and include VAT where applicable.
- Payments are processed securely by Stripe. EvalSpec does not store your card details.
- A credit is used when you start an automated evaluation, or when you first save a manual one, whether or not every test case is then scored.
- When the credit is used, the system details, selected test cases and dimension weights for that evaluation are fixed. Testing a different system, different test cases or different weights needs a new evaluation and a new credit.
- Resuming an interrupted run, retrying test cases the judge could not score (up to three attempts each), changing scores, and viewing, printing or exporting results do not use further credits.
- Credits do not expire.
- All purchases are non-refundable. Once a credit purchase is completed, it cannot be refunded, whether or not the credits have been used. If you experience a technical issue that prevents you from using a credit you have paid for, contact us at hello@evalspec.ai and we will investigate.
5. Acceptable use
You agree not to use EvalSpec to:
- Attempt to gain unauthorised access to any part of the service or its infrastructure.
- Reverse engineer, decompile, or attempt to extract the source code of the service.
- Use automated tools to scrape, crawl, or stress-test the service.
- Submit content that is unlawful, harmful, or infringes third-party rights.
- Resell or sublicense access to the service without written permission.
- Circumvent the free-tier credit limit through multiple account creation or other means.
6. Your content
You retain ownership of any AI system descriptions, test cases, and evaluation data you submit to EvalSpec. By submitting content, you grant us a limited licence to store and process it solely for the purpose of providing the service to you. We do not use your evaluation data for any other purpose, and we do not share it with third parties.
7. Intellectual property
EvalSpec, its framework, methodology, design, and software are owned by EvalSpec and protected by applicable intellectual property laws. You may not copy, reproduce, or distribute any part of the service without written permission.
8. Disclaimer of warranties
EvalSpec is provided "as is" and "as available" without warranties of any kind, express or implied. We do not warrant that the service will be uninterrupted, error-free, or that results will be accurate, complete, or suitable for any particular purpose. The evaluation framework is based on established standards (NIST, EU AI Act, ISO 42001, OWASP) but its application depends entirely on the inputs and configuration you provide.
9. Limitation of liability
To the fullest extent permitted by law, EvalSpec shall not be liable for any indirect, incidental, special, consequential, or punitive damages arising from your use of the service, including but not limited to losses arising from reliance on evaluation results in deployment decisions. Our total liability to you for any claim shall not exceed the amount you paid to us in the 12 months preceding the claim.
10. Service availability & changes
We reserve the right to modify, suspend, or discontinue any part of the service at any time. We will provide reasonable notice of material changes where possible. We may update these terms from time to time - continued use of the service after changes are posted constitutes acceptance of the updated terms.
11. Governing law
These terms are governed by the laws of England and Wales. Any disputes arising from these terms or your use of EvalSpec shall be subject to the exclusive jurisdiction of the courts of England and Wales.
12. Contact
For any questions about these terms, contact us at hello@evalspec.ai.