Terms of Service

Provider: AI Evaluator, identified through the domain aievaluator.dev.

Client: The person or entity that creates an account and uses the platform ("you").

By creating an account, you accept these Terms of Service in their entirety. If you do not agree, do not use the platform.

AI Evaluator provides an LLM-as-a-Judge evaluation platform as a service (SaaS). The service allows you to:

• Evaluate the quality of AI agent responses using LLM judges
• Upload datasets and configure evaluation metrics
• Integrate evaluations into CI/CD pipelines (GitHub Actions, GitLab CI)
• Manage teams with role-based access control (Enterprise)
• Configure Single Sign-On (Enterprise)

• Free: 50 evaluations per month. No payment required.
• Registered: 100 evaluations per month. Free. Requires account creation.
• Pro: 5,000 evaluations per month. €29/month. Billed via Stripe.
• Pro Plus: 5,000 evaluations per month + BYOK. €35/month. Billed via Stripe.
• Enterprise: Unlimited evaluations, SSO, RBAC, audit logs. Custom pricing.

Payments are processed by Stripe. By subscribing to a paid plan, you agree to Stripe's terms. Prices are subject to change with 30 days notice.

Subscriptions automatically renew each month. You may cancel at any time — your access continues until the end of the current billing period, after which you will not be charged again.

Refunds: monthly subscriptions are non-refundable. If you cancel mid-month, you retain access for the remaining days but no partial refund is issued.

You agree to:

• Provide accurate information during registration
• Not use the platform for illegal purposes or to evaluate content that violates applicable laws
• Not attempt to circumvent rate limits, quotas, or security measures
• Keep your API keys confidential — you are responsible for all activity under your account
• Comply with the terms of any third-party LLM providers you connect via BYOK

• Free and Registered plans: best-effort availability. No SLA.
• Pro plan: target 99.5% uptime. Support via email (business hours).
• Enterprise plan: 99.5% SLA (custom 99.99% available). 24/7 support.

We reserve the right to perform scheduled maintenance with advance notice (at least 24h for enterprise, 48h when possible).

• The platform, its code, design, and documentation are our intellectual property.
• Your data (datasets, evaluations, scores, agent responses) is your intellectual property. We claim no rights over it.
• We may use aggregated, anonymized usage statistics to improve the service.

We process your data in accordance with our Privacy Policy and applicable data protection laws (GDPR). By using the platform, you agree to our data processing practices as described in the Privacy Policy.

For enterprise clients: a Data Processing Agreement (DPA) is available on request. Contact support@aievaluator.dev.

To the maximum extent permitted by law:

• AI Evaluator is provided "as is" without warranties of any kind.
• We are not liable for damages arising from the use or inability to use the platform.
• LLM judges (DeepSeek, GPT-4, Claude) are third-party services. We do not guarantee the accuracy, completeness, or reliability of their evaluations.
• Our total liability for any claim is limited to the amount paid by you in the 12 months preceding the claim.

• You may close your account at any time from Settings or by contacting support.
• We may suspend or terminate your account for violation of these terms, with notice where possible.
• Upon termination, your data will be deleted within 30 days, except for immutable audit logs required for compliance.

We may update these terms. Material changes will be notified by email or through the platform. Continued use after changes constitutes acceptance.

These terms are governed by Spanish law. Any dispute shall be resolved in the courts of the provider's domicile in Spain. For consumers, the courts of their domicile shall have jurisdiction where applicable by law.

For any questions about these terms:

📧 support@aievaluator.dev