kitio.aiAdded Oct 28, 2026
Deepchecks
Free trialLLM evaluation, testing and monitoring platform for production AI
What is Deepchecks?
Deepchecks is an evaluation and observability platform for LLM apps and AI agents that scores outputs, compares versions and monitors quality in production. It is for AI teams that need consistent quality checks beyond ad hoc LLM-as-a-judge scripts.
Teams can compare prompts, models and agents, build auto-scoring pipelines for nuanced requirements, generate datasets and create LLM judges quickly. Auto-scoring also helps with annotation and slicing data to find weak spots.
Tests run in CI/CD, tracing and monitoring cover production, and the platform can be cloud-hosted or privately hosted. Deepchecks also maintains a widely starred open-source testing library and is available natively inside AWS SageMaker.
Features
- Version comparison
- Auto-scoring pipelines
- LLM judge creation
- Dataset generation
- CI/CD testing
- Production monitoring
Tags
Releases
+ Submit new release- Listed
Deepchecks was added to the directory.
Organization
Deepchecks AI
🇮🇱 Israel
Listed by kitio.ai · unverified owner
Pricing
- Pricing model
- Free trial
- Paid options from
- Not listed
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.
Top Deepchecks alternatives
View allModels & APIs
Open-source Python library for testing and evaluating LLM apps
Models & APIs
Open-source LLM observability, prompt management and evals
Models & APIs
Comet's open-source platform for LLM tracing and evaluation
Models & APIs
AI observability and evaluation, plus the open-source Phoenix
Compare Deepchecks
If you liked Deepchecks
LLM evaluation platform built on the open-source DeepEval framework
Freemium · $200/moModels & APIsMade in United StatesOpen-source AI agent observability that sends failures to coding agents
Freemium · $99/moModels & APIsMade in Spain
Pros and cons
Pros
- Evaluation and monitoring in one place
- Private hosting option
- Available inside AWS SageMaker
Cons
- Prices not listed publicly
- Basic plan limited to one AI application
- Enterprise features need sales contact
Prompts & results
No prompts yet. Add your own prompt and output to help others use this tool.
Share a prompt
Reviews
Q&A
What is Deepchecks?
Deepchecks is an evaluation and observability platform for LLM apps and AI agents that scores outputs, compares versions and monitors quality in production. It is for AI teams that need consistent quality checks beyond ad hoc LLM-as-a-judge scripts.
How much does Deepchecks cost?
Deepchecks is free trial.
Is there a free version of Deepchecks?
No, but you can try it free before paying.
What are the main features of Deepchecks?
Version comparison, Auto-scoring pipelines, LLM judge creation, Dataset generation, CI/CD testing, Production monitoring.
Who makes Deepchecks?
Deepchecks is made by Deepchecks AI.
What are the best alternatives to Deepchecks?
Popular alternatives include BenchLLM, Langfuse, Opik.