kitio.aiAdded Oct 28, 2026
Promptfoo
FreemiumOpen-source CLI for testing prompts and red-teaming AI apps
What is Promptfoo?
Promptfoo is an open-source command-line tool for evaluating prompts and models and for red-teaming AI applications against attacks like prompt injection. OpenAI acquired the company in March 2026, and the tool stays open source and provider-neutral.
You define test cases and assertions in a config file, run them across several models and compare results in a web view. Red-team mode generates adversarial inputs and reports vulnerabilities, and it plugs into CI pipelines.
The CLI is free under the MIT license and works with models from any provider, not only OpenAI. An enterprise version adds team features, continuous monitoring and compliance reporting.
Features
- Config-based test cases
- Model comparison
- Red-team scans
- CI integration
- Web results viewer
Tags
Releases
+ Submit new release- Listed
Promptfoo was added to the directory.
Organization
OpenAI
🇺🇸 United States
Listed by kitio.ai · unverified owner
Pricing
- Pricing model
- Freemium
- Paid options from
- Not listed
Promptfoo plans
Community
Free
- Open source
- All LLM evaluation features
- Red teaming (10k probes/month)
- Run locally or self-host
Enterprise
Contact sales
- Reports and continuous monitoring
- Issue tracking and remediation
- Dedicated runner
- Assigned deployment engineer
Prices in USD, checked Oct 28, 2026. Plans change often, so confirm on the Promptfoo site.Official pricing
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.
Top Promptfoo alternatives
View allModels & APIs
Run open models locally with one command, plus optional cloud models
Models & APIs
Open-source LLM observability, prompt management and evals
Models & APIs
Comet's open-source platform for LLM tracing and evaluation
Models & APIs
AI observability and evaluation, plus the open-source Phoenix
If you liked Promptfoo
LLM evaluation platform built on the open-source DeepEval framework
Freemium · $200/moModels & APIsMade in United States
Pros and cons
Pros
- Free and works with any provider
- Strong security testing
- Fits developer workflows
Cons
- Owned by a model vendor now
- CLI-first may not suit everyone
- Enterprise pricing not public
Prompts & results
No prompts yet. Add your own prompt and output to help others use this tool.
Share a prompt
Reviews
Q&A
What is Promptfoo?
Promptfoo is an open-source command-line tool for evaluating prompts and models and for red-teaming AI applications against attacks like prompt injection. OpenAI acquired the company in March 2026, and the tool stays open source and provider-neutral.
How much does Promptfoo cost?
Promptfoo is freemium.
Is there a free version of Promptfoo?
Yes. Promptfoo has a free plan, and paid plans add more usage and features.
What are the main features of Promptfoo?
Config-based test cases, Model comparison, Red-team scans, CI integration, Web results viewer.
Who makes Promptfoo?
Promptfoo is made by OpenAI.
What are the best alternatives to Promptfoo?
Popular alternatives include Ollama, Langfuse, Opik.