Promptmetheus

Promptmetheus is an IDE for composing, testing and optimizing prompts used in AI apps, agents and automations. Prompt engineers and developers use it to compare output quality, cost and speed across more than 150 models from 15 providers.

Prompts are built from text and data blocks with variants, so you can iterate quickly and track every version. Datasets inject user input or retrieved context, and custom evaluators automatically check completions against your requirements.

Projects group prompts, datasets and completions with dashboard statistics, and completion ratings show results by model and variant. Providers include OpenAI, Anthropic, Google DeepMind, Mistral, xAI, DeepSeek and Groq, and you can configure your own endpoint.