All AI tools
Every tool in the directory (10,042). Filter by category and price, or search by what you want to do.
Every tool in the directory (10,042). Filter by category and price, or search by what you want to do.
79 tools for “LLM Proxy”
Few tools use these exact words, so these also include tools that match what you mean.
Open-source gateway to call 100+ LLM providers in OpenAI format
Open-source LLM observability, prompt management and evals
AI gateway with observability, guardrails and prompt management
Flat monthly LLM API with unlimited tokens and request-based limits
The main hub for open models, datasets and AI demo apps
Serverless inference for open models on Cloudflare's global network
Tracing, evaluation and deployment platform for LLM agents
NVIDIA's optimized model containers and hosted API catalog
Experiment tracking and LLM observability, now part of CoreWeave
Very fast inference API for open models on custom LPU chips
Serverless cloud for running Python and GPU workloads on demand
Wafer-scale chips serving open models at record inference speeds
Comet's open-source platform for LLM tracing and evaluation
FinOps layer that meters, caps and routes LLM and agent spend
Fast inference for large open models on SambaNova's RDU chips
Open-source library for faster, low-memory LLM fine-tuning
Unified API, agent tool connectors and LLM gateway for AI products
Inference cloud for open models like DeepSeek, Qwen and GLM
Guardrails, evaluations and red teaming for LLM apps and agents
REST API and playground for open language and image models
Open-source model serving and a managed platform for AI inference
Open-source AI gateway and LLM observability platform
LLM evaluation platform built on the open-source DeepEval framework
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.