kitio.aiAll AI tools
Every tool in the directory (5,694). Filter by category and price, or search by what you want to do.
Every tool in the directory (5,694). Filter by category and price, or search by what you want to do.
43 tools for “LLM Inference”
Searching forllminferenceModels & APIs
Flat monthly LLM API with unlimited tokens and request-based limits
Cuts cloud and LLM inference bills with pooled commitments and routing
LLM evaluation platform built on the open-source DeepEval framework
Open-source LLM observability, prompt management and evals
Experiment tracking and LLM observability, now part of CoreWeave
Comet's open-source platform for LLM tracing and evaluation
Tracing, evaluation and deployment platform for LLM agents
Open-source AI gateway and LLM observability platform
Open-source AI agent observability that sends failures to coding agents
Platform for fine-tuning LLMs, data labeling and document extraction
Open-source library for faster, low-memory LLM fine-tuning
Open-source gateway to call 100+ LLM providers in OpenAI format
REST API and playground for open language and image models
Inference cloud for open models like DeepSeek, Qwen and GLM
Open-source model serving and a managed platform for AI inference
Very fast inference API for open models on custom LPU chips
One API and key for hundreds of models from dozens of providers
Enterprise models for chat, embeddings and reranking with private deployment
OpenTelemetry observability for Python apps and AI agents
AI observability and evaluation, plus the open-source Phoenix
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.