kitio.aiAll AI tools
Every tool in the directory (5,694). Filter by category and price, or search by what you want to do.
Every tool in the directory (5,694). Filter by category and price, or search by what you want to do.
17 tools for “Local Inference”
Searching forlocalinferenceModels & APIs
NVIDIA's optimized model containers and hosted API catalog
Open-source library for faster, low-memory LLM fine-tuning
Open-source gateway to call 100+ LLM providers in OpenAI format
Enterprise models for chat, embeddings and reranking with private deployment
Open-source LLM observability, prompt management and evals
Comet's open-source platform for LLM tracing and evaluation
Fast inference for large open models on SambaNova's RDU chips
Observability, evals and governance for enterprise AI agents
Serverless inference for open models on Cloudflare's global network
Open-source model serving and a managed platform for AI inference
LLM evaluation platform built on the open-source DeepEval framework
Inference cloud for open models like DeepSeek, Qwen and GLM
Wafer-scale chips serving open models at record inference speeds
Very fast inference API for open models on custom LPU chips
Open-source AI agent observability that sends failures to coding agents
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.