kitio.aiAll AI tools
Every tool in the directory (5,694). Filter by category and price, or search by what you want to do.
Every tool in the directory (5,694). Filter by category and price, or search by what you want to do.
69 tools for “Local Inference”
Searching forlocalinferenceModels & APIs
NVIDIA's optimized model containers and hosted API catalog
Open-source library for faster, low-memory LLM fine-tuning
Open-source gateway to call 100+ LLM providers in OpenAI format
Package an LLM and its runtime into one portable executable file
AI dubbing and speech models for 150+ languages, including live events
Legal AI workspace, private LLMs and custom workflows for law firms
Enterprise models for chat, embeddings and reranking with private deployment
Run and deploy open-source AI models through a simple API
Open-source LLM observability, prompt management and evals
Apple's array framework for running and training models on Apple Silicon
Comet's open-source platform for LLM tracing and evaluation
Fast inference for large open models on SambaNova's RDU chips
Gradio web interface for running local LLMs with many backends
GPU cloud for training and inference on NVIDIA H100, H200 and B200
Small task-specific open models for search, extraction and classification
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.