kitio.aiAll AI tools
Every tool in the directory (5,694). Filter by category and price, or search by what you want to do.
Every tool in the directory (5,694). Filter by category and price, or search by what you want to do.
232 tools for “LLM Inference”
Searching forllminferenceModels & APIs
High-throughput open-source engine for serving LLMs in production
Very fast inference API for open models on custom LPU chips
Run and deploy open-source AI models through a simple API
Fast open-source serving framework for LLMs and vision models
Low-cost serverless API for hundreds of open-source models
Affordable model APIs and GPU cloud for open-source AI
Managed Ray platform for scaling AI training, data and serving
Web search, research and inference APIs for AI applications
One API and key for hundreds of models from dozens of providers
Enterprise models for chat, embeddings and reranking with private deployment
Apple's array framework for running and training models on Apple Silicon
OpenTelemetry observability for Python apps and AI agents
Gradio web interface for running local LLMs with many backends
Open-source platform for ML experiments, models and GenAI tracing
AI observability and evaluation, plus the open-source Phoenix
AI gateway with observability, guardrails and prompt management
Observability, replay debugging and cost tracking for AI agents
Observability, evals and governance for enterprise AI agents
Emotionally intelligent voice AI, expression APIs and voice evals
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.