kitio.aiAll AI tools
Every tool in the directory (5,694). Filter by category and price, or search by what you want to do.
Every tool in the directory (5,694). Filter by category and price, or search by what you want to do.
24 tools for “Inference Routing”
Searching forinferenceroutingModels & APIs
Few tools use these exact words, so these also include tools that match what you mean.
High-throughput open-source engine for serving LLMs in production
Fast open-source serving framework for LLMs and vision models
Package an LLM and its runtime into one portable executable file
Open-source Python library for testing and evaluating LLM apps
Apple's array framework for running and training models on Apple Silicon
Gradio web interface for running local LLMs with many backends
Open-source platform for ML experiments, models and GenAI tracing
Open-source library for fast, memory-efficient distributed training
Open-source deep learning framework from Berkeley AI Research
Open-source library for similarity search over dense vectors
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.