kitio.aiAll AI tools
Every tool in the directory (10,042). Filter by category and price, or search by what you want to do.
Every tool in the directory (10,042). Filter by category and price, or search by what you want to do.
39 tools for “LLM Routing”
Few tools use these exact words, so these also include tools that match what you mean.
C/C++ engine for running LLMs efficiently on CPUs and GPUs
Command-line tool and Python library for working with any LLM
High-throughput open-source engine for serving LLMs in production
Run large language models together over a BitTorrent-style network
SDK that compiles and optimizes models for fast inference on NVIDIA GPUs
Open language, speech and vision models from TII in Abu Dhabi
Lightweight tensor library for running large models locally
Desktop app for chatting with open-source LLMs fully offline
Fast open-source serving framework for LLMs and vision models
Open-source Python library for production natural language processing
Baidu's open-source deep learning framework for training and inference
Package an LLM and its runtime into one portable executable file
Apple framework for running machine learning models on device
Apple's array framework for running and training models on Apple Silicon
NVIDIA SDK for real-time video analytics pipelines with vision AI
Gradio web interface for running local LLMs with many backends
Open-source platform for ML experiments, models and GenAI tracing
Open-source Python library for testing and evaluating LLM apps
Open-source library to run ML models from many programming languages
Open-source deep learning server and platform for training and inference
Open-source Mac app for chatting with local LLaMA models
Free native app to run AI models offline on your computer
Open-source Python library of NLP models for QA, NER and classification
Programming language for prompting LLMs with types and constraints
Open-source Python server for serving ML models over REST and gRPC
Sponsored
Your AI tool here
A Featured launch puts your tool in this spot and on the home page for a week.