AI tools for Self Hosted Models
Browse 13 catalog entries for self hosted models tasks. Listings are displayed alphabetically and are not quality, popularity, or editorial rankings.
Catalog entries
AnythingLLM
Multi-user enterprise-grade local RAG document workspace indexing folders systematically.
ComfyUI
The most powerful and modular node-based diffusion model GUI, API, and backend.
GPT4All
Nomic's privacy-centric desktop application parsing local document folders offline.
Jan
An open-source custom-aligned desktop assistant mirroring standard editors sidebars.
KoboldCPP
An optimized, lightweight single-file executable running local GGUF weights on low RAM.
Llamafile Suite
Mozilla-backed multi-platform executable bundling weights inside single run files.
LM Studio
A beautiful, premium cross-platform GUI discovering, downloading, and running GGUF local files.
LocalAI Suite
An open-source self-hostable OpenAI API wrapper executing model endpoints locally.
Ollama
The absolute premier command-line manager instantiating local LLM nodes in single commands.
Open WebUI
An incredibly feature-rich ChatGPT clone designed to overlay local Ollama API loops beautifully.
PrivateGPT
A developer-first secure template building fully offline RAG nodes securely.
Qwen
Alibaba Cloud's bilingual model, highly tailored for local server hosting and translation.
vLLM Server
An incredibly fast, high-throughput LLM serving engine optimized for GPUs.
Our Methodology
This beta presents documented catalog details without public scores or rankings. Check each listing's official source and verification date before relying on it.
Read Evaluation Standards