Self-hosted AI
Run language models, chat UIs and AI gateways on your own hardware, with measured speed and memory use.
Planned, in order
- Run an LLM locally with Ollama on Linux In review
- Install Open WebUI and connect it to Ollama Planned
- Run Ollama in Docker with NVIDIA GPU Planned
- Use Codex CLI in the terminal Planned
- Run LiteLLM as a self-hosted AI gateway Planned