Switch language한국어
Back to the list

Want Your AI to Stay Private? Run a Fully Local LLM with Open WebUI + Ollama

TL;DR AI

Key summary

2 min read
  1. The article shows how to run a fully local LLM using Open WebUI and Ollama to keep data on your machine.

  2. Ollama provides a local API on port 11434 and models can be pulled with ollama pull and listed with ollama list.

  3. Open WebUI runs in Docker and should use --network=host so the container can access the local Ollama API.

  4. After starting the container, the chat interface is available at http://localhost:8080 for private, offline use.

Read the original