Black & White Path

Aug 19, 2026 · Artificial Intelligence

Building a Local LLM with Ollama and a RAG‑Powered Security Knowledge Base

This guide walks through installing Ollama on a RTX 5080 laptop, configuring CUDA, pulling quantized 26‑B and 31‑B Gemma models, setting up Open WebUI via Docker, adding an embedding model, and creating a RAG‑enabled security knowledge base for offline AI queries.