Architecture Digest

Sep 2, 2026 · Artificial Intelligence

OlliteRT: Turn Old Android Phones into Local LLM API Servers

OlliteRT is an open-source Android app that transforms old phones into local LLM servers exposing OpenAI-compatible APIs, supporting models like Gemma 4 E2B and Qwen 2.5 1.5B with configurable hardware acceleration, monitoring, and Home Assistant integration, all running offline on 5-10W power.