Tagged articles

OlliteRT

3 articles · Page 1 of 1

Oct 5, 2026 · Mobile Development

Run LLMs on Old Android Phones with OlliteRT: OpenAI-Compatible Local Server

OlliteRT lets you run large language models on Android phones with 6GB+ RAM, exposing an OpenAI-compatible API for network clients, supporting model management, multimodal inference, and Home Assistant integration, though limited to .litertlm format and single-model loading.

AndroidLLMOlliteRT

0 likes · 8 min read

Run LLMs on Old Android Phones with OlliteRT: OpenAI-Compatible Local Server

macrozheng

Sep 23, 2026 · Mobile Development

Run LLMs on 6GB Android Phones with OlliteRT: OpenAI-Compatible LAN API

OlliteRT is an open-source Android app that runs large language models locally via Google's LiteRT runtime, exposing an OpenAI-compatible API over LAN for lightweight always-on tasks like RSS summarization and smart home automation, with monitoring, logging, and security features.

AndroidGemmaLLM

0 likes · 11 min read

Run LLMs on 6GB Android Phones with OlliteRT: OpenAI-Compatible LAN API

Architecture Digest

Sep 2, 2026 · Artificial Intelligence

OlliteRT: Turn Old Android Phones into Local LLM API Servers

OlliteRT is an open-source Android app that transforms old phones into local LLM servers exposing OpenAI-compatible APIs, supporting models like Gemma 4 E2B and Qwen 2.5 1.5B with configurable hardware acceleration, monitoring, and Home Assistant integration, all running offline on 5-10W power.

AndroidGemmaHome Automation

0 likes · 10 min read

OlliteRT: Turn Old Android Phones into Local LLM API Servers