OlliteRT is an open-source Android app that runs large language models locally via Google's LiteRT runtime, exposing an OpenAI-compatible API over LAN for lightweight always-on tasks like RSS summarization and smart home automation, with monitoring, logging, and security features.
OlliteRT is an open-source Android app that transforms old phones into local LLM servers exposing OpenAI-compatible APIs, supporting models like Gemma 4 E2B and Qwen 2.5 1.5B with configurable hardware acceleration, monitoring, and Home Assistant integration, all running offline on 5-10W power.
Google AI Edge Gallery is an on‑device generative‑AI platform that lets users run and compare open‑source large language models on phones, offering features like chat, image Q&A, audio transcription, benchmark testing, and modular skills, while its open‑source nature and easy installation have quickly earned it over 22,000 GitHub stars.
Google AI Edge introduces two open‑source projects—Gallery and LiteRT‑LM—that let Android developers run large language models locally without network connectivity, offering offline inference, privacy protection, GPU/NPU acceleration, and streaming output for real‑time AI experiences.
