Run LLMs on Old Android Phones with OlliteRT: OpenAI-Compatible Local Server
OlliteRT lets you run large language models on Android phones with 6GB+ RAM, exposing an OpenAI-compatible API for network clients, supporting model management, multimodal inference, and Home Assistant integration, though limited to .litertlm format and single-model loading.
