Building a Privacy-First Chat Assistant with On-Device LLMs on Android
A developer shares the technical journey of building a floating chat assistant for Android that suggests replies using on-device LLMs, detailing accessibility-based screen reading, OCR fallback for WeChat, a local memory system, CPU vs GPU benchmarking surprises, and AI-assisted development with Claude Code.
