on-device LLM — 3 Technical Articles

Jul 15, 2025 · Artificial Intelligence

Unlock Apple’s On‑Device LLM: Foundation Models Guide & Travel Planner Demo

This article introduces Apple’s Foundation Models framework for on‑device large language models, explains its advantages and limitations, details technical features like guided generation, snapshot streaming, and tool calling, and provides a complete Swift‑based travel‑itinerary example with performance‑tuning tips.

AIAppleSwift

0 likes · 12 min read

Unlock Apple’s On‑Device LLM: Foundation Models Guide & Travel Planner Demo

ShiZhen AI

Jun 14, 2024 · Artificial Intelligence

Can Apple Intelligence Preserve Privacy in the AI Era?

Apple Intelligence introduces on‑device large language models and new AI features across iOS, macOS and iPad, but its limited memory forces aggressive quantization and a private‑cloud fallback, raising questions about whether Apple can truly safeguard user data while matching competitors like Google, Microsoft and OpenAI.

Apple IntelligenceChatGPT integrationPost‑Training Quantization

0 likes · 11 min read

Can Apple Intelligence Preserve Privacy in the AI Era?

21CTO

May 21, 2024 · Artificial Intelligence

How Google’s Edge AI Makes On‑Device Large Language Models a Reality

Google I/O highlighted the rise of on‑device AI, showing how new neural processors, Edge TPU, and tools like the Edge AI SDK and TensorFlow Lite enable developers to run large language models locally, reducing latency, cost, and privacy concerns while integrating with cloud resources.

AIEdge AIGoogle I/O

0 likes · 9 min read

How Google’s Edge AI Makes On‑Device Large Language Models a Reality