NewBeeNLP

Apr 25, 2024 · Artificial Intelligence

How Apple’s OpenELM Redefines Efficient LLM Scaling with Layer‑Wise Design

Apple’s OpenELM introduces a layer‑wise scaling Transformer family ranging from 270 M to 3 B parameters, provides a full open‑source training framework, and demonstrates superior zero‑shot and few‑shot performance over existing open LLMs despite using less public data, while also analyzing inference bottlenecks and PEFT results.