DataFunSummit

Mar 3, 2024 · Artificial Intelligence

Instruction Fine-Tuning Practices for Huawei's Pangu Large Language Model

This presentation details the concepts, methodologies, and experimental results of instruction fine‑tuning for Huawei's Pangu large language model, covering model scale, architecture, training strategies, data quality, parallelism techniques, and case studies on Chinese‑English translation and Thai language adaptation.