Tagged articles

AWQ quantization

1 articles · Page 1 of 1
DaTaobao Tech
DaTaobao Tech
Oct 15, 2026 · Artificial Intelligence

On-Device Intent Detection at Taote: LoRA, ShortGPT Pruning & AWQ Quantization

Taote details its end-to-end on-device model pipeline for real-time user intent detection, using Qwen3-0.6B with LoRA fine-tuning, ShortGPT-based layer pruning, and AWQ quantization to achieve 80%+ on-device accuracy, enabling feed re-ranking and retention coupon scenarios with measurable GMV growth.

AWQ quantizationGMV growthLoRA fine-tuning
0 likes · 30 min read
On-Device Intent Detection at Taote: LoRA, ShortGPT Pruning & AWQ Quantization