Tag

large-scale DNN

1 views collected around this technical thread.

Sohu Tech Products
Sohu Tech Products
Jan 10, 2024 · Artificial Intelligence

Baidu's Practices and Insights on Recommendation Ranking

Baidu’s recommendation ranking system handles billions of daily impressions and millions of users by combining discrete and cross features, bias mitigation, and long‑short sequence modeling within a multi‑stage funnel and hierarchical architecture, while planning to integrate large language models for generative, interpretable, and decision‑oriented recommendations.

AIBaidufeature engineering
0 likes · 19 min read
Baidu's Practices and Insights on Recommendation Ranking
AntTech
AntTech
May 24, 2022 · Artificial Intelligence

WPipe: Group‑Based Interleaved Pipeline Parallelism for Large‑Scale DNN Training

The paper introduces WPipe, a group‑based interleaved pipeline parallelism method that reduces memory overhead and weight‑update latency compared with PipeDream‑2BW, achieving up to 1.4× speed‑up and 36% lower memory usage while preserving model accuracy on large‑scale DNNs.

Memory EfficiencyWPipedeep learning
0 likes · 13 min read
WPipe: Group‑Based Interleaved Pipeline Parallelism for Large‑Scale DNN Training