BestHub
Sign in
Tag

ERNIE

0 views collected around this technical thread.

Baidu Geek Talk
Baidu Geek Talk
Nov 9, 2023 · Artificial Intelligence

Deep Learning Model Architecture Evolution in Baidu Search

The article chronicles Baidu Search’s Model Architecture Group’s evolution of deep‑learning‑driven search, detailing the shift from inverted‑index to semantic vector indexing, the use of transformer‑based models for text and image queries, large‑scale offline/online pipelines, and extensive GPU‑centric optimizations such as pruning, quantization and distillation, all aimed at delivering precise, cost‑effective results to hundreds of millions of users.

Deep LearningERNIEGPU inference
0 likes · 14 min read
Deep Learning Model Architecture Evolution in Baidu Search
DataFunSummit
DataFunSummit
Nov 3, 2023 · Artificial Intelligence

Applying Large Language Models to Search Advertising Satisfaction: From DNN to ERNIE and Prompt Learning

This article details Baidu Fengchao's practical use of large language models to improve search advertising satisfaction, covering search ad relevance, the transition from DNN to ERNIE, prompt-based industry isolation, AIGC applications, and a Q&A on model architecture and optimization.

ERNIESearch Advertisingad satisfaction
0 likes · 22 min read
Applying Large Language Models to Search Advertising Satisfaction: From DNN to ERNIE and Prompt Learning
Baidu Tech Salon
Baidu Tech Salon
Jul 21, 2023 · Artificial Intelligence

IDC Report: Baidu Wenxin Large Model Leads AI Evaluation with 7 Full Scores

IDC’s 2023 AI Large Model Technology Capability Assessment names Baidu’s Wenxin (ERNIE) series as the overall leader, earning seven full scores across twelve dimensions—including the sole perfect score for algorithm model—thanks to its four‑layer stack, knowledge‑enhanced core, PaddlePaddle platform, and extensive industry deployments with over 150,000 enterprises.

AI Large ModelsBaiduERNIE
0 likes · 6 min read
IDC Report: Baidu Wenxin Large Model Leads AI Evaluation with 7 Full Scores
Architecture & Thinking
Architecture & Thinking
Jun 30, 2023 · Artificial Intelligence

How INT8 Quantization Supercharges Baidu's Search Models: Techniques and Insights

This article explores the rapid evolution of Baidu's semantic search models, the large GPU consumption they entail, and how extensive INT8 quantization, sensitivity analysis, calibration data augmentation, hyper‑parameter auto‑tuning, and advanced methods like Quantization‑Aware Training and SmoothQuant dramatically improve inference performance while preserving business metrics.

Deep LearningERNIEINT8 quantization
0 likes · 17 min read
How INT8 Quantization Supercharges Baidu's Search Models: Techniques and Insights
Baidu Geek Talk
Baidu Geek Talk
Jun 26, 2023 · Artificial Intelligence

INT8 Quantization for Baidu Search Semantic Models (ERNIE)

Baidu applied large‑scale INT8 quantization to its ERNIE search semantic models, achieving over 25% inference speedup with less than 1% degradation in relevance metrics by selectively quantizing less‑sensitive fully‑connected layers, using automated calibration, hyper‑parameter tuning, and techniques such as QAT and SmoothQuant, while paving the way for even lower‑bit quantization and token pruning.

ERNIEINT8 quantizationQuantization Aware Training
0 likes · 15 min read
INT8 Quantization for Baidu Search Semantic Models (ERNIE)
DataFunTalk
DataFunTalk
Dec 4, 2021 · Artificial Intelligence

Knowledge‑Enhanced Graph Semantic Understanding and the ERNIESage Framework

This article introduces knowledge‑enhanced graph semantic understanding techniques, detailing the ERNIE pre‑training models, GraphSAGE, and the ERNIESage family of node, edge, and multi‑neighbor architectures, and demonstrates their explicit and implicit knowledge integration in industrial search, recommendation, and map‑POI applications.

ERNIEGraph Neural NetworksSemantic Understanding
0 likes · 14 min read
Knowledge‑Enhanced Graph Semantic Understanding and the ERNIESage Framework
DataFunTalk
DataFunTalk
Sep 5, 2019 · Artificial Intelligence

Baidu Semantic Computing: ERNIE, SimNet, and Future Directions in Natural Language Processing

This article reviews Baidu's research on semantic computing, covering the evolution of semantic representation, the development and evaluation of the ERNIE and SimNet models, their industrial applications, model compression techniques, and outlines future research priorities in multilingual and multimodal semantic understanding.

Deep LearningERNIENatural Language Processing
0 likes · 12 min read
Baidu Semantic Computing: ERNIE, SimNet, and Future Directions in Natural Language Processing