Domain Knowledge Enhanced Pretrained Language Model for Medicinal Product Vertical Search

This article presents a domain‑knowledge‑enhanced pretrained language model that combines ELECTRA‑based token‑level masking with a novel product‑attribute prediction (PAP) task to improve query understanding, intent classification, and relevance matching in vertical drug e‑commerce search, and validates its effectiveness through extensive experiments on public and proprietary datasets.

ELECTRAdomain knowledgemedical NLP

0 likes · 13 min read

Domain Knowledge Enhanced Pretrained Language Model for Medicinal Product Vertical Search

Meituan Technology Team

Jul 6, 2022 · Artificial Intelligence

Improving Search Relevance in PointCheck

The article details Meituan‑Dianping's search relevance pipeline, describing how multi‑similarity matrix structures, multi‑stage domain‑adaptive training, POI field summarization, and online inference optimizations together improve a BERT‑based relevance model's offline metrics and reduce the BadCase rate in production.

BERTMeituanmulti-similarity matrix

0 likes · 31 min read

Improving Search Relevance in PointCheck

DataFunTalk

Jun 20, 2022 · Artificial Intelligence

SMedBERT: Knowledge‑Enhanced Pre‑trained Language Model for Medical Text Mining and Its Business Applications

The article introduces Dingxiangyuan's medical knowledge‑graph ecosystem, describes the construction of a four‑layer taxonomy, presents the ACL‑published SMedBERT model that injects structured medical semantics into a pre‑trained language model, and discusses its deployment in search, query expansion, and semantic matching while outlining future challenges.

Healthcare AISMedBERTmedical NLP

0 likes · 13 min read

SMedBERT: Knowledge‑Enhanced Pre‑trained Language Model for Medical Text Mining and Its Business Applications

DataFunTalk

Dec 31, 2021 · Artificial Intelligence

Knowledge‑Enhanced Semantic Understanding with Baidu ERNIE: Techniques, Progress, and Applications

This article reviews Baidu's knowledge‑enhanced semantic understanding models, detailing the evolution from early semantic techniques to ERNIE 1.0, 2.0 and the large‑scale ERNIE 3.0, its architecture, training strategies, performance benchmarks, and real‑world applications across industry.

ErnieNLPai

0 likes · 19 min read

Knowledge‑Enhanced Semantic Understanding with Baidu ERNIE: Techniques, Progress, and Applications

Kuaishou Tech

Nov 16, 2021 · Artificial Intelligence

KuaiSearch's PERKS Pre‑trained Language Model Sets New Record on the CLUE Benchmark

The KuaiSearch research team introduced PERKS, a large‑scale Chinese pre‑trained language model that achieved an 80.618 score on the CLUE 1.1 language classification task, narrowing the gap to human annotation and demonstrating significant advances in multi‑stage training, model optimization, and real‑world search applications.

CLUE benchmarkKuaiSearchNLP

0 likes · 7 min read

KuaiSearch's PERKS Pre‑trained Language Model Sets New Record on the CLUE Benchmark

DataFunTalk

Oct 24, 2020 · Artificial Intelligence

FinBERT 1.0: An Open‑Source Chinese Financial Domain Pre‑trained BERT Model and Its Evaluation

FinBERT 1.0 is an open‑source Chinese BERT model pre‑trained on large‑scale financial corpora that achieves 2‑5 % F1 improvements across multiple downstream fintech tasks without additional tuning, demonstrating the value of domain‑specific pre‑training for natural language processing.

BERTChineseDeep Learning

0 likes · 14 min read

FinBERT 1.0: An Open‑Source Chinese Financial Domain Pre‑trained BERT Model and Its Evaluation

58 Tech

Jun 5, 2020 · Artificial Intelligence

qa_match V1.1: Upgraded Lightweight Deep Learning QA Matching Tool

The article introduces qa_match V1.1, an open‑source, Apache‑licensed lightweight question‑answer matching system that adds a simple pre‑trained language model (SPTM), supports one‑level knowledge bases, details model architecture, training resources, performance benchmarks, future plans, and contribution guidelines.

Deep LearningKnowledge Baseai

0 likes · 10 min read

qa_match V1.1: Upgraded Lightweight Deep Learning QA Matching Tool