Tagged articles
pretrained language models
10 articles · Page 1 of 1
Unified Prompt Tuning (UPT) is a meta-learning based few‑shot algorithm that converts diverse NLP tasks into a common Prompt‑Options‑Verbalizer format, enabling large pre‑trained language models to achieve higher accuracy with minimal labeled data, as demonstrated on EMNLP‑2022 benchmarks and SuperGLUE datasets.
Few-Shot LearningMeta-learningNLP
0 likes · 10 min read

This report reviews the background, recent research progress, practical applications, and future directions of controllable text generation using transformer‑based pretrained language models, highlighting methods such as decoding strategies, prompt learning, memory networks, continual learning, contrastive training, and knowledge integration.
Continual LearningKnowledge Integrationcontrastive training
0 likes · 13 min read

This article presents Meituan's practical experience with compressing large pre‑trained language models—covering challenges of large‑model deployment, compression techniques such as knowledge distillation, pruning and quantization, the AutoDisc assistant‑model approach, multi‑teacher and iterative distillation, and real‑world applications in search advertising, intelligent assistants, and dual‑tower semantic matching.
MeituanNLPpretrained language models
0 likes · 17 min read

After the BERT era, this article reviews the limitations of pre‑trained language models for semantic matching, discusses negative‑sample sampling, data‑augmentation techniques, contrastive learning methods such as ConSERT and SimCSE, and practical deployment considerations in vector‑based retrieval systems.
Contrastive LearningData Augmentationpretrained language models
0 likes · 20 min read

This comprehensive article surveys controllable text generation, covering core NLP concepts, model architectures, evaluation metrics, four main control strategies, recent research trends, and a practical e‑commerce query‑generation case study.
Evaluation Metricscontrollable text generationnatural language processing
0 likes · 33 min read

This article presents a comprehensive approach to Chinese short‑text entity linking, describing the Qianyan dataset, pipeline and end‑to‑end task formulations, sample construction, a multitask model that jointly performs entity ranking and NIL classification, various optimization techniques including confidence learning and adversarial training, and detailed experimental analysis showing state‑of‑the‑art performance.
Chinese NLPadversarial trainingconfidence learning
0 likes · 13 min read


JD TechFeb 2, 2021 · Artificial Intelligence
The article reviews recent research on multimodal digital content generation and automatic text summarization, outlining the evolution from extractive to abstractive methods, highlighting four key technology trends such as pretrained language models, transformer dominance, knowledge‑enhanced generation, and multimodal‑knowledge joint modeling, and describing an industrial e‑commerce application built on these advances.
Generative ModelsKnowledge Integratione-commerce
0 likes · 12 min read

This article reviews current query expansion methods, contrasting relevance‑based models that rely on terms or entities with generative models that encode whole queries, discusses challenges of handling long and complex queries, and surveys recent research on encoding queries, session modeling, and multi‑task feature integration.
Generative ModelsNLPinformation retrieval
0 likes · 9 min read

The article reviews the principles of popular pretrained language models, compares their architectures, and details how NetEase Yanxuan applied BERT, GPT and ELMo to classification, matching, sequence labeling and generation tasks, presenting experimental results and deployment insights.
BERTNLPpretrained language models
0 likes · 20 min read

At the SIGIR 2020 Meituan workshop, researchers unveiled MT‑BERT’s large‑scale pre‑training and compression techniques, a KDD Cup winning solution that tackles bias with graph‑ and multimodal learning for search advertising, and a massive food‑delivery knowledge graph powering personalized recommendations, all demonstrating significant real‑world performance gains.
model compressionmultimodal learningpretrained language models
0 likes · 18 min read
