BestHub
Sign in
Tagged articles

NLP

530 articles · Page 4 of 6
DataFunTalk
DataFunTalk
Jul 2, 2021 · Artificial Intelligence

Vector Retrieval for Community Forum Search Using Milvus at Dingxiangyuan

This article describes how Dingxiangyuan's algorithm team adopted Milvus for distributed vector indexing to improve semantic search in their community forum, detailing the background, retrieval workflow, various embedding models—including Bi‑Encoder, Spherical Embedding, and Knowledge Embedding—and summarizing the benefits and future applications.

EmbeddingMilvusNLP
0 likes · 10 min read
Vector Retrieval for Community Forum Search Using Milvus at Dingxiangyuan
DataFunTalk
DataFunTalk
Jun 22, 2021 · Artificial Intelligence

Survey of Graph Neural Networks for Natural Language Processing

This comprehensive survey reviews the latest research on graph neural networks applied to natural language processing, covering graph construction methods, graph representation learning techniques, encoder‑decoder models, static and dynamic graph building, and discusses challenges, benchmarks, and future directions in the field.

Encoder-DecoderGraph ConstructionGraph Neural Networks
0 likes · 57 min read
Survey of Graph Neural Networks for Natural Language Processing
58 Tech
58 Tech
Jun 18, 2021 · Artificial Intelligence

Bidding Document Classification and Entity Extraction Using BERT-based Models

This article describes how 58.com built an end‑to‑end bidding service that crawls tender documents, classifies them into multiple categories with BERT‑based models (including softmax, sigmoid and ensemble approaches) and extracts key entities using BERT‑CRF and reading‑comprehension techniques, achieving over 90% overall accuracy and dramatically improving recall and precision.

BERTNLPdocument classification
0 likes · 15 min read
Bidding Document Classification and Entity Extraction Using BERT-based Models
Python Crawling & Data Mining
Python Crawling & Data Mining
Jun 16, 2021 · Artificial Intelligence

Master Chinese Text Segmentation with jieba: Installation, Modes, and Advanced Tricks

This tutorial walks you through installing the jieba Python library, explains its three segmentation modes—precise, full, and search—demonstrates how to add or delete words, manage custom dictionaries, handle stop words, perform weight analysis, adjust word frequencies, and retrieve token positions, all with clear code examples and visual output.

NLPPythonchinese segmentation
0 likes · 10 min read
Master Chinese Text Segmentation with jieba: Installation, Modes, and Advanced Tricks
MaGe Linux Operations
MaGe Linux Operations
Jun 13, 2021 · Fundamentals

7 Fun Python Projects: Web Scraping, Chatbots, Poetry Classification and More

This article presents seven practical Python scripts—from a concise web scraper for Zhihu images and a chatbot conversation loop to a Naive Bayes poem author classifier, a lottery number generator, an automated essay writer, a screen‑capture tool, and a GIF creator—demonstrating how to avoid reinventing the wheel while exploring diverse automation tasks.

ChatbotData GenerationNLP
0 likes · 8 min read
7 Fun Python Projects: Web Scraping, Chatbots, Poetry Classification and More
58 Tech
58 Tech
Jun 4, 2021 · Artificial Intelligence

Architecture and Evolution of the 58 Intelligent Q&A Chatbot System

This article details the design, iterative development, and performance optimizations of 58's AI‑driven intelligent Q&A chatbot, covering its overall three‑layer architecture, the QABot, TaskBot, and answer‑recommendation modules, as well as dynamic strategy adjustment, caching mechanisms, and real‑world deployment results.

AIChatbotNLP
0 likes · 16 min read
Architecture and Evolution of the 58 Intelligent Q&A Chatbot System
Meituan Technology Team
Meituan Technology Team
Jun 3, 2021 · Artificial Intelligence

ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer

ConSERT is a contrastive self‑supervised framework that fine‑tunes BERT with augmented sentence views and NT‑Xent loss to overcome embedding collapse, delivering roughly 8% higher STS performance than prior methods, remaining robust in few‑shot and supervised scenarios, and now deployed in Meituan’s NLP pipelines.

BERTNLPcontrastive learning
0 likes · 20 min read
ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer
Meituan Technology Team
Meituan Technology Team
May 27, 2021 · Artificial Intelligence

Standardizing Food Delivery Dish Names: Knowledge Graph Construction and Applications

The paper outlines an end‑to‑end pipeline that standardizes highly personalized food‑delivery dish names by combining rule‑based and BERT‑DSSM text synonym detection with EfficientNet image classification, constructing a multi‑level taxonomy that improves aggregation, supply‑demand analysis, recall ranking and merchant tagging.

NLPStandardizationcomputer vision
0 likes · 17 min read
Standardizing Food Delivery Dish Names: Knowledge Graph Construction and Applications
Python Programming Learning Circle
Python Programming Learning Circle
May 24, 2021 · Artificial Intelligence

Useful Python Libraries for Data Science Beyond Pandas and NumPy

This article introduces a curated selection of lesser‑known Python libraries for data‑science tasks—including data acquisition, date‑time handling, imbalanced‑learning, fast keyword extraction, fuzzy string matching, time‑series modeling, 3‑D visualization, web‑app building, and reinforcement‑learning—providing installation commands and concise usage examples.

NLPdata sciencelibraries
0 likes · 10 min read
Useful Python Libraries for Data Science Beyond Pandas and NumPy
TiPaiPai Technical Team
TiPaiPai Technical Team
May 21, 2021 · Artificial Intelligence

How AI Powers Automatic Homework Grading: Challenges and Solutions

Automatic homework grading leverages AI to transform captured images into graded results through preprocessing, layout analysis, OCR, answer matching, and strategy modules, while addressing three question categories—logical, text‑rich, and graphic—each presenting distinct technical challenges and future research directions.

AIEducation TechnologyImage processing
0 likes · 7 min read
How AI Powers Automatic Homework Grading: Challenges and Solutions
Meituan Technology Team
Meituan Technology Team
May 20, 2021 · Artificial Intelligence

CKBQA Task for Chinese Knowledge Graph Question Answering

The CKBQA task introduced at CCKS2021 challenges participants to build Chinese knowledge‑graph question answering systems that combine Meituan’s life‑services KG with open‑domain data from PKUBASE, requiring accurate, efficient and explainable handling of both domain‑specific and open‑domain queries to advance real‑world applications such as smart customer service and e‑commerce.

AICCKS2021KBQA
0 likes · 4 min read
CKBQA Task for Chinese Knowledge Graph Question Answering
Python Programming Learning Circle
Python Programming Learning Circle
May 5, 2021 · Fundamentals

Python Scripts for Various Automation Tasks: Web Scraping, Chatbots, Poem Classification, Lottery Generation, Apology Writing, Screen Capture, and GIF Creation

This article presents a collection of Python 3.6.4 scripts that demonstrate how to scrape Zhihu images, converse with chatbots, classify Tang poems using NLP, generate random lottery numbers, automatically compose apology letters, capture screen images, and create animated GIFs, providing practical code examples for each task.

ChatbotGIFNLP
0 likes · 9 min read
Python Scripts for Various Automation Tasks: Web Scraping, Chatbots, Poem Classification, Lottery Generation, Apology Writing, Screen Capture, and GIF Creation
Cyber Elephant Tech Team
Cyber Elephant Tech Team
Apr 28, 2021 · Artificial Intelligence

Understanding BERT: From Encoder-Decoder to Transformer and Attention

This article explains the BERT model by first reviewing the Encoder-Decoder framework, then detailing the attention mechanism—including self-attention and multi-head attention—before describing the full Transformer architecture and finally outlining BERT’s encoder-only design, training stages, and fine-tuning applications.

BERTEncoder-DecoderNLP
0 likes · 15 min read
Understanding BERT: From Encoder-Decoder to Transformer and Attention
NetEase Media Technology Team
NetEase Media Technology Team
Apr 13, 2021 · Artificial Intelligence

Applying BERT for News Timeliness Classification at NetEase

The article describes how NetEase adapts a pre‑trained BERT model to classify news articles into ultra‑short, short, or long timeliness categories by combining rule‑based strong and weak time cues, key‑sentence extraction, domain‑embedding fusion and multi‑layer semantic aggregation, achieving accurate and interpretable predictions for its platform.

Artificial IntelligenceBERTModel Fusion
0 likes · 12 min read
Applying BERT for News Timeliness Classification at NetEase
DataFunTalk
DataFunTalk
Apr 6, 2021 · Artificial Intelligence

Advances in Text Summarization: Pointer-Generator, Coverage Mechanisms, Entity Knowledge Integration, and Non-Autoregressive Models

This article reviews recent advances in abstractive summarization, covering pointer‑generator networks with coverage loss, integration of entity knowledge, strategies to mitigate repetition such as unlikelihood training and nucleus sampling, and emerging non‑autoregressive approaches like the Levenshtein Transformer.

NLPPointer-Generatorcoverage
0 likes · 15 min read
Advances in Text Summarization: Pointer-Generator, Coverage Mechanisms, Entity Knowledge Integration, and Non-Autoregressive Models
DataFunTalk
DataFunTalk
Apr 5, 2021 · Artificial Intelligence

Summary of Methods and Findings from the NLP Chinese Pre‑training Model Generalization Challenge

The article reviews the Chinese NLP pre‑training model generalization competition, detailing data preprocessing, augmentation, external data usage, model scaling and architecture tweaks, loss functions, learning‑rate and adversarial training strategies, regularization techniques, post‑processing optimizations, and ineffective methods, highlighting their impact on performance metrics.

Loss FunctionsModel OptimizationNLP
0 likes · 15 min read
Summary of Methods and Findings from the NLP Chinese Pre‑training Model Generalization Challenge
Youku Technology
Youku Technology
Mar 23, 2021 · Artificial Intelligence

Text-Video Alignment Algorithm for Automated Short Video Production at Youku

Youku’s new text‑video alignment system automatically generates short video summaries by extracting multimodal video and linguistic features, matching sentences to clips through embedding and tag‑level models, and enabling AI‑driven auto‑editing that cuts production time from days to minutes.

BERTNLPcross-modal matching
0 likes · 10 min read
Text-Video Alignment Algorithm for Automated Short Video Production at Youku
58 Tech
58 Tech
Mar 5, 2021 · Artificial Intelligence

Intelligent Job Title Generation with Pipeline and Seq2Seq Approaches

This article presents a comprehensive study on generating recruitment job titles by combining a rule‑based pipeline with advanced seq2seq models—including BiLSTM‑Attention, Pointer‑Generator, and a Field‑Gate Dual‑Attention architecture—demonstrating significant performance gains on real‑world hiring data.

NLPPointer-GeneratorText Generation
0 likes · 14 min read
Intelligent Job Title Generation with Pipeline and Seq2Seq Approaches
AntTech
AntTech
Mar 3, 2021 · Artificial Intelligence

Ant Group Intelligent Service Research Overview: NLP, Dialogue, Recommendation, and Anti‑fraud Papers

The article presents a comprehensive overview of Ant Group's intelligent service research, summarizing recent AI‑focused papers on text classification, stance detection, data augmentation, knowledge distillation for ranking, reinforcement‑learning‑based dialogue clarification, behavior‑cloning dialogue systems, anti‑fraud outbound bots, tag‑based service recommendation, and multi‑agent service groups, while also highlighting future directions and recruitment opportunities.

AI researchAnti‑fraudDialogue Systems
0 likes · 17 min read
Ant Group Intelligent Service Research Overview: NLP, Dialogue, Recommendation, and Anti‑fraud Papers
DataFunTalk
DataFunTalk
Feb 26, 2021 · Artificial Intelligence

Fine‑Grained Sentiment Analysis and Opinion Quadruple Extraction: Methods, Tasks, and Applications

This article introduces the concepts, tasks, and recent advances in text sentiment analysis, focusing on attribute‑level sentiment (TG‑ABSA) and opinion‑quadruple extraction, describing unsupervised, reading‑comprehension, and multi‑task deep‑learning approaches, their implementation on Huawei Cloud, experimental results, and future research directions.

NLPSentiment Analysisaspect‑based sentiment
0 likes · 20 min read
Fine‑Grained Sentiment Analysis and Opinion Quadruple Extraction: Methods, Tasks, and Applications
DataFunTalk
DataFunTalk
Feb 11, 2021 · Artificial Intelligence

How to Build Successful AI Products: Insights on AI Development, NLP, and Product Strategies

This article explores the current state of AI, the evolution of NLP and voice assistants, common pitfalls in AI product development, and practical product‑management methods—including user segmentation, metric design, and lifecycle planning—to help engineers and product managers deliver effective AI‑driven solutions.

AINLPProduct Management
0 likes · 19 min read
How to Build Successful AI Products: Insights on AI Development, NLP, and Product Strategies
Efficient Ops
Efficient Ops
Feb 7, 2021 · Artificial Intelligence

How NLP Transforms Big Data Operations: Real-World AIOps Case Studies

This article explores the intersection of natural language processing and operations, outlines common text‑handling challenges, and presents three concrete AIOps case studies—log Q&A, anomaly detection, and ticket recommendation—while reflecting on a closed‑loop AI workflow and future research directions.

AIOpsBig DataNLP
0 likes · 9 min read
How NLP Transforms Big Data Operations: Real-World AIOps Case Studies
JD Cloud Developers
JD Cloud Developers
Feb 5, 2021 · Artificial Intelligence

2020 NLP Milestones & Future Trends: Insights from JD’s AI Scientist

In an InfoQ interview, JD Technology senior algorithm scientist Wu Youzheng reviews the rapid advances of natural language processing in 2020—including GPT‑3, multimodal dialogue, knowledge‑enhanced pre‑training, and knowledge graphs—while outlining the most promising research directions and practical challenges for the coming year.

AI ApplicationsGPT-3NLP
0 likes · 18 min read
2020 NLP Milestones & Future Trends: Insights from JD’s AI Scientist
DataFunTalk
DataFunTalk
Feb 3, 2021 · Artificial Intelligence

Travel Search Technology and Innovations at Alibaba Feizhu

This article presents an in‑depth overview of Alibaba Feizhu's travel‑scene search system, covering its background, architecture, query understanding, tagging, POI mining, synonym extraction, recall strategies, model designs, performance results, and future directions for personalization and explainability.

AINLPSearch
0 likes · 18 min read
Travel Search Technology and Innovations at Alibaba Feizhu
HaoDF Tech Team
HaoDF Tech Team
Feb 2, 2021 · Artificial Intelligence

AI‑Based Structuring of Medical Examination Reports: OCR, Text Detection, Classification, and NER

This article describes how a Chinese online medical platform tackled the large‑scale extraction and structuring of hospital report images by combining OCR, deep‑learning text‑region detection, fast text classification, and advanced NER techniques, detailing challenges, algorithm choices, performance results, and remaining issues.

AINERNLP
0 likes · 19 min read
AI‑Based Structuring of Medical Examination Reports: OCR, Text Detection, Classification, and NER
New Oriental Technology
New Oriental Technology
Feb 1, 2021 · Artificial Intelligence

Neural Machine Translation: Seq2Seq, Beam Search, BLEU, Attention Mechanisms, and GNMT Improvements

This article explains key concepts of neural machine translation, covering Seq2Seq encoder‑decoder models, beam search strategies, BLEU evaluation, various attention mechanisms, and the enhancements introduced in Google's Neural Machine Translation system to improve speed, OOV handling, and translation quality.

BLEUBeam SearchGNMT
0 likes · 11 min read
Neural Machine Translation: Seq2Seq, Beam Search, BLEU, Attention Mechanisms, and GNMT Improvements
58 Tech
58 Tech
Jan 29, 2021 · Artificial Intelligence

Optimization Practices for Business Opportunity Slot Recognition in 58.com Intelligent Customer Service

This article details the background, challenges, architecture, model selection, and future directions of the business‑opportunity slot recognition module used in 58.com’s intelligent customer service, highlighting how regex‑model fusion and IDCNN‑CRF improve entity extraction for phone, WeChat, address, and time slots.

BERTCRFIDCNN
0 likes · 11 min read
Optimization Practices for Business Opportunity Slot Recognition in 58.com Intelligent Customer Service
JD Cloud Developers
JD Cloud Developers
Jan 25, 2021 · Artificial Intelligence

Top Tech Highlights: AI Advances, Open‑Source Rankings, and New Hardware in Jan 2021

This weekly roundup covers ShardingSphere's top‑5 ranking among Chinese‑led open‑source projects, Taro's entry into the 2020 China Open‑Source TOP4, Raspberry Pi Pico's $4 launch, Visual Studio's native WSL 2 support, Elasticsearch's license shift, Facebook's AI for the visually impaired, JD's future‑tech whitepaper, an AAAI paper on modal‑free segmentation, and SimCLR applied to NLP pre‑training.

AIHardwareNLP
0 likes · 6 min read
Top Tech Highlights: AI Advances, Open‑Source Rankings, and New Hardware in Jan 2021
JD Cloud Developers
JD Cloud Developers
Jan 18, 2021 · Artificial Intelligence

What’s New This Week? AI Model, MR Glasses, TypeScript 4.2, Go Generics & More

This week’s developer newsletter highlights China’s 11.3‑billion‑parameter Wenhui AI model, Rokid’s dual‑camera MR glasses, the TypeScript 4.2 beta release, a Go generics proposal for 1.18, Docker’s 2021 priorities, the Industrial Internet action plan, a robust DARTS paper from ICLR 2021, and the open‑source TextBox library for text generation.

AIDockerGo
0 likes · 8 min read
What’s New This Week? AI Model, MR Glasses, TypeScript 4.2, Go Generics & More
58 Tech
58 Tech
Jan 15, 2021 · Artificial Intelligence

Exploring Text Pre‑training Models for Dialogue Classification in Information Security: From TextCNN to RoBERTa and Knowledge Distillation

This article presents a systematic exploration of text pre‑training models for dialogue classification in information‑security scenarios, comparing baseline TextCNN, an enhanced TextCNN_role, RoBERTa with domain‑adaptive pre‑training, and a distilled mini‑model, and discusses their performance, trade‑offs, and future directions.

Dialog ModelingKnowledge DistillationNLP
0 likes · 13 min read
Exploring Text Pre‑training Models for Dialogue Classification in Information Security: From TextCNN to RoBERTa and Knowledge Distillation
Amap Tech
Amap Tech
Dec 30, 2020 · Artificial Intelligence

LRC-BERT: Contrastive Learning based Knowledge Distillation with COS‑NCE Loss for Efficient NLP Models

The Amap team introduced LRC‑BERT, a contrastive‑learning‑based knowledge‑distillation framework that employs a novel COS‑NCE loss, gradient‑perturbation, and a two‑stage training schedule, enabling a 4‑layer student model to retain about 97 % of BERT‑Base accuracy while being 7.5× smaller and 9.6× faster, and it has already improved real‑world traffic‑event extraction performance.

BERTCOS-NCE lossNLP
0 likes · 16 min read
LRC-BERT: Contrastive Learning based Knowledge Distillation with COS‑NCE Loss for Efficient NLP Models
DataFunSummit
DataFunSummit
Dec 27, 2020 · Artificial Intelligence

Sequence Labeling in Natural Language Processing: Definitions, Tag Schemes, Model Choices, and Practical Implementation

This article provides a comprehensive overview of sequence labeling tasks in NLP, covering their definition, common tag schemes (BIO, BIEO, BIESO), comparisons with other NLP tasks, major modeling approaches such as HMM, CRF, RNN and BERT, real‑world applications like POS tagging, NER, event extraction and gene analysis, and a step‑by‑step PyTorch implementation with dataset preparation, training pipeline, and evaluation metrics.

BERTCRFHMM
0 likes · 27 min read
Sequence Labeling in Natural Language Processing: Definitions, Tag Schemes, Model Choices, and Practical Implementation
DataFunTalk
DataFunTalk
Dec 25, 2020 · Artificial Intelligence

Exploring Pretraining Model Optimization and Deployment Challenges in NLP

This article reviews the evolution of pretraining models in NLP, discusses the practical challenges of deploying large models such as inference latency, knowledge integration, and task adaptation, and presents Xiaomi’s optimization techniques including knowledge distillation, low‑precision inference, operator fusion, and multi‑granularity segmentation for dialogue systems.

BERTDialogue SystemsInference Optimization
0 likes · 15 min read
Exploring Pretraining Model Optimization and Deployment Challenges in NLP
58 Tech
58 Tech
Dec 23, 2020 · Artificial Intelligence

Application Practice of Intelligent Writing Technology in the 58 Community Content Platform

The article reviews the rise of AI‑driven intelligent writing robots, outlines industry use cases, explains two main generation methods, and details how 58.com leverages massive structured data to automatically produce narrative, emotion‑rich listings for vehicles, housing, and jobs, enhancing user engagement.

58.comAIContent Generation
0 likes · 6 min read
Application Practice of Intelligent Writing Technology in the 58 Community Content Platform
DataFunTalk
DataFunTalk
Dec 21, 2020 · Artificial Intelligence

Intelligent Question Answering Technology Framework and Practices at Meituan

This article describes Meituan's intelligent question answering system, detailing its three core capabilities—Document QA, Community QA, and Knowledge‑Graph QA—along with the underlying machine‑reading comprehension models, multi‑task learning, answer ranking, and real‑world deployment scenarios across travel, hotel, and retail services.

MeituanNLPknowledge graph
0 likes · 22 min read
Intelligent Question Answering Technology Framework and Practices at Meituan
DataFunTalk
DataFunTalk
Dec 20, 2020 · Artificial Intelligence

Complex Semantic Expression Methods in Voice Assistants: NLP Layers, DIS Limitations, and the CMRL Schema

This article explains how voice assistants rely on NLP's three processing layers, examines the shortcomings of the traditional DIS semantic structure, introduces the hierarchical CMRL schema with its six element types, and presents two neural models—copy‑write seq2seq and seq2tree—for accurate semantic parsing of complex commands.

AICMRLNLP
0 likes · 15 min read
Complex Semantic Expression Methods in Voice Assistants: NLP Layers, DIS Limitations, and the CMRL Schema
DataFunSummit
DataFunSummit
Dec 18, 2020 · Artificial Intelligence

Complex Semantic Representation in Voice Assistants: NLP Layers, DIS Limitations, and the CMRL Schema

This article explains how voice assistants rely on a three‑layer NLP pipeline (lexical, syntactic, and semantic analysis), discusses the shortcomings of the traditional DIS (Domain‑Intent‑Slot) structure for complex commands, and introduces the hierarchical CMRL schema along with two neural models (copy‑write seq2seq and seq2tree) for converting natural language into structured logical expressions.

CMRLNLPSeq2Seq
0 likes · 14 min read
Complex Semantic Representation in Voice Assistants: NLP Layers, DIS Limitations, and the CMRL Schema
DataFunSummit
DataFunSummit
Dec 14, 2020 · Artificial Intelligence

LightSeq: High‑Performance Open‑Source Inference Engine for Transformers, GPT and Other NLP Models

This article introduces LightSeq, an open‑source, GPU‑accelerated inference engine that dramatically speeds up Transformer‑based models such as BERT and GPT by up to 14× over TensorFlow, supports multiple decoding strategies, integrates seamlessly with major deep‑learning frameworks, and provides detailed performance benchmarks and technical optimizations.

GPULightSeqNLP
0 likes · 15 min read
LightSeq: High‑Performance Open‑Source Inference Engine for Transformers, GPT and Other NLP Models
DataFunTalk
DataFunTalk
Dec 14, 2020 · Artificial Intelligence

Query Expansion Techniques: Relevance Modeling vs. Generative Approaches and Future Directions

This article reviews current query expansion methods, contrasting relevance‑based models that rely on terms or entities with generative models that encode whole queries, discusses challenges of handling long and complex queries, and surveys recent research on encoding queries, session modeling, and multi‑task feature integration.

Information RetrievalNLPQuery Expansion
0 likes · 9 min read
Query Expansion Techniques: Relevance Modeling vs. Generative Approaches and Future Directions
Python Crawling & Data Mining
Python Crawling & Data Mining
Nov 23, 2020 · Artificial Intelligence

How to Scrape Douban Reviews and Uncover Hidden Sentiment Trends with Python

This article demonstrates how to crawl Douban short reviews for the TV show "Actors Please Take Your Place" Season 2, clean and deduplicate the data, apply Baidu's SKEP sentiment model, and visualize word clouds, rating distributions, posting times, and sentiment scores, providing full Python code for replication.

NLPdata-visualizationdouban
0 likes · 10 min read
How to Scrape Douban Reviews and Uncover Hidden Sentiment Trends with Python
58 Tech
58 Tech
Nov 13, 2020 · Artificial Intelligence

Slot Recognition and Correction in Voice Robots: Methods, Models, and Experimental Results

This article presents a comprehensive study on slot (entity) recognition and error correction for voice robots, describing the labeling scheme, data annotation, IDCNN+CRF and BiLSTM+CRF models, a pinyin‑based similarity algorithm, and reporting significant accuracy improvements in real‑world deployments.

AIError CorrectionNLP
0 likes · 10 min read
Slot Recognition and Correction in Voice Robots: Methods, Models, and Experimental Results
Sohu Tech Products
Sohu Tech Products
Nov 11, 2020 · Artificial Intelligence

Illustrated Transformer: Comprehensive Explanation and Code Implementation

This article provides a step‑by‑step illustrated guide to the Transformer architecture, covering its macro structure, detailed self‑attention mechanisms, multi‑head attention, positional encoding, residual connections, decoder operation, training process, loss functions, and includes complete PyTorch and custom Python code examples.

Multi-Head AttentionNLPPyTorch
0 likes · 33 min read
Illustrated Transformer: Comprehensive Explanation and Code Implementation
FunTester
FunTester
Nov 11, 2020 · Artificial Intelligence

Unlocking NLP: From the Turing Test to Word Embeddings and Beyond

This article provides a comprehensive overview of natural language processing, tracing its origins from Turing's seminal test to modern techniques like regular expressions, word order importance, word embeddings, Word2vec, GloVe, and knowledge‑ and retrieval‑based chatbot methods.

GloVeNLPWord2Vec
0 likes · 15 min read
Unlocking NLP: From the Turing Test to Word Embeddings and Beyond
Sohu Tech Products
Sohu Tech Products
Nov 4, 2020 · Artificial Intelligence

Understanding BERT: Architecture, Pre‑training, Fine‑tuning and Applications in Modern NLP

This article provides a comprehensive overview of BERT and related NLP advances, covering its historical context, model architecture, input‑output mechanisms, comparisons with CNNs, word‑embedding evolution, pre‑training strategies like MLM and next‑sentence prediction, and practical guidance for fine‑tuning and feature extraction.

BERTNLPTransformer
0 likes · 17 min read
Understanding BERT: Architecture, Pre‑training, Fine‑tuning and Applications in Modern NLP
JD Cloud Developers
JD Cloud Developers
Nov 4, 2020 · Artificial Intelligence

Multimodal AI Breakthroughs Unveiled at NLPCC 2020 Workshop

The article recaps the inaugural Multimodal Natural Language Processing workshop at NLPCC 2020, highlighting breakthroughs in multimodal summarization, pre‑training models, AI‑driven art, visual‑language interaction, and multimodal dialogue systems, and showcases research from leading institutions and industry partners.

AINLPdialogue
0 likes · 9 min read
Multimodal AI Breakthroughs Unveiled at NLPCC 2020 Workshop
58 Tech
58 Tech
Oct 9, 2020 · Artificial Intelligence

Speaker Role Recognition in an Intelligent Voice Analysis Platform

This article describes a speaker role recognition system for a voice analysis platform, detailing a gender‑based pre‑filter, keyword‑matching and TextCNN‑based text classification, and single‑sentence correction methods that together improve role assignment accuracy by about 6% over baseline third‑party solutions.

AINLPTextCNN
0 likes · 12 min read
Speaker Role Recognition in an Intelligent Voice Analysis Platform
AntTech
AntTech
Sep 27, 2020 · Artificial Intelligence

Question Directed Graph Attention Network for Numerical Reasoning over Text (QDGAT)

The paper introduces QDGAT, a question‑directed graph attention network that enhances numerical reasoning in reading comprehension by explicitly modeling relationships among numbers, entities, and questions, and demonstrates its effectiveness through extensive experiments on the DROP dataset.

DROPNLPPretrained Models
0 likes · 7 min read
Question Directed Graph Attention Network for Numerical Reasoning over Text (QDGAT)
Tencent Cloud Developer
Tencent Cloud Developer
Sep 23, 2020 · Artificial Intelligence

NLP Model Interpretability: White-box and Black-box Methods and Business Applications

The article reviews NLP interpretability techniques, contrasting white‑box approaches that probe model internals such as neuron analysis, diagnostic classifiers, and attention with black‑box strategies like rationales, adversarial testing, and local surrogates, and argues that black‑box methods are generally more practical for business deployment despite offering shallower insights.

Attention MechanismBERTLIME
0 likes · 12 min read
NLP Model Interpretability: White-box and Black-box Methods and Business Applications
DataFunTalk
DataFunTalk
Sep 23, 2020 · Artificial Intelligence

From Word Embedding to BERT: A Comprehensive Overview of Pre‑training Model Development in NLP

This article surveys the evolution of pre‑training models for natural language processing, detailing model architectures such as Encoder‑AE, Decoder‑AR, Encoder‑Decoder, Prefix LM, and PLM, analyzing why models like RoBERTa, T5, and GPT‑3 excel, and offering practical guidance for building strong pre‑training systems.

BERTLanguage ModelsNLP
0 likes · 47 min read
From Word Embedding to BERT: A Comprehensive Overview of Pre‑training Model Development in NLP
DataFunTalk
DataFunTalk
Sep 19, 2020 · Artificial Intelligence

AliCoCo: Alibaba’s E‑commerce Cognitive Concept Net – Architecture, Construction, and Applications

The article presents AliCoCo, Alibaba’s large‑scale e‑commerce knowledge graph that models user demand as concepts, describes its four‑layer architecture, the algorithms for concept extraction, taxonomy building, and item association, and demonstrates its impact on search and recommendation systems.

AlibabaE‑CommerceNLP
0 likes · 22 min read
AliCoCo: Alibaba’s E‑commerce Cognitive Concept Net – Architecture, Construction, and Applications
DataFunTalk
DataFunTalk
Sep 16, 2020 · Artificial Intelligence

Hotspot Mining and Event Extraction in Tencent Information Flow: Methods, Framework, and Applications

This article presents Tencent's research on hotspot mining and event extraction for information flow, detailing the challenges of timeliness, comprehensiveness, and heat rationality, the combined use of time‑series analysis, topic detection, clustering, and dynamic‑time‑warping, and the resulting framework and its applications to text, image, and video recommendation.

Event ExtractionInformation RetrievalNLP
0 likes · 17 min read
Hotspot Mining and Event Extraction in Tencent Information Flow: Methods, Framework, and Applications
MaGe Linux Operations
MaGe Linux Operations
Sep 13, 2020 · Artificial Intelligence

Beyond Pandas: 10 Lesser‑Known Python Libraries Every Data Scientist Should Try

This article introduces a curated collection of lesser‑known Python libraries for data‑science tasks—including wget, pendulum, imbalanced‑learn, flashtext, fuzzywuzzy, pyflux, ipyvolume, dash, and gym—detailing their purpose, installation commands, and concise code examples to help practitioners expand their toolkit.

NLPPythontime series
0 likes · 9 min read
Beyond Pandas: 10 Lesser‑Known Python Libraries Every Data Scientist Should Try
Baobao Algorithm Notes
Baobao Algorithm Notes
Aug 28, 2020 · Artificial Intelligence

Avoid Common Pitfalls in Industrial Text Classification: A Practical Guide

This comprehensive guide examines real‑world text classification projects, covering label taxonomy design, data scarcity solutions, efficient annotation, new‑class discovery, algorithm selection, evaluation metrics, OOV handling, model evolution, rule‑model integration, performance‑boosting tricks, and inference under resource constraints.

NLPadversarial validationalgorithm selection
0 likes · 15 min read
Avoid Common Pitfalls in Industrial Text Classification: A Practical Guide
Didi Tech
Didi Tech
Aug 23, 2020 · Artificial Intelligence

DiDi AI Labs Achieves Third Place in WMT2020 News Translation Task

DiDi AI Labs’ NLP team earned third place in the WMT2020 Chinese‑to‑English news translation task with a 36.6 BLEU score, using an enhanced Transformer‑2 model that incorporates self‑attention, relative positional attention, iterative back‑translation, knowledge distillation, data cleaning, ensembling, and other techniques, now deployed across DiDi’s international services.

BLEUDiDi AI LabsNLP
0 likes · 5 min read
DiDi AI Labs Achieves Third Place in WMT2020 News Translation Task
MaGe Linux Operations
MaGe Linux Operations
Aug 20, 2020 · Artificial Intelligence

Explore 10 Lesser-Known Python Libraries for Data Science & AI

This article introduces a curated selection of lesser‑known Python packages—such as wget, pendulum, imbalanced‑learn, FlashText, fuzzywuzzy, PyFlux, ipyvolume, Dash, and Gym—detailing their installation commands, core functionalities, and code examples to help data scientists expand their toolkit beyond the usual pandas, scikit‑learn, and matplotlib.

NLPPythondata science
0 likes · 9 min read
Explore 10 Lesser-Known Python Libraries for Data Science & AI
Sohu Tech Products
Sohu Tech Products
Aug 19, 2020 · Artificial Intelligence

ASR Error Correction with BERT, ELECTRA and a Fuzzy‑Phoneme Generator: Techniques from Xiaomi AI

This article describes how Xiaomi's AI team tackles Automatic Speech Recognition (ASR) query errors by analyzing error patterns, employing BERT, ELECTRA and a soft‑masked BERT model, generating synthetic noisy data with a fuzzy‑phoneme generator, and presenting experimental results and future research directions.

ASRBERTELECTRA
0 likes · 18 min read
ASR Error Correction with BERT, ELECTRA and a Fuzzy‑Phoneme Generator: Techniques from Xiaomi AI
58 Tech
58 Tech
Aug 12, 2020 · Artificial Intelligence

Guide to Using SPTM (Simple Pre-trained Model) with qa_match for an AI Competition

This article provides a step‑by‑step tutorial on preparing data, pre‑training the SPTM language model, fine‑tuning a text‑classification model, generating predictions, and creating a submission file for the 58.com AI algorithm competition using the open‑source qa_match toolkit.

AIModel TrainingNLP
0 likes · 9 min read
Guide to Using SPTM (Simple Pre-trained Model) with qa_match for an AI Competition
MaGe Linux Operations
MaGe Linux Operations
Aug 6, 2020 · Artificial Intelligence

Build a Python Chatbot with ChatterBot: Step‑by‑Step Guide

This article introduces chatbots, explains rule‑based and self‑learning types, describes how AI‑driven bots work, and provides a complete Python tutorial using the ChatterBot library—including environment setup, installation, and full source code for a functional chatbot.

ChatbotChatterBotNLP
0 likes · 4 min read
Build a Python Chatbot with ChatterBot: Step‑by‑Step Guide
DataFunTalk
DataFunTalk
Aug 3, 2020 · Artificial Intelligence

Advances in Sequence‑to‑Sequence Text Generation: Attention, Pointer, Copy, and Transformer Models

This article reviews the evolution of encoder‑decoder based text generation, covering classic seq2seq with attention, pointer networks, copy mechanisms, knowledge‑enhanced models, convolutional approaches, and the latest Transformer‑based pre‑training such as MASS, highlighting their architectures, key innovations, and practical considerations.

NLPSeq2SeqText Generation
0 likes · 17 min read
Advances in Sequence‑to‑Sequence Text Generation: Attention, Pointer, Copy, and Transformer Models
58 Tech
58 Tech
Aug 3, 2020 · Artificial Intelligence

Intelligent Customer Service Competition: Leveraging AI for Text Matching and Classification

This announcement describes the rise of AI‑driven intelligent customer service, highlights 58.com’s long‑standing system, and introduces a competition that provides real‑world data for participants to develop advanced text‑matching and classification models using state‑of‑the‑art NLP techniques.

Artificial IntelligenceNLPcustomer service
0 likes · 3 min read
Intelligent Customer Service Competition: Leveraging AI for Text Matching and Classification
iQIYI Technical Product Team
iQIYI Technical Product Team
Jul 24, 2020 · Artificial Intelligence

Fine‑grained Character Sentiment Analysis in Scripts: Models, Challenges, and Future Directions

The article surveys fine‑grained character sentiment analysis for script evaluation, detailing traditional, target‑dependent and aspect‑level methods, describing iQIYI’s BERT‑TD‑LSTM and CNN architectures, addressing challenges such as character name recognition and long‑range context, and outlining future improvements after a Parasite case study.

BERTLSTMNLP
0 likes · 19 min read
Fine‑grained Character Sentiment Analysis in Scripts: Models, Challenges, and Future Directions
58 Tech
58 Tech
Jul 22, 2020 · Artificial Intelligence

Intelligent Customer Service Competition: Leveraging AI for Text Matching and Classification

The announcement introduces an AI‑driven intelligent customer service competition, highlighting the importance of text matching and classification in NLP, describing 58.com’s existing system, providing a real‑world dataset, and inviting participants to develop precise models using the latest deep‑learning techniques.

AINLPcustomer service
0 likes · 4 min read
Intelligent Customer Service Competition: Leveraging AI for Text Matching and Classification
Alibaba Cloud Developer
Alibaba Cloud Developer
Jul 16, 2020 · Artificial Intelligence

How BERT‑to‑TextCNN Knowledge Distillation Boosts Spam Opinion Detection

This article examines how large pretrained BERT models can be compressed via knowledge distillation into a lightweight TextCNN classifier for efficient garbage opinion detection, detailing traditional distillation methods, several practical schemes, experimental results, and the advantages of the approach.

BERTKnowledge DistillationNLP
0 likes · 9 min read
How BERT‑to‑TextCNN Knowledge Distillation Boosts Spam Opinion Detection
DataFunTalk
DataFunTalk
Jul 15, 2020 · Artificial Intelligence

ASR Error Correction with BERT, ELECTRA, and a Fuzzy‑Phoneme Generator: Methods, Experiments, and Future Directions

This article presents a comprehensive overview of automatic speech recognition (ASR) error correction techniques employed by Xiaomi's Xiao‑Ai team, detailing problem definition, related work on BERT and ELECTRA, a custom generator‑discriminator architecture with a fuzzy‑phoneme simulator, experimental results, and prospective research directions.

ASRBERTELECTRA
0 likes · 19 min read
ASR Error Correction with BERT, ELECTRA, and a Fuzzy‑Phoneme Generator: Methods, Experiments, and Future Directions
58 Tech
58 Tech
Jul 10, 2020 · Artificial Intelligence

Tag Mining for Used‑Car Business: NLP, Word2Vec, and Retrieval Pipeline

This article details the end‑to‑end process of extracting and leveraging tags for used‑car listings, covering data collection, segmentation, NLP‑based tokenization, word‑vector generation, tag‑library construction, and online retrieval flow to improve personalized recall and CTR.

Information RetrievalNLPTagging
0 likes · 19 min read
Tag Mining for Used‑Car Business: NLP, Word2Vec, and Retrieval Pipeline
DataFunTalk
DataFunTalk
Jul 7, 2020 · Artificial Intelligence

Optimizing Pretrained Language Model Inference: Lessons from the NLPCC Small Model Competition and Deployment at Xiaomi

This article shares the Xiaomi AI Lab NLP team's experience in the NLPCC lightweight language model competition, discusses efficiency challenges of large pretrained models like BERT, and details practical inference optimizations—including model distillation, batching, FP16 quantization, and FasterTransformer integration—that dramatically reduce latency and hardware costs in production.

AIBERTInference Optimization
0 likes · 15 min read
Optimizing Pretrained Language Model Inference: Lessons from the NLPCC Small Model Competition and Deployment at Xiaomi
Tencent Advertising Technology
Tencent Advertising Technology
Jun 22, 2020 · Artificial Intelligence

Graph-based Evidence Aggregating and Reasoning (GEAR) Model for Fact Verification in NLP

The article explains how the GEAR model uses graph neural networks and BERT representations to aggregate multiple pieces of evidence for fact verification, improving accuracy on datasets like FEVER and offering applications in misinformation detection, knowledge‑graph completion, and advertising analytics.

BERTGEAR modelGraph Neural Networks
0 likes · 8 min read
Graph-based Evidence Aggregating and Reasoning (GEAR) Model for Fact Verification in NLP
DataFunTalk
DataFunTalk
Jun 12, 2020 · Artificial Intelligence

Content Understanding for Advertising on Weibo: Challenges, Solutions, and Applications

This article explains how Weibo's advertising platform leverages content understanding—covering system architecture, problems caused by insufficient comprehension, the construction of NLP and vision capabilities, content‑based ad strategies, and a celebrity‑brand knowledge graph—to improve ad relevance and ROI.

AdvertisingNLPWeibo
0 likes · 13 min read
Content Understanding for Advertising on Weibo: Challenges, Solutions, and Applications
NetEase Media Technology Team
NetEase Media Technology Team
Jun 12, 2020 · Artificial Intelligence

Semantic Text Understanding for NetEase News Feed Recommendation

NetEase improves its news‑feed recommendation by applying a multi‑stage semantic text understanding pipeline—lexical analysis, hierarchical content tagging, and quality filtering—using two‑level classifiers, LDA‑based topic modeling, multi‑label concept and entity extraction, and dense vector representations to better capture user interests and boost personalization performance.

NLPRecommendation Systemsfeature engineering
0 likes · 9 min read
Semantic Text Understanding for NetEase News Feed Recommendation
DataFunTalk
DataFunTalk
Jun 8, 2020 · Artificial Intelligence

Recap of Baidu ACL 2020 Paper Sharing Session – Papers 4 to 6

The Baidu ACL 2020 paper sharing live session recap presents three NLP research papers—on unsupervised style transfer, sentiment‑knowledge‑enhanced pre‑training, and conversational recommendation over multi‑type dialogs—detailing their novel models, methodologies, and key contributions.

ACL 2020NLPSentiment Analysis
0 likes · 4 min read
Recap of Baidu ACL 2020 Paper Sharing Session – Papers 4 to 6
DataFunTalk
DataFunTalk
May 25, 2020 · Artificial Intelligence

NLP Techniques for Financial Investment Analysis: Case Studies from Two Sigma, BlackRock, UC Berkeley and Others

This article reviews how natural language processing is used in financial investment analysis, summarizing case studies from Two Sigma, BlackRock, UC Berkeley and other institutions that apply topic modeling, event extraction and sentiment analysis to improve portfolio performance and achieve excess returns.

Event ExtractionInvestment AnalysisNLP
0 likes · 17 min read
NLP Techniques for Financial Investment Analysis: Case Studies from Two Sigma, BlackRock, UC Berkeley and Others
Huawei Cloud Developer Alliance
Huawei Cloud Developer Alliance
May 25, 2020 · Artificial Intelligence

How AI Turns Dark Data into Actionable Automation

This article explains how enterprises can classify structured, semi‑structured and unstructured data as “dark data”, why traditional RPA struggles with it, and how AI technologies like NLP, computer vision and machine learning—exemplified by Automation Anywhere’s IQ‑Bot—enable end‑to‑end automation of hidden information.

AIIQ BotNLP
0 likes · 9 min read
How AI Turns Dark Data into Actionable Automation
Meituan Technology Team
Meituan Technology Team
May 21, 2020 · Artificial Intelligence

AIS 2020 Conference: Schedule and Speakers for Top NLP/AI/IR Papers

The AIS 2020 Conference, co‑hosted by the Beijing Academy of Artificial Intelligence and Meituan, showcased 74 top ACL, IJCAI and SIGIR papers across 15 sessions on NLP, AI and IR topics, streamed free online on May 23‑24 2020 with keynote speakers from leading Chinese universities.

AIInformation RetrievalNLP
0 likes · 12 min read
AIS 2020 Conference: Schedule and Speakers for Top NLP/AI/IR Papers
DataFunTalk
DataFunTalk
May 18, 2020 · Artificial Intelligence

Intelligent Investment Research and Financial Sentiment Monitoring with NLP and Big Data

This article describes how advanced natural‑language‑processing, big‑data, and deep‑learning techniques are integrated into an end‑to‑end platform for financial asset management, covering large‑scale bid‑tender text analysis, few‑shot sentiment monitoring, model architectures, data‑enhancement methods, and practical deployment results.

Big DataNLPfew-shot learning
0 likes · 28 min read
Intelligent Investment Research and Financial Sentiment Monitoring with NLP and Big Data
DataFunTalk
DataFunTalk
May 17, 2020 · Artificial Intelligence

Improving Text Representation and Clustering for Small‑Sample Scenarios in 58 Second‑Hand Car Intelligent Customer Service

This article presents a study on enhancing text representation and clustering in a small‑sample setting for 58's second‑hand car intelligent customer service by introducing a Bi‑LSTM based pre‑training language model and an improved Deep Embedded Clustering (DEC) algorithm, demonstrating significant gains in accuracy, silhouette score, and answer‑rate through extensive experiments.

AIBi-LSTMDEC
0 likes · 16 min read
Improving Text Representation and Clustering for Small‑Sample Scenarios in 58 Second‑Hand Car Intelligent Customer Service
Qunar Tech Salon
Qunar Tech Salon
May 13, 2020 · Artificial Intelligence

Intelligent Hotel Post‑Sale QA System: Model Selection, Evaluation, and Engineering Optimization

This article describes the design, model selection, experimental evaluation, and engineering optimization of an AI‑driven post‑sale question‑answering system for hotel services, covering FAQ construction, intent detection, deep‑learning matching models such as DSSM, ESIM, BERT, and their performance and latency trade‑offs.

AIBERTDSSM
0 likes · 14 min read
Intelligent Hotel Post‑Sale QA System: Model Selection, Evaluation, and Engineering Optimization
iQIYI Technical Product Team
iQIYI Technical Product Team
May 8, 2020 · Artificial Intelligence

Introduction to NLP in Video Applications

When you browse video apps by tags, receive personalized recommendations, or search with keywords, the seamless experience is powered by Natural Language Processing, which analyzes and interprets textual data to connect users with relevant content, and the article invites you to scan a QR code for further exploration.

AI ApplicationsArtificial IntelligenceNLP
0 likes · 9 min read
Introduction to NLP in Video Applications
DataFunTalk
DataFunTalk
May 7, 2020 · Artificial Intelligence

Comprehensive Overview of Query Understanding in Search Engines

Query understanding (QU) involves lexical, syntactic, and semantic analysis of user queries to enable effective search recall and ranking, covering modules such as preprocessing, correction, expansion, segmentation, intent detection, term importance, and guidance, with detailed discussion of algorithms, models, and system architecture.

Information RetrievalNLPSearch Engine
0 likes · 51 min read
Comprehensive Overview of Query Understanding in Search Engines
Ctrip Technology
Ctrip Technology
Apr 30, 2020 · Artificial Intelligence

Intelligent Generation of Search Engine Advertising Keywords: Methods, Frameworks, and Future Directions

This article presents a comprehensive overview of automated techniques for generating high‑quality search engine advertising keywords, covering background, traditional manual methods, intelligent keyword expansion using NLP, segmentation, POS tagging, BILSTM‑CRF, BERT classification, semantic matching with DSSM, and additional approaches such as query suggestion and synonym rewriting.

BERTBILSTM-CRFNLP
0 likes · 15 min read
Intelligent Generation of Search Engine Advertising Keywords: Methods, Frameworks, and Future Directions
Yanxuan Tech Team
Yanxuan Tech Team
Apr 20, 2020 · Artificial Intelligence

How AI-Driven Clustering Boosts Smart Customer Service Knowledge Bases

This article outlines an AI-powered workflow for constructing and enriching a business knowledge base in intelligent customer service, covering preprocessing, intent detection, deep and shallow semantic feature engineering, hierarchical bucket clustering, and automated summary extraction to improve FAQ coverage and reduce manual workload.

AIClusteringKnowledge Base
0 likes · 15 min read
How AI-Driven Clustering Boosts Smart Customer Service Knowledge Bases
DataFunTalk
DataFunTalk
Apr 10, 2020 · Artificial Intelligence

Improving Machine Translation: Addressing Exposure Bias, Efficient Decoding, and Non‑Autoregressive Models

This article reviews recent research on machine translation that tackles the training‑inference distribution gap, exposure bias, and slow autoregressive decoding by introducing scheduled sampling, differentiable sequence‑level losses, cube‑pruning, and sequence‑aware non‑autoregressive decoding, showing BLEU gains and significant speedups.

BLEUMachine TranslationNLP
0 likes · 16 min read
Improving Machine Translation: Addressing Exposure Bias, Efficient Decoding, and Non‑Autoregressive Models
Didi Tech
Didi Tech
Apr 2, 2020 · Artificial Intelligence

Interview: Didi AI’s DELTA – A Unified Framework for NLP and Speech Model Development

In this interview, Didi AI Labs’ Han Kun explains how the DELTA platform unifies TensorFlow‑based NLP and speech models—supporting tasks from text classification to voice emotion recognition—through a modular, easily deployable architecture, accelerating development, powering Didi products, and now open‑sourced for broader AI collaboration.

AI platformDeltaNLP
0 likes · 14 min read
Interview: Didi AI’s DELTA – A Unified Framework for NLP and Speech Model Development