This article demonstrates a compact 21‑line Python spell checker that uses a Bayesian model and edit‑distance concepts to suggest correct spellings, explaining the underlying probability theory and providing a full code walkthrough.
This article surveys the most useful open‑source Python packages for data science, covering core numerical libraries, visualization tools, machine‑learning frameworks, natural‑language‑processing kits, and data‑mining utilities, while showing GitHub contribution metrics and Google‑trend popularity.
This article details the evolution, architecture, and practical applications of knowledge graphs at Beike Real Estate, covering their historical background, five‑view advantages, data pipelines, ontology construction, intelligent search, recommendation, and chatbot integration, while also discussing challenges and future directions.
The article outlines Shenma Search's development history, its AI‑driven relevance and ranking technologies, the underlying system architecture based on Zookeeper and YARN, and discusses challenges in query understanding, machine‑learning ranking, and deep‑learning solutions for large‑scale search.
An extensive overview of ACL 2018, featuring acceptance statistics, award-winning papers, tutorial insights, and concise summaries of notable research across machine translation, semantic parsing, question answering, domain adaptation, text classification, summarization, dialogue systems, generation, and related tools.
The article presents a technical overview of Chatopera’s multi‑turn dialogue platform, covering language model fundamentals, Chinese segmentation, word embeddings, information retrieval, and open‑source tools, while illustrating how these AI techniques enable low‑cost, scalable enterprise chatbot solutions.
The Didi Tech Seminar showcased how AI—through DeepMotion’s mapping solutions, Sogou’s NLP‑enhanced search, and advanced computer‑vision techniques—augments Didi’s core map engine for ETA estimation, route planning, and dynamic pickup/drop‑off updates, while addressing integration challenges between AI models and traditional mapping algorithms.
This article summarizes Sogou's information‑feed recommendation system, covering the architecture from data collection and NLP processing to recall, ranking, and feedback, and detailing the classification, tagging, keyword extraction, and various recall and ranking models such as FastText, TextCNN, collaborative filtering, and wide‑and‑deep learning.
Alibaba’s AI-powered contract diagnosis system can analyze 600 online agreements in a single second, achieving 100% issue detection accuracy by combining domain-specific phrase mining, knowledge graphs, specialized word embeddings, and a hybrid deep‑learning plus rule‑based pipeline.
This article demonstrates a compact, runnable Python 3 scraper that fetches job listings from Lagou.com based on a keyword, filters by city and salary, extracts detailed job requirements using XPath, and applies Baidu's free NLP service for word segmentation and part‑of‑speech tagging to reveal key skill terms.
This article explains the motivation behind the growing gap between developers and operations, introduces Tencent Cloud's AI‑driven intelligent operations robot, outlines its core features, typical use cases, and dives into the retrieval‑based dialogue system and matching models that enable natural‑language interactions.
This article breaks down the Kaggle toxic comment classification competition, detailing thorough data cleaning, advanced word‑vector techniques, pseudo‑labeling, BPE tokenization, diverse neural models and ensemble strategies, and shares practical insights and pitfalls from the author's nine‑month competition journey.
This article demonstrates how to combine Jieba segmentation, Word2Vec embeddings, and NetworkX graph visualization to extract and analyze character relationships from the Chinese novel "Heavenly Sword and Dragon Slaying," detailing data preparation, model training, entity matrix construction, and network graph generation.
The article proposes a hybrid approach that first filters blacklist words and then classifies suspicious comments with a character-level TextCNN, achieving around 89% precision and 87% recall, demonstrating that simple convolutional networks outperform keyword filters and RNNs for short, noisy abusive Chinese text.
Ren Dengjun, a Meituan Dianping tech leader, recounts her shift from NLP research at Northeastern to industry roles at Toshiba, Alibaba, and Youyi, now heading Meituan’s location‑based advertising platform, while sharing insights on leadership, gender bias, and balancing technical and managerial challenges.
This article provides a comprehensive guide to text classification, covering traditional pipelines, bag‑of‑words and TF‑IDF features, dimensionality‑reduction techniques, word‑embedding models such as GloVe, word2vec and fastText, and modern deep‑learning architectures like CNN, RCNN and HAN.
This article walks through constructing a Spark-powered text sentiment analysis pipeline—from crawling movie reviews, preprocessing and feature extraction with jieba and TF‑IDF, to training Naive Bayes and SVM classifiers—while discussing Spark's advantages and ways to improve model accuracy.
Natural Language Processing, a branch of AI, is traced from its Turing origins through early rule‑based methods, statistical and deep‑learning paradigms, covering lexical analysis, syntax, semantics, knowledge graphs, and current applications, highlighting historical shifts, challenges, and future research directions.
The team built a lightweight three‑class sentiment classifier for iQIYI user comments using a linear‑kernel SVM with high‑dimensional bag‑of‑words features and an expanded ~100k word lexicon, achieving over 96% accuracy across domains, and deployed it as a Spring Boot PMML service with zero‑downtime refresh, while planning GBDT‑enhanced features and word‑embedding optimizations.
Alibaba’s iDST NLP team, led by Dr. Si Luo, clinched the top spot in both the KBP2017 English entity discovery challenge and the 2017 Chinese Grammatical Error Diagnosis contest, showcasing cutting‑edge deep‑learning techniques, massive multilingual processing capacity, and innovative transfer‑learning methods.
This article surveys the most essential Python packages for data science in 2017, covering core scientific computing, data manipulation, visualization, machine learning, deep learning, natural language processing, and web scraping, and explains why each library remains indispensable for modern analysts.
This article summarizes Zhao Jiunchun's conference talk on leveraging AI and machine learning—covering pattern extraction, supervised learning, loss functions, classification algorithms, NLP, and real-world Tencent ZhiYun case studies—to enhance operational efficiency, monitoring, and intelligent automation.
This tutorial introduces natural language processing (NLP) with Python, covering the basics of NLP, popular libraries, NLTK installation, text tokenization, stop‑word removal, stemming, lemmatization, synonym/antonym handling, and multilingual support, all illustrated with clear code examples and visual guides.
Learn how to create a fully functional spell checker in just 21 lines of Python by training a Bayesian model on a large text corpus, generating candidate corrections via edit distance, and selecting the most probable word using probability calculations.
The iQIYI NLP team applies lexical analysis, knowledge‑graph construction, tag recommendation, query understanding, voice‑assistant semantics, sentiment mining, and box‑office/view‑count prediction—leveraging weakly labeled data, CRF/CNN‑CRF models and deep learning—to enhance video comprehension, recommendation, search and commercial services across the platform.
This article demonstrates how to build and train a bi‑directional LSTM sentiment analysis model with TensorFlow, covering data preprocessing, word embedding, model architecture, code implementation, and evaluation results, and discusses potential improvements.
This article presents a comprehensive NLP‑driven text‑mining workflow for tourism comment data, covering data cleaning, word2vec training, keyword extraction, sentiment analysis, ranking, and a lightweight architecture that enables fast, accurate recommendation of scenic spots for users.
Alibaba’s Tmall Genie X1 showcases a new semantic encoding model called Conv‑RNN that improves intelligent question answering and text classification, achieving state‑of‑the‑art results on benchmark datasets while illustrating the broader impact of semantic encoding on NLP applications.
Dr. Lv Zhengdong discusses the challenges of true language understanding, the integration of symbolic reasoning with neural networks, recent advances in neural‑symbolic models, and the practical prospects of NLP in domains such as law and finance, emphasizing the need for hybrid approaches.
This article reviews the most essential Python libraries for data science—including NumPy, SciPy, Pandas, Matplotlib, Seaborn, Bokeh, Plotly, Scikit‑Learn, TensorFlow, Keras, NLTK, Gensim, Scrapy and Statsmodels—highlighting their core features, GitHub activity and typical use cases.
The paper introduces LSTM‑Jump, a reinforcement‑learning‑trained LSTM variant that can dynamically skip irrelevant tokens, achieving up to six‑fold speed‑ups over standard sequential LSTMs while maintaining or improving accuracy on various NLP tasks such as sentiment analysis, document classification, and question answering.
This article surveys a wide range of natural language processing libraries—including Python packages like NLTK and spaCy, Java frameworks such as OpenNLP and StanfordNLP, and specialized Chinese tokenizers like IKAnalyzer, ICTCLAS, and FudanNLP—detailing their features, usage, and setup steps for Chinese text analysis.
This tutorial explains how to create, test, and enhance a multi‑platform chatbot using Microsoft Bot Framework, LUIS for natural language processing, and Azure services, guiding beginners from Node.js basics to real‑world bot scenarios.
The article reviews ACL 2016’s tutorial program, summarizing key talks on computer‑aided translation, neural machine translation, semantic sense representation, short‑text understanding, and highlights selected papers on multimodal translation, coverage modeling, and language‑vision grounding, illustrating deep learning’s impact on NLP research.
This article explains how natural language processing stores word meanings as numeric vectors, builds token dictionaries, represents sentences as binary vectors, and uses dot‑product calculations to measure similarity, illustrating concepts with simple examples and highlighting current limitations and future directions.
This tutorial explains how to use IBM's AlchemyLanguage API within the Python‑based Noteable application to convert scanned handwritten notebook pages into searchable, editable text by leveraging concept tagging and taxonomy services on Bluemix.
In a June 28 presentation at Baidu’s 51st Technology Salon, senior NLP researcher Zhao Shiqi showcased Baidu Kaoba—a conversational search tool for college admissions—illustrating how inference‑based rewriting, ellipsis completion, concept clarification and interactive generation enable deep, domain‑specific semantic understanding that he predicts will power future internet services.
