Tagged articles
jieba
31 articles · Page 1 of 1
This article walks through the four core steps of Chinese NLP corpus preparation—collecting data, cleaning it with regex and encoding detection, tokenizing using dictionary‑based or statistical methods such as jieba, HMM and CRF, and finally standardizing with stop‑word removal, vocabulary building and one‑hot encoding—while illustrating each step with concrete code snippets and practical examples.
CRFChineseNLP
0 likes · 12 min read


JavaEdgeMar 12, 2025 · Artificial Intelligence
This article guides Java developers through a complete Chinese sentiment‑analysis dataset exploration, covering label distribution, sentence length statistics, vocabulary counts, adjective extraction, and visual word‑cloud generation using Python libraries such as pandas, seaborn, jieba, and wordcloud.
NLPPythondata visualization
0 likes · 10 min read

This guide explains how to install the jieba-php extension— a Rust‑based Chinese word segmentation library for PHP—by listing required dependencies, showing the cargo build steps, demonstrating runtime commands, describing the provided API, and offering a complete usage example.
chinese segmentationjieba
0 likes · 2 min read

This tutorial demonstrates how to convert a JSON lyric database into Excel, filter Jay Chou songs, perform Chinese word segmentation with Jieba, compute word frequencies, and create visualizations such as word clouds using Python code and online tools.
PandasPythondata preprocessing
0 likes · 9 min read

This tutorial introduces fundamental natural language processing techniques, covering text preprocessing steps such as tokenization and stop‑word removal, followed by TF‑IDF feature extraction, and provides complete Python code examples to practice these concepts on a sample dataset.
NLPPythonTF-IDF
0 likes · 5 min read

The article explains that a token is the unit processed by large language models, describes three common tokenizer methods—word‑level, character‑level, and sub‑word level—with English and Chinese examples, discusses their advantages and limitations, and shows how OpenAI’s tokenizer varies across model versions.
NLPSubwordcharacter-level
0 likes · 5 min read

Learn step‑by‑step how to extract text from a CSV generated by a Python web crawler, clean it with stop‑words, create a word‑cloud visualization, compute word frequencies, and perform sentiment analysis using jieba and SnowNLP, with all code snippets provided.
PythonSnowNLPjieba
0 likes · 11 min read

This tutorial demonstrates how to preprocess a Chinese lyrics JSON dataset, extract Jay Chou's songs using Python, perform word segmentation with Jieba, compute word frequencies, and create visualizations such as word clouds both programmatically and with online tools.
NLPdata preprocessingjieba
0 likes · 9 min read

This article demonstrates how to scrape a news webpage with Python, extract and segment its Chinese text using jieba, count word frequencies, and visualize the top ten terms as a word cloud and a pie chart with pyecharts.
PyechartsPythonjieba
0 likes · 3 min read

This article explores Chinese word segmentation, illustrating its linguistic nuances with a humorous example, explains key methods—including dictionary‑based, statistical, and deep‑learning approaches—and provides Python code using a simple dictionary algorithm and the popular jieba library to demonstrate practical implementation.
Chinese NLPPythonWord Segmentation
0 likes · 6 min read

This tutorial explains how to scrape a news article with Python, segment Chinese text, count word frequencies, and visualize the top ten words using a word cloud and a pie chart, providing complete code and sample results.
PyechartsPythondata-visualization
0 likes · 3 min read

This guide shows how to use Python libraries such as docx, jieba, NLTK, and openpyxl to read a Word file, perform tokenization, compute word frequencies, assign part‑of‑speech tags, and export the results into an Excel spreadsheet, including troubleshooting tips for common errors.
NLPNLTKWord
0 likes · 7 min read

This article demonstrates how to calculate word frequencies in Chinese text using Python's jieba library, collections.Counter, and xlwt to export results to Excel, providing complete code examples and alternative approaches for effective text analysis.
Word Frequencyjiebatext-processing
0 likes · 5 min read

This guide walks you through extracting text from a CSV obtained via Python web scraping, cleaning it with stop‑words, generating a word‑cloud, performing jieba tokenization and frequency analysis, and finally applying SnowNLP for sentiment scoring, with all code snippets and data links provided.
SnowNLPjiebasentiment analysis
0 likes · 12 min read

This article explains how to perform Chinese part-of-speech tagging using the jieba.posseg library in Python, including loading stop words, extracting article content via Newspaper3k, applying precise mode segmentation, filtering, and presenting results in a pandas DataFrame.
NLPPOS taggingPython
0 likes · 3 min read

This article demonstrates how to use Python's requests and BeautifulSoup to crawl text from a news site, process it with collections, numpy, and jieba for word‑frequency analysis, and then visualize the top terms using pyecharts, providing complete code snippets and explanations.
PyechartsWord Frequencydata visualization
0 likes · 7 min read

This report describes a Python‑based web application built with Flask that scrapes hot‑search data from Weibo, Baidu and Zhihu, processes it using jieba and other libraries, and visualizes the results together with domestic COVID‑19 statistics using ECharts on a responsive front‑end page.
data-visualizationfrontendjieba
0 likes · 7 min read

This tutorial walks you through installing the jieba Python library, explains its three segmentation modes—precise, full, and search—demonstrates how to add or delete words, manage custom dictionaries, handle stop words, perform weight analysis, adjust word frequencies, and retrieve token positions, all with clear code examples and visual output.
NLPPythonchinese segmentation
0 likes · 10 min read

This tutorial explains how to install and use the Jieba segmentation library and the WordCloud package in Python to process Chinese text, customize dictionaries and stopwords, and generate visually appealing word cloud images based on a mask picture.
TextProcessingTutorialjieba
0 likes · 7 min read

This tutorial shows how to log in to Douban with Python, scrape short comments for the animated film “Nezha”, process the text using jieba for Chinese word segmentation, and generate a visual word cloud that highlights the most frequent audience sentiments.
Doubandata-miningjieba
0 likes · 9 min read

This tutorial walks you through analyzing JD product pages, extracting comment data via requests with proper headers, handling pagination, saving results, cleaning text using jieba, and visualizing frequent terms as a word cloud, all illustrated with step‑by‑step screenshots and code snippets.
Pythonjiebarequests
0 likes · 10 min read

This tutorial walks you through using Python's wordcloud and jieba libraries to process WeChat Moments data, generate frequency statistics, and produce attractive, shape‑based word cloud images, complete with code snippets and visual examples.
Pythonjiebatext-mining
0 likes · 6 min read

Learn how to extract WeChat Moments data using Python web scraping, process the Chinese text with jieba, generate and customize word clouds with the wordcloud library, and enhance visual appeal using WordArt, all illustrated with detailed code snippets and screenshots.
Pythonjieba
0 likes · 5 min read

This tutorial guides programmers through installing required Python libraries, extracting keywords from One Piece song lyrics using jieba, and generating a Chopper‑shaped word cloud with the wordcloud package in a Jupyter notebook, complete with code examples and visual results.
Jupyterdata visualizationjieba
0 likes · 3 min read

This tutorial walks you through installing the WordCloud and jieba packages, resolving common Windows compilation errors, handling Chinese font encoding issues, and creating both basic and image‑masked word clouds with practical code examples and screenshots.
encodinginstallationjieba
0 likes · 5 min read

This article explains how to build a Python tool that monitors real‑time WeChat chats, uses wxpy to capture messages, applies jieba for Chinese word segmentation, and generates a heart‑shaped word cloud with the wordcloud library, complete with code examples and setup instructions.
WeChatjiebaword cloud
0 likes · 6 min read

This tutorial walks you through extracting WeChat Moments with a Python web scraper, processing the Chinese text using jieba, and visualizing the most frequent words as beautiful word clouds with customizable shapes and fonts.
Pythondata visualizationjieba
0 likes · 6 min read

This article demonstrates how to combine Jieba segmentation, Word2Vec embeddings, and NetworkX graph visualization to extract and analyze character relationships from the Chinese novel "Heavenly Sword and Dragon Slaying," detailing data preparation, model training, entity matrix construction, and network graph generation.
Graph VisualizationNLPPython
0 likes · 10 min read

This tutorial guides readers with basic programming experience through using Python 3 in Jupyter to extract keywords from One Piece lyrics with jieba, and then generate a Chopper‑shaped word cloud using matplotlib and the wordcloud library, covering required dependencies and step‑by‑step code.
JupyterPythondata visualization
0 likes · 3 min read

This tutorial shows how to use the Python libraries jieba and wordcloud to quickly generate Chinese word‑cloud visualizations, explaining required dependencies, code structure, and usage tips so readers can produce word clouds from any Chinese text in just minutes.
Chinese textPythonjieba
0 likes · 2 min read

This guide walks you through installing the Python WordCloud library, resolving common compilation errors, handling Chinese font encoding issues, and creating basic and image‑masked word clouds, complete with code snippets and troubleshooting tips for smooth visualization of Chinese text data.
Chinese NLPPythonjieba
0 likes · 4 min read
