Chinese New Word Discovery: From Traditional Unsupervised Methods to CNN‑Based Deep Learning

The article examines the challenge of out‑of‑vocabulary terms in Chinese e‑commerce NLP, reviews classic unsupervised metrics such as frequency, cohesion and neighbor entropy, and proposes a lightweight fully‑convolutional network inspired by image‑segmentation techniques to automatically detect new words.

CNNDeep LearningNLP

0 likes · 10 min read

Chinese New Word Discovery: From Traditional Unsupervised Methods to CNN‑Based Deep Learning

Architect

Dec 31, 2015 · Big Data

Using Spark for Machine Learning, New Word Discovery, and Intelligent Q&A

The article explains how to leverage Apache Spark for machine‑learning tasks, large‑scale new‑word discovery, and simple intelligent question‑answering by using Spark‑Shell, Scala code, and word2vec‑based similarity, while sharing practical tips and performance considerations.

Big DataIntelligent QANew Word Discovery

0 likes · 15 min read

Using Spark for Machine Learning, New Word Discovery, and Intelligent Q&A

Efficient Ops

Dec 29, 2015 · Big Data

Unlocking Spark: Machine Learning, New Word Discovery, and Smart Q&A Techniques

This article explains how to leverage Spark for machine learning, discover new terms from massive text corpora, and build intelligent question‑answer systems, sharing practical tips, performance considerations, and real‑world examples for data analysts and algorithm engineers.

Intelligent QANew Word DiscoveryScala

0 likes · 15 min read

Unlocking Spark: Machine Learning, New Word Discovery, and Smart Q&A Techniques