Tagged articles
word embeddings
14 articles · Page 1 of 1
This article explains how natural language is converted into neural network inputs, covering tokenization with BPE using DeepSeek's 128K vocabulary, special tokens, and word embeddings via Word2Vec CBOW/Skip-gram, demonstrated with cosine similarity examples from a 7B model's 4096-dimensional embedding layer.
BPECosine SimilarityDeepSeek
0 likes · 12 min read

This article explains the Word2Vec algorithm, its CBOW and Skip‑Gram architectures, cosine similarity mathematics, training process with negative sampling, and provides a concise Python example using the gensim library.
AIGensimPython
0 likes · 8 min read


DevOpsApr 7, 2023 · Artificial Intelligence
The article explains that ChatGPT produces responses by converting words into high‑dimensional vectors, feeding them through neural networks, and selecting tokens based on probability distributions, while also contrasting GPT with BERT and describing a related training event.
ChatGPTGPT-4NLP
0 likes · 7 min read


Code DAOJan 15, 2022 · Artificial Intelligence
This article shows how the compress‑fasttext Python library can shrink a 7 GB fastText word‑embedding model to about 21 MB—a 300‑fold reduction—while preserving almost the same accuracy on downstream NLP tasks, and explains the underlying compression techniques, usage examples, and evaluation results.
NLPcompress-fasttextfastText
0 likes · 9 min read


Code DAODec 12, 2021 · Artificial Intelligence
This article explains practical techniques for improving NLP model accuracy on massive corpora, covering challenges of multi‑field text, word‑embedding choices, a fasttext‑based regression demo with book‑review data, feature engineering tricks, and a comparison with tf‑idf + LASSO.
NLPPythonWord2Vec
0 likes · 13 min read


FunTesterNov 11, 2020 · Artificial Intelligence
This article provides a comprehensive overview of natural language processing, tracing its origins from Turing's seminal test to modern techniques like regular expressions, word order importance, word embeddings, Word2vec, GloVe, and knowledge‑ and retrieval‑based chatbot methods.
GloVeNLPWord2Vec
0 likes · 15 min read

AlphaEmbedding builds a weighted graph linking Chinese words, sub‑words, characters and pinyin, then uses random‑walk‑based node2vec training to produce embeddings that capture orthographic and phonetic similarity, markedly improving recall and ranking for homophones, typos and OOV terms in enterprise search.
Chinese NLPgraph computingsemantic similarity
0 likes · 17 min read

On August 6, Dr. Feng Ao presented a comprehensive overview of the evolution of word representations and sentiment analysis, illustrating the shift from traditional linguistic features to modern pretrained models such as BERT and XLNet, and sharing practical convolutional experiments relevant to industry applications.
NLPPretrained Modelsartificial intelligence
0 likes · 4 min read

This article reviews the evolution of word and sentence embeddings, covering foundational theories like vector semantics and distributional hypothesis, practical models such as Word2Vec, GloVe, fastText, Skip‑Thought, Quick‑Thought, and evaluation techniques, while offering implementation tips and real‑world use cases.
GloVeNLPWord2Vec
0 likes · 21 min read

This article reviews the history of natural language processing, explains key deep‑learning models such as NNLM, Word2vec, CNN, RNN, attention mechanisms, and Transformers, and discusses their applications, future trends, and practical considerations in NLP tasks.
AttentionNLPTransformer
0 likes · 38 min read

This article introduces cw2vec, a novel Chinese word‑embedding algorithm that exploits stroke‑level subword information, outlines its theoretical foundations, compares it with word2vec, GloVe, CWE and other models on multiple benchmarks, and demonstrates its superior performance across word similarity, analogy, text classification and named‑entity recognition tasks.
Chinese NLPDeep Learningcw2vec
0 likes · 14 min read

This article provides a comprehensive guide to text classification, covering traditional pipelines, bag‑of‑words and TF‑IDF features, dimensionality‑reduction techniques, word‑embedding models such as GloVe, word2vec and fastText, and modern deep‑learning architectures like CNN, RCNN and HAN.
CNNDeep LearningNLP
0 likes · 9 min read


AntTechJan 18, 2018 · Artificial Intelligence
The cw2vec paper, presented at AAAI 2018, introduces a Chinese word embedding method that leverages stroke n‑grams to capture character semantics, proposes a novel loss function, demonstrates consistent improvements over existing models across similarity, analogy, classification and NER tasks, and discusses real‑world AI applications.
AAAI 2018AI researchChinese NLP
0 likes · 7 min read


ITPUBDec 23, 2015 · Artificial Intelligence
This article explains how natural language processing stores word meanings as numeric vectors, builds token dictionaries, represents sentences as binary vectors, and uses dot‑product calculations to measure similarity, illustrating concepts with simple examples and highlighting current limitations and future directions.
NLPartificial intelligencetokenization
0 likes · 7 min read
