Graph-Based Methods for Hot Event Discovery, Long Text Matching, and Ontology Construction in Natural Language Processing
This talk presents a series of graph‑based techniques for natural language processing, including the Story Forest system for hot event discovery, the GIANT framework for ontology creation and user interest modeling, and a divide‑and‑conquer approach to long‑text matching that leverages graph neural networks and community detection.
The presentation begins with an overview of natural language processing (NLP) history, from bag‑of‑words to large pre‑trained language models, and argues that graph‑structured representations combined with graph neural networks (GNNs) are the next promising direction for NLP.
It introduces the Story Forest system, which organizes news articles into hierarchical story trees using a two‑stage graph‑based clustering pipeline (keyword community detection followed by document graph community detection) to reduce redundancy and reveal event evolution.
The talk then describes the GIANT framework for ontology creation and user interest modeling. By constructing a search‑click graph from query‑document interactions, the system extracts concepts, events, and topics, inserts them into a knowledge graph, and tags user interests for personalized recommendation.
For long‑text matching, a divide‑and‑conquer strategy is proposed: texts are split into sub‑topics, aligned locally, and then aggregated globally via a GCN that performs message passing on a concept interaction graph, overcoming the limitations of traditional encoder‑ or interaction‑based models.
Experimental results on two long‑text datasets show that the graph‑based models (SimNet, CIG‑Siam, CIG‑Siam‑GCN) outperform baseline methods, with GCN aggregation improving accuracy by over 10%.
The session concludes with a Q&A covering story forecasting advantages, keyword extraction tools, clustering pipelines, and the benefits of community‑detection clustering over density‑based methods.
DataFunTalk
Dedicated to sharing and discussing big data and AI technology applications, aiming to empower a million data scientists. Regularly hosts live tech talks and curates articles on big data, recommendation/search algorithms, advertising algorithms, NLP, intelligent risk control, autonomous driving, and machine learning/deep learning.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.