Large‑Scale Twitter Data Collection and Analysis: From Crawling to Sentiment and Market Correlation
The article describes a two‑year, 400‑billion‑tweet crawling project, its statistical and sentiment analyses linking sleep patterns, weekdays, holidays, and market indices, and the low‑cost technical infrastructure built to store and query the massive dataset.
