Tagged articles
data scraping
19 articles · Page 1 of 1

21CTOAug 26, 2026 · Industry Insights
Elon Musk's X platform has issued a legal takedown notice to the open‑source front‑end service Nitter and its XCancel site, accusing them of illegally scraping user data, bypassing APIs, and violating multiple state and federal laws, prompting the service to go offline.
Elon MuskNitterX platform
0 likes · 4 min read

After battling captchas, IP bans, and constant code rewrites while scraping social‑media hotspots, the author switched to RedFox's API, built a lightweight Python‑Flask and HTML dashboard focused on AI programming tools, and cut maintenance time and costs by more than half.
AI Programming ToolsFlaskPython
0 likes · 10 min read

A dark‑web post by the BellaSwanLeak group alleges possession of about 2.46 billion TikTok user records, prompting TikTok's swift denial, a detailed analysis of possible scraping or third‑party sources, risk implications for overseas businesses, and practical self‑protection steps.
Dark WebRisk AssessmentTikTok
0 likes · 6 min read

The article showcases five practical open‑source projects—including a flip‑board TV simulator, a high‑speed Rust CLI scraper, a Brazilian public‑data MCP server, a visual OpenClaw client, and an AI‑powered WeChat writing workflow—detailing their features, benchmarks, installation steps, and ideal use cases.
AIclidata scraping
0 likes · 12 min read

In the era of abundant AI utilities, this article highlights three recently popular open‑source projects—Spider_XHS for comprehensive Xiaohongshu data collection and automated posting, PPTAgent for one‑click, multi‑scene PowerPoint generation, and Code2Video for code‑driven, high‑quality video creation—detailing their core features, deployment steps, and GitHub links.
AI toolsPPT Automationdata scraping
0 likes · 7 min read

The Chaoyang District People's Court in Beijing found that a technology company illegally scraped the "congestion delay index" from a navigation map, used it for commercial purposes, and ordered it to stop the infringement and pay a total of 12.5 million yuan in damages, highlighting the legal protection of competitive data rights.
Chinadata scrapinginformation security
0 likes · 5 min read

This article presents a collection of Python code examples demonstrating how to scrape, process, visualize, and analyze data from news sites, social media, stock markets, e‑commerce, web traffic, text, images, and more, covering tasks such as clustering, time‑series forecasting, and sentiment analysis.
Pythondata analysisdata scraping
0 likes · 12 min read

This article examines a Python web‑crawler issue where the original script returns incorrect results, explains the underlying cause related to mutable data handling, and provides a corrected version of the code that successfully retrieves the desired price data from the Xinfadi website.
data scrapingmutable objectsrequests
0 likes · 6 min read

This article recounts how a corporate web‑crawling tool designed to automate housing‑loan data collection overloaded a municipal residence‑permit system, triggered a large‑scale denial‑of‑service attack, and led to the CTO and programmer being prosecuted for damaging a computer information system.
Web Crawlingcomputer crimecyberlaw
0 likes · 8 min read

This article recounts how a Chinese fintech company's automated web‑crawler, built to query a municipal residence‑permit system, overloaded the server, triggered police action, led to criminal charges for the CTO and programmer, and offers lessons on the legal risks of large‑scale data scraping.
Web Crawlingcloud computingcomputer crime
0 likes · 9 min read


21CTOFeb 5, 2022 · Information Security
This article recounts how a fintech company's automated web‑scraping tool overloaded a municipal residence‑permit system, leading to massive data leakage, legal prosecution of its CTO and programmer, and highlights the severe legal risks of unchecked crawling practices.
Web Crawlingcomputer crimedata scraping
0 likes · 9 min read


ITPUBJun 17, 2021 · Information Security
A recent Chinese court case reveals that a university graduate used a custom web‑crawler to harvest more than 1.18 billion Taobao user records, which were then sold to a partner who ran fraudulent WeChat groups, leading to both perpetrators’ conviction for violating personal information protection laws.
Chinadata scrapinginformation security
0 likes · 10 min read

This tutorial explains how to capture and analyze Douyin's hot list data on Android by setting up Charles proxy, installing required certificates, intercepting traffic, and automating the process with Appium and mitmproxy, providing step‑by‑step instructions and key code snippets.
AndroidAppiumCharles Proxy
0 likes · 5 min read


21CTONov 16, 2019 · Fundamentals
This article traces the evolution of web crawlers—from early Perl scripts to modern ByteDance agents—explaining their role in search engines, business models, anti‑crawling measures, and the impact on content creation and competition.
Web Crawlingcontent aggregationdata scraping
0 likes · 6 min read

This article walks through the process of scraping Meican's ordering data via its APIs, analyzing restaurant popularity, and creating a Node.js‑based DingTalk robot that automatically notifies users when it’s time to place their lunch orders, complete with code snippets and visual insights.
DingTalk botMeican APINode.js
0 likes · 10 min read

Using Python, Scrapy, pandas and seaborn, this article crawls public Shanbay user data, cleans and stores it in PostgreSQL, then analyses retention, growth and word‑learning distributions, revealing that the overwhelming majority of learners abandon the app within a few days.
PythonSeabornShanbay
0 likes · 10 min read

An Alibaba engineer demonstrates how to scrape Ziroom listings, apply random‑forest feature importance and grey relational analysis to rank shared apartments by size, price and commute distance, dramatically narrowing the search for a perfect rental in Beijing.
Housing MarketPythonRandom Forest
0 likes · 11 min read

This article describes how to employ UIAutomator to automate data extraction from K12 education mobile apps, handling device identity spoofing, image input normalization, and UI control reverse‑engineering to overcome encryption, token checks, and non‑standard input challenges.
Image NormalizationK12 educationUI Reverse Engineering
0 likes · 5 min read

This article examines the hidden, often unglamorous world of web crawling and anti‑crawling, revealing why companies deploy aggressive scraping and defensive measures, the technical arms race between crawlers and defenders, the impact on engineers' careers, and future trends in this contested space.
Web Crawlinganti‑crawlingdata scraping
0 likes · 21 min read
