Tag

data scraping

1 views collected around this technical thread.

Java Architect Essentials
Java Architect Essentials
Dec 24, 2024 · Information Security

Beijing Chaoyang Court Rules Unfair Competition in Navigation Data Scraping, Awards 12.5 Million Yuan Compensation

The Chaoyang District People's Court in Beijing found that a technology company illegally scraped the "congestion delay index" from a navigation map, used it for commercial purposes, and ordered it to stop the infringement and pay a total of 12.5 million yuan in damages, highlighting the legal protection of competitive data rights.

Chinadata scrapinginformation security
0 likes · 5 min read
Beijing Chaoyang Court Rules Unfair Competition in Navigation Data Scraping, Awards 12.5 Million Yuan Compensation
Test Development Learning Exchange
Test Development Learning Exchange
Jan 16, 2024 · Artificial Intelligence

Python Code Samples for Data Scraping and Analysis Across Various Business Scenarios

This article presents a collection of Python code examples demonstrating how to scrape, process, visualize, and analyze data from news sites, social media, stock markets, e‑commerce, web traffic, text, images, and more, covering tasks such as clustering, time‑series forecasting, and sentiment analysis.

Machine LearningPythonWeb Scraping
0 likes · 12 min read
Python Code Samples for Data Scraping and Analysis Across Various Business Scenarios
Architecture Digest
Architecture Digest
Feb 19, 2022 · Information Security

Case Study: Illegal Web Crawling and Criminal Conviction in China

This article recounts how a corporate web‑crawling tool designed to automate housing‑loan data collection overloaded a municipal residence‑permit system, triggered a large‑scale denial‑of‑service attack, and led to the CTO and programmer being prosecuted for damaging a computer information system.

computer crimecyberlawdata scraping
0 likes · 8 min read
Case Study: Illegal Web Crawling and Criminal Conviction in China
Baidu Intelligent Testing
Baidu Intelligent Testing
Jul 25, 2017 · Mobile Development

Using UIAutomator for Mobile App Data Scraping and Quality Evaluation in K12 Education Apps

This article describes how to employ UIAutomator to automate data extraction from K12 education mobile apps, handling device identity spoofing, image input normalization, and UI control reverse‑engineering to overcome encryption, token checks, and non‑standard input challenges.

Image NormalizationK12 EducationUI Reverse Engineering
0 likes · 5 min read
Using UIAutomator for Mobile App Data Scraping and Quality Evaluation in K12 Education Apps
Ctrip Technology
Ctrip Technology
May 22, 2017 · Information Security

The Dark Side of Web Crawling and Anti‑Crawling: Industry Realities and Technical Strategies

This article examines the hidden, often unglamorous world of web crawling and anti‑crawling, revealing why companies deploy aggressive scraping and defensive measures, the technical arms race between crawlers and defenders, the impact on engineers' careers, and future trends in this contested space.

anti-crawlingbackend developmentdata scraping
0 likes · 21 min read
The Dark Side of Web Crawling and Anti‑Crawling: Industry Realities and Technical Strategies
Baidu Intelligent Testing
Baidu Intelligent Testing
May 18, 2016 · Operations

Engineering Approach to Resource Evaluation for Online Appointment Platforms

This article presents a systematic methodology for evaluating the full‑stack resource data of online appointment services, using Baidu Doctor as a case study, and details the three‑step process of data capture, parsing, and metric calculation together with tool selection, code examples, and strategy formulas.

data scrapingmetricsonline appointment
0 likes · 11 min read
Engineering Approach to Resource Evaluation for Online Appointment Platforms