When Is Web Scraping Legal? A Developer’s Guide to Chinese Cyber Laws

01 Is Technology Innocent?

Many say technology itself is neutral, but users can be liable if they knowingly use it illegally; companies and programmers must bear consequences when employing illegal crawlers.

Since the Cybersecurity Law, many gray‑area services have been shut down. Selling personal data exceeding 50 entries is deemed a serious offense.

Numerous sites (social‑engineer databases, copyright‑infringing platforms) have disappeared under stricter enforcement.

As China’s economy grows, intellectual‑property protection intensifies; illegal crawlers are increasingly targeted.

02 Crawlers Put Jobs at Risk

Job listings show high demand for crawler engineers, with salaries from 10k to 60k RMB.

Common questions:

Is it a crime to scrape internal company data on orders?

Is scraping publicly available information illegal?

Is publishing code on GitHub that others misuse a crime?

Answers:

Scraping internal data with company authorization is not a crime, but using crawlers instead of proper APIs is questionable.

Scraping public data is legal, but causing server overload or denial‑of‑service is illegal.

Uploading code is generally permissible; however, if the software facilitates intrusion, cracking, or viruses, liability may arise.

Companies should involve legal and risk‑control teams before releasing such tools; otherwise, individuals may face “unit crime” liability.

03 What Makes a Crawler Illegal?

Collecting personal identifiers (name, ID, contact, address, credentials, assets, location) for illicit purposes violates personal‑information laws.

Three illegal scenarios:

Bypassing anti‑scraping measures to obtain data, potentially constituting “illegal acquisition of computer system data”.

Disrupting target servers, which can be prosecuted as “damage to computer information systems”.

Harvesting personal data, leading to “illegal acquisition of personal information”.

Commercially sold paid‑course content scraped and resold also breaches the law.

04 What Makes a Crawler Legal?

1. Respect the robots.txt protocol.

2. Do not cause server crashes or excessive traffic (e.g., exceeding one‑third of daily traffic).

3. Do not profit illegally from scraped data; misuse can lead to unfair‑competition lawsuits.

05 Final Thoughts

Programmers should stay aware of legal risks, avoid scraping personal data, paid content, or engaging in illegal profit, and maintain caution when operating near legal boundaries.

Respect the law and act responsibly.