How to Scrape Baidu Tieba Images with Python and Save Locally

1. Retrieve the whole page data

The urllib module provides an interface to read web page data just like reading local files. First, define a getHtml(url) function that opens the URL with urllib.urlopen() and reads the content using read(). The function returns the complete HTML of the page.

2. Filter the desired data

Python’s powerful regular‑expression engine is used to locate image URLs in the HTML. Create a getImg(html) function that compiles a regex pattern with re.compile() and extracts matching URLs with re.findall(). The pattern should match strings like src="http://imgsrc.baidu.com/...jpg".

3. Save the extracted images locally

Iterate over the list of image URLs returned by getImg. For each URL, download the image data and write it to a file in the script’s directory. Use a counter variable (e.g., x) to generate sequential filenames so the saved files have consistent naming.

After the script finishes, the downloaded images will appear in the program’s folder.