How to Decode URL‑Encoded Strings in Python Web Scraping

1. Introduction

Hello, I am a Python enthusiast. Recently a question about URL encoding in Python web crawling was raised in a WeChat group.

Below is the request screenshot:

2. Implementation

The issue has been covered before; a related library is linked. The original attempt did not yield the expected results.

Later, a user provided the following code:

Code:

url4 = '%25E9%2598%25BF%25E5%259D%259D%25E8%2597%258F%25E6%2597%258F%25E7%25BE%258C%25E6%2597%258F%25E8%2587%25AA%25E6%25B2%25BB%25E5%25B7%259E'
url5 = '%E9%98%BF%E5%9D%9D%E8%97%8F%E6%97%8F%E7%BE%8C%E6%97%8F%E8%87%AA%E6%B2%BB%E5%B7%9E'
res1 = urllib.parse.unquote(url4)
print(res1)
res2 = urllib.parse.unquote(url5)
print(res2)

Note that url4 and url5 have different formats.

3. Conclusion

This article reviews the Python web‑scraping URL‑encoding problem, provides analysis and code to decode the URLs, and helps readers resolve similar issues.