Tag

urllib2

0 views collected around this technical thread.

Python Programming Learning Circle
Python Programming Learning Circle
Jan 24, 2024 · Backend Development

Eight Essential Techniques for Python Web Scraping with urllib2

This article presents a concise guide to Python web scraping, covering eight practical techniques—including basic GET/POST requests, proxy usage, cookie management, header spoofing, page parsing, captcha handling, gzip compression, and multithreaded crawling—each illustrated with clear code examples.

ProxyWeb Scrapingcookies
0 likes · 8 min read
Eight Essential Techniques for Python Web Scraping with urllib2
Python Programming Learning Circle
Python Programming Learning Circle
Aug 19, 2022 · Backend Development

Essential Python Web Scraping Techniques: GET/POST Requests, Proxy IPs, Cookie Handling, Header Spoofing, Gzip Compression, and Multithreading

This article presents a comprehensive guide to Python web scraping, covering basic GET and POST requests with urllib2, using proxy IPs, managing cookies, disguising as a browser via custom headers, handling gzip-compressed responses, and accelerating crawls with a simple multithreaded worker pool.

ProxyPythonWeb Scraping
0 likes · 8 min read
Essential Python Web Scraping Techniques: GET/POST Requests, Proxy IPs, Cookie Handling, Header Spoofing, Gzip Compression, and Multithreading
Python Programming Learning Circle
Python Programming Learning Circle
Aug 21, 2021 · Backend Development

Python Script for Scraping Super Schedule App Topics via HTTP Requests

This tutorial demonstrates how to capture network packets from the Super Schedule Android app, perform a login request with required headers, and repeatedly fetch and parse topic data using Python urllib2 and JSON handling, enabling infinite scrolling of user‑generated topics.

AndroidBackendJSON
0 likes · 7 min read
Python Script for Scraping Super Schedule App Topics via HTTP Requests
Python Programming Learning Circle
Python Programming Learning Circle
Jul 23, 2021 · Backend Development

Simulating Login to a Web Portal Using Python urllib2 and cookielib

This tutorial demonstrates how to programmatically log into a website by handling cookies, fetching and solving captchas, and posting the required form data using Python's urllib2 and cookielib modules, with a complete example targeting a school academic system.

HTTPLogin SimulationWeb Scraping
0 likes · 5 min read
Simulating Login to a Web Portal Using Python urllib2 and cookielib
Python Programming Learning Circle
Python Programming Learning Circle
Apr 13, 2021 · Backend Development

Python Web Scraping Techniques: GET/POST Requests, Proxy IP, Cookies, Header Spoofing, Gzip Compression, and Multithreading

This article provides a comprehensive Python web‑scraping guide covering basic GET/POST requests with urllib2, proxy handling, cookie management, header manipulation to mimic browsers, gzip compression handling, regular‑expression and library parsing, simple captcha strategies, and a multithreaded thread‑pool example.

Header SpoofingProxyPython
0 likes · 8 min read
Python Web Scraping Techniques: GET/POST Requests, Proxy IP, Cookies, Header Spoofing, Gzip Compression, and Multithreading
Python Programming Learning Circle
Python Programming Learning Circle
Dec 18, 2019 · Backend Development

Automate Daily Joke SMS with Python: From API to Cron Job

This tutorial shows how to fetch a joke via a free API using Python's urllib2, split the short joke to fit a 140‑character SMS limit, send it through a QQ email to a 139 mailbox, and schedule the script with a Linux crontab entry for daily delivery.

APIPythonautomation
0 likes · 9 min read
Automate Daily Joke SMS with Python: From API to Cron Job