Tagged articles

requests

199 articles · Page 1 of 2

Sep 7, 2026 · Cloud Native

Kubernetes Resource Contracts: How requests and limits Control Pod Scheduling, Throttling, and Eviction

This article explains how Kubernetes requests and limits act as a contract between workloads and the scheduler, detailing their distinct roles, the divergent consequences of CPU throttling versus memory OOMKills, the three QoS classes that determine eviction priority, and how LimitRange and ResourceQuota enforce resource policies at the namespace level.

CPU throttlingKubernetesLimitRange

0 likes · 10 min read

Kubernetes Resource Contracts: How requests and limits Control Pod Scheduling, Throttling, and Eviction

DeepHub IMBA

Aug 6, 2026 · Backend Development

10 Practical Python API Tips to Turn Scripts from Working to Robust

This article presents ten concrete Python techniques for handling APIs—automatic retries, response caching, environment‑based secrets, Pydantic schema validation, clean pagination, WebSocket streaming, rate‑limiting, concurrent requests, mock responses, and GraphQL—each illustrated with runnable code to make scripts more reliable and efficient.

APIConcurrencyGraphQL

0 likes · 8 min read

10 Practical Python API Tips to Turn Scripts from Working to Robust

Test Development Learning Exchange

Jul 8, 2026 · Backend Development

Beyond Simple Requests: 7 Python Snippets to Upgrade Script‑Kiddie Tests

The article walks through seven progressive Python code examples—from a robust GET request with timeout to async httpx calls and ORM‑based database assertions—showing how to transform naïve request scripts into maintainable, fault‑tolerant API automation projects.

API-testingPythonSQLAlchemy

0 likes · 9 min read

Beyond Simple Requests: 7 Python Snippets to Upgrade Script‑Kiddie Tests

liandk

May 13, 2026 · Backend Development

Python Web Scraping Basics: Extract Strings and Intro to Regex in 5 Minutes

This tutorial walks through fixing common requests‑module errors, selecting a reliable PyPI mirror, formatting URLs correctly, and using built‑in string methods and basic regex to reliably extract IP, keyword and request URL data from HTTP responses, with batch examples and a summary of four common pitfalls.

PythonString ExtractionWeb Scraping

0 likes · 12 min read

Python Web Scraping Basics: Extract Strings and Intro to Regex in 5 Minutes

liandk

May 13, 2026 · Backend Development

Advanced Requests and Simple Web Scraping in Python: Extract Data in 5 Minutes

This tutorial walks you through installing the requests library from reliable mirrors, setting browser-like headers, extracting JSON or raw text data, handling common errors, and performing batch requests to build a quick, functional web scraper in just five minutes.

HTTP headersPythonWeb Scraping

0 likes · 11 min read

Advanced Requests and Simple Web Scraping in Python: Extract Data in 5 Minutes

liandk

May 13, 2026 · Fundamentals

Python Basics – Part 8: Master requests in 5 Minutes to Start Web Scraping

This tutorial walks you through installing the Python requests library, demonstrates basic GET requests, adding query parameters, handling errors with timeout and exceptions, and highlights four common pitfalls with solutions, enabling you to quickly build simple web‑scraping scripts in just five minutes.

HTTPPythonWeb Scraping

0 likes · 8 min read

Python Basics – Part 8: Master requests in 5 Minutes to Start Web Scraping

Test Development Learning Exchange

May 1, 2026 · Backend Development

20 Essential Python API Testing Skills: From Manual to AI‑Powered Automation

This guide presents 20 practical Python skills for API testing, covering basic request handling, pytest fixtures, JSON validation, database helpers, framework abstraction, dynamic data generation, Allure reporting, CI pipeline integration, AI‑driven test case creation, intelligent retries, performance and security testing, and engineering best practices to transform manual testing into an intelligent, automated workflow.

AIAPI-testingAllure

0 likes · 14 min read

20 Essential Python API Testing Skills: From Manual to AI‑Powered Automation

Test Development Learning Exchange

Apr 16, 2026 · Backend Development

Simplify API Parameter Formatting with a Python @serialize_params Decorator

This tutorial shows how to create a reusable Python decorator that automatically converts a data dictionary into the correct request format (JSON or form‑data), letting you write test scripts with a uniform data= syntax and avoid common payload errors.

API-testingDecoratorPython

0 likes · 7 min read

Simplify API Parameter Formatting with a Python @serialize_params Decorator

Woodpecker Software Testing

Jan 26, 2026 · Backend Development

How to Design Practical Login API Test Cases

This article presents several Python‑based login API test cases—including normal login, parameterized login, handling missing endpoints, and chaining an order request—along with step‑by‑step code examples and best‑practice tips for writing reliable, maintainable tests.

API-testingPythonlogin API

0 likes · 5 min read

How to Design Practical Login API Test Cases

Test Development Learning Exchange

Dec 15, 2025 · Backend Development

How to Build a Self‑Healing API Test Client with Automatic Token Refresh

Learn how to implement an automatic token‑refresh mechanism for API automation tests using Python’s requests and tenacity libraries, covering token refresh strategies, intercepting 401 responses, retry logic, client design, and production‑grade enhancements to ensure robust, unattended test execution.

API-testingPythonToken Refresh

0 likes · 7 min read

How to Build a Self‑Healing API Test Client with Automatic Token Refresh

Test Development Learning Exchange

Dec 13, 2025 · Backend Development

Mastering HTTP Response Validation in Python Requests for Robust API Tests

Learn how to expertly extract status codes, parse JSON bodies, verify headers, and implement defensive checks in Python's requests library, turning simple API calls into reliable automated test cases with clear assertions and reusable response handling patterns.

API-testingHTTP responseassertions

0 likes · 7 min read

Mastering HTTP Response Validation in Python Requests for Robust API Tests

Test Development Learning Exchange

Dec 10, 2025 · Backend Development

Mastering GET, POST, and File Upload Parameters with Python requests

This guide explains how to correctly use params, json, data, and files in Python's requests library for GET, POST/PUT, and multipart requests, highlighting common pitfalls, debugging tips, and when to choose each method to avoid typical API errors.

Pythonapi-testingfile upload

0 likes · 6 min read

Mastering GET, POST, and File Upload Parameters with Python requests

Test Development Learning Exchange

Dec 9, 2025 · Backend Development

Mastering Login State in API Automation: Cookies, Sessions, and Tokens

This guide explains why maintaining login state is essential for API automation, details the classic Session‑Cookie mechanism, shows how to simulate it with Python's requests.Session, explores token‑based alternatives like JWT, and provides best‑practice tips and debugging techniques.

API-testingAuthenticationCookie

0 likes · 7 min read

Mastering Login State in API Automation: Cookies, Sessions, and Tokens

Python Programming Learning Circle

Nov 14, 2025 · Fundamentals

Boost Your Python Productivity with 7 Essential Efficiency Tools

This guide introduces seven powerful Python libraries—Pandas, Selenium, Flask, Scrapy, Requests, Faker, and Pillow—explaining their core uses, installation commands, and example code snippets to help developers automate tasks, streamline workflows, and accelerate development.

FakerFlaskpandas

0 likes · 6 min read

Boost Your Python Productivity with 7 Essential Efficiency Tools

Python Programming Learning Circle

Nov 10, 2025 · Fundamentals

What Are the 22 Most Popular Python Packages and Why They Matter

This article examines the 22 most‑used Python packages on PyPI, explaining their core functionality, download statistics, and typical use cases—from HTTP clients like urllib3 to compatibility tools like six, security libraries such as certifi and rsa, and utility modules for dates, YAML, and concurrency—providing developers with a concise guide to essential Python tooling.

PyPIPythondevelopment

0 likes · 20 min read

What Are the 22 Most Popular Python Packages and Why They Matter

IT Services Circle

Nov 1, 2025 · Cloud Native

Understanding Kubernetes CPU Requests vs Limits: The Secrets of Overselling

This article explains how Kubernetes uses CPU requests and limits to implement overselling, detailing the underlying Linux cgroup mechanisms, bandwidth throttling, weight‑based scheduling, and practical configuration tips for SREs to balance guaranteed resources with maximum usage.

CPU schedulingKubernetesResource Limits

0 likes · 16 min read

Understanding Kubernetes CPU Requests vs Limits: The Secrets of Overselling

21CTO

Oct 30, 2025 · Backend Development

Top Python Web Frameworks in 2024: FastAPI, Django, Flask & More

This article reviews the most popular Python web frameworks of 2024—FastAPI, Django, Flask, Requests, Asyncio, and Django REST Framework—detailing their usage trends, strengths, weaknesses, and ideal use cases, while also highlighting emerging tools and how to choose the right one for your project.

DjangoFastAPIFlask

0 likes · 17 min read

Top Python Web Frameworks in 2024: FastAPI, Django, Flask & More

Python Programming Learning Circle

Oct 16, 2025 · Backend Development

Why DrissionPage Is the Game‑Changer for Python Web Scraping and Automation

This article introduces DrissionPage, a Python library that merges Selenium and Requests, explains its three page objects, highlights seamless mode switching, built‑in utilities, API changes in version 4.0, and provides practical code examples for web automation, data crawling, and testing.

Web Scrapingbrowser automationdata-extraction

0 likes · 14 min read

Why DrissionPage Is the Game‑Changer for Python Web Scraping and Automation

Test Development Learning Exchange

Oct 13, 2025 · Backend Development

Boost Your API Test Automation with a Powerful Python HTTP Client

Learn how to create a professional, reusable Python HTTP client that streamlines API automation by automatically handling URL concatenation, colored logging, built‑in assertions, response timing, environment management, and structured results, turning repetitive request code into concise, readable one‑liners.

API-testingHTTP ClientPython

0 likes · 9 min read

Boost Your API Test Automation with a Powerful Python HTTP Client

Dunmao Tech Hub

Sep 12, 2025 · Backend Development

Build a Python Tkinter Auto‑Learning Timer: GUI, Captcha, and Threaded Requests

This tutorial explains how to create a Python Tkinter desktop tool that automates login, captcha handling, and periodic study‑time submissions to an online learning platform using Requests, multithreading, and a state‑machine UI for reliable operation.

GUIPythonTkinter

0 likes · 8 min read

Build a Python Tkinter Auto‑Learning Timer: GUI, Captcha, and Threaded Requests

Python Crawling & Data Mining

Sep 5, 2025 · Backend Development

Fix Chinese Encoding Issues in Python Web Scraping: Practical Tips & Code

This article walks through a common Chinese character garbling problem in Python web crawlers, explains why automatic encoding detection can fail, and provides clear code examples—including manual GBK setting and re‑encoding tricks—to reliably extract readable text.

ParselPythonUnicode

0 likes · 4 min read

Fix Chinese Encoding Issues in Python Web Scraping: Practical Tips & Code

Model Perspective

Aug 27, 2025 · Fundamentals

Unlock Python’s Power: 7 Essential Libraries Every Developer Should Master

This article visually explores seven of Python’s most influential third‑party libraries—NumPy, Pandas, Matplotlib, Requests, Scikit‑learn, Flask, and Beautiful Soup—detailing their core features, typical use cases, and sample code to help developers quickly grasp how each tool can accelerate data processing, visualization, web development, and machine‑learning projects.

BeautifulSoupFlaskNumPy

0 likes · 12 min read

Unlock Python’s Power: 7 Essential Libraries Every Developer Should Master

Code Mala Tang

Jul 21, 2025 · Backend Development

Implement Robust HTTP Retry with urllib3 & Requests in Python

Learn how to configure Python's urllib3 Retry and Requests adapters to automatically handle common HTTP errors, set retry counts, backoff factors, and method whitelists, enabling resilient API consumption and preventing rate‑limit failures.

APIHTTP retrybackoff

0 likes · 6 min read

Implement Robust HTTP Retry with urllib3 & Requests in Python

Practical DevOps Architecture

Jul 16, 2025 · Operations

How to Build a Simple Python Service Health Check Script

This guide shows how to write a Python script that constructs a service health URL from command‑line arguments, sends an HTTP request using the requests library, parses the JSON response, and raises an error if the service status is not "UP", providing clear success or failure feedback.

BackendScripthealth-check

0 likes · 2 min read

How to Build a Simple Python Service Health Check Script

Test Development Learning Exchange

Jul 10, 2025 · Backend Development

Requests vs httpx: Which Python HTTP Client Wins for Your Tests?

This article compares the popular Python HTTP client libraries requests and httpx, outlining their core features, ideal usage scenarios, code examples for synchronous and asynchronous requests, installation steps, and a final recommendation to help developers choose the right tool for API testing.

API-testingHTTPasynchronous

0 likes · 4 min read

Requests vs httpx: Which Python HTTP Client Wins for Your Tests?

Python Programming Learning Circle

Jul 1, 2025 · Operations

How to Scrape Weibo Data with Python: Complete Guide & Code

This tutorial walks through using Python to crawl Weibo, covering environment setup, three login methods, data extraction functions for user info, posts and comments, anti‑crawling strategies, storage to CSV or MySQL, a full example script, and legal considerations.

Data StorageWeb ScrapingWeibo

0 likes · 12 min read

How to Scrape Weibo Data with Python: Complete Guide & Code

Python Programming Learning Circle

Jun 10, 2025 · Backend Development

How to Scrape Beike Real‑Estate Listings with Python: A Complete Guide

This tutorial walks you through building a Python web‑scraper for Beike (Lianjia) second‑hand property listings, covering session spoofing, dynamic parameters, pagination, multithreaded detail fetching, data cleaning, and exporting results to Excel in a step‑by‑step manner.

BeautifulSoupPythonWeb Scraping

0 likes · 18 min read

How to Scrape Beike Real‑Estate Listings with Python: A Complete Guide

Python Programming Learning Circle

Jun 7, 2025 · Backend Development

Master Python Web Scraping: From Requests to Selenium and Scrapy

Learn how to efficiently scrape web pages using Python by exploring multiple approaches—including simple requests with BeautifulSoup, fast parsing with lxml, dynamic content extraction with Selenium, and large‑scale crawling with Scrapy—complete with installation steps, code snippets, and detailed explanations.

BeautifulSoupPythonWeb Scraping

0 likes · 10 min read

Master Python Web Scraping: From Requests to Selenium and Scrapy

Python Programming Learning Circle

Jun 4, 2025 · Backend Development

How to Scrape JD.com Product Reviews with Python and Save to CSV

This tutorial explains how to use Python to scrape product reviews from JD.com via its AJAX comment API, extract fields such as nickname, score, content, and image count, and save the collected data into a CSV file using the requests and csv modules.

CSVJD.comPython

0 likes · 7 min read

How to Scrape JD.com Product Reviews with Python and Save to CSV

Python Programming Learning Circle

May 28, 2025 · Backend Development

Using Proxy IPs for Web Scraping with Python: A Practical Guide

This article explains why proxy IPs are essential for reliable web crawling, compares dynamic and static residential proxies, and provides step‑by‑step Python code to scrape product titles, prices and links from Snapdeal while demonstrating how to integrate proxies for improved efficiency and security.

BeautifulSoupdata-extractionproxy IP

0 likes · 12 min read

Using Proxy IPs for Web Scraping with Python: A Practical Guide

php Courses

May 14, 2025 · Backend Development

Python Advantages for Web Scraping and Core Library Guide

This article outlines Python's advantages for web crawling, introduces core libraries such as Requests, BeautifulSoup, and Scrapy, details a step-by-step development workflow, provides practical code examples for extracting news titles, and highlights important considerations and advanced techniques for robust scraper implementation.

BeautifulSoupPythonWeb Scraping

0 likes · 5 min read

Python Advantages for Web Scraping and Core Library Guide

Python Programming Learning Circle

May 12, 2025 · Fundamentals

Basic Python Web Scraping Techniques and Tips

This article introduces beginner-friendly Python web‑scraping methods, covering the simplest urllib/requests approach, adding request headers, inspecting network traffic for hidden data, handling dynamically loaded content with Selenium, and provides links to deeper tutorials for each technique.

Network InspectionPythonrequest headers

0 likes · 4 min read

Basic Python Web Scraping Techniques and Tips

php Courses

Apr 25, 2025 · Backend Development

Understanding HTTP Protocol and Using Python requests Library

This article introduces the fundamentals of the HTTP protocol, explains its request and response structures, and provides a comprehensive guide to using Python's requests library for sending GET, POST, PUT, DELETE requests, handling headers, parameters, JSON responses, timeouts, and exceptions.

HTTPPythonnetwork-programming

0 likes · 9 min read

Understanding HTTP Protocol and Using Python requests Library

Python Crawling & Data Mining

Apr 10, 2025 · Backend Development

Build a Daily Article Email Bot with Python Web Scraping

This tutorial shows how to use Python to scrape a daily article from a website, format the content, and automatically send it via email using SMTP, with full source code and guidance for scheduling the script.

SMTPemail-automationlxml

0 likes · 6 min read

Build a Daily Article Email Bot with Python Web Scraping

Test Development Learning Exchange

Mar 25, 2025 · Backend Development

API Automation Testing with Pytest, Requests, and Allure: A Step‑by‑Step Guide

This guide walks through setting up a Python environment, organizing a test project, writing reusable request utilities and data‑driven Pytest cases, generating Allure reports, and extending tests with token handling and database verification for robust backend API automation.

API-testingAllureautomation

0 likes · 6 min read

API Automation Testing with Pytest, Requests, and Allure: A Step‑by‑Step Guide

Python Programming Learning Circle

Mar 25, 2025 · Backend Development

Comprehensive Python Guide to Download Files from the Web, S3, and Other Sources

This tutorial walks through multiple Python techniques for downloading regular files, web pages, Amazon S3 objects, and other resources, covering basic requests, wget, handling redirects, chunked large‑file downloads, parallel downloads, progress bars, urllib, urllib3, proxy usage, boto3 for S3, and asynchronous downloads with asyncio.

Boto3File DownloadPython

0 likes · 8 min read

Comprehensive Python Guide to Download Files from the Web, S3, and Other Sources

Python Programming Learning Circle

Mar 25, 2025 · Backend Development

Python Script for Scraping and Converting Anime Images from Huashi6

This article explains how to use Python's requests, BeautifulSoup, and Pillow libraries to crawl high‑resolution anime pictures from the Huashi6 website, extract their webp URLs via regex, download them, and convert the images to the more common png format for personal use.

Pythonimage-processingrequests

0 likes · 8 min read

Python Script for Scraping and Converting Anime Images from Huashi6

Test Development Learning Exchange

Mar 19, 2025 · Backend Development

Using Python Requests to Send RESTful API Requests: A Step‑by‑Step Guide

This article introduces the fundamentals of RESTful APIs and demonstrates how to install the Python requests library, send GET, POST, PUT, and DELETE requests, set custom headers, handle responses, manage sessions, and apply best‑practice tips for reliable API testing.

Backend DevelopmentHTTPRESTful API

0 likes · 6 min read

Using Python Requests to Send RESTful API Requests: A Step‑by‑Step Guide

Python Programming Learning Circle

Feb 7, 2025 · Backend Development

Python Web Crawling Tutorial: From Basics to a Full‑Scale Novel Scraper

This article introduces web crawling fundamentals, demonstrates how to inspect HTML elements, walks through simple examples using urllib, requests, and BeautifulSoup, and culminates in a complete Python script that extracts chapter links and contents from a novel website, saving them to a text file.

BeautifulSoupCrawlerWeb Scraping

0 likes · 19 min read

Python Web Crawling Tutorial: From Basics to a Full‑Scale Novel Scraper

Python Crawling & Data Mining

Feb 7, 2025 · Artificial Intelligence

Unlocking DeepSeek: How to Use AI-Powered Python Scraping for Baidu Hot Topics

This article introduces DeepSeek, an AI platform with strong NLP and multimodal capabilities, outlines its core features and products, and provides a step‑by‑step Python tutorial—including a complete requests‑BeautifulSoup script—to scrape Baidu’s homepage hot‑topic titles, plus usage tips and precautions.

AI platformBaidu hot topicsPython web scraping

0 likes · 8 min read

Unlocking DeepSeek: How to Use AI-Powered Python Scraping for Baidu Hot Topics

Test Development Learning Exchange

Feb 6, 2025 · Backend Development

Comprehensive Python API Testing Examples with Requests and Pytest

This article provides a collection of practical Python snippets demonstrating how to send GET and POST requests, validate status codes, response bodies, JSON schemas, handle headers, query parameters, file uploads, redirects, timeouts, sessions, authentication, rate limiting, and parameterized testing using the requests library and pytest framework.

API-testingHTTPPython

0 likes · 14 min read

Comprehensive Python API Testing Examples with Requests and Pytest

Python Crawling & Data Mining

Jan 9, 2025 · Backend Development

How to Fix Common URL Construction Errors in Python Web Scraping

This article walks through a typical Python web‑scraping issue caused by incorrect URL concatenation and XPath mismatches, explains the debugging process, and provides complete, ready‑to‑run code along with a practical urljoin example to prevent similar errors.

error handlinglxmlrequests

0 likes · 6 min read

How to Fix Common URL Construction Errors in Python Web Scraping

Python Programming Learning Circle

Dec 31, 2024 · Fundamentals

Top 10 Essential Python Libraries and How to Use Them

An overview of ten indispensable Python libraries—including Requests, NumPy, Pandas, Matplotlib, Flask, Django, PyTorch, OpenCV, Scikit‑learn, and BeautifulSoup—detailing their core features, typical use cases, common pitfalls, and example code snippets to help developers quickly adopt them in projects.

Librariesmachine learningrequests

0 likes · 8 min read

Top 10 Essential Python Libraries and How to Use Them

Raymond Ops

Dec 27, 2024 · Backend Development

Master Python Requests: Web Scraping Basics with GET, POST, and File Saving

This tutorial walks you through installing the Python requests library, using GET, POST, and PUT methods, handling query parameters, setting custom headers to bypass anti‑scraping measures, and saving both HTML content and images to local files, complete with runnable code examples.

HTTPPythonTutorial

0 likes · 7 min read

Master Python Requests: Web Scraping Basics with GET, POST, and File Saving

Python Crawling & Data Mining

Dec 20, 2024 · Fundamentals

How to Scrape Fund Data with Python: A Step‑by‑Step Guide

This article walks you through using Python's requests and lxml libraries to crawl a fund website, extract stock IDs, fetch detailed fund information, process the data, and save it to CSV for further analysis, complete with code snippets and screenshots.

CSVFund DataPython

0 likes · 5 min read

How to Scrape Fund Data with Python: A Step‑by‑Step Guide

Python Crawling & Data Mining

Nov 19, 2024 · Backend Development

Mastering Python’s requests stream=True: Fast, Efficient Web Crawling

This article walks through using Python’s requests library with the stream=True parameter to efficiently filter valid URLs during web crawling, presenting two methods, code examples, execution time comparisons, and a clear explanation of the stream option’s role.

PythonStreamWeb Crawling

0 likes · 5 min read

Mastering Python’s requests stream=True: Fast, Efficient Web Crawling

Python Programming Learning Circle

Nov 7, 2024 · Backend Development

11 Efficient Python Web Scraping Tools and a Practical News‑Site Example

This article introduces eleven powerful Python libraries for web scraping—including Requests, BeautifulSoup, Scrapy, Selenium, PyQuery, Lxml, Pandas, Pyppeteer, aiohttp, Faker, and ProxyPool—explains their key features, provides ready‑to‑run code snippets, and demonstrates a real‑world news‑site crawling case study.

BeautifulSoupWeb Scrapingrequests

0 likes · 13 min read

11 Efficient Python Web Scraping Tools and a Practical News‑Site Example

Python Crawling & Data Mining

Nov 6, 2024 · Backend Development

Master Python Web Scraping: Extract JSON Data Efficiently with Real Code

This article walks through extracting JSON data from a web page using Python, showcasing multiple code examples with requests, regex, BeautifulSoup, and json handling, and explains how to simplify storage and avoid common parsing pitfalls for reliable web scraping.

BeautifulSoupJSONrequests

0 likes · 6 min read

Master Python Web Scraping: Extract JSON Data Efficiently with Real Code

21CTO

Oct 28, 2024 · Backend Development

What Are the Top 5 Python Packages on PyPI? Surprising Rankings Revealed

This article reveals the surprising top‑five Python packages on PyPI, explains why popular libraries like NumPy and Pandas are not among them, and provides installation details and key features for each of the leading packages such as boto3, urllib3, botocore, aiobotocore, and Requests.

BackendBoto3PyPI

0 likes · 7 min read

What Are the Top 5 Python Packages on PyPI? Surprising Rankings Revealed

Python Programming Learning Circle

Oct 8, 2024 · Fundamentals

Top 10 Essential Python Packages Every Developer Should Know

This article introduces the ten most essential and widely used Python packages—such as NumPy, Pendulum, Pillow, MoviePy, requests, Tkinter, PyQt, Pandas, Pywin32, and pytest—providing concise descriptions, practical code examples, and guidance on when and why to use each in general programming projects.

Tkinterprogrammingrequests

0 likes · 11 min read

Top 10 Essential Python Packages Every Developer Should Know

Test Development Learning Exchange

Sep 25, 2024 · Backend Development

Creating a Reusable Python HTTP Client with Parent and Child Classes

This tutorial demonstrates how to build a reusable Python HTTP client by defining a base HttpRequest class with standard methods, extending it with a RestApiRequest subclass that adds authentication handling, and provides a complete code example showing GET and POST requests.

HTTPOOPPython

0 likes · 6 min read

Creating a Reusable Python HTTP Client with Parent and Child Classes

Python Programming Learning Circle

Aug 28, 2024 · Backend Development

Python Web Scraper for Downloading Online Comics

This article explains how to build a Python script that searches a comic website, extracts chapter links and image URLs using requests and BeautifulSoup, and downloads the images into organized folders with multithreaded support, while outlining required modules and potential improvements.

BeautifulSoupManga DownloaderPython

0 likes · 8 min read

Python Web Scraper for Downloading Online Comics

Test Development Learning Exchange

Aug 24, 2024 · Backend Development

Master JSON API Testing in Python: 10 Essential Scenarios

This guide walks through ten practical Python examples for parsing, constructing, validating, updating, deleting, and iterating JSON data via HTTP requests, including custom date serialization and schema validation, each demonstrated with complete code and expected outcomes.

API-testingBackendJSON

0 likes · 7 min read

Master JSON API Testing in Python: 10 Essential Scenarios

Test Development Learning Exchange

Aug 22, 2024 · Backend Development

Python Requests Examples for File Upload, Download, and Validation

This article presents a series of Python requests code snippets demonstrating how to upload and download files, compare contents, process CSV and JSON payloads, verify file size, name, MD5 checksum, MIME type, and handle multiple file uploads in typical backend API scenarios.

Backend DevelopmentPythonrequests

0 likes · 7 min read

Python Requests Examples for File Upload, Download, and Validation

Test Development Learning Exchange

Jul 27, 2024 · Backend Development

Using fake_useragent to Generate Random User-Agent Strings for API Automation Testing

This guide explains why random User-Agent headers improve API automation testing, introduces the Python fake_useragent library, shows how to install it, and provides comprehensive example code for generating, validating, and persisting random User-Agent strings.

Automation TestingHTTPPython

0 likes · 5 min read

Using fake_useragent to Generate Random User-Agent Strings for API Automation Testing

Test Development Learning Exchange

Jul 17, 2024 · Backend Development

Sending XML Data with Python requests: Build, Post, and Parse

This tutorial explains how to construct XML data in Python, set the appropriate Content-Type header, send it via a POST request using the requests library, and parse the XML response, providing complete example code for developers working with web APIs.

APIBackendHTTP

0 likes · 5 min read

Sending XML Data with Python requests: Build, Post, and Parse

Python Crawling & Data Mining

Jun 8, 2024 · Backend Development

Why Does My Python Scraper Save Only the Last Page? Fix It Now

This article walks through a common Python web‑scraping issue where data from multiple pages is overwritten, explains the root cause, and provides a complete, runnable script using requests, parsel, and openpyxl to correctly collect and store each page's information.

data-extractionopenpyxlrequests

0 likes · 6 min read

Why Does My Python Scraper Save Only the Last Page? Fix It Now

Test Development Learning Exchange

Jun 3, 2024 · Backend Development

Efficient API Automation Testing Practices with Python

This article presents ten practical strategies for improving efficiency, maintainability, and reusability in Python API automation testing, covering session reuse, parameterization, mocking, exception handling, fixtures, concurrency, data‑driven tests, response validation, conditional execution, and scheduled test runs.

api-testingpytestrequests

0 likes · 8 min read

Efficient API Automation Testing Practices with Python

Python Crawling & Data Mining

May 16, 2024 · Backend Development

How to Build a Python Web Scraper for Eastmoney Data with Real Code

This article walks through a Python web‑scraping solution using requests and pandas to fetch Eastmoney stock data, explains the limitations of AI‑generated code, and provides a complete, runnable script with sample output.

data-analysisrequestsweb-scraping

0 likes · 4 min read

How to Build a Python Web Scraper for Eastmoney Data with Real Code

Python Programming Learning Circle

Apr 11, 2024 · Backend Development

Comprehensive Guide to Downloading Files with Python Using requests, wget, urllib, urllib3, Boto3, asyncio and More

This tutorial explains how to download regular files, web pages, Amazon S3 objects, and other resources in Python by covering multiple modules such as requests, wget, urllib, urllib3, Boto3, and asyncio, and demonstrates handling redirects, large files, parallel downloads, progress bars, proxies, and asynchronous execution.

Boto3ConcurrencyFile Download

0 likes · 8 min read

Comprehensive Guide to Downloading Files with Python Using requests, wget, urllib, urllib3, Boto3, asyncio and More

Test Development Learning Exchange

Apr 7, 2024 · Backend Development

When to Use requests vs grequests: Sync, Threaded, and Async HTTP Calls in Python

This guide compares Python's synchronous requests library with the asynchronous grequests wrapper, showing when to choose each approach and providing clear code examples for single-threaded, multi-threaded, timeout‑controlled, and exception‑handled HTTP requests.

@AsyncConcurrencygrequests

0 likes · 5 min read

When to Use requests vs grequests: Sync, Threaded, and Async HTTP Calls in Python

Liangxu Linux

Mar 25, 2024 · Information Security

How to Use Gzip Compression to Overload Web Crawlers (Gzip Bomb Tutorial)

This guide shows how to create a tiny gzip‑compressed file, serve it with FastAPI, and exploit automatic decompression in Python's requests library to force a crawler to consume massive memory, effectively turning compression into a denial‑of‑service weapon.

CompressionDenial of ServiceFastAPI

0 likes · 7 min read

How to Use Gzip Compression to Overload Web Crawlers (Gzip Bomb Tutorial)

MaGe Linux Operations

Mar 23, 2024 · Backend Development

Master Python Requests: Step-by-Step Web Scraping and Data Saving Guide

This tutorial walks you through installing the Python requests library on Windows and Linux, demonstrates how to perform GET, POST, PUT requests, pass parameters, bypass anti‑scraping measures, and save fetched HTML or images to local files with clear, runnable code examples.

Data SavingHTTPPython

0 likes · 8 min read

Master Python Requests: Step-by-Step Web Scraping and Data Saving Guide

MaGe Linux Operations

Mar 19, 2024 · Backend Development

Master Python Proxies: 5 Essential Tips for Effective Web Scraping

Learn the core concepts of using proxies in Python web scraping, including what proxies are, common types like anonymous and high‑anonymity, how they protect your crawler, practical implementation with the requests library, and an overview of building a proxy pool for scalable data extraction.

CrawlerPythonWeb Scraping

0 likes · 7 min read

Master Python Proxies: 5 Essential Tips for Effective Web Scraping

Python Programming Learning Circle

Mar 11, 2024 · Fundamentals

7 Essential Python Tools to Boost Development Efficiency

This article introduces seven practical Python tools—including Pandas, Selenium, Flask, Scrapy, Requests, Faker, and Pillow—explaining their core features, typical use cases, and providing ready‑to‑run code snippets to help developers automate tasks and accelerate project development.

Fakerpandaspillow

0 likes · 6 min read

7 Essential Python Tools to Boost Development Efficiency

Python Programming Learning Circle

Feb 20, 2024 · Fundamentals

15 Essential Python Packages and Their Uses

This article introduces fifteen widely used Python packages—including Dash, Pygame, Pillow, Colorama, JMESPath, Requests, Simplejson, Emoji, tqdm, IPython, Home Assistant, Flask, and Beautiful Soup—explaining their core features, typical applications, and providing illustrative examples to help developers quickly adopt them in various projects.

DASHbeautiful souppackages

0 likes · 9 min read

15 Essential Python Packages and Their Uses

Test Development Learning Exchange

Feb 19, 2024 · Backend Development

Using Python's json Module for Serialization, Deserialization, and API Testing

This article explains how to use Python's built‑in json module for serializing and deserializing data, demonstrates sending JSON payloads with the requests library, and covers advanced techniques such as data‑driven testing, JsonPath/JMESPath extraction, JSON Schema validation, and dynamic request body construction for API automation.

API-testingPythondeserialization

0 likes · 9 min read

Using Python's json Module for Serialization, Deserialization, and API Testing

Python Programming Learning Circle

Jan 6, 2024 · Fundamentals

Top Downloaded Python Packages on PyPI in the Past Year and Their Uses

This article reviews the most downloaded Python packages on PyPI over the last year, explaining each library's purpose, key features, and example code snippets, while highlighting their popularity and relationships within the Python ecosystem.

AWSpackagesrequests

0 likes · 15 min read

Top Downloaded Python Packages on PyPI in the Past Year and Their Uses

Python Programming Learning Circle

Jan 4, 2024 · Fundamentals

Top 15 Most Downloaded Python Packages on PyPI and Their Uses

This article reviews the fifteen Python packages with the highest download counts on PyPI over the past year, explaining each library's purpose, key features, typical use‑cases, and providing code snippets to illustrate how they are used in real projects.

PyPIPythonYAML

0 likes · 16 min read

Top 15 Most Downloaded Python Packages on PyPI and Their Uses

Test Development Learning Exchange

Jan 1, 2024 · Backend Development

Python API Automation Testing Suite with requests, pytest, and pytest‑html

This guide demonstrates how to build a Python API automation testing suite using requests, pytest, and pytest‑html, covering environment setup, project structure, common utilities, test case implementation, advanced assertions, error handling, test data management, and HTML report generation.

API-testingPythonpytest

0 likes · 9 min read

Python API Automation Testing Suite with requests, pytest, and pytest‑html

Python Crawling & Data Mining

Dec 27, 2023 · Backend Development

How to Scrape ETF Data with Python: Step-by-Step Code and Tips

This article walks through retrieving ETF fund codes and names from Eastmoney using Python's requests and pandas, explains constructing the correct URLs, handling pagination, cleaning the JSON response, and provides complete sample scripts, while also highlighting a simpler solution and recommending a data‑collection platform.

ETFWeb Scrapingdata-extraction

0 likes · 8 min read

How to Scrape ETF Data with Python: Step-by-Step Code and Tips

Test Development Learning Exchange

Dec 21, 2023 · Backend Development

Advanced Requestium Techniques for Python Web Automation and Scraping

This article introduces Requestium, a Python library that merges Selenium and Requests, and provides step‑by‑step examples covering basic session setup, installation, dynamic content handling, user interaction simulation, cookie and header management, asynchronous fetching, iframe switching, alert handling, and screenshot or video recording.

PythonRequestiumWeb Scraping

0 likes · 8 min read

Advanced Requestium Techniques for Python Web Automation and Scraping

Python Programming Learning Circle

Dec 8, 2023 · Backend Development

Python Script for Retrieving Google Search Rankings Using Requests and BeautifulSoup

This article explains how to automate Google SEO keyword rank checking by writing a Python script that sends HTTP requests, parses the search results with BeautifulSoup, iterates through results to find a target domain, and handles errors, providing a free alternative to costly SEO tools.

Google SearchSEOrequests

0 likes · 7 min read

Python Script for Retrieving Google Search Rankings Using Requests and BeautifulSoup

MaGe Linux Operations

Sep 24, 2023 · Cloud Native

Mastering Kubernetes Limits & Requests: Best Practices and Real‑World Examples

This article explains Kubernetes Limits and Requests, their differences, practical deployment examples, CPU and memory characteristics, namespace ResourceQuota and LimitRange policies, and provides best‑practice guidelines to optimize resource allocation, avoid OOM kills, and prevent CPU throttling.

Best PracticesKuberneteslimits

0 likes · 13 min read

Mastering Kubernetes Limits & Requests: Best Practices and Real‑World Examples

Sohu Tech Products

Sep 20, 2023 · Backend Development

Analyzing and Fixing Encoding Issues in Python Requests, Scrapy, and Golang Charset Libraries

The article examines how Python Requests, Scrapy, and Go’s charset package detect page encodings, reveals why they often mis‑decode Chinese GB‑series pages, and proposes a unified strategy—prefer header charset, then HTML meta, finally a reliable heuristic—to eliminate garbled text in web scraping.

PythonWeb Scrapingencoding

0 likes · 8 min read

Analyzing and Fixing Encoding Issues in Python Requests, Scrapy, and Golang Charset Libraries

Test Development Learning Exchange

Jul 24, 2023 · Backend Development

Automating Arithmetic Captcha Solving with Python, Requests, pytesseract, and Selenium

This guide explains how to programmatically download arithmetic captcha images, use OCR to extract and compute the expression, and automatically click the correct image on a website by combining Python requests, pytesseract, and Selenium for web automation.

CAPTCHAOCRPython

0 likes · 8 min read

Automating Arithmetic Captcha Solving with Python, Requests, pytesseract, and Selenium

Python Programming Learning Circle

Jul 5, 2023 · Backend Development

Python Tutorial: Crawling YY Live Videos via API and Saving Locally

This article demonstrates how to use Python's requests library to call the YY live video API, parse the returned JSON for video URLs, download each video file, and store them locally, while also providing a complete reusable script for repeated batch downloads.

Pythonrequestsvideo-download

0 likes · 6 min read

Python Tutorial: Crawling YY Live Videos via API and Saving Locally

Python Crawling & Data Mining

Jul 3, 2023 · Backend Development

How to Fix Common Python Web‑Scraping Issues with Ready‑to‑Use Code

This article walks through a real Python web‑scraping problem, explains why missing request headers cause failures, and provides complete, runnable code snippets—including header setup, cookie handling, and request loops—to retrieve stock data from Xueqiu, followed by a concise summary of the solution.

Web Scrapingdata-extractionrequests

0 likes · 5 min read

How to Fix Common Python Web‑Scraping Issues with Ready‑to‑Use Code

Python Crawling & Data Mining

Jun 13, 2023 · Backend Development

How to Scrape 51Job Listings with Python: A Complete Guide

This article walks through a Python-based web scraper that extracts job listings from 51job.com, detailing required header and cookie settings, pagination logic, data parsing, and CSV output, and includes full code snippets and tips for handling site changes and further data analysis.

Job DataWeb Scrapingdata-extraction

0 likes · 9 min read

How to Scrape 51Job Listings with Python: A Complete Guide

Python Crawling & Data Mining

Jun 7, 2023 · Backend Development

Why Your Python Web Scraper Fails and How to Fix It with Correct Headers

This article walks through a common Python web‑scraping issue where missing request parameters cause failures, demonstrates how to add the necessary headers—including User‑Agent and Origin—and provides complete, runnable code snippets that retrieve the expected data from the 10086 shop API.

APIHTTP headersWeb Scraping

0 likes · 6 min read

Why Your Python Web Scraper Fails and How to Fix It with Correct Headers

Test Development Learning Exchange

Jun 3, 2023 · Fundamentals

Python Libraries and Frameworks: Practical Applications and Projects

This article introduces ten essential Python libraries and frameworks, providing practical examples and code implementations for each to help readers understand and master their applications in various domains.

Data AnalysisFlaskNumPy

0 likes · 12 min read

Python Libraries and Frameworks: Practical Applications and Projects

Test Development Learning Exchange

May 23, 2023 · Backend Development

Automated Testing of WeChat Mini Program APIs with Python, Requests, and Beautiful Report

This guide explains how to use Python3, the Requests library, and Beautiful Report to perform automated API testing for WeChat Mini Programs, covering prerequisite knowledge, obtaining an access token, writing test cases, and generating detailed HTML test reports.

BeautifulReportPythonWeChat Mini Program

0 likes · 5 min read

Automated Testing of WeChat Mini Program APIs with Python, Requests, and Beautiful Report

Python Programming Learning Circle

May 22, 2023 · Fundamentals

Top 15 Most Downloaded Python Packages on PyPI and Their Uses

This article reviews the fifteen Python packages with the highest download counts on PyPI over the past year, explaining each library's purpose, key features, typical use‑cases, and providing code examples to illustrate how they simplify tasks such as HTTP requests, compatibility, cloud interaction, configuration, security, and data handling.

PyPIPythoncloud

0 likes · 15 min read

Python Crawling & Data Mining

May 1, 2023 · Backend Development

Scrape Shandong Government Data with Python: Full Code Walkthrough

This article walks through a real‑world Python web‑scraping case, showing how to retrieve disease‑pest data from the Shandong government site using custom headers, cookies, and request parameters, and provides two complete code examples that successfully return the desired JSON results.

Backend DevelopmentWeb Scrapingdata-extraction

0 likes · 6 min read

Scrape Shandong Government Data with Python: Full Code Walkthrough

Python Programming Learning Circle

Apr 18, 2023 · Fundamentals

Top Downloaded Python Packages on PyPI and Their Uses

This article lists the most downloaded Python packages on PyPI over the past year, explains each library’s main features, typical use cases, and why they are popular, and includes code snippets demonstrating common operations such as HTTP requests, date parsing, and RSA encryption.

PyPIPythonpip

0 likes · 15 min read

Top Downloaded Python Packages on PyPI and Their Uses

Python Crawling & Data Mining

Apr 14, 2023 · Backend Development

How to Download Audio Files with Python Web Scraping: Step-by-Step Guide

This article walks through a Python web‑scraping solution for extracting and downloading audio files from a WeChat page, explains the problem, shows the implementation steps with screenshots, and provides the complete, ready‑to‑run code.

Audio DownloadCrawlerWeb Scraping

0 likes · 5 min read

How to Download Audio Files with Python Web Scraping: Step-by-Step Guide

System Architect Go

Mar 31, 2023 · Cloud Native

Understanding CPU Requests and Limits in Kubernetes

This article explains how Kubernetes uses CPU requests and limits to schedule pods, allocate CPU proportionally, calculate minimal request units, and provides practical guidelines for setting appropriate request and limit values based on workload characteristics and monitoring data.

Kuberneteslimitsrequests

0 likes · 6 min read

Understanding CPU Requests and Limits in Kubernetes

Python Programming Learning Circle

Mar 23, 2023 · Backend Development

Python Script for Parsing and Downloading Tencent Video URLs

This article explains how to use a Python program to parse Tencent video URLs, retrieve the cached TS segments via HTTP requests, download them concurrently with multiprocessing, and finally merge the segments into a playable MP4 file, including environment setup and full source code.

multiprocessingrequeststs-to-mp4

0 likes · 8 min read

Python Script for Parsing and Downloading Tencent Video URLs

Python Crawling & Data Mining

Mar 17, 2023 · Backend Development

Build a Python Stock Data Scraper with Requests and Pandas

This article walks through building a Python web scraper that fetches stock trading data using the requests library and pandas, showing the complete code, how to set headers and cookies, and the resulting DataFrame, while highlighting the limits of relying solely on ChatGPT‑generated snippets.

APIWeb Scrapingdata-extraction

0 likes · 4 min read

Build a Python Stock Data Scraper with Requests and Pandas

Python Programming Learning Circle

Mar 13, 2023 · Fundamentals

Downloading Files in Python Using requests, wget, urllib, boto3, and asyncio

This tutorial demonstrates multiple Python techniques for downloading files—including simple requests.get calls, wget and urllib modules, handling redirects and large files with chunked streaming, parallel batch downloads, progress bars, proxy support, S3 retrieval via boto3, and asynchronous downloads with asyncio—providing a comprehensive guide for developers.

Boto3File Downloadasyncio

0 likes · 8 min read

Downloading Files in Python Using requests, wget, urllib, boto3, and asyncio

Python Crawling & Data Mining

Oct 13, 2022 · Backend Development

How to Fix Common Regex Errors in Python Web Scraping: A Step-by-Step Guide

This article walks through a Python web‑scraping example that fetches Douban's Top 250 movies, identifies problems with the regular‑expression pattern, shows the corrected regex, and provides the complete, runnable code to extract movie titles, directors, and years.

regexrequests

0 likes · 4 min read

How to Fix Common Regex Errors in Python Web Scraping: A Step-by-Step Guide

Python Programming Learning Circle

Oct 12, 2022 · Backend Development

Comprehensive Guide to Downloading Files in Python Using Requests, wget, urllib, urllib3, Boto3, and asyncio

This tutorial walks through multiple Python approaches for downloading files—including simple requests.get calls, the wget module, handling redirects, chunked large‑file downloads, parallel batch downloads, proxy usage with urllib, S3 retrieval via Boto3, and asynchronous fetching with asyncio—providing code examples and best‑practice tips.

BackendBoto3File Download

0 likes · 8 min read

Comprehensive Guide to Downloading Files in Python Using Requests, wget, urllib, urllib3, Boto3, and asyncio

Python Crawling & Data Mining

Sep 13, 2022 · Backend Development

Fix Chinese Character Garbling in Python Web Scraping: Simple Encoding Hacks

This article explains why Chinese characters become garbled during Python web scraping, demonstrates the problematic code, and provides clear encoding adjustments and alternative solutions to reliably extract readable text.

Chinese charactersParselencoding

0 likes · 4 min read

Fix Chinese Character Garbling in Python Web Scraping: Simple Encoding Hacks

Python Crawling & Data Mining

Sep 7, 2022 · Backend Development

Fixing XPath Errors in Python Web Scraping: A Step-by-Step Guide

This article walks through diagnosing and fixing an XPath extraction issue in a Python web scraper, showing the original faulty code, the corrected selector, and the final working script with sample outputs, while emphasizing best practices like setting request headers.

Backend DevelopmentXPathlxml

0 likes · 4 min read

Fixing XPath Errors in Python Web Scraping: A Step-by-Step Guide

php Courses

Sep 6, 2022 · Backend Development

Using Residential Proxy IPs for Unrestricted Web Scraping with Python

This guide explains what residential proxy IPs are, their advantages, how to obtain them from services like IPIDEA, and provides step‑by‑step Python code examples for integrating proxies into web‑scraping tasks such as extracting Amazon product data.

APIProxyPython

0 likes · 11 min read

Using Residential Proxy IPs for Unrestricted Web Scraping with Python

Python Crawling & Data Mining

Aug 30, 2022 · Fundamentals

How to Clean and Extract Product Prices with Python Web Scraping (XPath Tips)

This article walks through a Python web‑scraping problem where price data extracted via XPath contains empty lines and unwanted characters, presenting multiple code solutions—including list comprehensions, map‑filter, and conditional printing—to clean and correctly display the product prices.

XPathlxmlrequests

0 likes · 6 min read

How to Clean and Extract Product Prices with Python Web Scraping (XPath Tips)

Python Crawling & Data Mining

Aug 24, 2022 · Backend Development

Why Your Python Web Crawler Returns Wrong Data and How to Fix It

This article examines a Python web‑crawler issue where the original script returns incorrect results, explains the underlying cause related to mutable data handling, and provides a corrected version of the code that successfully retrieves the desired price data from the Xinfadi website.

data scrapingmutable objectsrequests

0 likes · 6 min read

Why Your Python Web Crawler Returns Wrong Data and How to Fix It

Python Programming Learning Circle

Aug 17, 2022 · Backend Development

Python Script to Scrape and Download Images from Divnil.com

This article explains how to use Python's requests and BeautifulSoup libraries to crawl Divnil.com, extract image detail page URLs, parse each page for high‑resolution image links, and download the images into a local folder with a complete, runnable script.

BeautifulSoupPythonWeb Scraping

0 likes · 7 min read

Python Script to Scrape and Download Images from Divnil.com

Python Crawling & Data Mining

Aug 7, 2022 · Backend Development

Generate Python Web Scraper Code Instantly with an Online Tool

This article walks through using the free online tool spidertools.cn to automatically convert captured HTTP requests into ready‑to‑run Python requests code for web scraping, showing step‑by‑step screenshots and explaining how the method works for common GET and POST scenarios.

Crawlerautomationrequests

0 likes · 3 min read

Generate Python Web Scraper Code Instantly with an Online Tool

Python Crawling & Data Mining

May 24, 2022 · Backend Development

Build a Python Web Scraper that Emails Daily Articles Automatically

This tutorial shows how to create a Python web scraper that fetches a daily article, formats it, and sends it via email using SMTP, including the full source code and step‑by‑step implementation details.

SMTPemail automationlxml

0 likes · 6 min read

Build a Python Web Scraper that Emails Daily Articles Automatically