This tutorial walks you through extracting image URLs from a webpage using XPath, constructing full URLs, and automating batch downloads with Python's requests, lxml, and fake_useragent libraries, including code snippets and practical tips for handling files and headers.
An experienced Python engineer shares three indispensable tools—Kite for AI‑powered code completion, Mypy for static type checking, and SonarLint for real‑time linting—explaining their benefits, usage examples, and how they improve coding speed, reliability, and error detection.
This guide demonstrates how to programmatically pull date, title, and document number fields from thousands of similarly structured Word tables, normalize the dates, and export the data into a formatted Excel spreadsheet using Python's docx, datetime, and openpyxl libraries.
On April 20, 2020, the Python core team released Python 2.7.18, the last official version of Python 2, concluding a two‑decade release history that began with Python 2.0 in 2000 and marking the end of maintenance for the legacy language.
This article provides a comprehensive step‑by‑step guide to installing Scrapy, understanding its core components and processing flow, creating a weather‑data crawling project, writing items, settings, middlewares, spiders, running the crawler, exporting results, and storing the scraped data into MongoDB.
This article explains the two key properties of recursive functions, demonstrates Python's default recursion depth limit and how to adjust it, discusses the drawbacks of recursion, and presents a programming task to implement a recursive Fibonacci‑triangle generator with sample code.
This tutorial demonstrates how to read an Excel file with pandas, convert an 8‑digit birthdate column to datetime, calculate age, and then use groupby to produce aggregated statistics by age and gender, including combined summaries for all students and females only.
This article introduces Python's core concepts and hierarchy, highlights ten frequent beginner mistakes, and walks through building a basic web scraper that extracts book information from Douban, processes it with pandas, and displays the resulting data, providing a practical learning path for Python fundamentals.
This article explains how to implement a priority queue in Python using the built‑in heapq module, demonstrates extracting smallest and largest elements from price lists, and provides a full PriorityQueue class with push, pop, and is_empty methods, illustrated with stock portfolio examples.
This guide explains how to configure an Android project, write Python scripts for uploading APKs to Fir.im and Pgyer, create a Jenkinsfile with checkout, build, and upload stages, and set up Jenkins global variables and pipeline parameters for automated CI/CD deployment.
This tutorial walks you through creating a desktop Python chatbot using the Turing API, covering required libraries, authentication, code implementation for both basic and Selenium‑enhanced versions, and packaging the final program into an executable.
This tutorial walks through multiple Python approaches for downloading files—including simple requests and wget calls, handling redirects, large and multi‑file downloads, proxy usage, urllib/urllib3 methods, and asynchronous techniques—providing complete code snippets and practical tips for each scenario.
This tutorial shows how to fetch restaurant review data from online platforms, clean and structure it in Python, and then use pyecharts along with Python's Counter to create bar and pie visualizations that reveal overall impressions and star‑rating distributions.
This guide walks you through using Python to crawl proxy server data, extract city names with the cpca library, count occurrences per city, and create an interactive heat‑map of nationwide proxy distribution using the Pyecharts visualization toolkit.
This article compiles essential readings on Python programming, covering functional programming, performance optimization, testing practices, and coding standards to help developers become proficient and write high‑quality, maintainable code.
After months of trial and error, I share my step‑by‑step journey of creating a Python web scraper that collects Zhihu and Weibo hot‑list data, exposing it via a Django REST API, and integrating the results into a functional WeChat mini‑program, while outlining the challenges and future improvements.
This tutorial walks through analyzing a proxy‑listing website’s structure, building a Python scraper using requests, Scrapy, regular expressions and BeautifulSoup, extracting IP, port, location and type fields across multiple pages, and saving the collected data to files, illustrating key web‑crawling techniques.
This article explains Python's variable scope rules, demonstrates how local variables shadow globals, and shows how the global keyword enables functions to modify global variables, illustrated with clear examples and visual results.
This tutorial explains how to overcome common anti‑scraping defenses of a proxy‑listing website by capturing legitimate HTTP headers with Fiddler, configuring the Python requests library, and building a dynamic proxy pool to keep your crawler running smoothly.
Learn how to create a practical employee smart‑check‑in tool with just 12 lines of Python code by capturing mobile MAC addresses via a USB Wi‑Fi adapter, using scapy and pandas on Ubuntu, and automatically logging attendance without expensive hardware.
This article explains how the Mars framework enables parallel and distributed execution of core Python data‑science libraries—Numpy, Pandas, and Scikit‑Learn—while integrating with RAPIDS for GPU acceleration, and demonstrates its performance advantages through code examples and benchmark results.
This article walks through the complete engineering workflow for building an image‑search system, covering CNN‑based feature extraction with VGG16, vector normalization, image preprocessing, black‑edge removal, and practical deployment of the Milvus vector database including hardware requirements, capacity planning, collection/partition design, and search result handling.
This article benchmarks several Linux techniques—including rm, find, rsync, Python, and Perl—for deleting 500,000 small files, measuring execution times and revealing that rsync with the --delete option completes the task in under 20 seconds, far outpacing traditional commands.
This article explains why iterating over Pandas DataFrames with iterrows() is slow, demonstrates the performance gain of using itertuples()—often over a hundred times faster—and provides a simple example to help Python data‑analysis practitioners write more efficient code.
This tutorial walks you through creating a web‑based employee management system that demonstrates MongoDB CRUD operations using Python, Flask, and Pipenv, covering project setup, environment configuration, code implementation for querying, adding, updating, and soft‑deleting records, and how to run the application.
This article completes a FastAPI series by detailing middleware usage, request redirection, trusted host and CORS settings, background task handling, custom HTTP status responses, and multiple deployment options—including Uvicorn, Gunicorn, Docker, and Nginx—accompanied by full code examples.
This article explains how to create a JetBrains IntelliJ plugin that parses MySQL DDL statements, performs lexical analysis to extract table and column information, and automatically generates corresponding Python ORM model classes, illustrating the underlying state‑machine lexer, recursive parsing logic, and sample code.
This article explains why Python dictionary keys with numeric values can overwrite each other, how a return statement inside a try block is overridden by a return in a finally block, and why object identity (is) and hash values behave as they do, illustrating each point with code examples.
This article demonstrates how to create a custom Python SDK for Pinduoduo's order-related APIs, covering request signing, parameter assembly, URL encoding, and example calls to retrieve order lists, details, status, and incremental updates, complete with sample code and usage screenshots.
This tutorial explains how to install PyMongo, connect to local or remote MongoDB instances, choose databases and collections, and perform all common CRUD operations—including inserts, queries, updates, deletions, and special cases—using Python code examples and practical tips.
This article examines the severe time‑critical pain points of bank database operations, explains why AI‑based intelligent ops are needed, describes the platform architecture, unsupervised algorithms (3σ, Isolation Forest, DBSCAN, Pearson, Apriori), and presents a real‑world case study that demonstrates anomaly detection, root‑cause analysis, and practical optimization recommendations.
DeepMatch is an open‑source Python library that implements several mainstream deep‑learning based recall‑matching algorithms, provides easy installation via pip, detailed usage examples with code, and supports exporting user and item vectors for ANN search, making it ideal for rapid experimentation and learning in recommendation systems.
This article explains the fundamentals of Python class inheritance, covering five typical ways to use parent class attributes and methods—including direct calls, super() for private members, method overriding, invoking __init__, and passing initialization parameters—accompanied by clear code examples.
This article demonstrates how to import Bitcoin price data, preprocess it, and use Matplotlib's fill_between, bar, and FuncAnimation functions to generate static and animated area charts, including code snippets, parameter explanations, and tips for exporting the animation as GIF or MP4.
This tutorial walks through using Python to fetch QQ Music song rankings, lyrics, and hot comments, then iterates through comment pages to collect data and generate a word‑cloud visualization, illustrating the required libraries, code snippets, and key parameters.
This article surveys the preferences of Tencent engineers on Python IDEs, discussing how personal habits, project requirements, and specific use‑cases such as data science, web development, or lightweight editing influence the choice among tools like Notebook, Spyder, PyCharm, VS Code, Vim, and the built‑in IDLE.
Learn how to set up Zabbix HTTP agent monitoring for weather data, create dependent items with JSON preprocessing, automate batch addition for multiple cities using Python, and visualize alerts on a dynamic map with custom triggers and graphics.
This article demonstrates how to use Python's pandas library to read CSV and XLS files, filter and merge data based on group assignments, compute derived columns, and export the results to a new Excel workbook, providing a complete automation workflow for Excel data processing.
This article introduces Python's advanced features—list comprehensions, dictionary and set comprehensions, iterators, and generators—explaining their syntax, providing interview‑style examples, and showing how they improve code readability, efficiency, and memory usage.
This article benchmarks several Linux methods for deleting half a million small files—including rm, find with -exec, find with -delete, rsync, Python, and Perl—showing their execution times and concluding that rsync with the --delete option is the quickest and most convenient solution.
This tutorial explains how to install Supervisor on CentOS and Ubuntu, configure its main and program-specific files, and use it to monitor a continuously running Python script, automatically restarting the script if it crashes or is killed.
This tutorial demonstrates how to build a vivid fireworks simulation in Python using Pygame, covering module imports, window setup, color configuration, a Fireworks class definition, particle dynamics, and the main game loop for rendering and animation.
This guide walks you through using Python's requests library to scrape QQ Music, showing how to retrieve a song’s ID, fetch its lyrics, and extract the top comments, complete with code snippets and step‑by‑step explanations.
The article explains Facebook's Configurator system, which treats configuration as code, uses Thrift schemas and Python scripts, provides version control, validation, automated canary testing, UI editing, and a robust distribution pipeline to prevent configuration errors across large‑scale services.
This article explains why nohup cannot monitor scripts, introduces Supervisor as a Python‑based process monitor, shows how to install it on CentOS, Ubuntu, and via pip, details the supervisord.conf and program .ini configurations, demonstrates a sample Python script, and outlines common commands for managing and restarting services.
This article explains four Python techniques—os.system, os.popen, the commands module, and subprocess—for running shell commands, comparing their ability to capture output, return status, and recommending subprocess as the most flexible modern solution.
This tutorial walks you through two reliable methods for installing Python 3.7 on Ubuntu 18.04 LTS—using the deadsnakes PPA with APT and compiling from source—detailing prerequisite packages, exact commands, expected output, and verification steps.
Learn to retrieve song titles, album names, and playback links from QQ Music’s artist ranking pages using Python’s requests library, parse JSON responses from XHR calls, and store results in Excel, with a complete walkthrough from setup to final summary.
This guide walks you through three common problems encountered when using Python's docx‑mailmerge library to batch‑create work‑return certificates, offering step‑by‑step solutions such as installing the correct package, resolving name conflicts, and correctly placing template files.
This tutorial walks through deploying FastAPI in production, covering router inclusion as blueprints, handling multiple HTTP methods, integrating SQLAlchemy for database operations, applying Pydantic data validation, and implementing robust exception handling for a reliable backend service.
This guide explains how to use Zabbix's auto‑discovery feature to automatically find Redis instances on a server, create shell or Python scripts for port detection, configure Zabbix agent keys, set up server‑side templates, discovery rules, item prototypes, graphs, and triggers, and finally apply the template to monitored hosts.
This article explains the concept of loss functions and gradient descent, illustrates how to find the global optimum for linear regression, discusses the role of learning rate, and provides a complete Python example that generates data, applies gradient descent, and visualizes the results.
This article explains various methods to protect Python source code—including distributing compiled .pyc files, applying code obfuscation, packaging with py2exe, and compiling with Cython—detailing their concepts, implementation steps, advantages, and limitations.
This article introduces FastAPI, a modern high‑performance Python web framework, walks through installation, basic routing, async handling, query and path parameters, data modeling with Pydantic, template rendering with Jinja2, and compares its speed to Flask, providing complete code examples and screenshots.
This article explains how to hide real intentions behind visible actions by using text obfuscation and custom Base64‑like encoding to defeat standard web scrapers, detailing the underlying principles, decoding challenges, and Python implementations of a flexible Custom64 encoder.
This article explains the concepts, differences, and practical Python implementations of the Factory Method, Abstract Factory, and Builder design patterns, highlighting when to use each, their advantages, and providing clear code examples.
This article presents a complete Python implementation for generating captcha images, loading and preprocessing data, defining a three‑layer convolutional neural network, and training and evaluating the model with TensorBoard, achieving over 99% training accuracy and 93% test accuracy.
This comprehensive Matplotlib tutorial walks you through installing the library, importing pyplot, creating basic and advanced plot types—including line, contour, histogram, bar, and stream plots—customizing fonts, axes, and labels, saving figures, and using subplots to compose multi‑panel visualizations, all with clear code examples.
This tutorial walks through configuring GitHub Actions for a Python project to enforce code style, run unit tests, and generate coverage reports using CodeFactor, the wemake‑python‑styleguide action, and Codecov, complete with step‑by‑step instructions and workflow examples.
This article presents a curated list of technical resources covering Java, Groovy, and Python, including tutorials on concurrency, memory management, regular expressions, scripting, and performance optimization, each linked to detailed explanations and code examples.
This tutorial shows how to generate a simple image‑based CAPTCHA using Python's Pillow library and the Sanic web framework, store the code in a session, and validate user input, with notes on adding asynchronous refresh functionality.
This article demonstrates how to use Python 3 TCP sockets to send an image file from one computer to another, detailing the sender and receiver scripts, the required struct packing, file handling, and network considerations for successful transmission.
Zucker is an open‑source Android utility that automatically analyzes APK module sizes by cloning projects, calculating unique AAR dependencies, simulating target AARs, and providing detailed reports to help developers reduce app bloat early in the development cycle.
This guide walks through the challenges of accessing Weibo comment data, demonstrates how to locate and bypass API restrictions using the mobile site, and provides step‑by‑step Python code for fetching, cleaning, de‑duplicating, and scheduling comment extraction into text files.
This article explains what Python decorators are, describes their four types—function decorating function, function decorating class, class decorating function, and class decorating class—illustrates each with diagrams, and provides a practical example that dynamically passes test case names to a function via a decorator.
This article explains Python tuples as immutable ordered collections, covering their creation, indexing (including negative indices), slicing with optional stride, concatenation and replication operators, and useful built‑in functions such as len, max, and min, while contrasting tuples with lists.
This article presents ten essential Python concepts—from language features and copy semantics to inheritance, multithreading, monkey‑patching, argument handling, special methods, ternary expressions, and memory management—providing clear explanations and code examples for each.
An analysis of Indeed's 2014‑2019 US job data reveals that SQL, Java, and Python dominate employer demand, while AWS shows explosive growth, highlighting shifting trends in programming languages, cloud services, and data‑science‑related roles across the tech job market.
This curated collection presents dozens of Chinese-language articles covering Java, Groovy, and Python topics such as concurrency, performance optimization, regular expressions, JMeter scripting, and algorithmic challenges, providing links to in-depth tutorials and code examples for developers seeking to deepen their programming expertise.
This article reveals practical tricks for dramatically improving Kaggle competition metrics—such as multi‑class F1 and Spearman correlation—by applying weight scaling, non‑linear threshold optimization, and custom rounding techniques, complete with Python code examples and step‑by‑step guidance.
The article explains how unordered Python dictionaries cause inconsistent MD5 signatures when assembling JSON payloads for an ERP API, and demonstrates using collections.OrderedDict together with json.dumps separators to produce a stable, correctly signed request.
This tutorial explains how to create Django view functions for user registration and login, covering request handling, rendering templates, database interactions, and URL routing, with complete Python code examples and guidance on using the render function and request methods.
This comprehensive guide walks you through importing Matplotlib, creating basic charts like line, scatter, and histograms, customizing plot elements, legends, color maps, arranging subplots, generating 3D visualizations, and applying these techniques to a Pokémon dataset, all with ready-to-use code snippets for Python developers.
This guide explains how to define Django model classes, map them to database tables, and use the makemigrations and migrate commands to generate and apply migrations, illustrated with Users and Files examples and the resulting SQL schema.
This tutorial walks through preparing the development environment, creating a Django project and app in PyCharm, configuring MySQL, adjusting Django's MySQL backend, setting up URL routing, and establishing a folder for file uploads, all illustrated with step‑by‑step screenshots.
This article demonstrates how to enhance Selenium web‑scraping scripts by using JavaScript to directly modify date picker values and to automatically scroll dynamic pages, providing concise code examples that overcome common challenges when crawling sites like 12306 and Tencent Video.
This comprehensive guide walks you through Python fundamentals, covering its philosophy, installation, basic syntax, comments, operators, data types, variable naming, control structures, loops, functions, and module usage, providing clear examples and practical tips for quick reference.
The article details how a low‑cost, compact face‑recognition lock for an escape‑room game was built using a Raspberry Pi, camera, ultrasonic sensor, relay‑controlled electromagnetic lock, and Tencent Cloud’s Face Recognition API, with about 200 lines of Python code handling parallel sensor monitoring, video streaming, watermark overlay, and cloud authentication.
This article explores the internal call chain of the Python Requests library, explains how the timeout argument is propagated through urllib3’s pool manager and HTTPConnection objects, and shows the relevant source code that makes socket-level timeouts work for HTTP requests.
Learn how to use Python's zipfile module to inspect ZIP archives, extract their contents, and create new compressed files, with clear code examples demonstrating reading file info, extracting all files, and adding files in write or append mode.
This tutorial explains how to obtain free proxy IPs, extract their addresses using Python's requests and BeautifulSoup, and continuously validate them to overcome anti‑scraping restrictions when crawling sites such as Baidu Baike for data mining tasks.
This article explains four practical ways the underscore (_) is used in Python—retrieving the last expression result, discarding unwanted values, marking private module members, and improving readability of large numeric literals—with clear code examples.
This article introduces HttpRunner 2.0.1 for API automation, explains the environment setup, project structure, essential CLI commands and Python integration, and shares solutions to frequent problems such as timestamp handling, variable overriding, extraction, and execution repeats, along with useful tips for efficient test layering.
This article explains the principles of event‑driven programming, compares traditional linear execution with event‑driven models, and details various I/O models—including blocking, non‑blocking, multiplexing, signal‑driven, and asynchronous—providing Python code examples and discussing their advantages and use cases.
This article explains three frequent Python pitfalls—using mutable objects as default arguments, unintentionally sharing class variables, and writing incorrect exception clauses—illustrates the problematic behavior with code examples, and provides the proper patterns to avoid each issue.
This tutorial explains how to detect hidden Wi‑Fi networks by capturing router signals with airodump-ng, analyzing them with Python's Scapy library on Ubuntu, and extracting the SSID when a client connects, providing step‑by‑step instructions and essential tools.
This article explains how to create a parameterized Python decorator that can be applied to any function, measures its execution duration using the time module, and prints the function name along with whether it ran within a specified number of seconds, complete with full code examples.
This article explains how to use Python's urllib2 library for web scraping, covering basic page fetching, proxy configuration, cookie handling, form submission, header manipulation, anti‑hotlink techniques, and advanced methods like Selenium to bypass restrictions.
This article demonstrates how to use Python's requests and regular‑expression libraries to crawl Taobao product listings, extract product titles and prices, handle pagination, and store the results, providing complete sample code for each step.
This article provides a comprehensive guide to Python's file handling capabilities, covering built‑in functions, the csv module, numpy's load and save methods, pandas' extensive read/write utilities, Excel libraries such as xlrd and openpyxl, and popular database connectors like pymysql and sqlalchemy.
This article shows how to determine whether two strings contain the same set of characters in Python, presenting two approaches—using set comparison and the all() function with length checks—and provides complete code examples for each method.
This article introduces Appium, an open‑source cross‑platform mobile automation tool, and provides a step‑by‑step guide to set up the Android development environment, install the Appium server (both CLI and desktop), and configure Python with the Appium‑Python client, including necessary code snippets.
This tutorial walks you through creating a fully functional Rock‑Paper‑Scissors desktop game using PyQt5, covering window setup, grid layout, widget placement, signal‑slot connections, random image selection, score tracking, and graceful exit handling, all illustrated with screenshots.
This article demonstrates how to use Python and the python‑docx library to read student scores from CSV files, generate appropriate evaluation comments, and programmatically insert those comments into each student's Word report, streamlining the grading workflow.
This article introduces twenty frequently used Python libraries—including Requests, Scrapy, NumPy, matplotlib, and IPython—along with a curated list of system‑administration tools such as psutil, paramiko, Ansible, and SaltStack, explaining their core features and typical use cases.
This article explains how to use Python to crawl hotel information and reviews near major Chinese universities, process the data, handle common pitfalls, and draw insights about hotel distribution and rating patterns within a 2‑kilometer radius.
This article outlines the historical development of Python, explains why Python 2 reached end‑of‑life in 2020, and details the major syntactic and functional differences between Python 2 and Python 3, including encoding defaults, exception handling, range functions, print statements, and input behavior, concluding with guidance on choosing a version.
Learn how to use Python’s built‑in random module and NumPy’s random functions to generate various types of random numbers—including floats, integers, ranges, selections, shuffling, and sampling—while understanding seeds, pseudo‑randomness, and practical code examples for each method.
Backpressure, the resistance to data flow in overloaded systems, is crucial for reliable asynchronous programming; this article explains its concepts, illustrates pitfalls in Python asyncio and other languages, and presents strategies such as buffering, draining, semaphores, and protocol-level flow control to manage overload.
This tutorial explains how to use Python's turtle graphics and the random module to draw a 3×3 magic square, covering functions for drawing squares, filling colors, displaying numbers, and a brute‑force algorithm that shuffles numbers until the magic‑square condition is met.
