Author

Python Crawling & Data Mining

Life's short, I code in Python. This channel shares Python web crawling, data mining, analysis, processing, visualization, automated testing, DevOps, big data, AI, cloud computing, machine learning tools, resources, news, technical articles, tutorial videos and learning materials. Join us!

1.5k

Articles

Likes

506

Views

Comments

Latest from Python Crawling & Data Mining

100 recent articles max

Python Crawling & Data Mining

Jul 11, 2025 · Fundamentals

How to Generate All 3‑Item Combinations in Python Using itertools and List Comprehensions

This article explains a fan's request for a Python solution to a combinatorial problem, demonstrates three different implementations—including itertools.combinations, a custom index‑based method, and a list‑comprehension approach—and compares their outputs, concluding with a recommendation for the most efficient technique.

code examplescombinationscombinatorics

0 likes · 5 min read

How to Generate All 3‑Item Combinations in Python Using itertools and List Comprehensions

Python Crawling & Data Mining

Jul 10, 2025 · Backend Development

How to Master Web Scraping with Playwright: A Step‑by‑Step Python Guide

This article walks you through using Playwright in Python to scrape the Xinfadi market website, showing how to capture URLs, handle request payloads, extract JSON data, and process results with a complete, runnable code example.

AutomationData ExtractionPlaywright

0 likes · 7 min read

How to Master Web Scraping with Playwright: A Step‑by‑Step Python Guide

Python Crawling & Data Mining

Jul 9, 2025 · Backend Development

How to Batch Rename Files in Python Using Regex – A Step-by-Step Guide

This article walks through a Python file‑processing challenge, explains the logic behind selective batch renaming using regular expressions, provides a complete script, and demonstrates the solution with clear code and illustrative screenshots for practical automation.

AutomationBatch ProcessingFile Renaming

0 likes · 4 min read

How to Batch Rename Files in Python Using Regex – A Step-by-Step Guide

Python Crawling & Data Mining

Jul 3, 2025 · Operations

Automate Deleting Massive Windows Files and Bypass Long Path Limits with Python

This article explains how to use Python's built‑in functions and the os.walk method to automatically locate and delete files or directories belonging to specific subsystems, while also addressing Windows' long‑path limitation by prefixing paths with the special "\\?\" syntax.

file-managementlong pathos.walk

0 likes · 11 min read

Automate Deleting Massive Windows Files and Bypass Long Path Limits with Python

Python Crawling & Data Mining

Jul 2, 2025 · Fundamentals

Why Python’s Boolean Is Actually an Integer: Deep Dive into Type Mechanics

A Python community discussion reveals that the bool type is a subclass of int, explaining the relationship between True/False and 1/0, the differences in object identity, the use of __base__, and the distinction between the is and == operators, all backed by code examples and screenshots.

Programming FundamentalsPythonbool

0 likes · 4 min read

Why Python’s Boolean Is Actually an Integer: Deep Dive into Type Mechanics

Python Crawling & Data Mining

Jun 26, 2025 · Fundamentals

How to Quickly Convert Pandas Timestamps to Date Strings – A Simple Guide

In this brief tutorial, the author shares a straightforward Pandas solution for converting timestamp strings like '06/27/2022 12:00' into 'YYYY‑MM‑DD' format, complete with sample code, screenshots, and an invitation to join a Python learning community for further support.

data processingtutorial

0 likes · 3 min read

How to Quickly Convert Pandas Timestamps to Date Strings – A Simple Guide

Python Crawling & Data Mining

Jun 25, 2025 · Fundamentals

How to Fix Chinese Garbled Text in Jupyter and VS Code: Simple Encoding Tricks

This article explains why Chinese characters appear as garbled text in Jupyter notebooks and VS Code, demonstrates the issue with screenshots, evaluates several Python code fixes, and ultimately provides a reliable solution by setting the console code page to UTF‑8.

Chinese charactersJupyterPython

0 likes · 4 min read

How to Fix Chinese Garbled Text in Jupyter and VS Code: Simple Encoding Tricks

Python Crawling & Data Mining

Jun 24, 2025 · Fundamentals

How to Debug Python Function Arguments: A Step‑by‑Step Walkthrough

This article walks through a Python function‑argument issue, explains how default parameters work, shows the code breakdown with visual diagrams, and demonstrates how to use Python Tutor to visualize execution, helping readers solve similar problems and deepen their understanding of Python functions.

Function ArgumentsPythonPython Tutor

0 likes · 3 min read

How to Debug Python Function Arguments: A Step‑by‑Step Walkthrough

Python Crawling & Data Mining

Jun 21, 2025 · Fundamentals

How to Fix Pyecharts Map Visualization Errors in Python: A Step‑by‑Step Guide

This article walks through a follower's Pyecharts map visualization problem, explains why the original code failed, and provides a corrected Python script that successfully renders COVID‑19 data maps, complete with screenshots and full code examples.

COVID-19Data VisualizationPyecharts

0 likes · 8 min read

How to Fix Pyecharts Map Visualization Errors in Python: A Step‑by‑Step Guide

Python Crawling & Data Mining

Jun 20, 2025 · Fundamentals

7 Creative Ways to Clean Up Strings in a Python List

This article explores a Python list string‑replacement problem and demonstrates seven distinct solutions—including simple replace loops, set‑based approaches, regular expressions, and comprehension techniques—providing clear code examples and results for each method.

code-exampleslist-processingset-comprehension

0 likes · 8 min read

7 Creative Ways to Clean Up Strings in a Python List