Tagged articles
78 articles
Page 1 of 1
macrozheng
macrozheng
Jun 10, 2025 · Backend Development

Simplify Java Stream Processing with JDFrame: A Semantic DataFrame API

This article introduces JDFrame/SDFrame, a JVM‑level DataFrame‑style library that provides semantic, chainable APIs for Java 8 streams, covering quick start, dependency setup, example use cases, and detailed API categories such as matrix view, filtering, aggregation, distinct, grouping, sorting, joining, slicing, parameter settings, percentage conversion, partitioning, row‑number generation, and data replenishment, all illustrated with concise code snippets.

JDFrameJavaSDFrame
0 likes · 16 min read
Simplify Java Stream Processing with JDFrame: A Semantic DataFrame API
Code Mala Tang
Code Mala Tang
Jun 4, 2025 · Fundamentals

10 Powerful CSV Module Tricks Every Python Developer Should Know

This guide reveals ten powerful and often overlooked techniques for Python’s built‑in csv module, covering automatic delimiter detection, header detection, custom dialects, DictWriter usage, selective column reading, generator‑based streaming, special‑character escaping, safe appending, CSV‑JSON conversion, and explicit Unicode handling to boost data‑processing efficiency.

CSVTipsdata-processing
0 likes · 8 min read
10 Powerful CSV Module Tricks Every Python Developer Should Know
Code Mala Tang
Code Mala Tang
Apr 22, 2025 · Fundamentals

Unlock Python’s itertools: The Swiss‑Army Knife for Efficient Data Pipelines

This article introduces Python’s built‑in itertools module, explains its infinite, finite, and combinatorial iterator utilities, demonstrates advanced techniques like grouping and pipeline construction, and compares its lazy evaluation memory benefits to traditional list comprehensions for large‑scale data processing.

IteratorLazy Evaluationdata-processing
0 likes · 10 min read
Unlock Python’s itertools: The Swiss‑Army Knife for Efficient Data Pipelines
Python Crawling & Data Mining
Python Crawling & Data Mining
Mar 10, 2025 · Fundamentals

Three Clever Ways to Sum Columns in a 2D Python List

This article demonstrates three efficient Python techniques—list unpacking, NumPy aggregation, and functional reduction—to sum corresponding elements across sub‑lists in a two‑dimensional list, complete with code examples and visual explanations for beginners and seasoned developers alike.

data-processinglist-sumlist-unpacking
0 likes · 5 min read
Three Clever Ways to Sum Columns in a 2D Python List
Test Development Learning Exchange
Test Development Learning Exchange
Feb 14, 2025 · Fundamentals

Python List Comprehensions: Syntax, Examples, and Advanced Uses

This article introduces Python list comprehensions, explaining their concise syntax, basic and advanced usage patterns such as filtering, nested loops, dictionary and set comprehensions, and demonstrates numerous practical examples with code snippets for tasks like generating squares, filtering even numbers, combining lists, and processing files.

codingdata-processingexamples
0 likes · 9 min read
Python List Comprehensions: Syntax, Examples, and Advanced Uses
Test Development Learning Exchange
Test Development Learning Exchange
Jan 11, 2025 · Fundamentals

Python Scripts for File Management, Data Processing, Automation, and More

This article provides a collection of practical Python code snippets covering file and directory management, data processing, network requests, automation tasks, document handling, image manipulation, system monitoring, visualization, cleaning, logging, and web scraping, all presented with clear explanations and ready-to-use examples.

data-processingfile-managementweb-scraping
0 likes · 7 min read
Python Scripts for File Management, Data Processing, Automation, and More
Python Crawling & Data Mining
Python Crawling & Data Mining
Dec 19, 2024 · Backend Development

How to Scrape and Automate King of Glory Item Data with Python

Learn how to use Python to scrape hero equipment data from the King of Glory website, download images via multithreaded requests, and automatically generate comprehensive Markdown and Excel reports, complete with code snippets and troubleshooting tips for a seamless data extraction workflow.

data-processinggame datamarkdown
0 likes · 9 min read
How to Scrape and Automate King of Glory Item Data with Python
Test Development Learning Exchange
Test Development Learning Exchange
Oct 19, 2024 · Fundamentals

Python Libraries for CSV and Excel File Processing: csv, openpyxl, pandas, xlsxwriter, and More

This guide introduces and compares several Python libraries—including csv, openpyxl, pandas, xlsxwriter, pyexcel, xlrd/xlwt, xlutils, tablib, ezodf, xlwings, and readxl—detailing their purposes, key features, typical use cases, installation commands, and example code for reading and writing CSV and Excel files.

Exceldata-processingopenpyxl
0 likes · 21 min read
Python Libraries for CSV and Excel File Processing: csv, openpyxl, pandas, xlsxwriter, and More
Test Development Learning Exchange
Test Development Learning Exchange
Sep 6, 2024 · Fundamentals

Python Pandas Examples for Reading, Filtering, Sorting, Merging, De‑duplicating, Pivoting, Analyzing, Plotting, Formatting, and Conditional Formatting of Excel Data

This article provides a series of Python pandas code snippets that demonstrate how to read, filter, sort, merge, remove duplicates, create pivot tables, perform statistical analysis, generate charts, apply formatting, and add conditional formatting to Excel files.

Exceldata-analysisdata-processing
0 likes · 5 min read
Python Pandas Examples for Reading, Filtering, Sorting, Merging, De‑duplicating, Pivoting, Analyzing, Plotting, Formatting, and Conditional Formatting of Excel Data
Python Programming Learning Circle
Python Programming Learning Circle
Jul 18, 2024 · Operations

17 Practical Python Scripts for Automating Common Tasks

This article presents seventeen versatile Python scripts that automate tasks such as file management, web scraping, email handling, database interaction, system monitoring, and image processing, providing clear code examples and explanations to help developers and analysts streamline workflows and boost productivity.

Emaildata-processingsystem-administration
0 likes · 20 min read
17 Practical Python Scripts for Automating Common Tasks
Test Development Learning Exchange
Test Development Learning Exchange
Jul 8, 2024 · Backend Development

Understanding JSONPath Decorator in Python

This article explains how to create and use a Python JSONPath decorator to simplify extracting data from JSON, covering installation, basic and advanced use cases such as list handling, filtering, aggregation, asynchronous processing, API parsing, validation, dynamic path generation, and nested data extraction, with full code examples.

AsyncDecoratorJsonPath
0 likes · 6 min read
Understanding JSONPath Decorator in Python
Python Programming Learning Circle
Python Programming Learning Circle
Apr 29, 2024 · Fundamentals

Leveraging the Underscore (_) in Python: Tips for Console, Data Handling, and Code Aesthetics

This article explains how the underscore character in Python can be used to capture the last console result, ignore unwanted values during unpacking, denote protected or private members in classes, and improve numeric readability, offering practical tips to write cleaner and more efficient code.

coding-tipsdata-processingnaming-conventions
0 likes · 3 min read
Leveraging the Underscore (_) in Python: Tips for Console, Data Handling, and Code Aesthetics
Python Programming Learning Circle
Python Programming Learning Circle
Apr 25, 2024 · Fundamentals

Introducing CleverCSV: A Smart Python Library for Intelligent CSV Parsing

CleverCSV is a Python library that uses machine‑learning to automatically detect CSV dialects, offering a more flexible alternative to the standard csv module, with installation instructions, basic and advanced usage examples, and a complete script demonstrating generation, detection, manipulation, and writing of complex CSV files.

CSVclevercsvdata-processing
0 likes · 6 min read
Introducing CleverCSV: A Smart Python Library for Intelligent CSV Parsing
Python Crawling & Data Mining
Python Crawling & Data Mining
Aug 22, 2023 · Fundamentals

Label Excel Rows by Keywords with Pandas: A Quick Python Guide

This article demonstrates how to use Python's pandas library to read an Excel file, define a function that matches specific brand keywords in a column, assign corresponding labels such as “automobile brand” or “sports brand” to a new column, and output the results, while also providing the full code example and tips for sharing data and seeking help.

ExcelPythondata-processing
0 likes · 5 min read
Label Excel Rows by Keywords with Pandas: A Quick Python Guide
Python Programming Learning Circle
Python Programming Learning Circle
Jul 30, 2022 · Fundamentals

Using openpyxl for Excel Automation in Python

This tutorial demonstrates how to use the Python openpyxl library to create, open, modify, and save Excel workbooks, covering worksheet management, cell operations, row and column handling, insertion and deletion, as well as read‑only and streaming techniques for efficient data processing.

AutomationExceldata-processing
0 likes · 7 min read
Using openpyxl for Excel Automation in Python
Python Programming Learning Circle
Python Programming Learning Circle
Mar 28, 2022 · Backend Development

15 Popular Open-Source Python Frameworks for Web, Networking, Data Processing, and More

This article presents a curated list of fifteen widely used open‑source Python frameworks, covering full‑stack web development, lightweight micro‑frameworks, event‑driven I/O, OLAP, distributed computing, continuous integration, and web crawling, each with a brief functional overview.

BackendWeb frameworkdata-processing
0 likes · 5 min read
15 Popular Open-Source Python Frameworks for Web, Networking, Data Processing, and More
Python Programming Learning Circle
Python Programming Learning Circle
Feb 24, 2022 · Fundamentals

Parsing Complex JSON Structures with pandas json_normalize

This article explains how to use pandas' json_normalize function to transform different JSON formats—including simple objects, nested objects, lists, and deeply nested structures—into DataFrames, covering parameters such as record_path, meta, max_level, sep, errors, and prefix handling, with practical code examples.

JSONdata-processingdataframe
0 likes · 12 min read
Parsing Complex JSON Structures with pandas json_normalize
Python Programming Learning Circle
Python Programming Learning Circle
Nov 12, 2021 · Fundamentals

Processing CSV, JSON, and XML Data in Python

This tutorial demonstrates how to read, write, and convert CSV, JSON, and XML data using Python's built‑in modules and popular libraries such as pandas and dicttoxml, providing clear code examples for each format and showing how to interconvert them efficiently.

JSONXMLdata-processing
0 likes · 7 min read
Processing CSV, JSON, and XML Data in Python
MaGe Linux Operations
MaGe Linux Operations
May 18, 2021 · Backend Development

Automate Python Notifications for Model Training and Data Transfers

Learn how to use Python to send real-time progress updates and completion alerts via email for long-running tasks such as model training, data processing, and financial modeling, by leveraging the email, smtplib, and MIME libraries to build customizable notifications with images and attachments.

AutomationModel Trainingdata-processing
0 likes · 13 min read
Automate Python Notifications for Model Training and Data Transfers
Python Crawling & Data Mining
Python Crawling & Data Mining
Mar 16, 2021 · Fundamentals

Find Nearest Geographic Points in Large Excel Files with Python

This article demonstrates a step‑by‑step Python workflow for reading two Excel sheets, calculating haversine distances between latitude‑longitude pairs, identifying the nearest point for each record, and exporting the results, complete with code snippets, progress display, and performance advantages over traditional GIS tools.

ExcelGeospatialdata-processing
0 likes · 6 min read
Find Nearest Geographic Points in Large Excel Files with Python
MaGe Linux Operations
MaGe Linux Operations
Dec 18, 2018 · Backend Development

Unlock 20+ Python Tricks: From Image Processing to Train Ticket Queries

This guide presents a collection of practical Python snippets covering image manipulation with Pillow, video downloading via youtube-dl, object introspection, music bot usage, financial data retrieval with Tushare, vulnerability lab setup, Beijing bus API queries, article extraction, QR code generation, fake user agents, HTTP request statistics, shell commands, Chinese text sentiment analysis, proxy handling, Zhihu API access, password breach checking, Nginx log analysis, and train ticket queries.

PythonTutorialcode snippets
0 likes · 14 min read
Unlock 20+ Python Tricks: From Image Processing to Train Ticket Queries
Test Development Learning Exchange
Test Development Learning Exchange
Jun 14, 2018 · Fundamentals

Using xlrd to Read Excel Files in Python

xlrd is a Python module for reading Excel files, and this guide explains how to install it, locate its documentation, and demonstrates basic operations such as opening a workbook, accessing sheets, retrieving rows, columns, and cell values with example code snippets.

data-processingxlrd
0 likes · 3 min read
Using xlrd to Read Excel Files in Python
MaGe Linux Operations
MaGe Linux Operations
Jan 20, 2018 · Fundamentals

Python Cheat Sheet: Image Processing, API Calls, Data Mining, and Automation Scripts

This guide compiles essential Python snippets for tasks such as image manipulation with Pillow, video downloading via youtube‑dl, inspecting request objects, accessing NetEase Cloud Music, retrieving financial data with Tushare, running Docker‑based vulnerability labs, querying Beijing bus real‑time info, extracting articles with Goose, performing sentiment analysis, generating fake user agents, and more.

Sentiment Analysisdata-processingweb-scraping
0 likes · 13 min read
Python Cheat Sheet: Image Processing, API Calls, Data Mining, and Automation Scripts
Meituan Technology Team
Meituan Technology Team
Jan 12, 2018 · Backend Development

Design and High‑Performance Practices of Meituan's Settlement and Reconciliation Platform

Meituan’s settlement and reconciliation platform was rebuilt from a single‑threaded, month‑end batch system into a distributed, multi‑threaded, real‑time service that abstracts core models, uses lock‑free processing, sharding, and dedicated Kafka topics, achieving millisecond latency for millions of daily bills across 17 business lines.

BackendReconciliationdata-processing
0 likes · 20 min read
Design and High‑Performance Practices of Meituan's Settlement and Reconciliation Platform