This article walks through five pandas-based methods—and an optional openpyxl approach—to extract unique date‑hour entries from an Excel file, explaining each technique, its code, and the nuances of handling datetime rounding and duplicate removal.
This tutorial shows how to calculate upward and downward differences of numeric columns for each category in a pandas DataFrame by sorting, grouping with groupby, and applying diff through several concise methods, including a custom helper function.
This article addresses a common data cleaning challenge by demonstrating four Python-based solutions—including custom functions, regex searches, and pandas string methods—to extract numeric work experience values from CSV entries, complete with code snippets and visual results for easy replication.
This article provides a comprehensive, step‑by‑step tutorial on using pandas.read_excel, covering its syntax, file handling, sheet selection, header and column name options, additional parameters, and practical tips for efficiently loading Excel data into Python dataframes.
An experienced data practitioner shares a concise pandas tutorial that shows how to recompute column aggregates after grouping, using a flexible function that applies arithmetic operations like addition, subtraction, multiplication, or division to the grouped results.
This tutorial shows how to group pandas data by two columns, count occurrences, and reshape the result so that the secondary condition becomes column headers, presenting three practical methods with code examples and visual explanations.
This article demonstrates several practical techniques for stripping dollar signs and commas from string columns in a pandas DataFrame and converting the cleaned values to floating‑point numbers, using plain Python, regular expressions, and pandas‑specific string methods.
This article demonstrates several practical techniques—including sorting before grouping, using drop_duplicates, and leveraging NumPy stacking—to extract the top N rows for each group in a pandas DataFrame, compares their performance, and provides a reusable function for custom use.
This tutorial demonstrates how to install Python and Pandas, use Pandas to read and write Excel files, handle common issues with xlrd and openpyxl, and provides a complete script for automating weekly Excel report updates.
This tutorial demonstrates how to fetch, clean, and organize King of Glory item data via a public JSON API using Python requests and pandas, then download item images concurrently, and finally generate comprehensive Markdown, Excel, and other documentation formats for easy reference.
This article demonstrates how to retrieve specific values from a pandas DataFrame with a MultiIndex using both straightforward reset‑index methods and native multi‑level indexing techniques such as chained .loc calls, tuple indexing, and level swapping.
This tutorial demonstrates two practical methods for conditionally swapping values between two columns in a pandas DataFrame, using boolean masking and NumPy indexing, and explains why direct column swapping may not work as expected.
This article demonstrates how to use pandas groupby, list aggregation, sorting, deduplication, and explode (or a custom apply function) to retrieve each user's top‑priority tag while preserving other tag columns, comparing two practical implementations and their performance trade‑offs.
This tutorial demonstrates how to reshape a one‑dimensional pandas DataFrame into a two‑dimensional format using both pivot_table with a custom aggregation function and the unstack method, providing step‑by‑step code, visual results, and practical tips for handling larger datasets.
This article demonstrates how to use Python's requests and BeautifulSoup libraries to scrape current and 14‑day weather data from China Weather Network, store it in CSV files, and then apply pandas, numpy, and matplotlib for comprehensive visual analysis of temperature, humidity, air quality, wind direction, and climate distribution.
This tutorial explains how to convert single‑variable and multi‑variable time‑series data into a supervised‑learning format using Pandas' shift() function and a custom series_to_supervised() helper, covering one‑step, multi‑step, and multivariate forecasting examples with complete Python code.
This tutorial demonstrates how to split a master Excel rent ledger into per‑room Excel files, automatically adjust column widths and borders, capture each sheet as an image using xlwings and Pillow, and finally package the script into a standalone executable for distribution.
This article explores a surprising behavior of Python sets where values like 1, 1.0, True, and even complex numbers are considered identical, explains the underlying use of the 'is' and '==' operators, and demonstrates how this affects deduplication with clear code examples.
This article presents a Python utility that reads an original class schedule Excel file, processes the data with pandas, and generates separate class‑wise and teacher‑wise timetables saved as Excel files, all wrapped in a simple PySimpleGUI interface requiring a login.
This tutorial explains six Python techniques—including datetime.weekday(), datetime.isoweekday(), strftime(), calendar, pendulum, and pandas—to retrieve the weekday of any given date such as 2022‑02‑22, with code examples and usage tips for data analysis.
This article demonstrates how to transform a single Excel column containing semicolon‑separated values into separate rows using pandas' explode() function, offering both an openpyxl‑based method and a concise pandas solution with code examples and step‑by‑step screenshots.
This article shows how to read a CSV file with pandas, sort its rows by a chosen column in descending order while preserving the header, and save the sorted data to a new CSV, providing a clear, step‑by‑step solution for Python automation tasks.
This article walks through six practical Pandas techniques—using map, apply, replace, and dictionary look‑ups—to batch‑replace numeric codes with descriptive strings, complete with code snippets and visual results for each method.
This article walks through two practical methods for converting a Python list into the first column of an Excel file—first using openpyxl for direct cell writing, then leveraging pandas for a more concise DataFrame approach, plus additional pandas tricks for column manipulation.
This article walks through a fan's question about selecting the maximum of two DataFrame columns per row, presenting five concise Pandas solutions—including direct max, loc, apply, assign, and NumPy where—complete with code snippets and visual output.
This article provides a comprehensive overview of NumPy and pandas, covering ndarray basics, multi‑dimensional array creation, core array attributes, broadcasting, random number generation, reshaping, as well as pandas Series and DataFrame structures, data import/export, grouping, merging, and advanced data manipulation techniques for scientific and data‑analysis tasks.
This article explains how to use pandas' json_normalize function to transform different JSON formats—including simple objects, nested objects, lists, and deeply nested structures—into DataFrames, covering parameters such as record_path, meta, max_level, sep, errors, and prefix handling, with practical code examples.
This tutorial demonstrates how to build an interactive fruit‑sales dashboard using Python's Dash framework together with Tailwind CSS for styling, covering data preparation with Pandas, chart creation with Plotly, layout design, and deployment on a local server.
This tutorial walks you through a real‑world example of constructing e‑commerce user profiles using Python, pandas, and matplotlib, covering data loading, preprocessing, feature engineering, behavior tagging, activity analysis, and RFM segmentation with clear code snippets and visualizations.
This tutorial shows how to fetch historical stock data using Python, compute 5‑day and 20‑day moving averages with pandas, and visualize them with matplotlib to support short‑term and medium‑term trading strategy design.
This tutorial demonstrates two pandas approaches to retrieve each user's highest‑priority label based on ordered tags, covering data preparation, grouping, custom sorting with key functions, deduplication, and the explode method, complete with code snippets and performance considerations.
This article explains how to retrieve specific values from a pandas DataFrame with a MultiIndex by resetting the index, using query, chaining .loc calls, tuple indexing, and swapping index levels, providing clear code examples and useful tips for efficient data extraction.
This tutorial shows how to exchange selected values between two columns in a pandas DataFrame using boolean masking and NumPy indexing, providing two practical methods with complete code examples and explanations.
This article demonstrates how to reshape a one‑dimensional dataset into a two‑dimensional table using pandas, covering the data requirements, import steps, and two practical methods—pivot_table with a custom aggregation function and the unstack technique—complete with code snippets and visual results.
This article walks through two common Excel‑automation tasks—merging a named sheet from two workbooks and consolidating the second sheet of every file in a folder—using concise pandas code, complete with step‑by‑step explanations and runnable examples.
This comprehensive Pandas tutorial walks you through loading CSV and Excel files, creating Series and DataFrames, performing basic operations, cleaning data, handling missing values, working with hierarchical indexes, grouping, merging, concatenating, and applying time‑series techniques, all illustrated with clear code examples and screenshots.
This tutorial walks through using pandas to import, review, preprocess (including integration, cleaning, transformation, handling missing and duplicate values, outlier detection, and sampling), analyze (descriptive statistics and correlation), and visualize e‑commerce data with Python, providing practical code examples for each step.
This article presents a series of Python examples using xlwings and pandas to batch‑sort worksheets, filter and aggregate data across multiple workbooks, compute summary statistics, perform correlation, ANOVA, regression, and generate pivot tables and visualizations, illustrating practical Excel automation and data‑analysis techniques.
This article describes the author's exploration of various approaches—including custom servers, JupyterHub, JupyterBook, and Thebe—to enable users to run pandas code directly within a webpage, detailing the requirements, challenges, and the final implementation that embeds interactive execution while preserving user isolation and minimal setup.
This tutorial demonstrates how to fetch historical stock data with pandas_datareader, calculate 5‑day and 20‑day moving averages using pandas, and visualize the price series together with these averages in a Matplotlib chart to illustrate simple trading‑strategy concepts.
Camelot is a Python library that lets you pull tables from PDF files into Pandas DataFrames with just a few lines of code, offering a fast and reliable solution for researchers and developers who need to convert PDF‑embedded tables into usable data.
Learn how to create a Python-based GUI application that uses pandas and PySimpleGUI to split Excel tables by a chosen column and merge multiple worksheets into a single file, then package the script into an executable with pyinstaller, complete with code snippets and usage instructions.
This tutorial explains pandas' four primary data merging functions—concat, merge, append, and join—detailing their usage, key parameters, and practical code examples to help you efficiently combine DataFrames in various scenarios.
This tutorial walks through constructing a movie recommendation engine by downloading a dataset, cleaning and de‑duplicating entries, encoding plot summaries into vectors with transformer models, and performing nearest‑neighbor searches using scikit‑learn, while handling misspellings with Levenshtein distance.
This article presents a thorough collection of frequently used pandas commands for importing data, preprocessing, cleaning, transforming, analyzing, and visualizing datasets, complete with code examples and explanations to help Python developers perform efficient data analysis tasks.
This guide demonstrates how to use a second‑hand housing dataset to create various reports—frequency tables, cross‑tables, and summary statistics—and visualise them with bar and stacked bar charts using Python's pandas library.
This article demonstrates how to use Python and pandas to automatically add a column containing each workbook or sheet name to every sheet in multiple Excel files and then merge all the data into a single file, dramatically reducing manual effort.
This guide demonstrates how to efficiently read, write, and convert CSV, JSON, and XML data using Python's built‑in modules, pandas, and third‑party libraries, providing clear code examples for each format and showcasing best practices for data processing.
This tutorial walks you through creating a fully interactive sales‑data dashboard using Python's Pandas for data handling, Plotly for visualizations, and Streamlit to assemble a sleek web interface, covering data import, sidebar filters, key metrics, charts, and deployment steps.
This tutorial walks through a complete pandas‑based workflow for analyzing a concrete‑strength dataset, covering data loading, cleaning, exploratory visualizations, correlation analysis, and targeted sub‑group investigations to uncover factors influencing product strength and suggest improvement measures.
This article demonstrates how to use Python with pandas and openpyxl to automatically generate yearly Excel workbooks, create monthly sheets, and add predefined column headers, turning a manual multi‑minute task into a fast, error‑free process.
This article demonstrates how to collect historical Beijing weather data using Python web‑scraping, clean and transform it with pandas, visualize overall and monthly patterns, and extract insights such as the first winter snowfall each year and annual snow‑day counts.
This article demonstrates how to scrape cat breed information from a dedicated website, store the data in Excel, and perform comprehensive analysis and visualizations—including relationship graphs, geographic distribution, size ratios, price extremes, and word clouds—using Python libraries such as requests, lxml, pandas, pyecharts, and stylecloud.
This article explains why passing pandas data directly to Pyecharts results in blank charts due to NumPy data types, and shows how converting pandas Series to Python lists with .tolist() resolves the issue, providing corrected example code.
This article walks you through six Python methods—including two newly added approaches—to automatically combine all sheets from every Excel file in nested folders, saving hours of manual copy‑paste and reducing errors for data‑processing tasks.
This tutorial demonstrates how to use the Python PyWebIO library to create a web interface for uploading, cleaning, and querying pandas data—adding buttons, displaying tables, and handling continuous input—without writing any front-end HTML or JavaScript code.
This article explains how to use Python's pandas, os, and glob libraries to automatically locate, read, and concatenate all sheets from multiple Excel workbooks across nested folders, offering four concise code solutions, visual results, and practical tips for reliable batch merging.
This tutorial demonstrates how to read, write, and convert CSV, JSON, and XML data using Python's built‑in modules and popular libraries such as pandas and dicttoxml, providing clear code examples for each format and showing how to interconvert them efficiently.
This article walks you through the complete process of automating Excel report generation with Python, covering Excel fundamentals, a five‑step workflow, practical code examples using pandas and openpyxl, and techniques for merging results into a single workbook or multiple sheets.
This tutorial shows how to use Python to crawl Douban's Top250 movie list, handle anti‑scraping measures, extract detailed fields, store the data in Excel, and perform data cleaning, statistical analysis, and visualizations such as year distribution, rating trends, and genre word clouds.
This article explains how to use Python and the openpyxl library to automatically locate rows where column A equals 10 (representing 10 am) across multiple Excel files, presents two practical solutions, and provides complete code snippets and screenshots for easy implementation.
This tutorial demonstrates how to scrape Maoyan movie comments for "The Battle at Lake Changjin", clean and store the data, perform comprehensive visual analyses such as likes, city, gender, watch status, rating, user level, and creator mentions, and finally predict next‑day box office using linear regression with sklearn.
This tutorial explains how to replicate Excel conditional‑formatting features such as highlighting missing values, max/min, quantiles, color scales, data bars, custom formatting functions, and other styling tricks using Pandas' df.style API, complete with code examples and visual illustrations.
This article presents a comprehensive guide to essential Pandas operations, including creating Series and DataFrames, common methods for data selection, indexing, grouping, reading and writing files, handling missing values, sorting, statistical analysis, and data transformation, with practical code examples for each feature.
This article explains the limitations of CSV for big datasets, introduces the Feather binary format, shows how to install and use it with Python and pandas, and compares its saving/loading speed and storage size against CSV, highlighting Feather's advantages for efficient data handling.
This article walks through extracting latitude and longitude pairs from a CSV file into separate Excel columns using pandas, explains each processing step, and presents an optimized chunk‑based solution that handles tens of thousands of rows in seconds.
This guide walks you through handling textual data with pandas, covering basic and new string dtypes, essential string methods for formatting, alignment, counting, encoding, and advanced operations such as splitting, replacing, concatenating, matching, and extracting patterns, all illustrated with clear code examples.
This guide explains how to use Python, pandas, and requests to fetch minute‑by‑minute K‑line data for Chinese stocks from Eastmoney's API, generate the required secid, handle different market codes, and continuously save the data until market close.
Using Python and pandas, this article collects and analyzes 97,331 danmu comments from the first episode of Mango TV’s “Brother” show, presenting data previews, word clouds, top‑liked remarks, super‑active users, and favorite performers, while also sharing the data‑scraping script.
This guide explains why data cleaning is essential, categorizes common problems such as missing values, noise/outliers, and inconsistent records, and provides step‑by‑step procedures and Pandas code snippets to detect, diagnose, and remediate each issue in real‑world datasets.
This tutorial shows how to use Python to fetch the Weibo hot search list, clean and organize the data with pandas, send the results via QQ email, and schedule the whole process to run automatically each evening.
This guide shows how to fetch financial time‑series data from Quandl using Python, store it in pandas, explore it with head/tail, and create line, volume, and candlestick visualizations with matplotlib, including code snippets and best practices for API keys and date handling.
This article provides a Python tutorial that explains how to generate Eastmoney‑specific security IDs, request minute‑level K‑line data for a given stock code via the Eastmoney API, process the response into a pandas DataFrame, and continuously fetch and save data until market close.
This comprehensive tutorial translates the official Pandas documentation into Chinese, then walks readers through DataFrames, Series, indexing, I/O operations, data manipulation, string handling, merging, and advanced tips, providing clear code examples for each concept.
This guide walks through Pandas' three core data‑combination methods—merge, join, and concat—explaining their syntax, key parameters, and join types (inner, outer, left, right) with clear code examples and practical tips for seamless DataFrame integration.
This tutorial shows how to dramatically reduce pandas DataFrame memory consumption—by up to 90%—by inspecting internal storage, downcasting numeric columns, converting object columns to categoricals, and specifying optimal dtypes while reading CSV data, all demonstrated on a large MLB game logs dataset.
This tutorial demonstrates how to analyze pandas memory consumption, downcast numeric columns, convert object columns to categoricals, and specify optimal dtypes when reading CSV files, achieving a reduction of nearly 90% in DataFrame memory usage while preserving full analytical capabilities.
This article presents a curated collection of 100 frequently used pandas functions, organized into six categories—statistical aggregation, data cleaning, data selection, plotting and element‑wise operations, time‑series utilities, and miscellaneous helpers—providing concise Chinese explanations for each function’s purpose.
This article introduces Python's pandas library as a powerful open‑source alternative to MATLAB for data modeling competitions, covering basic, intermediate, and advanced functions—including data I/O, inspection, logical filtering, visualization, aggregation, and integration with tqdm for progress tracking—complete with code examples.
This comprehensive tutorial introduces Pandas—the powerful Python library for data manipulation and analysis—covers installation, data import, inspection, cleaning, indexing, selection, sorting, grouping, transformation, statistical functions, visualization, and exporting, all illustrated with clear code examples and visual outputs.
This article introduces a free Pandas cheat sheet covering data creation, reshaping, selection, exploration, modification, grouping, and merging, provides direct download links, showcases key functions with images, and explains how to obtain high‑resolution versions for quick reference.
This article describes how QA engineers automated the repetitive Excel‑based mapping and validation process of a valuation system by using Python pandas scripts to filter, compare, and export data, reducing manual effort from ten minutes to under one minute while improving accuracy and coverage.
This article provides a detailed tutorial on using various Python libraries such as xlrd, xlwt, xlutils, xlwings, openpyxl, XlsxWriter, win32com, and pandas for reading, writing, modifying, and visualizing Excel files, complete with code examples and best‑practice tips.
This article introduces twelve powerful NumPy and Pandas functions—six for each library—explaining their purpose, usage, and providing code snippets, enabling readers to perform efficient array manipulation, data filtering, aggregation, and I/O operations, with a link to the full Jupyter Notebook on GitHub.
This article introduces twelve high‑performance Numpy and Pandas functions—six for each library—explaining their purpose, typical use cases, and providing ready‑to‑run code examples to help data analysts work faster and more efficiently.
This tutorial introduces pandasql, a compact Python library that enables SQL queries on pandas DataFrames within the Rodeo IDE, covering installation, built‑in datasets, basic queries, aggregation, joins, and visualization tips for data‑analysis beginners.
This tutorial presents 25 practical pandas techniques, covering version checking, DataFrame creation, column renaming, row and column reversal, dtype selection, type conversion, memory optimization, reading and concatenating multiple files, handling missing values, string splitting, series expansion, aggregation, pivot tables, categorizing continuous data, DataFrame styling, and profiling, all illustrated with clear code examples.
This tutorial walks beginners through the complete process of building a Python web scraper to collect internship listings from Shixi.com, covering page analysis, static vs dynamic detection, data location with XPath, pagination handling, and storing results in a CSV file using pandas.
This tutorial walks you through creating a variety of Python visualizations—line plots, bar charts, histograms, density plots, scatter matrices, and faceted grids—using pandas, matplotlib, and seaborn, with complete code examples and tips for customizing appearance.
This article introduces seven powerful Python tools—including Pandas, Selenium, Flask, Scrapy, Requests, Faker, and Pillow—explaining their core features and providing ready-to-use code snippets to help developers automate data analysis, testing, web development, crawling, API calls, fake data generation, and image processing.
This tutorial shows how to read two Excel worksheets with pandas, merge them on matching name columns using a single merge command, and save the combined data back to a new Excel file, all with just a few lines of Python code.
This tutorial explains how to create, read, and write JSON files using Python's json module, load them into Pandas dataframes, perform data manipulation, rename columns, save to CSV, fetch JSON from URLs, and visualize the data with Seaborn, providing code examples and visual illustrations.
This tutorial walks you through Python's built‑in JSON handling, covering reading JSON files, converting between JSON strings and Python objects, using pandas for JSON parsing, and applying serialization, deserialization, and pretty‑printing techniques with complete code examples.
This article extends a basic pandas tutorial by covering advanced data access methods, index types, concatenation, merging, joining, grouping, aggregation, time series handling, and basic plotting, providing clear code examples and explanations for each feature.
This article presents ten concise Python and Jupyter Notebook tricks—including pandas‑profiling for quick data‑frame exploration, interactive plotting with Cufflinks, useful Jupyter magic commands, pretty‑printing, alert boxes, and shortcuts for debugging and cell output—that together dramatically accelerate everyday data‑analysis tasks.
This article walks through reading monthly rainfall data with pandas, cleaning missing values, calculating rainfall deviations, generating descriptive paragraphs, and rendering a formatted Word report using docxtpl, providing complete code snippets and example outputs for each step.
This article walks through a full Python‑based sales analysis for a cosmetics company, covering data loading, cleaning, aggregation, visualization, and business‑focused conclusions such as product demand cycles, regional performance, and customer retention strategies.
Learn step‑by‑step how to scrape Tencent’s location data via its API, process the coordinates with pandas, deduplicate and filter them, and finally visualize regional foot‑traffic as an interactive heatmap using Folium, complete with code snippets and practical tips.
This article demonstrates how to use Python's time, NumPy, and Pandas libraries to build an RFM (Recency, Frequency, Monetary) model for customer value segmentation, covering data preparation, score calculation, weighting strategies, and exporting the results for marketing insights.
This article demonstrates how to crawl 6,025 Beijing Dank Apartment listings using Python, clean and enrich the data with Pandas, and visualize distribution, price, size, floor, and subway proximity through charts, revealing key market insights and correlation patterns.
