This article walks through a common Python automation task of merging spreadsheet data using pandas, explaining the differences between append and extend, demonstrating proper use of pd.concat, and providing clear code snippets to help readers solve the problem efficiently.
Version 1.5.3 of the Python pandas library introduces optional pip extras, expanded Index support for NumPy dtypes, a new dtype_backend parameter, improved write copying, fixes for GroupBy cumulative operations overflow, several backward‑incompatible API changes, and multiple deprecations aimed at enhancing data analysis workflows.
This article walks through a real‑world Python web‑scraping problem, demonstrating how to extract clean table data using pandas.read_html and an alternative XPath approach, complete with code snippets, output screenshots, and practical tips for robust data collection.
This article demonstrates how to use Python and pandas to automatically read a text‑based question bank, parse questions and options, and export the data to an Excel file, providing complete code examples and a step‑by‑step explanation of the process.
Learn how to use Python's pandas library to automatically scan multiple folders, extract specified columns from hundreds of Excel files, and merge them into a single workbook, complete with step-by-step code examples and visual results.
This article walks through a Python‑based solution for cleaning and extracting data using Pandas, presenting multiple approaches—including regex, zero‑width spaces, and slicing—to help readers resolve common data‑processing challenges efficiently.
This article walks through a Python web‑scraping solution that extracts GDP data from a website using requests, lxml, and pandas, then stores the results in a CSV file, providing complete code and step‑by‑step explanation for readers.
This article walks through a Python web‑scraping solution that fetches GDP data from a website using the requests library, parses HTML with lxml, and demonstrates two approaches—manual XPath extraction and a streamlined pandas.read_html method—while providing complete code snippets and tips for handling pagination and data storage.
In this article, the author shares a real‑world pandas data‑processing problem caused by missing spaces, demonstrates the error, provides the corrected code snippet, and explains how the fix resolves the issue for fellow Python learners.
Learn a quick Python solution that automatically divides a large Excel workbook into multiple files, each containing three rows (or the remaining rows), using pandas and a simple loop, eliminating tedious manual copying and saving for large-scale data processing tasks.
This article explains how to retrieve data from an Oracle database with cx_Oracle, convert it to a pandas DataFrame, and correctly write the results to an Excel file with column headers, providing a complete code example and a practical solution to a common data‑processing issue.
This tutorial shows how to use Python and pandas to combine all Excel files in a folder, merge their sheets into a single workbook, and then filter the merged data based on specific criteria, providing complete code examples and visual results.
This tutorial shows how to use Python and pandas to automatically scan thousands of Excel files, filter rows by a specific ID, and consolidate the results into a single workbook, providing complete code examples and explanations to replace manual copy‑paste operations.
This article walks through a real‑world Pandas grouping problem, showing how to aggregate song and actor data, concatenate song IDs with commas, and sum tags, providing clear code examples and explanations to help Python learners solve similar data‑processing challenges.
This article walks through a Python pandas solution for processing Excel data, showing how to compute row‑wise minimums across multiple columns with concise code snippets, including a loop with f‑strings, and explains the implementation details for readers to apply to similar data‑analysis tasks.
This article walks through a real‑world pandas question on reshaping Excel data using pd.pivot_table, presenting the problem, showing the original and target layouts, and providing concrete code snippets that successfully solve the issue.
This article walks through a pandas workflow that merges two Excel sheets and eliminates duplicate rows based on the "Name" column, providing clear code snippets and a concise solution for common data‑cleaning tasks.
This article walks through a practical Python tutorial that shows how to extract non‑duplicate items from two lists using set operations and pandas, includes code screenshots, and explains how to export the results to Excel or other formats.
This article walks through a real‑world pandas problem where a user needs to filter an Excel column while preserving null entries, the literal "X" marker, and all positive numbers, providing step‑by‑step code snippets and explanations.
This tutorial demonstrates how to use Python's pandas library to read an Excel file, identify the first and last non‑zero entries in each row, and output their values and column positions, complete with code examples and performance tips.
This article walks through a real‑world pandas example that filters an Excel sheet by department and ID length, shows the complete Python code, displays the resulting output, and explains how the solution resolved a reader's data‑processing question.
This tutorial introduces the Pandas library, covering installation, data import from CSV and Excel, DataFrame creation, descriptive statistics, indexing with loc/iloc, and applying custom functions to clean and transform column values, all illustrated with code snippets and images.
This article walks through a pandas data‑processing problem, showing how to concatenate province, city, and district fields using vectorized string operations with clear code examples and resulting output to help readers apply the technique.
This article walks through a Python‑pandas solution for marking rows in an Excel sheet where two string columns share common characters, presenting three concise code approaches and visual results to help readers quickly apply the technique to their own data.
This article walks through a real‑world Pandas question, showing how to apply the map function, replace method, and str.contains() to transform column values, with step‑by‑step code examples and explanations.
This article walks through a real‑world Pandas problem posted in a Python community, showing how to read multiple Excel sheets, reshape the data, rename columns, and filter the result to match a desired table layout, complete with code and screenshots.
This article explains how to use pandas' sort_values and drop_duplicates functions to eliminate duplicate entries in a DataFrame, preserving the row with the maximum age (or other criteria), and provides multiple code examples and parameter details for effective data cleaning.
This article shows how to handle irregular JSON strings exported from a database by using a concise Pandas lambda expression that replaces empty actor lists with a default ID, providing a quick data‑cleaning solution for Python developers.
This article demonstrates how to read a CSV file with Pandas, use regular expressions to extract tag names from a string column, and transform the results into separate rows using the explode function, while also presenting alternative community‑sourced approaches.
This article walks through a real‑world question from a Python community about converting a Pandas DataFrame into a CSV file, explains why the original code was insufficient, and provides clear, step‑by‑step Python code using both pandas and built‑in file handling to produce the desired output.
This article introduces the GoPUP Python library, explains how to install it, demonstrates retrieving Weibo index data with code examples, shows how to visualize the results using Pandas, Jupyter and Matplotlib, and lists the wide range of public data APIs the library supports.
This article explains several Python/Pandas techniques for dropping columns that contain only missing or zero values, presenting three code snippets and a brief discussion of their usage for data cleaning.
Learn how to automate the extraction of answer symbols (√ and ×) from Word documents using Python, with step-by-step code examples employing docx, pandas, regex, and openpyxl to generate Excel files, and explore multiple community-contributed solutions.
This article walks through a real‑world Pandas problem where a column of tag strings is parsed, extracted, and transformed into dummy variables with get_dummies, providing clear code snippets and explanations to help Python developers solve similar data‑processing challenges.
This article walks through a real‑world pandas question, shows the original JSON data, presents a concise Python script to normalize and explode the data, highlights common pitfalls, and demonstrates the successful output with clear screenshots.
This tutorial walks through installing Pandas, importing CSV and Excel files, building DataFrames from dictionaries, describing data, indexing with loc/iloc, and applying custom functions to transform columns, providing clear code examples and visual outputs.
This article demonstrates how to collect, clean, and visualize Taobao mooncake sales data using Python libraries such as Pandas, Pyecharts, jieba and collections, revealing top‑selling flavors, regional distribution, price ranges and shop rankings through step‑by‑step data‑processing and charting techniques.
This article walks through transforming a list of Python dictionaries into a consolidated structure using basic loops, itertools grouping, and Pandas, providing clear code examples and visual results to help readers solve common dictionary‑handling challenges.
Learn how Pearson, Spearman, and Kendall correlation coefficients measure linear and monotonic relationships between variables, explore their mathematical properties, interpret their value ranges, and see practical Python examples using Pandas to compute each coefficient on generated data.
This article walks through a Python community member's JSON‑processing problem, explores several solutions using pandas, jsonpath, and regular expressions, and presents a final script that normalizes the data into a tidy CSV for further analysis.
This tutorial demonstrates how to generate synthetic datasets with NumPy, organize them into a Pandas DataFrame, and explore their distributions using Seaborn’s histograms, KDE plots, boxplots, violin plots, as well as multivariate visualizations like heatmaps, pair plots, and joint plots.
This article walks through a real‑world Pandas problem where British and American date formats are mixed, showing how to detect, clean, and convert the dates—including handling empty rows—using concise code and clear visual examples.
This article presents seven practical techniques for enhancing daily data‑analysis work in Jupyter notebooks, covering Pandas Profiling, Cufflinks/Plotly visualisation, IPython magic commands, markdown formatting, keyboard shortcuts, displaying multiple outputs simultaneously, and converting notebooks into live presentation slides.
This article presents a comprehensive Python-based analysis of a large game dataset (2.29 million records, 109 fields), covering user registration trends, payment rates, ARPU/ARPPU calculations, level‑based spending behavior, and consumption patterns of resources and acceleration items, with visualizations and actionable conclusions.
Learn how to use pandas' query() function to filter DataFrames with single or multiple conditions, combine logical operators, handle string queries, and perform inline arithmetic and built‑in functions, illustrated with a synthetic dataset and step‑by‑step code examples.
This article demonstrates how to replace tedious manual Excel reporting by using Python libraries pandas and xlwings to read multiple sheets, merge data, write the combined DataFrame back to Excel, and apply conditional formatting such as font colors, borders, and cell shading based on statistical thresholds.
Learn multiple Python approaches—including NumPy flattening, collections.Counter, and pandas melt/value_counts—to efficiently count the occurrences of each element in both regular and irregular multidimensional arrays, with code examples and a custom flatten function for handling nested structures.
This article walks through a common Pandas time‑handling issue, showing how to convert a timestamp column to a YYYY‑MM‑DD date format with concise code, complete with example data, output screenshots, and a brief conclusion for Python learners.
This article introduces Python's extensive libraries such as Pandas and NumPy, explains their role in quantitative finance platforms, and reviews essential data structures and algorithmic techniques—including arrays, strings, trees, hash tables, DFS, recursion, divide‑and‑conquer, and greedy methods—providing a solid foundation for building trading strategies.
Learn how to use pandas' str.extract and str.extractall methods with regular expressions to pull specific characters, capture groups, and match multiple patterns, including extracting first numbers, edge digits, and conditional keyword matches, while understanding key parameter differences and practical code examples.
This tutorial demonstrates multiple pandas techniques—including datetime mapping, MonthBegin/MonthEnd offsets, floor operations, period conversion, and asfreq—to accurately retrieve the first and last day of a month for any given date, while highlighting common pitfalls and performance considerations.
This guide shows how to calculate common statistical measures such as mean, median, range, variance, standard deviation, covariance, and correlation using NumPy functions, and demonstrates the equivalent operations with Pandas DataFrames, including a table of useful DataFrame methods for statistical analysis.
This article demonstrates how to replace common Excel operations such as data import, VLOOKUP, pivot tables, and charting with Python libraries like pandas and plotly, providing step‑by‑step code examples, performance tips, and comparisons that help analysts transition from spreadsheet‑based workflows to programmatic data analysis.
This article demonstrates four Pandas techniques—between with loc, cut, qcut, and value_counts—to discretize numeric variables into bins, assigning grades A, B, C to exam scores, and shows how to generate synthetic data, define bin boundaries, and count records per bin.
This article walks through a Pandas date‑handling challenge, presenting two robust methods using MonthEnd to convert month strings, discussing edge cases where month‑end dates shift, and sharing community‑derived optimizations and pure‑Python alternatives to help Python developers process dates accurately.
This article demonstrates two concise methods to add a column of average marks to a Pandas DataFrame by using lambda with np.mean or directly applying NumPy's mean function, complete with sample data, expected output, and step‑by‑step code snippets.
This article shows how to use Pandas to group rows by multiple columns, collect the values of another column into a list, and then join them into a comma‑separated string, providing two concise code solutions and a performance comparison.
This article outlines six typical errors beginners make with Pandas—slow CSV reads, lack of vectorization, improper dtypes, ignoring styling, inefficient CSV saving, and not consulting documentation—and provides faster alternatives, memory‑saving techniques, and best‑practice tips for handling large datasets.
This article walks through a step‑by‑step Python web‑scraping tutorial that fetches financial data of over 3000 listed companies from a public website, parses the tables with pandas, enhances the script with error handling, URL flexibility, MySQL storage, and multiprocessing to speed up the crawl.
This article demonstrates how to calculate similarity between rows in a pandas DataFrame using both a Cartesian‑product approach and vectorized broadcasting, providing complete Python code, performance notes, and step‑by‑step explanations.
This article demonstrates how to deduplicate invoice numbers and compute monthly order counts in retail data using pandas, comparing three approaches—unique with explode, groupby with value_counts, and drop_duplicates—while highlighting performance differences and providing complete code examples.
This article demonstrates two approaches for efficiently importing massive CSV data into MySQL using Python: a direct pymysql method with chunked inserts and a concise pandas‑SQLAlchemy method, comparing performance, code complexity, and offering tips for further speed improvements.
This article demonstrates how to de‑duplicate rows and concatenate string values within each id‑type group in a pandas DataFrame using drop_duplicates, groupby, agg, set, unique, and str.join techniques.
This tutorial demonstrates multiple pandas techniques—including list comprehensions, str.count, str.findall, and str.extractall—to count occurrences of one or more characters in a Series, handling case‑insensitivity and complex grouping with concise code examples.
This article demonstrates how to replace typical Excel tasks such as VLOOKUP, pivot tables, duplicate removal, missing‑value handling, multi‑condition filtering, and grouping with concise Python pandas code, providing step‑by‑step examples and practical tips for efficient data analysis.
This tutorial shows how to merge multiple Excel files using pandas in Python and enhance the process with a live progress bar by integrating the tqdm library, complete with code examples and visual results.
This article demonstrates how to use pandas' merge() and join() functions to combine DataFrames, shows examples of merging, joining with single and multi‑index DataFrames, illustrates horizontal concatenation with concat(), and compares the execution speed of merge versus join on large datasets.
This tutorial demonstrates how to generate random product usage data, compute per‑product usage‑duration percentages with pandas, calculate cumulative sums, and create a horizontal stacked bar chart using Matplotlib, offering multiple pandas techniques such as groupby‑value_counts, unstack, and crosstab for clear visual analysis.
This tutorial demonstrates how to use regular expressions and pandas string methods to extract numeric values from Series columns, calculate average years of experience, and convert salary strings into numeric monthly figures for further analysis.
Learn multiple techniques to interchange odd‑ and even‑positioned columns in a pandas DataFrame—including reshaping with NumPy, column indexing tricks, and handling both even and odd numbers of columns—complete with code examples and explanations for flexible data manipulation.
This tutorial explains how to horizontally merge three pandas DataFrames on column A using concat, join, and merge, demonstrates handling missing values, shows iterative merging with itertools.accumulate, and provides practical code snippets for flexible data‑frame combination.
This article explains how pandas' copy method works with deep and shallow options, demonstrates their effects on mutable and immutable data, and shows how to safely modify DataFrames using Python's copy module to avoid unintended changes to the original data.
This guide explains why pandas cannot directly cast float64 columns containing None, np.nan, or pd.NA to integers and demonstrates practical methods—using map with a lambda function or the nullable Int64 dtype—to safely convert such data to int64.
This article demonstrates how to use pandas' groupby and diff functions to calculate daily differences for numeric columns within each category, offering four implementation methods—including apply, direct diff, transform, and a custom function—complete with code examples and visual results.
This guide shows how to transform string‑typed date columns into proper datetime objects using pandas' pd.to_datetime, covering basic usage, key parameters, handling various formats, timestamps, and practical code examples for reliable data cleaning.
This article demonstrates six different ways to use Pandas for grouping and ordering the values in a DataFrame column according to their original occurrence order, providing complete code examples, explanations, and visual results for each method.
This article demonstrates three Python approaches to exchange odd‑indexed and even‑indexed columns in a Pandas DataFrame, providing complete code snippets, execution results, and a concise explanation for each method.
This guide shows how to download historical Kweichow Moutai stock data from NetEase Finance as a CSV file, handle encoding issues, and use Python's pandas and matplotlib libraries to filter the data and create both volume and OHLC line charts for a selected month.
This article walks through a Python data‑processing problem and presents five distinct pandas‑based solutions, each with complete code snippets and output screenshots, helping readers efficiently group and aggregate tabular data.
This article teaches how to use Python's pandas library to create various exploratory visualizations—line, scatter, histogram, bar, pie, and box charts—on real datasets such as Iris, the 2013 American Community Survey, and the Boston Housing data, including code examples and interpretation of results.
This article demonstrates several lesser‑known but highly useful Pandas functions—including to_period for period conversion, cumsum with groupby for cumulative sums, and the memory‑efficient Category dtype—through a step‑by‑step example DataFrame with code snippets and output illustrations.
This article introduces fifteen widely used Python libraries covering data collection, cleaning, visualization, machine‑learning, and web development, providing a comprehensive toolkit for data scientists and analysts to build end‑to‑end data pipelines.
This article explains how Python can boost office productivity by using libraries such as xlrd/xlwt, openpyxl, pandas for Excel, python‑docx for Word, and python‑pptx for PowerPoint, highlighting their ease of use and efficiency in handling large or repetitive documents.
This article explains how to iterate over DataFrame rows with pandas iterrows(), demonstrates grouping data using pandas groupby() with examples of splitting, aggregation, transformation, and filtration, and provides complete code snippets for each operation.
This article demonstrates four practical ways to transform a list of (letter, number) tuples into two distinct lists—one for letters and one for numbers—using basic loops, zip unpacking, pandas, and numpy, complete with code snippets and output screenshots.
This article walks through a Python data‑analysis task where a fan asks how many teachers come from the United States, demonstrating two solutions with pandas—using merge() and join()—including code examples, explanations, and how to adjust the output to meet changing requirements.
This article presents four practical methods—including list slicing, regex, Excel splitting, and lambda‑based eval—to efficiently parse and extract values from template strings in Python, complete with code examples and visual illustrations.
This article compiles thirteen concise pandas techniques—including missing‑value calculation, group‑by max row extraction, multi‑column aggregation, string filtering, memory optimization, and more—to help Python users perform data analysis more efficiently and effectively.
This tutorial explains how to use the Python FuzzyWuzzy library, which relies on Levenshtein distance, to perform fuzzy string matching for tasks such as normalizing province or company names, and provides complete code examples and practical applications.
This article walks through a fan's data‑processing question by presenting two practical Python approaches—renaming columns then summing, and using NumPy addition—to combine matching columns from separate DataFrames, complete with visual code examples.
This comprehensive tutorial walks you through pandas fundamentals—including reading CSV/Excel files, creating Series and DataFrames, performing basic operations, cleaning data, indexing, grouping, concatenation, merging, and handling time series—using clear examples and code snippets.
This article demonstrates how to dramatically speed up the slow pandas apply function—by up to six hundred times—using Swifter for parallel execution, vectorized pandas/numpy operations, dtype downcasting, and direct .values array manipulation, with detailed timing comparisons.
This article walks through a real‑world data‑cleaning task where duplicate process IDs are removed but earlier approval comments are retained, showcasing two pandas‑based solutions, code snippets, and practical tips for handling empty cells.
This article presents eight practical pandas data‑selection techniques—including boolean indexing, loc/iloc, isin, str.contains, where/mask, query, filter, and any/all—illustrated with code examples and visual outputs to help Python users efficiently extract and analyze data.
This article walks through five pandas-based methods—and an optional openpyxl approach—to extract unique date‑hour entries from an Excel file, explaining each technique, its code, and the nuances of handling datetime rounding and duplicate removal.
This tutorial shows how to calculate upward and downward differences of numeric columns for each category in a pandas DataFrame by sorting, grouping with groupby, and applying diff through several concise methods, including a custom helper function.
This article addresses a common data cleaning challenge by demonstrating four Python-based solutions—including custom functions, regex searches, and pandas string methods—to extract numeric work experience values from CSV entries, complete with code snippets and visual results for easy replication.
This article provides a comprehensive, step‑by‑step tutorial on using pandas.read_excel, covering its syntax, file handling, sheet selection, header and column name options, additional parameters, and practical tips for efficiently loading Excel data into Python dataframes.
An experienced data practitioner shares a concise pandas tutorial that shows how to recompute column aggregates after grouping, using a flexible function that applies arithmetic operations like addition, subtraction, multiplication, or division to the grouped results.
This tutorial shows how to group pandas data by two columns, count occurrences, and reshape the result so that the secondary condition becomes column headers, presenting three practical methods with code examples and visual explanations.
