BatchProcessing

Top Architect

Apr 18, 2025 · Backend Development

Optimizing XML-to-MySQL Import: Reducing Execution Time from 300 s to 4 s with Batch Processing and Multithreading

This article details how to dramatically speed up importing over 60,000 XML records into MySQL by profiling the original 300‑second implementation, enabling JDBC batch writes, configuring MySQL rewriteBatchedStatements, and applying a Disruptor‑based multithreaded pipeline, ultimately achieving sub‑5‑second runtimes with modest memory usage.

BatchProcessingDisruptorJava

0 likes · 15 min read

Optimizing XML-to-MySQL Import: Reducing Execution Time from 300 s to 4 s with Batch Processing and Multithreading

Test Development Learning Exchange

Mar 17, 2025 · Fundamentals

Python Script for Batch Generating Screenshots of All Sheets in Excel Files

This guide explains how to install required libraries and use a Python script that leverages pandas and excel2img to automatically capture high‑resolution screenshots of every worksheet in multiple Excel files, streamlining batch processing and boosting productivity.

AutomationBatchProcessingExcel

0 likes · 4 min read

Python Script for Batch Generating Screenshots of All Sheets in Excel Files

macrozheng

Nov 12, 2024 · Backend Development

Boost Kafka Throughput in Spring Boot: Batch Consumption Guide

This article demonstrates how to integrate Kafka with Spring Boot, add necessary dependencies and configuration, implement both single‑message and batch consumers, and tune batch settings to dramatically improve processing speed for millions of records in a microservice environment.

BatchProcessingJavaKafka

0 likes · 12 min read

Boost Kafka Throughput in Spring Boot: Batch Consumption Guide

Java Architect Essentials

Aug 18, 2022 · Backend Development