Tagged articles

Batch

21 articles · Page 1 of 1

Apr 20, 2026 · Backend Development

Optimizing SpringBoot Batch Insert/Update with MyBatis: Real‑World Tips for High‑Volume Data

This article explains why naïve per‑record inserts or updates in SpringBoot cause severe performance problems, analyzes three common mistakes, and demonstrates how MyBatis batch processing—through connection reuse, prepared‑statement reuse, and batch transaction commits—can speed up operations by tens of times, with practical code examples and configuration tips for handling millions of rows.

BatchJavaMyBatis

0 likes · 21 min read

Optimizing SpringBoot Batch Insert/Update with MyBatis: Real‑World Tips for High‑Volume Data

ITPUB

Jan 18, 2026 · Databases

From Full Sync to Real‑Time CDC: Building Scalable Order Data Pipelines

An e‑commerce junior developer tackles the challenge of regularly syncing order data to a data warehouse, evolving from naïve full‑table copies to incremental sync, batch processing, cursor‑based pagination, performance tuning, and finally a real‑time CDC‑plus‑message‑queue architecture, while addressing reliability, ordering, and scaling issues.

BatchCDCCursor

0 likes · 13 min read

From Full Sync to Real‑Time CDC: Building Scalable Order Data Pipelines

Raymond Ops

Jul 20, 2025 · Operations

Automate MySQL Backups on Linux and Windows with Python and Batch Scripts

This guide shows how to create automated MySQL backups on Linux using a Python script and on Windows using a batch file, covering configuration, backup retention, and cleanup to ensure reliable data protection across platforms.

AutomationBatchLinux

0 likes · 7 min read

Automate MySQL Backups on Linux and Windows with Python and Batch Scripts

AI Large Model Application Practice

May 9, 2025 · Backend Development

How JSON‑RPC Batch Processing and Tool Annotations Boost MCP Protocol Efficiency

The updated MCP protocol (2025‑03‑26) introduces JSON‑RPC batch processing and enhanced tool annotations, enabling AI agents to send multiple requests in a single call, improve performance, and provide richer metadata for safer, more transparent tool usage.

BatchJSON-RPCMCP

0 likes · 9 min read

How JSON‑RPC Batch Processing and Tool Annotations Boost MCP Protocol Efficiency

Java Tech Enthusiast

Feb 2, 2025 · Backend Development

Optimizing XML-to-MySQL Bulk Import with JDBC Batch and Disruptor

By switching from a naïve per‑record insert to JDBC batch writes with rewriteBatchedStatements and then off‑loading those batches to multiple consumer threads via a LMAX Disruptor ring buffer, the XML‑to‑MySQL import of 60,000 rows dropped from roughly 300 seconds to about 4 seconds while keeping memory usage modest.

BatchDisruptorJDBC

0 likes · 11 min read

Optimizing XML-to-MySQL Bulk Import with JDBC Batch and Disruptor

Big Data Technology & Architecture

Dec 2, 2024 · Big Data

Optimizing Primary‑Key and Append‑Scalable Tables in Paimon with Flink

This guide explains how to optimize Paimon primary‑key and Append‑Scalable tables in Flink by adjusting sink and source parallelism, checkpoint intervals, making small‑file merges fully asynchronous, changing file formats, and applying ordering strategies to improve both write and read performance.

BatchBig DataFlink

0 likes · 6 min read

Optimizing Primary‑Key and Append‑Scalable Tables in Paimon with Flink

Bilibili Tech

Nov 26, 2024 · Big Data

Bilibili’s Iceberg‑Based Streaming‑Batch Integration: Architecture, Optimizations, and Practices

Bilibili migrated its massive user‑behavior, commercial AI training, and database synchronization pipelines from Hive and Kafka to an Iceberg‑based streaming‑batch architecture, using Flink and the Magnus optimizer to achieve minute‑level freshness, reduce CPU and memory usage by about 20‑22 %, save roughly 3.55 M CNY annually, and dramatically improve query latency and join performance.

BatchData IntegrationData Lake

0 likes · 20 min read

Bilibili’s Iceberg‑Based Streaming‑Batch Integration: Architecture, Optimizations, and Practices

Liangxu Linux

May 8, 2024 · Fundamentals

Bypassing WeChat’s Singleton Check: Run Multiple Instances on Windows

This guide explains how a simple batch file can launch two or more WeChat instances on Windows by analyzing the app’s global mutex mechanism, reverse‑engineering the related DLL functions, and showing why the rapid start‑up bypasses the built‑in single‑instance guard.

BatchSingletonWeChat

0 likes · 6 min read

Bypassing WeChat’s Singleton Check: Run Multiple Instances on Windows

Spring Full-Stack Practical Cases

Mar 5, 2024 · Backend Development

Master SpringBoot JDBC Batch Operations: Code Samples & Best Practices

This guide demonstrates how to set up a SpringBoot environment, create a MySQL table, define a JavaBean, and perform efficient batch inserts using JdbcTemplate, BatchPreparedStatementSetter, NamedParameterJdbcTemplate, SimpleJdbcInsert, and MappingSqlQuery, with complete code examples for each technique.

BatchJDBCSimpleJdbcInsert

0 likes · 7 min read

Master SpringBoot JDBC Batch Operations: Code Samples & Best Practices

Top Architect

Apr 20, 2023 · Backend Development

Common Backend Interface Performance Optimization Strategies

This article outlines ten practical backend interface optimization techniques—including batch processing, asynchronous handling, caching, pre‑processing, pooling, parallelization, indexing, transaction management, code restructuring, and pagination—illustrated with code snippets and diagrams to help reduce latency and improve system efficiency.

BatchCaching

0 likes · 12 min read

Common Backend Interface Performance Optimization Strategies

DataFunTalk

Sep 11, 2022 · Big Data

Flink Table Store v0.2: Application Scenarios, Core Features, and Future Roadmap

This article introduces Flink Table Store v0.2, explains its four primary application scenarios—offline warehouse acceleration, partial update, pre‑aggregation rollup, and real‑time warehouse enhancement—details the core lake‑storage architecture, bucket management, append‑only mode, and outlines the project’s future roadmap and trade‑off considerations.

BatchFlinkLake Storage

0 likes · 16 min read

Flink Table Store v0.2: Application Scenarios, Core Features, and Future Roadmap

DataFunTalk

Mar 29, 2022 · Big Data

FlinkX Multi-Source Heterogeneous Data Synchronization Framework: Architecture, Features, and Cloud‑Native Enhancements

This article introduces the FlinkX framework for multi‑source heterogeneous data synchronization, detailing its background, core functions such as checkpoint‑based resume, metric monitoring, rate limiting, plugin architecture, cloud‑native K8s deployment, Hudi integration, and future roadmap, while also addressing common Q&A topics.

BatchBig DataData Lake

0 likes · 14 min read

FlinkX Multi-Source Heterogeneous Data Synchronization Framework: Architecture, Features, and Cloud‑Native Enhancements

Big Data Technology & Architecture

Apr 24, 2021 · Big Data

Integrating Apache Flink 1.12.2 with Apache Hudi: Batch and Streaming Modes

This article walks through downloading the required Flink and Hudi components, building Hudi for Scala 2.12, and demonstrates step‑by‑step how to create, populate, query, and update Hudi tables in both batch and streaming modes using Flink SQL, complete with code snippets and result screenshots.

BatchData LakeFlink

0 likes · 8 min read

Integrating Apache Flink 1.12.2 with Apache Hudi: Batch and Streaming Modes

Programmer DD

Mar 26, 2021 · Backend Development

Why MyBatis Returns -2147482646 with BATCH Executor and How to Fix It

The article explains that MyBatis returns the constant -2147482646 when the executor type is set to BATCH, shows how to trace the source code to uncover this behavior, and provides a simple configuration change to restore correct update counts.

Backend DevelopmentBatchExecutorType

0 likes · 5 min read

Why MyBatis Returns -2147482646 with BATCH Executor and How to Fix It

Laravel Tech Community

Feb 28, 2021 · Big Data

Apache Beam 2.28.0 Release Highlights and New Features

Apache Beam 2.28.0 introduces extensive Parquet support, new hash functions in BeamSQL and ZetaSQL, ApproximateDistinct via HLL, enhanced I/O connectors including SpannerIO for Numeric fields, ParquetIO schema support, KafkaTableProvider thrift, HadoopFormatIO key/value cloning skip, and various other improvements.

Apache BeamBatchBig Data

0 likes · 3 min read

Apache Beam 2.28.0 Release Highlights and New Features

MaGe Linux Operations

Jul 20, 2020 · Cloud Native

Mastering Kubernetes Jobs: Serial & Parallel Execution with Real‑World Examples

This guide explains how Kubernetes Job controllers run one‑off tasks, covering serial and parallel execution modes, required manifest fields, restart policies, monitoring commands, and cleanup options, complete with YAML examples and command‑line snippets.

BatchJobParallel

0 likes · 9 min read

Mastering Kubernetes Jobs: Serial & Parallel Execution with Real‑World Examples

Big Data Technology & Architecture

May 14, 2020 · Big Data

Understanding Flink 1.10 TaskManager Memory Model and Configuration Parameters

This article explains the new unified TaskManager memory model introduced in Flink 1.10, detailing each memory component, its configuration parameters, how they map to JVM settings, and practical guidance for both standalone and containerized deployments, including a concrete YARN example.

BatchBig DataFlink

0 likes · 10 min read

Understanding Flink 1.10 TaskManager Memory Model and Configuration Parameters

360 Quality & Efficiency

Mar 16, 2018 · Fundamentals

Introduction to Windows Batch Commands and Scripting

This article provides a comprehensive beginner-friendly guide to Windows batch (BAT) commands, covering common file operations, control structures, variable handling, and practical code examples for automating tasks on Windows virtual machines.

AutomationBatchScripting

0 likes · 8 min read

Introduction to Windows Batch Commands and Scripting

MaGe Linux Operations

Sep 15, 2017 · Operations

Automate SSH Key Distribution and Batch Operations with Expect, PSSH, and PSCP

This guide details how to automate SSH key generation, password‑less login, and batch file distribution across hundreds of servers using Expect scripts, ssh‑keygen, ssh‑copy‑id, and the pssh/pscp/pslurp command suite, providing step‑by‑step examples for efficient operations.

BatchLinuxexpect

0 likes · 14 min read

Automate SSH Key Distribution and Batch Operations with Expect, PSSH, and PSCP

ITPUB

May 31, 2017 · Operations

Automate Bulk Host Addition for Cacti and Nagios with Simple Scripts

The article explains how to automate the tedious process of adding multiple hosts to Cacti and Nagios by using shell‑wrapped PHP scripts and custom templates, provides download links, and shares practical tips to avoid common installation pitfalls.

AutomationBatchCacti

0 likes · 5 min read

Automate Bulk Host Addition for Cacti and Nagios with Simple Scripts

MaGe Linux Operations

May 15, 2015 · Operations

Master Linux Local Mail, at/batch, and cron: A Practical Guide

This guide explains how to use Linux's local mail service and the at, batch, and cron commands to create, list, modify, and delete one‑time and recurring scheduled tasks, including command syntax, examples, and troubleshooting tips.

BatchLinuxMail

0 likes · 6 min read

Master Linux Local Mail, at/batch, and cron: A Practical Guide