Tagged articles
batch
22 articles · Page 1 of 1
This article explains why naïve per‑record inserts or updates in SpringBoot cause severe performance problems, analyzes three common mistakes, and demonstrates how MyBatis batch processing—through connection reuse, prepared‑statement reuse, and batch transaction commits—can speed up operations by tens of times, with practical code examples and configuration tips for handling millions of rows.
JavaMyBatisSpringBoot
0 likes · 21 min read


ITPUBJan 18, 2026 · Databases
An e‑commerce junior developer tackles the challenge of regularly syncing order data to a data warehouse, evolving from naïve full‑table copies to incremental sync, batch processing, cursor‑based pagination, performance tuning, and finally a real‑time CDC‑plus‑message‑queue architecture, while addressing reliability, ordering, and scaling issues.
CDCCursorbatch
0 likes · 13 min read

The article explains that real‑time data processing requires not only speed but also accuracy, stability, and long‑term maintainability, compares Lambda, Kappa, and unified batch‑stream architectures, discusses lakehouse storage, and provides practical guidance on selecting the most suitable approach for different project needs.
FlinkKappa architectureLambda architecture
0 likes · 9 min read

This guide shows how to create automated MySQL backups on Linux using a Python script and on Windows using a batch file, covering configuration, backup retention, and cleanup to ensure reliable data protection across platforms.
LinuxMySQLWindows
0 likes · 7 min read

The updated MCP protocol (2025‑03‑26) introduces JSON‑RPC batch processing and enhanced tool annotations, enabling AI agents to send multiple requests in a single call, improve performance, and provide richer metadata for safer, more transparent tool usage.
JSON-RPCMCPPython
0 likes · 9 min read

By switching from a naïve per‑record insert to JDBC batch writes with rewriteBatchedStatements and then off‑loading those batches to multiple consumer threads via a LMAX Disruptor ring buffer, the XML‑to‑MySQL import of 60,000 rows dropped from roughly 300 seconds to about 4 seconds while keeping memory usage modest.
DisruptorJDBCJava
0 likes · 11 min read

This guide explains how to optimize Paimon primary‑key and Append‑Scalable tables in Flink by adjusting sink and source parallelism, checkpoint intervals, making small‑file merges fully asynchronous, changing file formats, and applying ordering strategies to improve both write and read performance.
FlinkPaimonTable Optimization
0 likes · 6 min read

Bilibili migrated its massive user‑behavior, commercial AI training, and database synchronization pipelines from Hive and Kafka to an Iceberg‑based streaming‑batch architecture, using Flink and the Magnus optimizer to achieve minute‑level freshness, reduce CPU and memory usage by about 20‑22 %, save roughly 3.55 M CNY annually, and dramatically improve query latency and join performance.
Flinkbatchdata integration
0 likes · 20 min read

This guide explains how a simple batch file can launch two or more WeChat instances on Windows by analyzing the app’s global mutex mechanism, reverse‑engineering the related DLL functions, and showing why the rapid start‑up bypasses the built‑in single‑instance guard.
WeChatWindowsbatch
0 likes · 6 min read

This guide demonstrates how to set up a SpringBoot environment, create a MySQL table, define a JavaBean, and perform efficient batch inserts using JdbcTemplate, BatchPreparedStatementSetter, NamedParameterJdbcTemplate, SimpleJdbcInsert, and MappingSqlQuery, with complete code examples for each technique.
JDBCSimpleJdbcInsertbatch
0 likes · 7 min read

This article outlines ten practical backend interface optimization techniques—including batch processing, asynchronous handling, caching, pre‑processing, pooling, parallelization, indexing, transaction management, code restructuring, and pagination—illustrated with code snippets and diagrams to help reduce latency and improve system efficiency.
Cachingbatch
0 likes · 12 min read

This article introduces Flink Table Store v0.2, explains its four primary application scenarios—offline warehouse acceleration, partial update, pre‑aggregation rollup, and real‑time warehouse enhancement—details the core lake‑storage architecture, bucket management, append‑only mode, and outlines the project’s future roadmap and trade‑off considerations.
FlinkLake StorageSQL
0 likes · 16 min read

This article introduces the FlinkX framework for multi‑source heterogeneous data synchronization, detailing its background, core functions such as checkpoint‑based resume, metric monitoring, rate limiting, plugin architecture, cloud‑native K8s deployment, Hudi integration, and future roadmap, while also addressing common Q&A topics.
FlinkXKubernetesbatch
0 likes · 14 min read

This article walks through downloading the required Flink and Hudi components, building Hudi for Scala 2.12, and demonstrates step‑by‑step how to create, populate, query, and update Hudi tables in both batch and streaming modes using Flink SQL, complete with code snippets and result screenshots.
ApacheFlinkHudi
0 likes · 8 min read

The article explains that MyBatis returns the constant -2147482646 when the executor type is set to BATCH, shows how to trace the source code to uncover this behavior, and provides a simple configuration change to restore correct update counts.
ExecutorTypeJavaMyBatis
0 likes · 5 min read

Apache Beam 2.28.0 introduces extensive Parquet support, new hash functions in BeamSQL and ZetaSQL, ApproximateDistinct via HLL, enhanced I/O connectors including SpannerIO for Numeric fields, ParquetIO schema support, KafkaTableProvider thrift, HadoopFormatIO key/value cloning skip, and various other improvements.
Apache BeamI/O ConnectorsParquet
0 likes · 3 min read

This guide explains how Kubernetes Job controllers run one‑off tasks, covering serial and parallel execution modes, required manifest fields, restart policies, monitoring commands, and cleanup options, complete with YAML examples and command‑line snippets.
JobKubernetesParallel
0 likes · 9 min read

This article explains the new unified TaskManager memory model introduced in Flink 1.10, detailing each memory component, its configuration parameters, how they map to JVM settings, and practical guidance for both standalone and containerized deployments, including a concrete YARN example.
FlinkMemory configurationTaskManager
0 likes · 10 min read

This article provides a comprehensive beginner-friendly guide to Windows batch (BAT) commands, covering common file operations, control structures, variable handling, and practical code examples for automating tasks on Windows virtual machines.
Windowsautomationbatch
0 likes · 8 min read

This guide details how to automate SSH key generation, password‑less login, and batch file distribution across hundreds of servers using Expect scripts, ssh‑keygen, ssh‑copy‑id, and the pssh/pscp/pslurp command suite, providing step‑by‑step examples for efficient operations.
LinuxSSHbatch
0 likes · 14 min read


ITPUBMay 31, 2017 · Operations
The article explains how to automate the tedious process of adding multiple hosts to Cacti and Nagios by using shell‑wrapped PHP scripts and custom templates, provides download links, and shares practical tips to avoid common installation pitfalls.
CactiNagiosautomation
0 likes · 5 min read

This guide explains how to use Linux's local mail service and the at, batch, and cron commands to create, list, modify, and delete one‑time and recurring scheduled tasks, including command syntax, examples, and troubleshooting tips.
A*LinuxMail
0 likes · 6 min read
