This article details a step‑by‑step performance overhaul for importing 60,000+ XML records into MySQL, covering baseline measurements, MySQL batch processing, asynchronous writes with Disruptor, XML parsing optimizations, and tuning MySQL buffers, ultimately reducing total runtime from 300 seconds to just four seconds.
This article describes how to dramatically speed up the import of 60,000+ XML records into MySQL by analyzing the original environment, measuring baseline performance, and applying a series of backend optimizations—including MySQL batch mode, rewriteBatchedStatements, multithreaded asynchronous writes with Disruptor, and XML parsing improvements—ultimately cutting the total runtime from five minutes to just a few seconds.
This article details how a Java‑based XML‑to‑MySQL import of over 60,000 records was accelerated from 300 seconds to just 4 seconds by enabling JDBC batch processing, configuring rewriteBatchedStatements, and employing a multithreaded Disruptor pipeline for asynchronous writes, while also discussing further tuning options.
This article provides a comprehensive guide on using Python's xml.etree.ElementTree library to parse XML data, covering installation, parsing methods, data extraction, and handling nested structures with practical code examples.
This article describes how to reduce manual effort by automatically syncing sub‑task fields to TAPD requirement fields using webhooks and by batch‑creating TAPD sub‑tasks from OmniPlan files through XML parsing, providing a streamlined, visual project‑management workflow.
This article provides a comprehensive tutorial on XPath concepts, node types, syntax, axes, predicates, and operators, followed by a detailed introduction to the fast Python lxml library, its installation, usage for both offline and online HTML parsing, and practical code examples for extracting elements and attributes.
The article explains four XML parsing approaches (DOM, SAX, JDOM, DOM4J), highlights the use of Groovy for scripting, provides a sample XML snippet, and presents a complete Groovy/Java utility class that leverages dom4j to parse XML files for backend applications.
After completing a DOM‑based XML parsing class, I tackled the messy Zookeeper configuration hierarchy for MySQL services, exposing unexpected node structures, missing values, and hundreds of database settings, and finally crafted a Groovy script that traverses the XML, filters relevant keys, and logs the extracted configuration details.
This article explains MyBatis sqlFragment, its purpose for reusable SQL snippets, demonstrates how to define and include fragments in select/insert/update/delete statements, walks through the parsing process with code examples, and visualizes the transformation steps to build complete SQL queries.
This article walks you through four hands‑on Python projects—instant tagging, PDF drawing, XML‑driven website generation, and a Usenet news aggregator—explaining the underlying modules, key code structures, and how to extend each example for deeper learning.
This article outlines ten frequent security flaws in Python—from input injection and unsafe XML parsing to misuse of assert statements and vulnerable third‑party packages—explaining how each can be exploited and providing concrete remediation techniques to write safer code.
