What’s New in Transwarp TDH 5.2.3? Key Performance and Stability Enhancements

Overview

Compared with the previous version, TDH 5.2.3 focuses on improving system stability and performance. Highlights include transaction compaction optimizations for Inceptor, performance fixes for Guardian when security plugins are enabled, SUSE‑specific fixes for Transwarp Manager, expanded Studio capabilities, and a new monitoring framework for TxSQL.

Transaction and Compaction Optimizations

The CTC table, which records transaction IDs to ensure strict commit order, can grow large and degrade performance. This release adds an index to the CTC table, cleans up transaction metadata after DROP/TRUNCATE operations, and reduces I/O by streamlining CTC log output.

Lock‑based improvements:

DESCRIBE/SHOW/CREATE operations on ORC transactional tables no longer acquire locks.

Lock acquisition time is shortened under high concurrency.

Improved Error Messages

Previously unsupported scenarios often lacked clear errors. New error prompts now cover:

UDF parameters cannot use the DISTINCT keyword.

LOAD statements cannot import data into ORC transactional tables.

Outer join syntax with the Sign(+) operator must be replaced by explicit OUTER JOIN in complex joins.

SQL Length Protection

To prevent OOM caused by excessively long UNION or IN‑list clauses generated by BI tools, the system now limits the number of UNIONs and IN items per SQL statement and provides configurable thresholds that trigger an error when exceeded.

UDF Oracle Compatibility Enhancements

The DECODE function now mirrors Oracle behavior:

If search and result are numeric, the highest‑precision numeric type is chosen, and all operands are cast to that type.

Otherwise, operands are cast to the search type; CHAR types are promoted to VARCHAR2 with length equal to the longest result value.

NULL matching is supported: a NULL expr can match a NULL search value.

The TDH_TODATE function now:

Returns NULL for illegal dates (e.g., "2018-02-31").

Parses English‑style dates (e.g., "25-MAR-18" → "2018-03-25").

Single‑Value Partition Insert Enhancements

Invalid inputs now trigger error messages (e.g., illegal DATE strings).

Different representations of the same value are normalized before insertion (e.g., "2012-2-7" and "2012-02-07" both map to "2012-02-07").

Implicit conversion for numeric partition keys (e.g., inserting a float into an INT partition key converts the value to an integer).

Default Resource Pool Support

Users can set a default queue; when the Inceptor scheduler operates in Furion mode without a specified queue, tasks are automatically dispatched to this default queue.

Guardian Performance Optimizations

Mitigated performance degradation caused by frequent HDFS quota checks.

Introduced caching for permission‑check results, reducing response time for repeated access requests.

Transwarp Manager Updates

Added TxSQL anomaly alerts to the monitoring dashboard.

Service upgrades no longer overwrite user‑defined defaults when the cluster environment changes.

TxSQL Monitoring and Stability Improvements

Built a comprehensive operations‑metric system covering Paxos lifecycle, SQL lifecycle, and resource anomalies, visualized on the control panel.

RTO‑performance balance:

Controlled master transaction speed based on pipeline lag to prevent excessively long RTO during high load.

Stability enhancements:

Fixed expansion mechanism failures.

Optimized Paxos storage cleanup to reduce space consumption and added logs for better visibility.

Resolved temporary RPC instability under heavy load.

Addressed brief CPU spikes that blocked Paxos message processing.

Performance Tuning

Eliminated performance fluctuations caused by Paxos message handling.

Adjusted MySQL resource settings in TxSQL: increased memory buffer size and relaxed file‑open limits.

Transwarp Studio Workflow Fixes

Corrected the ineffective retention‑time setting for workflow execution records.

Fixed missing creator information on the workflow basic‑info page.

OLAP Cube Engine Rubik Enhancements

Added support for partition fields in Rubik.

Extended REST API to allow incremental builds via API calls.

Fixed inability to delete Rubik instances when security is enabled.

For optimal performance and stability, users of older TDH versions are encouraged to upgrade. The new package can be installed directly from the Manager’s application marketplace.