What’s New in openLooKeng 1.6.0? Key Performance Boosts and Features
openLooKeng 1.6.0 introduces major enhancements such as faster data persistence with Kryo serialization, HDFS spill support, improved connector capabilities, low‑latency features like Star Tree indexing and cube updates, and a refined task recovery mechanism that reduces failure detection time, delivering a more reliable and high‑performance big‑data engine.
openLooKeng v1.6.0 Release
openLooKeng 1.6.0 brings a series of optimizations and new features aimed at improving engine performance, reliability, and functionality.
1. Data Persistence
Optimized calculation data spill speed and size by using Kryo serialization, which reduces write time and file size.
Added support for spilling overflow data to HDFS, increasing throughput.
Implemented an asynchronous spill/no‑spill mechanism to avoid blocking downstream operators when memory thresholds are exceeded.
Enabled overflow write for right‑outer‑join and full‑join scenarios using a Bloom filter to identify overflow data.
2. Connector Enhancements
PostgreSQL and openGauss connectors now support update and delete operations on the data source.
3. Low Latency
Added Star Tree index support, cube update commands, and heuristic index optimizations that shrink Bloom filter size by more than ten times.
4. Task Recovery
Reduced task failure detection time from 300 seconds to a much shorter interval, improving overall query execution flow.
Optimized snapshot time and size by replacing Java serialization with Kryo, resulting in faster snapshots and smaller files.
Note: Kryo is a fast serialization/deserialization tool that leverages bytecode generation (using the ASM library) to achieve high performance.
openLooKeng maintains a three‑month release cadence, continuing to provide a fast, minimalist data experience. Download links and a QR code for the new version are available below.
Signed-in readers can open the original source through BestHub's protected redirect.
This article has been distilled and summarized from source material, then republished for learning and reference. If you believe it infringes your rights, please contactand we will review it promptly.
Huawei Cloud Developer Alliance
The Huawei Cloud Developer Alliance creates a tech sharing platform for developers and partners, gathering Huawei Cloud product knowledge, event updates, expert talks, and more. Together we continuously innovate to build the cloud foundation of an intelligent world.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.
