Tagged articles
Zstd
16 articles · Page 1 of 1
This article analyzes OkHttp 5.5's features, concluding that Encrypted Client Hello (ECH) requires Android 17 and offers limited immediate value, while versions 5.2–5.4 deliver practical upgrades like Zstd compression, 16KB page alignment, enhanced interceptor permissions, DNS-over-HTTPS, and QUERY method support, recommending a staged upgrade starting with 5.4.
AndroidDNS-over-HTTPSECH
0 likes · 11 min read

A midnight bandwidth alarm triggers a deep dive into message compression, revealing how algorithm choice, compression placement, batch handling, and selective policies evolve from simple no‑compression setups to multi‑layered strategies that balance CPU, bandwidth, disk costs, and latency in million‑QPS systems.
KafkaZstdbatch compression
0 likes · 20 min read

This article details Zhihu's comprehensive cost‑reduction and efficiency‑boosting initiatives for its big‑data platform, covering FinOps‑driven financial operations, hybrid‑cloud architecture, cost allocation models, operational monitoring, and technical optimizations such as erasure coding, ZSTD compression, Spark auto‑tuning, and a remote shuffle service.
Cloud Cost ManagementCost OptimizationErasure Coding
0 likes · 22 min read

Uber’s data lake on Hadoop stores hundreds of petabytes in Parquet files and, by adopting ZSTD compression, column pruning, and column reordering, achieves up to 79% storage reduction and significant vCore savings, with detailed benchmarks guiding optimal compression levels and open‑source contributions.
Apache ParquetCompressionHadoop
0 likes · 14 min read

This article explains how JD ElasticSearch has integrated the high‑performance ZSTD compression algorithm, details the motivations behind its adoption, presents benchmark results comparing it with LZ4 and best_compression, and provides step‑by‑step instructions and code snippets for configuring and using the new jd_zstd codec in Elasticsearch.
CompressionElasticsearchJava
0 likes · 14 min read

Switching a Java Netty gateway from GZIP to ZSTD compression using zstd‑jni doubled GC time and introduced heap and Netty off‑heap memory leaks, which were resolved by employing the library’s direct off‑heap API with a NoFinalizer compressor, promptly releasing ByteBufs, avoiding finalize(), and adopting jemalloc to reduce fragmentation.
GCJavaMemoryLeak
0 likes · 19 min read

By integrating ZSTD compression into Didi’s Elasticsearch 7.6, the team cut CPU usage by about 15 %, reduced index storage roughly 30 %, boosted write throughput up to 25 %, and eliminated over 20 servers, demonstrating a faster, more storage‑efficient solution for petabyte‑scale log ingestion.
CompressionElasticsearchLucene
0 likes · 10 min read

This article explains how Linux memory compression techniques such as zSwap, zRAM, and the Zstandard algorithm reduce I/O pressure, extend flash lifespan, and improve overall system performance, while also covering their drawbacks and step‑by‑step activation procedures.
LinuxMemory CompressionZstd
0 likes · 6 min read

Memory compression techniques like Linux's zSwap, zRAM, and the zstd algorithm reduce I/O latency and extend RAM capacity by compressing swap pages, offering performance gains while introducing trade‑offs such as CPU overhead and configuration complexity, and this guide explains their principles, advantages, drawbacks, and activation steps.
LinuxMemory CompressionSystem Performance
0 likes · 6 min read

This article explains how introducing a remote cache backed by CFS and Zstandard compression into cloud‑native CI/CD pipelines dramatically reduces build times by 3‑5 times, outlines the implementation steps, tool choices, cache key strategy, eviction policy, and showcases performance gains across Java, Node.js, Go, and GCC builds.
CFSCI/CDCaching
0 likes · 10 min read

AWS switched S3 log compression from gzip to Zstandard, saving roughly 30% of storage space—equivalent to exabytes—by changing the internal storage method, a move confirmed by employee comments and a coinciding 31% price drop in late 2021.
AWSCompressionCost Optimization
0 likes · 4 min read

Linux kernel version 5.19 has entered its fifth release candidate (RC5), with Linus Torvalds noting a low patch count focused on driver fixes, architecture updates, and filesystem and networking improvements, and introducing support for LoongArch CPUs, Apple NVMe, Zstd-compressed firmware, and FAT32 creation timestamps, with the stable release slated for late July.
LinuxLoongArchNVMe
0 likes · 2 min read

This guide explains what Zstandard (zstd) is, shows how to install it on major Linux distributions, and provides step‑by‑step commands for compressing single or multiple files, checking compression ratios, and decompressing archives safely.
LinuxZstdfile compression
0 likes · 6 min read

By integrating SIMD‑accelerated ISA‑L and parallel Zstandard (Pzstd) into Meituan’s build‑and‑deployment pipeline, compression time for typical 200 MiB–1 GiB packages dropped from over a minute to about one second—a 90%‑plus speedup that preserves gzip compatibility while dramatically accelerating overall build latency.
CompressionISA‑LZstd
0 likes · 21 min read

The article explains MySQL 8.0.20's binlog transaction compression feature using the ZSTD algorithm, describes its internal implementation, outlines usage steps, presents performance test results, and lists important considerations for deploying compression in production environments.
CompressionMySQLZstd
0 likes · 6 min read


ITPUBApr 3, 2019 · Operations
Arch Linux maintainers replaced the single‑threaded xz compression in devtools with Facebook's fast, multithreaded Zstandard algorithm at level ‑18, achieving dramatically higher compression and decompression speeds and more stable parallel processing, which will speed up pacman package installations.
Arch LinuxCompressionDevTools
0 likes · 3 min read
