BestHub
Sign in
Tag

compression

1 views collected around this technical thread.

Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
May 22, 2025 · Big Data

Optimizing Kafka Producer for High Throughput: Batching, Asynchronous Sending, Compression, and Concurrency

This article details practical techniques for boosting Kafka producer throughput, covering batch sending optimization, linger.ms tuning, asynchronous send handling, compression options, and concurrent sending strategies, while providing code examples and performance considerations for high‑throughput streaming applications.

BatchingKafkaasynchronous
0 likes · 4 min read
Optimizing Kafka Producer for High Throughput: Batching, Asynchronous Sending, Compression, and Concurrency
Qunar Tech Salon
Qunar Tech Salon
May 9, 2025 · Operations

Kafka Production Optimization: Reducing Load and Improving Compression via Filebeat Tuning

This technical case study details how a high‑traffic Kafka logging cluster was optimized by adjusting Filebeat and Kafka parameters, increasing compression batch size, and tuning Kubernetes settings, resulting in significant reductions in request volume, network traffic, CPU usage, and overall resource consumption.

FilebeatKafkaKubernetes
0 likes · 10 min read
Kafka Production Optimization: Reducing Load and Improving Compression via Filebeat Tuning
Java Architect Essentials
Java Architect Essentials
Apr 27, 2025 · Backend Development

Concept-Download: A Spring‑Based Library for Simplified File Download, Compression and Reactive Streaming

This article introduces a Spring‑compatible download library that lets developers annotate a single method to download arbitrary objects—files, HTTP resources, or custom objects—while handling caching, concurrent loading, compression, and reactive response writing for both MVC and WebFlux environments.

AnnotationJavaReactive Programming
0 likes · 14 min read
Concept-Download: A Spring‑Based Library for Simplified File Download, Compression and Reactive Streaming
Raymond Ops
Raymond Ops
Apr 16, 2025 · Operations

How to Enable and Optimize Gzip Compression in Nginx for Faster Websites

This guide explains how to activate gzip compression in Nginx, configure its compression level, buffer size, and minimum file size, and apply it to both static and dynamic responses, providing step‑by‑step examples to improve web performance.

NginxServer Configurationcompression
0 likes · 5 min read
How to Enable and Optimize Gzip Compression in Nginx for Faster Websites
OPPO Kernel Craftsman
OPPO Kernel Craftsman
Dec 13, 2024 · Fundamentals

Overview of H.266/VVC Video Coding Standard and Its Key Technologies

H.266/VVC, the next‑generation video coding standard finalized in 2020, delivers roughly 50 % bitrate savings over H.265/HEVC with modestly higher decoding complexity, introduces advanced intra‑ and inter‑prediction, transform, quantization, entropy and loop‑filtering tools, and faces patent‑pool and adoption challenges before widespread smartphone integration around 2026.

Encoding StandardsH.266VVC
0 likes · 20 min read
Overview of H.266/VVC Video Coding Standard and Its Key Technologies
Architecture Development Notes
Architecture Development Notes
Nov 22, 2024 · Backend Development

Build a Fast Rust Gzip Compressor: Step‑by‑Step Tutorial

This tutorial walks you through creating a simple yet efficient Gzip compression tool in Rust, covering project setup, dependency configuration, full source code, command‑line parsing with clap, file handling, compression using flate2, performance measurement, and execution instructions.

Rustclicompression
0 likes · 6 min read
Build a Fast Rust Gzip Compressor: Step‑by‑Step Tutorial
Tencent Architect
Tencent Architect
Oct 25, 2024 · Artificial Intelligence

How Tencent’s TVQA‑C Algorithm Won the ECCV 2024 Video Quality Challenge

Tencent’s TVQA‑C video quality assessment algorithm clinched first place in the ECCV 2024 AIM Workshop compression video quality track, showcasing a novel model architecture, group‑aware training strategy, and specialized loss functions that will soon power Tencent Cloud’s media processing services.

AIECCV 2024Tencent
0 likes · 10 min read
How Tencent’s TVQA‑C Algorithm Won the ECCV 2024 Video Quality Challenge
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Oct 18, 2024 · Fundamentals

Fundamentals of Audio and Video Processing, Compression, and Streaming Protocols

This article provides a comprehensive overview of audio and video fundamentals, including signal conversion, PCM encoding, compression techniques, spatial audio concepts, video encoding standards such as H.264/H.265, streaming protocols, bitrate control, and practical optimization algorithms for both audio and video pipelines.

Audio ProcessingVideo Encodingcompression
0 likes · 49 min read
Fundamentals of Audio and Video Processing, Compression, and Streaming Protocols
Aikesheng Open Source Community
Aikesheng Open Source Community
Jul 22, 2024 · Databases

Performance Comparison of Local, Remote, and Percona XtraBackup 8.0 Backup Methods for MySQL

This article evaluates MySQL backup strategies using Percona XtraBackup, comparing local, remote, and streaming modes in terms of backup duration, primary server load impact, and backup file size, and provides practical recommendations based on detailed test results.

BackupMySQLPercona XtraBackup
0 likes · 17 min read
Performance Comparison of Local, Remote, and Percona XtraBackup 8.0 Backup Methods for MySQL
vivo Internet Technology
vivo Internet Technology
Jul 17, 2024 · Frontend Development

Optimizing 3D Model Loading and First‑Frame Rendering with Three.js, ZIP Packaging, and WASM Decompression

By compressing GLB files into ZIP, extending Three.js loaders to unzip via a Rust‑compiled WASM tool, encrypting small buffers, and caching morph‑target shaders while spreading mesh rendering across frames, the team shrank model size from 50 MB to 11 MB and cut first‑frame render time from 7 seconds to 0.6 seconds, reducing overall page load from 15 seconds to 5 seconds.

3D model optimizationThree.jsWasm
0 likes · 11 min read
Optimizing 3D Model Loading and First‑Frame Rendering with Three.js, ZIP Packaging, and WASM Decompression
Deepin Linux
Deepin Linux
May 30, 2024 · Fundamentals

Understanding Linux Kernel Memory Compression and the Zsmalloc Allocator

This article explains the fragmentation problems of the Linux slab allocator, introduces the zsmalloc memory allocator and its requirements, surveys mainstream kernel memory‑compression techniques such as zSwap, zRAM and zCache, and details related allocators like Zbud and Z3fold with example source code.

LinuxMemory ManagementOperating Systems
0 likes · 11 min read
Understanding Linux Kernel Memory Compression and the Zsmalloc Allocator
Code Ape Tech Column
Code Ape Tech Column
Mar 28, 2024 · Backend Development

A Reactive Download Library for Spring MVC and WebFlux: Design, Implementation, and Usage

This article introduces a Java library that simplifies file download in Spring applications by using a @Download annotation, supporting various source types, reactive and servlet environments, concurrent loading, compression, and customizable handlers, and details its architecture, code examples, and practical considerations.

AnnotationJavaReactive
0 likes · 16 min read
A Reactive Download Library for Spring MVC and WebFlux: Design, Implementation, and Usage
ByteDance Cloud Native
ByteDance Cloud Native
Mar 27, 2024 · Cloud Native

How ByteDance Optimized Its Metrics Agent for 70% CPU Savings

This article details how ByteDance's cloud‑native observability team tackled performance bottlenecks in their metricserver2 Agent—reducing memory copies, merging tiny packets, applying SIMD for tag parsing, and switching compression libraries—to cut CPU usage by over 10% and memory usage by nearly 20% while handling petabyte‑scale metric data.

C++ObservabilitySIMD
0 likes · 15 min read
How ByteDance Optimized Its Metrics Agent for 70% CPU Savings
JD Tech
JD Tech
Mar 14, 2024 · Databases

JD ElasticSearch Supports ZSTD Compression: Implementation, Performance Evaluation, and Usage Guide

This article explains how JD ElasticSearch has integrated the high‑performance ZSTD compression algorithm, details the motivations behind its adoption, presents benchmark results comparing it with LZ4 and best_compression, and provides step‑by‑step instructions and code snippets for configuring and using the new jd_zstd codec in Elasticsearch.

BigDataElasticsearchJava
0 likes · 14 min read
JD ElasticSearch Supports ZSTD Compression: Implementation, Performance Evaluation, and Usage Guide
Sohu Tech Products
Sohu Tech Products
Feb 28, 2024 · Big Data

Why Use Zarr? Storing and Accessing Large NumPy Arrays with mmap and Zarr

Zarr provides a modern, chunked and compressed storage format that lets you treat massive NumPy arrays like in‑memory objects, offering on‑demand loading, flexible back‑ends (disk, S3, zip), automatic caching, resizing, parallel reads/writes, and superior performance compared to traditional mmap‑based memmap files.

MMAPNumPyPython
0 likes · 18 min read
Why Use Zarr? Storing and Accessing Large NumPy Arrays with mmap and Zarr
JD Retail Technology
JD Retail Technology
Jan 26, 2024 · Backend Development

Nginx Gzip Compression Optimization: Boosting Performance by Over 50×

This article documents a real‑world nginx performance tuning case where adjusting gzip settings and switching to static compression reduced CPU usage dramatically and increased QPS from 5 w to 27 w, achieving more than a fifty‑fold overall performance improvement.

BackendNginxOptimization
0 likes · 8 min read
Nginx Gzip Compression Optimization: Boosting Performance by Over 50×
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
Jan 24, 2024 · Mobile Development

Optimizing Hermes Bytecode Bundle Size and SourceMap Handling in React Native

To counter the 40‑100 % size increase of Hermes bytecode bundles after upgrading to React Native 0.70, the team switched to xz compression (cutting zip size 20‑26 %), enabled hermesc ‑O optimization (shrinking bundles 10‑22 % while requiring a two‑step source‑map merge), and used the ‑base‑bytecode option with bsdiff to reduce incremental OTA patches by up to 85 %, collectively improving download and update efficiency.

BytecodeHermesIncremental Update
0 likes · 13 min read
Optimizing Hermes Bytecode Bundle Size and SourceMap Handling in React Native
php中文网 Courses
php中文网 Courses
Dec 20, 2023 · Backend Development

PHP Code Compression and Optimization Techniques

This article explains how to improve PHP web application performance by removing unnecessary whitespace and semicolons, leveraging caching, and using built‑in functions such as isset, empty, and count, with concrete code examples for each technique.

cachingcode optimizationcompression
0 likes · 6 min read
PHP Code Compression and Optimization Techniques
JD Tech
JD Tech
Nov 30, 2023 · Artificial Intelligence

Understanding ChatGPT: Mechanisms, Attention, Emergence, and the Chinese Room

This article examines the principles behind ChatGPT, detailing its continuation-based operation, the role of attention mechanisms and transformer architecture, the scaling of neural networks that leads to emergent abilities, and interprets these phenomena through the lenses of compression theory and the Chinese Room thought experiment.

ChatGPTEmergenceLarge Language Models
0 likes · 27 min read
Understanding ChatGPT: Mechanisms, Attention, Emergence, and the Chinese Room