BestHub
Sign in
Tagged articles
216 articles
Page 1 of 3
Machine Heart
Machine Heart
May 21, 2026 · Artificial Intelligence

How GaussianPile Enables 3DGS to Reconstruct Internal Structures from Slice‑Based Volumetric Images

GaussianPile extends 3D Gaussian Splatting to slice‑based volumetric data by embedding finite slice thickness and focus depth into the rendering pipeline, achieving up to 20‑26× compression, 8‑minute training, and superior 2D/3D PSNR/SSIM compared with HEVC, INR/NeRF and standard 3DGS on medical imaging datasets.

3DGSGaussianPilecompression
0 likes · 11 min read
How GaussianPile Enables 3DGS to Reconstruct Internal Structures from Slice‑Based Volumetric Images
DataFunSummit
DataFunSummit
May 10, 2026 · Big Data

How Lance File Format v2.2 Accelerates, Cuts Costs, and Governs Multimodal Data

Lance File Format v2.2 tackles the AI data explosion by delivering hundred‑fold random‑read performance, advanced two‑layer compression, zero‑cost schema evolution, Git‑style versioning, external blob handling, and a roadmap toward native media support and intelligent encoding, positioning it as a core infrastructure for large‑scale multimodal workloads.

Data GovernanceFile FormatIO performance
0 likes · 14 min read
How Lance File Format v2.2 Accelerates, Cuts Costs, and Governs Multimodal Data
IT Services Circle
IT Services Circle
May 6, 2026 · Fundamentals

Why Does a .tar.gz File Have Two Extensions?

The article explains that the .tar.gz suffix reflects two separate Unix tools—tar for archiving and gzip for compression—combined via a pipeline, tracing their historical origins, design philosophy, and why this dual‑extension format remains prevalent today.

GzipUnixarchiving
0 likes · 10 min read
Why Does a .tar.gz File Have Two Extensions?
Linux Tech Enthusiast
Linux Tech Enthusiast
May 4, 2026 · Operations

Essential Linux Commands Every Sysadmin Should Know

This guide compiles the most frequently used Linux commands for system administrators, covering navigation, file manipulation, searching, permission handling, text processing, archiving, system control, and process management, complete with practical examples and option details to boost daily operational efficiency.

LinuxNetworkingShell
0 likes · 15 min read
Essential Linux Commands Every Sysadmin Should Know
Architect
Architect
Apr 28, 2026 · Artificial Intelligence

Agent Harness Context: Chat Log vs. Workset – How Runtime Management Shapes Long‑Running Agents

The article argues that an agent harness’s context window should be treated as a bounded workset rather than an ever‑growing transcript, and explains how pagination, compression, tool‑output limits, session isolation, and sub‑agent design together determine whether long‑running agents remain reliable and efficient.

Agent HarnessLLMSession
0 likes · 24 min read
Agent Harness Context: Chat Log vs. Workset – How Runtime Management Shapes Long‑Running Agents
Machine Heart
Machine Heart
Apr 20, 2026 · Artificial Intelligence

Why Compression Is the Core of Mathematics and AI, According to Michael Freedman

In an interview, Fields Medalist Michael Freedman explains how his new paper shows that mathematical reasoning is fundamentally about compression, presents statistical analysis of the Lean mathlib library revealing astronomically large unfolded statements versus compact token representations, and argues that understanding this compression is key to future human‑AI collaboration in mathematics.

Artificial IntelligenceLeancompression
0 likes · 14 min read
Why Compression Is the Core of Mathematics and AI, According to Michael Freedman
Architect's Guide
Architect's Guide
Apr 12, 2026 · Fundamentals

Why 7‑Zip Beats WinRAR: License, Features, and Compression Ratio Explained

The article explains that 7‑Zip is an open‑source compression program released under GNU LGPL (with AES under BSD and unRAR under dual licenses), highlights its key features, compares its compression ratios to WinRAR using Firefox and Google Earth files, and provides the GitHub repository link.

7-ZipFile CompressionGitHub
0 likes · 3 min read
Why 7‑Zip Beats WinRAR: License, Features, and Compression Ratio Explained
Linux Tech Enthusiast
Linux Tech Enthusiast
Apr 11, 2026 · Fundamentals

Essential Linux Commands, Directory Structure, and Vim Shortcuts

This guide introduces Linux's directory hierarchy, explains the most frequently used command‑line operations—including file handling, system utilities, compression, and permission management—and provides a concise overview of common Vim editing shortcuts.

CLIDirectory StructureFile Permissions
0 likes · 5 min read
Essential Linux Commands, Directory Structure, and Vim Shortcuts
Code Mala Tang
Code Mala Tang
Mar 25, 2026 · Fundamentals

How to Build a gzip Decompressor in Rust – Inside DEFLATE, Huffman & LZ77

The article walks through creating a compact 250‑line Rust gzip decompressor from scratch, explaining gzip’s header, DEFLATE block types, bit‑reading logic, Huffman coding, and LZ77 back‑references, and shows how to test it with real compressed data, highlighting key implementation challenges and trade‑offs.

DEFLATEGzipHuffman
0 likes · 14 min read
How to Build a gzip Decompressor in Rust – Inside DEFLATE, Huffman & LZ77
Linux Kernel Journey
Linux Kernel Journey
Mar 22, 2026 · Fundamentals

Understanding EROFS: A Read‑Only Linux File System for Immutable Deployments

EROFS is a security‑focused, high‑performance read‑only Linux kernel file system designed for immutable scenarios such as container images, OS partitions, and AI model distribution, offering block‑aligned storage, minimal metadata, native compression, and host‑side page‑cache sharing to improve startup speed and reduce storage overhead.

EROFSLinux kernelcompression
0 likes · 15 min read
Understanding EROFS: A Read‑Only Linux File System for Immutable Deployments
PaperAgent
PaperAgent
Mar 21, 2026 · Artificial Intelligence

How Cursor’s Composer 2 Leverages Self‑Summarization and RL for Long‑Horizon Tasks

The article examines Cursor’s Composer 2 model, detailing its self‑summarization reinforcement‑learning workflow, the limitations of traditional compression methods, token‑efficient results on the CursorBench benchmark, and a challenging Terminal‑Bench case study that demonstrates dramatically reduced token usage while improving performance.

Agentic AIComposer 2Cursor
0 likes · 9 min read
How Cursor’s Composer 2 Leverages Self‑Summarization and RL for Long‑Horizon Tasks
Architect
Architect
Mar 11, 2026 · Artificial Intelligence

How OpenClaw Manages Context: Multi‑Layer Compression, Memory Persistence, and Overflow Recovery

This article explains OpenClaw's sophisticated context‑management system, detailing its three‑layer approach to pruning old turns, trimming tool results, and handling oversized outputs, while preserving critical state through memory flushing, structured compaction, and a robust overflow‑recovery pipeline.

LLM agentscompressionmemory persistence
0 likes · 29 min read
How OpenClaw Manages Context: Multi‑Layer Compression, Memory Persistence, and Overflow Recovery
AI Tech Publishing
AI Tech Publishing
Mar 6, 2026 · Artificial Intelligence

How Codex CLI Compresses Context: Inside the compact() API

The article dissects Codex CLI's two compression paths—local LLM summarization for non‑Codex models and an encrypted compact() API for Codex models—by injecting prompts, extracting system, handoff, and compression prompts, and comparing them with open‑source references to reveal the underlying mechanism.

API analysisCodex CLILLM
0 likes · 5 min read
How Codex CLI Compresses Context: Inside the compact() API
Tech Musings
Tech Musings
Jan 2, 2026 · Information Security

Why MongoDB’s CVE‑2025‑14847 Lets Attackers Leak Secrets Like Heartbleed

The article explains the CVE‑2025‑14847 MongoDB vulnerability, detailing how crafted BSON with a falsified document length triggers memory over‑read, demonstrates a reproducible PoC, compares it to the SSL Heartbleed bug, and offers mitigation advice for affected deployments.

CVE-2025-14847HeartbleedMongoDB
0 likes · 8 min read
Why MongoDB’s CVE‑2025‑14847 Lets Attackers Leak Secrets Like Heartbleed
php Courses
php Courses
Dec 24, 2025 · Backend Development

How to Compress and Optimize PHP Code for Faster Web Apps

This guide explains why code size and efficiency matter for web applications and provides practical PHP techniques—including whitespace removal, caching strategies, and built‑in functions like isset, empty, and count—to dramatically reduce file size and improve runtime performance.

BackendCode Optimizationcaching
0 likes · 5 min read
How to Compress and Optimize PHP Code for Faster Web Apps
Data STUDIO
Data STUDIO
Dec 5, 2025 · Big Data

Why Parquet Is the Default Choice for Big Data Storage

The article explains how Apache Parquet’s columnar layout, multi‑level row‑group structure, projection and predicate push‑down, and advanced compression and encoding make it the high‑performance, space‑efficient storage format that powers modern big‑data ecosystems and tools like Spark, Python pandas, and ClickHouse.

Big DataColumnar StorageParquet
0 likes · 11 min read
Why Parquet Is the Default Choice for Big Data Storage
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Dec 3, 2025 · Big Data

Kafka High‑Throughput Tricks: Sequential Writes, Zero‑Copy, Partitioning

The article explains how Kafka achieves high throughput by writing messages sequentially to disk, leveraging OS page cache and zero‑copy system calls, using partitioned topics for parallelism, batching and compressing records on both producer and broker sides, and employing asynchronous replication with configurable persistence strategies.

BatchingHigh ThroughputKafka
0 likes · 4 min read
Kafka High‑Throughput Tricks: Sequential Writes, Zero‑Copy, Partitioning
Liangxu Linux
Liangxu Linux
Nov 8, 2025 · Operations

Linux Compression Mastery: tar, gzip, zip Deep Dive with Real‑World Scripts

This comprehensive guide explains Linux compression and archiving tools—including tar, gzip, and zip—covers their algorithms, performance trade‑offs, practical command examples, real‑world backup scenarios, optimization techniques, monitoring, security, and automation, helping engineers efficiently manage data across diverse environments.

LinuxShellcompression
0 likes · 35 min read
Linux Compression Mastery: tar, gzip, zip Deep Dive with Real‑World Scripts
IT Services Circle
IT Services Circle
Sep 29, 2025 · Artificial Intelligence

How Memvid Stores AI Knowledge in MP4 Videos with 10× Less Space

Memvid replaces traditional vector databases by encoding text chunks as QR codes inside MP4 video frames, achieving up to ten‑fold storage reduction, millisecond‑level semantic search, zero‑infrastructure deployment, and a built‑in conversational interface, while providing a fast‑install Python SDK and CLI.

AIMemvidcompression
0 likes · 9 min read
How Memvid Stores AI Knowledge in MP4 Videos with 10× Less Space
Open Source Linux
Open Source Linux
Sep 9, 2025 · Operations

Master Linux Compression: Choose tar, gzip or zip and Apply Real‑World Best Practices

This comprehensive guide explains Linux compression and decompression fundamentals, compares tar, gzip, and zip commands, provides detailed syntax, performance benchmarks, practical scripts, automation techniques, monitoring, security considerations, cloud integration, and future trends for reliable data handling in modern operations.

BackupGzipLinux
0 likes · 39 min read
Master Linux Compression: Choose tar, gzip or zip and Apply Real‑World Best Practices
ITPUB
ITPUB
Sep 3, 2025 · Backend Development

How We Boosted Kafka Throughput by 35% with Filebeat Tuning and Compression Tricks

This case study details how a high‑traffic Kafka logging cluster was optimized by analyzing low compression ratios, tuning Filebeat parameters, adjusting memory queues and round‑robin settings, and validating the changes through gray‑scale tests, resulting in up to 35% higher throughput and significant resource savings.

FilebeatKafkacompression
0 likes · 10 min read
How We Boosted Kafka Throughput by 35% with Filebeat Tuning and Compression Tricks
Ops Community
Ops Community
Sep 1, 2025 · Operations

Master Linux Compression: Compare tar, gzip, zip and Real‑World Tips

This comprehensive guide explores Linux compression and decompression, detailing the fundamentals of tar, gzip, and zip, comparing performance, providing practical command examples, advanced techniques, automation scripts, monitoring, security considerations, and real‑world case studies to help engineers choose the right tool for efficient data handling.

BackupGzipcompression
0 likes · 44 min read
Master Linux Compression: Compare tar, gzip, zip and Real‑World Tips
Raymond Ops
Raymond Ops
Aug 29, 2025 · Operations

Mastering Nginx Gzip: When, How, and Common Pitfalls

Compressing HTTP responses with Nginx gzip improves user experience by reducing load times and cuts bandwidth costs, while proper configuration—such as setting compression level, buffer sizes, MIME types, and handling static compression—avoids common mistakes that can render gzip ineffective in production environments.

BackendGzipNginx
0 likes · 6 min read
Mastering Nginx Gzip: When, How, and Common Pitfalls
Raymond Ops
Raymond Ops
Jul 1, 2025 · Databases

Master MySQL Backups: Commands for Single DB, Multiple DBs, Compression & Restoration

This guide explains how to use mysqldump to back up individual databases, multiple databases, all databases, specific tables, and how to compress backups, include drop statements, export only schema, and restore data using both interactive and non‑interactive MySQL commands, plus an automated backup script.

Bash scriptDatabase BackupRestore
0 likes · 9 min read
Master MySQL Backups: Commands for Single DB, Multiple DBs, Compression & Restoration
Code Ape Tech Column
Code Ape Tech Column
Jun 30, 2025 · Backend Development

Mastering Software Performance: 6 Time‑Space Trade‑offs and 4 Advanced Parallel Techniques

This article explores practical performance‑optimization techniques, covering six fundamental time‑for‑space trade‑offs such as indexing, compression, caching, prefetching, peak‑shaving, and batch processing, followed by four advanced methods that boost parallelism like resource draining, horizontal scaling, sharding, and lock‑free programming.

BackendBatch Processingcaching
0 likes · 22 min read
Mastering Software Performance: 6 Time‑Space Trade‑offs and 4 Advanced Parallel Techniques
dbaplus Community
dbaplus Community
Jun 25, 2025 · Operations

How We Boosted Kafka Production Capacity by 35% with Simple Compression Tweaks

Facing petabyte‑scale log traffic, the Qunar team identified low compression rates in their Kafka‑Filebeat pipeline as the main bottleneck and, through systematic tuning of batch size, memory queues, and round‑robin settings, achieved a 35% reduction in traffic and a 30‑42% drop in request volume while raising per‑minute throughput by 35%.

BackendFilebeatKafka
0 likes · 10 min read
How We Boosted Kafka Production Capacity by 35% with Simple Compression Tweaks
Open Source Linux
Open Source Linux
Jun 18, 2025 · Operations

Boost Apache Performance: 4 Proven Techniques to Speed Up Your Site by 70%

This guide walks you through four practical Apache optimizations—web compression, caching, hotlink protection, and version information hiding—explaining why they matter, how to configure them with step‑by‑step commands, and the measurable performance and security benefits they deliver.

ApacheWeb Performancecompression
0 likes · 9 min read
Boost Apache Performance: 4 Proven Techniques to Speed Up Your Site by 70%
Senior Tony
Senior Tony
Jun 8, 2025 · Backend Development

Why Kafka Handles Millions of Messages Per Second: Batch, Partition, Zero‑Copy, and Compression Explained

This article breaks down the core techniques that give Kafka its high‑throughput capability, including producer batch settings (batch.size, linger.ms), broker append‑only writes, consumer poll configuration, partition distribution, zero‑copy data transfer, dual‑thread processing, and configurable compression algorithms.

Batch ProcessingConsumerHigh Throughput
0 likes · 8 min read
Why Kafka Handles Millions of Messages Per Second: Batch, Partition, Zero‑Copy, and Compression Explained
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
May 22, 2025 · Big Data

Optimizing Kafka Producer for High Throughput: Batching, Asynchronous Sending, Compression, and Concurrency

This article details practical techniques for boosting Kafka producer throughput, covering batch sending optimization, linger.ms tuning, asynchronous send handling, compression options, and concurrent sending strategies, while providing code examples and performance considerations for high‑throughput streaming applications.

AsynchronousBatchingHigh Throughput
0 likes · 4 min read
Optimizing Kafka Producer for High Throughput: Batching, Asynchronous Sending, Compression, and Concurrency
Java Architect Essentials
Java Architect Essentials
Apr 27, 2025 · Backend Development

Concept-Download: A Spring‑Based Library for Simplified File Download, Compression and Reactive Streaming

This article introduces a Spring‑compatible download library that lets developers annotate a single method to download arbitrary objects—files, HTTP resources, or custom objects—while handling caching, concurrent loading, compression, and reactive response writing for both MVC and WebFlux environments.

File DownloadWebFluxannotation
0 likes · 14 min read
Concept-Download: A Spring‑Based Library for Simplified File Download, Compression and Reactive Streaming
Liangxu Linux
Liangxu Linux
Mar 9, 2025 · Backend Development

Mastering Nginx Gzip: Configuration, Tips, and Common Pitfalls

Compressing HTTP responses with Nginx gzip improves user experience by reducing load times and cuts bandwidth costs, while proper directives, static gzip handling, and awareness of common misconfigurations ensure optimal performance in production environments.

BackendGzipOps
0 likes · 6 min read
Mastering Nginx Gzip: Configuration, Tips, and Common Pitfalls
AIWalker
AIWalker
Feb 22, 2025 · Artificial Intelligence

DC‑AE: A 128× Downsampling Autoencoder that Super‑Charges High‑Resolution Diffusion Models

DC‑AE introduces Residual Autoencoding and Decoupled High‑Resolution Adaptation to achieve up to 128× spatial compression in autoencoders, preserving reconstruction quality while delivering roughly 19× inference and 18× training speedups for high‑resolution diffusion models, as demonstrated on ImageNet and other benchmarks.

AutoencoderDiffusion Modelscompression
0 likes · 13 min read
DC‑AE: A 128× Downsampling Autoencoder that Super‑Charges High‑Resolution Diffusion Models
Liangxu Linux
Liangxu Linux
Jan 19, 2025 · Operations

Linux Compression & Archiving Essentials: compress, gzip, bzip2, xz, zip, tar, cpio

This guide reviews the most common Linux compression and archiving utilities—compress, gzip, bzip2, xz, zip, tar, and cpio—detailing their file formats, key options for compressing, decompressing, preserving original files, displaying progress, and adjusting compression levels with practical command examples.

Gziparchivingcommand-line
0 likes · 9 min read
Linux Compression & Archiving Essentials: compress, gzip, bzip2, xz, zip, tar, cpio
ITPUB
ITPUB
Jan 5, 2025 · Operations

How to Boost Web App Performance 10× with NGINX: 10 Proven Tips

This article explains why web‑application speed is critical, presents ten concrete NGINX‑based techniques—including reverse proxy, load balancing, caching, compression, SSL/TLS tuning, HTTP/2, software updates, Linux and server tuning, and real‑time monitoring—to achieve up to ten‑fold performance gains.

Linux TuningSSL/TLSWeb Performance
0 likes · 25 min read
How to Boost Web App Performance 10× with NGINX: 10 Proven Tips
OPPO Kernel Craftsman
OPPO Kernel Craftsman
Dec 13, 2024 · Fundamentals

Overview of H.266/VVC Video Coding Standard and Its Key Technologies

H.266/VVC, the next‑generation video coding standard finalized in 2020, delivers roughly 50 % bitrate savings over H.265/HEVC with modestly higher decoding complexity, introduces advanced intra‑ and inter‑prediction, transform, quantization, entropy and loop‑filtering tools, and faces patent‑pool and adoption challenges before widespread smartphone integration around 2026.

H.266MultimediaVVC
0 likes · 20 min read
Overview of H.266/VVC Video Coding Standard and Its Key Technologies
Tencent Architect
Tencent Architect
Oct 25, 2024 · Artificial Intelligence

How Tencent’s TVQA‑C Algorithm Won the ECCV 2024 Video Quality Challenge

Tencent’s TVQA‑C video quality assessment algorithm clinched first place in the ECCV 2024 AIM Workshop compression video quality track, showcasing a novel model architecture, group‑aware training strategy, and specialized loss functions that will soon power Tencent Cloud’s media processing services.

AIDeep LearningECCV 2024
0 likes · 10 min read
How Tencent’s TVQA‑C Algorithm Won the ECCV 2024 Video Quality Challenge
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Oct 18, 2024 · Fundamentals

Fundamentals of Audio and Video Processing, Compression, and Streaming Protocols

This article provides a comprehensive overview of audio and video fundamentals, including signal conversion, PCM encoding, compression techniques, spatial audio concepts, video encoding standards such as H.264/H.265, streaming protocols, bitrate control, and practical optimization algorithms for both audio and video pipelines.

Audio ProcessingStreaming ProtocolsVideo Encoding
0 likes · 49 min read
Fundamentals of Audio and Video Processing, Compression, and Streaming Protocols
Architecture and Beyond
Architecture and Beyond
Sep 7, 2024 · Backend Development

Six Proven Backend Techniques to Supercharge System Performance

This comprehensive guide walks backend architects through six core optimization methods—caching, batch processing, asynchronous handling, data compression, parallelization, and eliminating unnecessary requests—detailing their problem domains, implementation strategies, real‑world scenarios, benefits, and trade‑offs.

AsynchronousBackendBatch Processing
0 likes · 48 min read
Six Proven Backend Techniques to Supercharge System Performance
Liangxu Linux
Liangxu Linux
Sep 1, 2024 · Backend Development

How to Enable and Optimize Gzip Compression in Nginx for Faster Websites

Learn step-by-step how to activate gzip compression in Nginx, configure compression level, buffer size, minimum file size, and proxy settings, and understand the impact of each directive on bandwidth reduction and page load speed for both static and dynamic content.

BackendConfigurationGzip
0 likes · 5 min read
How to Enable and Optimize Gzip Compression in Nginx for Faster Websites
MaGe Linux Operations
MaGe Linux Operations
Aug 17, 2024 · Fundamentals

How to Create ZFS Filesystems and Enable Compression on Linux

This guide walks through creating a ZFS filesystem from a pool, setting quotas and reservations, configuring an alternate mount point, enabling compression, and verifying compression effectiveness, helping Linux users save disk space with ZFS.

FilesystemLinuxSystem Administration
0 likes · 6 min read
How to Create ZFS Filesystems and Enable Compression on Linux
FunTester
FunTester
Aug 15, 2024 · Backend Development

9 Proven Techniques to Supercharge Service Performance

This article outlines nine practical methods—caching, parallelization, batch processing, data compression, lock‑free design, sharding, request avoidance, pooling, and asynchronous handling—demonstrating how each can be applied to backend services to dramatically reduce latency and improve throughput.

AsynchronousBatch ProcessingParallelism
0 likes · 25 min read
9 Proven Techniques to Supercharge Service Performance
Liangxu Linux
Liangxu Linux
Aug 5, 2024 · Fundamentals

Master Linux File Compression: Zip, Rar, and Tar Commands Explained

This guide walks through the most common Linux compression and archiving tools—zip, unzip, rar, unrar, and tar—detailing file formats, command syntax, options for compression levels, encryption, and extraction, plus practical examples for each utility.

Linuxcommand-linecompression
0 likes · 8 min read
Master Linux File Compression: Zip, Rar, and Tar Commands Explained
vivo Internet Technology
vivo Internet Technology
Jul 17, 2024 · Frontend Development

Optimizing 3D Model Loading and First‑Frame Rendering with Three.js, ZIP Packaging, and WASM Decompression

By compressing GLB files into ZIP, extending Three.js loaders to unzip via a Rust‑compiled WASM tool, encrypting small buffers, and caching morph‑target shaders while spreading mesh rendering across frames, the team shrank model size from 50 MB to 11 MB and cut first‑frame render time from 7 seconds to 0.6 seconds, reducing overall page load from 15 seconds to 5 seconds.

3D model optimizationThree.jsWasm
0 likes · 11 min read
Optimizing 3D Model Loading and First‑Frame Rendering with Three.js, ZIP Packaging, and WASM Decompression
Deepin Linux
Deepin Linux
May 30, 2024 · Fundamentals

Understanding Linux Kernel Memory Compression and the Zsmalloc Allocator

This article explains the fragmentation problems of the Linux slab allocator, introduces the zsmalloc memory allocator and its requirements, surveys mainstream kernel memory‑compression techniques such as zSwap, zRAM and zCache, and details related allocators like Zbud and Z3fold with example source code.

LinuxOperating Systemscompression
0 likes · 11 min read
Understanding Linux Kernel Memory Compression and the Zsmalloc Allocator
MaGe Linux Operations
MaGe Linux Operations
Apr 10, 2024 · Fundamentals

How to Compress and Decompress ZIP and TAR Files in Python

This guide explains how to use Python's built‑in zipfile and tarfile modules to compress individual files or entire directories into ZIP or TAR archives, traverse archive contents, and extract them, covering both plain TAR and compressed variants such as .tar.gz.

File Compressioncompressiondecompression
0 likes · 6 min read
How to Compress and Decompress ZIP and TAR Files in Python
WeChat Client Technology Team
WeChat Client Technology Team
Apr 9, 2024 · Databases

How WCDB Evolved: Multi‑Language Support, Powerful SQL Builder, and Ultra‑Fast Backup

This article details the major upgrades of WCDB, including expanded language support, a redesigned Winq SQL builder, robust data backup and repair mechanisms, seamless data migration, on‑the‑fly compression, automatic column addition, and performance optimizations such as interruptible transactions and WAL header improvements.

DataBackupMulti-languageORM
0 likes · 49 min read
How WCDB Evolved: Multi‑Language Support, Powerful SQL Builder, and Ultra‑Fast Backup
Code Ape Tech Column
Code Ape Tech Column
Mar 28, 2024 · Backend Development

A Reactive Download Library for Spring MVC and WebFlux: Design, Implementation, and Usage

This article introduces a Java library that simplifies file download in Spring applications by using a @Download annotation, supporting various source types, reactive and servlet environments, concurrent loading, compression, and customizable handlers, and details its architecture, code examples, and practical considerations.

File Downloadannotationbackend-development
0 likes · 16 min read
A Reactive Download Library for Spring MVC and WebFlux: Design, Implementation, and Usage
ByteDance Cloud Native
ByteDance Cloud Native
Mar 27, 2024 · Cloud Native

How ByteDance Optimized Its Metrics Agent for 70% CPU Savings

This article details how ByteDance's cloud‑native observability team tackled performance bottlenecks in their metricserver2 Agent—reducing memory copies, merging tiny packets, applying SIMD for tag parsing, and switching compression libraries—to cut CPU usage by over 10% and memory usage by nearly 20% while handling petabyte‑scale metric data.

MsgpackSIMDc++
0 likes · 15 min read
How ByteDance Optimized Its Metrics Agent for 70% CPU Savings
Liangxu Linux
Liangxu Linux
Mar 25, 2024 · Information Security

How to Use Gzip Compression to Overload Web Crawlers (Gzip Bomb Tutorial)

This guide shows how to create a tiny gzip‑compressed file, serve it with FastAPI, and exploit automatic decompression in Python's requests library to force a crawler to consume massive memory, effectively turning compression into a denial‑of‑service weapon.

Denial of ServiceFastAPIGzip
0 likes · 7 min read
How to Use Gzip Compression to Overload Web Crawlers (Gzip Bomb Tutorial)
JD Tech
JD Tech
Mar 14, 2024 · Databases

JD ElasticSearch Supports ZSTD Compression: Implementation, Performance Evaluation, and Usage Guide

This article explains how JD ElasticSearch has integrated the high‑performance ZSTD compression algorithm, details the motivations behind its adoption, presents benchmark results comparing it with LZ4 and best_compression, and provides step‑by‑step instructions and code snippets for configuring and using the new jd_zstd codec in Elasticsearch.

Elasticsearchcompressionjava
0 likes · 14 min read
JD ElasticSearch Supports ZSTD Compression: Implementation, Performance Evaluation, and Usage Guide
Sohu Tech Products
Sohu Tech Products
Feb 28, 2024 · Big Data

Why Use Zarr? Storing and Accessing Large NumPy Arrays with mmap and Zarr

Zarr provides a modern, chunked and compressed storage format that lets you treat massive NumPy arrays like in‑memory objects, offering on‑demand loading, flexible back‑ends (disk, S3, zip), automatic caching, resizing, parallel reads/writes, and superior performance compared to traditional mmap‑based memmap files.

NumPyPythonZarr
0 likes · 18 min read
Why Use Zarr? Storing and Accessing Large NumPy Arrays with mmap and Zarr
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
Jan 24, 2024 · Mobile Development

Optimizing Hermes Bytecode Bundle Size and SourceMap Handling in React Native

To counter the 40‑100 % size increase of Hermes bytecode bundles after upgrading to React Native 0.70, the team switched to xz compression (cutting zip size 20‑26 %), enabled hermesc ‑O optimization (shrinking bundles 10‑22 % while requiring a two‑step source‑map merge), and used the ‑base‑bytecode option with bsdiff to reduce incremental OTA patches by up to 85 %, collectively improving download and update efficiency.

HermesReact NativeSourceMap
0 likes · 13 min read
Optimizing Hermes Bytecode Bundle Size and SourceMap Handling in React Native
php Courses
php Courses
Dec 20, 2023 · Backend Development

PHP Code Compression and Optimization Techniques

This article explains how to improve PHP web application performance by removing unnecessary whitespace and semicolons, leveraging caching, and using built‑in functions such as isset, empty, and count, with concrete code examples for each technique.

Code Optimizationcachingcompression
0 likes · 6 min read
PHP Code Compression and Optimization Techniques
JD Tech
JD Tech
Nov 30, 2023 · Artificial Intelligence

Understanding ChatGPT: Mechanisms, Attention, Emergence, and the Chinese Room

This article examines the principles behind ChatGPT, detailing its continuation-based operation, the role of attention mechanisms and transformer architecture, the scaling of neural networks that leads to emergent abilities, and interprets these phenomena through the lenses of compression theory and the Chinese Room thought experiment.

Attention MechanismChatGPTEmergence
0 likes · 27 min read
Understanding ChatGPT: Mechanisms, Attention, Emergence, and the Chinese Room
Open Source Tech Hub
Open Source Tech Hub
Nov 29, 2023 · Backend Development

How to Enable Gzip Compression in Nginx for Faster Web Performance

This guide explains why Gzip compression improves web speed, lists the resource types it supports, shows how to verify Nginx’s gzip module, demonstrates performance before and after enabling gzip with configuration examples, and highlights the bandwidth and cost benefits.

GzipServer ConfigurationWeb Optimization
0 likes · 7 min read
How to Enable Gzip Compression in Nginx for Faster Web Performance
Architect's Guide
Architect's Guide
Nov 22, 2023 · Backend Development

Performance Optimization Techniques: Indexing, Caching, Compression, Prefetching, Throttling, and Batch Processing

This article explains how software performance can be improved by balancing time and space trade‑offs through six fundamental techniques—indexing, compression, caching, prefetching, peak‑valley smoothing, and batch processing—and then explores four advanced, parallelism‑focused methods for large‑scale systems.

batch-processingcompressionindexing
0 likes · 35 min read
Performance Optimization Techniques: Indexing, Caching, Compression, Prefetching, Throttling, and Batch Processing
Architect
Architect
Nov 3, 2023 · Backend Development

How We Cut Risk Engine Latency from 80 ms to 25 ms with Prefetch, Batching, Async, Compression and Bloom‑Filter Caching

Facing a traffic surge that pushed a risk‑control engine's response time beyond 250 ms, the team applied a series of systematic optimizations—feature prefetching, batch requests, asynchronous accumulator updates, multi‑level caching with Bloom filters, and log‑compression redesign—resulting in latency dropping to 25 ms, CPU and memory usage falling by up to 90%, and storage costs reduced by over a third.

Batch Processingasynchronous processingbackend systems
0 likes · 22 min read
How We Cut Risk Engine Latency from 80 ms to 25 ms with Prefetch, Batching, Async, Compression and Bloom‑Filter Caching
Bilibili Tech
Bilibili Tech
Oct 25, 2023 · Backend Development

Performance Optimization Practices in Bilibili's Risk Control Engine

To overcome storage, compute, and I/O bottlenecks in Bilibili’s risk‑control engine, the team combined pre‑fetching with Redis caching, batch retrieval, asynchronous writes via Railgun, aggressive log compression, and a multi‑level cache plus Bloom filter, cutting latency to sub‑100 ms, reducing Redis QPS by over 90 % and storage by ~38 %, while supporting million‑level query throughput.

AsyncBackendBatch Processing
0 likes · 22 min read
Performance Optimization Practices in Bilibili's Risk Control Engine
JD Cloud Developers
JD Cloud Developers
Oct 10, 2023 · Artificial Intelligence

Do Large Language Models Have a Mind? Attention, Emergence & Compression Explained

This article examines whether ChatGPT and other large language models exhibit true Theory of Mind, detailing the role of attention mechanisms, neural network architecture, emergent abilities, the Chinese‑room argument, and how compression of massive textual data underlies their apparent intelligence.

Attention MechanismEmergenceNeural Networks
0 likes · 30 min read
Do Large Language Models Have a Mind? Attention, Emergence & Compression Explained
ITPUB
ITPUB
Oct 9, 2023 · Databases

Boost MySQL Performance on Large Tables: Proven Strategies and Tools

This article examines why MySQL can still handle massive tables and presents practical techniques—including proper primary keys, eliminating redundant indexes, choosing optimal data types, compression, archiving, partitioning, sharding, query optimization, and safe schema changes—to keep large‑table performance high.

Partitioningcompressionindexing
0 likes · 16 min read
Boost MySQL Performance on Large Tables: Proven Strategies and Tools
ITPUB
ITPUB
Sep 13, 2023 · Backend Development

Why Is Kafka So Fast? 7 Core Techniques Behind Its High Throughput

This article explains how Kafka achieves million‑message‑per‑second throughput by leveraging zero‑copy I/O, an append‑only log, batch processing, compression, consumer pull optimization, unflushed memory buffers, and JVM garbage‑collection tuning, detailing each mechanism and its impact on performance.

Batch ProcessingGC optimizationKafka
0 likes · 14 min read
Why Is Kafka So Fast? 7 Core Techniques Behind Its High Throughput
Continuous Delivery 2.0
Continuous Delivery 2.0
Sep 12, 2023 · Artificial Intelligence

Compression as a Measure of Intelligence in Large Language Models

The article argues that a large language model's ability to compress data through next‑token prediction reflects its intelligence, reviews theoretical and empirical evidence linking compression efficiency to model scale, and proposes a circuit‑competition framework to explain emergent capabilities, in‑context learning, and fine‑tuning effects.

GPT-4IntelligenceLLM
0 likes · 58 min read
Compression as a Measure of Intelligence in Large Language Models
Meituan Technology Team
Meituan Technology Team
Aug 31, 2023 · Backend Development

Performance Optimization of Java Compression in MJDK Using ISA‑L Based mzlib

The article explains how MJDK, Meituan's OpenJDK‑based distribution, integrates the Intel ISA‑L‑optimized mzlib library into java.util.zip, preserving API and format compatibility while delivering a five‑to‑ten‑fold increase in compression and decompression throughput, backed by benchmark results on the Silesia corpus.

ISA‑LJNIMJDK
0 likes · 13 min read
Performance Optimization of Java Compression in MJDK Using ISA‑L Based mzlib
MaGe Linux Operations
MaGe Linux Operations
Jul 8, 2023 · Databases

Why Columnstore Indexes Supercharge SQL Server Queries

This article explains how columnstore indexes differ from traditional row stores, detailing their batch processing, compression, and storage mechanisms that can boost data‑warehouse query performance by up to ten times while reducing storage size dramatically.

Columnstore IndexSQL Servercompression
0 likes · 11 min read
Why Columnstore Indexes Supercharge SQL Server Queries
DataFunTalk
DataFunTalk
May 31, 2023 · Artificial Intelligence

Why GPT Can Exhibit Intelligence Through Next‑Token Prediction: A Comprehensive Exploration of Compression, Knowledge Circuits, and Model Scaling

This article examines the debate over whether large language models truly possess intelligence, arguing that next‑token prediction functions as a form of lossless data compression whose efficiency reflects intelligence, and it surveys research on knowledge extraction, neuron semantics, circuit competition, scaling effects, and the broader philosophical implications of GPT as a mirror of the world’s parameters.

Artificial IntelligenceGPTModel Scaling
0 likes · 59 min read
Why GPT Can Exhibit Intelligence Through Next‑Token Prediction: A Comprehensive Exploration of Compression, Knowledge Circuits, and Model Scaling
Liangxu Linux
Liangxu Linux
Apr 27, 2023 · Operations

Mastering tar: Create, Extract, List, and Manage Linux Archives

This guide explains how to use the Linux tar command to create uncompressed, gzip‑compressed, and bzip2‑compressed archives, extract whole or individual files, list archive contents, append files, verify archives, and check archive sizes, with clear examples for each operation.

BackupLinuxarchiving
0 likes · 15 min read
Mastering tar: Create, Extract, List, and Manage Linux Archives
Architects' Tech Alliance
Architects' Tech Alliance
Mar 7, 2023 · Databases

Analysis of Current Trends, Architecture, and Technologies in Chinese Database Products

This article reviews recent Chinese database market reports, outlines the evolution of database management systems, describes architectural layers, HTAP solutions, compression techniques, storage index structures, intelligent governance, and deployment models, highlighting both technical trends and future directions.

Database ArchitectureHTAPcloud deployment
0 likes · 11 min read
Analysis of Current Trends, Architecture, and Technologies in Chinese Database Products
IT Architects Alliance
IT Architects Alliance
Jan 3, 2023 · Fundamentals

Performance Optimization Techniques: Indexing, Caching, Compression, Prefetching, Throttling, and Batch Processing

The article explores a wide range of performance‑optimization strategies—including indexing, caching, compression, prefetching, peak‑shaving, and batch processing—explaining their trade‑offs, practical applications, and how they relate to hardware latency and system design in modern computing environments.

batch-processingcachingcompression
0 likes · 34 min read
Performance Optimization Techniques: Indexing, Caching, Compression, Prefetching, Throttling, and Batch Processing
Coolpad Technology Team
Coolpad Technology Team
Dec 27, 2022 · Fundamentals

Fragment Deduplication Support in erofs-utils mkfs

This article explains the implementation of fragment deduplication in the erofs-utils mkfs tool, describing the hash‑based fragment lookup, the conditions for fixing fragments during compression, the generation of additional extents, and the integration of these steps into the existing packing workflow.

Filesystemcompressionfragment deduplication
0 likes · 8 min read
Fragment Deduplication Support in erofs-utils mkfs
Architects' Tech Alliance
Architects' Tech Alliance
Dec 25, 2022 · Operations

Mastering Time‑Space Trade‑offs: Indexing, Caching, Compression & More

This article consolidates three performance‑optimization posts, detailing six universal time‑space trade‑off techniques—indexing, caching, compression, prefetching, peak‑valley smoothing, and batch processing—plus four advanced parallelism strategies, illustrated with real‑world analogies and practical guidelines for developers.

Batch Processingcachingcompression
0 likes · 22 min read
Mastering Time‑Space Trade‑offs: Indexing, Caching, Compression & More
Programmer DD
Programmer DD
Dec 23, 2022 · Backend Development

Unlock High Performance: 6 Proven Techniques to Supercharge Your Software

This article presents six practical performance‑optimization methods—indexing, compression, caching, prefetching, peak‑shaving, and batch processing—explains their principles, trade‑offs, and real‑world applications, and then dives into four advanced strategies for scaling and parallelism, all illustrated with memorable analogies.

Scalabilitycachingcompression
0 likes · 36 min read
Unlock High Performance: 6 Proven Techniques to Supercharge Your Software
ITPUB
ITPUB
Dec 18, 2022 · Databases

Why ClickHouse Is So Fast: Deep Dive into Storage and Compute Engine Optimizations

This article explains how ClickHouse achieves high query performance by leveraging storage‑engine designs such as pre‑sorting, columnar layout, and block‑level compression, and by exploiting a vectorized compute engine while avoiding joins and using built‑in functions.

Big DataColumnar StorageDatabase Performance
0 likes · 9 min read
Why ClickHouse Is So Fast: Deep Dive into Storage and Compute Engine Optimizations
Top Architect
Top Architect
Nov 26, 2022 · Backend Development

Performance Optimization Techniques: Indexing, Caching, Compression, Prefetching, Throttling, and Batch Processing

This article presents a comprehensive guide to performance optimization, covering six fundamental techniques—indexing, compression, caching, prefetching, throttling, and batch processing—along with deeper strategies for focusing, transformation, adaptation, and system-wide planning to maximize throughput while managing trade‑offs.

Scalabilitycompressionoptimization
0 likes · 38 min read
Performance Optimization Techniques: Indexing, Caching, Compression, Prefetching, Throttling, and Batch Processing
Laravel Tech Community
Laravel Tech Community
Nov 16, 2022 · Databases

DuckDB New Release Highlights and Feature Changes

The article introduces DuckDB, a high‑performance embedded analytical database, outlines its new release’s storage, performance, and memory improvements, describes its C/C++ integration and build process, and lists key feature changes such as parallel execution, novel compression methods, and enhanced SQL capabilities.

Analytical DatabaseDuckDBEmbedded Database
0 likes · 3 min read
DuckDB New Release Highlights and Feature Changes
Architecture Digest
Architecture Digest
Nov 7, 2022 · Backend Development

Comprehensive Guide to Software Performance Optimization: Indexing, Compression, Caching, Prefetching, Throttling, and Batch Processing

This article presents a thorough, multi‑part exploration of software performance optimization techniques—including indexing, compression, caching, prefetching, peak‑shaving, and batch processing—explaining their principles, trade‑offs, practical applications, and how they relate to hardware constraints and system design.

Batch ProcessingScalabilitycaching
0 likes · 36 min read
Comprehensive Guide to Software Performance Optimization: Indexing, Compression, Caching, Prefetching, Throttling, and Batch Processing
Java High-Performance Architecture
Java High-Performance Architecture
Nov 5, 2022 · Big Data

Why Can Kafka Process 20 Million Messages per Second? Inside Its High‑Performance Architecture

This article explains how Kafka achieves extremely high throughput—up to 20 million messages and 600 MB per second per node—by optimizing the producer, broker, and consumer components through batch sending, custom protocols, page‑cache usage, zero‑copy transfers, and efficient compression algorithms.

BrokerConsumerKafka
0 likes · 7 min read
Why Can Kafka Process 20 Million Messages per Second? Inside Its High‑Performance Architecture
Laravel Tech Community
Laravel Tech Community
Nov 2, 2022 · Fundamentals

Common Linux Compression and Decompression Commands

This article provides a concise reference of frequently used Linux commands for compressing and extracting files in various formats such as tar, gz, bz2, zip, rar, and more, including syntax, options, and practical notes for each archive type.

LinuxShellcommand-line
0 likes · 5 min read
Common Linux Compression and Decompression Commands