BestHub
Sign in
Tagged articles

compression

225 articles · Page 2 of 3
Programmer DD
Programmer DD
Dec 23, 2022 · Backend Development

Unlock High Performance: 6 Proven Techniques to Supercharge Your Software

This article presents six practical performance‑optimization methods—indexing, compression, caching, prefetching, peak‑shaving, and batch processing—explains their principles, trade‑offs, and real‑world applications, and then dives into four advanced strategies for scaling and parallelism, all illustrated with memorable analogies.

IndexingOptimizationcaching
0 likes · 36 min read
Unlock High Performance: 6 Proven Techniques to Supercharge Your Software
ITPUB
ITPUB
Dec 18, 2022 · Databases

Why ClickHouse Is So Fast: Deep Dive into Storage and Compute Engine Optimizations

This article explains how ClickHouse achieves high query performance by leveraging storage‑engine designs such as pre‑sorting, columnar layout, and block‑level compression, and by exploiting a vectorized compute engine while avoiding joins and using built‑in functions.

Big DataClickHouseDatabase Performance
0 likes · 9 min read
Why ClickHouse Is So Fast: Deep Dive into Storage and Compute Engine Optimizations
Top Architect
Top Architect
Nov 26, 2022 · Backend Development

Performance Optimization Techniques: Indexing, Caching, Compression, Prefetching, Throttling, and Batch Processing

This article presents a comprehensive guide to performance optimization, covering six fundamental techniques—indexing, compression, caching, prefetching, throttling, and batch processing—along with deeper strategies for focusing, transformation, adaptation, and system-wide planning to maximize throughput while managing trade‑offs.

Optimizationcompressionscalability
0 likes · 38 min read
Performance Optimization Techniques: Indexing, Caching, Compression, Prefetching, Throttling, and Batch Processing
Laravel Tech Community
Laravel Tech Community
Nov 16, 2022 · Databases

DuckDB New Release Highlights and Feature Changes

The article introduces DuckDB, a high‑performance embedded analytical database, outlines its new release’s storage, performance, and memory improvements, describes its C/C++ integration and build process, and lists key feature changes such as parallel execution, novel compression methods, and enhanced SQL capabilities.

DuckDBEmbedded DatabaseSQL
0 likes · 3 min read
DuckDB New Release Highlights and Feature Changes
Architecture Digest
Architecture Digest
Nov 7, 2022 · Backend Development

Comprehensive Guide to Software Performance Optimization: Indexing, Compression, Caching, Prefetching, Throttling, and Batch Processing

This article presents a thorough, multi‑part exploration of software performance optimization techniques—including indexing, compression, caching, prefetching, peak‑shaving, and batch processing—explaining their principles, trade‑offs, practical applications, and how they relate to hardware constraints and system design.

Batch ProcessingIndexingOptimization
0 likes · 36 min read
Comprehensive Guide to Software Performance Optimization: Indexing, Compression, Caching, Prefetching, Throttling, and Batch Processing
Java High-Performance Architecture
Java High-Performance Architecture
Nov 5, 2022 · Big Data

Why Can Kafka Process 20 Million Messages per Second? Inside Its High‑Performance Architecture

This article explains how Kafka achieves extremely high throughput—up to 20 million messages and 600 MB per second per node—by optimizing the producer, broker, and consumer components through batch sending, custom protocols, page‑cache usage, zero‑copy transfers, and efficient compression algorithms.

BrokerKafkaProducer
0 likes · 7 min read
Why Can Kafka Process 20 Million Messages per Second? Inside Its High‑Performance Architecture
Laravel Tech Community
Laravel Tech Community
Nov 2, 2022 · Fundamentals

Common Linux Compression and Decompression Commands

This article provides a concise reference of frequently used Linux commands for compressing and extracting files in various formats such as tar, gz, bz2, zip, rar, and more, including syntax, options, and practical notes for each archive type.

Command LineLinuxcompression
0 likes · 5 min read
Common Linux Compression and Decompression Commands
Liangxu Linux
Liangxu Linux
Oct 30, 2022 · Operations

Master Linux File Compression: tar, gzip, bzip2, 7zip and More

This guide explains why file compression matters for storage and bandwidth, then details the most common Linux compression utilities—including tar, gzip, lzma, xz, bzip2, pax, peazip, 7zip, shar, cpio, ar, iso, kgb, zpaq, and File Roller—along with installation steps, key options, and practical command examples.

Linuxcommand-linecompression
0 likes · 10 min read
Master Linux File Compression: tar, gzip, bzip2, 7zip and More
Architect
Architect
Aug 31, 2022 · Backend Development

How Kafka Achieves High Performance: Producer, Broker, and Consumer Optimizations

This article explains why Kafka can handle up to 20 million messages per second and 600 MB/s throughput by detailing producer batching and custom protocols, broker page‑cache, file layout and zero‑copy techniques, as well as consumer group strategies for efficient message consumption.

Message Queuecompressionperformance
0 likes · 7 min read
How Kafka Achieves High Performance: Producer, Broker, and Consumer Optimizations
WeChat Client Technology Team
WeChat Client Technology Team
Aug 30, 2022 · Databases

How WeChat Optimized Its Desktop Database for Speed, Size, and Reliability

This article analyzes the performance and storage problems of the Windows version of WeChat, explains why message growth causes slowness, large file size, and corruption risk, and presents a multi‑pronged solution involving sharding, indexing, payload compression, and robustness improvements that halve database size and boost I/O performance by about ten percent.

IndexingSQLiteSharding
0 likes · 11 min read
How WeChat Optimized Its Desktop Database for Speed, Size, and Reliability
Tencent Architect
Tencent Architect
Aug 26, 2022 · Fundamentals

Tencent's Self‑Developed TXAV1 Video Codec: Architecture, Performance, and Optimization Techniques

Tencent's TXAV1 encoder, a self‑developed AV1 video codec, combines advanced compression‑rate improvements, engineering acceleration, and extensive cloud deployment, achieving up to 78‑334% speedup with minimal quality loss, and includes novel pre‑analysis models, adaptive quantization, and multi‑threading strategies for both video and image applications.

AV1Pre‑analysisTencent
0 likes · 15 min read
Tencent's Self‑Developed TXAV1 Video Codec: Architecture, Performance, and Optimization Techniques
Programmer DD
Programmer DD
Aug 23, 2022 · Cloud Computing

How Switching S3 Compression to Zstd Cut Storage Costs by 30%

AWS switched S3 log compression from gzip to Zstandard, saving roughly 30% of storage space—equivalent to exabytes—by changing the internal storage method, a move confirmed by employee comments and a coinciding 31% price drop in late 2021.

AWSCloud StorageS3
0 likes · 4 min read
How Switching S3 Compression to Zstd Cut Storage Costs by 30%
Open Source Linux
Open Source Linux
Aug 21, 2022 · Backend Development

How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes

This article explains how Elasticsearch leverages inverted indexes, term dictionaries, and compression techniques such as Frame‑of‑Reference and Roaring Bitmaps to enable rapid full‑text search, detailing the underlying data structures, query processing, and practical indexing tips for efficient backend search implementations.

ElasticsearchPostings Listbackend development
0 likes · 17 min read
How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes
Efficient Ops
Efficient Ops
Aug 16, 2022 · Backend Development

How Elasticsearch Delivers Lightning‑Fast Search with Inverted Indexes and Compression

This article explains how Elasticsearch uses inverted indexes, term dictionaries, and advanced compression techniques such as Frame‑of‑Reference and Roaring Bitmaps to achieve rapid search performance while minimizing memory and disk usage, and it also covers practical indexing tips for production use.

ElasticsearchPostings Listbackend development
0 likes · 15 min read
How Elasticsearch Delivers Lightning‑Fast Search with Inverted Indexes and Compression
ELab Team
ELab Team
May 19, 2022 · Frontend Development

Boost Web Performance: Mastering Image Optimization with WebP and Lazy Loading

This guide explores systematic image optimization for web applications, covering formats like WebP, lossless vs lossy compression, lazy loading, placeholder strategies, format fallback, monitoring, and practical code implementations to reduce image size, memory usage, and improve loading speed and user experience.

Frontend PerformanceResponsive ImagesWebP
0 likes · 18 min read
Boost Web Performance: Mastering Image Optimization with WebP and Lazy Loading
Tencent Database Technology
Tencent Database Technology
May 11, 2022 · Databases

In-depth Analysis of InnoDB File Structure and Page Organization

This article provides a comprehensive examination of InnoDB's physical file layout, detailing page components such as the file header, page header, record storage formats, variable‑length and NULL handling, free space, page directory, file trailer, external storage pages, and the differences among row formats and compression techniques, illustrated with concrete hexdump examples and SQL statements.

InnoDBMySQLROW format
0 likes · 27 min read
In-depth Analysis of InnoDB File Structure and Page Organization
IT Services Circle
IT Services Circle
Feb 25, 2022 · Backend Development

Detecting and Handling Gzip Bombs in Web Crawling with Python Requests

This article explains how to identify gzip‑compressed responses that may be gzip bombs, how to inspect HTTP headers and raw response data using Python's requests library, and provides command‑line and code examples for measuring compressed and uncompressed sizes without triggering decompression.

compressiongziprequests
0 likes · 5 min read
Detecting and Handling Gzip Bombs in Web Crawling with Python Requests
Alibaba Cloud Developer
Alibaba Cloud Developer
Jan 12, 2022 · Databases

How to Slash Cloud Data Warehouse Costs with ADB PG Disk Optimization

This article explains how enterprises can dramatically reduce cloud‑native data‑warehouse expenses by understanding ADB PG/Greenplum architecture, applying disk‑reservation and lock‑write safeguards, and implementing practical optimizations such as table compression, hot‑cold tiering, vacuuming, redundant‑index cleanup, replication conversion, and isolated temporary‑table spaces.

ADB PGCold DataData Warehouse
0 likes · 25 min read
How to Slash Cloud Data Warehouse Costs with ADB PG Disk Optimization
Open Source Linux
Open Source Linux
Dec 29, 2021 · Backend Development

How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes

This article explains how Elasticsearch uses inverted indexes, term dictionaries, and compression techniques like FOR and Roaring Bitmaps to enable rapid full‑text search, contrasting its approach with traditional relational databases and offering practical indexing tips for large‑scale applications.

ElasticsearchLucenePostings List
0 likes · 15 min read
How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes
Open Source Linux
Open Source Linux
Dec 8, 2021 · Backend Development

How Elasticsearch Uses Lucene’s Inverted Index for Lightning‑Fast Search

This article explains how Elasticsearch leverages Lucene’s inverted index, detailing the structure of term dictionaries, postings lists, compression techniques like Frame‑of‑Reference and Roaring Bitmaps, and query optimizations such as filter caches and skip‑list intersections to achieve fast, memory‑efficient search.

ElasticsearchLucenecompression
0 likes · 19 min read
How Elasticsearch Uses Lucene’s Inverted Index for Lightning‑Fast Search
Efficient Ops
Efficient Ops
Dec 2, 2021 · Backend Development

How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes

This article explains how Elasticsearch uses inverted indexes, term dictionaries, and compression techniques such as Frame‑of‑Reference and Roaring Bitmaps to deliver rapid full‑text search, efficient storage, and fast union queries, while also offering practical indexing tips for production use.

LucenePostings ListRoaring Bitmap
0 likes · 15 min read
How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes
Sohu Tech Products
Sohu Tech Products
Dec 1, 2021 · Mobile Development

Understanding HEIF Image Format and Its Implementation on Android

HEIF (High Efficiency Image File Format) offers superior compression, support for image sequences, depth and transparency, and is natively supported on iOS and Android P, with implementation options via ImageDecoder, BitmapFactory, or conversion to JPEG, though adoption faces compatibility and hardware licensing challenges.

AndroidHEIFHEVC
0 likes · 8 min read
Understanding HEIF Image Format and Its Implementation on Android
JD Retail Technology
JD Retail Technology
Nov 22, 2021 · Backend Development

Designing a High‑Performance Log Collection System with UDP, Compression, and ClickHouse

The article analyzes the high cost and scalability challenges of traditional log collection pipelines and proposes a streamlined architecture that uses in‑memory buffering, UDP transport, aggressive compression, and ClickHouse storage to achieve massive throughput while drastically reducing hardware and operational expenses.

ClickHouseHigh ThroughputMonitoring
0 likes · 15 min read
Designing a High‑Performance Log Collection System with UDP, Compression, and ClickHouse
Java Interview Crash Guide
Java Interview Crash Guide
Nov 11, 2021 · Big Data

How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes and Compression

This article explains how Elasticsearch uses inverted indexes, term dictionaries, and advanced compression techniques like Frame of Reference and Roaring Bitmaps to enable rapid, scalable search over massive datasets, contrasting its approach with traditional relational database queries and detailing practical optimization tips.

ElasticsearchLucenePostings List
0 likes · 16 min read
How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes and Compression
IT Architects Alliance
IT Architects Alliance
Oct 6, 2021 · Big Data

Understanding Elasticsearch Inverted Index and Efficient Search Retrieval

This article explains how Elasticsearch uses inverted indexes, term dictionaries, and postings lists—along with compression techniques like Frame of Reference and Roaring Bitmaps—to achieve fast, memory‑efficient search queries, and provides practical tips for optimizing indexing and query performance.

ElasticsearchLucenePostings List
0 likes · 14 min read
Understanding Elasticsearch Inverted Index and Efficient Search Retrieval
IT Architects Alliance
IT Architects Alliance
Sep 29, 2021 · Databases

Understanding Elasticsearch Inverted Index: Fast Retrieval, Compression, and Query Techniques

This article explains how Elasticsearch uses inverted index structures—including term dictionaries, term indexes, and postings lists—combined with compression methods like Frame‑of‑Reference and Roaring Bitmaps to achieve fast search, efficient storage, and effective union queries compared to traditional relational databases.

ElasticsearchLucenePostings List
0 likes · 14 min read
Understanding Elasticsearch Inverted Index: Fast Retrieval, Compression, and Query Techniques
Architect
Architect
Sep 4, 2021 · Databases

Understanding Elasticsearch Fast Retrieval: Inverted Index, Term Dictionary, and Compression Techniques

This article explains how Elasticsearch achieves fast data retrieval by comparing it with traditional relational databases, detailing search engine fundamentals, the structure of Lucene's inverted index—including term dictionaries, postings lists, and term indexes—and the compression techniques such as Frame of Reference and Roaring Bitmaps that optimize storage and query performance.

ElasticsearchLucenePostings List
0 likes · 14 min read
Understanding Elasticsearch Fast Retrieval: Inverted Index, Term Dictionary, and Compression Techniques
Tencent Cloud Developer
Tencent Cloud Developer
Aug 26, 2021 · Big Data

Recap of Shenzhen Elasticsearch Meetup – Community Growth, Compression Optimization, Real‑time Data Fusion, and Cluster Practices

The first Shenzhen Elasticsearch meetup on August 21, 2021, jointly hosted by the ES Chinese community and Tencent Cloud, gathered experts from Tencent, Tapdata, ByteDance and Vivo to showcase rapid community growth, compression‑encoding optimizations, real‑time ES‑MongoDB data fusion, custom kernel extensions, large‑scale cluster practices, and concluded with extensive Q&A and networking.

Big DataCluster ManagementElasticsearch
0 likes · 11 min read
Recap of Shenzhen Elasticsearch Meetup – Community Growth, Compression Optimization, Real‑time Data Fusion, and Cluster Practices
Aotu Lab
Aotu Lab
Aug 12, 2021 · Frontend Development

How to Optimize glTF/.glb Files for Faster 3D Loading in Web Projects

This article explains the glTF format, compares .gltf and .glb, shows how to split and compress glTF assets using tools like gltf‑pipeline, Draco, mesh quantization and meshopt, and presents performance tests across various devices to guide efficient 3D model delivery in web applications.

3D OptimizationThree.jscompression
0 likes · 14 min read
How to Optimize glTF/.glb Files for Faster 3D Loading in Web Projects
Open Source Linux
Open Source Linux
Aug 11, 2021 · Backend Development

Boost Web Performance with OpenResty: Caching, Compression, and Dynamic Updates

This article explains how to use OpenResty with Lua to build a high‑performance caching layer that directly accesses Redis, compresses large responses, schedules periodic updates, forwards requests intelligently, and provides configurable URL caching, thereby improving concurrency, reducing latency, and optimizing bandwidth usage.

LuaOpenRestyRedis
0 likes · 6 min read
Boost Web Performance with OpenResty: Caching, Compression, and Dynamic Updates
Java Interview Crash Guide
Java Interview Crash Guide
Jul 2, 2021 · Databases

How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes

This article explains how Elasticsearch leverages inverted indexes, term dictionaries, and advanced compression techniques like Frame of Reference and Roaring Bitmaps to enable rapid full‑text search, covering the underlying concepts, data structures, and query optimizations essential for high‑performance search applications.

ElasticsearchLucenePostings List
0 likes · 17 min read
How Elasticsearch Achieves Lightning‑Fast Search with Inverted Indexes
Selected Java Interview Questions
Selected Java Interview Questions
Jul 1, 2021 · Fundamentals

Understanding Elasticsearch Inverted Index: Posting Lists, Term Dictionary, and Compression Techniques

This article explains how Elasticsearch achieves fast search by using inverted indexes, detailing the structure of posting lists, term dictionaries, term indexes, and compression methods such as Frame of Reference and Roaring Bitmaps, as well as techniques for efficient union and intersection queries.

ElasticsearchPostings ListTerm Dictionary
0 likes · 16 min read
Understanding Elasticsearch Inverted Index: Posting Lists, Term Dictionary, and Compression Techniques
IT Architects Alliance
IT Architects Alliance
Jun 28, 2021 · Industry Insights

WeChat Moments' Billion-Visit Architecture: Disaster Recovery & Flexible Scaling

The article analyzes WeChat Moments' massive image and video services, detailing its OC/IDC architecture, holiday traffic challenges, software and hardware safeguards, disaster‑recovery mechanisms, retry policies, and a series of flexible strategies—including compression format changes, bitrate reduction, buffer pools, and timeline throttling—to sustain billions of daily accesses.

Disaster RecoveryFlexible ScalingVideo Bitrate
0 likes · 13 min read
WeChat Moments' Billion-Visit Architecture: Disaster Recovery & Flexible Scaling
Aikesheng Open Source Community
Aikesheng Open Source Community
Jun 15, 2021 · Databases

How to Enable Binlog Compression in MySQL

This article explains why MySQL binlog files can become large, demonstrates how to enable the slave_compressed_protocol parameter for binlog compression, presents benchmark results showing reduced network traffic and CPU impact, and outlines compatibility considerations and known bugs.

MySQLbinlogcompression
0 likes · 5 min read
How to Enable Binlog Compression in MySQL
Open Source Linux
Open Source Linux
Feb 22, 2021 · Fundamentals

Master Linux Compression: gzip, bzip2, zip, xz & tar Commands

This guide provides a comprehensive overview of common Linux compression and decompression utilities—including gzip, bzip2, zip/unzip, xz, and tar—detailing their descriptions, key options, usage examples, and tips for handling files and directories efficiently.

Linuxcompressiongzip
0 likes · 6 min read
Master Linux Compression: gzip, bzip2, zip, xz & tar Commands
Meituan Technology Team
Meituan Technology Team
Jan 7, 2021 · Operations

Optimizing Build Package Compression for Faster Deployment

By integrating SIMD‑accelerated ISA‑L and parallel Zstandard (Pzstd) into Meituan’s build‑and‑deployment pipeline, compression time for typical 200 MiB–1 GiB packages dropped from over a minute to about one second—a 90%‑plus speedup that preserves gzip compatibility while dramatically accelerating overall build latency.

ISA‑LZSTDbuild
0 likes · 21 min read
Optimizing Build Package Compression for Faster Deployment
Big Data Technology & Architecture
Big Data Technology & Architecture
Dec 9, 2020 · Big Data

Handling Small Files in Hive: Configuration, Compression, and File Format Optimization

The article explains why Hive tables generate many small files on HDFS, describes the performance impact on NameNode and MapReduce, and provides detailed configuration steps and compression techniques—including input and output file merging, various Hive file formats, and partition optimization—to efficiently manage storage and resource consumption in big‑data environments.

HadoopHiveSmall Files
0 likes · 19 min read
Handling Small Files in Hive: Configuration, Compression, and File Format Optimization
JD Cloud Developers
JD Cloud Developers
Sep 15, 2020 · Databases

How JD’s HoraeDB Tackles Massive Time‑Series Data at Scale

This article introduces JD Cloud’s self‑built time‑series database HoraeDB, explaining its core concepts, typical use cases, architectural layers, high‑performance features, down‑sampling strategies, compression techniques, and stability measures for handling massive, 24‑hour monitoring data at scale.

DownsamplingMonitoringcompression
0 likes · 18 min read
How JD’s HoraeDB Tackles Massive Time‑Series Data at Scale
Big Data Technology & Architecture
Big Data Technology & Architecture
Sep 1, 2020 · Big Data

Configuring Hadoop to Support LZO Compression

This guide explains how to enable LZO compression in Hadoop by installing the twitter‑provided hadoop‑lzo library, updating core‑site.xml, synchronizing files across nodes, creating LZO indexes, and running a WordCount MapReduce job with LZO‑compressed output.

Big DataConfigurationHadoop
0 likes · 6 min read
Configuring Hadoop to Support LZO Compression
Architects Research Society
Architects Research Society
Sep 1, 2020 · Databases

Understanding SAP HANA’s Combined Technologies: Memory, Columnar Storage, Compression, and Insert‑Only

The article explains SAP HANA’s performance advantages by combining four key technologies—high‑speed memory, columnar storage, data compression, and an insert‑only model—detailing their individual pros and cons, how they complement each other, and the trade‑offs involved in scaling and persistence.

DatabaseIn-MemoryInsert-Only
0 likes · 19 min read
Understanding SAP HANA’s Combined Technologies: Memory, Columnar Storage, Compression, and Insert‑Only
Programmer DD
Programmer DD
Aug 18, 2020 · Backend Development

How to Boost Web App Performance 10× with NGINX: 10 Proven Tips

Web performance is critical in today's online economy; this article explains ten practical NGINX‑based techniques—including reverse proxy, load balancing, caching, compression, SSL/TLS tuning, HTTP/2, software upgrades, Linux tweaks, server tuning, and real‑time monitoring—that together can deliver up to tenfold speed improvements and higher conversion rates.

HTTP/2Load BalancingSSL/TLS
0 likes · 23 min read
How to Boost Web App Performance 10× with NGINX: 10 Proven Tips
Architect
Architect
Aug 12, 2020 · Backend Development

10 Tips to Achieve 10× Web Application Performance with NGINX

This article explains why web performance is critical, presents ten practical NGINX‑based recommendations—including reverse proxy, load balancing, caching, compression, SSL/TLS optimization, HTTP/2, software upgrades, Linux tuning, and real‑time monitoring—to help developers and operators dramatically improve application speed and reliability.

SSL/TLSWeb Performancecompression
0 likes · 21 min read
10 Tips to Achieve 10× Web Application Performance with NGINX
Top Architect
Top Architect
Jul 27, 2020 · Operations

10 Practical Tips to Boost Web Application Performance Up to 10× with NGINX

This article presents ten actionable recommendations—including reverse‑proxy deployment, load balancing, caching, compression, SSL/TLS tuning, HTTP/2 adoption, software upgrades, Linux and web‑server tuning, and real‑time monitoring—to dramatically improve web application performance, often achieving tenfold speed gains.

Load BalancingMonitoringNginx
0 likes · 22 min read
10 Practical Tips to Boost Web Application Performance Up to 10× with NGINX
Architecture Digest
Architecture Digest
Jul 22, 2020 · Backend Development

10 Tips to Achieve 10× Application Performance with NGINX

This article presents ten practical NGINX‑based techniques—including reverse proxy deployment, load balancing, caching, compression, SSL/TLS optimization, HTTP/2 adoption, software upgrades, Linux tuning, web‑server configuration, and real‑time monitoring—that together can boost web‑application throughput and latency by up to an order of magnitude.

Linux TuningLoad BalancingSSL/TLS
0 likes · 22 min read
10 Tips to Achieve 10× Application Performance with NGINX
MaGe Linux Operations
MaGe Linux Operations
Jul 11, 2020 · Databases

Unlocking Time‑Series Power: A Deep Dive into TimescaleDB

This article introduces TimescaleDB—a PostgreSQL extension for time‑series data—explaining its core concepts, data‑model choices, architecture, native compression, and provides step‑by‑step installation instructions on a CentOS 7 environment.

PostgreSQLTimescaleDBcompression
0 likes · 15 min read
Unlocking Time‑Series Power: A Deep Dive into TimescaleDB
Programmer DD
Programmer DD
Jul 5, 2020 · Backend Development

How to Boost Your Web Application Performance by 10× with NGINX

This article explains why web performance matters, presents ten practical NGINX‑based techniques—including reverse proxy, load balancing, caching, compression, SSL/TLS optimization, HTTP/2, software upgrades, Linux and web‑server tuning, and real‑time monitoring—to help you achieve up to tenfold speed improvements.

HTTP/2NginxSSL/TLS
0 likes · 25 min read
How to Boost Your Web Application Performance by 10× with NGINX
DataFunTalk
DataFunTalk
Mar 24, 2020 · Databases

ByteDance’s Enhancements to RocksDB: LazyBuffer, Adaptive Map, KV Separation, Multi‑Index, Extreme Compression, and New Hardware Support

This article describes ByteDance’s extensive improvements to the RocksDB storage engine—including LazyBuffer, Adaptive Map‑based lazy compaction, KV separation, adaptive multi‑index support, extreme compression techniques, and hardware acceleration—to reduce amplification, improve performance, and lower costs for large‑scale database workloads.

Hardware AccelerationIndexingKV Separation
0 likes · 14 min read
ByteDance’s Enhancements to RocksDB: LazyBuffer, Adaptive Map, KV Separation, Multi‑Index, Extreme Compression, and New Hardware Support
macrozheng
macrozheng
Feb 4, 2020 · Fundamentals

Unlocking Computer Fundamentals: From CPU Basics to Assembly Language Explained

Explore the essential building blocks of modern computing, covering CPU architecture, memory hierarchy, binary operations, compression techniques, operating system fundamentals, and assembly language, with clear explanations, diagrams, and code examples that demystify how hardware and software interact at the lowest level.

AssemblyCPUMemory
0 likes · 74 min read
Unlocking Computer Fundamentals: From CPU Basics to Assembly Language Explained
Tencent Cloud Developer
Tencent Cloud Developer
Jan 8, 2020 · Backend Development

Four Dimensions of HTTP Performance Optimization

The article outlines four key dimensions for extreme HTTP performance optimization—encoding efficiency, channel utilization, transmission path, and information security—explaining how advances like binary encoding, multiplexed streams, TCP/QUIC tuning, and TLS 1.3 together reduce latency, boost concurrency, and enhance user experience.

HTTPMultiplexingTLS
0 likes · 17 min read
Four Dimensions of HTTP Performance Optimization
Architect's Tech Stack
Architect's Tech Stack
Nov 11, 2019 · Backend Development

Optimizing Java File Compression: From Buffered Streams to NIO Channels, Memory‑Mapped Files and Pipes

This article demonstrates how to dramatically speed up Java file compression of multiple images by replacing naive FileInputStream reads with BufferedInputStream, then leveraging NIO Channels with transferTo, memory‑mapped files, and finally Pipe‑based streaming, showing performance improvements from 30 seconds down to about 1 second.

NIOOptimizationcompression
0 likes · 10 min read
Optimizing Java File Compression: From Buffered Streams to NIO Channels, Memory‑Mapped Files and Pipes
Liangxu Linux
Liangxu Linux
Oct 22, 2019 · Operations

10 Quick Commands to Peek Inside Archives Without Extracting

This guide presents ten practical Linux commands—including Vim, tar, rar, unzip, zipinfo, zcat, zless, and less—that let you view the contents and metadata of archive or compressed files directly without extracting them first, saving time and effort.

Unziparchivecommand-line
0 likes · 7 min read
10 Quick Commands to Peek Inside Archives Without Extracting
Amap Tech
Amap Tech
Sep 12, 2019 · Big Data

Exploring Map Data Serialization Techniques at Gaode

Gaode’s map platform serializes massive geographic data by weighing bandwidth, extensibility, and decoding speed, comparing open‑source protobuf and FlatBuffers with a bespoke binary format that adds chapter‑based storage, variable attributes, and aggressive compression, ultimately selecting the method that best fits specific size‑or‑speed priorities.

FlatBuffersProtobufcompression
0 likes · 10 min read
Exploring Map Data Serialization Techniques at Gaode
Aikesheng Open Source Community
Aikesheng Open Source Community
Aug 19, 2019 · Databases

How Network Bandwidth Affects MySQL Performance

This article examines how network bandwidth, protocol compression, and SSL encryption impact MySQL Group Replication performance by running sysbench benchmarks on 1 Gb and 10 Gb networks, revealing bandwidth limits, CPU overhead, and scalability issues.

BenchmarkingMySQLNetwork Performance
0 likes · 6 min read
How Network Bandwidth Affects MySQL Performance
ITPUB
ITPUB
Apr 3, 2019 · Operations

Why Arch Linux Switched Its Default Package Compression to Zstandard (zstd)

Arch Linux maintainers replaced the single‑threaded xz compression in devtools with Facebook's fast, multithreaded Zstandard algorithm at level ‑18, achieving dramatically higher compression and decompression speeds and more stable parallel processing, which will speed up pacman package installations.

Arch LinuxDevToolsZSTD
0 likes · 3 min read
Why Arch Linux Switched Its Default Package Compression to Zstandard (zstd)
MaGe Linux Operations
MaGe Linux Operations
Mar 9, 2019 · Fundamentals

Unlock Hidden Python Tricks: Variable Arguments, Glob, Debugging, UUID, Serialization & More

This article reveals several lesser‑known Python features—including functions that accept arbitrary arguments, powerful file searching with glob, debugging with inspect, generating unique IDs via uuid, data serialization, string compression, and registering shutdown hooks—providing practical code examples for each.

DebuggingSerializationatexit
0 likes · 5 min read
Unlock Hidden Python Tricks: Variable Arguments, Glob, Debugging, UUID, Serialization & More
58 Tech
58 Tech
Mar 7, 2019 · Big Data

In-Memory Inverted Index Compression Algorithms: Overview and MILC Optimization for High‑Performance Search

This article reviews major in‑memory inverted index compression techniques such as PForDelta, PEF, and MILC, explains their principles and trade‑offs, and details practical optimizations applied at 58.com to achieve query performance comparable to uncompressed indexes while reducing memory usage by about 35 percent.

AlgorithmBig DataMILC
0 likes · 17 min read
In-Memory Inverted Index Compression Algorithms: Overview and MILC Optimization for High‑Performance Search
21CTO
21CTO
Feb 22, 2019 · Fundamentals

Why the Iconic “Lenna” Photo Became the Face of Image‑Processing Research

The article recounts how a 1960 Playboy portrait of Lena Söderberg was adopted by image‑processing researchers as a standard test image, explains the technical and cultural reasons for its lasting popularity, and follows her unexpected rise to fame within the scientific community.

Lennabenchmarkcompression
0 likes · 7 min read
Why the Iconic “Lenna” Photo Became the Face of Image‑Processing Research
Java Backend Technology
Java Backend Technology
Aug 8, 2018 · Backend Development

Designing Efficient RPC Message Protocols: Boundaries, Structures, and Compression

This article explains the core principles of RPC message protocol design, covering how to determine message boundaries, choose between delimiter and length‑prefix methods, handle explicit and implicit message structures, apply compression, and implement varint and zigzag encoding for optimal traffic efficiency.

Message ProtocolRPCSerialization
0 likes · 12 min read
Designing Efficient RPC Message Protocols: Boundaries, Structures, and Compression
Beike Product & Technology
Beike Product & Technology
Jun 1, 2018 · Big Data

Design and Evolution of Lianjia's Big Data Platform: Architecture, Challenges, and Solutions

This article details Lianjia's journey from a Hadoop‑based 0.0 data platform to a sophisticated 2.0 architecture, describing the three‑layer design, OLAP engine choices, transparent compression techniques, operational challenges, and practical recommendations for building and maintaining large‑scale big data systems.

HadoopKylinarchitecture
0 likes · 15 min read
Design and Evolution of Lianjia's Big Data Platform: Architecture, Challenges, and Solutions
UCloud Tech
UCloud Tech
Apr 28, 2018 · Operations

Ceph April 2018 Update: New Object, Block, and Cluster Features

The April 2018 Ceph monthly report highlights LTTng tracing for RGW, SSL support for the beast frontend, MFA integration, a notrim option for rbd mapping, runtime lz4 and brotli compression, Zabbix PG metrics, asynchronous dashboard tasks, detailed operation tracking, osdmap pruning, and a new iostat manager plugin.

CephCluster ManagementLTTng
0 likes · 9 min read
Ceph April 2018 Update: New Object, Block, and Cluster Features
21CTO
21CTO
Nov 26, 2017 · Frontend Development

Mastering Web Image Optimization: Formats, Compression, and Responsive Techniques

This article explains the fundamentals of web image optimization, covering vector vs raster formats, compression methods, responsive image techniques with srcset and picture elements, and practical loading strategies such as lazy loading, sprites, and progressive JPEGs to improve front‑end performance.

FrontendResponsive ImagesWeb Performance
0 likes · 8 min read
Mastering Web Image Optimization: Formats, Compression, and Responsive Techniques
Tencent IMWeb Frontend Team
Tencent IMWeb Frontend Team
Aug 22, 2017 · Backend Development

Node.js Gzip Compression Made Easy: Code Samples to Boost Performance

This guide explains how gzip and deflate compression work in web browsers and demonstrates straightforward Node.js examples for compressing and decompressing files, streaming responses, and handling HTTP requests with proper Accept‑Encoding checks, helping developers improve bandwidth efficiency and page load speed.

Node.jsWeb Performancebackend development
0 likes · 4 min read
Node.js Gzip Compression Made Easy: Code Samples to Boost Performance
Tencent IMWeb Frontend Team
Tencent IMWeb Frontend Team
Jul 6, 2017 · Frontend Development

Fix Mobile Photo Rotation Issues with EXIF and Canvas

This article explains how to detect the EXIF Orientation tag on mobile‑captured photos, rotate them correctly with canvas, and compress the result to reduce size, providing a lightweight solution for fixing 90° rotation issues on iPhone and certain Android devices.

CanvasEXIFFrontend
0 likes · 5 min read
Fix Mobile Photo Rotation Issues with EXIF and Canvas