BestHub
Sign in
Tagged articles

Performance Optimization

2086 articles · Page 8 of 21
DataFunTalk
DataFunTalk
May 10, 2024 · Artificial Intelligence

GPU Performance Optimization Practices for Tencent PCG Recommendation Model Training Framework

This article presents a comprehensive overview of Tencent PCG's GPU‑based recommendation model training framework, detailing why GPU adoption is essential, the hardware and software challenges faced, the multi‑level data architecture, pipeline design, and a series of network, storage, and compute optimizations, followed by future directions.

Distributed TrainingGPUPerformance Optimization
0 likes · 13 min read
GPU Performance Optimization Practices for Tencent PCG Recommendation Model Training Framework
360 Tech Engineering
360 Tech Engineering
May 10, 2024 · Cloud Native

Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360

This article shares the architecture design, cluster deployment, storage selection, multi‑region mode, service discovery, performance tuning, monitoring, alerting, and future plans of a production‑grade Apache Pulsar platform running on Kubernetes, providing valuable insights for engineers adopting Pulsar.

Apache PulsarDistributed MessagingKubernetes
0 likes · 17 min read
Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360
360 Smart Cloud
360 Smart Cloud
May 9, 2024 · Cloud Native

Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360

This article shares 360's practical experience deploying Apache Pulsar on Kubernetes, covering architecture design, storage choices, multi‑cluster modes, service discovery, performance tuning, monitoring, alerting, and future plans, offering valuable guidance for engineers building cloud‑native messaging platforms.

Apache PulsarDistributed MessagingKubernetes
0 likes · 19 min read
Practical Experience of Deploying and Optimizing Apache Pulsar on Kubernetes at 360
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
May 9, 2024 · Big Data

How RoaringBitmap Supercharged Lazada’s Selection Platform and Cut Processing Time by 99%

This article explains how Lazada’s internal selection platform leveraged Hologres and the RoaringBitmap compression algorithm to dramatically reduce storage costs, accelerate set operations, and break the 200,000‑item pool limit, achieving up to a 99% speed improvement in scheduling.

Bitmap CompressionHologresPerformance Optimization
0 likes · 16 min read
How RoaringBitmap Supercharged Lazada’s Selection Platform and Cut Processing Time by 99%
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
May 8, 2024 · Frontend Development

How We Halved Cloud Music Desktop Startup Time and Fixed UI Lag with a React Refactor

This article details the migration of the Cloud Music desktop client from a legacy NEJ‑CEF hybrid to a React‑based architecture, outlines four major performance challenges, and explains the step‑by‑step optimizations—including API preloading, render memoization, virtual‑list replacement, and resource‑usage reductions—that cut startup latency by 48%, eliminated interaction stutter, and dramatically lowered CPU, GPU, and memory consumption.

CPUGPUHybrid App
0 likes · 30 min read
How We Halved Cloud Music Desktop Startup Time and Fixed UI Lag with a React Refactor
Baidu App Technology
Baidu App Technology
May 8, 2024 · Artificial Intelligence

How AI Can Auto‑Generate Standardized Git Commit Messages

This article details the design, implementation, and evaluation of an AI‑powered tool that automatically creates compliant Git commit messages by leveraging large language models, custom plugins, and performance‑focused optimizations to improve developer productivity and commit quality.

AICommit MessageGit
0 likes · 16 min read
How AI Can Auto‑Generate Standardized Git Commit Messages
FunTester
FunTester
May 8, 2024 · Fundamentals

How Garbage Collection Impacts Performance and How to Optimize It

This article explains the fundamentals of garbage collection, compares manual and automatic memory management, outlines common GC algorithms, and provides practical guidance on performance analysis, tool selection, and optimization techniques to improve application responsiveness and resource utilization.

GC algorithmsPerformance OptimizationResource Utilization
0 likes · 22 min read
How Garbage Collection Impacts Performance and How to Optimize It
JD Retail Technology
JD Retail Technology
May 7, 2024 · Backend Development

Off‑Heap Cache (OHC) Practice: Reducing JVM GC Impact and Boosting C‑Side Interface Throughput

This article explains how using an off‑heap local cache (OHC) can dramatically lower GC pauses and cut interface latency by up to tenfold, covering the underlying principles, configuration, custom serializers, performance testing, monitoring metrics, and practical optimization recommendations for high‑traffic Java backend services.

CachingGCJava
0 likes · 15 min read
Off‑Heap Cache (OHC) Practice: Reducing JVM GC Impact and Boosting C‑Side Interface Throughput
JD Retail Technology
JD Retail Technology
May 6, 2024 · Frontend Development

Common Testing Techniques and Implementation Strategies for JD H5 Marketing Pages

This article outlines the architecture of JD's H5 marketing pages, compares native and H5 development, details container layering, describes functional implementation, and presents a comprehensive set of server‑side and front‑end testing methods, performance optimization, online tracking, and current pain points to improve testability and reliability.

Frontend TestingH5JD Hybrid
0 likes · 16 min read
Common Testing Techniques and Implementation Strategies for JD H5 Marketing Pages
DataFunSummit
DataFunSummit
May 5, 2024 · Big Data

Alluxio in Lakehouse Architecture: Benefits, Challenges, and Real‑World Use Cases

This article explains how Alluxio enables a unified lake‑warehouse architecture by decoupling compute and storage, outlines its core capabilities, evaluates the cost‑saving and performance benefits, discusses the technical challenges, and presents several practical deployment scenarios in finance and AI workloads.

AlluxioLakehousePerformance Optimization
0 likes · 15 min read
Alluxio in Lakehouse Architecture: Benefits, Challenges, and Real‑World Use Cases
ITPUB
ITPUB
May 2, 2024 · Databases

Boost MySQL Performance 30‑50% with Profile‑Guided Optimization (PGO)

This article explains how Profile‑Guided Optimization (PGO) can increase MySQL throughput by 30‑50% without changing application code, detailing the required compilation steps, necessary CMake flags, and real‑world benchmark results that demonstrate the performance gains and their limitations.

C++MySQLPGO
0 likes · 10 min read
Boost MySQL Performance 30‑50% with Profile‑Guided Optimization (PGO)
Open Source Linux
Open Source Linux
Apr 26, 2024 · Operations

7 Practical Linux Performance Optimization Techniques for Enterprise Systems

This article compiles seven hands‑on Linux performance‑optimization practices—including hardware, kernel, and network tuning, diagnostic commands, memory accounting, swap usage, and TCP parameter adjustments—to help engineers quickly identify and resolve stability and speed issues in production environments.

CPULinuxPerformance Optimization
0 likes · 20 min read
7 Practical Linux Performance Optimization Techniques for Enterprise Systems
DataFunTalk
DataFunTalk
Apr 25, 2024 · Big Data

Apache Hudi 1.0: Design Reconsiderations and Key New Features

This article provides a comprehensive overview of Apache Hudi 1.0, detailing its architectural redesign, five major development directions, and the most important new capabilities such as LSM‑tree timeline, function indexes, file‑group readers/writers, partial updates, and non‑blocking concurrency control, along with performance evaluations and resource links.

Apache HudiFunction IndexLSM Tree
0 likes · 14 min read
Apache Hudi 1.0: Design Reconsiderations and Key New Features
Tencent Cloud Developer
Tencent Cloud Developer
Apr 25, 2024 · Fundamentals

Cache, Prefetching, False Sharing, Pipeline and Data Dependency: Performance Optimization in Rust

The article uses Rust benchmarks to show how cache layout, prefetching, associativity, false sharing, pipeline stalls, and loop data dependencies impact performance, and demonstrates practical optimizations such as row‑major traversal, proper alignment, avoiding dependent loops, and leveraging sequential access to achieve near‑optimal speed.

CPU cacheFalse sharingPerformance Optimization
0 likes · 17 min read
Cache, Prefetching, False Sharing, Pipeline and Data Dependency: Performance Optimization in Rust
Tencent Cloud Developer
Tencent Cloud Developer
Apr 23, 2024 · Backend Development

Performance Optimization of the qs Library: A 5× Speedup Case Study

A Tencent engineer fixed a severe memory‑leak in the qs library’s encode function by processing 30 MB strings in 1024‑character chunks, reducing heap usage from 2.5 GB to 0.48 GB and cutting runtime from 7.9 s to 2.1 s, achieving a five‑fold speedup and memory reduction, and contributed the change as an open‑source pull request.

JavaScriptMemory LeakNode.js
0 likes · 10 min read
Performance Optimization of the qs Library: A 5× Speedup Case Study
Past Memory Big Data
Past Memory Big Data
Apr 19, 2024 · Databases

How ByteHouse Achieves Hundred‑Fold OLAP Performance Gains

ByteHouse, a cloud‑native data warehouse built on ClickHouse, redesigns storage‑compute separation, introduces a new MPP architecture, rule‑based and cost‑based optimizers, exchange runtime filters, and parallelism techniques, delivering 10‑200× faster query performance on TPC‑DS, TPC‑H and SSB benchmarks and boosting point‑lookup QPS to 32,000.

ByteHouseOLAPPerformance Optimization
0 likes · 19 min read
How ByteHouse Achieves Hundred‑Fold OLAP Performance Gains
ZhongAn Tech Team
ZhongAn Tech Team
Apr 19, 2024 · Mobile Development

Implementing a Flutter Hot‑Fix Solution for ZA Bank: Architecture, Process, and Lessons Learned

This article details ZA Bank’s implementation of a Flutter hot‑fix solution, describing the evaluation of various approaches, the selection of a FlutterWeb‑based page‑downgrade strategy, the design of backend patch management, challenges such as font loading and package size, and the resulting high fix rate and performance improvements.

Cross‑PlatformFlutterFlutterWeb
0 likes · 24 min read
Implementing a Flutter Hot‑Fix Solution for ZA Bank: Architecture, Process, and Lessons Learned
ByteFE
ByteFE
Apr 19, 2024 · Game Development

Optimizing Game Interaction with AnnieX: Engine Preheat, Asset Offline Library, and Resource Compression for the 2024 Douyin Spring Festival

This article details how the AnnieX cross‑platform container was enhanced for the 2024 Douyin Spring Festival by introducing an interactive suite that includes engine pre‑heating, a shared offline asset library, and advanced 3D resource compression techniques, resulting in significant performance gains and bandwidth savings.

Performance OptimizationResource Compressionasset management
0 likes · 21 min read
Optimizing Game Interaction with AnnieX: Engine Preheat, Asset Offline Library, and Resource Compression for the 2024 Douyin Spring Festival
macrozheng
macrozheng
Apr 18, 2024 · Backend Development

Boost Spring Boot Performance with Redis Lua Scripts: A Complete Guide

This tutorial explains Lua scripting fundamentals, why Lua is ideal for Redis, common use cases, and step‑by‑step integration of Lua scripts into Spring Boot applications—including dependency setup, configuration, code examples, performance benefits, error handling, security considerations, and best‑practice recommendations.

Lua scriptingPerformance OptimizationSpring Boot
0 likes · 21 min read
Boost Spring Boot Performance with Redis Lua Scripts: A Complete Guide
ByteFE
ByteFE
Apr 17, 2024 · Frontend Development

How ByteDance’s SAR Creator Powers the ‘Lucky Dragon’ New Year Interactive Experience

This article details the technical implementation of the "Lucky Dragon" Spring Festival interactive game in Douyin, covering the cross‑platform framework, SAR Creator engine, scene construction, animation control, coordinate synchronization, terrain management, and performance‑focused scene switching strategies.

Performance OptimizationSAR CreatorTypeScript
0 likes · 29 min read
How ByteDance’s SAR Creator Powers the ‘Lucky Dragon’ New Year Interactive Experience
Ops Development & AI Practice
Ops Development & AI Practice
Apr 17, 2024 · Fundamentals

Master Bitwise Operations: Essential Tricks for Faster Code

This article introduces the fundamentals of bitwise operations, explains common operators, presents practical tricks such as parity checks, swapping without extra space, clearing and extracting the lowest set bit, and demonstrates real‑world applications like bit counting and permission management with clear C code examples.

C ProgrammingPerformance Optimizationbitwise-operations
0 likes · 6 min read
Master Bitwise Operations: Essential Tricks for Faster Code
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Apr 16, 2024 · Backend Development

Speed Up Spring Startup with Parallel Bean Initialization

This article introduces Spring 6.2’s Parallel Bean Initialization feature, explains its benefits for reducing startup time, provides step‑by‑step code examples for configuring background bean initialization and a bootstrap executor, compares traditional and concurrent initialization timings, and details the underlying implementation in the Spring container.

JavaParallel Bean InitializationPerformance Optimization
0 likes · 7 min read
Speed Up Spring Startup with Parallel Bean Initialization
MaGe Linux Operations
MaGe Linux Operations
Apr 15, 2024 · Operations

Speed Up Ansible: Deep Dive into Execution Flow, Async Tasks, and Performance Tweaks

This article explains why Ansible can be slow with many tasks, shows how to profile task execution, analyzes the detailed SSH‑based execution process, and provides practical optimizations such as adjusting forks, using async/poll, enabling persistent SSH connections, pipelining, tweaking fact collection, and employing the Mitogen strategy plugin.

Performance OptimizationPipeliningSSH
0 likes · 29 min read
Speed Up Ansible: Deep Dive into Execution Flow, Async Tasks, and Performance Tweaks
NetEase Cloud Music Tech Team
NetEase Cloud Music Tech Team
Apr 15, 2024 · Mobile Development

Implementation and Optimization of Local Private Domain Search in Cloud Music

The Cloud Music team integrated a lightweight on‑device full‑text engine using SQLite FTS5 with a simple tokenizer, replaced JavaScript matching with SQLite’s bm25(), parallelized queries, and cut search latency by 75%, boosting CTR 13% and average playback by 17 seconds while preserving user privacy.

FTS5Performance OptimizationSQLite
0 likes · 15 min read
Implementation and Optimization of Local Private Domain Search in Cloud Music
Ops Development & AI Practice
Ops Development & AI Practice
Apr 15, 2024 · Backend Development

Boost Go Performance with sync.Pool: Practical Guide and UML Modeling

This article explains how Go's sync.Pool can reduce memory allocations and garbage‑collection overhead in high‑performance applications, provides step‑by‑step usage examples, demonstrates a byte‑buffer pool, shows performance benefits, and visualizes the mechanism with UML class and sequence diagrams.

GoPerformance Optimizationmemory management
0 likes · 7 min read
Boost Go Performance with sync.Pool: Practical Guide and UML Modeling
DataFunTalk
DataFunTalk
Apr 15, 2024 · Databases

ByteHouse Cloud‑Native Data Warehouse Performance Whitepaper: Architecture, Optimizations, and Benchmark Results

The ByteHouse performance whitepaper details the cloud‑native data warehouse’s architecture, rule‑based and cost‑based optimizer enhancements, exchange runtime, runtime filters, parallelism and wide‑table optimizations, and presents benchmark comparisons on TPC‑DS, TPC‑H and SSB datasets demonstrating orders‑of‑magnitude query speed improvements.

ByteHouseOLAPPerformance Optimization
0 likes · 17 min read
ByteHouse Cloud‑Native Data Warehouse Performance Whitepaper: Architecture, Optimizations, and Benchmark Results
Architecture Digest
Architecture Digest
Apr 14, 2024 · Backend Development

Optimizing Nested Loops in Java: From O(N²) to O(N) Using HashMap

This article demonstrates how to replace a costly double‑for‑loop that matches two large lists of users with a HashMap lookup, showing performance measurements, the effect of adding a break statement, and detailed Java code examples for backend developers.

HashMapJavaPerformance Optimization
0 likes · 7 min read
Optimizing Nested Loops in Java: From O(N²) to O(N) Using HashMap
iQIYI Technical Product Team
iQIYI Technical Product Team
Apr 12, 2024 · Mobile Development

Performance Optimization Strategies for iQIYI Android App on Low-End Devices

iQIYI improves its Android app for low‑end phones by classifying devices, streamlining startup with task‑based scheduling and baseline profiles, reducing UI thread load through card layout hard‑coding, message queuing, effect degradation, and pre‑fetching data, while continuously monitoring performance to ensure faster, smoother user experiences.

AndroidBaseline ProfilesPerformance Optimization
0 likes · 16 min read
Performance Optimization Strategies for iQIYI Android App on Low-End Devices
FunTester
FunTester
Apr 12, 2024 · Backend Development

Performance Optimization Techniques for Backend Systems: Replacing Protobuf with C++ Classes, Cache‑Friendly Structures, jemalloc, and Lock‑Free Data Structures

The article presents practical backend performance optimization methods—including substituting Protobuf with native C++ classes, employing cache‑friendly data structures, integrating jemalloc/tcmalloc, using lock‑free double‑buffer designs, and tailoring data formats—to achieve up to three‑fold speed improvements and significant latency reductions.

C++Cache FriendlyLock-Free
0 likes · 15 min read
Performance Optimization Techniques for Backend Systems: Replacing Protobuf with C++ Classes, Cache‑Friendly Structures, jemalloc, and Lock‑Free Data Structures
JD Tech
JD Tech
Apr 11, 2024 · Mobile Development

Performance Optimization of the Five-Star Store Mini Program: A Comprehensive Case Study

This article details the background, actions, and future outlook of performance and experience optimization for the Five-Star Store mini program, covering template handling, JS error reduction, rendering speed improvements, package size reduction, and systematic testing and iteration mechanisms across multiple device platforms.

Mobile DevelopmentPerformance Optimizationcross-platform
0 likes · 16 min read
Performance Optimization of the Five-Star Store Mini Program: A Comprehensive Case Study
DataFunTalk
DataFunTalk
Apr 9, 2024 · Big Data

Practical Experience and Solutions for Migrating and Optimizing Spark 3.1 in Xiaomi’s One‑Stop Data Development Platform

This article shares Xiaomi's real‑world challenges and solutions when building a new Spark 3.1‑based data platform, covering Multiple Catalog implementation, Hive‑to‑Spark SQL migration, automated batch upgrades, performance and stability optimizations, and future roadmap for vectorized execution.

Apache SparkHiveMetacat
0 likes · 14 min read
Practical Experience and Solutions for Migrating and Optimizing Spark 3.1 in Xiaomi’s One‑Stop Data Development Platform
Bilibili Tech
Bilibili Tech
Apr 9, 2024 · Big Data

Optimizing Flink State Performance with RocksDB KV Separation and BlobDB

In large‑scale Flink double‑stream joins, terabyte‑sized RocksDB state caused severe compaction latency and CPU spikes, but enabling RocksDB BlobDB KV‑separation (and an inner‑compaction patch) dramatically shrank SST files, reduced read/write latencies to sub‑millisecond levels, and cut CPU spikes by about half.

FlinkKV SeparationPerformance Optimization
0 likes · 12 min read
Optimizing Flink State Performance with RocksDB KV Separation and BlobDB
Architects' Tech Alliance
Architects' Tech Alliance
Apr 6, 2024 · Artificial Intelligence

How ByteDance Scaled LLM Training to Over 10,000 GPUs: Inside the MegaScale System

The article analyzes ByteDance and Peking University's MegaScale system that enables efficient, stable training of large language models on clusters exceeding ten thousand GPUs, detailing algorithmic tweaks, 3D parallel communication overlap, operator optimizations, data‑pipeline improvements, network tuning, and fault‑tolerance mechanisms that together achieve a 55.2% MFU on a 175B model.

GPU clustersLLM trainingMegaScale
0 likes · 15 min read
How ByteDance Scaled LLM Training to Over 10,000 GPUs: Inside the MegaScale System
DataFunSummit
DataFunSummit
Mar 30, 2024 · Big Data

Alluxio in Data & AI Lakehouse: Architecture, Performance Optimizations, and Cloud Practices at OPPO

OPPO's data architects combined their self‑developed Shuttle service with Alluxio to double performance, halve system pressure, and double throughput, while building a unified Data & AI lakehouse that integrates structured and unstructured data, metadata management, real‑time ingestion, and cloud cost reductions.

AIAlluxioCloud Computing
0 likes · 11 min read
Alluxio in Data & AI Lakehouse: Architecture, Performance Optimizations, and Cloud Practices at OPPO
ITPUB
ITPUB
Mar 29, 2024 · Databases

How to Import 1 Billion Records into MySQL at Lightning Speed

This guide explains how to efficiently load one billion 1‑KB log entries from HDFS or S3 into MySQL by analyzing B‑tree limits, using batch inserts, choosing the right storage engine, sharding tables, optimizing file reading, and coordinating tasks with Redis, Redisson, and Zookeeper.

Batch InsertDistributed TasksMySQL
0 likes · 19 min read
How to Import 1 Billion Records into MySQL at Lightning Speed
Bilibili Tech
Bilibili Tech
Mar 29, 2024 · Mobile Development

Bilibili Completes Beta Development of HarmonyOS Native Video Application

Bilibili has finished beta development of its HarmonyOS native video app—the first bullet‑comment‑enabled video client on the platform—offering medium‑long video playback, personalized recommendations, search, hot lists and interactive features, while cutting build times from over twenty to under five minutes and targeting a full commercial launch with expanded services across smartphones, tablets, displays and vehicles in Q4 2024.

BilibiliHarmonyOSKotlin Multiplatform
0 likes · 4 min read
Bilibili Completes Beta Development of HarmonyOS Native Video Application
Code Ape Tech Column
Code Ape Tech Column
Mar 29, 2024 · Backend Development

Using Lua Scripts with Spring Boot and Redis: A Comprehensive Guide

This article explains how to integrate Lua scripts into Spring Boot applications for Redis, covering Lua fundamentals, performance benefits, common use cases, step‑by‑step implementation with Spring Data Redis, error handling, security considerations, and best‑practice recommendations.

LuaPerformance OptimizationSpring Boot
0 likes · 20 min read
Using Lua Scripts with Spring Boot and Redis: A Comprehensive Guide
NewBeeNLP
NewBeeNLP
Mar 28, 2024 · Industry Insights

How Meta’s HSTU Architecture Scales Recommendation Systems Beyond Decades of Deep Models

Meta introduces a generative recommendation framework (GR) built on the Hierarchical Sequential Transduction Unit (HSTU) that unifies heterogeneous features, treats user behavior as a new modality, and leverages novel encoder and inference optimizations to achieve order‑of‑magnitude scaling in model size, training compute, and online latency while delivering 12‑18% online gains over traditional deep recommendation models.

Generative ModelsHSTUMeta
0 likes · 36 min read
How Meta’s HSTU Architecture Scales Recommendation Systems Beyond Decades of Deep Models
Data Thinking Notes
Data Thinking Notes
Mar 27, 2024 · Big Data

How to Build and Optimize a Scalable User Profiling Platform from Scratch

This article explains the value of user profiling platforms, outlines their core functions, presents a layered architecture with open‑source options, and details engineering optimizations—from wide‑table design to BitMap caching and task‑mode execution—while also discussing current industry trends.

Performance OptimizationPlatform Architecturebig data
0 likes · 18 min read
How to Build and Optimize a Scalable User Profiling Platform from Scratch
StarRocks
StarRocks
Mar 26, 2024 · Big Data

How Replacing Spark with StarRocks Cut Data Refresh Time by 90% and Saved 99% Cost

The article details how the Xiaohongshu data warehouse team integrated StarRocks into their offline processing pipeline, replacing Spark for heavy Cube calculations, which reduced job execution from hours to minutes, cut resource consumption by over 90%, advanced daily data output by 1.5 hours, and lowered refresh cost by more than 99%.

OLAPPerformance OptimizationSpark
0 likes · 18 min read
How Replacing Spark with StarRocks Cut Data Refresh Time by 90% and Saved 99% Cost
FunTester
FunTester
Mar 21, 2024 · Operations

How Dynamic Task‑Grabbing Cuts Distributed Batch Jobs from Hours to Minutes

This article presents a detailed case study of optimizing a distributed batch processing system by replacing static shard‑key concurrency with a dynamic task‑grabbing mechanism, dramatically reducing execution time from several hours to under fifteen minutes while maintaining stable resource usage.

Batch ProcessingPerformance Optimizationdistributed systems
0 likes · 8 min read
How Dynamic Task‑Grabbing Cuts Distributed Batch Jobs from Hours to Minutes
DataFunSummit
DataFunSummit
Mar 20, 2024 · Big Data

Large‑Scale Evolution of Spark Shuffle Cloud‑Native Architecture at ByteDance

This article details ByteDance's large‑scale evolution of Spark Shuffle to a cloud‑native architecture, describing background, stability and mixed‑resource scenarios, challenges such as CPU and I/O limits, custom ESS enhancements, shuffle throttling, spill‑split mechanisms, and the Cloud Shuffle Service with its push‑based design and performance gains.

KubernetesPerformance OptimizationShuffle
0 likes · 21 min read
Large‑Scale Evolution of Spark Shuffle Cloud‑Native Architecture at ByteDance
DataFunTalk
DataFunTalk
Mar 16, 2024 · Big Data

Performance Optimization Practices for KwaiBI Big Data Analysis Platform

This article introduces KwaiBI, the internal data analysis product of Kuaishou, outlines its five major functional areas, details the performance challenges of large‑scale analytics, and presents a comprehensive set of optimization techniques—including cache warming, query rewriting, materialized acceleration, and the Bleem lake‑house engine—along with future directions and a brief Q&A.

Data AnalyticsKwaiBILakehouse
0 likes · 15 min read
Performance Optimization Practices for KwaiBI Big Data Analysis Platform
Architect
Architect
Mar 15, 2024 · Databases

How to Diagnose and Optimize Redis Memory Usage: Real‑World Cases

This article dissects Redis's memory architecture, explains each memory component, walks through object encoding rules, buffer handling, fragmentation, and child‑process memory, then presents two production incidents with step‑by‑step analysis and concrete optimization actions to prevent future memory alarms.

Performance OptimizationRediscase study
0 likes · 27 min read
How to Diagnose and Optimize Redis Memory Usage: Real‑World Cases
DataFunSummit
DataFunSummit
Mar 14, 2024 · Big Data

Tencent Game Data Analysis: Lakehouse Integration Practice

This article presents Tencent Game's comprehensive lakehouse integration practice, detailing the project background, storage‑compute separation, data layering, unified DDL/DML operations, performance optimizations, and future plans, illustrating how StarRocks, Iceberg, and Spark are combined to achieve scalable, cost‑effective analytics for massive game data.

Compute-Storage SeparationLakehousePerformance Optimization
0 likes · 16 min read
Tencent Game Data Analysis: Lakehouse Integration Practice
DataFunTalk
DataFunTalk
Mar 13, 2024 · Artificial Intelligence

Exploring and Practicing Large Models at Ctrip

This presentation by Ctrip algorithm expert Wei Peng details the rapid development of large language models, their core capabilities, and practical applications in the travel industry, covering content marketing, multimodal interactions, customer service efficiency, model comparisons, fine‑tuning, and inference performance optimization.

Performance OptimizationTravel Industry
0 likes · 3 min read
Exploring and Practicing Large Models at Ctrip
Architect
Architect
Mar 12, 2024 · Backend Development

Boost C++ Service Performance: 3× Faster with Classes, Cache‑Friendly Structures, jemalloc and Lock‑Free Designs

This article walks through a series‑by‑step performance‑tuning process for high‑throughput C++ services, replacing Protobuf with plain classes, adopting cache‑friendly hash tables, switching to jemalloc, implementing a double‑buffer lock‑free data structure, and tailoring data formats, each backed by concrete code examples, benchmark results, and analysis of trade‑offs.

C++Cache FriendlyLock-Free
0 likes · 20 min read
Boost C++ Service Performance: 3× Faster with Classes, Cache‑Friendly Structures, jemalloc and Lock‑Free Designs
21CTO
21CTO
Mar 11, 2024 · Backend Development

How I Slashed PHP 1B‑Row Processing Time from 25 min to 27 s

In this article the author walks through the 1 billion‑row (1brc) challenge, shows a naïve PHP implementation, profiles its bottlenecks, and incrementally applies optimizations—switching from fgetcsv to fgets, using references, adding type casts, enabling JIT and parallel processing—to reduce runtime from 25 minutes to under 30 seconds.

1B Row ChallengeJITPHP
0 likes · 12 min read
How I Slashed PHP 1B‑Row Processing Time from 25 min to 27 s
Ctrip Technology
Ctrip Technology
Mar 8, 2024 · Backend Development

Design and Implementation of Ctrip Flight Order Itinerary System: Architecture, Sharding, Caching, and Structured Concurrency

The article presents a comprehensive case study of Ctrip's flight order itinerary system, detailing its background challenges, design goals, modular architecture, data aggregation strategies, sharding and Redis caching optimizations, and the adoption of Java structured concurrency to achieve high performance, reliability, and scalability.

BackendCachingPerformance Optimization
0 likes · 13 min read
Design and Implementation of Ctrip Flight Order Itinerary System: Architecture, Sharding, Caching, and Structured Concurrency
iQIYI Technical Product Team
iQIYI Technical Product Team
Mar 8, 2024 · Big Data

Smooth Migration from Hive to Iceberg Data Lake at iQIYI: Architecture, Techniques, and Performance Evaluation

iQIYI migrated hundreds of petabytes of Hive tables to Apache Iceberg using dual‑write, in‑place, and CTAS strategies, combined with partition pruning, Bloom filters, and Trino/Alluxio optimizations, achieving up to 40% lower query latency, simplified pipelines, and faster, cost‑effective data lake operations.

Data LakeHivePerformance Optimization
0 likes · 20 min read
Smooth Migration from Hive to Iceberg Data Lake at iQIYI: Architecture, Techniques, and Performance Evaluation
Test Development Learning Exchange
Test Development Learning Exchange
Mar 7, 2024 · Operations

Full‑Chain Load Testing: Definition, Challenges, and Best Practices

This article explains the concept of full‑chain load testing for e‑commerce systems, outlines why it is essential, discusses major challenges such as coordination and data isolation, and provides practical steps and optimization strategies to reliably simulate real‑world traffic and improve system stability.

Load TestingPerformance Optimizatione-commerce
0 likes · 9 min read
Full‑Chain Load Testing: Definition, Challenges, and Best Practices
Baidu Geek Talk
Baidu Geek Talk
Mar 6, 2024 · Artificial Intelligence

How Baidu’s BCCL Boosts Large‑Model Training with Real‑Time Observability and Fault Diagnosis

The article explains why collective communication is critical for distributed large‑model training, outlines the new requirements for system reliability, and introduces Baidu’s Collective Communication Library (BCCL), detailing its enhanced observability, fault‑diagnosis, stability, and performance optimizations that raise effective training time to 98 % and bandwidth utilization to 95 %.

AI InfrastructureDistributed TrainingPerformance Optimization
0 likes · 11 min read
How Baidu’s BCCL Boosts Large‑Model Training with Real‑Time Observability and Fault Diagnosis
php Courses
php Courses
Mar 6, 2024 · Databases

MySQL 8 New Features and Network Communication Course Overview

This course introduces MySQL 8's latest features, deep dives into its network communication mechanisms, and teaches advanced performance optimization techniques such as connection pooling, compression, and SSL encryption through hands‑on projects to enhance database efficiency and security.

MySQLPerformance Optimizationdatabase
0 likes · 2 min read
MySQL 8 New Features and Network Communication Course Overview
Su San Talks Tech
Su San Talks Tech
Mar 5, 2024 · Backend Development

Cracking the One Billion Row Challenge: Java Performance Secrets Unveiled

This article walks through the One Billion Row Challenge, explaining the problem, baseline solution, and a series of progressive Java optimizations—from parallel streams and better JVMs to custom hash tables, Unsafe, SWAR, and statistical tuning—that shrink execution time from minutes to under two seconds.

Custom Hash TableGraalVMJava
0 likes · 20 min read
Cracking the One Billion Row Challenge: Java Performance Secrets Unveiled
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Mar 4, 2024 · Big Data

Integrating Data Lake Technologies with Data Warehouse Architecture at Xiaohongshu: Practices and Performance Optimizations

Xiaohongshu’s data‑warehouse team integrated Apache Iceberg‑based data‑lake techniques into its existing warehouse, replacing the legacy Hive/Spark stack with global sorting, Z‑order, and upsert‑enabled tables, which cut query latency by up to 90 %, boosted data freshness by 50 %, slashed storage costs by 83 % and saved tens of thousands of GB‑hours of compute daily.

Apache IcebergData LakeFlink
0 likes · 19 min read
Integrating Data Lake Technologies with Data Warehouse Architecture at Xiaohongshu: Practices and Performance Optimizations
Volcano Engine Developer Services
Volcano Engine Developer Services
Feb 29, 2024 · Big Data

How MetaApp Cut Data Warehouse Costs by 50% with ByConity

MetaApp replaced ClickHouse with the open‑source cloud‑native data warehouse ByConity, achieving over 50% cost reduction and faster, more stable OLAP queries by separating storage and compute, simplifying scaling, and improving resource utilization across a range of analytics workloads such as deduplication, retention, conversion and point‑lookup.

ByConityClickHouseOLAP
0 likes · 13 min read
How MetaApp Cut Data Warehouse Costs by 50% with ByConity
Tencent Cloud Developer
Tencent Cloud Developer
Feb 29, 2024 · Backend Development

Performance Optimization Strategies for High‑Throughput Backend Services

The article outlines practical, continuous performance‑optimization tactics for high‑throughput back‑end services—replacing Protobuf with lightweight C++ classes, using cache‑friendly data structures, adopting jemalloc/tcmalloc, employing lock‑free double buffers, tailoring data formats, and leveraging profiling tools—to achieve multi‑fold speedups while balancing maintainability.

BackendC++Cache Friendly
0 likes · 18 min read
Performance Optimization Strategies for High‑Throughput Backend Services
DeWu Technology
DeWu Technology
Feb 28, 2024 · Cloud Native

Technical Overview of ZingJDK: ReadyNow, Falcon JIT, and C4 GC

ZingJDK, Azul’s high‑performance commercial JDK built on OpenJDK, combines ReadyNow® pre‑warming, the LLVM‑based Falcon JIT compiler, the pause‑free C4 concurrent compacting garbage collector, and a cloud‑native off‑load compiler to deliver dramatically faster startup and execution across JDK 7‑21, though it lacks dynamic Attach support and requires a commercial license.

JITJVMPerformance Optimization
0 likes · 17 min read
Technical Overview of ZingJDK: ReadyNow, Falcon JIT, and C4 GC
Baidu Geek Talk
Baidu Geek Talk
Feb 28, 2024 · Big Data

How Baidu’s Fusion Compute Engine Cuts Query Time to Seconds on Petabyte‑Scale Data

This article analyzes Baidu's fusion compute engine for its data warehouse, detailing its architecture, optimization techniques such as data skipping, Parquet column indexing, ProjectLimit and CodeGen, and demonstrates how these innovations reduce query latency to seconds while cutting storage costs by about 30% on multi‑petabyte workloads.

BaiduFusion Compute EnginePerformance Optimization
0 likes · 12 min read
How Baidu’s Fusion Compute Engine Cuts Query Time to Seconds on Petabyte‑Scale Data
php Courses
php Courses
Feb 26, 2024 · Backend Development

PHP Memory Management Functions: memory_get_usage, memory_get_peak_usage, gc_collect_cycles, and memory_limit

This article explains PHP's key memory management functions—including memory_get_usage, memory_get_peak_usage, gc_collect_cycles, and the memory_limit setting—providing usage syntax, examples, and guidance on optimizing script performance and preventing memory‑related issues.

PHPPerformance Optimizationbackend development
0 likes · 4 min read
PHP Memory Management Functions: memory_get_usage, memory_get_peak_usage, gc_collect_cycles, and memory_limit
Practical DevOps Architecture
Practical DevOps Architecture
Feb 26, 2024 · Big Data

Advanced ElasticStack Development and Architecture Course (P6)

This course provides comprehensive, hands‑on training on ElasticSearch, Logstash, Kibana, and the ElasticStack ecosystem, covering advanced development, cluster design, performance tuning, security, and real‑world integration techniques for large‑scale data processing.

ElasticStackElasticsearchPerformance Optimization
0 likes · 6 min read
Advanced ElasticStack Development and Architecture Course (P6)
Architect
Architect
Feb 17, 2024 · Backend Development

How Bilibili Scaled Its Membership Purchase System: Call‑Chain Refactor, Async Ordering, and Sharding

This article details how Bilibili’s membership‑purchase platform tackled massive traffic spikes by redesigning the order call chain, introducing concurrent and asynchronous processing, and applying a sharding strategy that split databases and tables, ultimately boosting latency performance and supporting over 4,000 TPS during peak sales.

BackendDatabase ScalingPerformance Optimization
0 likes · 15 min read
How Bilibili Scaled Its Membership Purchase System: Call‑Chain Refactor, Async Ordering, and Sharding
DataFunTalk
DataFunTalk
Feb 17, 2024 · Big Data

JD Logistics One‑Stop Agile BI Solution: Architecture, Challenges, and Optimization

This article presents JD Logistics' one‑stop agile BI platform, detailing the complex data sources, rapid requirement changes, and Chinese‑style reporting challenges it addresses, while outlining the UData solution, product methodology, performance enhancements, and real‑world case studies that demonstrate significant efficiency gains.

Agile AnalyticsBIData Integration
0 likes · 26 min read
JD Logistics One‑Stop Agile BI Solution: Architecture, Challenges, and Optimization
NewBeeNLP
NewBeeNLP
Feb 8, 2024 · Artificial Intelligence

How Speculative Decoding Supercharges Large Language Model Inference

This survey examines speculative decoding—a draft‑then‑verify technique that parallelizes token generation to cut LLM inference latency, outlines its core components, compares independent and self‑drafting methods, discusses verification strategies, and highlights open research challenges.

Artificial IntelligenceLLM InferenceParallelism
0 likes · 15 min read
How Speculative Decoding Supercharges Large Language Model Inference
DataFunSummit
DataFunSummit
Feb 7, 2024 · Big Data

Evolution of OLAP with Apache Doris at Xingyun Retail Credit

Facing rapid data growth, Xingyun Retail Credit transitioned from traditional OLTP systems to an Apache Doris‑based OLAP solution, detailing the data demand generation, OLAP engine selection challenges, multi‑stage implementation, performance gains, data‑warehouse construction, and future roadmap for scalable analytics.

Apache DorisFinTechOLAP
0 likes · 17 min read
Evolution of OLAP with Apache Doris at Xingyun Retail Credit
Architect
Architect
Feb 4, 2024 · Backend Development

How We Revamped QQ Browser Content Architecture: From Microservices to a High‑Performance Monolith

Facing low development efficiency, poor CPU utilization, and fragile fault tolerance, the QQ Browser content ingestion team rebuilt a 93‑service microservice system into a single‑process, plugin‑driven architecture, achieving up to 13‑fold throughput gains, 10‑fold batch‑processing speedups, and dramatically reduced lead times and code complexity.

BackendC++CI/CD
0 likes · 22 min read
How We Revamped QQ Browser Content Architecture: From Microservices to a High‑Performance Monolith
Su San Talks Tech
Su San Talks Tech
Feb 4, 2024 · Databases

Essential MySQL Design & Performance Guidelines You Should Follow

This article compiles practical MySQL best‑practice rules covering character set selection, InnoDB usage, naming conventions, field design, index strategies, SQL coding standards, and operational safeguards to help developers build robust, high‑performance databases.

MySQLPerformance Optimizationbest practices
0 likes · 24 min read
Essential MySQL Design & Performance Guidelines You Should Follow
Sohu Tech Products
Sohu Tech Products
Jan 31, 2024 · Industry Insights

How Didi Scaled Real‑Time Dashboards with StarRocks Materialized Views

This article details Didi's evolution from a multi‑engine OLAP stack to a unified StarRocks solution, explains the design of global dictionaries and materialized views for real‑time dashboard acceleration, and shares performance results, challenges, and future optimization directions.

DidiMaterialized ViewsOLAP
0 likes · 19 min read
How Didi Scaled Real‑Time Dashboards with StarRocks Materialized Views
DataFunTalk
DataFunTalk
Jan 28, 2024 · Databases

Practical Experience of StarRocks Materialized Views at Didi

This article presents Didi's practical experience with StarRocks materialized views, covering the evolution of its OLAP architecture, the challenges of previous engines, the adoption of StarRocks, the design of materialized view acceleration for real‑time dashboards, and future optimization directions.

Materialized ViewOLAPPerformance Optimization
0 likes · 17 min read
Practical Experience of StarRocks Materialized Views at Didi
Architect's Guide
Architect's Guide
Jan 27, 2024 · Backend Development

Optimizing Thread Pool Size for CPU‑Bound and I/O‑Bound Tasks in Java

This article explains the differences between CPU‑intensive and I/O‑intensive workloads, provides optimization strategies such as multithreading, caching, and load balancing, and presents Java code examples and formulas for calculating the optimal thread‑pool size based on core count, target CPU utilization, and blocking factors.

CPU BoundI/O BoundJava
0 likes · 12 min read
Optimizing Thread Pool Size for CPU‑Bound and I/O‑Bound Tasks in Java
JD Tech
JD Tech
Jan 26, 2024 · Backend Development

Optimizing Java Applications with Spring Boot 2.7 and JDK 17: Features, Migration Steps, and Deployment Practices

This article explains how combining Spring Boot 2.7 with JDK 17 can improve Java application performance, outlines the new language and runtime features, details migration challenges, provides configuration and code examples, and shares practical deployment guidance for cloud‑native environments.

JDK 17Performance OptimizationSpring Boot
0 likes · 23 min read
Optimizing Java Applications with Spring Boot 2.7 and JDK 17: Features, Migration Steps, and Deployment Practices
Volcano Engine Developer Services
Volcano Engine Developer Services
Jan 24, 2024 · Cloud Native

How ByteDance’s Gödel Scheduler Unifies Online and Offline Workloads at Massive Scale

The article details ByteDance’s Gödel Scheduler, a cloud‑native, distributed Kubernetes scheduler that unifies online and offline workloads, describing its architecture, enhanced features, performance gains, roadmap, and open‑source plans, including its multi‑instance design, optimistic concurrency, and rescheduling capabilities for improved throughput and scheduling quality.

KubernetesPerformance Optimizationscheduler
0 likes · 15 min read
How ByteDance’s Gödel Scheduler Unifies Online and Offline Workloads at Massive Scale
Caiyun Tech Team
Caiyun Tech Team
Jan 24, 2024 · Backend Development

How We Built a High‑Performance Elevation API with 30 m Resolution

This article details the end‑to‑end process of replacing low‑resolution SRTM data with 30‑meter ASTER elevation data, redesigning storage and access using JuiceFS, Go, and sync.Pool, and achieving sub‑millisecond latency for 1500 QPS in a Kubernetes environment.

GeoTIFFGoJuiceFS
0 likes · 9 min read
How We Built a High‑Performance Elevation API with 30 m Resolution
Architect
Architect
Jan 23, 2024 · Backend Development

How I Cut a Java Service’s Response Time from Seconds to Milliseconds with Arthas

The article details how a high‑traffic Helios scoring service, originally taking several seconds to return a day’s worth of data, was profiled with Arthas and iteratively optimized through four code revisions, ultimately reducing latency to around 60 ms while exposing key performance pitfalls such as object creation, date formatting, and trivial list operations.

ArthasBackendJava
0 likes · 35 min read
How I Cut a Java Service’s Response Time from Seconds to Milliseconds with Arthas
IT Niuke
IT Niuke
Jan 20, 2024 · Backend Development

How Lua Scripts Supercharge Spring Boot with Redis for Performance and Atomic Operations

This article explains Lua fundamentals, why Lua is advantageous inside Redis, common use‑cases such as cache updates and distributed locks, and provides step‑by‑step guidance for integrating and executing Lua scripts in a Spring Boot application to improve performance and ensure atomicity.

LuaLua scriptingPerformance Optimization
0 likes · 22 min read
How Lua Scripts Supercharge Spring Boot with Redis for Performance and Atomic Operations
Architect
Architect
Jan 18, 2024 · Backend Development

How Vivo Supercharged Dubbo Routing with Async Caching and Load‑Balancing Optimizations

This article analyzes the CPU‑heavy routing and load‑balancing modules of Dubbo in a large‑scale microservice cluster, identifies O(n) traversal as the root cause, and presents a step‑by‑step redesign—including disabling unused routers, caching route results with epoch validation, BitMap‑based intersection, and grouped routing—that reduces CPU usage by up to 27% and doubles TPS when provider instances exceed 2,000.

CachingDubboJava
0 likes · 21 min read
How Vivo Supercharged Dubbo Routing with Async Caching and Load‑Balancing Optimizations
Meituan Technology Team
Meituan Technology Team
Jan 18, 2024 · Information Security

Meituan Java RASP: Architecture, Challenges, and Performance Optimizations

The article details Meituan's large‑scale RASP (Runtime Application Self‑Protection) rollout, covering deployment challenges such as heterogeneous Java environments, performance impact of agent injection, upgrade difficulties, monitoring complexities, and the engineering solutions—including agentmain/premain hybrid loading, gray‑scale upgrades, hot‑update plugin architecture, and performance optimizations—validated with concrete metrics and benchmarks.

Gray DeploymentJava AgentPerformance Optimization
0 likes · 31 min read
Meituan Java RASP: Architecture, Challenges, and Performance Optimizations
DaTaobao Tech
DaTaobao Tech
Jan 17, 2024 · Backend Development

Scaling and Performance Optimization of Taobao Shopping Cart

Taobao’s shopping cart was scaled and optimized by raising the item limit to 380, deploying the cloud‑native in‑memory read‑only replica tairSQL for read‑write separation, pre‑computing promotions, compressing payloads, caching data, redesigning the protocol, introducing response‑streaming APIs, and parallelizing per‑item processing with Java’s ForkJoinPool, dramatically cutting latency during traffic spikes.

Performance OptimizationShopping Cartcloud-native
0 likes · 15 min read
Scaling and Performance Optimization of Taobao Shopping Cart
Tencent Cloud Developer
Tencent Cloud Developer
Jan 17, 2024 · Mobile Development

Upgrading Tencent Video Search from Hippy 2.0 to Hippy 3.0: Process, Optimizations, and New Features

The Tencent Video Search team migrated its search pages from Hippy 2.0 to Hippy 3.0, eliminating animation, image and style inconsistencies, adding a native horizontal‑scroll component, and applying engine pre‑loading, JSI calls and CSS optimizations that cut rendering time by up to 30 % and dramatically improved development efficiency and cross‑platform consistency.

Frontend FrameworkHippyMobile Development
0 likes · 17 min read
Upgrading Tencent Video Search from Hippy 2.0 to Hippy 3.0: Process, Optimizations, and New Features
DataFunTalk
DataFunTalk
Jan 14, 2024 · Big Data

Optimizing Object Storage and Impala Engine in NetEase NDH: Performance Enhancements and Feature Additions

This presentation outlines NetEase's NDH big‑data platform, detailing its background, object‑storage upload and rename optimizations, Impala engine adaptations—including file‑handle caching, transparent URI handling, and getFileBlockLocations improvements—and a suite of operational enhancements such as dynamic proxy user configuration and audit‑log extensions.

AlluxioImpalaNDH
0 likes · 14 min read
Optimizing Object Storage and Impala Engine in NetEase NDH: Performance Enhancements and Feature Additions
Architect
Architect
Jan 10, 2024 · Backend Development

Design and Performance Optimization of a Custom API Gateway (DAG)

This article presents a comprehensive analysis of the limitations of Spring Cloud Gateway, proposes a self‑developed API gateway architecture called DAG, details its core components such as request context, filter chain, async client, routing, and connection management, and demonstrates through extensive performance testing that DAG achieves significantly higher throughput, lower latency, and improved stability compared to the original SCG solution.

API GatewayNettyPerformance Optimization
0 likes · 39 min read
Design and Performance Optimization of a Custom API Gateway (DAG)
政采云技术
政采云技术
Jan 10, 2024 · Operations

Understanding and Improving Elasticsearch Shard Balancing Strategies

This article analyzes Elasticsearch shard imbalance incidents, explains the built‑in shard balancing algorithm and its configuration parameters, demonstrates weight calculations with source code, and proposes practical improvements—including shard count adjustments and a custom load‑aware balancing tool—to achieve more effective cluster load distribution.

Cluster OperationsElasticsearchPerformance Optimization
0 likes · 17 min read
Understanding and Improving Elasticsearch Shard Balancing Strategies
DaTaobao Tech
DaTaobao Tech
Jan 5, 2024 · Mobile Development

Edge Deployment and Performance Optimization of Large Language Models with MNN

The upgraded mnn‑llm framework adds a unified llm‑export pipeline, cross‑platform inference with tokenizers and disk‑embedding, and ARM‑focused linear‑layer optimizations—including SIMD, hand‑written assembly and 4‑bit quantization—that dramatically speed up prefilling and achieve real‑time LLM conversation on mobile devices within a 2 GB memory budget, outperforming llama.cpp, fastllm and mlc‑llm.

ARM CPUEdge DeploymentLLM
0 likes · 17 min read
Edge Deployment and Performance Optimization of Large Language Models with MNN
DataFunTalk
DataFunTalk
Dec 31, 2023 · Big Data

Apache Celeborn (Incubating): Addressing Traditional Shuffle Limitations in Big Data Processing

Apache Celeborn (Incubating) is a remote shuffle service designed to overcome the inefficiencies, high storage demands, network overhead, and limited fault tolerance of traditional Spark shuffle implementations by introducing push‑shuffle, partition splitting, columnar shuffle, multi‑layer storage, and elastic, stable, and scalable architectures.

Apache SparkPerformance OptimizationRemote Shuffle
0 likes · 15 min read
Apache Celeborn (Incubating): Addressing Traditional Shuffle Limitations in Big Data Processing
DataFunSummit
DataFunSummit
Dec 29, 2023 · Big Data

Exploring Indicator Platform Construction: Architecture, Methods, and Future Directions by Shusheng Technology

This article presents a comprehensive exploration of Shusheng Technology's indicator platform, covering industry challenges, three solution modes (Agile BI, Data Warehouse, Headless BI), the SwiftMetrics architecture, product capabilities, a retail case study, and future development plans for real‑time metrics and AI‑driven services.

BIData MetricsPerformance Optimization
0 likes · 15 min read
Exploring Indicator Platform Construction: Architecture, Methods, and Future Directions by Shusheng Technology
dbaplus Community
dbaplus Community
Dec 27, 2023 · Backend Development

Boost Elasticsearch Performance: 24 Proven Tips and Pitfalls to Avoid

This article compiles practical Elasticsearch recommendations—covering query caching, aggregation design, pagination strategies, scripting, mapping choices, shard and replica settings, and bulk indexing—to help engineers write faster, more reliable search queries while avoiding common performance traps.

Performance OptimizationQuery Tuningindex design
0 likes · 26 min read
Boost Elasticsearch Performance: 24 Proven Tips and Pitfalls to Avoid