Tagged articles
performance benchmarking
41 articles · Page 1 of 1
This comprehensive guide covers practical LLM quantization deployment, comparing GPTQ, AWQ, and GGUF formats with detailed implementation steps, performance benchmarks, memory planning, kernel selection, monitoring strategies, and rollback procedures for production environments.
AWQGGUFGPTQ
0 likes · 97 min read

StarRocks adopts Apache Paimon's C++ implementation (paimon-cpp) to replace JNI calls for primary-key merges and delete-vector handling, cutting cross-language overhead and reusing StarRocks' cache, memory management, and Query Profile; benchmarks show 1.4–3.4× speedups on primary-key counts and wide-table aggregations.
Apache PaimonJNINative Execution
0 likes · 14 min read

This article analyzes six public benchmark datasets comparing HTTP/1.1+JSON (REST) against binary protocols like gRPC+Protobuf and Dubbo, showing gRPC achieves roughly 2x throughput and half the latency, but argues the gap is often negligible in real business scenarios where database and logic dominate latency.
DubboHTTPHTTP/2
0 likes · 16 min read

This article benchmarks Java 27's default Compact Object Headers against Java 8 and Java 27 with the feature disabled, using identical bytecode. In a Spring Boot authentication service, COH reduces per-session heap by ~300 bytes (10% total heap), with total upgrade savings of ~21%. Benefits scale with active small object count, while hashCode and locking remain fully compatible.
Heap AnalysisJOLJVM Memory Optimization
0 likes · 25 min read

The article details how researchers bypassed OTP and firmware locks on the NVIDIA CMP 170HX mining GPU, expanding its memory from 10 GB to up to 80 GB, boosting FP32 performance from about 0.39 TFLOPS to roughly 12.2 TFLOPS (≈31×), while discussing benchmark results, stability limits, and the resulting price explosion.
AI inferenceCMP 170HXGPU unlocking
0 likes · 7 min read

The article shows that in AI‑assisted coding the real cost driver is cache hit rate, not model intelligence, using a lawyer‑memory analogy, hierarchical caching details, three SGLang PR fixes, token‑usage statistics, benchmark scores, and four concrete task‑level observations that together explain how Agnes 2.5 Pro Alpha reduces latency and expense.
AI programmingAgnesAISGLang
0 likes · 22 min read

Alibaba Mama AI Infra and AMD collaborated to integrate SGLang‑ATOM plugin mode for Qwen 3.5/3.6 models on MI308X GPUs, detailing multimodal, GDN, KV‑cache, and parallel‑strategy optimizations that achieve low‑latency, high‑throughput inference suitable for complex advertising workloads.
AMD ATOMGPU optimizationLLM inference
0 likes · 18 min read

This article examines how eBPF can reshape host security by providing kernel‑level visibility, low‑overhead real‑time monitoring, and a closed‑loop architecture that improves process and network data capture, demonstrates higher audit success rates than Netlink, and outlines performance, stability, and emergency‑handling mechanisms.
LinuxeBPFhost security
0 likes · 16 min read

This article explains how INT8, INT4, bitsandbytes, GPTQ, and AWQ quantization methods can dramatically cut memory usage, boost inference speed, and lower costs for large language models, while detailing their trade‑offs, practical workflows, benchmark results, and common pitfalls to help engineers decide which technique best fits their production scenario.
AWQGPTQINT4
0 likes · 22 min read


Geek LabsJun 9, 2026 · Artificial Intelligence
Rapid-MLX leverages Apple’s MLX framework and optimizations such as model caching and reasoning separation to deliver up to 4.2× faster token throughput than Ollama on Apple Silicon Macs, offers a lightweight 460 MB install, full OpenAI‑compatible API, tool calling, prompt caching, and easy Homebrew or pip setup.
Apple SiliconOpenAI compatibilityRapid-MLX
0 likes · 6 min read

Intel unveiled the world’s first 1.8nm data‑center CPU, the Xeon 6+ with 288 cores, leveraging RibbonFET, PowerVia and 3D chiplet stacking to achieve up to 2.26× higher performance and 55% better performance‑per‑watt than the previous generation, while adding SGX/TDX security and a 200 GbE Ethernet plus a new AI‑focused GPU.
1.8nmAI inferenceChiplet architecture
0 likes · 10 min read

Redisun 1.4.0 is a 33KB Java Redis client that uses connection‑reuse and Java AIO to achieve up to ten‑fold higher throughput than traditional clients such as Redisson, Lettuce and Jedis, while reducing startup time, memory usage, image size and bandwidth, and it offers a simple Maven dependency and API.
AIOJavaRedis
0 likes · 5 min read

vLLM tops the Artificial Analysis ranking by delivering the highest throughput for DeepSeek V3.2, Qwen 3.5 397B, and MiniMax‑M2.5 on identical NVIDIA Blackwell Ultra hardware, thanks to extensive kernel‑fusion optimizations that remain in the main branch.
DeepSeekLLM inferenceQwen
0 likes · 7 min read

QuantClaw, an open‑source plug‑in for the OpenClaw AI agent framework, uses a systematic quantization study to dynamically route tasks to appropriate model precisions, achieving up to 21% cost reduction, 8‑15% latency improvement, and even higher task scores across diverse workloads.
AI agentsCost OptimizationOpenClaw
0 likes · 8 min read

A benchmark of Redis, Memcached, DragonflyDB, and Cashews using the same FastAPI workload reveals that Redis falls behind on latency, throughput, and memory efficiency, while DragonflyDB and Cashews offer superior performance and developer experience for Python caching.
CachingCashewsDragonflyDB
0 likes · 11 min read

A recent ICLR 2026 study from Zhejiang University, Ant Group, and Stony Brook introduces a problem‑oriented dataset and an anchor‑verification framework that enable large language models to not only generate correct code but also significantly improve its execution speed, achieving up to six‑fold acceleration while maintaining high correctness.
AI code generationanchor verificationcode optimization
0 likes · 8 min read

Taalas embeds the Llama 3.1 8B model directly into a 6nm ASIC, delivering 17,000 tokens per second—nearly ten times faster than top NVIDIA GPUs—while cutting system cost by over tenfold and power consumption by tenfold, albeit with limited flexibility and quantization trade‑offs.
AI hardwareASICLlama 3.1
0 likes · 10 min read


TonyBaiFeb 18, 2026 · Backend Development
The Bifrost team replaced Python with Go for their LLM gateway, achieving roughly 700× lower latency, 68% less memory usage, and three‑fold higher throughput, and the article explains the performance bottlenecks of Python, Go’s concurrency model, deployment advantages, and future AI infrastructure trends.
AI infrastructureConcurrencyGo
0 likes · 14 min read

This article explains the predictive‑execution design pattern for agentic AI, showing how to launch tool calls speculatively in parallel with LLM reasoning, provides a full Python implementation using LangChain, and demonstrates a 28% latency reduction compared with a sequential workflow.
Agentic AILangChainPython
0 likes · 13 min read

ClusterAttn tackles the KV‑cache bottleneck of large language models by exploiting the natural clustering of attention scores, achieving up to 92% compression without accuracy loss, boosting throughput 2.6–4.8×, handling 128K‑token sequences on a single GPU, and outperforming existing training‑free compression methods.
KV Cache compressionattention clusteringdensity clustering
0 likes · 8 min read

This article introduces OpenAI's Triton language, compares its block‑wise programming model to traditional CUDA, walks through vector‑addition and fused‑softmax kernel implementations, and presents benchmark results that demonstrate significant speedups over native PyTorch operations.
CUDAGPU programmingPyTorch
0 likes · 10 min read

This article explains the evolution of file system architecture from kernel‑level VFS to userspace via FUSE, reviews the historical role of NFS, details JuiceFS's implementation on top of FUSE, and presents benchmark results that demonstrate its high throughput and practical limitations.
FUSEJuiceFSLinux kernel
0 likes · 15 min read


AIWalkerJan 14, 2025 · Artificial Intelligence
The paper introduces DiC, a fully convolutional diffusion model that rethinks 3×3 convolutions, adds sparse skip connections, stage‑specific embeddings and conditional gating, and demonstrates superior FID/IS scores and faster inference compared to diffusion Transformers across multiple scales.
AIconvolutional networksdiffusion models
0 likes · 19 min read

This article explains how OpenSearch's GPU‑accelerated vector search leverages parallel graph algorithms to achieve up to tenfold speed improvements over CPU solutions, detailing ANNS techniques, performance benchmarks, and practical GPU specifications for high‑QPS AI applications.
Approximate Nearest NeighborGPU accelerationOpenSearch
0 likes · 11 min read

This article investigates why enabling line‑prefix regex for multiline logs slows Logtail down, explains the underlying regex matching mechanism, and demonstrates how switching from boost::regex_match to boost::regex_search with proper flags can dramatically improve collection throughput, achieving a seven‑fold speed increase.
Log Collectionboost::regexlogtail
0 likes · 10 min read


21CTONov 7, 2024 · Databases
This article presents a comprehensive benchmark comparing memcached and ScyllaDB across memory, disk, and read‑only workloads, analyzes architectural trade‑offs, and offers practical guidance on when to prefer a simple in‑memory cache versus a persistent wide‑column database.
CachingMemcachedScyllaDB
0 likes · 13 min read

With the growing complexity of LLM architectures like GQA, MLA, and MoE, runtime overhead has become a bottleneck; this article analyzes Python performance, communication costs, and synchronous execution in current inference frameworks, introduces the fully asynchronous TAG architecture, and demonstrates its superior throughput and latency through benchmarks.
GPU utilizationLLM inferenceRuntime Optimization
0 likes · 12 min read


21CTOApr 23, 2024 · Artificial Intelligence
This guide explains how to deploy open‑source large language models using vLLM, benchmark latency and throughput, and apply 8‑bit/4‑bit quantization techniques such as BitsandBytes and NF4 to achieve faster inference on limited‑GPU hardware.
LLM DeploymentPythonlarge language models
0 likes · 13 min read

This article examines the trade‑offs between centralized and distributed OLTP databases, presents industry usage statistics, performance benchmarks, practical questions for migration, and detailed guidance on sharding, SQL design, and operational considerations to help decide when a distributed solution is truly needed.
Database ArchitectureOLTPSharding
0 likes · 12 min read

This article presents a detailed benchmark of four Transformer models of varying sizes trained on the high‑end Inspur NF5488A5 GPU server, compares its NVSwitch‑based interconnect with a PCIe‑based system, and analyzes the impact of model scale, tensor parallelism, and hardware bandwidth on training efficiency.
DeepSpeedGPU serverMegatron-LM
0 likes · 12 min read

The article presents a detailed technical review of Kunlun Chip's XPU‑R AI accelerator, covering its evolution from early FPGA prototypes to the current 7nm, 256 TOPS chip, the architectural choices that address AI workload demands, performance advantages over CPUs/GPUs, and the product ecosystem supporting diverse AI scenarios.
AI accelerationAI hardwareKunlun Chip
0 likes · 20 min read


Code DAOMay 21, 2022 · Artificial Intelligence
The article explains CNN inference optimization by applying PyTorch quantization and module‑fusion techniques, compares model size and latency before and after quantization, shows code for building, quantizing, and fusing a simple CNN, and presents benchmark results on CPU, highlighting a four‑fold size reduction and up to 1.7× speed‑up.
CNNEdge InferencePyTorch
0 likes · 11 min read

The article introduces Volcano Engine's veGiantModel, a high‑performance large‑model training framework built on PyTorch, Megatron and DeepSpeed, details its distributed parallel strategies, hardware setups, benchmark results showing up to 6.9× speedup over Megatron and DeepSpeed, and provides open‑source links for further use.
ByteCCLdistributed traininglarge language models
0 likes · 6 min read

In a series of local benchmarks on a 2.6 GHz six‑core Intel i7 machine, the author compares K6, Gatling, and FunTester under 10 k to 20 k QPS loads, detailing CPU, memory, and response‑time metrics, analyzing script languages, JVM settings, and offering optimization suggestions for FunTester.
FunTesterGatlingJVM
0 likes · 11 min read

This article benchmarks four load‑testing frameworks—JMeter, k6, Locust, and FunTester—across multiple concurrency levels, measuring CPU, memory, QPS and response time to reveal each tool’s strengths, weaknesses, and scalability limits.
FunTesterJMeterLocust
0 likes · 11 min read

Facing high memory usage and slow startup after containerizing its Java services, NetEase Media adopted Go in 2020, leveraging its fast compilation, low‑resource footprint and goroutine‑based concurrency to build the high‑performance Ngo framework, which outperforms Spring‑Boot in throughput while using far less memory.
Go LanguageJava to Go migrationNgo framework
0 likes · 32 min read


ITPUBDec 24, 2020 · Databases
This article explains how Tencent's TDSQL database tackles the combined challenges of transaction and distributed consistency by introducing a multi‑level strong consistency model that delivers several‑fold performance improvements over Spanner, CockroachDB, and native Greenplum while preserving ACID guarantees.
Database ResearchTDSQLdistributed transactions
0 likes · 12 min read

An in‑depth Java performance study explores LongAdder, compares it with AtomicLong and lock‑based counters using JMH, and walks through successive custom implementations (V0‑V5) that apply striping, modulo optimization, false‑sharing elimination, and advanced hash probing to approach or surpass LongAdder’s throughput.
JMHJava ConcurrencyLongAdder
0 likes · 16 min read

This article outlines how 360’s data center built QuickSQL, a federated SQL engine that unifies queries across heterogeneous sources such as Hive, MySQL, and Elasticsearch, detailing the business challenges, architectural design, performance benchmarks, and future roadmap for multi‑source data analysis.
SQL Enginebig datadata integration
0 likes · 12 min read

This article examines whether Pilosa, a bitmap index originally built for sparse high‑cardinality data, can efficiently handle dense relational datasets by benchmarking it against a billion‑row NYC taxi trip dataset and comparing query performance with other database systems.
Bitmap IndexNYC taxi datasetPilosa
0 likes · 6 min read


21CTOMay 22, 2017 · Backend Development
The author rewrote a Laravel‑based Boxzilla application in Go, detailing migration steps, code‑size reduction, benchmark results, and testing advantages, showing how Go delivers faster response times, lower latency, and a more maintainable backend.
Code Size ReductionGoLaravel migration
0 likes · 7 min read
