Tagged articles

System Throughput

4 articles · Page 1 of 1
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Sep 22, 2026 · Artificial Intelligence

Scaling LLM RL: How Batch Size Affects Training Speed and Efficiency

The article explores how batch size scaling impacts LLM reinforcement learning training efficiency, introducing critical generation and training batch concepts, showing optimal batch size balances sample efficiency and system throughput, with experiments achieving 29% time reduction on fixed hardware.

Batch Size ScalingCritical BatchGRPO
0 likes · 36 min read
Scaling LLM RL: How Batch Size Affects Training Speed and Efficiency
Architect Chen
Architect Chen
Jun 3, 2026 · Fundamentals

What TPS Threshold Defines High Concurrency? A Complete Guide

The article explains TPS (Transactions Per Second), shows how to calculate it with a concrete example, and outlines industry‑based concurrency tiers—from less than 100 TPS for ordinary systems up to 50,000+ TPS for billion‑level traffic platforms—helping readers understand what counts as high concurrency.

High ConcurrencySystem ThroughputTPS
0 likes · 3 min read
What TPS Threshold Defines High Concurrency? A Complete Guide
Programmer DD
Programmer DD
Jun 14, 2021 · Operations

Mastering QPS, TPS, PV, UV, DAU, MAU & System Throughput Explained

This article clarifies key performance metrics such as QPS, TPS, PV, UV, DAU, MAU, concurrent users, and system throughput, explains their differences, relationships, and how they impact capacity planning, while also outlining essential performance testing concepts and evaluation methods for robust system design.

Capacity PlanningQPSSystem Throughput
0 likes · 8 min read
Mastering QPS, TPS, PV, UV, DAU, MAU & System Throughput Explained