Tagged articles
OFFSET
28 articles · Page 1 of 1
The article explains why OFFSET/LIMIT pagination causes full table scans and linear performance degradation with large offsets, demonstrates a 100k-row benchmark where cursor-based pagination using primary keys runs in 0.01s versus 12.80s for OFFSET, and recommends keyset pagination for scalable systems while noting limitations for tables without unique sequential columns.
Keyset PaginationLIMITOFFSET
0 likes · 7 min read

The article explains why Kafka consumers can reprocess tens of thousands of messages after a restart despite successful offset commits, detailing the roles of automatic commit timing, rebalance triggers, GC pauses, and the limitations of manual commits, and offers practical configuration and idempotent processing solutions.
ConsumerJavaKafka
0 likes · 8 min read

The article explains why a Kafka consumer can re‑process tens of thousands of messages after a restart even though the offset was reported as successfully committed, covering auto‑commit timing, rebalance triggers, GC pauses, manual‑commit pitfalls, and practical mitigation strategies.
KafkaOFFSETRebalance
0 likes · 8 min read

A backend team discovered that their simple paginated API slowed from 200 ms to over 2 seconds as data grew, traced the issue to costly OFFSET scans, and solved it by switching to keyset (cursor) pagination, adding proper indexes and a materialized view, achieving sub‑200 ms response times.
OFFSETPaginationkeySet
0 likes · 7 min read

This article explains the hidden performance costs of traditional OFFSET pagination in MySQL, analyzes why deep paging becomes a bottleneck, and presents keyset (cursor) pagination and other optimization techniques as efficient alternatives for handling massive or frequently changing datasets.
Database PerformanceKeyset PaginationMySQL
0 likes · 15 min read

This article explains Kafka consumer semantics such as at‑most‑once, at‑least‑once and exactly‑once delivery, shows how to configure and commit offsets, describes the rebalance process and partition‑assignment strategies, and discusses thread‑safety and task scheduling with illustrative Java code examples.
ConsumerKafkaOFFSET
0 likes · 17 min read

This article explains why using OFFSET and LIMIT for pagination becomes inefficient on large tables, illustrates the performance impact with examples, and proposes a cursor‑based pagination alternative that leverages indexed primary keys to achieve faster, scalable queries.
CursorLIMITOFFSET
0 likes · 8 min read

This article explains how OFFSET and LIMIT cause severe performance problems on large tables due to full‑table scans, demonstrates the issue with real‑world examples, and presents a more efficient cursor‑based (keyset) pagination technique as a practical alternative.
CursorOFFSETPagination
0 likes · 6 min read

This article explains why using OFFSET and LIMIT for pagination becomes a performance bottleneck on massive tables, illustrates the cost of full‑table scans, and introduces a cursor‑based pagination technique that leverages primary‑key ordering for efficient data retrieval.
CursorOFFSETPagination
0 likes · 7 min read

This article explains why using OFFSET and LIMIT for pagination on large tables leads to costly full‑table scans and poor performance, and introduces keyset (cursor) pagination as a faster, index‑driven alternative while discussing its requirements and trade‑offs.
CursorLIMITOFFSET
0 likes · 5 min read

This article explains the PHP substr_count() function, its syntax, parameters, and demonstrates how to count substring occurrences with optional offset, length, and case‑sensitivity options through clear code examples.
COUNTOFFSETString
0 likes · 4 min read

The article explains the performance drawbacks of using OFFSET and LIMIT for pagination on large tables, illustrates the issue with full‑table scans, and presents a more efficient cursor‑based approach that leverages indexed primary keys to retrieve pages quickly.
CursorLIMITOFFSET
0 likes · 5 min read

This article explains why using OFFSET and LIMIT for pagination becomes inefficient as data grows, leading to costly full table scans, and demonstrates a high‑performance cursor‑based pagination alternative that leverages indexed primary keys to retrieve pages quickly and reliably.
CursorOFFSETPagination
0 likes · 6 min read

The article explains the performance problems of using OFFSET and LIMIT for large‑scale database pagination, demonstrates their inefficiency with full‑table scans, and presents a faster cursor‑based alternative that relies on storing the last primary key and using LIMIT instead of OFFSET.
CursorLIMITOFFSET
0 likes · 8 min read

Using a large OFFSET in MySQL's LIMIT clause forces the server to scan hundreds of thousands of index and data pages, causing excessive random I/O, whereas rewriting the query with a sub‑select and join reduces page accesses dramatically, as demonstrated through buffer‑pool measurements.
Buffer PoolIndexLIMIT
0 likes · 8 min read

This article explains how data scheduling systems manage task execution, ETL processes, and cross‑period dependencies by linking task versions, data partitions, and time parameters, and introduces the offset‑and‑cnt model to express dynamic dependencies in big‑data pipelines.
DAGData SchedulingETL
0 likes · 14 min read

The article explains why using LIMIT with a large OFFSET in MySQL causes severe performance degradation, demonstrates the issue with a 5‑million‑row table, and shows how rewriting the query as a join dramatically reduces I/O and execution time while also discussing buffer‑pool effects.
Buffer PoolIndexLIMIT
0 likes · 8 min read

The article demonstrates how a large OFFSET in a MySQL LIMIT query forces MySQL to scan millions of index rows and data pages, causing severe slowdown, and shows that rewriting the query with an inner‑join sub‑select dramatically reduces I/O and buffer‑pool usage, confirming the performance difference through experiments.
Buffer PoolInnoDBLIMIT
0 likes · 8 min read

This article examines why MySQL pagination with large OFFSET values becomes painfully slow, explains the underlying B+‑tree index mechanics, and presents two practical solutions—keyset pagination and index‑covering subqueries—to dramatically improve query performance.
B+TreeCovering IndexKeyset Pagination
0 likes · 8 min read

This article explains the challenges of returning large result sets in APIs, compares traditional offset‑based pagination with cursor‑based approaches, shows performance differences through SQL examples, and discusses why cursor pagination is more efficient for deep paging and concurrent data modifications.
APICursorOFFSET
0 likes · 8 min read

The article explains the performance problems of using OFFSET and LIMIT for database pagination on large tables, demonstrates their inefficiency with real‑world examples, and presents cursor‑based pagination as a high‑performance alternative that leverages indexed primary keys.
CursorLIMITOFFSET
0 likes · 6 min read

This article explains why traditional OFFSET/LIMIT pagination becomes inefficient with large tables, illustrates its performance drawbacks with real examples, and introduces a high‑performance cursor‑based pagination method that leverages indexed primary keys to dramatically speed up data retrieval.
Cursor PaginationOFFSETSQL
0 likes · 6 min read

This article explains Kafka’s workflow, detailing how topics, partitions, and segments are organized, the structure of index and log files, message composition, offset-based retrieval, and the overall data directory layout, providing a comprehensive overview of Kafka’s storage architecture.
IndexKafkaOFFSET
0 likes · 8 min read

This article examines why a MySQL query with a large OFFSET is extremely slow, demonstrates the performance gap with a join‑based rewrite, and validates the findings by comparing InnoDB buffer‑pool page usage, highlighting how unnecessary random I/O pollutes the cache.
Buffer PoolIndexLIMIT
0 likes · 8 min read

The article investigates a Kafka cluster outage where several brokers became unavailable and consumers could not join groups, explains the role of __consumer_offsets, analyzes the coordinator selection logic, identifies a stuck loadGroupsForPartition operation and compact thread failure, and documents the recovery steps taken.
Consumer GroupLog CompactionOFFSET
0 likes · 11 min read

This article explains Kafka’s core architecture—including brokers, topics, partitions, offsets, producer and consumer mechanics, replication, availability, consistency, persistence, performance optimizations, and Zookeeper integration—providing a comprehensive guide for building reliable distributed messaging systems.
Distributed MessagingKafkaOFFSET
0 likes · 15 min read

This article details a Redis replication bug where slave offsets exceed the master after network interruptions, explains the root‑cause analysis of offset handling during full and incremental sync, describes the code fix applied by the Redis team, and offers testing and prevention guidance.
FixOFFSETRedis
0 likes · 11 min read

This article details a deep‑rooted Redis replication bug where slave offsets become larger than the master after a network interruption, explains the underlying cause in the full‑sync process, describes the code changes made to fix it, and offers testing and prevention guidance.
BackendBugFixFullSync
0 likes · 11 min read
