Tag

offset

0 views collected around this technical thread.

Top Architect
Top Architect
Aug 7, 2024 · Backend Development

Kafka Consumer Deep Dive: Offset Management, Rebalance Strategies, and Thread Safety

This article explains Kafka consumer semantics such as at‑most‑once, at‑least‑once and exactly‑once delivery, shows how to configure and commit offsets, describes the rebalance process and partition‑assignment strategies, and discusses thread‑safety and task scheduling with illustrative Java code examples.

ConsumerJavaKafka
0 likes · 17 min read
Kafka Consumer Deep Dive: Offset Management, Rebalance Strategies, and Thread Safety
Top Architect
Top Architect
Apr 19, 2024 · Databases

Problems with OFFSET/LIMIT Pagination and Cursor‑Based Alternatives

This article explains why using OFFSET and LIMIT for pagination becomes inefficient on large tables, illustrates the performance impact with examples, and proposes a cursor‑based pagination alternative that leverages indexed primary keys to achieve faster, scalable queries.

CursorDatabaseSQL
0 likes · 8 min read
Problems with OFFSET/LIMIT Pagination and Cursor‑Based Alternatives
Architecture Digest
Architecture Digest
Mar 31, 2024 · Databases

Why OFFSET/LIMIT Pagination Fails at Scale and How to Use Cursor‑Based Pagination

This article explains how OFFSET and LIMIT cause severe performance problems on large tables due to full‑table scans, demonstrates the issue with real‑world examples, and presents a more efficient cursor‑based (keyset) pagination technique as a practical alternative.

CursorDatabaseSQL
0 likes · 6 min read
Why OFFSET/LIMIT Pagination Fails at Scale and How to Use Cursor‑Based Pagination
Architect's Guide
Architect's Guide
Feb 18, 2024 · Databases

Problems with OFFSET and LIMIT and Alternative High‑Performance Pagination Strategies

This article explains why using OFFSET and LIMIT for pagination on large tables leads to costly full‑table scans and poor performance, and introduces keyset (cursor) pagination as a faster, index‑driven alternative while discussing its requirements and trade‑offs.

CursorDatabaseSQL
0 likes · 5 min read
Problems with OFFSET and LIMIT and Alternative High‑Performance Pagination Strategies
php中文网 Courses
php中文网 Courses
Aug 23, 2023 · Backend Development

Using PHP substr_count() to Count Substring Occurrences

This article explains the PHP substr_count() function, its syntax, parameters, and demonstrates how to count substring occurrences with optional offset, length, and case‑sensitivity options through clear code examples.

case-sensitivecount()length
0 likes · 4 min read
Using PHP substr_count() to Count Substring Occurrences
Laravel Tech Community
Laravel Tech Community
May 22, 2023 · Databases

Why OFFSET/LIMIT Pagination Is Inefficient and How to Use Cursor‑Based Pagination

The article explains the performance drawbacks of using OFFSET and LIMIT for pagination on large tables, illustrates the issue with full‑table scans, and presents a more efficient cursor‑based approach that leverages indexed primary keys to retrieve pages quickly.

CursorDatabaseSQL
0 likes · 5 min read
Why OFFSET/LIMIT Pagination Is Inefficient and How to Use Cursor‑Based Pagination
Selected Java Interview Questions
Selected Java Interview Questions
Mar 19, 2022 · Databases

Why LIMIT OFFSET with Large Offsets Is Slow in MySQL and How to Optimize It

Using a large OFFSET in MySQL's LIMIT clause forces the server to scan hundreds of thousands of index and data pages, causing excessive random I/O, whereas rewriting the query with a sub‑select and join reduces page accesses dramatically, as demonstrated through buffer‑pool measurements.

Buffer PoolMySQLQuery Optimization
0 likes · 8 min read
Why LIMIT OFFSET with Large Offsets Is Slow in MySQL and How to Optimize It
DataFunTalk
DataFunTalk
Mar 5, 2022 · Big Data

Designing Cross‑Period Dependencies in Data Scheduling Systems

This article explains how data scheduling systems manage task execution, ETL processes, and cross‑period dependencies by linking task versions, data partitions, and time parameters, and introduces the offset‑and‑cnt model to express dynamic dependencies in big‑data pipelines.

Big DataDAGETL
0 likes · 14 min read
Designing Cross‑Period Dependencies in Data Scheduling Systems
Laravel Tech Community
Laravel Tech Community
Sep 21, 2021 · Databases

Why a Large OFFSET in MySQL LIMIT Is Slow and How to Optimize It with a Join

The article explains why using LIMIT with a large OFFSET in MySQL causes severe performance degradation, demonstrates the issue with a 5‑million‑row table, and shows how rewriting the query as a join dramatically reduces I/O and execution time while also discussing buffer‑pool effects.

Buffer PoolMySQLSQL
0 likes · 8 min read
Why a Large OFFSET in MySQL LIMIT Is Slow and How to Optimize It with a Join
Top Architect
Top Architect
Sep 21, 2021 · Databases

Understanding MySQL LIMIT OFFSET Performance and Buffer‑Pool Impact

The article demonstrates how a large OFFSET in a MySQL LIMIT query forces MySQL to scan millions of index rows and data pages, causing severe slowdown, and shows that rewriting the query with an inner‑join sub‑select dramatically reduces I/O and buffer‑pool usage, confirming the performance difference through experiments.

Buffer PoolInnoDBMySQL
0 likes · 8 min read
Understanding MySQL LIMIT OFFSET Performance and Buffer‑Pool Impact
High Availability Architecture
High Availability Architecture
Dec 29, 2020 · Databases

Efficient API Pagination: Offset vs Cursor and Performance Considerations

This article explains the challenges of returning large result sets in APIs, compares traditional offset‑based pagination with cursor‑based approaches, shows performance differences through SQL examples, and discusses why cursor pagination is more efficient for deep paging and concurrent data modifications.

APICursorSQL
0 likes · 8 min read
Efficient API Pagination: Offset vs Cursor and Performance Considerations
Qunar Tech Salon
Qunar Tech Salon
Feb 27, 2018 · Big Data

Root Cause Analysis of Kafka Consumer Group Coordinator Failure and __consumer_offsets Compaction Issues

The article investigates a Kafka cluster outage where several brokers became unavailable and consumers could not join groups, explains the role of __consumer_offsets, analyzes the coordinator selection logic, identifies a stuck loadGroupsForPartition operation and compact thread failure, and documents the recovery steps taken.

Consumer GroupKafkaLog Compaction
0 likes · 11 min read
Root Cause Analysis of Kafka Consumer Group Coordinator Failure and __consumer_offsets Compaction Issues
Baidu Intelligent Testing
Baidu Intelligent Testing
Dec 9, 2015 · Databases

Analysis and Fix of Redis Replication Offset Bug Causing Slave Offset Larger Than Master

This article details a Redis replication bug where slave offsets exceed the master after network interruptions, explains the root‑cause analysis of offset handling during full and incremental sync, describes the code fix applied by the Redis team, and offers testing and prevention guidance.

DatabaseFixRedis
0 likes · 11 min read
Analysis and Fix of Redis Replication Offset Bug Causing Slave Offset Larger Than Master
Baidu Intelligent Testing
Baidu Intelligent Testing
Nov 20, 2015 · Databases

Analysis and Fix of a Redis Replication Offset Bug Caused by Full‑Sync Interference

This article details a deep‑rooted Redis replication bug where slave offsets become larger than the master after a network interruption, explains the underlying cause in the full‑sync process, describes the code changes made to fix it, and offers testing and prevention guidance.

BugFixDatabaseFullSync
0 likes · 11 min read
Analysis and Fix of a Redis Replication Offset Bug Caused by Full‑Sync Interference