Tagged articles
Near Real-Time
20 articles · Page 1 of 1
This article details Feeder pipelines that transport diverse data types—user features, content tags, embeddings, popularity rankings, and operational rules—from offline computation to online serving, covering batch atomic switches, NRT incremental updates, cursor-based recovery, scheduling platform design, and latency observability practices.
Feature StoreFeederIncremental Sync
0 likes · 30 min read

This article breaks down ElasticSearch's performance advantages across three layers—data structures (inverted index, FST, compressed posting lists), storage (immutable segments, Doc Values), and architecture (shard parallelism, near-real-time writes, multi-level caching)—with concrete examples and interview-focused explanations.
CachingElasticsearchInterview questions
0 likes · 16 min read

The article explains why ElasticSearch excels at full‑text search and analytics while MySQL remains the reliable storage engine, compares their underlying data structures, outlines real‑time write behavior, lists scenarios where ES should not be used, and describes a production double‑store architecture with asynchronous sync.
B+ TreeElasticsearchInverted Index
0 likes · 14 min read

This article explains Elasticsearch's core architecture including distributed sharding, near real-time search, inverted indexes, and key concepts like indices, documents, mappings, and replicas, along with typical use cases and the Elastic Stack ecosystem.
Distributed SearchElastic StackElasticsearch
0 likes · 14 min read

This article explains how MaxCompute’s integrated offline‑and‑near‑real‑time architecture, built on Delta Table, solves complex big‑data scenarios by providing unified storage, ACID transactions, upsert, time‑travel, automatic data‑file governance and low‑latency query capabilities while reducing cost and operational complexity.
Delta TableMaxComputeNear Real-Time
0 likes · 27 min read

This article explains MaxCompute’s new integrated offline‑and‑near‑real‑time architecture, Transaction Table 2.0, detailing its unified storage and compute design, automatic data governance, schema evolution, upsert and time‑travel capabilities, and how it simplifies complex big‑data pipelines while delivering minute‑level latency and lower costs.
MaxComputeNear Real-TimeSQL
0 likes · 27 min read

This article explains Elasticsearch’s near‑real‑time nature, its core mechanisms such as inverted indexes and tokenizers, common interview scenarios, search types, refresh strategies, and the difference between query and filter, helping readers understand when and why to choose ES for full‑text and complex queries.
Inverted IndexNear Real-TimeQuery vs Filter
0 likes · 15 min read

This article presents a comprehensive overview of TikTok e-commerce's near‑real‑time data lake implementation, detailing data lake characteristics, architecture choices, practical use cases across analysis and operations, and for future challenges and plans.
Apache HudiFlinkNear Real-Time
0 likes · 16 min read

This article explains ByteDance’s data lake technology, its Apache Hudi‑based features, near‑real‑time architecture, and practical e‑commerce use cases such as marketing promotion, traffic diagnosis, logistics monitoring, risk governance, and operational monitoring, while outlining future challenges and plans.
Apache HudiE-commerce AnalyticsNear Real-Time
0 likes · 15 min read

The presentation by TikTok e‑commerce data‑warehouse engineer Ma Wenyuan explains data‑lake characteristics, near‑real‑time architecture, and practical e‑commerce use cases, highlighting Apache Hudi features, hybrid batch‑stream processing, and future challenges for scaling and integration.
HudiNear Real-TimeTikTok
0 likes · 13 min read

This article explains how ElasticSearch achieves near real‑time search by using immutable inverted indexes, segment merging, shard distribution, and a translog for durability, while also offering practical guidance on how to study the system effectively.
Distributed SearchInverted IndexNear Real-Time
0 likes · 8 min read

This article explains Elasticsearch's core mechanisms for indexing, querying, and searching data, covering the roles of coordinating nodes, primary and replica shards, refresh cycles, translog, commit/flush processes, and the underlying Lucene inverted index.
Data IngestionElasticsearchInverted Index
0 likes · 13 min read

This article explains Elasticsearch's write, read, and search mechanisms, the role of coordinating nodes, primary and replica shards, refresh and commit cycles, Lucene's inverted index, and how data becomes searchable in near‑real‑time.
ElasticsearchInverted IndexLucene
0 likes · 12 min read

This comprehensive guide explains Elasticsearch’s fundamentals, including its distributed architecture, indexing process, shard and replica mechanisms, query execution, near‑real‑time search, segment management, and practical optimization techniques, providing developers and engineers with the knowledge needed to design, operate, and troubleshoot large‑scale search clusters.
Near Real-Timedistributed-systemsindexing
0 likes · 71 min read

This article explains Elasticsearch's internal mechanisms for writing, reading, and searching data, covering the roles of coordinating nodes, primary and replica shards, buffers, translog, segment files, refresh cycles, commit and flush operations, as well as Lucene's inverted index and how deletions and updates are handled.
ElasticsearchInverted IndexLucene
0 likes · 10 min read

This article explains Elasticsearch’s write, read, and search workflows, detailing the roles of coordinating nodes, primary and replica shards, refresh and commit cycles, translog handling, and the underlying Lucene inverted index mechanism.
ElasticsearchInverted IndexLucene
0 likes · 11 min read

This article explains Elasticsearch's internal mechanisms for indexing, querying, and retrieving data, covering the roles of coordinating nodes, primary and replica shards, the refresh and commit cycles, near‑real‑time search, and the underlying Lucene inverted index.
Data IngestionElasticsearchLucene
0 likes · 12 min read


JavaEdgeJun 26, 2019 · Backend Development
This article explains the complete workflow of Elasticsearch write, read, search, delete, and update operations, covering coordinating nodes, shard routing, buffer refresh, translog, segment files, commit/flush processes, and the underlying inverted index mechanism.
ElasticsearchNear Real-TimeSearch Architecture
0 likes · 10 min read

Elasticsearch is an open‑source, scalable, high‑availability distributed full‑text search engine that operates in near real‑time, using clusters of nodes, indexes, documents, shards and replicas to efficiently store and retrieve large volumes of data.
ClusterElasticsearchNear Real-Time
0 likes · 4 min read

The article introduces Transwarp Transporter, a near‑real‑time ETL tool for TDH 5.x, explains its architecture, visual dashboard, drag‑and‑drop data‑flow design, debugging features, parameter management, and highlights how it empowers business users to achieve fast, reliable data migration in big‑data environments.
ETLNear Real-TimeTranswarp
0 likes · 7 min read
