Tagged articles

Incremental Computation

6 articles · Page 1 of 1
DataFunSummit
DataFunSummit
Aug 3, 2026 · Big Data

Why Real‑Time vs Batch Data Diverge 5% and Teams Revert to T+1: The Lambda Architecture Dilemma

Amid exploding real‑time data demand, the traditional Lambda architecture suffers from high cost, data inconsistency and operational complexity, prompting a shift to a unified incremental computation engine that delivers minute‑level latency, sub‑hourly cost, and sub‑1% result divergence, as demonstrated by Kuaishou and Xiaohongshu production deployments.

Big DataIncremental ComputationKuaishou
0 likes · 12 min read
Why Real‑Time vs Batch Data Diverge 5% and Teams Revert to T+1: The Lambda Architecture Dilemma
Hacker Afternoon Tea
Hacker Afternoon Tea
Jun 24, 2026 · Artificial Intelligence

How 800 Lines Added Binance Futures Trading to ITB Using Codex and GLM‑5.2 (Full Testnet Verification)

The article details how the author extended the intelligent‑trading‑bot (ITB) with a new Binance futures execution pipeline using Codex CLI for TDD and GLM‑5.2 for context hand‑off, illustrating three business chains, incremental computation, state‑machine design, crash recovery, risk controls, and nine real‑world bugs uncovered during full testnet verification.

AI tradingBinance futuresCodex CLI
0 likes · 11 min read
How 800 Lines Added Binance Futures Trading to ITB Using Codex and GLM‑5.2 (Full Testnet Verification)
DaTaobao Tech
DaTaobao Tech
Dec 18, 2024 · Big Data

Incremental Computation in Big Data: Flink Materialized Table and Paimon

The article explains how Flink 1.20’s Materialized Table combined with Paimon’s changelog storage enables incremental computation that unifies batch and streaming workloads, delivering minute‑level latency at lower cost, illustrated by a materialized‑table example while noting current streaming‑only support and future batch extensions.

Big DataFlinkIncremental Computation
0 likes · 13 min read
Incremental Computation in Big Data: Flink Materialized Table and Paimon
ByteDance Web Infra
ByteDance Web Infra
May 27, 2021 · Fundamentals

Understanding Build Systems à la Carte: Theory, Incremental Computation, and Front‑End Applications

This article reviews the paper “Build Systems à la Carte”, explains its abstract build‑system model, shows how incremental computation concepts apply to tools such as Excel, React, Recoil, module loaders and dependency injection, and demonstrates a TypeScript translation of the core ideas for front‑end developers.

Incremental ComputationReActRecoil
0 likes · 37 min read
Understanding Build Systems à la Carte: Theory, Incremental Computation, and Front‑End Applications
Ctrip Technology
Ctrip Technology
Mar 25, 2021 · Big Data

Challenges and Approaches for Real‑Time Data Aggregation Analysis

The article examines the key challenges of real‑time data aggregation—data freshness, timely processing, and result visibility—and surveys common solutions such as timestamp‑based sync, CDC, full and incremental computation, storage formats, and trigger mechanisms.

Big DataCDCIncremental Computation
0 likes · 11 min read
Challenges and Approaches for Real‑Time Data Aggregation Analysis
ITPUB
ITPUB
Jun 14, 2018 · Databases

How T‑TDSQL Enables Real‑Time Incremental Reconciliation and Temporal Flashback

This article explains how T‑TDSQL leverages full‑temporal storage and snapshot‑difference techniques to perform incremental data extraction, precise account reconciliation, online flashback, and data replay, illustrating the underlying SQL commands, error‑handling tables, and practical benefits for internet finance workloads.

Data ReconciliationData ReplayIncremental Computation
0 likes · 14 min read
How T‑TDSQL Enables Real‑Time Incremental Reconciliation and Temporal Flashback