BestHub
Sign in
Tagged articles

schema evolution

17 articles · Page 1 of 1
LuTiao Programming
LuTiao Programming
Sep 12, 2026 · Backend Development

Spring Boot 4.1 gRPC: Why I Swapped One REST Call and What It Revealed About Microservice Boundaries

The author migrates a high-frequency internal inventory query from REST to gRPC in Spring Boot 4.1, discovering that gRPC's contract-first approach, binary encoding, and explicit timeout handling improve interface governance for service-to-service RPC, while REST remains better for web-facing and low-frequency APIs.

API ContractProtobufService-to-Service Communication
0 likes · 17 min read
Spring Boot 4.1 gRPC: Why I Swapped One REST Call and What It Revealed About Microservice Boundaries
Xiaolin Talks Programming
Xiaolin Talks Programming
Aug 10, 2026 · Big Data

Building Real-Time Data Lakes with Spring Boot, Flink CDC 3.0 & Iceberg: Production Patterns

This article details migrating from a legacy Canal+Kafka+Flink+Hive stack to a modern Flink CDC + Iceberg real-time data lake, covering Spring Boot orchestration, chunk-based full/incremental sync, Interval Join for wide tables, automated schema evolution, hidden partitioning, Exactly-Once checkpoint tuning, and Kubernetes deployment practices.

Apache IcebergExactly-OnceFlink CDC
0 likes · 17 min read
Building Real-Time Data Lakes with Spring Boot, Flink CDC 3.0 & Iceberg: Production Patterns
Xike
Xike
Aug 1, 2026 · Big Data

Big Data Series #6: Getting Started with Iceberg Lakehouse – Snapshots, Time Travel, and Writes

This tutorial explains how Apache Iceberg adds snapshot metadata to files on HDFS or object storage, enabling atomic writes, time‑travel queries, and schema evolution, and walks through a Docker‑based setup with a REST catalog, Spark 3.5.3, and hands‑on examples including table creation, data insertion, version queries, and troubleshooting tips.

Apache IcebergData LakeHDFS
0 likes · 16 min read
Big Data Series #6: Getting Started with Iceberg Lakehouse – Snapshots, Time Travel, and Writes
Xiaolin Talks Programming
Xiaolin Talks Programming
Jun 30, 2026 · Databases

Zero-Downtime Database Evolution: Flyway + Spring Boot Expand/Migrate/Contract Pattern

This article details a production-verified zero-downtime database migration strategy using Spring Boot and Flyway, covering why DDL causes outages, Flyway configuration best practices, the expand-migrate-contract pattern for smooth schema changes, script writing and rollback techniques, Kubernetes deployment coordination, monitoring with circuit breakers, and a post-mortem checklist.

DDLFlywayKubernetes
0 likes · 18 min read
Zero-Downtime Database Evolution: Flyway + Spring Boot Expand/Migrate/Contract Pattern
Alibaba Cloud Developer
Alibaba Cloud Developer
Jun 18, 2026 · Big Data

How AI-Driven Real-Time Data Lakes Are Ditching ETL: A Kafka‑to‑Iceberg Architecture Simplification

In the AI era, enterprises need a data foundation that supports both low‑latency streaming and long‑term analytics, and the combination of Kafka, Iceberg and object storage is emerging as a preferred solution; by moving ingestion capabilities closer to the message layer and eliminating external ETL jobs, a "zero‑ETL" approach reduces architectural complexity, improves consistency, and streamlines schema evolution and small‑file management.

CDCData LakeKafka
0 likes · 27 min read
How AI-Driven Real-Time Data Lakes Are Ditching ETL: A Kafka‑to‑Iceberg Architecture Simplification
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Aug 29, 2025 · Big Data

How MaxCompute Streaming Insert Revolutionized Real‑Time Data Migration from BigQuery

This article details how a leading Southeast Asian tech group migrated its real‑time write workloads from Google BigQuery to MaxCompute using MaxCompute Streaming Insert, covering architecture, core features, migration challenges, optimization strategies, business impact, and future enhancements.

BigQuery MigrationMaxComputeReal-time Data
0 likes · 9 min read
How MaxCompute Streaming Insert Revolutionized Real‑Time Data Migration from BigQuery
Java Baker
Java Baker
Jul 7, 2025 · Databases

Choosing the Right Database Schema for Dynamic Business Field Expansion

This article compares five common database extension strategies—from simple MySQL column additions to a hybrid MySQL‑HBase solution—detailing their implementation, advantages, drawbacks, and ideal scenarios, helping architects select the most scalable and maintainable design for evolving business data requirements.

Dynamic FieldsHBaseMySQL
0 likes · 8 min read
Choosing the Right Database Schema for Dynamic Business Field Expansion
Big Data Technology & Architecture
Big Data Technology & Architecture
Aug 20, 2024 · Big Data

Practical Insights on Using Apache Paimon for Real-World Data Lake Scenarios

This article shares a personal, experience‑driven overview of Apache Paimon, highlighting its design simplicity, key capabilities such as schema evolution, stream‑batch unified processing, primary‑key support, and closed‑loop data handling, while discussing when its features are appropriate for production environments.

Apache PaimonBatch ProcessingStreaming
0 likes · 5 min read
Practical Insights on Using Apache Paimon for Real-World Data Lake Scenarios
StarRocks
StarRocks
May 22, 2024 · Big Data

Unlocking Data Lake Power: Iceberg Architecture & StarRocks Acceleration

Apache Iceberg offers a modern, ACID‑compliant table format for data lakes with features like hidden partitions and schema evolution, while StarRocks provides high‑performance query acceleration, metadata caching, and distributed planning to address Iceberg’s latency challenges, enabling seamless lake‑warehouse integration and real‑time analytics.

Apache IcebergData LakeMetadata Caching
0 likes · 19 min read
Unlocking Data Lake Power: Iceberg Architecture & StarRocks Acceleration
DataFunSummit
DataFunSummit
Oct 1, 2023 · Big Data

Iceberg Data Lake: Core Features, Xiaomi Use Cases, and Future Plans

This presentation introduces Iceberg's core capabilities, details Xiaomi's practical applications—including log ingestion, near‑real‑time warehousing, offline challenges, column‑level encryption, and Hive migration—and outlines future development directions such as materialized views and cloud migration, providing a comprehensive view of modern data‑lake engineering.

Data LakeFlinkSpark
0 likes · 22 min read
Iceberg Data Lake: Core Features, Xiaomi Use Cases, and Future Plans
DataFunTalk
DataFunTalk
Jun 26, 2023 · Big Data

Iceberg Data Lake: Core Features, Xiaomi Use Cases, and Future Plans

This presentation details Iceberg's core capabilities—transactional writes, schema evolution, implicit partitioning, and row‑level updates—while showcasing Xiaomi's real‑world applications such as log ingestion redesign, near‑real‑time warehousing, offline optimizations, column‑level encryption, Hive migration strategies, and outlining upcoming enhancements like materialized views and cloud migration.

Column EncryptionData LakeFlink
0 likes · 20 min read
Iceberg Data Lake: Core Features, Xiaomi Use Cases, and Future Plans
DataFunTalk
DataFunTalk
May 11, 2023 · Big Data

Scaling ByteDance Feature Store to EB‑Level with Apache Iceberg: Architecture, Practices, and Future Roadmap

This article describes how ByteDance tackled petabyte‑scale feature storage by adopting Apache Iceberg, detailing the problem background, design choices, implementation of COW and MOR back‑fill strategies, performance optimizations, and future plans such as lake‑cold‑layering and materialized views.

Apache IcebergData LakeFeature Store
0 likes · 16 min read
Scaling ByteDance Feature Store to EB‑Level with Apache Iceberg: Architecture, Practices, and Future Roadmap
JavaEdge
JavaEdge
Jun 26, 2022 · Backend Development

Ensuring Forward and Backward Compatibility in Distributed Systems

This article explains why forward and backward compatibility are crucial for evolving systems, covering database encoding, schema evolution, REST and RPC communication, message brokers, and actor frameworks, and provides practical guidance for designing compatible data flows across services.

Message BrokerRESTRPC
0 likes · 22 min read
Ensuring Forward and Backward Compatibility in Distributed Systems
dbaplus Community
dbaplus Community
Jan 15, 2020 · Databases

How Didi Built Fusion-NewSQL: A High‑Throughput, Low‑Latency NewSQL on Distributed KV

Fusion-NewSQL is Didi’s internally‑developed NewSQL system built atop the Fusion distributed KV store, offering MySQL compatibility, high throughput, low latency, flexible schema changes, secondary indexes, and integration with ElasticSearch and Hive, with detailed architecture, data flow, and future roadmap.

MySQL compatibilityNewSQLdistributed storage
0 likes · 16 min read
How Didi Built Fusion-NewSQL: A High‑Throughput, Low‑Latency NewSQL on Distributed KV
Didi Tech
Didi Tech
Oct 8, 2019 · Databases

Design and Implementation of Fusion-NewSQL: A NewSQL System Built on Distributed NoSQL Storage

Fusion‑NewSQL is a NewSQL layer built atop Didi’s distributed KV store Fusion, translating MySQL queries into Redis‑style hashmaps, asynchronously maintaining secondary indexes, supporting fast Hive‑to‑Fusion loads and Elasticsearch integration, thereby delivering over 2 million QPS, 600 TB storage and flexible schema evolution for dozens of services.

IndexingMySQL compatibilityNewSQL
0 likes · 15 min read
Design and Implementation of Fusion-NewSQL: A NewSQL System Built on Distributed NoSQL Storage