BestHub
Sign in
Big Data Technology Architecture
Author

Big Data Technology Architecture

Exploring Open Source Big Data and AI Technologies

290
Articles
0
Likes
602
Views
0
Comments
Recent Articles

Latest from Big Data Technology Architecture

100 recent articles max
Big Data Technology Architecture
Big Data Technology Architecture
Jul 8, 2023 · Databases

Industry Leaders Discuss the Integration of Databases, Big Data, and AI in Modern Enterprise Data Platforms

In a round‑table interview, former Alibaba executive Jia Yangqing, Yunqi CTO Guan Tao, and OtterTune co‑founder Zhang Bohan explore how databases, big data, and AI converge, the distinctions between “AI for Data” and “Data for AI,” and what enterprises need in an integrated AI‑enabled data platform.

Data PlatformsEnterprise Architecturedatabases
0 likes · 23 min read
Industry Leaders Discuss the Integration of Databases, Big Data, and AI in Modern Enterprise Data Platforms
Big Data Technology Architecture
Big Data Technology Architecture
Jul 4, 2023 · Databases

Apache Doris 2.0‑beta Release: New Query Optimizer, Pipeline Engine, Workload Management and Performance Enhancements

Apache Doris 2.0‑beta, released on July 3, 2023, introduces a modern Cascades‑based query optimizer, a data‑driven pipeline execution engine, fine‑grained workload groups, enhanced memory management, partial‑column updates, compute nodes, cold‑hot tiering and cross‑cluster replication, delivering up to tenfold speedups and significant cost reductions for real‑time analytics.

Apache DorisPipeline ExecutionQuery Optimization
0 likes · 24 min read
Apache Doris 2.0‑beta Release: New Query Optimizer, Pipeline Engine, Workload Management and Performance Enhancements
Big Data Technology Architecture
Big Data Technology Architecture
Jun 20, 2023 · Big Data

Data Platform Evolution and the Future of Snowflake in China: Insights from Industry Leaders

The panel discusses the three‑stage evolution of data platforms, compares US and Chinese market dynamics, evaluates Snowflake’s success factors, and outlines the criteria and opportunities for a China‑specific Snowflake‑like solution, while also sharing investment perspectives on data‑driven startups.

Data PlatformsSnowflakecloud
0 likes · 24 min read
Data Platform Evolution and the Future of Snowflake in China: Insights from Industry Leaders
Big Data Technology Architecture
Big Data Technology Architecture
May 15, 2023 · Cloud Native

Interview with Chen Hao, Founder of MegaEase: From Bank Engineer to Cloud‑Native Entrepreneur

In this interview, Chen Hao, founder of MegaEase and former bank technician, recounts his two‑decade journey from leaving a state‑owned bank to working at Amazon, Alibaba, and launching a cloud‑native infrastructure startup, sharing insights on remote work, entrepreneurship, and the rise of cloud‑native technologies.

EntrepreneurshipTech Careerremote work
0 likes · 18 min read
Interview with Chen Hao, Founder of MegaEase: From Bank Engineer to Cloud‑Native Entrepreneur
Big Data Technology Architecture
Big Data Technology Architecture
Apr 22, 2023 · Big Data

Deep Dive into Kafka’s High Reliability and High Performance Mechanisms

This article comprehensively explores Kafka’s core architecture, explaining how asynchronous decoupling and traffic shaping are achieved, detailing the roles of producers, brokers, consumers, and ZooKeeper, and analyzing the reliability and performance techniques such as ACK policies, replication, idempotent and transactional producers, page‑cache flushing, zero‑copy, compression, batching, and load‑balancing strategies.

Message QueueReliabilitydistributed-systems
0 likes · 31 min read
Deep Dive into Kafka’s High Reliability and High Performance Mechanisms
Big Data Technology Architecture
Big Data Technology Architecture
Apr 19, 2023 · Big Data

Why the Big Data Era Is Over

The article argues that the era of big data is ending, showing that most organizations store only modest amounts of data, that storage costs outweigh benefits, and that modern cloud and analytics tools allow efficient processing without needing massive datasets.

AnalyticsData Managementbig data
0 likes · 16 min read
Why the Big Data Era Is Over
Big Data Technology Architecture
Big Data Technology Architecture
Feb 15, 2023 · Databases

ClickHouse Usage Guide: Table Engines, Best Practices, and Cluster Architecture

This comprehensive guide introduces ClickHouse as a high‑performance columnar DBMS, outlines its main application scenarios, details the various table engines and their creation syntax, and provides practical development, deployment, and operational recommendations for building reliable ClickHouse clusters.

ClickHouseClusterArchitectureSQLGuidelines
0 likes · 22 min read
ClickHouse Usage Guide: Table Engines, Best Practices, and Cluster Architecture