BestHub
Sign in
Past Memory Big Data
Author

Past Memory Big Data

A popular big-data architecture channel with over 100,000 developers. Publishes articles on Spark, Hadoop, Flink, Kafka and more. Visit the Past Memory Big Data blog at https://www.iteblog.com. Search "Past Memory" on Google or Baidu.

60
Articles
0
Likes
240
Views
0
Comments
Recent Articles

Latest from Past Memory Big Data

60 recent articles
Past Memory Big Data
Past Memory Big Data
Feb 23, 2023 · Databases

Optimizing ClickHouse: ByteHouse’s Real‑Time Data Warehouse Breakthrough

ByteHouse, a cloud‑native data warehouse on Volcano Engine, leverages ClickHouse to deliver ultra‑fast real‑time analytics, detailing its business motivations, ROI‑driven evaluation, performance trade‑offs, architectural evolution, and concrete financial‑industry deployments such as real‑time monitoring and risk‑control scenarios.

ByteHouseClickHouseCloud Native
0 likes · 17 min read
Optimizing ClickHouse: ByteHouse’s Real‑Time Data Warehouse Breakthrough
Past Memory Big Data
Past Memory Big Data
Feb 1, 2023 · Databases

From ClickHouse to ByteHouse: Real‑Time Data Analytics Optimization Practices

This article details ByteDance's large‑scale ClickHouse deployment, presents two real‑time analytics use cases—recommendation metrics and ad delivery—and explains the performance bottlenecks encountered and the concrete engineering solutions such as asynchronous indexing, multi‑threaded Kafka Engine, and enhanced Buffer Engine that boosted throughput and ensured data integrity.

Buffer EngineByteHouseClickHouse
0 likes · 11 min read
From ClickHouse to ByteHouse: Real‑Time Data Analytics Optimization Practices
Past Memory Big Data
Past Memory Big Data
Dec 27, 2022 · Operations

How Volcano Engine DataTester Handles Private Deployment: Architecture, Challenges, and Business‑Driven Solutions

This article details Volcano Engine DataTester's private deployment architecture, the version‑management, performance, and stability challenges encountered, and the business‑oriented solutions—including branch strategies, pipeline automation, ClickHouse model optimizations, and multi‑level caching—that enable reliable, efficient A/B testing in on‑premise environments.

A/B testingAnsibleArchitecture
0 likes · 13 min read
How Volcano Engine DataTester Handles Private Deployment: Architecture, Challenges, and Business‑Driven Solutions
Past Memory Big Data
Past Memory Big Data
Nov 15, 2022 · Big Data

How Uber Accelerated Presto Queries with Alluxio Local Cache

Uber processes over 500,000 daily Presto queries across 20 clusters handling more than 50 PB of data, and by deploying Alluxio Local Cache on NVMe disks they raised cache‑hit rates from roughly 65% to over 90% while addressing real‑time partition updates, node churn, and cache‑size constraints.

AlluxioBig Dataconsistent hashing
0 likes · 15 min read
How Uber Accelerated Presto Queries with Alluxio Local Cache
Past Memory Big Data
Past Memory Big Data
Oct 29, 2022 · Big Data

How to Adapt Hadoop for Domestic Big Data Requirements

The article analyzes Hadoop’s declining relevance, the dominance of CDH/HDP, security pressures from vulnerabilities, and outlines ten technical steps—including hardware adaptation, component selection, dependency resolution, compilation, Ambari integration, packaging, testing, and functional verification—required to create a domestic ARM‑based Hadoop distribution, which the authors have released as a free HDP 3.3.1 build.

ARMAmbariBig Data
0 likes · 15 min read
How to Adapt Hadoop for Domestic Big Data Requirements
Past Memory Big Data
Past Memory Big Data
Oct 13, 2022 · Big Data

Step-by-Step Guide: Integrating Presto with Velox on macOS (Build, Configure, and Run)

This article walks through the performance bottleneck of CPU in data analytics, introduces the Velox vectorized execution engine, and provides a detailed, zero‑to‑one tutorial for downloading Presto source, syncing Velox, fixing build paths, compiling both Java and C++ components, configuring CLion and IntelliJ, launching the servers, and executing SQL queries while noting stability concerns.

JavaSQLVelox
0 likes · 19 min read
Step-by-Step Guide: Integrating Presto with Velox on macOS (Build, Configure, and Run)
Past Memory Big Data
Past Memory Big Data
Oct 9, 2022 · Operations

How Cloud Music Scaled Data Governance: Practices, Metrics, and Lessons Learned

The article details Cloud Music’s data‑governance journey, covering early modeling standards, self‑service data tools, quality and metadata management, asset‑reuse improvements, and cost‑saving Spark optimizations, while sharing concrete metrics, processes, and the team’s systematic methodology.

Data GovernanceQuality Managementcloud music
0 likes · 18 min read
How Cloud Music Scaled Data Governance: Practices, Metrics, and Lessons Learned
Past Memory Big Data
Past Memory Big Data
Sep 26, 2022 · Databases

How ClickHouse Gains Full Upsert and Delete Support with UniqueMergeTree

This article examines ClickHouse’s lack of native upsert and delete operations, explains how ByteHouse’s UniqueMergeTree engine introduces a Mark‑Delete + Insert approach to provide real‑time upsert/delete capabilities, and presents benchmark results showing dramatically faster queries with only modest write overhead.

ByteHouseClickHouseColumnar Database
0 likes · 10 min read
How ClickHouse Gains Full Upsert and Delete Support with UniqueMergeTree