BestHub
Sign in
Tagged articles

Streaming Execution

4 articles · Page 1 of 1
Big Data Technology & Architecture
Big Data Technology & Architecture
Oct 19, 2026 · Big Data

Ray Data Deep Dive: The AI-Era Distributed Engine Replacing Spark

This article provides a comprehensive technical deep dive into Ray Data, covering its architecture, streaming execution model, shuffle implementation, fault tolerance, performance tuning, and best practices for AI data pipelines, positioning it as a superior alternative to Spark for GPU-intensive workloads.

AI Data PipelinesDistributed ComputingPerformance Tuning
0 likes · 26 min read
Ray Data Deep Dive: The AI-Era Distributed Engine Replacing Spark
o-ai.tech
o-ai.tech
Jul 16, 2026 · Backend Development

Designing a Unified, Type‑Safe, Extensible Tool System for AI Agents

This document details a comprehensive architecture for an AI‑agent tool system that unifies registration, discovery, and invocation of dozens of tools, enforces strong type safety, supports runtime dynamic registration, and provides efficient streaming execution with a layered design and dependency‑injection container.

AI agentsDependency InjectionStreaming Execution
0 likes · 32 min read
Designing a Unified, Type‑Safe, Extensible Tool System for AI Agents
Big Data Technology Tribe
Big Data Technology Tribe
Nov 23, 2025 · Artificial Intelligence

How Ray Data Accelerates AI Workloads with Streaming Execution

Ray Data is a scalable library built on Ray that offers high‑performance, streaming‑execution APIs for AI workloads, enabling efficient batch inference, data preprocessing, and training data ingestion across CPU and GPU resources, while supporting diverse data formats and seamless integration with popular frameworks.

AI data processingPythonRay Data
0 likes · 11 min read
How Ray Data Accelerates AI Workloads with Streaming Execution
Alibaba Cloud Developer
Alibaba Cloud Developer
Jun 10, 2025 · Big Data

How Ray Data Streams Data: From Logical Plans to Distributed Execution

This deep‑dive explains how Ray Data transforms user‑level Dataset APIs into a logical plan, optimizes it, converts it into a physical streaming execution graph, and runs it on a cluster using task and actor pools, detailing each component from read sources to write sinks with code examples.

Data ProcessingDistributed ComputingPython
0 likes · 69 min read
How Ray Data Streams Data: From Logical Plans to Distributed Execution