BestHub
Sign in
Tagged articles

EMR Serverless Spark

6 articles · Page 1 of 1
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Jul 30, 2026 · Big Data

How EMR Serverless Spark Achieves 4× Faster PB‑Scale Text Deduplication

The article analyzes how migrating a large‑scale text deduplication workflow to Alibaba Cloud EMR Serverless Spark, using built‑in MinHash‑LSH functions and the Fusion Engine vectorized executor, reduces processing time from days to hours, cuts shuffle failures to zero, and eliminates most operational overhead.

AI data preprocessingEMR Serverless SparkFusion Engine
0 likes · 16 min read
How EMR Serverless Spark Achieves 4× Faster PB‑Scale Text Deduplication
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Jun 4, 2026 · Big Data

Scalar‑Vector Hybrid Search in a Data Lake with One SQL on EMR Serverless Spark

EMR Serverless Spark now supports scalar‑vector hybrid search via DLF Global Index, allowing a single Spark SQL statement to perform vector similarity and scalar filtering together, eliminating data movement, reducing latency, and boosting performance for scenarios such as autonomous driving, e‑commerce, and knowledge‑base retrieval.

DLF Global IndexEMR Serverless SparkSQL
0 likes · 17 min read
Scalar‑Vector Hybrid Search in a Data Lake with One SQL on EMR Serverless Spark
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Mar 25, 2025 · Big Data

How to Connect EMR Serverless Spark with Apache Doris for Seamless Data Processing

This guide explains how to integrate EMR Serverless Spark with the high‑performance Apache Doris analytical database, covering prerequisites, connector download, OSS upload, network configuration, table creation, and both SQL‑session and Notebook examples for reading and writing Doris tables.

Apache DorisData IntegrationEMR Serverless Spark
0 likes · 11 min read
How to Connect EMR Serverless Spark with Apache Doris for Seamless Data Processing
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Oct 31, 2024 · Big Data

How EMR Serverless Spark Powers the Next‑Gen Lakehouse Era

This article traces the evolution of data platforms, explains the rise of lakehouse architecture, and details how Alibaba Cloud's EMR Serverless Spark delivers one‑stop development, high performance, and full ecosystem compatibility, illustrated with real‑world case studies from Midea and Eagle Network.

AIEMR Serverless SparkLakehouse
0 likes · 16 min read
How EMR Serverless Spark Powers the Next‑Gen Lakehouse Era