Tagged articles

AWS EMR

2 articles · Page 1 of 1

Jun 29, 2022 · Big Data

From 1.0 to 3.0: Evolution of a Data Sandbox Platform on AWS EMR

This article chronicles the step‑by‑step evolution of a data‑sandbox platform built on AWS EMR, detailing architectural changes from a simple S3‑backed 1.0 version through a Ranger‑secured 2.0 iteration to a cost‑optimized 3.0 design that balances security, performance, and usability for business analysts.

AWS EMRApache RangerBig Data Security

0 likes · 24 min read

From 1.0 to 3.0: Evolution of a Data Sandbox Platform on AWS EMR

Liulishuo Tech Team

Jun 17, 2016 · Big Data

Building a Scalable Big Data Platform on AWS: Architecture and Execution Service Design

This article details the architectural design and implementation of a scalable big data platform built on AWS services, highlighting the transition from HDFS to S3 for storage, the use of EMR for elastic compute, and a custom Execution Service integrated with Consul and Airflow for automated cluster management and task scheduling.

AWS EMRAirflowBig Data Architecture

0 likes · 11 min read

Building a Scalable Big Data Platform on AWS: Architecture and Execution Service Design