Big Data 7 min read

How to Build a Multi‑Tenant Big Data Platform on MaxCompute: Lessons from a GCP Migration

This article details how a leading Southeast Asian tech group migrated from BigQuery to MaxCompute, designing a multi‑tenant big data platform with separate control and data planes, addressing cross‑account access, governance, and cost challenges on Alibaba Cloud.

Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
How to Build a Multi‑Tenant Big Data Platform on MaxCompute: Lessons from a GCP Migration

Why Adopt a Multi‑Tenant Architecture

GoTerra, a leading Southeast Asian tech group, originally used BigQuery on GCP. Because each business entity must operate under a separate cloud account for compliance and cost accounting, a multi‑tenant design is required to handle cross‑account resource access, unified management, and cost control.

MaxCompute Multi‑Tenant Capabilities

MaxCompute supports multiple tenants within the same cluster/region, each tenant containing projects, quotas, and network resources. Projects manage data objects, job instances, and user roles, while quotas manage compute resources. Cross‑project data access and proxy authorization enable controlled data sharing between tenants.

Although MaxCompute provides isolation and security, its native multi‑tenant features lack fine‑grained access control and flexible metadata discovery needed for large enterprises like GoTerra.

Implementation on Alibaba Cloud

Create a control‑plane cloud account (A) and multiple data‑plane accounts (B1…Bn).

In the control‑plane account, create a RAM role dataplaform_controlplane that ECS/ACK services can assume.

In each data‑plane account, create a RAM role that the control‑plane account can assume and grant the necessary MaxCompute permissions.

Control‑plane resources assume the data‑plane roles to access MaxCompute resources across accounts.

Next Steps and Outlook

DataWorks, Alibaba Cloud’s data integration platform, needs to extend its multi‑tenant capabilities—such as flexible data source tenancy, cross‑tenant metadata discovery, and multi‑tenant data development—to provide a one‑stop control‑plane solution for enterprise customers lacking self‑built toolchains.

Big Datacloud migrationMulti‑TenantMaxComputeAlibaba Cloud
Alibaba Cloud Big Data AI Platform
Written by

Alibaba Cloud Big Data AI Platform

The Alibaba Cloud Big Data AI Platform builds on Alibaba’s leading cloud infrastructure, big‑data and AI engineering capabilities, scenario algorithms, and extensive industry experience to offer enterprises and developers a one‑stop, cloud‑native big‑data and AI capability suite. It boosts AI development efficiency, enables large‑scale AI deployment across industries, and drives business value.

0 followers
Reader feedback

How this landed with the community

Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.