Applying A/B Testing to Drive Growth in Tencent Overseas Games
This article explains how Tencent leverages A/B testing across its overseas games, detailing market differences, experimental methodology, multi‑cloud platform compliance, data architecture, and case studies that illustrate how targeted experiments improve user onboarding, gameplay settings, and email‑based re‑engagement.
Tencent dominates the domestic gaming market but faces distinct challenges overseas due to differing market environments and user habits. To enhance user experience abroad, Tencent employs systematic A/B experiments that evaluate strategies, identify optimization directions, and select optimal solutions.
The overseas gaming landscape includes diverse product types—mobile, PC, and console—each with varying development cycles and experiment feasibility. Mobile games benefit from frequent updates and online connectivity, enabling rapid A/B testing, whereas PC/console titles face longer cycles and connectivity constraints.
AB testing at Tencent follows a five‑step workflow: user segmentation, random traffic allocation using hash algorithms, experiment rollout (e.g., backend changes, UI tweaks, recommendation algorithms), data collection and analysis, and final decision making. Typical experiment outcomes show modest metric improvements (0.1%–2%) but can have large impact given massive user bases.
Operating overseas introduces compliance challenges: data must reside in local jurisdictions, requiring isolated cloud buckets and strict IAM controls. Tencent’s multi‑cloud platform addresses these by isolating resources per region, granting data‑subject access rights, and enforcing granular permission management.
The platform’s data architecture ingests SDK events via Google Cloud Pub/Sub, processes them with Dataflow, stores hourly partitions in Cloud Storage, and aggregates exposure data in Databricks. Cross‑cloud data transfer is handled by Google Cloud Transfer Service, culminating in a unified data lake for analysis.
Two case studies demonstrate experiment‑driven growth: (1) optimizing the new‑player onboarding flow—experiments on skip‑button visibility, auto‑attack settings, and initial camera perspective revealed that preserving tutorial steps and allowing perspective choice significantly boost retention; (2) email‑based re‑engagement—testing subject line emphasis showed that highlighting free rewards, rather than updates, yields higher recall rates.
Overall, the systematic application of A/B testing, supported by a compliant multi‑cloud infrastructure and robust data pipelines, enables Tencent’s overseas games to iteratively improve user retention, engagement, and revenue.
DataFunTalk
Dedicated to sharing and discussing big data and AI technology applications, aiming to empower a million data scientists. Regularly hosts live tech talks and curates articles on big data, recommendation/search algorithms, advertising algorithms, NLP, intelligent risk control, autonomous driving, and machine learning/deep learning.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.