Tencent Advertising Technology
Author

Tencent Advertising Technology

Official hub of Tencent Advertising Technology, sharing the team's latest cutting-edge achievements and advertising technology applications.

128
Articles
0
Likes
539
Views
0
Comments
Recent Articles

Latest from Tencent Advertising Technology

100 recent articles max
Tencent Advertising Technology
Tencent Advertising Technology
Jul 24, 2024 · Artificial Intelligence

Multi-Embedding Paradigm for Scaling Recommendation Models: Mitigating Embedding Dimensional Collapse

This paper investigates the embedding dimensional collapse problem that hinders scaling of recommendation models and proposes a Multi-Embedding paradigm that learns multiple embeddings per feature with independent expert networks, demonstrating consistent performance gains across major CTR benchmarks and real‑world ad systems.

Artificial IntelligenceCTR predictionDeep Learning
0 likes · 10 min read
Multi-Embedding Paradigm for Scaling Recommendation Models: Mitigating Embedding Dimensional Collapse
Tencent Advertising Technology
Tencent Advertising Technology
Jul 19, 2024 · Artificial Intelligence

The Brutal Aesthetics of Data and Compute: Scaling Laws, Generative AI, and the Evolution of Advertising Systems

This article explains how the scaling law—massive data, compute, and a simple transformer architecture—drives generative AI breakthroughs, how Tencent applied this principle to build larger ad models and the "Hunyuan" large model, and how advertising systems must evolve to truly understand content and users.

@DataAIGenerative AI
0 likes · 11 min read
The Brutal Aesthetics of Data and Compute: Scaling Laws, Generative AI, and the Evolution of Advertising Systems
Tencent Advertising Technology
Tencent Advertising Technology
Jul 17, 2024 · Artificial Intelligence

Ads Recommendation in a Collapsed and Entangled World: Tencent's Innovations in Feature Encoding, Dimensional Collapse Mitigation, and Interest Disentanglement

This article summarizes Tencent Advertising's recent research on recommendation models, covering comprehensive feature encoding techniques, solutions to embedding dimensional collapse through multi‑embedding paradigms, and novel methods such as STEM and AME to disentangle conflicting user interests across multiple tasks.

AdvertisingEmbeddingRecommendation
0 likes · 20 min read
Ads Recommendation in a Collapsed and Entangled World: Tencent's Innovations in Feature Encoding, Dimensional Collapse Mitigation, and Interest Disentanglement
Tencent Advertising Technology
Tencent Advertising Technology
Mar 30, 2023 · Artificial Intelligence

Tencent's Taiji Machine Learning Platform: End-to-End MLOps for Advertising

Tencent’s Taiji machine learning platform, a cloud‑native, distributed parameter‑server system, provides end‑to‑end MLOps for advertising by integrating data ingestion, feature engineering, model training, evaluation, deployment, and monitoring, supporting massive models up to billions of parameters while improving efficiency, scalability, and resource management.

Distributed TrainingMLOpsMachine Learning Platform
0 likes · 18 min read
Tencent's Taiji Machine Learning Platform: End-to-End MLOps for Advertising
Tencent Advertising Technology
Tencent Advertising Technology
Mar 28, 2023 · Operations

Experimental Design for Two-Sided Markets in Advertising Scenarios

This article discusses experimental design challenges in two-sided markets, particularly in advertising scenarios, and presents various methods including four-table experiments, counterfactual interleaving, and contingency table joint sampling to address issues like network effects and competition between supply and demand sides.

A/B TestingAdvertisingExperimental Design
0 likes · 14 min read
Experimental Design for Two-Sided Markets in Advertising Scenarios
Tencent Advertising Technology
Tencent Advertising Technology
Mar 10, 2023 · Artificial Intelligence

Optimizing Large-Scale Model Training with Tencent's AngelPTM and ZeRO-Cache

This article presents Tencent's latest advancements in large‑scale model training, detailing the AngelPTM framework and its ZeRO‑Cache optimization techniques that reduce memory and storage costs, improve hardware utilization, and achieve high‑performance training for trillion‑parameter AI models across various applications.

AI modelsAngelPTMLarge‑Scale Training
0 likes · 14 min read
Optimizing Large-Scale Model Training with Tencent's AngelPTM and ZeRO-Cache
Tencent Advertising Technology
Tencent Advertising Technology
Mar 2, 2023 · Artificial Intelligence

Tencent's HunYuan‑NLP 1T Large‑Scale AI Model: Training Techniques, Optimization, and Real‑World Applications

This article details Tencent's development of the 1‑trillion‑parameter HunYuan‑NLP model, covering its MoE architecture, cost‑effective pre‑training strategies, distributed training framework, model compression toolkit, and successful deployment across advertising, gaming, and other Tencent services.

AI infrastructureMixture of ExpertsModel Compression
0 likes · 17 min read
Tencent's HunYuan‑NLP 1T Large‑Scale AI Model: Training Techniques, Optimization, and Real‑World Applications
Tencent Advertising Technology
Tencent Advertising Technology
Feb 17, 2023 · Big Data

Cost Optimization and Mixed‑Resource Deployment in Tencent's Taiji Machine Learning Platform

The article details how Tencent's Taiji machine‑learning platform reduces training costs and improves efficiency for large‑scale advertising models by leveraging cloud‑native mixed‑resource strategies—including online idle, offline elastic, and compute‑resource sharing—while maintaining high service stability through advanced scheduling, fault‑tolerance, and resource‑prediction techniques.

Machine Learning PlatformResource SchedulingTencent
0 likes · 16 min read
Cost Optimization and Mixed‑Resource Deployment in Tencent's Taiji Machine Learning Platform
Tencent Advertising Technology
Tencent Advertising Technology
Dec 27, 2022 · Big Data

Design and Optimization of Tencent Advertising Log Data Lake Using Iceberg, Spark, and Flink

The article details how Tencent Advertising re‑architected its massive log pipeline by consolidating heterogeneous real‑time and offline logs into an Iceberg‑based data lake, introducing multi‑level partitioning, Spark and Flink ingestion, and numerous performance and cost optimizations for scalable big‑data analytics.

Data LakeFlinkIceberg
0 likes · 20 min read
Design and Optimization of Tencent Advertising Log Data Lake Using Iceberg, Spark, and Flink