This article explains the concept of heterogeneous treatment effects, outlines how to select dimensions for HTE analysis, describes a Python‑based MVP tool for automated CATE exploration, and showcases a real‑world experiment case where sub‑group insights turned a non‑significant overall result into actionable findings.
This article explains experimental heterogeneity (HTE), clarifies key concepts such as CATE and ITE, discusses why analyzing treatment‑effect variation matters for business, compares statistical and machine‑learning methods, and introduces an open‑source Python tool that automates CATE discovery and reporting.
This article explains the concept of heterogeneous treatment effects (HTE), clarifies related terminology, outlines why HTE analysis matters for product decisions, and walks through dimension selection, statistical and machine‑learning methods—including ANOVA, causal trees, meta‑learners, and double‑machine‑learning—plus a practical MVP tool with code examples and future development directions.
This article outlines the motivation, design, architecture, engineering implementation, large‑model selection, and future improvement plans for an AI‑driven experiment analysis agent that integrates data aggregation, modular workflow orchestration, and interactive frontend features to streamline AB‑test insights.
This article outlines the motivation, design, architecture, and engineering of an AI-driven experiment analysis agent, detailing its modular workflow, large‑model selection, prompt engineering, front‑end form integration, and future enhancements to improve reliability, transparency, and user interaction.
The article introduces Meituan’s trusted experiment analysis engine, detailing its rich methodological library, system architecture, integration options, and a step‑by‑step offline analysis case that together empower teams to conduct reliable, efficient A/B tests without deep statistical expertise.
The article presents a next‑generation experiment analysis engine that standardizes the core AB testing framework, integrates advanced statistical solutions to tackle small‑sample and overflow challenges, and offers precise variance and P‑value calculations, thereby improving reliability and efficiency for multi‑side fulfillment platform experiments.
The article breaks down multiple practical approaches for data preparation, training code handling, and experiment analysis in large‑language‑model fine‑tuning, showing how deeper engagement in each step can boost personal expertise even when final model performance appears similar.
The presentation offers a comprehensive overview of online experiment fundamentals, design variations, and real-world case studies from Tencent Lookpoint, emphasizing hypothesis validation, causal analysis, best practices, and actionable recommendations for improving product growth and decision‑making.
This article presents a comprehensive overview of online experiment design and analysis, covering basic definitions, AB testing principles, complex experiment types, real-world case studies from Tencent's information flow platform, and practical guidelines for reliable experiment evaluation and product decision‑making.
