Shopee Tech Team
Author

Shopee Tech Team

How to innovate and solve technical challenges in diverse, complex overseas scenarios? The Shopee Tech Team will explore cutting‑edge technology concepts and applications with you.

46
Articles
0
Likes
118
Views
0
Comments
Recent Articles

Latest from Shopee Tech Team

46 recent articles
Shopee Tech Team
Shopee Tech Team
May 5, 2022 · Backend Development

seadt: Golang Distributed Transaction Solution – Design, Integration, and Code Implementation

seadt is a Golang‑based TCC distributed‑transaction framework for Shopee Financial Products that lets initiators run multi‑service operations as if they were local DB actions, providing TM, RM, and TC components, automatic proxy generation, and robust handling of empty commits, rollbacks, hanging branches, and concurrency issues.

GolangTCCdistributed transaction
0 likes · 32 min read
seadt: Golang Distributed Transaction Solution – Design, Integration, and Code Implementation
Shopee Tech Team
Shopee Tech Team
Apr 28, 2022 · Big Data

Building Real-Time Data Warehouse with Flink + Hudi at Shopee

Shopee replaced its hourly Hive pipeline with a hybrid Flink‑Hudi real‑time data warehouse that groups Kafka topics, applies lightweight stream ETL, uses partial‑update MOR tables for multi‑stream joins and COW tables for versioned batches, cutting latency from about 90 minutes to 2–30 minutes and halving resource usage.

Apache FlinkApache HudiBatch Processing
0 likes · 20 min read
Building Real-Time Data Warehouse with Flink + Hudi at Shopee
Shopee Tech Team
Shopee Tech Team
Apr 21, 2022 · Mobile Development

Understanding and Solving Android UI Jank and ANR with MDAP LooperMonitor

The article explains how Android UI jank and ANR stem from the Looper‑MessageQueue, and introduces MDAP’s LooperMonitor—a low‑overhead tool that records each message’s target, timing and stack, aggregates data across multiple loopers, visualizes it, and enables developers to quickly pinpoint and resolve the exact cause of stalls.

ANRAndroidLooperMonitor
0 likes · 32 min read
Understanding and Solving Android UI Jank and ANR with MDAP LooperMonitor
Shopee Tech Team
Shopee Tech Team
Apr 21, 2022 · Backend Development

Interview with Shopee Backend Engineer Draven on Technical Writing, Go Language Design, and Cloud‑Native Development

In this interview, Shopee backend engineer Draven discusses how his early blogging evolved into authoring a comprehensive Go language design book, compares book‑writing to blog series, shares his research‑driven learning methods for new technologies, outlines his current focus on OS, networking and C++, and invites readers to suggest technical books for a World Book Day giveaway.

Career DevelopmentGo languagebackend development
0 likes · 10 min read
Interview with Shopee Backend Engineer Draven on Technical Writing, Go Language Design, and Cloud‑Native Development
Shopee Tech Team
Shopee Tech Team
Apr 14, 2022 · Big Data

URL Normalization and Statistical Analysis in MDAP Using Probabilistic and Machine Learning Techniques

MDAP normalizes URLs by automatically learning pattern‑tree rule models using entropy‑based splits, gibberish and numeric detection, and scalable Flink processing, which groups millions of raw URLs into concise patterns for accurate statistical monitoring, dramatically reducing data noise while still facing latency and model‑iteration challenges.

Flinkmachine learningpattern tree
0 likes · 20 min read
URL Normalization and Statistical Analysis in MDAP Using Probabilistic and Machine Learning Techniques
Shopee Tech Team
Shopee Tech Team
Apr 7, 2022 · Operations

MDAP: A Multi‑Dimensional Real‑Time Monitoring and Analysis Platform for Mobile Applications

MDAP is a multi‑dimensional real‑time monitoring platform for mobile apps that gathers metrics, logs, and traces via lightweight SDKs, processes data through micro‑service back‑ends using Flink, Spark, and ClickHouse, applies intelligent analysis for smoothness scoring, memory‑snapshot optimization, stack de‑obfuscation, crash clustering, and URL templating, and aims to extend end‑to‑end observability and predictive issue detection.

Data AnalysisPerformanceStack Trace
0 likes · 26 min read
MDAP: A Multi‑Dimensional Real‑Time Monitoring and Analysis Platform for Mobile Applications
Shopee Tech Team
Shopee Tech Team
Mar 24, 2022 · Backend Development

How Finder Enables Precise Code Coverage and Automated Test‑Case Discovery

This article explains how the Finder system combines multi‑language code‑coverage collection, differential analysis, and call‑graph tracing to provide fine‑grained testing metrics, automate test‑case identification, and support continuous quality assurance across complex backend and frontend projects.

code coveragecontinuous integrationmicroservices
0 likes · 17 min read
How Finder Enables Precise Code Coverage and Automated Test‑Case Discovery
Shopee Tech Team
Shopee Tech Team
Mar 17, 2022 · Backend Development

Real-time Checking System for Data Consistency in Microservices

Shopee’s Real‑time Checking System provides configurable, non‑intrusive data consistency verification for micro‑services by capturing change events via CDC, streaming them through Kafka, applying flexible rules and expressions, and instantly alerting mismatches, delivering second‑level detection while scaling to tens of thousands of checks per second.

CDCData ConsistencyRedis
0 likes · 20 min read
Real-time Checking System for Data Consistency in Microservices
Shopee Tech Team
Shopee Tech Team
Mar 10, 2022 · Mobile Development

FolderBsdp: An Efficient Incremental Update Solution for React Native Hybrid Apps

FolderBsdp provides an efficient incremental update method for React Native hybrid apps by diffing raw resource folders per file with BSDiff, packaging tiny patches into a single ZIP, dramatically cutting bandwidth, memory usage, and storage while eliminating extra ZIP dependencies, making it ideal for low‑end devices.

Diff AlgorithmFolderBsdpIncremental Update
0 likes · 22 min read
FolderBsdp: An Efficient Incremental Update Solution for React Native Hybrid Apps
Shopee Tech Team
Shopee Tech Team
Mar 3, 2022 · Backend Development

seadt: A Golang Distributed Transaction Framework for Financial Products

seadt is a self‑developed Golang distributed‑transaction framework for Shopee’s financial products that adopts the TCC model, providing a global Transaction Coordinator, embedded Transaction Managers and Resource Managers via an SDK to ensure atomic two‑phase commits, idempotency, high availability, and eventual consistency in loan‑processing flows, with future Saga support planned.

Financial ServicesGolangSeata
0 likes · 20 min read
seadt: A Golang Distributed Transaction Framework for Financial Products