Tagged articles
10 articles
Page 1 of 1
DataFunSummit
DataFunSummit
Sep 13, 2025 · Artificial Intelligence

How Pinterest Scaled LLM Data Pipelines with Ray: Boosting Throughput and Cutting Costs

This article details how Pinterest’s senior staff engineer Dr. Luo leveraged the open‑source Ray framework to overcome LLM data‑preprocessing bottlenecks, describing the system’s architecture, key features such as map_batches, Carry‑Over Columns and Accumulators, and the dramatic performance and cost improvements achieved.

LLMPerformance OptimizationPinterest
0 likes · 12 min read
How Pinterest Scaled LLM Data Pipelines with Ray: Boosting Throughput and Cutting Costs
StarRocks
StarRocks
Aug 9, 2024 · Big Data

How Pinterest Cut Query Latency by 50% with StarRocks Migration

Pinterest migrated its Partner Insights analytics from Druid to StarRocks, achieving a 50% reduction in p90 latency, a six‑fold cost‑performance improvement, and simplified data ingestion, illustrating the benefits of a modern MPP database for real‑time ad analytics.

AnalyticsMPPPinterest
0 likes · 6 min read
How Pinterest Cut Query Latency by 50% with StarRocks Migration
21CTO
21CTO
May 25, 2024 · Databases

How Pinterest Scaled Its Architecture: From Clusters to Sharding

This article examines Pinterest's evolution through four development phases, the core technologies it adopted, and how it transitioned from complex clustering to a simpler sharding architecture to achieve scalable, high‑availability data storage.

Pinterestarchitectureclustering
0 likes · 11 min read
How Pinterest Scaled Its Architecture: From Clusters to Sharding
21CTO
21CTO
Jul 3, 2017 · Big Data

Inside the World’s Best Data Architectures: Netflix, Facebook, Airbnb, Pinterest

This article explores the cutting‑edge data pipelines of Netflix, Facebook, Airbnb and Pinterest, detailing the massive event volumes they handle, the core technologies such as Kafka, Spark, Presto and Hadoop, and how these giants design scalable, real‑time analytics infrastructures.

AirbnbBig DataData Architecture
0 likes · 6 min read
Inside the World’s Best Data Architectures: Netflix, Facebook, Airbnb, Pinterest
21CTO
21CTO
Jun 7, 2017 · Artificial Intelligence

How Pinterest Scaled Its Recommendation Engine: From Simple Graphs to Real‑Time AI Ranking

This article chronicles Pinterest's recommendation system evolution, detailing how the platform progressed from basic pin‑board co‑occurrence graphs to sophisticated machine‑learning‑driven candidate generation and real‑time personalized ranking, boosting user engagement and enabling advanced visual search capabilities.

AIPinterestcandidate generation
0 likes · 15 min read
How Pinterest Scaled Its Recommendation Engine: From Simple Graphs to Real‑Time AI Ranking
Java High-Performance Architecture
Java High-Performance Architecture
Aug 23, 2016 · Operations

How Pinterest Scales Service Discovery with ZooKeeper—and Overcomes Its Pitfalls

Pinterest shares its real‑world experience using ZooKeeper for service discovery and dynamic configuration, detailing the challenges of connection overload, transaction spikes, network partitions, and human error, and explains the multi‑step solutions that improved resilience and reduced operational risk.

Dynamic ConfigurationPinterestZooKeeper
0 likes · 7 min read
How Pinterest Scales Service Discovery with ZooKeeper—and Overcomes Its Pitfalls
Architecture Digest
Architecture Digest
May 11, 2016 · Artificial Intelligence

Interest Feeds: From Facebook NewsFeed and EdgeRank to Pinterest Smart Feed and General Techniques

This article explains why interest‑driven feeds are essential, reviews Facebook's NewsFeed evolution and EdgeRank algorithm, details Pinterest's Smart Feed architecture and Pinnability model, and provides a comprehensive guide to building, ranking, and monitoring generic interest‑feed systems for social platforms.

FacebookPinterestSocial network
0 likes · 34 min read
Interest Feeds: From Facebook NewsFeed and EdgeRank to Pinterest Smart Feed and General Techniques
21CTO
21CTO
Jan 29, 2016 · Backend Development

How Pinterest Scaled to Billions of Page Views: Architecture & Sharding Secrets

Pinterest grew from zero to over 100 billion monthly page views by rapidly expanding its infrastructure, adopting simple, mature technologies like MySQL, Redis, and Memcache, and transitioning from clustering to sharding, offering practical lessons on scaling, tool selection, ID design, and migration strategies for massive growth.

Pinterestarchitecturecloud
0 likes · 23 min read
How Pinterest Scaled to Billions of Page Views: Architecture & Sharding Secrets
Suning Design
Suning Design
May 13, 2014 · Product Management

How Pinterest’s Guided Search Redefines Visual Discovery

Pinterest’s guided search, inspired by mind‑mapping techniques, lets users start with a simple keyword and iteratively refine results, combining visual cues and trending data to deliver more personalized, multidimensional discovery without needing detailed user behavior tracking.

Guided SearchPinterestVisual Discovery
0 likes · 6 min read
How Pinterest’s Guided Search Redefines Visual Discovery