large-scale indexing

Bilibili Tech

Jan 7, 2025 · Cloud Native

Design and Implementation of Bilibili's Large-Scale Recall System

Bilibili’s large‑scale recall system separates online processing into a two‑tier merge service and an index service, supports multi‑channel text, item‑to‑item and vector indexes with real‑time updates, uses horizontal sharding, robust CI/CD, monitoring and degradation mechanisms, and is being extended toward model‑based recall and greater automation.

BilibiliCloud NativeVector Search

0 likes · 16 min read

Design and Implementation of Bilibili's Large-Scale Recall System

DataFunTalk

Jan 22, 2022 · Artificial Intelligence

Multimodal Content Understanding Techniques in Search Systems

This talk presents Tencent's multimodal content understanding framework for search, covering hierarchical content features, large‑scale ranking, fine‑grained image semantic vectors, video and document analysis, quality detection, duplicate removal, and future directions in AI‑driven search.

AIImage EmbeddingSearch

0 likes · 17 min read

Multimodal Content Understanding Techniques in Search Systems

Kuaishou Tech

Nov 29, 2021 · Artificial Intelligence

Starry Vector Retrieval Platform: Architecture, Features, and Performance

The article describes the design, challenges, architecture, key features, algorithm optimizations, and future roadmap of Kuaishou's Starry vector retrieval platform, which delivers high‑performance, high‑reliability, and easy‑to‑use large‑scale ANN search for diverse business scenarios.

AI PlatformANNVector Search

0 likes · 14 min read

Starry Vector Retrieval Platform: Architecture, Features, and Performance

Youku Technology

Jul 9, 2020 · Artificial Intelligence

Multi-level Multi-modal Search Engine and Graph Engine for Billion-scale Video Content

An advanced multi‑level, multi‑modal search and graph engine for Youku processes text, voice, image and video queries across hierarchical video elements, using combined vector and inverted indexes to merge cross‑level and cross‑modal results, while a distributed knowledge‑graph layer enables multimodal graph traversal for billion‑scale video retrieval.

AIgraph engineknowledge graph

0 likes · 12 min read

Multi-level Multi-modal Search Engine and Graph Engine for Billion-scale Video Content

Architecture Digest

Nov 15, 2019 · Big Data

Design and Key Technologies of the 360 Search Engine for Billion‑Scale Web Retrieval

This article explains how 360 Search handles billions of daily crawls and hundred‑billion‑scale indexing by describing its overall architecture, core modules such as offline indexing and online retrieval, query analysis, relevance scoring, and the engineering techniques that enable efficient large‑scale web search.

Big DataRankingSearch Engine

0 likes · 22 min read