StarRocks

Sep 15, 2026 · Databases

StarRocks AI Function: Embedding LLM Inference into the SQL Execution Pipeline

StarRocks introduces AI Functions that let SQL directly call LLMs for generation, classification, extraction, and embedding, integrating model inference into the query optimizer and pipeline execution engine with async dual-pipeline architecture, backpressure, and cost-based optimization to reduce unnecessary calls and manage latency.