Tagged articles

Performance Acceleration

4 articles · Page 1 of 1

Jun 17, 2026 · Artificial Intelligence

RedParrot’s Semantic Cache Accelerates Enterprise NL‑to‑DSL Analytics by 3.6×

RedParrot introduces a query‑semantic‑caching framework that compresses the multi‑stage LLM NL‑to‑DSL workflow into a short‑chain process, achieving an average 3.6× inference speedup and an 8.26% accuracy gain on real‑world business data while also delivering strong generalization on open NL‑to‑DSL benchmarks.

Business AnalyticsLLMNL-to-DSL

0 likes · 19 min read

RedParrot’s Semantic Cache Accelerates Enterprise NL‑to‑DSL Analytics by 3.6×

Machine Learning Algorithms & Natural Language Processing

May 29, 2026 · Artificial Intelligence

RTPurbo: >97% Sparsity and 9× Faster Long-Context LLM Inference with Minimal Training

The article presents RTPurbo, a lightweight two‑stage training method that converts full‑attention LLMs into highly sparse models with over 97% sparsity, achieving up to 9.36× prefill and 2.01× decode speedups while preserving near‑lossless accuracy across long‑context benchmarks up to 512K tokens.

Dynamic Token SelectionLow-Dimensional ProjectionPerformance Acceleration

0 likes · 17 min read

RTPurbo: >97% Sparsity and 9× Faster Long-Context LLM Inference with Minimal Training

AI Frontier Lectures

Jul 13, 2025 · Artificial Intelligence

How HarmoniCa Boosts Diffusion Model Speed with Joint Training‑Inference Caching

HarmoniCa, a new feature‑caching framework co‑designed by HKUST, Beihang University, and SenseTime, tackles diffusion model inference bottlenecks by aligning training and inference through Step‑Wise Denoising Training and an Image Error Proxy Objective, achieving up to 2× speedup while preserving image quality.

Performance Accelerationdiffusion modelsfeature caching

0 likes · 9 min read

How HarmoniCa Boosts Diffusion Model Speed with Joint Training‑Inference Caching

Code DAO

Dec 11, 2021 · Artificial Intelligence

Nimble: A Lightweight Parallel GPU Scheduler Boosting Deep Learning Performance

The article analyzes how Nimble reduces GPU scheduling overhead and enables parallel execution through ahead‑of‑time scheduling and automatic multi‑stream assignment, achieving up to 22.3× inference speedup over PyTorch and significantly improving GPU utilization for deep learning workloads.

Deep LearningGPU SchedulingParallel Execution

0 likes · 9 min read

Nimble: A Lightweight Parallel GPU Scheduler Boosting Deep Learning Performance