Skip to content
Tagged articles

inference engines

2 articles · Page 1 of 1
Lao Guo's Learning Space
Lao Guo's Learning Space
Nov 2, 2026 · Artificial Intelligence

Why 70B Struggles on 64GB MacBook Pro: 5 Deployment Iron Laws

This guide details five iron laws for deploying large language models on a 64GB MacBook Pro with M5 Pro chip, covering memory budgeting (45GB usable), model tier recommendations (32B smooth, 70B borderline), inference engine selection, speedup techniques like speculative decoding, and API serving best practices.

Apple SiliconLLM DeploymentMacBook Pro M5 Pro
0 likes · 10 min read
Why 70B Struggles on 64GB MacBook Pro: 5 Deployment Iron Laws
Bilibili Tech
Bilibili Tech
Nov 7, 2023 · Artificial Intelligence

Technical Overview of Bilibili Vision Toolkit (BVT): Architecture, Features, and FFmpeg Filter Integration

The Bilibili Vision Toolkit (BVT) is a C++ SDK that unifies multimedia AI algorithms through a low‑coupling core, modular dynamic libraries, and a multi‑engine backend, enabling configurable DAG pipelines, asynchronous parallel execution, and seamless FFmpeg filter integration for high‑performance, cross‑platform video processing.

BVTC++FFmpeg
0 likes · 15 min read
Technical Overview of Bilibili Vision Toolkit (BVT): Architecture, Features, and FFmpeg Filter Integration