Tagged articles

ZMQ

3 articles · Page 1 of 1

Jul 14, 2026 · Backend Development

How vLLM Generates Tokens: A Deep Dive into the Source Code

This article walks through vLLM’s token‑generation pipeline by dissecting its source files, process roles, ZMQ communication, scheduling, and deployment considerations, revealing how prompts become streamed token IDs and highlighting the key factors that limit concurrency and performance.

Backend ArchitectureGPU memoryLLM inference

0 likes · 17 min read

How vLLM Generates Tokens: A Deep Dive into the Source Code

360 Tech Engineering

Nov 28, 2018 · Backend Development

The Evolution and Architecture of Remote Real‑Device Debugging

This article traces the history, design motivations, implementation methods, protocol details, and Golang‑based ZMQ architecture of a cloud‑phone platform that enables remote real‑device debugging, covering security monitoring, performance optimization, and practical deployment diagrams.

ADBRemote DebuggingZMQ

0 likes · 6 min read

The Evolution and Architecture of Remote Real‑Device Debugging

360 Quality & Efficiency

Aug 9, 2018 · Backend Development

The Evolution and Architecture of Remote Real‑Device Debugging

This article traces the history, requirements, design, and implementation of a cloud‑phone platform that enables remote real‑device debugging using ADB over TCP, ZMQ‑based proxies, and Golang services to achieve high‑performance, secure, and scalable debugging across separated deployments.

ADBRemote DebuggingZMQ

0 likes · 6 min read