Machine Heart

Oct 21, 2026 · Artificial Intelligence

DeepSeek Open-Sources DeepInfer: Inference Framework Reveals 82% Gross Margin on AI Serving

DeepSeek releases DeepInfer inference framework and deepseek-recipe tokenizer under Apache 2.0, disclosing 155 trillion tokens/day throughput, $38/GPU/hour revenue at list price, and an 82% gross margin assuming $7/GPU/hour rental, with technical details on KV cache retention, speculative decoding, and deployment optimizations.