DeepSeek‑V4 Local Deployment: How SGLang Overcomes the Architecture Challenges

The article analyzes DeepSeek‑V4's architectural innovations—including mixed sparse attention, mHC, and native FP4 weights—explains SGLang's ShadowRadix, HiSparse, and in‑graph speculative decoding solutions, presents benchmark gains, provides Docker deployment steps, and warns of key pitfalls for long‑context inference.

DeepSeek-V4HiSparseSGLang

0 likes · 15 min read

DeepSeek‑V4 Local Deployment: How SGLang Overcomes the Architecture Challenges

Baobao Algorithm Notes

Jan 21, 2025 · Artificial Intelligence

Inside Kimi 1.5: Four Innovations That Supercharge Long‑Context Multimodal Reasoning

The article analyzes Kimi 1.5’s technical report, detailing its four core innovations, long‑to‑short inference tricks, reinforcement‑learning infrastructure, and benchmark results that show it out‑performing competing models in long‑context and multimodal tasks.

Kimi 1.5Multimodal Reasoninglong-context inference

0 likes · 11 min read

Inside Kimi 1.5: Four Innovations That Supercharge Long‑Context Multimodal Reasoning

DeepSeek‑V4 Local Deployment: How SGLang Overcomes the Architecture Challenges

Inside Kimi 1.5: Four Innovations That Supercharge Long‑Context Multimodal Reasoning

Inside Kimi 1.5: Four Innovations That Supercharge Long‑Context Multimodal Reasoning