DeepHub IMBA
Author

DeepHub IMBA

A must‑follow public account sharing practical AI insights. Follow now. internet + machine learning + big data + architecture = IMBA

133
Articles
0
Likes
1.2k
Views
0
Comments
Recent Articles

Latest from DeepHub IMBA

100 recent articles max
DeepHub IMBA
DeepHub IMBA
Aug 5, 2026 · Artificial Intelligence

Designing Multi‑Model Systems: 4 Common Architecture Patterns and When to Use Them

The article examines multi‑model system design, presenting four core architecture patterns—sequential (pipeline, router), parallel (fan‑out, voting), hierarchical (planner‑executor, supervisor‑worker), and ensemble (weighted, consensus)—and discusses their trade‑offs, implementation details, and scenarios where multi‑model approaches add real value.

AIArchitecture Patternsensemble
0 likes · 11 min read
Designing Multi‑Model Systems: 4 Common Architecture Patterns and When to Use Them
DeepHub IMBA
DeepHub IMBA
Aug 3, 2026 · Artificial Intelligence

How Continuous Batching Boosts LLM Throughput by Up to 36×

The article explains continuous batching, a scheduling technique that re‑evaluates the batch at every inference iteration, eliminating the straggler problem of static batching, and shows how it, together with PagedAttention, can raise LLM service throughput dramatically while balancing latency and memory usage.

GPU utilizationLLM inferencecontinuous batching
0 likes · 9 min read
How Continuous Batching Boosts LLM Throughput by Up to 36×
DeepHub IMBA
DeepHub IMBA
Aug 2, 2026 · Artificial Intelligence

Building a From‑Scratch LLM Training Framework: Full GRPO vs PPO vs DPO Comparison on GSM8K

The article presents a from‑scratch LLM training framework called grpo‑llm, implements GRPO with Trio rollout, FSDP and a C++ reward extension, and conducts a controlled experiment comparing GRPO, PPO and DPO on the GSM8K math‑reasoning benchmark, revealing why DPO outperforms the other two under sparse binary rewards.

DPOGRPOGSM8K
0 likes · 10 min read
Building a From‑Scratch LLM Training Framework: Full GRPO vs PPO vs DPO Comparison on GSM8K
DeepHub IMBA
DeepHub IMBA
Aug 1, 2026 · Artificial Intelligence

Estimating the GPU Count Needed to Train a Large Language Model

The article presents a practical scaling‑law based method to estimate the total FLOPs, GPU throughput, and required number of GPUs for training a large language model, showing how to compute these values from model parameters, token count, and target training time, and discusses approximation limits and useful tools.

AICompute EstimationGPU
0 likes · 9 min read
Estimating the GPU Count Needed to Train a Large Language Model
DeepHub IMBA
DeepHub IMBA
Jul 29, 2026 · User Experience Design

How to Write an Effective DESIGN.md So AI Generates Designs That Match Your Intent

Designers can use a plain‑text DESIGN.md file to convey visual identity, token‑based design decisions, and component specifications to AI tools such as Google Stitch, Claude Code or Cursor, ensuring the AI produces UI outputs that respect the original design system and reduce mismatches.

AI-assisted designDESIGN.mdUI Generation
0 likes · 9 min read
How to Write an Effective DESIGN.md So AI Generates Designs That Match Your Intent
DeepHub IMBA
DeepHub IMBA
Jul 28, 2026 · Artificial Intelligence

Why Multi‑Agent Systems Are Fundamentally Distributed Systems

Multi‑agent workflows often deadlock or drift because their agents behave like distributed nodes, so treating them as a distributed system reveals classic failure modes—deadlocks, state pollution, lack of timeouts, and missing idempotency—allowing proven engineering practices to keep AI pipelines reliable.

AI EngineeringLangChainLangGraph
0 likes · 14 min read
Why Multi‑Agent Systems Are Fundamentally Distributed Systems
DeepHub IMBA
DeepHub IMBA
Jul 26, 2026 · Artificial Intelligence

What Is Loop Engineering and How Does It Differ From Harness Engineering?

The article defines loop engineering as a system that replaces manual prompting of agents, explains its relationship to harness engineering, critiques its terminology, cost, and selective examples, outlines its five core components plus state, and discusses when and how to adopt it in production.

AI orchestrationAgent HarnessClaude Code
0 likes · 11 min read
What Is Loop Engineering and How Does It Differ From Harness Engineering?
DeepHub IMBA
DeepHub IMBA
Jul 24, 2026 · Operations

Avoid Repeating Microservice Governance Pitfalls in AI Agent Management

The article analyzes how AI agents create hidden, "shadow" integrations that are harder to detect than traditional services, outlines five critical governance questions, and proposes a set of operational capabilities and principles—identity, observability, governance, lifecycle, and reuse—to responsibly scale AgentOps.

AI AgentGovernanceLifecycle
0 likes · 10 min read
Avoid Repeating Microservice Governance Pitfalls in AI Agent Management
DeepHub IMBA
DeepHub IMBA
Jul 23, 2026 · Artificial Intelligence

DecentMem Dual-Pool Memory Halves Token Use and Boosts Collaboration

DecentMem replaces the shared memory of large‑language‑model multi‑agent systems with a decentralized dual‑pool design—an exploitation pool for proven strategies and an exploration pool for novel ideas—driven by an online router, achieving up to 49% token savings, 23.8% accuracy gains and faster self‑evolution.

DecentMemLLM-as-Judgedual‑pool memory
0 likes · 12 min read
DecentMem Dual-Pool Memory Halves Token Use and Boosts Collaboration