When Your Team Is All Agents: How Product Management Must Evolve
The article analyses why using instant‑messaging groups to orchestrate multiple AI agents cannot scale to dozens or hundreds of agents, proposes a four‑layer ICSE architecture, compares three agent‑to‑agent communication models, and outlines the new governance, design, and roadmap responsibilities that product managers will need to master.
Why "Putting Agents into IM" Won’t Scale
Most current multi‑agent solutions attach agents to WhatsApp, Slack, WeChat, or Email and rely on group chats, private chats, and @mentions, with a human acting as the overall scheduler. This approach is cheap and familiar, but it suffers from five structural defects that make it unsuitable for large‑scale, core‑process automation such as procurement, customer service, R&D, or finance.
Human operators can only supervise a handful of agents in a chat; managing 30 or 300 agents is infeasible.
Chat‑based coordination provides no reliable state, audit trail, or fine‑grained access control.
Natural‑language messages are imprecise and hard to verify at scale.
Scaling the chat model creates excessive cognitive friction and operational risk.
Chat cannot serve as a durable control plane for policy enforcement, delegation, or escalation.
This is a transition, not a final solution.
The Future Shape: A Four‑Layer ICSE Model
I call the emerging architecture the “ICSE model” – Intent, Control, Service, Event. The model’s purpose is not to prescribe the exact function of each layer, but to expose a core shift: humans will view high‑level summaries and key nodes, while agents collaborate through structured events and state machines.
Layer I – Intent
Humans will no longer issue a single prompt. Instead they will provide a structured intent that includes goal, scope, budget, deadline, requirements, and risk policies. Example:
Goal: Evaluate market entry opportunity in Southeast Asia Scope: Indonesia, Vietnam Budget: $3,000 Deadline: 48 hours Requirements: All external data must be traceable; decisions must be labeled as fact, inference, or recommendation; contracts must be approved by a human.
This “natural‑language + policy parameters” mix makes the command precise without adding unnecessary complexity.
Layer C – Control (The Core Plane)
The Control Plane is the system’s brain. It contains at least ten modules that together provide identity, capability registration, permission & policy, delegation, state & memory, event bus, verification, observability, escalation, and audit & compliance.
Identity: Agent identity and trust level.
Capability Registry: What each agent can do.
Permission & Policy: Access boundaries.
Delegation Engine: Task decomposition, routing, and delegation.
State & Memory: Shared state and long‑term memory.
Event Bus: Asynchronous messaging and error broadcasting.
Verification Layer: Output validation and cross‑checking.
Observability: Execution graph, cost, success‑rate tracking.
Escalation: Upgrade rules and rollback strategies.
Audit & Compliance: Responsibility chain and regulatory trace.
Product managers’ biggest opportunity: Build products around these ten modules rather than around a simple chat‑based “talking” agent.
Agent‑to‑Agent Communication Models
Three models will coexist long‑term:
Chat‑style (display language): Human‑readable natural‑language messages for summaries and explanations.
Structured execution language: Machine‑readable task descriptions, state transitions, permission tokens, artifact URLs, error codes, and audit logs.
Hybrid: Agents translate human intents into structured execution commands.
Just as the web separates human‑visible HTML from machine‑visible HTTP/JSON, future agent systems will separate presentation from execution.
Human Role Shift: From Operator to Policy Maker
Today humans are in‑the‑loop for every step; tomorrow they will be on‑the‑loop, defining policies that let agents act autonomously while intervening only when policies trigger.
Key policy categories include delegation policy, access policy, review policy, escalation policy, evidence policy, and rollback policy. Mastering these policies is the new competitive edge.
What Changes and What Remains
Newly added steps (9): Capability discovery, task routing & delegation, fine‑grained permission allocation, shared state management, output verification, anomaly escalation, audit & accountability, rollback & recovery, and agent performance management.
Replaced steps (5): Information shuffling, basic coordination, pre‑approval processing, low‑risk routine decisions, and partial management coordination.
Irreplaceable steps (5): Goal definition, constraint setting, exception adjudication, responsibility assignment, and organization design.
Roadmap
The evolution is split into three phases: 1‑3 years (prototype control plane, policy research), 3‑5 years (productizing the ICSE layers, building governance tooling), and 5‑10 years (full‑scale deployment, industry‑wide standards).
Fundamental Constraints
Permission constraints: Agents cannot have unlimited system access.
Responsibility constraints: Every error must be traceable to an accountable entity.
Audit constraints: No audit trail means the system cannot be used in core processes.
Cost constraints: More agents do not automatically reduce cost.
Organizational constraints: Enterprises will not rewrite processes and culture solely because a technology is feasible.
Practical Takeaways for Product Managers
Junior PMs: Learn the ICSE architecture, study emerging standards (MCP, Agent Protocol), and follow AgentOps/LangSmith observability tools.
Mid‑level PMs: Identify which of the nine new steps appear first in your product, design capability statements, permission models, and audit plans.
Senior PMs / Product Leaders: Build a prototype control plane, define organization‑wide delegation and escalation policies, and evaluate ROI for each automation opportunity instead of chasing demos.
Finally, remember the core message: the future is not about better prompt engineering; it is about policy engineering . Whoever learns to write robust policies, assign permissions, and implement audit for agents will secure the next era’s entry ticket.
PMTalk Product Manager Community
One of China's top product manager communities, gathering 210,000 product managers, operations specialists, designers and other internet professionals; over 800 leading product experts nationwide are signed authors; hosts more than 70 product and growth events each year; all the product manager knowledge you want is right here.
How this landed with the community
Was this worth your time?
0 Comments
Thoughtful readers leave field notes, pushback, and hard-won operational detail here.
