OpenRouter September AI Agent Rankings: Hermes Leads, DeepSeek Harness Enters Top 10

OpenRouter released its September 2024 App & Agent Rankings, measuring real-world adoption by tracking token consumption on the OpenRouter platform rather than synthetic benchmarks like SWE‑bench or WebDev Arena. The ranking reflects which agents are actively used for day‑to‑day development work, not underlying model capability.

Ranking Methodology

The ranking is based solely on the volume of tokens generated by each public App or Agent on OpenRouter. It does not reflect the underlying model's benchmark performance, nor does it equate to model API call volumes. For model‑level comparisons, the article points to Arena (https://arena.ai/leaderboard/text/expert) and Artificial Analysis (https://artificialanalysis.ai/leaderboards/models).

Top 1‑10 Agents

Hermes Agent – Nous Research's open‑source self‑evolving agent with cross‑session memory, Skills, and 40+ tool calls.

Claude Code – Anthropic's official coding agent that understands entire codebases, edits, tests, and runs commands.

Kilo Code – Open‑source AI coding agent supporting VS Code, JetBrains, and CLI environments.

Cline – IDE‑native open‑source coding agent capable of autonomous file edits, command execution, and tool use.

Freebuff – Ad‑subsidized AI coding service aimed at lowering model costs for developers.

pi – Highly customizable personal coding agent focused on building individual development workflows.

omp – CLI‑oriented agent connecting models, command line, and dev tools for terminal‑centric workflows.

DeepSeek Harness – DeepSeek's open‑source agent harness coordinating models, context, tool calls, and task execution.

OpenClaw – General‑purpose personal AI agent integrating with chat apps, browsers, and terminals.

Codex – OpenAI's software engineering agent that comprehends codebases, modifies code, runs tests, and completes dev tasks.

Top 11‑20 Agents

Framer – AI no‑code website builder using natural language for design and generation.

ZCode – Zhipu's integrated coding agent covering planning, coding, review, and deployment.

HighLevel – Marketing‑focused SaaS platform combining CRM, lead gen, and marketing automation.

Nous Research API – Model API platform serving Nous Research's models.

ISEKAI ZERO – AI role‑play adventure game platform with virtual characters.

Hello Minds – Ethoswarm‑driven AI role‑play and creation platform.

Portkey AI – AI gateway and control plane offering model routing, monitoring, governance, and observability.

Descript – AI audio/video editing platform for video, podcasts, transcription, and text‑based editing.

Lemonade – AI tools for Roblox creators assisting game content and development.

Cursor – AI‑native code editor integrating code understanding, generation, and agent capabilities directly into the IDE.

Top 21‑30 Agents

Janitor AI – AI role‑play chat platform with custom characters and long‑form immersive dialogue.

OpenHands – Open‑source software development agent that runs commands, edits code, browses the web, and calls APIs.

Open WebUI – Open‑source self‑hosted LLM interface connecting to Ollama and various model APIs.

Zed Editor – High‑performance, collaborative AI code editor emphasizing native development experience.

Strix – Developer‑focused AI coding tool for generation, analysis, and engineering tasks.

HackerAI – Security‑oriented AI agent for vulnerability discovery and penetration testing.

Command Code – AI programming tool for code generation, project modification, and development automation.

LangChain – Mainstream LLM application framework for building agents, RAG, and tool‑calling systems.

Sahasra – Creator‑focused digital product storefront for content sales and monetization.

Craft – AI RPG creation and play platform generating characters, worlds, and interactive game content.

Top 31‑40 Agents

Zoo Code – GitHub open‑source AI coding agent for code understanding, generation, and automated development.

Mira – Telegram‑native AI assistant that executes tasks directly in chat.

Ito – Agentic QA automation platform that actually runs and operates applications to find issues.

GDevelop – Low‑code game engine with AI‑assisted design and production.

SillyTavern – Advanced open‑source LLM frontend for role‑play and multi‑character dialogue.

claude‑mem – Claude Code memory plugin that auto‑saves context and continues cross‑session project memory.

Cheaper Inference – Low‑cost model inference API service for developers.

websim – AI web generation and simulation platform creating interactive sites/apps from natural language.

Peezy Gateway – Agent‑focused gateway connecting models, tools, and backend capabilities.

OceanAPI – Developer API platform providing model or data interfaces for applications.

Top 41‑50 Agents

CodeGPT – AI coding tool offering code Q&A, generation, development assistance, and agent features.

Proto Agent – General‑purpose AI agent combining models and tools for multi‑step complex tasks.

Roo Code – VS Code open‑source multi‑mode coding agent supporting coding, debugging, and automation.

ale‑evol – Experimental project exploring frontier model applications and evolution of new AI workflows.

Studs.gg – AI Roblox game generation platform for rapid content creation and iteration.

Halluna – AI role‑play chat platform with custom characters and immersive virtual interaction.

pre.dev‑agent – Software development AI agent participating in code analysis, generation, and engineering tasks.

Sophia's LoreBary – AI role‑play creation and organization tool for managing characters, worlds, and lore.

goose – Open‑source general AI agent invoking tools and models for development and automation.

HammerAI – Free AI role‑play chat platform supporting creation of various virtual characters.

Top 51‑60 Agents

Qwen Code – Alibaba Qwen's command‑line AI coding tool for terminal development and code tasks.

MavenBio – Life‑science data and AI platform for professional biological data processing and analysis.

HeyDitto – AI assistant and productivity tool for information processing and daily task automation.

mimocode – Xiaomi MiMo's AI coding tool for code generation and software development.

extra.email – AI‑native email tool designed around email organization, processing, and personal workflow.

Shapes Sandbox Gateway – Social agent platform sandbox gateway for connecting and testing AI characters and services.

ChainPatrol – Web3 security platform monitoring malicious links, phishing sites, and scam risks.

Pocket AI – Lightweight AI assistant covering Q&A, content processing, and everyday AI scenarios.

LOVE – Natura Umana lab's experimental AI project exploring new human‑AI interaction modes.

Chub AI – AI role‑play chat platform with character cards, world‑building, and long‑form immersive dialogue.

Key Takeaways

The leaderboard is dominated by coding/terminal/IDE agents, indicating that developer‑focused tooling drives the highest token consumption on OpenRouter.

Open‑source agents (Hermes, Kilo Code, Cline, OpenHands, etc.) compete directly with commercial offerings from Anthropic, OpenAI, and DeepSeek.

Token usage reflects real‑world adoption, not model quality; a high rank means the agent is actively used, not necessarily that its underlying model is "best."

Reference Data

Arena expert leaderboard: https://arena.ai/leaderboard/text/expert

Artificial Analysis model leaderboards: https://artificialanalysis.ai/leaderboards/models

Code example

来源丨
经授
权转自 菜鸟教程（ID：runoob）
作者
丨
RUNOOB