BestHub
Sign in
Tagged articles

Agent benchmarks

6 articles · Page 1 of 1
Old Zhang's AI Learning
Old Zhang's AI Learning
Oct 17, 2026 · Artificial Intelligence

DeepSeek-V4.1-Flash-1017: Flash Model Matches Flagships on Agent Benchmarks, Cuts KV Cache 4x

DeepSeek releases V4.1-Flash-1017, a flash-tier model that outperforms flagship competitors on key agent benchmarks like DeepSWE and Automation-Bench while reducing KV cache to 1/4 of its predecessor via CSA2 sparse attention and FP4 quantization, and adds native multimodal support, adjustable reasoning intensity, and a new Search & Fetch API for real-time web access.

Agent benchmarksCSA2 sparse attentionDeepSeek
0 likes · 6 min read
DeepSeek-V4.1-Flash-1017: Flash Model Matches Flagships on Agent Benchmarks, Cuts KV Cache 4x
Machine Heart
Machine Heart
Sep 16, 2026 · Artificial Intelligence

Why Agents Struggle to Self-Evolve: Three Benchmarks for True Recursive Improvement

ByteDance Seed and collaborators introduce ASPIRE, S³Gym, and HarnessDev benchmarks to study how agents learn from vague goals, self-evaluate actions, and persist improvements, revealing that current agents overfit to proxy feedback and fail to convert self-judgment into lasting capability gains.

AI AgentsASPIREAgent benchmarks
0 likes · 11 min read
Why Agents Struggle to Self-Evolve: Three Benchmarks for True Recursive Improvement
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Sep 8, 2026 · Artificial Intelligence

Strong Model ≠ Strong Agent: PolyWorkBench Benchmarks Cross-Lingual Long-Horizon Workflows

PolyWorkBench introduces 67 cross-lingual long-horizon workflow tasks across 5 domains and 10 languages, revealing that top models like Claude Opus 4.8 show 22.5% performance variance across agent harnesses and significant drops on commerce tasks and low-resource languages due to language understanding and cross-lingual coordination errors.

Agent HarnessAgent benchmarksClaude Opus
0 likes · 10 min read
Strong Model ≠ Strong Agent: PolyWorkBench Benchmarks Cross-Lingual Long-Horizon Workflows
Design Hub
Design Hub
Sep 4, 2026 · Artificial Intelligence

Major AI Outages Coincide with GPT-6 Astra and Claude Fable 5.1 Launches

On September 3, major AI services including Claude, Grok, ChatGPT, and Codex suffered simultaneous but unrelated outages, while OpenAI launched GPT-6 Astra with 105k-token context and 2.5x pricing, and Anthropic released Claude Fable 5.1 with cheaper caching; the article argues AI has become critical infrastructure requiring robust reliability engineering and cross-vendor fallback strategies.

AI ReliabilityAI infrastructureAI outages
0 likes · 14 min read
Major AI Outages Coincide with GPT-6 Astra and Claude Fable 5.1 Launches
PaperAgent
PaperAgent
Aug 25, 2026 · Artificial Intelligence

A New Paradigm for Teaching Agents Tools: Insights from ACL 2026 ToolCPT

ToolCPT demonstrates that embedding real‑world tool knowledge during LLM pre‑training, rather than fine‑tuning, dramatically improves agent performance, using a mined corpus of 5.1 million proxy tools, detailed playbooks, and a 10 % tool‑data mix that yields up to 7.15‑point gains on benchmark tasks.

ACL 2026Agent benchmarksLLM agents
0 likes · 8 min read
A New Paradigm for Teaching Agents Tools: Insights from ACL 2026 ToolCPT