Skip to content
Tagged articles

open-source benchmark

2 articles · Page 1 of 1
Machine Heart
Machine Heart
Oct 31, 2026 · Artificial Intelligence

Google's CLASHarness Benchmarks 15 LLMs on Multi-Agent Conflict in Computer Use

Google's CLASHarness evaluates 15 leading LLMs on 600 multi-agent conflict tasks with 4K visual evidence, revealing top models achieve only 25–28% end-to-end pass rates despite 55–67% per-step scores, and that visual verification is critical for detecting teammate deception.

CLASHarnessGoogle ResearchLLM benchmarking
0 likes · 13 min read
Google's CLASHarness Benchmarks 15 LLMs on Multi-Agent Conflict in Computer Use
Tencent Technical Engineering
Tencent Technical Engineering
Jul 16, 2025 · Artificial Intelligence

Introducing A.S.E: The First Project‑Level AI Code Generation Security Evaluation Framework

The A.S.E (AI Code Generation Security Evaluation) framework provides a comprehensive, project‑level benchmark for assessing the safety, quality, and stability of AI‑generated code across multiple languages and vulnerability types, helping developers and researchers evaluate and improve large language model coding assistants.

AI code generationopen-source benchmarksecurity evaluation
0 likes · 7 min read
Introducing A.S.E: The First Project‑Level AI Code Generation Security Evaluation Framework