Tagged articles

Benchmark

1150 articles · Page 3 of 12
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jul 9, 2026 · Artificial Intelligence

Grok 4.5 Matches Opus 4.7 While Cutting Token Use to One‑Quarter

xAI’s newly released Grok 4.5, a 1.5 T‑parameter MoE LLM, matches Claude Opus 4.7 on benchmark scores while delivering up to 80 TPS inference, cutting token costs by more than 60 % and reducing token usage to a quarter of Opus, thanks to revamped training pipelines and massive GPU resources.

AI modelAgentBenchmark
0 likes · 10 min read
Grok 4.5 Matches Opus 4.7 While Cutting Token Use to One‑Quarter
PaperAgent
PaperAgent
Jul 9, 2026 · Artificial Intelligence

Microsoft Unveils Two AI‑Powered Research Automation Papers

Microsoft Research recently released two papers—ResearchStudio‑Idea and ResearchStudio‑Reel—that introduce a skill‑based framework for AI‑driven research automation, tackling the challenges of generating novel, evidence‑grounded ideas and producing editable posters, videos, and bilingual blogs, with benchmark results that surpass human authors and existing tools.

AI research automationBenchmarkIdeaSpark
0 likes · 13 min read
Microsoft Unveils Two AI‑Powered Research Automation Papers
IT Services Circle
IT Services Circle
Jul 9, 2026 · Artificial Intelligence

Musk Unveils Grok 4.5: First Benchmarks Reveal Its Strengths and Limits

SpaceXAI's Grok 4.5 arrives ahead of OpenAI's GPT‑5.6 Sol, delivering terminal‑bench scores of 83.3% and multilingual code‑fixing at 78.0%, while offering a striking $2/$6 per‑million‑token price and 80 TPS inference speed, yet still lagging behind top rivals on the hardest SWE‑Bench Pro tasks.

AI coding agentBenchmarkGrok 4.5
0 likes · 6 min read
Musk Unveils Grok 4.5: First Benchmarks Reveal Its Strengths and Limits
PaperAgent
PaperAgent
Jul 8, 2026 · Artificial Intelligence

Why Agent Skills Need Self‑Evolution: A Survey of 19 Frameworks and 10 Benchmarks

This survey from Rutgers and UNC Charlotte systematically reviews 19 agent‑skill evolution methods and 10 evaluation benchmarks, revealing critical gaps such as the lack of longitudinal tracking, binary pass/fail metrics, and one‑time security checks, and highlighting how separating diagnosis from rewrite improves cross‑task performance.

AgentBenchmarkSelf-Improving AI
0 likes · 9 min read
Why Agent Skills Need Self‑Evolution: A Survey of 19 Frameworks and 10 Benchmarks
Alipay Experience Technology
Alipay Experience Technology
Jul 7, 2026 · Frontend Development

High‑Performance Streaming Markdown Renderer for Multi‑Platform Mini‑Programs (x‑markdown‑mini)

The article analyzes the shortcomings of existing mini‑program Markdown renderers—conversion overhead, streaming performance, and extensibility—then presents three strategies employed by @ant-design/x‑markdown‑mini to eliminate the HTML middle layer, cache stable blocks with incremental patching, and provide isolated, plug‑in‑based syntax and component extensions, achieving up to 4.4× faster conversion on long texts.

BenchmarkStreamingant-design
0 likes · 12 min read
High‑Performance Streaming Markdown Renderer for Multi‑Platform Mini‑Programs (x‑markdown‑mini)
PaperAgent
PaperAgent
Jul 6, 2026 · Artificial Intelligence

Why Agent Memory Can Backfire: Insights from MemSyco’s New Benchmark

The article introduces MemSyco-Bench, a systematic benchmark that reveals how long‑term memory in LLM agents can amplify sycophancy, cause accuracy drops, and expose the need for careful memory utilization rather than mere retrieval.

BenchmarkLLMMemory Utilization
0 likes · 9 min read
Why Agent Memory Can Backfire: Insights from MemSyco’s New Benchmark
Kuaishou Tech
Kuaishou Tech
Jul 6, 2026 · Artificial Intelligence

ICML 2026 Spotlight: MetaphorVU – The First Benchmark for Metaphorical Video Understanding

The MetaphorVU project introduces the first systematic benchmark for metaphor video understanding, builds a taxonomy of eight metaphor types from billions of real short videos, evaluates 11 multimodal LLMs revealing a 20‑point gap to human performance, and proposes MetaphorBoost—a knowledge‑graph‑enhanced inference framework that consistently improves metaphor comprehension across models.

BenchmarkICML 2026MetaphorBoost
0 likes · 14 min read
ICML 2026 Spotlight: MetaphorVU – The First Benchmark for Metaphorical Video Understanding
Machine Heart
Machine Heart
Jul 6, 2026 · Artificial Intelligence

Which LLM Is the True AI Software Engineer? Introducing the First Living Visual Spec‑to‑App Benchmark

VISTA is a new end‑to‑end benchmark that evaluates coding agents on their ability to build complete, runnable web applications from product requirements and Figma designs, revealing trends in model‑plus‑harness competition, performance gaps, and trade‑offs among quality, speed, and cost.

AI coding agentsBenchmarkLLM
0 likes · 16 min read
Which LLM Is the True AI Software Engineer? Introducing the First Living Visual Spec‑to‑App Benchmark
Su San Talks Tech
Su San Talks Tech
Jul 5, 2026 · Artificial Intelligence

Why PaddleOCR Is the Must‑Use Open‑Source OCR Tool

PaddleOCR, an open‑source OCR library from Baidu, offers high‑precision multilingual text extraction, lightweight models, and a modern pipeline, with benchmarks showing superior accuracy and speed over Tesseract and EasyOCR, and provides detailed installation, usage, and Java integration guides for developers.

BenchmarkJava integrationOCR
0 likes · 23 min read
Why PaddleOCR Is the Must‑Use Open‑Source OCR Tool
Data Party THU
Data Party THU
Jul 5, 2026 · Artificial Intelligence

Is One‑Prompt Image Generation Obsolete? Meet GenEvolve’s Tool‑Orchestrated Agents

GenEvolve introduces a self‑evolving image‑generation agent that orchestrates search, reference retrieval, and knowledge‑query tools into a prompt‑reference program, training via teacher‑student SFT and visual‑experience self‑distillation to achieve higher KScore on open‑source and strong generators.

Agentic AIBenchmarkSelf-Evolution
0 likes · 9 min read
Is One‑Prompt Image Generation Obsolete? Meet GenEvolve’s Tool‑Orchestrated Agents
DataFunTalk
DataFunTalk
Jul 5, 2026 · Artificial Intelligence

Why Compressing Prompts Can Raise Costs 2.7× – Insights from the Caveman Token Trap Paper

Although the Caveman plugin claims up to 65% token reduction, independent testing shows real‑world coding sessions only save 4‑10% and that aggressive input compression can actually increase costs by up to 2.7×, because token consumption is dominated by code generation, file reads, and multi‑step Agentic workflows; the article dissects benchmarks, Uber’s budget crisis, and the practical limits of prompt compression.

AI agentsBenchmarkCaveman
0 likes · 12 min read
Why Compressing Prompts Can Raise Costs 2.7× – Insights from the Caveman Token Trap Paper
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jul 3, 2026 · Artificial Intelligence

Why AI Agents Are Unstable: A Systematic Benchmark Dissects Their Weaknesses

LiveClawBench, a new benchmark for LLM agents, reveals that task domain explains only a small fraction of performance variance while a detailed complexity profile accounts for much more, exposing why even state‑of‑the‑art agents remain unstable on personal‑assistant workflows and offering a diagnostic framework to pinpoint and address specific failure modes.

AI AgentBenchmarkComplexity Analysis
0 likes · 17 min read
Why AI Agents Are Unstable: A Systematic Benchmark Dissects Their Weaknesses
Machine Heart
Machine Heart
Jul 3, 2026 · Artificial Intelligence

What Happens When a Code Agent Faces 1,000+ Files? CoDA‑Bench Exposes the Real Bottleneck

CoDA‑Bench, a new benchmark from RUC, places code agents in a sandbox containing over a thousand heterogeneous data files and requires them to locate the correct dataset, write analysis code, and produce answers, revealing that current agents achieve only about 61 % accuracy overall and struggle mainly with data discovery rather than code generation.

Artificial IntelligenceBenchmarkCode Agent
0 likes · 9 min read
What Happens When a Code Agent Faces 1,000+ Files? CoDA‑Bench Exposes the Real Bottleneck
IT Services Circle
IT Services Circle
Jul 3, 2026 · Artificial Intelligence

Ornith-1.0: The New Open‑Source Agentic Coding King with MIT License

Ornith-1.0, an open‑source model family released under the MIT license, tops multiple Agentic Coding benchmarks (SWE‑Bench Verified 82.4, Terminal‑Bench 77.5, etc.), spans from 9B to 397B parameters, and introduces joint reinforcement‑learning optimization of scaffold and solution to reshape AI‑assisted programming.

AI coding agentsBenchmarkOrnith-1.0
0 likes · 13 min read
Ornith-1.0: The New Open‑Source Agentic Coding King with MIT License
Machine Heart
Machine Heart
Jul 3, 2026 · Artificial Intelligence

Why AI Agents Are Unstable: A Systematic Benchmark Dissects Their Weaknesses

LiveClawBench, a new benchmark for LLM agents, reveals that task domain explains only a small fraction of performance variance while a detailed complexity profile accounts for much more, and it uses full‑stack mock workflows and trajectory analysis to diagnose why even top models remain unstable in personal‑assistant tasks.

AI AgentBenchmarkComplexity Analysis
0 likes · 17 min read
Why AI Agents Are Unstable: A Systematic Benchmark Dissects Their Weaknesses
Java Backend Technology
Java Backend Technology
Jul 3, 2026 · Artificial Intelligence

Which Chinese Multimodal LLM Is the Most Efficient in Real‑World Use?

The article benchmarks three domestic multimodal large models—Step 3.7 Flash, Qwen 3.6‑flash, and MiniMax M3—across two production‑oriented scenarios, measuring quality, latency, and token cost, and concludes that Step 3.7 Flash consistently offers the best speed‑cost trade‑off while maintaining reliable output.

BenchmarkLarge Language ModelsMiniMax M3
0 likes · 11 min read
Which Chinese Multimodal LLM Is the Most Efficient in Real‑World Use?
AI Engineering
AI Engineering
Jul 2, 2026 · Artificial Intelligence

Sidecar Routing Slashes AI Code Generation Costs 35% While Keeping Performance

Devin Fusion’s hybrid model routing, which pairs a high‑end main agent with a low‑cost Sidekick and employs in‑session dynamic routing and shared caches, reduces AI‑assisted coding expenses by about 35% while maintaining comparable performance, as demonstrated by multiple FrontierCode benchmarks and real‑world case studies.

AI codingBenchmarkDevin Fusion
0 likes · 8 min read
Sidecar Routing Slashes AI Code Generation Costs 35% While Keeping Performance
Black & White Path
Black & White Path
Jul 2, 2026 · Information Security

China’s Mysterious AI Security Team “MopMonk” Shocks the Industry with a 73% Success Rate

A previously unknown Chinese AI security group called MopMonk, operating without a website or corporate backing, posted a GitHub report that achieved a 73.1% vulnerability‑exploitation success rate, ranked seventh globally in the UC Berkeley‑run CyberGym benchmark, and demonstrated novel memory‑based multi‑agent techniques that signal China’s rising AI security prowess.

AI securityBenchmarkCyberGym
0 likes · 9 min read
China’s Mysterious AI Security Team “MopMonk” Shocks the Industry with a 73% Success Rate
AI Architecture Path
AI Architecture Path
Jul 2, 2026 · Artificial Intelligence

How Cognee’s Single‑Postgres AI Memory Outperforms Traditional RAG (23K+ Stars)

Cognee is an open‑source AI memory platform that combines vector embeddings and knowledge‑graph reasoning on a single Postgres database, delivering dual retrieval, automatic ontology generation, and BEAM benchmark scores up to 0.8—more than double traditional RAG—while offering multi‑language SDKs and flexible deployment options.

AI memoryBenchmarkPostgres
0 likes · 15 min read
How Cognee’s Single‑Postgres AI Memory Outperforms Traditional RAG (23K+ Stars)
Machine Heart
Machine Heart
Jul 1, 2026 · Artificial Intelligence

From QA to Experiments: How SciAgentGym Puts LLMs into Real Scientific Workflows

SciAgentGym introduces a type‑safe, reproducible, and extensible environment for evaluating large language model agents on multi‑step scientific tool use, revealing that while tool integration raises overall success rates, performance drops sharply on long‑chain tasks, and that training on executable trajectories (SciForge) can substantially improve results.

AIBenchmarkLLM
0 likes · 11 min read
From QA to Experiments: How SciAgentGym Puts LLMs into Real Scientific Workflows
Su San Talks Tech
Su San Talks Tech
Jul 1, 2026 · Artificial Intelligence

Which Domestic Multimodal LLM Is the Most Efficient for Production?

The article benchmarks three Chinese multimodal large models—Step 3.7 Flash, MiniMax M3, and Qwen 3.6‑flash—across two real‑world tasks, measuring output quality, API latency, and token cost, and concludes that Step 3.7 Flash consistently offers the best speed‑cost trade‑off for production use.

API latencyBenchmarkMiniMax M3
0 likes · 10 min read
Which Domestic Multimodal LLM Is the Most Efficient for Production?
Bilibili Tech
Bilibili Tech
Jul 1, 2026 · Artificial Intelligence

FATE Series (SABER & CASTER) Debuts at ACL 2026: Advanced LLM Reasoning

At ACL 2026 in San Diego, Bilibili’s tech team introduced the FATE series—SABER, which reduces overthinking in LLMs with a token‑budgeted switchable training, and CASTER, a community‑aware evaluation system built on Social‑CoT and the MEDEA framework that outperforms GPT‑5.2 and Claude‑4.5‑Opus on the new CASTER‑Bench, while also promoting the B‑UP talent recruitment program.

BenchmarkLLMMultimodal Evaluation
0 likes · 10 min read
FATE Series (SABER & CASTER) Debuts at ACL 2026: Advanced LLM Reasoning
Machine Heart
Machine Heart
Jul 1, 2026 · Artificial Intelligence

Beyond One-Word Prompts: How the Open-Source GenEvolve Agent Uses Tool Orchestration for Image Generation

GenEvolve, an open-source self-evolving image-generation agent, orchestrates search, image retrieval, and knowledge tools into a prompt-reference program, handling knowledge-anchored and quality-anchored tasks; experiments show it outperforms baseline generators on both standard and strong renderers, with open data and code released.

Agentic AIBenchmarkGenEvolve
0 likes · 9 min read
Beyond One-Word Prompts: How the Open-Source GenEvolve Agent Uses Tool Orchestration for Image Generation
Meituan Technology Team
Meituan Technology Team
Jul 1, 2026 · Artificial Intelligence

LongCat‑2.0: Training a Trillion‑Parameter Model on a Domestic 50k‑Card Cluster

Meituan’s LongCat‑2.0, a 1.6‑trillion‑parameter MoE model trained on a 50,000‑card domestic cluster, supports 1 M‑token context, uses Sparse Attention, zero‑compute experts and MOPD architecture, achieving over 1 T tokens/day throughput, 1.5× MFU efficiency, and top‑ranked scores on coding and agent benchmarks.

AI modelBenchmarkLongCat-2.0
0 likes · 10 min read
LongCat‑2.0: Training a Trillion‑Parameter Model on a Domestic 50k‑Card Cluster
Machine Heart
Machine Heart
Jun 30, 2026 · Artificial Intelligence

Why One Extra Loop Is All a 7B Model Needs – LoopCoder‑v2’s Surprising Sweet Spot

LoopCoder‑v2, a 7B LLM, gains a massive boost on SWE‑bench Verified (43.0 → 64.4) by adding just one test‑time loop, while additional loops cause performance to collapse, a finding explained through detailed probe analysis of hidden‑state convergence, attention re‑routing, and a constant “position‑mismatch tax”.

AI model efficiencyBenchmarkLLM looping
0 likes · 8 min read
Why One Extra Loop Is All a 7B Model Needs – LoopCoder‑v2’s Surprising Sweet Spot
Data Party THU
Data Party THU
Jun 30, 2026 · Artificial Intelligence

Do Video Generation Models Really Reason? A 303‑Question Benchmark Exposes Their Reasoning Gaps

The article introduces the MME‑CoF‑Pro benchmark, which uses 303 carefully crafted video‑reasoning samples across 16 categories to evaluate seven leading video generation models, revealing that current models lack true reasoning ability, that prompting can both help and hurt coherence, and that the new Reasoning Score aligns well with human judgments.

Artificial IntelligenceBenchmarkMME-CoF-Pro
0 likes · 11 min read
Do Video Generation Models Really Reason? A 303‑Question Benchmark Exposes Their Reasoning Gaps
Machine Heart
Machine Heart
Jun 30, 2026 · Artificial Intelligence

LiveWorld: A New Paradigm for Video World Models that Keeps Off‑Screen Worlds Evolving

LiveWorld introduces a novel video world modeling paradigm that explicitly separates world evolution from observation rendering, enabling objects and events to continue evolving even when they leave the camera view; extensive experiments on the new LiveBench benchmark show substantial gains over prior camera‑controllable models.

AI researchBenchmarkLiveWorld
0 likes · 13 min read
LiveWorld: A New Paradigm for Video World Models that Keeps Off‑Screen Worlds Evolving
Machine Heart
Machine Heart
Jun 29, 2026 · Artificial Intelligence

Open‑Source AI‑Infra Ops Agent Benchmark Powered by Hundreds of Billions of Real Data

The article introduces AISHPerf, the first open‑source benchmark for AI‑infra operations agents built on nearly a hundred‑billion real‑world ops records, detailing its data pipeline, multi‑layer coverage, evaluation metrics, experimental results that show current models lag behind human experts, and future plans to expand and refine the benchmark.

AI OpsBenchmarkGPU cluster
0 likes · 16 min read
Open‑Source AI‑Infra Ops Agent Benchmark Powered by Hundreds of Billions of Real Data
Machine Heart
Machine Heart
Jun 29, 2026 · Artificial Intelligence

Why AI Assistants Shouldn't Just Wait for Questions: Insights from Tsinghua’s EgoIntrospect and IPIBench

The article reviews two recent Tsinghua studies—EgoIntrospect and IPIBench—that shift AI assistants from passive Q&A toward real‑time, user‑centric understanding and proactive interaction, detailing new egocentric datasets, benchmark tasks, and an IPI‑Agent framework for timely, context‑aware assistance in wearable and embodied devices.

AI AssistantsBenchmarkegocentric dataset
0 likes · 9 min read
Why AI Assistants Shouldn't Just Wait for Questions: Insights from Tsinghua’s EgoIntrospect and IPIBench
Java Companion
Java Companion
Jun 29, 2026 · Artificial Intelligence

FastCode Beats Claude Code: 3× Faster and 50% Cheaper Codebase Understanding

FastCode, an open‑source code‑base understanding framework from HKU, lets large language models read multi‑language repositories up to three times faster and at half the token cost compared with Cursor and Claude Code, offering map‑based indexing, cost‑aware querying, multi‑repo analysis, and seamless editor integration.

BenchmarkFastCodeLLM code analysis
0 likes · 11 min read
FastCode Beats Claude Code: 3× Faster and 50% Cheaper Codebase Understanding
James' Growth Diary
James' Growth Diary
Jun 27, 2026 · Artificial Intelligence

Why the Top‑Tier GPT‑5.6 Model Is Still Unavailable

GPT‑5.6 has been announced but, because of U.S. government intervention, its highest‑performance Sol ultra version remains inaccessible, even though benchmark tests show it already outperforms the previous Mythos model in coding and cybersecurity tasks.

AI modelBenchmarkCoding
0 likes · 4 min read
Why the Top‑Tier GPT‑5.6 Model Is Still Unavailable
Machine Heart
Machine Heart
Jun 27, 2026 · Artificial Intelligence

Do Video Generation Models Really Reason? A 303‑Question Benchmark Exposes Their Reasoning Gaps

The paper introduces the Reasoning Coherence metric and the MME‑CoF‑Pro benchmark—303 image‑text‑video samples across 16 reasoning categories—to evaluate seven leading video generation models, revealing that reasoning ability is largely independent of visual quality, that textual prompts often induce hallucinations, and that the new Reasoning Score aligns well with human judgments.

AI evaluationBenchmarkMME-CoF-Pro
0 likes · 10 min read
Do Video Generation Models Really Reason? A 303‑Question Benchmark Exposes Their Reasoning Gaps
Old Zhang's AI Learning
Old Zhang's AI Learning
Jun 27, 2026 · Artificial Intelligence

GPT-5.6 Unveiled: Massive Power, Tiered Pricing, and Limited Access

OpenAI's GPT-5.6 arrives with three tiered models (Sol, Terra, Luna), new max and ultra reasoning modes, benchmark breakthroughs in programming, biology, and security, extensive multi‑layer safety guards, a steep pricing structure, and a tightly controlled preview rollout.

AI modelBenchmarkGPT-5.6
0 likes · 11 min read
GPT-5.6 Unveiled: Massive Power, Tiered Pricing, and Limited Access
Machine Heart
Machine Heart
Jun 27, 2026 · Artificial Intelligence

GPT-5.6 Launch: Sol, Terra, Luna Beat Mythos Yet Stay Behind Paywall

OpenAI’s surprise preview of GPT‑5.6 introduces three tiered models—Sol, Terra and Luna—with Sol offering max and ultra modes that deliver top‑tier performance in programming, biology and cybersecurity benchmarks, lower pricing, a new prompt‑cache system, and a restricted rollout amid U.S. regulatory scrutiny.

AI safetyBenchmarkCerebras
0 likes · 7 min read
GPT-5.6 Launch: Sol, Terra, Luna Beat Mythos Yet Stay Behind Paywall
ITPUB
ITPUB
Jun 26, 2026 · Artificial Intelligence

Doubao Pro: AI Productivity for Only ¥68 – Unmatched Value and Performance

Doubao launches its Professional edition featuring the flagship 2.1 Pro model, a new office‑task mode, and tiered pricing starting at ¥68 per month, while benchmark tests show its coding and agent abilities rivaling GPT‑5.5 and surpassing competing subscription plans.

AI productivityBenchmarkChatGPT comparison
0 likes · 11 min read
Doubao Pro: AI Productivity for Only ¥68 – Unmatched Value and Performance
Su San Talks Tech
Su San Talks Tech
Jun 26, 2026 · Artificial Intelligence

Codex vs Claude Code: Which AI Coding Assistant Is Better for Your Workflow?

The article compares OpenAI's Codex and Anthropic's Claude Code across architecture, token efficiency, benchmark scores, feature sets, installation steps, and real‑world use cases, helping developers decide which tool aligns with their workflow, security preferences, and budget.

AI coding assistantBenchmarkClaude Code
0 likes · 16 min read
Codex vs Claude Code: Which AI Coding Assistant Is Better for Your Workflow?
Machine Heart
Machine Heart
Jun 26, 2026 · Artificial Intelligence

From Human‑View Video to AI‑Understanding: Peking University’s Artic Framework Boosts Real‑Time AI Video Assistants

The Artic framework redesigns real‑time video communication for AI assistants by integrating model‑aware bitrate adaptation, region‑focused encoding, and a degradation‑aware benchmark, achieving a 15.12% accuracy gain and a 135.31 ms latency reduction in realistic mobile uplink scenarios while incurring modest cost overhead.

AI video communicationBenchmarkadaptive bitrate
0 likes · 11 min read
From Human‑View Video to AI‑Understanding: Peking University’s Artic Framework Boosts Real‑Time AI Video Assistants
PaperAgent
PaperAgent
Jun 26, 2026 · Artificial Intelligence

13 Must-Read Agent Papers from Meituan for ICML'26

This article presents a curated list of thirteen recent research papers on generalist agents—covering visual memory, environment synthesis, value modeling, self‑verification, robustness benchmarks, high‑resolution video generation, long‑horizon world models, and alignment fine‑tuning—along with brief abstracts and links to the PDFs for the upcoming Meituan ICML'26 sharing sessions.

AIAgentBenchmark
0 likes · 16 min read
13 Must-Read Agent Papers from Meituan for ICML'26
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jun 25, 2026 · Artificial Intelligence

Introducing DeNovoSWE: The First Long‑Horizon Doc2Repo Training Set for Code Agents

DeNovoSWE, a newly released large‑scale dataset of 4,818 high‑quality document‑to‑repository tasks, uses a Divide‑and‑Conquer and Critic‑Repair pipeline to generate well‑organized, evaluation‑aligned specifications, and experiments show it boosts LLM code agents’ repository‑level generation performance from single‑digit to over 40% on benchmarks.

BenchmarkLLMcode agents
0 likes · 10 min read
Introducing DeNovoSWE: The First Long‑Horizon Doc2Repo Training Set for Code Agents
Machine Heart
Machine Heart
Jun 24, 2026 · Artificial Intelligence

AutoControl Arena: Enabling AI to Automatically Detect Frontier Risks

AutoControl Arena automatically synthesizes executable test environments that let researchers and developers uncover hidden AI agent risks in unknown tail scenarios, introduces the X‑BENCH benchmark with 70 scenarios across seven risk categories, reveals that stronger models exhibit more complex mis‑alignments, and validates its fidelity against real red‑team setups.

AI AlignmentAI safetyAgent risk evaluation
0 likes · 10 min read
AutoControl Arena: Enabling AI to Automatically Detect Frontier Risks
Machine Heart
Machine Heart
Jun 24, 2026 · Artificial Intelligence

From Pixels to Words: A Native Vision-Language Model Unifies Images and Video

The paper introduces NEO‑ov, a native vision‑language model that discards external visual encoders, feeding raw pixels directly into a unified transformer, and demonstrates competitive performance on image, multi‑image, and video tasks—including fine‑grained perception and spatial reasoning—while outlining its three‑stage training pipeline and current limitations.

BenchmarkMultimodalQwen
0 likes · 13 min read
From Pixels to Words: A Native Vision-Language Model Unifies Images and Video
Amap Tech
Amap Tech
Jun 23, 2026 · Artificial Intelligence

GrowLoop: Turning Subjective Dialogue Quality into a Rational Benchmark

GrowLoop proposes a self‑evolving loop that uses a few human seed annotations and large‑language‑model meta‑reflection to automatically generate and refine scoring rubrics and test questions for open‑domain dialogue, enabling reliable benchmarking where no fixed standard exists.

BenchmarkLLMReward Modeling
0 likes · 23 min read
GrowLoop: Turning Subjective Dialogue Quality into a Rational Benchmark
Machine Heart
Machine Heart
Jun 23, 2026 · Artificial Intelligence

Can VLA‑JEPA Achieve Robust Vision‑Language‑Action with Few Robot Trajectories and Lots of Human Video?

The article analyzes VLA‑JEPA, a JEPA‑style pre‑training framework that combines limited robot trajectories with abundant human video to build a latent world model for Vision‑Language‑Action tasks, showing improved robustness and high success rates across simulated and real‑robot benchmarks.

BenchmarkSelf-Supervised LearningVLA-JEPA
0 likes · 12 min read
Can VLA‑JEPA Achieve Robust Vision‑Language‑Action with Few Robot Trajectories and Lots of Human Video?
JD Tech Talk
JD Tech Talk
Jun 23, 2026 · Artificial Intelligence

From Q&A to Real‑Time Seeing and Speaking: JD’s World‑First Open‑Source JoyAI‑VL‑Interaction

JD’s open‑source JoyAI‑VL‑Interaction model transforms large‑language models from static question‑answering to continuous visual‑language interaction, enabling proactive judgment, instant responses, and intelligent task delegation, with benchmark win rates up to 87.9% against leading competitors and full stack code, model, and dataset released for real‑world deployment.

AI assistantBenchmarkJoyAI-VL-Interaction
0 likes · 9 min read
From Q&A to Real‑Time Seeing and Speaking: JD’s World‑First Open‑Source JoyAI‑VL‑Interaction
JD Cloud Developers
JD Cloud Developers
Jun 23, 2026 · Artificial Intelligence

From Q&A to Real‑Time Seeing & Speaking: JD’s First Open‑Source JoyAI‑VL‑Interaction

JD’s open‑source JoyAI‑VL‑Interaction transforms large‑model AI from static question‑answering to continuous, on‑scene observation, proactive judgment, and real‑time response, offering agent delegation and achieving up to 87.9% win rate against leading video assistants in live benchmarks.

AI assistantBenchmarkVision-Language Model
0 likes · 9 min read
From Q&A to Real‑Time Seeing & Speaking: JD’s First Open‑Source JoyAI‑VL‑Interaction
Weekly Large Model Application
Weekly Large Model Application
Jun 23, 2026 · Artificial Intelligence

Inside Artificial Analysis: Independent AI Voice Benchmarks for ASR, TTS, and Speech‑to‑Speech

Artificial Analysis provides an independent, reproducible benchmarking platform for voice AI, offering objective WER scores for ASR, Elo‑based blind‑listening scores for TTS, and three‑dimensional metrics for end‑to‑end speech dialogue, together with detailed methodology, top‑model rankings, and practical guidance for developers to choose the most suitable model and provider for their scenarios.

AI voice evaluationASRArtificial Analysis
0 likes · 14 min read
Inside Artificial Analysis: Independent AI Voice Benchmarks for ASR, TTS, and Speech‑to‑Speech
Geek Labs
Geek Labs
Jun 23, 2026 · Artificial Intelligence

Ponytail: An Open‑Source Tool That Cuts AI‑Generated Code Bloat

Ponytail is an open‑source assistant that trims AI‑generated code by up to 94%, reduces token consumption and cost, speeds up development by 27%, and maintains 100% safety through a six‑step decision ladder, as demonstrated in a Claude Code benchmark on a FastAPI + React project.

AI code generationBenchmarkClaude Code
0 likes · 6 min read
Ponytail: An Open‑Source Tool That Cuts AI‑Generated Code Bloat
Data Party THU
Data Party THU
Jun 22, 2026 · Artificial Intelligence

From Reasoning to Physical Execution: Peking University Papers Push LLMs Toward Fully Automated Labs

The article analyzes how two Peking University papers presented at ICML 2026 and ACL 2026 introduce BioProBench and BioProAgent to benchmark and enable large language models to safely perform complex wet‑lab experiments, achieving high physical compliance and integrating into a multi‑agent AI4S LAB platform.

AI for ScienceBenchmarkBioProAgent
0 likes · 7 min read
From Reasoning to Physical Execution: Peking University Papers Push LLMs Toward Fully Automated Labs
AI Programming Lab
AI Programming Lab
Jun 22, 2026 · Artificial Intelligence

How GLM‑5.2’s Success Reveals the Secret Behind Chinese Models Catching Up to Claude and GPT

The article analyzes GLM‑5.2’s surprising performance—ranking first in front‑end web design, surpassing Claude Opus on Code Arena, and leveraging DeepSeek‑derived sparse attention and IndexShare optimizations—while noting its weaker long‑context engineering scores and highlighting hardware scarcity as the main bottleneck for Chinese LLMs.

AI EfficiencyBenchmarkDeepSeek
0 likes · 11 min read
How GLM‑5.2’s Success Reveals the Secret Behind Chinese Models Catching Up to Claude and GPT
Java Companion
Java Companion
Jun 21, 2026 · Artificial Intelligence

How Ponytail’s AI Coding Plugin Gained 40K Stars in One Week

The article analyzes Ponytail, an AI‑coding plugin that enforces six safety‑first checks, dramatically cuts generated code, reduces token usage and cost, supports dozens of agents, and backs its claims with real‑world benchmarks showing up to 94% code reduction.

AI coding pluginBenchmarkClaude Code
0 likes · 13 min read
How Ponytail’s AI Coding Plugin Gained 40K Stars in One Week
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jun 20, 2026 · Artificial Intelligence

Musk Says GLM Could Reach Fable Level by Q1 2027—ZhiPu’s Tang Argues It’s Much Sooner

Elon Musk predicted that China’s GLM model would catch up to Anthropic’s Fable by the first quarter of 2027, but ZhiPu’s chief scientist Tang Jie argues the gap is closing much faster, as GLM‑5.2 receives free global compute, tops benchmark leaderboards, and demonstrates open‑source performance rivaling top closed‑source models.

Anthropic FableBenchmarkGLM-5.2
0 likes · 8 min read
Musk Says GLM Could Reach Fable Level by Q1 2027—ZhiPu’s Tang Argues It’s Much Sooner
Machine Heart
Machine Heart
Jun 20, 2026 · Artificial Intelligence

Claw-Anything: Cross‑Device, Cross‑Time, Cross‑Service Benchmark for Scaling AI Agents (GPT‑5.5 Pass@1 = 34.5%)

Claw-Anything introduces a large‑scale, multi‑service benchmark that evaluates AI agents across long‑term histories, dozens of applications, and both GUI and CLI interfaces, revealing that even top‑tier closed‑source models like GPT‑5.5 achieve only a 34.5% pass rate while open‑source fine‑tuning gains a 23.7% improvement.

AI agentsBenchmarkClaw-Anything
0 likes · 12 min read
Claw-Anything: Cross‑Device, Cross‑Time, Cross‑Service Benchmark for Scaling AI Agents (GPT‑5.5 Pass@1 = 34.5%)
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jun 19, 2026 · Artificial Intelligence

Can Post‑Training Close the Gap to Mythos‑Level AI? Musk Says 9 Months, Tang Says Faster

The article analyzes whether post‑training on GLM‑5.1/5.2 can bridge the gap to the banned Mythos model, citing Musk’s nine‑month claim, Tang’s rebuttal, Mind Lab’s benchmark gains, architectural adaptations, and the high barriers that make post‑training a critical yet scarce capability in China.

AI developmentBenchmarkGLM-5.2
0 likes · 9 min read
Can Post‑Training Close the Gap to Mythos‑Level AI? Musk Says 9 Months, Tang Says Faster
Machine Heart
Machine Heart
Jun 19, 2026 · Artificial Intelligence

Who Is Quietly Building China’s Mythos‑Level AI? Musk Says 9 Months, Tang Says It’s Not That Fast

The article analyzes China’s race to achieve Mythos‑level intelligence, contrasting Musk’s nine‑month claim with Tang’s skepticism, and highlights Mind Lab’s unique post‑training work on GLM‑5.1/5.2 that has already delivered significant benchmark gains, while outlining the technical hurdles and timeline uncertainties.

AI development in ChinaBenchmarkGLM-5.2
0 likes · 8 min read
Who Is Quietly Building China’s Mythos‑Level AI? Musk Says 9 Months, Tang Says It’s Not That Fast
Machine Heart
Machine Heart
Jun 19, 2026 · Artificial Intelligence

Which Multi‑Agent Communication Protocol Wins? UIUC Introduces ProtocolBench at ICML 2026

The UIUC team presents ProtocolBench, a systematic benchmark that compares four multi‑agent communication protocols across four realistic scenarios, revealing distinct trade‑offs in latency, reliability, and security, and proposes ProtocolRouter to automatically select the most suitable protocol per workload.

BenchmarkLLM agentsProtocolBench
0 likes · 14 min read
Which Multi‑Agent Communication Protocol Wins? UIUC Introduces ProtocolBench at ICML 2026
Machine Heart
Machine Heart
Jun 19, 2026 · Artificial Intelligence

Hugging Face Funds 6‑Hour Free Compute for GLM‑5.2 as Musk Praises the Model

Hugging Face has pledged six hours of global free compute for the Chinese open‑source LLM GLM‑5.2, a model praised by Elon Musk and benchmarked within 1‑4 % of top closed‑source systems, while its novel IndexShare architecture cuts token‑wise computation by nearly threefold and its MIT‑licensed release fuels China’s rapid ascent in the global AI model landscape.

AI competitionBenchmarkChina AI
0 likes · 8 min read
Hugging Face Funds 6‑Hour Free Compute for GLM‑5.2 as Musk Praises the Model
PaperAgent
PaperAgent
Jun 19, 2026 · Artificial Intelligence

From Harness to Environment: A Survey of Agentic Environment Engineering

This article surveys the emerging field of Agentic Environment Engineering, defining environments as POMDPs, classifying their attributes and tasks, reviewing synthesis methods, evaluation frameworks, and outlining four complementary paths for agent evolution and three paradigms for environment evolution.

Agentic AIBenchmarkEnvironment Modeling
0 likes · 15 min read
From Harness to Environment: A Survey of Agentic Environment Engineering
Frontend AI Walk
Frontend AI Walk
Jun 19, 2026 · Artificial Intelligence

One‑Line Command to Simplify AI Coding: Ponytail’s 5‑Day, 27K‑Star Success

The article examines how AI coding assistants tend to over‑engineer solutions, introduces Ponytail’s lazy‑decision ladder and four intensity levels, shows one‑command installation across 13 platforms, and presents benchmark data indicating 80‑94% code reduction, 42‑75% cost savings, and 3‑6× speed improvements.

AI codingBenchmarkPonytail
0 likes · 14 min read
One‑Line Command to Simplify AI Coding: Ponytail’s 5‑Day, 27K‑Star Success
Machine Heart
Machine Heart
Jun 18, 2026 · Artificial Intelligence

DeepSeek’s New Image‑Recognition Mode Struggles to Identify Its Own CEO

After DeepSeek fully launched its image‑recognition mode, a hands‑on test revealed that while the model can spot well‑known figures like Huang Renxun, it misreads text, fails on Chinese handwriting, cannot recognize its CEO Liang Wenfeng, and lags behind Gemini, GPT 5.5 and Claude in music‑theory reasoning.

AI comparisonBenchmarkDeepSeek
0 likes · 6 min read
DeepSeek’s New Image‑Recognition Mode Struggles to Identify Its Own CEO
Alipay Experience Technology
Alipay Experience Technology
Jun 18, 2026 · Artificial Intelligence

Building a Hippocampus for AI: Brain‑Inspired Memory Achieves SOTA

The open‑source Hebb Mind project replicates the brain’s encode‑consolidate‑activate‑forget loop in engineering, replacing simple storage‑retrieval approaches with a four‑stage memory cycle, and demonstrates state‑of‑the‑art performance on LongMemEval and LoCoMo benchmarks while running locally without external services.

AI memoryBenchmarkHebb Mind
0 likes · 13 min read
Building a Hippocampus for AI: Brain‑Inspired Memory Achieves SOTA
Machine Heart
Machine Heart
Jun 18, 2026 · Artificial Intelligence

SAG: The New RAG SOTA That Delivers Sub‑Second Retrieval on 500 Million Records

SAG (SQL‑Retrieval Augmented Generation) introduces a hypergraph‑based event‑entity data model that combines SQL joins, vector similarity, and hyperedge reasoning to achieve 79%‑88% Recall@2‑5 with second‑level latency on a 500 M‑row corpus, outperforming GraphRAG and HippoRAG in multi‑hop tasks.

AIAgentBenchmark
0 likes · 14 min read
SAG: The New RAG SOTA That Delivers Sub‑Second Retrieval on 500 Million Records
Geek Labs
Geek Labs
Jun 18, 2026 · Artificial Intelligence

8 Must‑Watch Open‑Source TTS Projects for 2026

This article reviews eight open‑source text‑to‑speech systems—from lightweight, CPU‑only models to multilingual, podcast‑focused engines—detailing their architectures, language coverage, benchmark scores, licensing, and practical use‑case recommendations.

AIBenchmarkSpeech Synthesis
0 likes · 15 min read
8 Must‑Watch Open‑Source TTS Projects for 2026
SuanNi
SuanNi
Jun 17, 2026 · Artificial Intelligence

GLM-5.2 Tops Code Arena Benchmarks and Goes Open Source

GLM-5.2, the newly released open‑source LLM from Zhipu, achieves the #1 ranking on Code Arena’s global blind‑test, supports a 1 million‑token context, introduces architectural innovations like IndexShare and MTP, and delivers competitive benchmark results against leading closed‑source models.

1M token contextBenchmarkGLM-5.2
0 likes · 8 min read
GLM-5.2 Tops Code Arena Benchmarks and Goes Open Source
PaperAgent
PaperAgent
Jun 17, 2026 · Artificial Intelligence

Spatial-Agent: A New Concept‑Transformation Paradigm for Map Agents

The paper introduces Spatial‑Agent, which models geospatial question answering as a concept‑transformation process using a GeoFlow Graph intermediate representation, outlines a five‑step workflow, defines core concepts and functional roles, and demonstrates its effectiveness on MapEval‑API and MapQA benchmarks with detailed error and cost analyses.

BenchmarkGISGeoFlow Graph
0 likes · 13 min read
Spatial-Agent: A New Concept‑Transformation Paradigm for Map Agents
AI Engineering
AI Engineering
Jun 17, 2026 · Artificial Intelligence

How GLM-5.2 Surpassed Claude Fable 5 to Top Design Arena Rankings

GLM-5.2, the new open‑source LLM from Zhipu, offers a stable 1 M token context, adjustable coding inference strength, and an IndexShare architecture that cuts FLOPs per token by 2.9×, achieving the highest Elo score on Design Arena and leading multiple coding benchmarks against both open‑source and proprietary models.

1M contextBenchmarkGLM-5.2
0 likes · 10 min read
How GLM-5.2 Surpassed Claude Fable 5 to Top Design Arena Rankings
IoT Full-Stack Technology
IoT Full-Stack Technology
Jun 17, 2026 · Backend Development

When Java Streams Crash: A Real‑World Performance Disaster

A production outage caused by a Java Stream pipeline processing one million orders revealed massive memory overhead and CPU‑bound garbage collection, prompting a benchmark that showed a handcrafted for‑loop to be up to twenty times faster and far more memory‑efficient.

BenchmarkMemoryPerformance
0 likes · 10 min read
When Java Streams Crash: A Real‑World Performance Disaster
Machine Heart
Machine Heart
Jun 16, 2026 · Artificial Intelligence

From Bayesian to LLMs: A Comprehensive Survey of Recent Temporal Point Process Advances

This article reviews the rapid evolution of Temporal Point Processes, covering Bayesian non‑parametric models, neural architectures—including RNN, Transformer, and ODE‑based designs—and the emerging LLM‑driven approaches, while discussing training methods, benchmarks, applications, and open research challenges.

Bayesian TPPBenchmarkEvent Modeling
0 likes · 17 min read
From Bayesian to LLMs: A Comprehensive Survey of Recent Temporal Point Process Advances
Weekly Large Model Application
Weekly Large Model Application
Jun 16, 2026 · Artificial Intelligence

Building a Reproducible, Scalable ASR Evaluation Framework for 2025‑2026

The article outlines why a unified ASR evaluation pipeline—combining a TestSet Zoo, Model Zoo, and standardized Benchmark Pipeline—is essential for fair cross‑model comparison, describes 2025‑2026 trends such as multi‑track metrics and robustness, and provides a step‑by‑step implementation guide with best‑practice warnings.

ASRBenchmarkNeMo
0 likes · 9 min read
Building a Reproducible, Scalable ASR Evaluation Framework for 2025‑2026
Code of Duty
Code of Duty
Jun 15, 2026 · Artificial Intelligence

Cursor vs Codex: An Application‑Level Comparison and Insights

The author runs a series of real‑world development tasks with Cursor (Composer 2.5) and Codex (GPT‑5.5) to compare how each agent understands directories, creates files, designs a WeChat lottery mini‑program MVP, generates MySQL schemas, evaluates non‑functional requirements, and reflects on token usage, concluding that Cursor excels in IDE‑centric, structured outputs while Codex shines as a terminal‑based coding agent.

AI coding assistantBenchmarkCodex
0 likes · 10 min read
Cursor vs Codex: An Application‑Level Comparison and Insights
Machine Heart
Machine Heart
Jun 15, 2026 · Artificial Intelligence

How Close Is Video Generation to Being Beautiful, Useful, Accurate? 1080‑Prompt, 7‑Model KIVI Benchmark

Researchers introduce KIVI, a knowledge‑intensive video generation benchmark with 1080 real‑world prompts, evaluating seven models using new FactP and HelpS metrics, revealing systematic errors such as entity mis‑depiction, procedural mistakes, and component misplacement, and showing a gap between human‑crafted and AI‑generated videos.

BenchmarkFactPHelpS
0 likes · 9 min read
How Close Is Video Generation to Being Beautiful, Useful, Accurate? 1080‑Prompt, 7‑Model KIVI Benchmark
Machine Heart
Machine Heart
Jun 15, 2026 · Artificial Intelligence

Breaking the SWE‑bench Score‑Only Myth: Open‑Source Benchmark that Independently Measures Harnesses

The article critiques the reliance on raw SWE‑bench scores for programming agents, introduces the Claw‑SWE‑Bench benchmark and a dedicated adapter that isolates harness effects, and presents extensive experiments showing how model choice, harness design, and cost impact real-world coding performance across multiple languages.

BenchmarkHarnessLLM agents
0 likes · 14 min read
Breaking the SWE‑bench Score‑Only Myth: Open‑Source Benchmark that Independently Measures Harnesses
ZhongAn Tech Team
ZhongAn Tech Team
Jun 15, 2026 · Artificial Intelligence

Claude’s New Fable 5 Model Unleashed: Explosive Performance but Double the Cost

The weekly tech roundup covers Anthropic’s flagship Claude Fable 5 and Mythos 5 models—showing record‑high benchmark scores but a two‑fold price increase—while also reviewing GPT‑5.6’s internal tests, Meshy’s world‑first 3D Agent, Kimi Work’s local AI assistant, Tencent Cloud’s Agent strategy, token‑cost cuts for overseas AI teams, Apple’s side‑AI breakthrough, and the HRM‑Text model that challenges scaling laws.

3DAIAgents
0 likes · 33 min read
Claude’s New Fable 5 Model Unleashed: Explosive Performance but Double the Cost
Tech Musings
Tech Musings
Jun 14, 2026 · Backend Development

Does Netty’s io_uring Make the 2× CPU Thread Rule Obsolete?

A benchmark on an 8‑core Linux 6.6 system shows that switching Netty from epoll to io_uring lets a half‑sized thread pool achieve 3 % higher throughput, more than double per‑thread efficiency, and a 67 % reduction in CPU migrations, challenging the traditional rule of using twice‑the‑core thread counts.

BenchmarkEpollNetty
0 likes · 21 min read
Does Netty’s io_uring Make the 2× CPU Thread Rule Obsolete?
SuanNi
SuanNi
Jun 14, 2026 · Artificial Intelligence

How HRM-Text-1B Beats Scaling Laws with 0.1% Data and Hundreds‑Fold Compute Savings

HRM-Text-1B, a brain‑inspired hierarchical language model, achieves strong benchmark scores while using only 0.1% of the training tokens of comparable models, cutting compute costs by 96‑432× through a novel H/L module architecture, MagicNorm stabilization, and a focused instruction‑response training objective.

BenchmarkEfficient PretrainingHRM-Text
0 likes · 9 min read
How HRM-Text-1B Beats Scaling Laws with 0.1% Data and Hundreds‑Fold Compute Savings
AI Engineering
AI Engineering
Jun 14, 2026 · Artificial Intelligence

Can a Plugin Stop AI Code Generators from Over‑Engineering? Meet Ponytail

The Ponytail open‑source plugin guides AI coding assistants through a six‑step checklist that eliminates unnecessary libraries, redundant wrappers, and excess code, cutting generated code size by 80‑94%, reducing call costs by up to 77%, and speeding execution 3‑6× across common tasks.

AI codingBenchmarkPonytail
0 likes · 6 min read
Can a Plugin Stop AI Code Generators from Over‑Engineering? Meet Ponytail
AI Insight Log
AI Insight Log
Jun 12, 2026 · Artificial Intelligence

Kimi K2.7 Code: 1T MoE Model Cuts Tokens 30% and Beats Claude Opus on MCP Calls

The newly released Kimi K2.7 Code, a 1‑trillion‑parameter mixture‑of‑experts model that activates only 32 B parameters per inference, offers a 256 K context window, supports multimodal input, improves benchmark scores by up to 31.5 % over K2.6, reduces inference token usage by about 30 %, and achieves an 81.1 MCP tool‑call score surpassing Claude Opus 4.8, while providing a CLI installation command and usage guidelines.

BenchmarkCoding ModelKimi
0 likes · 7 min read
Kimi K2.7 Code: 1T MoE Model Cuts Tokens 30% and Beats Claude Opus on MCP Calls
Baidu Maps Tech Team
Baidu Maps Tech Team
Jun 12, 2026 · Artificial Intelligence

RoadSceneBench: A Lightweight Benchmark for Mid‑Level Road Scene Understanding

The CVPR 2026 paper introduces RoadSceneBench, a lightweight benchmark that evaluates models on six structured mid‑level road‑scene tasks using short front‑view video clips, and presents MapVLM with HRRP‑T training, which significantly outperforms existing closed‑ and open‑source visual‑language models.

Autonomous DrivingBenchmarkCVPR 2026
0 likes · 14 min read
RoadSceneBench: A Lightweight Benchmark for Mid‑Level Road Scene Understanding
Machine Heart
Machine Heart
Jun 12, 2026 · Artificial Intelligence

Breaking Fable 5’s Safety in Under 5 Seconds with a Single Dialogue

A multinational research team demonstrated that the new safety classifier of Anthropic’s Fable 5 can be bypassed in less than five seconds with just one conversation, revealing an internal safety collapse (ISC) flaw that lets agents generate harmful content despite external defenses.

AI safetyAgent SecurityBenchmark
0 likes · 11 min read
Breaking Fable 5’s Safety in Under 5 Seconds with a Single Dialogue
Bilibili Tech
Bilibili Tech
Jun 12, 2026 · Artificial Intelligence

A New UGC Video Evaluation Paradigm Built on 17 Billion Real User Interactions

The paper introduces CASTER, a multimodal AI system that uses Social‑CoT reasoning and the MEDEA framework to simulate diverse audience reactions, benchmarked on the large‑scale CASTER‑Bench dataset, and demonstrates superior performance over GPT‑5.2, Claude‑4.5‑Opus, and traditional VQA methods while already being deployed on Bilibili.

BenchmarkCommunity resonanceSocial CoT
0 likes · 9 min read
A New UGC Video Evaluation Paradigm Built on 17 Billion Real User Interactions
SuanNi
SuanNi
Jun 11, 2026 · Artificial Intelligence

Why the Human Turing Test Is No Longer Enough: Agents’ Last Exam Benchmark

The article introduces Agents’ Last Exam (ALE), a comprehensive benchmark created by Berkeley and over 250 experts to evaluate generalist computer‑use agents on real‑world, multi‑step workflows across 55 sub‑fields, revealing that even the strongest models achieve only single‑digit pass rates.

AI agentsBenchmarkClaude
0 likes · 13 min read
Why the Human Turing Test Is No Longer Enough: Agents’ Last Exam Benchmark
JD Tech Talk
JD Tech Talk
Jun 11, 2026 · Artificial Intelligence

How JD’s Open‑Source JoyAI‑Echo Overcomes the Three Biggest Long‑Video Generation Challenges

JoyAI‑Echo, JD’s newly open‑sourced long‑video generation framework, tackles character inconsistency, voice instability, and slow rendering by introducing a cross‑modal memory bank, memory‑driven training with DMD for 7.5× speedup, a conversational Director Agent, and real‑time super‑resolution, achieving leading benchmark scores and high user preference.

AI video generationBenchmarkDirector Agent
0 likes · 6 min read
How JD’s Open‑Source JoyAI‑Echo Overcomes the Three Biggest Long‑Video Generation Challenges
JD Cloud Developers
JD Cloud Developers
Jun 11, 2026 · Artificial Intelligence

How JD’s Open‑Source JoyAI‑Echo Tackles the Three Big Challenges of Long‑Form Video Generation

JD’s newly open‑source JoyAI‑Echo framework addresses long‑video generation’s three major pain points—character inconsistency, unstable speaker timbre, and slow rendering—through a cross‑modal memory bank, memory‑driven training, a conversational Director Agent, and real‑time super‑resolution, delivering up to 7.5× speed gains and superior benchmark results.

AI videoBenchmarkJoyAI-Echo
0 likes · 6 min read
How JD’s Open‑Source JoyAI‑Echo Tackles the Three Big Challenges of Long‑Form Video Generation
Node.js Tech Stack
Node.js Tech Stack
Jun 11, 2026 · Artificial Intelligence

How 5 Engineers Built an Open‑Source Long‑Horizon Coding Agent in 14 Days that Outperforms Claude Code

A five‑person Xiaomi team created MiMo Code, an open‑source long‑horizon programming agent written in TypeScript, within two weeks; the paper details its three‑dimensional design—compute, memory, evolution—benchmark results that surpass Claude Code, and simple installation options.

AI coding agentBenchmarkMiMo Code
0 likes · 6 min read
How 5 Engineers Built an Open‑Source Long‑Horizon Coding Agent in 14 Days that Outperforms Claude Code
Meituan Technology Team
Meituan Technology Team
Jun 11, 2026 · Artificial Intelligence

From Moonwalks to Cyber Cities: How WBench Maps the Limits of World Models

WBench, the first systematic multi‑turn benchmark for interactive video world models, evaluates 20 cutting‑edge models across navigation, actions, editing and view‑switching, revealing that no single model excels at all tasks, navigation is independent of visual quality, and multi‑turn interaction causes a 33‑point drop in performance.

AI evaluationBenchmarkInteractive Video
0 likes · 7 min read
From Moonwalks to Cyber Cities: How WBench Maps the Limits of World Models
Top Architect
Top Architect
Jun 11, 2026 · Artificial Intelligence

Google’s Gemini 3.2 Flash Appears Silently, Outcoding Its Own Pro Model

Gemini 3.2 Flash was quietly released on the web, discovered by a Reddit user, and instantly demonstrated the ability to generate thousands of lines of code—including complex SVG, Three.js scenes, and even a functional Windows 98 environment—thanks to a distilled and sparsified model that rivals GPT‑5.5 performance while cutting inference cost by 15‑20×.

AI codingBenchmarkGemini 3.2
0 likes · 8 min read
Google’s Gemini 3.2 Flash Appears Silently, Outcoding Its Own Pro Model
Machine Heart
Machine Heart
Jun 11, 2026 · Artificial Intelligence

Can Agents Search Without a Vector Database? A Simple Grep Is Enough

The paper introduces Direct Corpus Interaction (DCI), letting LLM agents bypass vector indexes and use command‑line tools like grep to directly search raw text, achieving higher accuracy and lower cost on complex multi‑hop QA and retrieval benchmarks.

Agentic SearchBenchmarkDirect Corpus Interaction
0 likes · 12 min read
Can Agents Search Without a Vector Database? A Simple Grep Is Enough
Machine Heart
Machine Heart
Jun 11, 2026 · Artificial Intelligence

Two Global Wins in Half a Month: Chinese Startup HiDream.ai Redefines AI Image Generation

Within two weeks, HiDream.ai’s HiDream-O1-Image-1.5 topped the Artificial Analysis Text‑to‑Image leaderboard, surpassing Google, NVIDIA and ByteDance models, thanks to its novel UiT pixel‑level unified transformer architecture that abandons the conventional text‑encoder + VAE + DiT pipeline and delivers high parameter efficiency and production‑ready capabilities across diverse visual scenarios.

AI image generationBenchmarkChinese AI startup
0 likes · 14 min read
Two Global Wins in Half a Month: Chinese Startup HiDream.ai Redefines AI Image Generation
Machine Heart
Machine Heart
Jun 11, 2026 · Artificial Intelligence

MBench: Tsinghua and Tencent Define Long-Term Memory for Video World Models

MBench, a new benchmark from Tsinghua University and Tencent, systematically evaluates the long‑term memory ability of streaming video generation models across entity, environment, and causal consistency, introduces a trigger‑conditioned scoring scheme, and reveals that memory remains a major bottleneck for current SOTA models.

AIBenchmarkMemory
0 likes · 8 min read
MBench: Tsinghua and Tencent Define Long-Term Memory for Video World Models
Machine Heart
Machine Heart
Jun 10, 2026 · Artificial Intelligence

MiniAppBench Reveals Only 1 in 6 AI‑Generated Apps Meet Real User Needs

MiniAppBench, the first benchmark that evaluates large language models' ability to generate fully functional interactive HTML applications, shows an average pass rate of just 17% across 16 top models—with the strongest model, GPT‑5.2, achieving only 45%—highlighting a substantial gap between current capabilities and real‑world user requirements.

AI evaluationBenchmarkLLM
0 likes · 16 min read
MiniAppBench Reveals Only 1 in 6 AI‑Generated Apps Meet Real User Needs
Lao Guo's Learning Space
Lao Guo's Learning Space
Jun 10, 2026 · Artificial Intelligence

2026 Top 10 Local LLMs Ranked by Real Downloads, GPU Fit, and License Risks

The article analyzes why local large‑language‑model deployment is essential for privacy, offline use, and cost control, then ranks the ten most popular models in 2026 using Ollama download counts, GitHub stars, benchmark scores, and hardware requirements, and finally provides a GPU‑based selection guide, deployment‑tool comparison, license‑risk table, decision‑tree and quick‑start instructions.

BenchmarkLLMLicense
0 likes · 19 min read
2026 Top 10 Local LLMs Ranked by Real Downloads, GPU Fit, and License Risks
DataFunSummit
DataFunSummit
Jun 10, 2026 · Databases

Sonar-TS: A New Text-to-SQL Paradigm for Time‑Series Databases

The paper defines the NLQ4TSDB problem of letting non‑expert users query massive time‑series data with natural language, builds the large‑scale NLQTSBench benchmark, proposes the neural‑symbolic Sonar‑TS framework that searches then verifies, and shows it outperforms existing baselines while highlighting remaining challenges.

BenchmarkNLQ4TSDBSonar-TS
0 likes · 9 min read
Sonar-TS: A New Text-to-SQL Paradigm for Time‑Series Databases