Skip to content
Tagged articles

Trajectory Evaluation

3 articles · Page 1 of 1
ThinkingAgent
ThinkingAgent
Oct 8, 2026 · Artificial Intelligence

No Evals, No Production Agents: The 4-Layer Evaluation Framework

This article presents a comprehensive four-layer evaluation framework for production-grade AI agents—Model, Component, Trajectory, and Outcome Eval—along with three dataset types (Golden, Edge Case, Adversarial), three evaluation methods (Rule-based, LLM-as-Judge, Human), seven key metrics, regression automation, and a production-to-eval flywheel, illustrated with a customer-service refund agent case study.

AI agent evaluationAgent ObservabilityAgent Security
0 likes · 36 min read
No Evals, No Production Agents: The 4-Layer Evaluation Framework
Frontend AI Walk
Frontend AI Walk
Jun 24, 2026 · Artificial Intelligence

Turning Static AI Agent Skills into Dynamic, Testable, Iterable Workflows

This article explains how to extend a static AI Agent Skill defined in SKILL.md with a dynamic Workflows layer, add trajectory evaluation for deterministic execution, and provides concrete JavaScript examples, directory structures, anti‑patterns, and a step‑by‑step validation checklist to make Skills runnable, testable, and iteratively improvable.

AI agentsCI integrationJavaScript
0 likes · 24 min read
Turning Static AI Agent Skills into Dynamic, Testable, Iterable Workflows
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Jun 7, 2026 · Artificial Intelligence

AgentDoG 1.5: A Lightweight, Extensible Framework for Trajectory‑Level Agent Safety

AgentDoG 1.5 expands AI‑agent safety from final replies to complete execution trajectories, introducing the ATBench family for fine‑grained evaluation, a taxonomy‑guided DataEngine for high‑quality data generation, and demonstrating substantial safety gains in both SFT/RL training and online guardrail deployment with lightweight models.

AI safetyATBenchAgentDoG
0 likes · 14 min read
AgentDoG 1.5: A Lightweight, Extensible Framework for Trajectory‑Level Agent Safety