Tagged articles

release gates

3 articles · Page 1 of 1

Oct 22, 2026 · Artificial Intelligence

AI SRE Agents: Correct Answers ≠ Safe Execution — Layered Evaluation & Release Gates

This article presents a comprehensive evaluation framework for AI SRE agents that audits tool usage, execution trajectories, evidence provenance, safety constraints, and environmental outcomes — not just final answer correctness — using deterministic contract tests, real-model trials, mutation testing, and statistical release gates to ensure reliable, auditable automation.

AI SRE AgentCI/CDGo

0 likes · 62 min read

AI SRE Agents: Correct Answers ≠ Safe Execution — Layered Evaluation & Release Gates

Random Bulletin

Sep 6, 2026 · Operations

Continuous Load Testing: Keeping Capacity Evidence in Sync with System Evolution at 10M QPS

This article explains why ad-hoc load testing fails at scale and details a four-stage evolution toward continuous load testing, covering baseline regression, release gates, failure capacity verification, production safety boundaries, and organizational ownership to keep capacity evidence current with system changes.

QPSSystem architecturebaseline regression

0 likes · 40 min read

Continuous Load Testing: Keeping Capacity Evidence in Sync with System Evolution at 10M QPS

Data Bricklaying Diary

Aug 26, 2026 · Artificial Intelligence

AI Evaluation Sets ≠ Training Holdouts: Golden Data, Hard Cases, Contamination & Regression

This article explains why enterprise AI evaluation requires purpose-built datasets — golden baselines, challenge cases, red-team tests, regression suites, and online replays — designed from capability questions, risk lists, and real failures, with structured answers, contamination governance, tiered LLM judging, and version-locked regression pipelines gated by risk-based release thresholds.

AI evaluationLLM-as-a-Judgechallenge set

0 likes · 24 min read

AI Evaluation Sets ≠ Training Holdouts: Golden Data, Hard Cases, Contamination & Regression