Skip to content
Tagged articles

evaluation dataset

2 articles · Page 1 of 1
Alibaba Cloud Native
Alibaba Cloud Native
Oct 27, 2026 · Cloud Native

Building Trustworthy AIOps Evaluation Datasets: STAROps Root Cause Analysis Practices

Alibaba Cloud details its methodology for constructing and maintaining high-quality evaluation datasets for the STAROps AIOps agent, covering fault injection, signal capture, evidence extraction, quality checks, environment construction, and continuous iteration to ensure reliable root cause analysis assessments.

AIOpsAgent EvaluationCloud Native
0 likes · 42 min read
Building Trustworthy AIOps Evaluation Datasets: STAROps Root Cause Analysis Practices
Tencent Cloud Developer
Tencent Cloud Developer
Nov 20, 2020 · Artificial Intelligence

Design of a Symbolic Evaluation Set for Knowledge Question Answering (KBQA)

The paper introduces a symbolic‑logic‑focused evaluation set for knowledge‑base question answering, defining single, deterministic, and non‑deterministic element symbols with linguistic tags, constructing complex celebrity‑domain queries, and showing that current commercial KBQA systems achieve only modest accuracy, highlighting the need for more robust reasoning capabilities.

AIKBQAKnowledge Graph
0 likes · 11 min read
Design of a Symbolic Evaluation Set for Knowledge Question Answering (KBQA)