Skip to content
Tagged articles

automated evaluation

2 articles · Page 1 of 1
Alibaba Cloud Native
Alibaba Cloud Native
Nov 13, 2026 · Artificial Intelligence

Decision Models in Production: Threshold Tuning, Calibration & Training Essentials

This article details how to properly deploy decision models like Jev for automated evaluations, covering threshold tuning via cross-validation, probability calibration with Platt scaling, training loss design using strictly proper scoring rules, and practical techniques for atomic judge decomposition and cost-effective inference.

Brier scoreDecision ModelsLLM-as-a-Judge
0 likes · 43 min read
Decision Models in Production: Threshold Tuning, Calibration & Training Essentials
DataFunSummit
DataFunSummit
Sep 13, 2023 · Artificial Intelligence

Data Engineering, Automated Evaluation, and Knowledge Graph Integration in Large Model Development

This article presents a comprehensive overview of data engineering practices for large model training, reviews current model scales and pre‑training data sources, discusses automated evaluation techniques, and explores how knowledge graphs can be integrated throughout the model lifecycle to improve quality and applicability.

AIData Engineeringautomated evaluation
0 likes · 29 min read
Data Engineering, Automated Evaluation, and Knowledge Graph Integration in Large Model Development