Contrastive Evaluation

Xiaohongshu Tech REDtech

Mar 13, 2025 · Artificial Intelligence

UniCBE: A Unified Multi‑Objective Optimization Framework for Contrastive Based Evaluation

UniCBE introduces a unified multi‑objective optimization framework for contrastive‑based evaluation that mitigates sampling bias, unbalanced uncertainty reduction, and inefficient resource allocation by combining three decoupled probability matrices through a greedy and Hadamard‑product strategy, achieving Pearson correlations above 0.995 with only 83 % of the annotation budget and cutting evaluation costs by more than 50 % across diverse LLM evaluators.