Meituan Technology Team

Jan 13, 2022 · Artificial Intelligence

MME-CRS: Multi-Metric Evaluation with Correlation Re-Scaling for Open-Domain Dialogue Evaluation

The paper presents MME‑CRS, a champion method for DSTC10 open‑domain dialogue evaluation that combines seven diverse metrics—fluency, relevance, topic coherence, engagement, and three specificity measures—using a correlation‑re‑scaling algorithm to weight each metric, achieving state‑of‑the‑art Spearman correlation and top rankings across multiple evaluation dimensions.