Xiaohongshu Tech REDtech

Aug 7, 2026 · Artificial Intelligence

Can AI Translation Miss Memes? CULTURE‑MT Benchmark at ICML 2026

The authors introduce CULTURE‑MT, the first Chinese‑English social‑media translation benchmark that evaluates cultural effectiveness, define a new metric, release the JUDGER automatic evaluator (86 % accuracy, κ = 0.72), and show that even top models like Gemini 3 pro achieve only 38 % perfect cultural translations.