Hulu’s Tech Director Reveals How to Master Video Codec Evaluation and MSU Benchmarks

This article is a repost of an interview by LiveVideoStack with Frank Lan, Hulu’s technology director, discussing Hulu’s internal codec evaluation methods and offering guidance on correctly using MSU reports.

Introduction

Frank Lan introduces himself as Hulu’s technology director, describing Hulu as a leading digital video media company delivering thousands of live TV channels and on‑demand videos. He leads a team in Beijing responsible for the video‑on‑demand production line, including transcoding, distribution, player adaptation, and QoS/QoE optimization, with a strong focus on video codec and streaming standards such as MPEG, DASH‑IF, and AOM.

MSU’s Codec Evaluation

Lan praises the MSU Graphics & Media Lab’s annual video‑codec evaluation as the industry‑recognized benchmark. He notes that the methodology has become a de‑facto reference standard for codec assessment.

Interpreting MSU Reports

He explains that an MSU report functions like a performance‑scorecard for codecs, providing a widely accepted reference point in the video industry, similar to benchmark scores for smartphones or computers.

Building Your Own Evaluation Suite

Lan points out that generic MSU tests are insufficient for many businesses. Hulu extends the test suite to cover long‑form content, VBR 1‑pass/2‑pass, CRF, capped‑CRF, 10‑bit, and HDR optimizations. For platforms without a custom suite, he recommends adding business‑specific video clips (e.g., UGC, animation) and testing features that matter to their use case.

Domestic Success in MSU Rankings

He observes that three of the top‑four MSU results this year come from domestic teams or Chinese companies, reflecting strong recent progress in China’s video‑technology sector. However, he notes that MSU’s evaluation fees limit participation, and many established codec vendors bypass MSU by conducting internal assessments.

Other Neutral Codec Benchmarks

According to Lan, MSU remains the dominant neutral benchmark. Some university labs offer third‑party testing, but their credibility and industry acceptance are far lower than MSU’s.