From PhD to Alibaba: How a Real‑Time Streaming Expert Built Blink on Flink

Shi Xiaogang, known as "Star Gang", earned his PhD at Peking University in 2016, focusing on "Iterative Computation on Real‑Time Data Streams". During his doctoral studies he published papers at top venues such as SIGMOD and TODS and received prestigious awards including the university’s President Scholarship.

After graduating, he joined Alibaba and contributed to the development of the real‑time computation system Blink, responsible for state storage, backup, and recovery. Blink powered critical Alibaba services (search, recommendation, advertising) during the 2016 Double‑11 event and later became an influential open‑source contribution to Apache Flink, where Shi became a top‑level committer.

Q: When did you first start programming and why did you fall in love with computers? A: He began in elementary school using a Yuxing learning machine, writing a simple Super Mario program, which sparked his interest in programming through games.

Q: Why did you choose algorithms as your focus? A: Working on distributed data storage and query during his PhD, he saw the exponential growth of user‑generated data and the need to extract value from it. This motivated him to research efficient data‑mining algorithms and platforms that could run them at scale.

Q: What academic achievements were most meaningful to you? A: His PhD work on a declarative language for iterative programs on streaming data and the associated system innovations were published at SIGMOD and TODS, earning him the President Scholarship (only 100 recipients university‑wide).

Q: Why did you choose Alibaba over other offers? A: He sought a role that aligned with his research on real‑time computation and offered massive data scenarios. Alibaba’s scale, resources, and focus on real‑time analytics matched his interests better than research labs at Microsoft or IBM.

Q: What was your initial motivation at Alibaba? A: Curious about how Alibaba’s massive e‑commerce platform handles huge traffic and data, he aimed to build a world‑impactful real‑time computing platform and become a leading expert in the field.

Q: How did you adapt from academia to industry? A: Transitioning from self‑directed research to business‑driven tasks required adjusting to fragmented schedules, frequent cross‑team communication, and a shift from personal curiosity to delivering tangible product value.

Q: What does being an "Alibaba Star" mean to you? A: It brings greater visibility, opportunities to collaborate with top talent, and higher expectations, creating both motivation and pressure to excel.

Q: What are you most proud of at Alibaba? A: Enhancing Blink’s state management—adding new state types, optimizing backup mechanisms, and improving fault‑tolerance—delivered significant business impact and earned recognition in the open‑source community, culminating in his role as a Flink committer.

Q: What key lessons have you learned? A: Deep understanding of large‑scale business, advanced debugging skills for peak‑load fault tolerance, and the importance of platform‑as‑a‑service design for flexible, high‑performance computing.

Q: What aspects of Alibaba’s culture helped your growth? A: An environment that encourages innovation, provides massive data and business scenarios for real‑world impact, and surrounds him with top‑tier colleagues who mentor and challenge him.

Q: Advice for graduating students? A: Master fundamental technical skills, clarify personal goals, maintain初心 (original intention), and consider long‑term career plans rather than short‑term gains.

Q: How would you pitch Alibaba’s campus recruitment? A: Alibaba, one of the world’s most valuable internet companies, offers vast data, cutting‑edge technology, and endless opportunities for talent to innovate and create global value.