Interview with Lv Yi on Lianjia's Big Data Platform Architecture Evolution

From November 18‑20, 2016, CSDN organized the SDCC 2016 China Software Developers Conference in Beijing, featuring an interview with Lv Yi, head of Lianjia’s big‑data platform architecture team.

Lv Yi, who joined Lianjia in August 2015 after stints at Baidu Mobile Cloud and Sina SAE, is responsible for building Lianjia’s data infrastructure, aiming to provide platform‑wide, tool‑based big‑data services for the whole company.

He follows open‑source projects, focuses on technical solutions and architectural evolution, and evaluates the cost‑benefit of architectural changes.

His previous experiences at Sina and Baidu gave him exposure to diverse technologies, rapid development cycles, and cross‑team platform construction, which enhanced his architectural design skills.

Choosing Lianjia was driven by the desire to join a pioneering team tackling numerous technical challenges in the real‑estate domain, where data‑driven solutions are essential for transaction processes.

Lv Yi explains that the transition from engineer to senior engineer and architect mainly involves greater responsibility, technical planning for the next six months to a year, and attention to implementation details.

Lianjia’s big‑data department was created in early 2015 to support massive operational data needs across cities, districts, and stores, evolving from simple reporting tools to a full‑featured platform offering data analysis and API services.

The current platform consists of three layers: a top layer providing data analysis and API services; a middle layer with an OLAP engine, ad‑hoc engine, and scheduling engine; and a bottom layer of clusters built primarily on open‑source technologies, with ongoing work on cluster security and scheduling.

The platform also includes data management components such as permission control, metadata and metric management, task scheduling, and cluster access management.

At the SDCC 2016 Beijing session, Lv Yi will present “Evolution of Lianjia’s Big‑Data Platform Architecture,” sharing the architectural changes, technology selections, trade‑offs, and lessons learned.

Welcome to join the conference; tickets are on sale with an 20% discount and group‑buy savings.