Baidu's Big Data Intelligence: From Data to Intelligence - QCon2014 Presentation

On October 17, 2014, QCon2014 Global Software Development Conference was held at Shanghai Everbright Convention & Exhibition Center. At the conference, Shen Zhiyong, scientist at Baidu Research Institute Big Data Lab, delivered a keynote speech titled "From Data to Intelligence," introducing Baidu's big data engine and big data intelligent analysis application cases.

Baidu, as China's largest search engine, processes massive amounts of data daily. According to Shen Zhiyong, Baidu currently has 20,000 PB of big data storage capacity and can process 10-100 PB of data daily through data analysis and mining. Baidu has established the Big Data Lab (BDL) and opened Baidu Brain, Baidu Data Factory, and Baidu Open Cloud as three-level open platforms to the industry.

Shen Zhiyong shared several notable prediction projects powered by Baidu's big data:

Tourism Prediction: Baidu's tourism prediction model utilizes historical visitor data from LBS products, search logs showing user travel intentions, information about upcoming events and festivals, and weather/air quality data to predict future tourist flows with high accuracy.

World Cup Prediction: During the 2014 FIFA World Cup, Baidu's big data-based prediction outperformed predictions from Yahoo, Microsoft, and Google, achieving the highest accuracy.

Disease Prediction: Baidu collaborates with China CDC to build infectious disease prediction models based on search data, showing high consistency with actual case data.

Baidu has also partnered with the United Nations to establish a big data joint laboratory, leveraging Baidu's big data technology to address global issues. Additionally, Baidu uses big data intelligent analysis for user profiling and personalized advertising recommendations.

Shen Zhiyong emphasized that Baidu aims to promote industry-wide development by sharing its big data capabilities and integrating data thinking into traditional industries to drive industrial upgrading.