TVP Training Camp: Exploring Big Data Technologies and Trends

On March 16, 2019, the first TVP Training Camp was held at the Beijing Guoxue Hall, a specialized event for data technology experts. TVP (Tencent Cloud Valuable Professional) is an important strategic initiative by Tencent Cloud to achieve digital transformation and build a smart ecosystem. The program aims to establish an exchange platform with industry technical experts to promote effective communication between Tencent Cloud and technical experts and users, thereby enhancing Tencent Cloud's product capabilities and building a cloud computing technology ecosystem.

The TVP Training Camp is a social technical exchange gathering organized by Tencent Cloud specifically for TVP members. It aims to promote communication and learning among TVP members, allowing them to discuss future technologies, cutting-edge technology, and technical management knowledge and experience face-to-face.

The first TVP Training Camp directly addressed the opportunities and challenges of the big data era, jointly exploring the development trends of big data technology. We specially invited Zhao Zhenping, CTO of Solar Tower Technology and Chairman of the PostgreSQL China Region, Li Yue, Co-founder/CTO of MemVerge, Yang Jianrong, Database Expert at Jinqi World and Initiator of the dbaplus Community, Chang Lei, CEO of Oushu Technology and Founder of Apache HAWQ, and Du Junping, Tencent Cloud Big Data Expert Engineer and Director of Data Warehouse and Data Lake Products, to discuss the obstacles encountered in the practical application of big data today and explore the development trends of future heterogeneous computing, new hardware, AI, and other directions.

During the opening ceremony, Tencent Cloud's expert product manager Wang Yonghe stated: "TVP is a very important part of Tencent Cloud's developer ecosystem construction. For Tencent Cloud, we hope more experts will join the developer ecosystem construction to help Tencent Cloud make products and services better, and together with us, contribute all our efforts to the construction of the developer ecosystem."

After the opening remarks, we entered the exciting speaker sharing session, where four speakers on-site would share around the topic of "Big Data" for 40 minutes each.

Zhao Zhenping, CTO of Solar Tower Technology and Chairman of the PostgreSQL China Region, mentioned GreenPlum, a distributed database biased towards data warehousing, in his sharing on "Distributed Database and Industry Opportunity Discussion." GreenPlum is a distributed database cluster composed of multiple segments and 2 masters. When discussing its advantages and why we would choose GreenPlum, Zhao Zhenping proposed five points: 1) High performance; 2) High product maturity; 3) Disaster recovery mechanism; 4) Support for linear expansion; 5) Familiar development environment.

Regarding linear expansion, Zhao Zhenping detailed that Greenplum adopts a common MPP parallel processing architecture. Adding nodes in the MPP architecture can linearly improve the system's storage capacity and processing capability. Meanwhile, Greenplum's node expansion operation is simple and can complete data redistribution in a very short time. Finally, Greenplum's linear expansion support provides technical assurance for the future expansion of data analysis systems, allowing users to expand capacity and performance as needed.

Next, Li Yue, Co-founder/CTO of MemVerge, brought a new round of themed sharing on "Next-Generation Big Data Infrastructure." Li Yue believes that PMEM will bring fundamental changes to all data infrastructure, or will achieve truly data-driven in the future. In the sharing, Li Yue also revealed that MemVerge and Tencent Cloud are currently cooperating and will launch a new generation of big data products in a very short time, providing better scalability and performance at a lower cost.

The third sharing content was brought by Yang Jianrong, Database Expert at Jinqi World and Initiator of the dbaplus Community, on the theme of "Optimization of Data Operations." Data operation and maintenance system not only includes maintaining the stability of the database cluster but also needs to focus on user experience. In the past, when using slow log analysis, we often encountered problems of low analysis efficiency and poor analysis effects. Yang Jianrong discovered through combining these problems that what we often call slow log extraction is actually a pseudo-need.

So how can we correctly reflect the value of data services? Yang Jianrong provided three suggestions on-site: 1) Use images or visualization methods to analyze, enabling slow log data analysis evaluation; 2) Through the results of data risk assessment, you may discover that small data also has potential value; 3) For the log reports provided by slow log parsing, from a data analysis perspective, we can provide deeper, potential opinions to the front-end operations team for operation.

The last sharing session featured Chang Lei, CEO of Oushu Technology and Founder of Apache HAWQ, who shared on the theme of "Next-Generation Cloud Database." In his on-site sharing, Chang Lei mentioned that in large manufacturing enterprise practices, they often encounter the following three problems: 1) A large amount of sensor data cannot be processed in time; 2) Faults cannot be detected in time, causing significant losses; 3) Traditional solutions are too expensive.

However, if we want to achieve our goals, how should we operate? Chang Lei proposed his views on these issues: 1) Build a big data platform to improve its processing capability; 2) 200+ node analysis platform cluster; 3) PB-level data storage; 4) Achieve real-time fault prediction and other applications.

At the climax of the TVP Training Camp - the roundtable forum - the technical leaders on-site raised their doubts to Du Junping, Li Yue, Chang Lei, and Yang Jianrong, including their views on HTAP, the development direction of databases, cloud database security, etc. They all received professional guidance from the four experts, and many people said that the roundtable forum helped them solve long-standing problems and confusions.

After the speaker sharing and roundtable forum sessions, we prepared a sumptuous dinner for the technical leaders. Everyone raised their glasses to celebrate the successful progress of the first TVP Training Camp and thanked the speakers for their passionate sharing today.

Good times are always short. When the event came to an end, those present still felt it was not enough and looked forward to meeting again, and jointly wished that the TVP Training Camp would get better and better in the future.

Next, Tencent Cloud will continue to invest more resources to establish a face-to-face communication channel between external technical experts and Tencent and Tencent Cloud, jointly discussing technical management, latest technology, popular technology, and other related topics, promoting the development of various technical fields, and using technology to influence the world.