Focused on big data technology research, exploring the Big Data era | [email protected]
This article explains the StreamSQL Application concept, its resource‑sharing and isolation mechanisms, the DDL syntax for managing Applications, and a step‑by‑step example showing how a new user can create, run, and isolate StreamJobs without affecting existing production workloads.
This article introduces Inceptor StreamSQL, explains its core concepts of Stream, StreamJob, and Application, and provides a step‑by‑step tutorial—from creating a Kafka source to launching a StreamJob and querying results—highlighting its ease of use and performance benefits.
This article explains how Inceptor’s data auditing feature works, showing how to enable or disable table‑level error logging, interpret and query the Log Error Table, and manage its access permissions to ensure accurate query results despite dirty data.
This article explains how real‑time data streaming turns massive, continuously growing datasets into actionable insights across finance, energy, and e‑commerce, showcasing early adopters like ConocoPhillips and DHL while urging businesses to rethink models for the next wave of data management.
This article explains the concept and workflow of data audit in Inceptor, detailing dirty data types, configuration steps, relevant SQL syntax for Log Error Tables, example table creation, and control switches that manage error handling and NOT NULL checks to ensure clean data processing.
This article shares actionable ETL tuning strategies for Inceptor, including avoiding unnecessary transaction tables, shortening transaction windows, analyzing the most impactful cases first, and iteratively refining steps until optimal performance is achieved.
Effective ETL optimization is crucial for data warehouse construction, and this guide outlines three core strategies—ensuring proper resource configuration, leveraging data characteristics for optimal partitioning and bucketing, and monitoring task execution—providing practical principles, pitfalls, and case studies to maximize ETL efficiency.
This article provides a comprehensive guide to Inceptor Server HA, covering its high‑availability architecture, configuration steps, required parameters, connection strings, failover behavior, and the HA Tools utility for monitoring and managing master‑standby switches.
Analyzing reading statistics of 23 original articles published before the 2017 Chinese New Year, this report reveals that SQL on Hadoop, Lambda architecture, and Docker+Jenkins were the three hottest big‑data topics, while also discussing the rise of Kappa, SQL optimization importance, and ongoing innovation in the field.
This article explains Kafka's architecture, identifies its security vulnerabilities, and presents Transwarp's Kerberos authentication and ACL-based authorization solutions, including configuration steps, code examples, and best practices for building a secure Kafka service.
