Focused on technical sharing in the data field, covering a tech stack that includes Hadoop, Spark, Flink, Kafka, Fluss, Paimon, Iceberg, StarRocks, ClickHouse, ES, Milvus, and more. Welcome to follow.
This article details troubleshooting StarRocks write failures caused by THRIFT_EAGAIN timeouts, analyzing JVM memory patterns, Thrift RPC behavior, TRUNCATE TABLE resource overhead, and resolving the issue by increasing thrift_rpc_timeout_ms from 5s to 30s while planning long-term architectural improvements.
This article details a comprehensive DataOps implementation using Alibaba Cloud's DataWorks, Flink, StarRocks, MaxCompute, and Yunxiao pipeline, covering four-layer architecture, standardized development, automated CI/CD with gray releases, full-chain quality monitoring achieving 80% self-healing, cross-team collaboration, cost optimization, and a phased rollout roadmap delivering 30% faster delivery and 30% cost reduction.
This comprehensive reference manual details essential command-line operations for core Hadoop ecosystem components including YARN resource management, HDFS distributed storage, HBase columnar database, Spark computing engine, and Flink stream processing framework, with practical examples for cluster administration, job submission, monitoring, and troubleshooting.
This guide details deploying a StarRocks compute-storage separation cluster using Alibaba Cloud OSS, covering architecture design, resource planning, Linux optimization, FE and CN node deployment with Ansible automation, configuration parameters, post-deployment tuning, and verification steps.
The author decommissioned three StarRocks nodes with over 1M tablets each; default replica migration moved only 200k replicas in 24 hours, so they increased tablet_sched_slot_num_per_path from 2 to 32 per disk during off-peak, achieving 800k+ replicas migrated per node in 8 hours while monitoring disk I/O.
The author documents three StarRocks production issues: varchar(50) truncating MaxCompute strings, BE memory spikes caused by API gateway timeout mismatches, and a global dictionary error fixed by disabling low-cardinality optimization.
This guide details the step-by-step deployment of a three-node Elasticsearch 7.17.9 cluster using Docker on existing test servers, including full YAML configurations, docker run commands, and network host mode setup to consolidate scattered test environments and reduce resource waste.
This guide walks through deploying Elasticsearch 8.7.1 on Windows 10, covering virtual network configuration, certificate generation for transport and HTTP layers, elasticsearch.yml configuration, service startup, password reset, and Kibana integration with security enabled.
This tutorial explains the Linux join command for merging two files based on matching key fields, covering syntax, common options like -a, -e, -i, -o, -t, -v, -1, -2, and provides practical examples with sample file contents and command outputs.
This guide explains the nslookup command-line tool for querying DNS records, covering interactive and non-interactive modes, supported record types (A, AAAA, MX, NS, PTR, etc.), and practical examples for domain lookup, reverse DNS, and debug mode.
