A platform for sharing and discussing tech knowledge, guiding you toward the cloud of technology.
This article provides a comprehensive guide to Spark UI, explaining each primary and secondary tab, the key metrics they expose, and how to interpret them for performance bottleneck detection, followed by two detailed case studies and practical tuning recommendations for Spark workloads.
This article examines the evolution of re‑ranking systems from traditional pointwise models to a two‑stage generation‑evaluation framework, compares autoregressive and non‑autoregressive generative approaches, details inference speed optimizations with GPU and model‑server upgrades, and outlines a future end‑to‑end sequence generation architecture enhanced by reinforcement learning and contrastive learning.
This article presents a production‑grade Flink ClickHouse sink that solves common pain points such as lack of size‑based batching, static table schemas, and distributed‑table latency by introducing data‑size batching, dynamic table routing, local‑table writes, load‑balanced node discovery, back‑pressure queues, dual‑trigger flush, and recursive retry with node exclusion, all integrated with Flink checkpoint semantics for at‑least‑once guarantees.
The article examines why developers need AI programming assistance, breaks down Claude Code’s core features such as precise dialogue flow, Plan mode, system prompts, and SKILL/MCP, presents a structured dialogue‑design methodology, showcases practical examples and a sub‑agent collaboration model, and reflects on the tool’s limitations and future prospects.
By integrating large language models to dynamically construct user knowledge graphs and applying two‑hop reasoning, the authors enhance serendipity in a large‑scale e‑commerce community recommendation system, achieving significant online gains in diversity, novelty, and user engagement metrics.
This article details the challenges of comparing billions of rows during large‑scale data migrations, presents a multi‑step solution using union‑all grouping, hash‑based aggregation, and intelligent primary‑key detection, and explains platform features, performance optimizations, and future enhancements that reduced comparison time by up to 70%.
This article details the design and implementation of an AI‑driven smart inspection platform for a mobile app, covering background challenges, system architecture, core detection features—including layout, visual, consistency, and AI‑operation checks—platform configuration, result feedback, and the measurable improvements achieved.
This article details how Poizon’s algorithm platform evolved from fragmented tracing to a unified, scenario‑driven observability system that standardizes traces, metrics, logs, and events, introduces a knowledge‑graph of algorithm scenes, and applies compression, async reporting, and advanced anomaly detection to improve stability and debugging efficiency.
This article details the governance framework, key metrics, and concrete engineering practices used to improve Git metadata performance, code quality scoring, lint enforcement, workflow checkpoints, and code duplication reduction for a large‑scale frontend monorepo, resulting in measurable stability gains.
This comprehensive guide explores RocketMQ’s four‑component architecture, storage formats, routing mechanisms, write‑and‑read workflows, high‑availability designs, performance optimizations, and a side‑by‑side comparison with Kafka, providing practical insights for building robust distributed messaging systems.
