Follow me! Discussing software architecture and development, AIGC and AI Agents... Sometimes sharing insights on IT professionals' life experiences.
This article explains the concept of Slowly Changing Dimensions (SCD) in data warehouses, compares six common SCD handling methods—including SCD0, SCD1, SCD2, SCD3, combined SCD2+SCD3, and historical tables—and guides you on selecting the most suitable approach for your business needs.
The Model Context Protocol (MCP), announced by Anthropic, standardizes how AI applications provide context to LLMs, offering a client‑server architecture that simplifies data and tool integration, and is compared with function calling, highlighting its benefits, workflow, controversies, and future prospects.
This article explains the role of the DWS layer in data warehouses, outlines design principles, step‑by‑step modeling, naming conventions, field design, provides concrete DDL/ETL examples, common pitfalls, and how to build reusable, performant summary tables for analytics.
This article provides a comprehensive guide to designing the Data Warehouse Detail (DWD) layer, covering Kimball‑based design principles, step‑by‑step modeling, table and field naming conventions, concrete Hive DDL/DML examples, and optimization techniques such as partitioning, bucketing, and compression.
On February 25 2025, Microsoft open‑sourced its first multimodal AI agent foundation model, Magma, which extends multimodal processing to images, video, and text, introduces Set‑of‑Mark and Trace‑of‑Mark techniques for spatial‑temporal reasoning, optimizes modular inference for edge devices, and integrates reinforcement learning for adaptive task execution.
This article explains the role of dimension tables in data warehouses, compares natural and surrogate keys, and details three strategies—overwrite, insert new rows, and add new attributes—for managing slowly changing dimensions, including full‑snapshot tables.
This article explains fact tables in data warehousing, covering their definition, granularity, additive classifications, null handling, consistency rules, and the various types such as transaction, snapshot, cumulative, fact‑less, and aggregate tables, along with design trade‑offs and ETL considerations.
GraphRAG, the next generation of Retrieval‑Augmented Generation, combines large language models, knowledge graphs, and graph databases to overcome traditional RAG’s knowledge gaps, hallucinations, and context limitations, and the article reviews its architecture, core modules, a recent 2025 paper, and six notable open‑source implementations.
The article explains Microsoft’s open‑source PIKE‑RAG system, detailing its four progressive stages—from knowledge‑base construction to creative multi‑agent reasoning—while describing the underlying modules, chunking strategies, multi‑granularity retrieval, and code snippets that enable specialized domain understanding and inference.
This guide explains how to configure and import the appropriate DistanceStrategy in LangChain, compares Euclidean distance, maximum inner product, and cosine similarity, and outlines their formulas, advantages, and typical use‑cases for vector‑based retrieval.
