Tagged articles
DuckDB
27 articles · Page 1 of 1
This article details integrating DuckDB into Spring Boot for embedded OLAP analytics, covering tenant-isolated connection pools, secure view-based file access, streaming exports via COPY and cursors, SQL injection guards, and performance tuning for ad-hoc Parquet/CSV queries without a separate cluster.
CSVDuckDBEmbedded Analytics
0 likes · 48 min read

Helix Foundry uses deterministic logic to discover cross-source entity relationships, materializes them as an ontology in HelixDB, and leverages DuckDB for SQL analytics, validated with 32 customers and 240 orders in 153 seconds.
Data AgentDuckDBHelix Foundry
0 likes · 23 min read

The article tests DuckDB 2.0 CLI's Agent Mode with a 1,205-row CSV, showing how it explicitly marks omitted rows and returns JSON-structured errors for missing columns, but emphasizes that statistical accuracy still requires aggregation queries like COUNT and FILTER rather than relying on displayed samples.
Agent ModeCSVDuckDB
0 likes · 10 min read

Helix Foundry open-sources a local-first workflow combining HelixDB graph database and DuckDB OLAP to automatically construct enterprise ontologies from disparate SaaS sources, using deterministic entity resolution with AI-assisted descriptions, validated via snapshot-versioned SQL pipelines and human review.
Data AgentDuckDBHelix Foundry
0 likes · 24 min read

Helix Foundry connects Postgres, Stripe, WorkOS, and PostHog into a unified ontology graph on your laptop, runs analytical queries via DuckDB, and answers questions with a local LLM — all without accounts, deployment, or cloud dependencies.
DuckDBHelix FoundryHelixDB
0 likes · 17 min read

The article presents a curated list of ten Python libraries—Polars, Pandera, DuckDB, Rich, Pydantic, MLflow, tqdm, pyinstrument, RapidFuzz, and sqlite-utils—each chosen for its ability to eliminate specific bottlenecks, reduce errors, and turn guesswork into verifiable steps in data workflows, complete with concrete code examples and practical trade‑offs.
Data EngineeringDuckDBMLflow
0 likes · 15 min read

This comprehensive DuckDB tutorial explains why loading large CSV files into Pandas is inefficient, demonstrates how DuckDB can query CSV, Parquet, and JSON directly, walks through SQL basics, advanced features like window functions and CTEs, compares performance against Pandas on ten‑million‑row datasets, and provides practical tips for tuning, common pitfalls, and when to choose DuckDB for data analysis.
DuckDBPandasParquet
0 likes · 28 min read

A head‑to‑head benchmark on a 2.3 GB CSV (~1.2 million rows) shows Pandas exhausting memory, Polars completing the pipeline in 8.7 seconds with modest RAM, and DuckDB answering the same query in just 12 milliseconds, highlighting distinct trade‑offs for Python data processing.
CSVDuckDBPandas
0 likes · 11 min read


ITPUBJul 2, 2026 · Industry Insights
The article compares four emerging data‑lake‑for‑PostgreSQL solutions—Databricks LTAP, EDB Fusion Analytics, Snowflake pg_lake, and pgEdge's ColdFront—highlighting ColdFront's unique transparent Iceberg layer, writable cold data, DuckDB integration, and the strategic trade‑offs developers must weigh when choosing a modern OLTP/OLAP/AI architecture.
Agentic AIColdFrontDuckDB
0 likes · 9 min read

When attribution analysis on over 900 million rows slowed to more than 40 seconds and threatened cluster stability, Ctrip's smart attribution team rebuilt the architecture with Ray and DuckDB, achieving sub‑15‑second query times, 160 % performance gain, and complete resource isolation.
DuckDBKubernetesRay
0 likes · 22 min read

This article shows how to replace manual grep searches on massive log files with six Python libraries—pygrok, drain3, datasketch, rapidfuzz, duckdb, and adtk—providing structured parsing, automatic clustering, near‑duplicate detection, fuzzy matching, SQL querying, and time‑series anomaly detection, all illustrated with real code examples and practical tips.
DuckDBPythonRapidFuzz
0 likes · 12 min read

This article explains how a DuckDB‑backed observability plugin transforms opaque OpenClaw AI agent responses into structured, searchable traces, enabling developers to see every hidden step, diagnose issues within seconds, and iteratively improve the system based on concrete metrics.
AI observabilityDuckDBOpenClaw
0 likes · 12 min read


ITPUBMar 27, 2026 · Databases
In 2026 the database ecosystem faces fierce competition between MySQL and PostgreSQL, while AI emerges as a new driver prompting open‑source projects like AliSQL to release DuckDB, vector engines and intelligent CLI, reshaping how relational databases serve both transactional and analytical workloads.
AIAliSQLDuckDB
0 likes · 15 min read

This article introduces six Python libraries—pygrok, drain3, datasketch, rapidfuzz, duckdb, and adtk—that transform massive, unstructured log streams into structured, searchable, and analyzable data, showing concrete code examples, performance gains, and practical tips for real‑world troubleshooting.
DuckDBPythonRapidFuzz
0 likes · 12 min read


TonyBaiMar 13, 2026 · Backend Development
The article analyzes why traditional row‑oriented databases struggle with high‑volume analytics, introduces DuckDB as an embedded columnar engine for Go, presents benchmark results of up to 18.6 M rows per second writes and 6 M rows per second scans, walks through the Appender API code, and outlines the trade‑offs and ideal hybrid architecture.
DuckDBGoOLAP
0 likes · 11 min read

This article explains how OpenClaw’s Skill system gives AI executable instructions, combines it with a DuckDB analytical instance, and builds a fully automated e‑commerce behavior forecasting pipeline that iteratively trains, validates, and optimizes models to achieve sub‑10% prediction error.
AI automationDuckDBE‑Commerce Forecasting
0 likes · 17 min read

AliSQL integrates DuckDB as its storage engine to achieve high‑density columnar compression and fast analytical scans, detailing DuckDB’s multi‑layer storage format, adaptive compression algorithm selection, performance benchmarks versus InnoDB, HBase, ClickHouse, OceanBase, and the engineering optimizations AliSQL adds for throughput and cost reduction.
AliSQLData CompressionDuckDB
0 likes · 12 min read


ITPUBFeb 7, 2026 · Databases
The article examines why MySQL’s transaction layer remains robust while its analytical capabilities lag, outlines enterprise demands for simultaneous OLTP and OLAP workloads, introduces DuckDB’s lightweight yet powerful engine, describes AliSQL’s integration of DuckDB for full MySQL compatibility, and presents TPCH benchmark results showing a dramatic performance boost for analytical queries.
AliSQLDuckDBMySQL
0 likes · 23 min read

The article explains why CSV becomes a bottleneck for large‑scale data, demonstrates how Parquet’s columnar, typed, and compressed format dramatically reduces storage, speeds up reads, and improves data safety, and provides step‑by‑step Python code for migrating and benchmarking the switch.
CSVData EngineeringDuckDB
0 likes · 18 min read

This article presents seven practical DuckDB SQL patterns—querying files directly, treating partition folders as tables, deduplicating with QUALIFY, computing rolling metrics with window functions, pivot/unpivot, handling JSON arrays, and exporting results to Parquet—plus tips and a mini case study that show how to turn a notebook into a lightweight OLAP engine without leaving the Python environment.
DuckDBJSONParquet
0 likes · 12 min read

DuckDB's DuckLake is an open‑standard, SQL‑driven data lake and catalog format that simplifies lakehouse architecture by managing metadata in a database while storing data in scalable Parquet files, offering multi‑user collaboration, time‑travel queries, and MIT licensing.
DuckDBParquetdatabases
0 likes · 4 min read

This article demonstrates how to create a lightweight, offline MySQL CVE scanning and reporting tool by cloning the CVEProject JSON repository, leveraging DuckDB for fast JSON parsing and SQL queries, and providing simple shell commands for data updates, version scanning, and vulnerability matching.
CVEDuckDBMySQL
0 likes · 6 min read

This article introduces DeepSeek Smallpond, a lightweight yet high‑performance AI data‑processing engine built on Ray and DuckDB, explains its dual Dataframe and LogicalPlan APIs, showcases integration with Volcano Engine's AI Data Lake LAS, and provides practical code examples for distributed processing, multimodal storage, and RAG pipelines.
AI data processingDuckDBLance
0 likes · 18 min read

This article explains how integrating DuckDB as an extension for RDS PostgreSQL creates a unified HTAP solution that dramatically accelerates complex analytical queries through columnar storage, vectorized execution, and advanced optimizer techniques, delivering up to hundreds‑fold performance improvements and superior compression.
AnalyticsColumnarDuckDB
0 likes · 11 min read

This guide explains how to export MongoDB collections to JSON, load them into DuckDB, generate compatible table schemas, and then transfer the data efficiently into MySQL using DuckDB as an intermediate processing engine.
DuckDBETLJSON
0 likes · 6 min read

On June 3, 2024 DuckDB announced its 1.0.0 "Snow Duck" release, highlighting a custom single‑file storage format with full transaction semantics, backward compatibility, massive community adoption, and a roadmap focused on stability, extensions, and continued open‑source development.
AnalyticsDuckDBSQL
0 likes · 6 min read

The article introduces DuckDB, a high‑performance embedded analytical database, outlines its new release’s storage, performance, and memory improvements, describes its C/C++ integration and build process, and lists key feature changes such as parallel execution, novel compression methods, and enhanced SQL capabilities.
CompressionDuckDBParallelism
0 likes · 3 min read
