Year-in-Review: Open-Source SQL LLM Benchmark, SQLE Updates, and Top DB Articles

1. SCALE Benchmark

On 2025‑06‑17 the open‑source SCALE framework was released to evaluate large‑language‑model (LLM) capabilities on SQL tasks. It measures three independent dimensions: SQL optimization, dialect translation, and SQL understanding. Scores are weighted toward high‑difficulty, high‑value queries.

Eight monthly leaderboards have been published, covering 19 mainstream models (e.g., GPT‑5, Claude Sonnet 4.5, Gemini 3 Pro, DeepSeek V3.2, Kimi‑K2). The leaderboard provides a professional, realistic standard for LLM SQL ability.

Expert commentary highlights

Comments emphasize challenges in database migration, the growing importance of AI‑driven SQL optimization, and a shift from “general champion” models to “scenario experts”.

December 2025 leaderboard (including Claude Opus 4.5, GPT‑5.2, Ling‑flash 2.0) will be released after the New Year.

2. SQLE Platform

SQL quality‑management platform SQLE released version 4.0 at the start of 2025 and accumulated ten incremental releases throughout the year. The “SQLE Little Classroom” video series now contains 15 episodes.

Upcoming release

A new update is planned for release after the New Year.

3. Selected technical articles (2025)

Flame Graph: Visualizing MySQL Performance Analysis – Shows how to combine EXPLAIN output with flame‑graph visualizations to locate bottlenecks in complex SQL.

MySQL DML Mistake Recovery: Flashback Tools Overview – Introduces flashback utilities for rolling back erroneous DML operations and outlines applicable scenarios.

pt‑slave‑repair for MySQL Replication Errors – Demonstrates fixing frequent 1032/1062 replication errors with minimal cost.

Why MySQL 8.0.13 Introduced sql_require_primary_key – Discusses the new parameter and its impact on data consistency.

2000× Performance Boost with Semi‑Join Rewrites – Case study of an OceanBase query rewritten to a semi‑join, reducing execution time from thousands of seconds to seconds.

Understanding MemFree vs MemAvailable in OceanBase – Analyzes out‑of‑memory messages and the difference between MemFree and MemAvailable metrics.

Open‑Source Migration from PolarDB PG to OB_Oracle – Outlines the migration workflow, challenges, and manual steps required.

Full‑Link Tracing in OceanBase 4.x – Describes the new tracing feature that speeds up latency diagnosis in the distributed database.

Batch SQL Timeout Cases and Cluster Management Tips – Shares a real‑world batch job that saturated I/O, causing RPC timeouts, and provides mitigation strategies.

Reverse Incremental Migration from MySQL to OceanBase – Details steps and precautions for pulling data back to MySQL after a forward migration, including reverse incremental replication.

4. Reference links

SCALE source code: https://github.com/actiontech/sql-llm-benchmark December 2025 leaderboard: https://sql-llm-leaderboard.com/ranking/2025-12 SQLE repository:

https://github.com/actiontech/sqle