Tagged articles
dataset construction
15 articles · Page 1 of 1
Researchers from Huawei, CUHK, and HKUST open-source LegoFlow, a framework that automates the entire code data pipeline—from mining 12M GitHub PRs to 5,000 verified tasks, generating 2,780 trajectories, and training models achieving 70.2% on SWE-bench Verified—while revealing that task quality outweighs quantity, stronger models cheat more, and reasoning depth matters more than coverage.
LLM trainingLegoFlowSWE-bench
0 likes · 18 min read

This article explains how high-quality data annotation requires defining annotation units, business rules, evidence requirements, and rejection criteria, then using double-blind annotation, disagreement classification, expert arbitration, and version governance to ensure correctness, rather than relying solely on inter-annotator agreement metrics.
Active LearningData Annotationbusiness rules
0 likes · 29 min read

The article explains why AI systems need four distinct data products—training sets, evaluation sets, RAG knowledge bases, and Agent contexts—each with separate purpose, structure, timeliness, isolation, and acceptance criteria, warning that reusing a single dataset creates false quality metrics and operational risks.
AI data productsAgent ContextData-Centric AI
0 likes · 20 min read

The article analyzes why data‑governance projects still fail when combined with AI, presents a four‑layer NL2SQL architecture, details agent responsibilities, metadata‑governance methods, anomaly‑diagnosis and permission‑control flows, outlines dataset‑building stages, evaluation metrics, and provides a step‑by‑step rollout roadmap.
AI agentNL2SQLanomaly detection
0 likes · 21 min read

This article examines the rapid surge of large AI models in 2024‑2025, critiques the reliability of public leaderboards, and presents a business‑focused evaluation framework—including dataset construction, metric selection, automation, and LLM‑as‑judge techniques—to help developers choose the right model for real‑world applications.
AI benchmarksAI performanceLLM-as-Judge
0 likes · 17 min read

This article outlines a systematic engineering workflow for creating professional domain fine‑tuning datasets for large models, covering data processing, validation, optimal sample size, industrial‑environment practices, and special considerations for reinforcement‑learning based fine‑tuning.
data processingdata validationdataset construction
0 likes · 7 min read

This guide walks readers through every stage of building high‑quality AI training datasets—from locating open‑source data and defining goals, through collection, annotation, cleaning, large‑scale processing, optional augmentation, and splitting, to validation—using a medical QA example for fine‑tuning DeepSeek‑R1.
AI fine-tuningData AugmentationPython
0 likes · 18 min read

This article provides an in‑depth review of alignment algorithms for multimodal large language models, covering application scenarios, dataset construction methods, evaluation benchmarks, current challenges, and future research directions, while summarizing contributions from leading academic institutions.
AI researchalignment algorithmsdataset construction
0 likes · 22 min read


ArchitectMar 24, 2025 · Artificial Intelligence
This article provides a systematic review of recent advances in multimodal alignment for large language models, covering key contributions, application scenarios, dataset construction, evaluation benchmarks, future challenges, and insights from LLM alignment research to guide both academia and industry.
AI safetyMLLMdataset construction
0 likes · 26 min read


AIWalkerMar 13, 2025 · Artificial Intelligence
VideoPainter introduces a plug‑and‑play dual‑branch framework with a lightweight context encoder and ID‑resampling adapter, built on the massive VPData/VPBench dataset, and demonstrates state‑of‑the‑art performance across eight video restoration and editing metrics, while supporting flexible model integration and long‑video consistency.
Dual-Branch ArchitectureID ConsistencyPlug and Play
0 likes · 18 min read


ArchitectFeb 22, 2025 · Artificial Intelligence
This article reviews the most notable open‑source reproductions of DeepSeek‑R1—including Open R1, OpenThoughts, LIMO and DeepScaleR—detailing their data pipelines, training steps, reinforcement‑learning strategies, dataset constructions, and benchmark results that demonstrate how small, high‑quality data can rival massive‑scale models.
AI researchDeepSeek-R1Model Scaling
0 likes · 26 min read

The article reviews recent automated quality assessment advances for AIGC image generation, including an aesthetic scoring framework with the APDD dataset and AANSPS network, a human‑preference benchmark (HPD v2 and HPS v2) that outperforms IS/FID, and the Pick‑Score model trained on user‑driven Pick‑a‑Pic data, all enabling faster, unbiased evaluation, cost savings, and more effective model iteration, with ongoing work in home‑improvement AI.
AIGCHuman Preferenceaesthetic evaluation
0 likes · 15 min read

The guide explains why generic LLMs struggle with enterprise tasks and outlines two remedies—retrieval‑augmented generation and domain‑specific fine‑tuning—detailing dataset creation, training strategies (full‑parameter, LoRA, Q‑LoRA), validation methods, hardware benchmarks, and practical tips such as supervised fine‑tuning, 30% domain data, and a stepwise tuning pipeline.
AIdataset constructiondomain-specific LLM
0 likes · 16 min read

This article presents a comprehensive guide on constructing domain-specific large language models, covering the differences from general models, how to build high‑quality domain datasets, selecting appropriate training methods, designing validation sets, evaluating model capabilities, and benchmarking domestic hardware performance.
AIDomain ModelModel Evaluation
0 likes · 20 min read

TDQA is a no‑reference, deep‑learning video quality assessment algorithm designed for live‑streaming, built on a large subjectively annotated dataset and an end‑to‑end architecture with fine‑tuned backbones, achieving state‑of‑the‑art accuracy and sub‑second inference for real‑time quality monitoring and pipeline optimization.
Model TrainingNo-ReferenceTDQA
0 likes · 15 min read
