Tagged articles
SFT
54 articles · Page 1 of 1
This comprehensive guide covers the full enterprise SFT lifecycle: data preparation, LoRA/QLoRA algorithm selection, hardware planning, training configuration with LlamaFactory, loss masking, evaluation via LLM-as-a-Judge, weight merging, vLLM deployment, and troubleshooting common failures.
Catastrophic ForgettingData EngineeringDeepSpeed
0 likes · 75 min read

Peking University and Google's Harness-Zero introduces agent-as-harness, where a harnessing agent reviews and corrects a student agent's actions using an evolved reference harness, then distills the corrected trajectories into the student model via SFT, achieving 90% relative improvement on a 9B model without external scaffolding at deployment.
AI agentsGoogleHarness-Zero
0 likes · 9 min read


Amap TechSep 23, 2026 · Artificial Intelligence
Amap details its system for extracting navigation landmarks from street-view imagery using multimodal large models, covering data annotation standards, a three-stage training pipeline (SFT, DPO, GRPO with a risk-aware reward), bounding-box-free evaluation, offline production, online integration, and A/B tests showing 23.5% faster user departure.
DPOGRPOSFT
0 likes · 26 min read


Geek LabsSep 5, 2026 · Artificial Intelligence
This article reviews an open-source book 'Deep Understanding of AI Agent' that structures AI Agent engineering around the formula Agent = LLM + Context + Tools, offering 10 chapters and 103 runnable Python experiments covering context engineering, memory, tool use, multi-agent collaboration, and model post-training.
AI AgentLLMMCP Protocol
0 likes · 11 min read

The article explains that forward KL encourages a student model to cover all major teacher modes, whereas reverse KL seeks a single dominant mode, and shows why online reinforcement learning methods like OPD and RLHF adopt reverse KL while offline SFT distillation relies on forward KL.
KL DivergenceOPDRLHF
0 likes · 7 min read

The article explains how using -100 as an ignored label in PyTorch cross‑entropy loss silently masks non‑assistant tokens, how to locate assistant spans via prefix‑difference, the trade‑offs between supervising only the final reply versus all assistant turns, and the essential pre‑training checks to avoid hidden masking errors in multi‑round SFT.
LLMPyTorchSFT
0 likes · 14 min read

UniNote introduces a unified multimodal embedding model that combines representation learning and ranking optimization in a single forward pass, using a two‑stage SFT‑then‑RL training paradigm and Matryoshka Representation Learning to achieve competitive Item‑to‑Item retrieval performance while reducing latency.
Item2ItemMatryoshka Representation LearningMultimodal Retrieval
0 likes · 12 min read

Reproducing the ACL 2026 paper on Incomplete Learning Phenomenon shows that about 15.3% of SFT training samples remain unlearned despite low loss, and the authors' Multiple‑Choice conversion with pass@5 detection uncovers five root causes and effective remediation strategies.
ILPKnowledge gapsLLM Evaluation
0 likes · 13 min read

AgentDoG 1.5 expands AI‑agent safety from final replies to complete execution trajectories, introducing the ATBench family for fine‑grained evaluation, a taxonomy‑guided DataEngine for high‑quality data generation, and demonstrating substantial safety gains in both SFT/RL training and online guardrail deployment with lightweight models.
AI safetyATBenchAgentDoG
0 likes · 14 min read

The article outlines a practical pipeline for creating agentic factual SFT and mid‑train datasets, covering how to define training goals, filter and classify queries, label processing tags, format trajectory samples, differentiate SFT from mid‑train data, and avoid common pitfalls when generating evidence‑driven AI training data.
Agentic AIData SynthesisSFT
0 likes · 10 min read

EDCO, Huawei’s entropy‑based dynamic curriculum method, continuously selects the most uncertain samples for domain‑specific LLM fine‑tuning, achieving higher accuracy and more stable gradients across communication, medical, and legal tasks while cutting entropy‑estimation cost by over 80 %.
EDCORLFTSFT
0 likes · 11 min read

This article outlines a systematic approach for creating agentic factual SFT and Mid‑train data, covering the definition of training goals, query filtering, two‑layer classification and labeling, trajectory format, differences between Mid‑train and SFT, a practical synthesis pipeline, and common pitfalls to avoid.
Agentic AIData SynthesisSFT
0 likes · 11 min read

The article walks through a JD interview scenario where a candidate explains how a tool‑calling accuracy metric rose from 71% to 94% by detailing the full SFT data‑engineering pipeline, teacher‑model trajectory generation, quality validation, evaluation methodology, and interview‑ready talking points.
Data EngineeringFunction CallingLLM fine-tuning
0 likes · 19 min read


SuanNiMay 5, 2026 · Artificial Intelligence
A systematic experiment by the Oxford Internet Institute shows that adding a friendly, empathetic personality to large language models via supervised fine‑tuning dramatically raises factual error rates—especially under emotional prompts—while cold, concise tuning leaves accuracy intact.
AI safetyHallucinationNature study
0 likes · 9 min read

The 360 AI Research Institute tackled the zero‑tolerance translation demands of airline maintenance by building a specialized parallel corpus and applying RAG‑enhanced, SFT‑fine‑tuned, and RL‑reinforced models, raising Chinese‑to‑English translation accuracy from 70% to 96% and enabling a one‑month rollout.
AI translationRAGReinforcement Learning
0 likes · 5 min read

The preview model Qwopus3.6-27B‑v1, distilled from Claude Opus onto Qwen3.6‑27B using SFT with the Unsloth stack and a curated 12 K high‑quality inference sample set, is evaluated on agentic reasoning, front‑end design, and Canvas/WebGL tasks with an RTX 5090, and can be deployed locally via llama.cpp GGUF quantizations with detailed memory guidelines.
Apache 2.0Claude OpusGGUF
0 likes · 7 min read


CodeTrendApr 24, 2026 · Artificial Intelligence
The article explains why pretrained LLMs cannot call tools, then breaks down the three‑stage training pipeline—Supervised Fine‑Tuning, Reinforcement Learning from Human Feedback, and knowledge distillation—showing how each step teaches models to read tool schemas, decide when to invoke a tool, generate JSON calls, and finally transfer the capability to smaller models with LoRA.
AI TrainingFunction CallingLLM
0 likes · 19 min read

SePT (Self‑evolving Post‑Training) shows that a large language model can improve its mathematical reasoning ability by about ten percentage points using a reward‑free online self‑training loop that decouples generation temperature from standard SFT, matching or surpassing RL‑based methods without harming general performance.
LLMMathematical ReasoningSFT
0 likes · 9 min read

The article presents a generative retrieval framework that anchors on a product‑side explicit semantic space, uses single‑sided query alignment, multi‑stage LLM‑driven attribute extraction, schema standardization, and 14B model SFT + DPO training to achieve interpretable, controllable, and high‑performance e‑commerce search.
DPOLLMSFT
0 likes · 29 min read

This article systematically reviews the core post‑training techniques for large language models—including supervised fine‑tuning, RLHF, PPO, GRPO, DPO, RLVR and Agentic RL—explains their evolution, compares their trade‑offs, and highlights the most promising research directions for 2025‑2026.
AI AlignmentGRPOLLM
0 likes · 20 min read

The authors show that high SFT accuracy does not guarantee strong RL performance because over‑fitting reduces output diversity, and they propose Adaptive Early‑Stop Loss (AESL), a diversity‑aware early‑stopping objective that dynamically weights token and subsequence losses, yielding consistently better RL results on multiple LLMs and math benchmarks.
AESLLLMMathBenchmarks
0 likes · 11 min read

This guide maps the end-to-end process for building a small AI model—from leveraging open-source base models and applying SFT with LoRA/QLoRA, through alignment techniques like DPO or ORPO, to low-cost distillation and final quantization for local deployment, while recommending free GPU resources and essential tooling.
AILoRAQLoRA
0 likes · 12 min read

The article breaks down how AI product managers can transform a raw base model into a market‑ready, high‑impact product by applying supervised fine‑tuning, tool‑use routing, RLHF alignment, and chain‑of‑thought reasoning, while highlighting trade‑offs, cost shifts, and evaluation metrics.
RLHFSFTartificial intelligence
0 likes · 13 min read

This article critically examines recent RL‑for‑LLM studies, revealing that reinforcement learning improves search efficiency but does not extend the intrinsic reasoning capabilities of base models, and explores the underlying model‑conditioned optimization bias, comparisons with SFT distillation, and the trade‑off with catastrophic forgetting.
Catastrophic ForgettingLLMReinforcement Learning
0 likes · 11 min read


Amap TechNov 19, 2025 · Artificial Intelligence
Gaode transforms its map app into a dynamic, AI‑driven “living map” by fine‑tuning the large Spacetime‑GR model through embedding‑based and generative ranking SFT, DPO alignment, and multimodal augmentation, achieving significant offline CTR‑AUC improvements and online CTR gains in POI recommendation.
AI recommendationDPOSFT
0 likes · 12 min read

The article examines the fundamental similarity between SFT and RL loss functions for large language models, explains why RL training is prone to instability, discusses infrastructure and data quality challenges, and reviews practical tricks and reward‑model considerations for more reliable RL fine‑tuning.
AILLMReinforcement Learning
0 likes · 11 min read

This article explains Meta's LLaMA model series, detailing LLaMA 2's architectural innovations—RMSNorm, SwiGLU, rotary positional encoding, and grouped-query attention—and LLaMA 3's post-training pipeline including supervised fine-tuning, reward modeling, rejection sampling, and direct preference optimization.
DPOGrouped-Query AttentionLLM Architecture
0 likes · 10 min read

This article details how Bilibili’s multimedia lab leveraged a multimodal training pipeline combining data‑compressed SFT and the GRPO reinforcement‑learning algorithm to achieve a 13.5% metric boost and secure second place in the ICCV MIPI Detailed Image Quality Assessment competition.
GRPOMIPI competitionReinforcement Learning
0 likes · 15 min read

This article examines the necessity of integrating Supervised Fine‑Tuning (SFT) with Reinforcement Learning (RL) for large language models, surveys alternating, sample‑reuse, simultaneous, and hint‑guided fusion methods, presents the underlying loss functions, and discusses practical trade‑offs such as entropy collapse and importance‑sampling corrections.
AILLMRL
0 likes · 14 min read

This article walks through installing Alibaba's WebDancer agent, explains its SFT‑plus‑RL training pipeline—including data construction, trajectory sampling, supervised fine‑tuning, and reinforcement learning—compares it with the earlier WebWalker, and demonstrates its multi‑step reasoning on a real‑world query.
AI AgentAlibabaLLM Agents
0 likes · 10 min read

This guide explains how to use the EasyDistill framework and Alibaba Cloud PAI to distill large language models for high‑quality text generation, covering model deployment, SFT and DPO training data construction, code examples, configuration files, and best practices for achieving resource‑efficient, high‑performance student models.
DPOEasyDistillPAI
0 likes · 14 min read

This article explains post‑training concepts, compares SFT, DPO, and GRPO fine‑tuning methods, and provides step‑by‑step guidance for using Alibaba Cloud's PAI platform—including Model Gallery and DSW—to fine‑tune large language models with code examples and practical tips.
DPOGRPOLLM
0 likes · 14 min read

In an interview at the DA Digital Intelligence Conference, ByteDance AI specialist Cai Conghuai explains how large language models, combined with techniques like SFT, DPO, and RAG, are reshaping Douyin's user‑experience signal detection, root‑cause analysis, and evaluation, while outlining future AI‑agent breakthroughs.
AIDPORAG
0 likes · 12 min read

In a detailed interview, Vivo AI engineer Liang Tianan explains how the BlueHeart Small V assistant leverages large language models, multi‑stage recall, ranking, and reward‑model fine‑tuning (SFT/DPO) to generate high‑quality, diverse post‑dialogue recommendation items while balancing latency, cost, and evaluation challenges.
DPOLLMSFT
0 likes · 15 min read

The article analyzes the DAPO technical report, showing how dynamic‑sampling pipelines and token‑level loss handling in SFT and RL training outperform ad‑hoc algorithm tricks, and compares the training dynamics of reinforce_baseline and GRPO with concrete code examples.
Dynamic SamplingGRPOLLM
0 likes · 8 min read

We built an LLM‑powered system for Bilibili that automatically creates ad titles from user keywords, employing fluency, style, and quality classifiers, mixed domain data cleaning, and alignment methods such as SFT, DPO and KTO, resulting in a product that now generates about ten percent of daily titles and drives significant ad spend.
AI AlignmentAd Title GenerationBilibili
0 likes · 24 min read

This guide explains when to rely on prompt engineering versus SFT fine‑tuning for Vision‑Language Models, emphasizing data quality, appropriate dataset sizes, training epochs, hyper‑parameter tuning, and practical steps to build robust VLM pipelines.
AIDPOPrompt engineering
0 likes · 10 min read

Cleaning SFT data for LLMs is surprisingly complex, as subtle JSON formatting variations, inconsistent markdown wrappers, intent settings, and unit handling can cause model inconsistencies, requiring unified standards, careful prompt design, and extensive manual review to ensure reliable training outputs.
JSON FormattingLLM data cleaningModel Training
0 likes · 8 min read

This article provides a comprehensive, experience‑driven guide to supervised fine‑tuning (SFT) of large language models, covering special tokens, latency considerations, data diversity and production, training frameworks and hyper‑parameters, over‑/under‑fitting diagnostics, and evaluation metrics such as helpfulness, honesty, and harmlessness.
AIData EngineeringLLM
0 likes · 40 min read


NewBeeNLPSep 5, 2024 · Artificial Intelligence
The article analyzes why supervised fine‑tuning (SFT) cannot replace reinforcement learning from human feedback (RLHF), highlighting SFT's lack of negative feedback and backward‑looking capability, and explains how RLHF’s reward model addresses these fundamental shortcomings.
RLHFReward ModelingSFT
0 likes · 7 min read

The answer explains that joining a pre‑training team accelerates a newcomer’s engineering abilities through hands‑on work with large‑scale data pipelines, distributed training code, and debugging, while SFT teams focus mainly on data labeling, making pre‑training the more effective path for rapid skill growth.
AIEngineering SkillsPretraining
0 likes · 6 min read

The article analyzes why Reinforcement Learning from Human Feedback (RLHF) cannot be replaced by Supervised Fine‑Tuning (SFT), highlighting SFT's lack of negative feedback, its one‑directional attention limitation, and how RLHF's reward models provide crucial safety and performance improvements for large language models.
AI AlignmentRLHFSFT
0 likes · 9 min read

The answer argues that fresh graduates should join pre‑training teams because the required engineering tasks—large‑scale data crawling, Hadoop/Spark pipelines, torch and CUDA setup, megatron code debugging, and scaling‑law experiments—rapidly sharpen coding skills, while SFT work focuses mainly on data labeling and offers slower technical growth.
AI EngineeringPretrainingSFT
0 likes · 7 min read

The article breaks down multiple practical approaches for data preparation, training code handling, and experiment analysis in large‑language‑model fine‑tuning, showing how deeper engagement in each step can boost personal expertise even when final model performance appears similar.
LLMSFTTraining code
0 likes · 9 min read

Over the past year our team explored applying large language models to specialized domains, detailing their professional benefits, unique challenges such as accuracy and knowledge‑base maintenance, and presenting solutions like alignment enhancement via BPO, Text2API, RAG, and advanced SFT/DPO techniques.
RAGSFTText2API
0 likes · 10 min read

Alibaba’s logistics AI team shares their year‑long journey building a vertical‑domain large language model for logistics, detailing model alignment, Text2API, RAG, SFT techniques, challenges like accuracy and knowledge‑base maintenance, and showcasing real‑world applications such as chatbots, DingTalk assistants, and custom AI assistants.
RAGSFTText2API
0 likes · 16 min read

Vertical domain large language models, fine‑tuned on specialized data, deliver higher expertise and task performance, but require continual knowledge updates and careful alignment; techniques such as BPO‑guided instruction tuning (+1.8% accuracy), Reflexion‑based Text2API (+4% API correctness), advanced RAG preprocessing, and SFT combined with ORPO (+5.2% gain) demonstrate notable improvements while underscoring remaining challenges and collaborative opportunities.
AIRAGSFT
0 likes · 9 min read

This article details the design, implementation, and evaluation of an AI‑powered tool that automatically creates compliant Git commit messages by leveraging large language models, custom plugins, and performance‑focused optimizations to improve developer productivity and commit quality.
AICommit MessageGit
0 likes · 16 min read

This article presents a comprehensive overview of the development, training, data preparation, algorithmic strategies, evaluation methods, and RAG integration for a domain‑specific patent large language model, highlighting challenges, practical results, and future research directions.
Domain-specific ModelPatent AIRAG
0 likes · 19 min read

This article examines JD Retail's end‑to‑end large language model framework that combines supervised fine‑tuning, retrieval‑augmented generation, and ReAct‑based AI agents to overcome retail‑specific challenges, improve model accuracy, reduce hallucinations, and enable autonomous multi‑step business workflows.
AI AgentLLMRAG
0 likes · 20 min read


NewBeeNLPFeb 22, 2024 · Artificial Intelligence
This article shares hands‑on guidance on using continual pre‑training (CPT), supervised fine‑tuning (SFT), and LoRA adapters for large language models, covering dataset size requirements, learning‑rate scheduling, warm‑up ratios, epoch strategies, and practical routing choices based on real‑world experiments.
CPTLLM fine-tuningLoRA
0 likes · 12 min read

This article investigates how mixing data from mathematical reasoning, code generation, and general instruction-following tasks influences supervised fine‑tuning of LLaMA models, revealing distinct scaling curves, resource‑dependent performance conflicts, and a two‑stage DMT strategy that mitigates catastrophic forgetting while boosting overall capability.
DMT StrategyData ScalingLlama
0 likes · 14 min read

This article shares practical techniques for domain‑specific large model continue pre‑training, including data selection, mixing ratios with general data, multi‑task instruction pre‑training, resource‑aware fine‑tuning strategies, evaluation set design, vocabulary considerations, and deployment constraints for 7‑13B models.
AI researchModel EvaluationSFT
0 likes · 9 min read

Llama 2 advances open‑source large‑model research by expanding context length to 4096, adopting GQA attention, scaling training data to 2 trillion tokens, and introducing refined SFT and RLHF techniques such as Ghost Attention, margin‑based reward modeling, and iterative rejection sampling, all detailed in Meta’s 76‑page report.
Llama 2RLHFSFT
0 likes · 8 min read
