Tagged articles
LLM fine-tuning
27 articles · Page 1 of 1
This comprehensive guide covers the full enterprise SFT lifecycle: data preparation, LoRA/QLoRA algorithm selection, hardware planning, training configuration with LlamaFactory, loss masking, evaluation via LLM-as-a-Judge, weight merging, vLLM deployment, and troubleshooting common failures.
Catastrophic ForgettingData EngineeringDeepSpeed
0 likes · 75 min read

NVIDIA integrated Palantir Ontology and Nemotron into its supply chain to capture human planner decisions, creating a decision loop where a 30B MoE model trained on decision trajectories outperformed larger models by 31 percentage points on allocation accuracy, proving that decision data—not just optimization—drives AI value in complex operations.
Decision LoopLLM fine-tuningNVIDIA
0 likes · 19 min read

Teams building LLM‑powered products often hit a wall where 30‑40% of responses are wrong and the model never learns from mistakes; the article explains how modern fine‑tuning using GRPO‑based reinforcement learning and the open‑source ART framework, together with the RULER reward‑free evaluator, lets small open‑source models surpass larger ones in cost, latency, and accuracy.
ART frameworkGRPOLLM fine-tuning
0 likes · 9 min read

The article walks through a JD interview scenario where a candidate explains how a tool‑calling accuracy metric rose from 71% to 94% by detailing the full SFT data‑engineering pipeline, teacher‑model trajectory generation, quality validation, evaluation methodology, and interview‑ready talking points.
Data EngineeringFunction CallingLLM fine-tuning
0 likes · 19 min read

This tutorial explains the concepts, methods, and practical commands for fine‑tuning large language models using efficient techniques like LoRA and QLoRA, covering model selection, resource considerations, Docker deployment, dataset preparation, training configuration, evaluation metrics, model merging, and deployment with GGUF and Ollama.
GGUFGPU memory optimizationLLM fine-tuning
0 likes · 27 min read

Unsloth‑MLX leverages Apple’s MLX framework to let Mac users with Apple Silicon fine‑tune large language models locally with a single import change, offering zero‑cost migration to cloud GPUs, supporting SFT, DPO, ORPO, GRPO training, and export to HuggingFace or GGUF formats.
Apple SiliconGPU cloudLLM fine-tuning
0 likes · 4 min read

This article shares practical experience on deploying private Agentic AI, covering background, architecture design, challenges, data generation, reinforcement learning with DPO, automated multi‑dimensional evaluation, and future plans for open‑source models and richer tool integration.
Agentic AIDPOLLM fine-tuning
0 likes · 16 min read

This article analyzes why standard reinforcement learning can degrade Pass@K metrics after fine‑tuning large language models, introduces a risk‑sensitive RL objective that reshapes the advantage estimator, and demonstrates through bandit and mathematical‑reasoning experiments that the RS‑GRPO method consistently boosts diversity and overall Pass@K scores across multiple LLMs.
Exploration-ExploitationLLM fine-tuningRS-GRPO
0 likes · 12 min read

This tutorial walks through installing Python dependencies, preparing a JSON‑based QA dataset, and using Hugging Face's PEFT library to fine‑tune a small FLAN‑T5 model so it can answer questions about AC/DC and other bands without passing knowledge at inference time.
FAQ modelHugging FaceLLM fine-tuning
0 likes · 12 min read

This tutorial provides a systematic overview of gradient‑based multi‑objective optimization for deep learning, covering core solution strategies, algorithmic details, convergence and generalization analyses, and demonstrates how these methods can be applied to fine‑tune and align large language models.
Gradient MethodsLLM fine-tuningMulti-Objective Optimization
0 likes · 3 min read


21CTOAug 30, 2025 · Artificial Intelligence
This article presents a curated list of ten open‑source AI tools—from instant prototyping agents and reactive notebooks to fast LLM fine‑tuning, ethical hacking assistants, local ChatGPT interfaces, and database‑integrated machine learning—explaining their key features, benefits, and why developers should adopt them to boost productivity and maintain privacy.
AI coding assistantLLM fine-tuningdeveloper tools
0 likes · 19 min read

This article explains how low‑rank adaptation (LoRA) and its quantized variant (QLoRA) compress large language model weights, reduce training cost, and enable flexible adapter switching, while detailing matrix decomposition, training mechanics, and trade‑offs with concrete examples and quantitative analysis.
AdapterLLM fine-tuningLoRA
0 likes · 11 min read


Amap TechMay 19, 2025 · Artificial Intelligence
The article introduces Group Policy Gradient (GPG), a reinforcement‑learning framework that eliminates surrogate loss functions and critic models, directly optimizes the original objective, reduces bias and variance, and achieves state‑of‑the‑art performance on both single‑modal and multimodal tasks.
AI researchLLM fine-tuningReinforcement Learning
0 likes · 7 min read

This article explains the challenges of fine‑tuning large language models, why Argo Workflows is an ideal Kubernetes‑native solution, and provides a step‑by‑step example using DeepSeek, covering data preparation, model selection, training, evaluation, and the benefits of automation and scalability.
AI pipelinesArgo WorkflowsLLM fine-tuning
0 likes · 8 min read

The article introduces Easy DataSet, an open‑source tool that streamlines the creation of domain‑specific datasets by aggregating public data sources, chunking Markdown documents, generating and managing QA pairs with configurable LLM endpoints, and exporting them in common formats, while outlining its architecture and future roadmap.
AIData ManagementLLM fine-tuning
0 likes · 30 min read

This article provides a comprehensive guide to customizing pre‑trained large language models through fine‑tuning techniques—including parameter‑efficient methods, data preparation, knowledge injection, and robust evaluation—offering practical steps, best practices, and domain‑specific considerations for achieving superior task performance.
LLM fine-tuningParameter-Efficient Fine-Tuningdata preparation
0 likes · 18 min read


ArchitectMar 9, 2025 · Artificial Intelligence
The author reports a series of reinforcement‑learning‑based fine‑tuning experiments on a 0.5‑billion‑parameter Qwen‑0.5VB instruct model using the KK dataset, detailing reward design adjustments, curriculum‑style data scaling, observed convergence issues, and hypotheses about why small models fail to develop long reasoning chains.
LLM fine-tuningReinforcement LearningReward Design
0 likes · 11 min read

This article demonstrates the before-and-after effects of fine‑tuning a large language model, explains the concept with analogies, details hardware setup, dataset preparation, LoRA configuration, training arguments, and provides complete Python code for a pure‑framework fine‑tuning workflow.
HuggingFaceLLM fine-tuningLoRA
0 likes · 24 min read


DevOpsMay 29, 2024 · Artificial Intelligence
This article presents an end‑to‑end approach for building task‑oriented dialogue agents by simulating user behavior with Monte Carlo methods, generating training data via LLMs, and efficiently fine‑tuning multiple large language models using LLaMA Factory, demonstrating significant improvements in intent recognition, slot filling, and contextual understanding.
Data GenerationLLM fine-tuningMonte Carlo simulation
0 likes · 17 min read

This article provides a comprehensive tutorial on fine‑tuning the Qwen‑14B large language model, covering the motivation, fine‑tuning concepts, step‑by‑step workflow, required code, DeepSpeed training parameters, testing scripts, and deployment using FastChat and the 360AI platform.
AI model deploymentDeepSpeedFastChat
0 likes · 9 min read


NewBeeNLPFeb 22, 2024 · Artificial Intelligence
This article shares hands‑on guidance on using continual pre‑training (CPT), supervised fine‑tuning (SFT), and LoRA adapters for large language models, covering dataset size requirements, learning‑rate scheduling, warm‑up ratios, epoch strategies, and practical routing choices based on real‑world experiments.
CPTLLM fine-tuningLoRA
0 likes · 12 min read


NewBeeNLPFeb 5, 2024 · Artificial Intelligence
HiFT introduces a layer‑wise hierarchical fine‑tuning strategy that freezes most parameters per step, reduces optimizer state memory, and adapts mixed‑precision training, enabling 7B and 13B models to be fine‑tuned on 16‑31 GB GPUs while maintaining competitive performance.
GPU memoryHiFTLLM fine-tuning
0 likes · 12 min read

This article explores the emerging enterprise knowledge assistant paradigm in the era of large models, detailing traditional knowledge management challenges, solution architecture using vector databases and LLMs, core technologies such as ETL pipelines, reranking, secure fine‑tuning, and future prospects for intelligent enterprise applications.
LLM fine-tuningSemantic SearchVector Database
0 likes · 11 min read

The second Baidu Search Innovation Contest attracted over 2,800 participants from 45 regions, featured five AI‑focused tracks, and highlighted champion teams that employed techniques such as Lora‑fine‑tuned LLMs, vector‑intersection Top‑K search, GPU‑optimized algorithms, and diffusion‑based image generation to push the boundaries of search technology.
AI competitionGPU optimizationLLM fine-tuning
0 likes · 12 min read

The article explains prompt engineering techniques, supervised fine‑tuning of large language models, and their practical deployment in the Mobile Tmall AI shopping assistant, detailing ChatGPT’s generation steps, Transformer architecture, prompt clarity, delimiters, role‑play, few‑shot and chain‑of‑thought prompting, SFT versus pre‑training, LoRA adapters, data collection, Qwen‑14B training configuration, SDK‑based inference, and comprehensive evaluation.
AI assistantLLM fine-tuningPrompt engineering
0 likes · 14 min read

This article explains how to restructure multi‑turn dialogue data into single session‑level training samples for decoder‑only large language models, leveraging causal attention and simple position IDs, and provides a concrete implementation, performance results, and a gradient‑weight analysis.
ChatGLM2LLM fine-tuningPrompt engineering
0 likes · 7 min read


phodalApr 12, 2023 · Artificial Intelligence
This article explores four distinct fine‑tuned LLaMA/ChatGLM approaches for AI‑assisted code generation—example‑based, test‑driven, metadata‑augmented, and information‑matching—detailing their training data, prompts, sample inputs and outputs, and evaluating their strengths, limitations, and suitable application scenarios.
AI code generationLLM fine-tuningcode synthesis
0 likes · 11 min read
