Tagged articles
hyperparameters
12 articles · Page 1 of 1
A new collaborative paper titled “There Will Be a Scientific Theory of Deep Learning” proposes a unified “Learning Mechanics” framework that connects solvable idealized models, tractable limits, empirical scaling laws, hyperparameter theory, and universal representation behavior, aiming to give deep learning a first‑principles scientific foundation.
deep learninghyperparameterslearning mechanics
0 likes · 14 min read

This guide walks you through interpreting training logs and loss curves, diagnosing common issues such as oscillation, under‑fitting, and over‑fitting, and applying concrete adjustments to learning rate, LoRA settings, batch size, and epochs, with scenario‑specific strategies to turn a novice into a tuning expert.
AI TrainingLoRAhyperparameters
0 likes · 23 min read

This article walks readers through the three major training methods—full‑parameter, LoRA, and QLoRA—explaining their memory costs, data requirements, and trade‑offs, then provides a line‑by‑line breakdown of LLaMAFactory configuration files, hyper‑parameter tuning guidelines, and the process for merging LoRA adapters into a deployable model.
LlamaFactoryLoRAModel Merge
0 likes · 27 min read

This guide shows how to fine‑tune the Amazon Nova Canvas foundation model on Amazon Bedrock using a 12‑hour workflow that extracts character frames from video with Amazon Rekognition, prepares labeled data, configures hyper‑parameters, creates a custom model, deploys it with provisioned throughput, and tests the model to generate coherent storyboard images, while also covering cleanup steps to avoid ongoing costs.
AI storyboardAmazon BedrockAmazon Nova Canvas
0 likes · 17 min read

This tutorial introduces linear regression fundamentals, explaining features, labels, weights, bias, and mean squared error loss, then demonstrates gradient descent optimization in PyTorch, reveals how unscaled features break convergence, and shows feature standardization fixing the problem.
Gradient DescentPyTorchfeature scaling
0 likes · 6 min read

The article analyses two months of community attempts to reproduce DeepSeek R1, highlighting that model scaling, high‑quality data, robust training infrastructure, and careful hyper‑parameter tuning outweigh pure reward‑based tricks, and it outlines common pitfalls and future research directions.
DeepSeekInfrastructureLLM
0 likes · 13 min read

The article enumerates a series of dubious techniques—from inflating batch sizes and hidden compute to hyper‑parameter tricks and fabricated evaluation methods—designed to artificially boost deep‑learning model scores on benchmarks, exposing how easy it is to game performance metrics.
AI tricksbenchmark cheatingdeep learning
0 likes · 9 min read


NewBeeNLPJul 31, 2024 · Artificial Intelligence
The article shares hands‑on experience training 7‑ and 13‑billion‑parameter language models, covering essential hyper‑parameters, hardware requirements, data quality considerations, open dataset resources, and the systemic difficulties that arise when scaling to trillion‑parameter models.
LLM traininghyperparameterslarge language models
0 likes · 8 min read

This article explores the role of hyperparameters in large language models, explains each key hyperparameter, and guides readers through manual and automated tuning methods such as random search, grid search, and Bayesian optimization to achieve optimal model performance.
AILLMModel tuning
0 likes · 18 min read


NewBeeNLPFeb 22, 2024 · Artificial Intelligence
This article shares hands‑on guidance on using continual pre‑training (CPT), supervised fine‑tuning (SFT), and LoRA adapters for large language models, covering dataset size requirements, learning‑rate scheduling, warm‑up ratios, epoch strategies, and practical routing choices based on real‑world experiments.
CPTLLM fine-tuningLoRA
0 likes · 12 min read

This article presents a comprehensive English summary of the deep learning specialization infographics originally shared by Andrew Ng, covering fundamentals, logistic regression, shallow and deep neural networks, regularization, optimization, hyperparameters, convolutional and recurrent networks, and practical advice for model building and evaluation.
CNNRNNRegularization
0 likes · 21 min read

This article explains the fundamentals of the Word2Vec SGNS model, details its hyper‑parameters and training tricks, and demonstrates how customized embeddings are built for rental‑listing and news‑article recommendation, covering data preparation, objective‑function redesign, evaluation, and deployment in both recall and ranking stages.
EmbeddingPersonalizationSGNS
0 likes · 14 min read
