Tagged articles
Loss Functions
13 articles · Page 1 of 1
This paper evaluates point‑wise, pair‑wise, and list‑wise loss functions for Transformer‑based stock‑return prediction on 110 S&P 500 stocks, showing that Margin loss achieves the highest annual return (16.23%) and Sharpe ratio (0.75), ListNet delivers strong returns with low volatility, and BPR minimizes maximum drawdown, highlighting how loss design critically shapes ranking‑driven portfolio performance.
Loss FunctionsTransformerfinancial time series
0 likes · 15 min read

Even as Agentic RAG evolves, the quality of the underlying retrieval embedding model remains crucial, and this article compares three training losses—pairwise cosine embedding, triplet margin, and InfoNCE—detailing their inputs, formulas, and practical trade‑offs.
AIEmbeddingInfoNCE
0 likes · 4 min read

This article systematically introduces the most common contrastive learning loss functions—including Contrastive Loss, Triplet Loss, N‑pair Loss, InfoNCE, and Cross‑Entropy—explaining their mathematical formulations, advantages, challenges, and typical applications in visual, textual, and multimodal representation learning.
Contrastive LearningInfoNCELoss Functions
0 likes · 10 min read

This article walks through the various loss functions used in OpenRLHF—including GPTLMLoss, KDLoss, DPOLoss, KTOLoss, and reward model losses—explaining their mathematical foundations, implementation details, and practical considerations for RLHF training.
DPOKTOLoss Functions
0 likes · 23 min read

This article explains the purpose of loss functions in machine learning and reviews the specific loss functions used by popular algorithms such as linear regression (MSE), logistic regression (cross‑entropy), decision trees, random forests, SVM (hinge loss), neural networks, and AdaBoost (exponential loss).
AIAlgorithmsLoss Functions
0 likes · 3 min read

This article provides a comprehensive overview of machine learning, covering fundamental concepts, key terminology, common algorithms for supervised, unsupervised, and reinforcement learning, model evaluation metrics, loss functions, and practical code examples such as random forest and SVM implementations.
AlgorithmsLoss FunctionsUnsupervised Learning
0 likes · 35 min read

This article explains ten widely used loss functions for regression and classification tasks, describes their mathematical definitions, compares their purposes, and provides complete Python code examples for each, helping readers understand how to select and implement appropriate loss metrics in machine‑learning models.
AIClassificationLoss Functions
0 likes · 10 min read

A lightweight real‑time super‑resolution network was created for the 2022 League of Legends S12 World Championship, using pixel‑unshuffle/shuffle, structural re‑parameterization, and a multi‑loss (L1, perceptual, Sobel‑based texture, GAN) training pipeline that upscales 1080p streams to 4K at 75 fps on a V100 GPU, delivering clearer textures and reduced noise while remaining computationally efficient.
Loss Functionsdeep learninggame streaming
0 likes · 10 min read

A real‑time super‑resolution network specially designed for the League of Legends S12 live broadcast upscales 1080p streams to 4K at 75 fps by compressing parameters, employing pixel‑unshuffle/shuffle, structural re‑parameterization, and a multi‑loss (L1, perceptual, Sobel, GAN) training pipeline, delivering markedly sharper textures and lower latency for live game streaming.
Loss Functionsdeep learninggame streaming
0 likes · 12 min read

This article surveys automated essay scoring (AES), compares handcrafted, deep‑learning, and pre‑trained language‑model approaches, proposes a multi‑scale BERT architecture with document, token, and segment features, introduces three combined loss functions, and demonstrates superior performance on the ASAP dataset and internal tasks.
ASAP datasetBERTLoss Functions
0 likes · 13 min read

The article reviews the Chinese NLP pre‑training model generalization competition, detailing data preprocessing, augmentation, external data usage, model scaling and architecture tweaks, loss functions, learning‑rate and adversarial training strategies, regularization techniques, post‑processing optimizations, and ineffective methods, highlighting their impact on performance metrics.
Data AugmentationLoss FunctionsNLP
0 likes · 15 min read

The article presents a series of insightful diagrams that illustrate core machine‑learning concepts such as the relationship between training and test error, the dangers of under‑ and over‑fitting, Occam’s razor, feature interactions, discriminative versus generative models, loss functions, least‑squares geometry, and sparsity.
Loss Functionsbias‑variancefeature engineering
0 likes · 6 min read

This article presents a curated collection of insightful machine‑learning diagrams that illustrate key concepts such as test versus training error, under‑ and over‑fitting, Occam’s razor, feature interactions, irrelevant features, basis functions, discriminative versus generative models, loss functions, least‑squares geometry, and sparsity.
Loss FunctionsOccam's razorfeature selection
0 likes · 6 min read
