Tagged articles
Contrastive Learning
92 articles · Page 1 of 1
The ICLR 2026 paper MoRA combines human mobility networks from transaction data with POI, satellite imagery, and demographics to learn 128-dimensional region embeddings, achieving top R² on 8 of 9 socioeconomic prediction tasks across China, showing mobility links provide information beyond geographic proximity.
Contrastive LearningGeospatial Representation LearningGraph Neural Networks
0 likes · 10 min read

Airbnb's CASTLE framework uses de-identified booking sessions to generate contrastive listing pairs, guiding LLMs to produce synthetic queries with inherent relevance labels, achieving KL divergence of 1.01 versus real user queries and 91–93% human agreement on label quality.
AirbnbCIKM 2026Contrastive Learning
0 likes · 13 min read

CLM-8B is a contrastive language model that maps states and actions to a shared vector space for fast decision-making, matching Jev's zero-shot performance on benchmarks like WikiRacing and Super Mario while being 9x faster, and serves as a verifier setting new SOTA on DeepSWE and Terminal-Bench with 4-5x speedup using decoupled encoders and vector caching.
CLM-8BContrastive LearningDecision Model
0 likes · 6 min read

MOON 3.0 shifts e-commerce multimodal representation from direct encoding to explicit attribute reasoning, using Multi-head Modality Fusion, joint contrastive and reinforcement learning, and fine-grained residual enhancement to improve fine-grained retrieval and classification across multiple benchmarks.
Contrastive LearningMLLMMOON 3.0
0 likes · 24 min read

The article details Meituan Search 3.0’s three‑phase journey—validating LLM‑based semantic vectors, rebuilding a systematic representation pipeline with contrastive learning and LoRA, and transferring the model to downstream item ranking—showing how 64‑dimensional cosine similarity features and multi‑scale embeddings consistently improve click, order and NDCG metrics across service‑retail search scenarios.
Contrastive LearningEmbeddingLLM
0 likes · 44 min read


AntTechJun 30, 2026 · Artificial Intelligence
FinixDoc is an end‑to‑end financial document parsing system built on a 4‑billion‑parameter Qwen3‑VL model that outperforms open‑source baselines on the newly released FinixDocBench, handling low‑quality, complex and ultra‑large documents through a specialized training pipeline and evaluation matrix.
Contrastive LearningFinixDocBenchQwen3-VL-4B
0 likes · 11 min read

The paper introduces the Spectral Disentanglement and Enhancement (SDE) framework, which uses singular value decomposition to separate strong semantic signals, weak auxiliary signals, and noise, applies curriculum‑based spectral enhancement, and jointly optimizes a dual‑domain contrastive loss, achieving markedly improved robustness and generalization on large‑scale multimodal benchmarks.
Contrastive Learningdual-domain lossmultimodal learning
0 likes · 14 min read

NOSE introduces a neural olfactory‑semantic embedding that unifies molecular structure, receptor sequences, and natural‑language odor descriptions into a continuous space, achieving state‑of‑the‑art results on eleven tasks and strong zero‑shot generalization for odor and receptor retrieval.
Contrastive LearningDeep LearningZero-Shot Learning
0 likes · 8 min read

The article explains how contrastive learning replaces fixed‑category visual training with a relationship‑based approach, detailing the dual‑encoder architecture, cosine similarity loss, batch scaling, temperature control, zero‑shot capabilities, scalability from web data, and the method's strengths and limitations in modern multimodal AI.
CLIPContrastive LearningZero-Shot Learning
0 likes · 25 min read


AntTechFeb 5, 2026 · Artificial Intelligence
This paper presents a lightweight, high‑efficiency framework called Triple Alignment with Rationale Generation (TAG) that transforms knowledge‑based visual question answering into a contrastive learning task, dramatically reducing trainable parameters while achieving state‑of‑the‑art performance on major KVQA benchmarks.
CLIPContrastive LearningVQA
0 likes · 7 min read

Relink introduces a ‘reason‑and‑construct’ paradigm that builds knowledge‑graph paths during inference, combining a high‑precision factual graph with a high‑recall potential‑relation pool, using query‑driven dynamic path expansion and contrastive alignment to markedly improve multi‑hop QA performance and robustness to sparse knowledge.
Contrastive LearningDynamic RetrievalGraphRAG
0 likes · 8 min read

This article explains CLIP’s dual‑encoder architecture, contrastive training, and zero‑shot inference, then demonstrates its use through image‑text matching and CIFAR‑10 classification experiments with code examples, highlighting strengths and limitations such as resolution mismatch.
CLIPContrastive LearningImage-Text Matching
0 likes · 11 min read

This article analyzes the Agentic‑R framework, which upgrades traditional single‑hop Retrieval‑Augmented Generation by introducing dual‑perspective scoring and a bidirectional flywheel, resulting in 2–3 absolute EM improvements across seven QA datasets and a 10–15% reduction in search rounds.
Agentic SearchContrastive LearningLLM
0 likes · 6 min read

By integrating large language models to dynamically construct user knowledge graphs and applying two‑hop reasoning, the authors enhance serendipity in a large‑scale e‑commerce community recommendation system, achieving significant online gains in diversity, novelty, and user engagement metrics.
Contrastive LearningLLMSerendipity
0 likes · 17 min read

Introducing C2LLM, a contrastive code LLM series that replaces mean and EOS pooling with a multi‑head attention pooling module, achieving top scores on the MTEB‑Code benchmark across 12 tasks and demonstrating cost‑effective, high‑precision code retrieval for both production and AI agent applications.
Code EmbeddingContrastive LearningMTEB-Code
0 likes · 8 min read

The paper introduces SSR, a novel multimodal recommendation framework that leverages graph Fourier transforms, energy‑balanced frequency bands, structured regularization, and low‑rank tensor decomposition to replace black‑box fusion with explainable, adaptive reasoning, achieving state‑of‑the‑art results on Amazon datasets and strong cold‑start performance.
Cold StartContrastive LearningGraph Neural Networks
0 likes · 15 min read

FreRA introduces a lightweight, plug‑in frequency‑refined augmentation that adaptively refines spectral components to preserve global semantics while injecting variance, dramatically improving contrastive learning performance on time‑series classification, anomaly detection, and transfer learning across multiple benchmark datasets.
Contrastive LearningData AugmentationRepresentation Learning
0 likes · 13 min read

This article details Baidu's generative recommendation ad recall framework, introducing the COBRA system and its three development stages—dense representation compression, sparse quantization with ID generation, and dense‑sparse cascading—highlighting coarse‑to‑fine inference, performance gains, long‑sequence extensions, online deployment, and future research directions.
Contrastive LearningGenerative AIad recall
0 likes · 18 min read

Dispersive Loss is a plug‑and‑play regularization technique that enhances diffusion‑based generative models by encouraging dispersed internal representations, requiring no additional pre‑training, parameters, or data, and consistently improves performance across various model sizes and configurations, as demonstrated through extensive experiments.
Contrastive LearningDispersive LossRegularization
0 likes · 18 min read

This article explains CLIP’s dual‑encoder architecture—using a Vision Transformer for images and a Transformer for text—how both encoders map inputs into a shared embedding space, the role of cosine similarity, and the InfoNCE contrastive loss that drives joint visual‑language learning.
CLIPContrastive LearningInfoNCE
0 likes · 8 min read

This article surveys six leading contrastive learning frameworks—SimCLR, MoCo, BYOL, SwAV, Barlow Twins, and NNCLR—detailing their loss functions, data‑augmentation pipelines, encoder architectures, and unique mechanisms such as momentum queues, twin networks, clustering swaps, and redundancy reduction, while highlighting their advantages and impact on self‑supervised vision research.
BYOLBarlow TwinsContrastive Learning
0 likes · 14 min read

This article systematically introduces the most common contrastive learning loss functions—including Contrastive Loss, Triplet Loss, N‑pair Loss, InfoNCE, and Cross‑Entropy—explaining their mathematical formulations, advantages, challenges, and typical applications in visual, textual, and multimodal representation learning.
Contrastive LearningInfoNCELoss Functions
0 likes · 10 min read

This article explains contrastive learning for visual language models, covering its definition, four‑step workflow, how to choose positive and negative pairs, the difference between supervised and self‑supervised variants, and why the technique is essential for zero‑shot and cross‑modal capabilities.
Contrastive LearningData AugmentationRepresentation Learning
0 likes · 6 min read

This article introduces visual‑language models (VLMs), explaining how they combine large language models with visual encoders, why they overcome the rigidity of traditional computer‑vision systems, their key advantages, modular architecture, training methods, and practical applications such as image captioning and visual question answering.
AI applicationsComputer VisionContrastive Learning
0 likes · 8 min read

This article explains why generic text‑embedding models often fail in specialized retrieval tasks, then demonstrates how to fine‑tune such models using contrastive learning, curated job‑listing data, and the Sentence‑Transformers library, achieving near‑perfect accuracy on a job‑matching benchmark.
Contrastive LearningFine-tuningHuggingFace
0 likes · 11 min read

This article introduces OpenAI’s CLIP multimodal model, explains its architecture and contrastive training, details hardware and installation steps, and demonstrates a hands‑on zero‑shot image classification workflow that achieves 97% confidence on a cat image without any task‑specific fine‑tuning.
CLIPContrastive LearningPython
0 likes · 6 min read

This survey reviews the evolution of semantic embedding—from Word2vec and GloVe to BERT, Sentence‑BERT, and recent contrastive methods—then examines how large language models improve embeddings via synthetic data generation and backbone architectures, detailing techniques such as contrastive prompting, in‑context learning, knowledge distillation, and discussing resource, privacy, and interpretability challenges.
Contrastive LearningNLPin-context learning
0 likes · 27 min read

This article reviews how large language models (LLMs) enhance semantic text embeddings by comparing traditional methods with LLM‑based approaches, detailing synthetic data generation, backbone model designs, key model families, experimental results on the MTEB benchmark, and future research challenges.
Contrastive LearningLLMmodel comparison
0 likes · 30 min read

The paper presents a comprehensive multi‑scenario recommendation study introducing three models—SACN, SAINet, and DSWIN—that integrate scene‑aware attention, attribute‑level preferences, and contrastive disentanglement to capture distinct user interests, achieving consistent AUC gains and online CTR improvements across real‑world datasets.
CTR predictionContrastive LearningDeep Learning
0 likes · 43 min read

The paper introduces Instruction Embedding—a task‑focused text representation learned on the new Instruction Embedding Benchmark—and shows that Prompt‑based Instruction Embedding (PIE) outperforms standard embeddings in clustering, similarity, and downstream tasks such as data selection, in‑context example retrieval, test‑set compression, and task‑correlation analysis.
Contrastive LearningFine-tuningLarge Language Models
0 likes · 15 min read

NoteLLM-2 introduces multimodal In-Content Learning and Late Fusion to overcome visual‑modality bias in end‑to‑end fine‑tuned large representation models, delivering significant gains over baseline multimodal LLMs and traditional retrieval methods in recommendation tasks.
AI researchContrastive Learningin‑content learning
0 likes · 11 min read

This article presents a comprehensive study on integrating multimodal image‑text representations into large‑scale e‑commerce advertising CTR models, introducing a semantic‑aware contrastive pre‑training (SCL) method and two application algorithms (SimTier and MAKE) that together achieve over 1 % GAUC improvement and significant online gains.
CTR predictionContrastive LearningPretraining
0 likes · 21 min read

Alibaba’s advertising team introduces semantic‑aware contrastive learning to pre‑train multimodal image‑text embeddings, integrates them via SimTier and MAKE into ID‑based CTR models, achieving up to 6.9% lift in Taobao display ad click‑through rates and improving long‑tail item performance.
CTR predictionContrastive Learninge-commerce
0 likes · 21 min read


NewBeeNLPJun 20, 2024 · Artificial Intelligence
This article analyzes Kuaishou’s May 2024 paper on LLM‑driven recommendation, detailing its dual‑tower architecture, contrastive learning of user and item embeddings, and a CVR‑auxiliary task that together improve cold‑start handling and boost both offline and online AUC metrics.
Cold StartContrastive LearningItem Embedding
0 likes · 10 min read

Recent collaboration between Alibaba Cloud’s big‑data team and leading universities introduced ContraLSP, a novel contrastive and locally sparse perturbation framework that outperforms state‑of‑the‑art methods in explaining time‑series models, offering improved interpretability for both white‑box forecasting and black‑box classification tasks.
Contrastive LearningInterpretabilityMachine Learning
0 likes · 8 min read

This article introduces the KANGAROO model, which injects hierarchical semantic information via hyperbolic space and leverages contrastive learning on dense subgraph structures to overcome global sparsity in vertical‑domain knowledge‑enhanced pre‑trained language models, and evaluates its performance on finance and medical tasks.
Contrastive LearningNLPdomain adaptation
0 likes · 10 min read

This article presents NetEase Cloud Music's multimodal cold‑start solution, detailing the problem background, feature selection using CLIP, two modeling approaches (I2I2U indirect and U2I DSSM direct), contrastive learning enhancements, interest‑boundary modeling, and evaluation results showing significant gains in user engagement.
AIContrastive LearningRecommendation System
0 likes · 15 min read

The HC² framework enhances multi‑scenario ad ranking by jointly applying a generalized contrastive loss on shared representations and an individual contrastive loss on scenario‑specific layers, using label‑aware positive sampling, diffusion‑noise negative sampling, and inverse‑similarity weighting, achieving consistent offline gains and up to 2.5% CVR and 3.7% GMV improvements in Alibaba’s live system.
Contrastive LearningMachine Learningad ranking
0 likes · 16 min read

This article presents NetEase Cloud Music's multimodal cold-start recommendation approach, detailing the problem's significance, feature extraction using CLIP, I2I2U indirect modeling, U2I DSSM direct modeling with contrastive learning and interest‑boundary mechanisms, deployment pipeline, evaluation results, and future optimization directions.
Cold StartContrastive Learningmultimodal learning
0 likes · 14 min read

The article surveys sequential recommendation models from early non-deep approaches like FPMC, through RNN-based GRU4Rec and CNN-based Caser, to Transformer-based methods such as SASRec, BERT4Rec, TiSASRec, and recent contrastive-learning techniques, recommending SASRec or its variants for production use.
Contrastive LearningDeep LearningTransformer
0 likes · 17 min read

BOMGraph introduces a unified heterogeneous graph neural network that jointly models text, image, and similar‑item search across multiple e‑commerce scenarios, using meta‑path‑guided attention, disentangled scenario‑specific and shared embeddings, and contrastive learning to alleviate sample sparsity, achieving consistent offline and online performance gains.
Contrastive LearningGraph Neural Networke-commerce
0 likes · 13 min read

The paper introduces ROPE, the first large‑scale cross‑domain product recognition dataset covering detail pages, short videos and live streams, and proposes COPE, a dual‑tower multimodal model that learns unified product embeddings using contrastive and classification losses, achieving superior retrieval and few‑shot classification performance across domains.
Contrastive LearningDatasetDeep Learning
0 likes · 13 min read

CC‑GNN addresses three drawbacks of existing graph‑neural retrieval for e‑commerce by adding content phrase nodes, scalable meta‑path message passing, and difficulty‑aware noisy contrastive learning with counterfactual augmentation, achieving up to 16 % recall improvement and notably larger gains on long‑tail queries and cold‑start items.
Cold StartContrastive LearningE-Commerce Search
0 likes · 19 min read

This article details HuoLala's AI‑driven intelligent quality inspection system, covering its NLP‑based semantic understanding pipeline, data denoising, confidence learning, contrastive learning, model acceleration techniques such as pruning, knowledge distillation, quantization, and interpretability methods to improve coverage, recall and risk detection.
Contrastive LearningModel AccelerationNLP
0 likes · 23 min read

This article presents a low‑resource NLP pretraining approach that combines transformer‑based language modeling with contrastive vector learning, details the unsupervised sample‑pair construction, introduces a camel‑shaped masking distribution, and demonstrates through extensive experiments that the resulting model achieves strong zero‑shot NLU, NLG, and retrieval performance while requiring minimal compute and data.
Contrastive LearningPretraininglanguage modeling
0 likes · 10 min read

The article introduces COPNER, a contrastive‑learning framework that uses class‑specific prompt words to guide sentence encoders, addressing the limited semantic capture of existing few‑shot NER methods and demonstrating superior performance across multiple benchmark datasets and K‑shot settings.
COPNERContrastive LearningNLP
0 likes · 4 min read

This article introduces a continuous semantic enhancement approach for neural machine translation that overcomes the limitations of discrete data‑augmentation techniques, details the neighbor risk minimization training objective, presents benchmark improvements on ACL‑2022 datasets, and describes practical deployment and fine‑tuning workflows in the Modu community.
Contrastive LearningData Augmentationcontinuous semantic augmentation
0 likes · 19 min read

This article reviews the importance and challenges of time‑series data, then summarizes recent contrastive‑learning approaches (TS2Vec, TF‑C) and mask‑reconstruction methods (PatchTST), highlighting their designs, key mechanisms, and future research directions.
Contrastive LearningPatchTSTRepresentation Learning
0 likes · 7 min read


AntTechMay 10, 2023 · Artificial Intelligence
This article presents Ant Security's research on novel biometric methods—brainwave (脑纹) and behavior recognition—detailing their scientific background, data collection, multi‑modal deep‑learning algorithms, adversarial and contrastive training strategies, experimental results, and practical applications for inclusive, secure identity verification.
Contrastive Learningaccessibilityadversarial learning
0 likes · 17 min read

The paper introduces DCCL, a model‑agnostic contrastive learning framework that decouples user interest and conformity representations to address popularity bias and out‑of‑distribution challenges in recommendation systems, demonstrating significant offline and online performance gains on real‑world datasets.
Causal InferenceContrastive LearningOOD robustness
0 likes · 8 min read

The article proposes a three-stage contrastive learning framework—pre‑training, fine‑tuning, and debiasing—to generate unbiased, fine‑grained image embeddings for mobile Taobao CTR prediction, achieving higher accuracy, fairness, and a 4‑5% CTR lift in large‑scale offline and online evaluations.
CTR predictionContrastive LearningDeep Learning
0 likes · 14 min read

KECP, a Knowledge‑Enhanced Contrastive Prompt‑tuning model, achieves strong few‑shot extractive question answering by converting questions to masked statements, injecting external knowledge via gated fusion, and leveraging contrastive learning alongside masked language modeling, as demonstrated on EMNLP‑2022 benchmarks.
Contrastive LearningNLPknowledge injection
0 likes · 9 min read

This article explains how Baidu's anti‑spam team tackled large‑scale promotional spam on Baidu Zhidao by combining the Ernie pretrained model with SimCSE contrastive learning, detailing the problem background, traditional methods, text‑representation stages, the SimCSE approach, training pipeline, optimizations, and experimental results.
Contrastive LearningERNIENLP
0 likes · 15 min read

The paper introduces a graph‑based weakly supervised contrastive learning framework that uses heterogeneous user‑behavior graphs, e‑commerce‑specific augmentations, and a hybrid fine‑tuning/transfer learning strategy to improve semantic relevance matching between queries and product titles, achieving significant gains on a large‑scale Taobao dataset.
Contrastive LearningGraph Neural NetworksWeak Supervision
0 likes · 12 min read

This article introduces contrastive learning, explains its definition, principles, and classic algorithms such as SimCLR and MoCo, and details its practical applications in recommendation systems, including a case study of its deployment at Zhuanzhuan that boosted order rates by over 10%.
AIContrastive LearningSelf-Supervised Learning
0 likes · 12 min read

The article outlines a comprehensive knowledge‑base retrieval matching solution—combining PageRank‑enhanced DSL rewriting, keyword and dual‑tower vector recall, contrastive fine‑ranking, and optimized vector‑based ranking—implemented via offline DP training and Sunfish online inference on Milvus, with applications in enterprise search and recommendations and future plans for graph‑neural embeddings.
Contrastive LearningInfoNCEMilvus
0 likes · 12 min read

This article presents a comprehensive overview of applying graph machine learning to security risk control, covering background cases, system architecture, dynamic heterogeneous graph modeling with HGT and DDGCL, experimental results, and future research directions for fraud, money‑laundering, and gambling detection.
Contrastive LearningGraph Neural NetworksRisk Control
0 likes · 10 min read

This article reviews the integration of contrastive learning into text generation, explains why it helps mitigate exposure bias, introduces the CoNT framework with three key improvements, presents extensive experiments on translation, summarization, code comment and data‑to‑text tasks, and discusses practical deployment considerations.
AICoNTContrastive Learning
0 likes · 21 min read

This article reviews recent progress in applying self‑supervised learning to OCR text recognition, covering mainstream model architectures, key considerations for self‑supervised tasks on text images, and detailed analyses of representative papers such as SeqCLR, SimAN, and DiG, highlighting their designs, experiments, and results.
Computer VisionContrastive LearningOCR
0 likes · 20 min read

This article reviews recent self‑supervised learning approaches for optical character recognition, covering mainstream OCR model architectures, key factors for applying contrastive and masked image modeling methods to text images, and detailed analyses of representative works such as SeqCLR, SimAN, and DiG, including their designs and experimental results.
Contrastive LearningOCRmasked image modeling
0 likes · 19 min read

By leveraging contrastive learning and large‑scale click‑through data, the article details a dual‑tower model that encodes product titles and queries, explains loss functions, batch‑negative sampling, distributed training tricks, and demonstrates how this approach outperforms traditional NER for product term and category prediction.
Contrastive LearningInfoNCEdistributed training
0 likes · 16 min read

This article reviews large‑scale image and multimodal pre‑training techniques—including contrastive learning, self‑supervised reconstruction, and multimodal alignment—explains data acquisition, model construction, evaluation metrics, and demonstrates how these methods are applied and optimized for real‑world information‑flow services.
AIContrastive LearningInformation Flow
0 likes · 17 min read

The paper introduces MUVCOG, a heterogeneous graph neural network that models multi‑modal, multi‑query search sessions on Mobile Taobao by jointly learning attention‑based global and hierarchical local views through contrastive pre‑training, yielding universal session embeddings that markedly improve CTR prediction, query recommendation, and intent classification.
Contrastive LearningGraph Neural NetworkMulti-modal
0 likes · 15 min read

Alibaba’s advertising team introduces CREATER, a CTR‑driven text generator that leverages user reviews, aspect control codes, and contrastive fine‑tuning, and CONNA, a non‑autoregressive bundle creator that predicts heterogeneous ad elements with set‑based loss, both delivering substantial online CTR gains and CPC reductions through dynamic creative optimization.
CTRContrastive LearningDynamic creative optimization
0 likes · 25 min read

The paper proposes CDAN, a dual‑tower retrieval model that separates item attribute and popularity representations via a Feature Decoupling Module with orthogonal embeddings, aligns head‑tail attribute distributions using MMD and contrastive learning, and jointly trains biased and unbiased towers, achieving higher tail recall, lower exposure concentration, and measurable online click‑through improvements.
Contrastive Learningdomain adaptationdual-tower model
0 likes · 13 min read

This article presents a comprehensive overview of how contrastive learning can alleviate data sparsity and distribution bias in recommendation systems, detailing its theoretical advantages, recent research progress in computer vision and NLP, and a multi‑task self‑supervised framework applied to Kuaishou's short‑video ranking pipeline with significant offline and online performance gains.
AIContrastive LearningKuaishou
0 likes · 21 min read

The paper demonstrates how self‑supervised models SwAV and M6 generate high‑quality image and multimodal embeddings for Meiping Meiwu’s recommendation system, delivering notable gains in scene/style consistency, ranking AUC, classification and retrieval performance, especially for cold‑start items, and achieving measurable production lifts.
A/B testingContrastive LearningM6 multimodal
0 likes · 15 min read

The paper presents a glance‑supervised video moment retrieval approach that records a single annotator‑seen frame, introduces the ViGA contrastive learning framework to leverage this weak temporal cue, and demonstrates on three benchmarks performance rivaling fully supervised methods while keeping annotation cost minimal.
Computer VisionContrastive LearningGlance Supervision
0 likes · 8 min read

This paper proposes SSAN, a novel dual‑stream network that separates content and style features to achieve domain‑generalized face anti‑spoofing, employing adversarial learning for content, contrastive learning for style, and a large‑scale evaluation protocol across twelve public datasets, achieving state‑of‑the‑art performance.
Contrastive LearningSSANdomain generalization
0 likes · 16 min read

ArcCSE introduces an angular‑margin contrastive loss and both pairwise (dropout‑augmented) and triple‑wise (span‑masked) relationship modeling to self‑supervise text embeddings, yielding tighter decision boundaries, higher alignment and uniformity, and superior performance on unsupervised STS, SentEval, and Alibaba’s retrieval and recommendation systems.
Contrastive LearningNLPSelf-Supervised Learning
0 likes · 8 min read

This article introduces the four types of machine learning, explains self‑supervised learning, details generative and contrastive approaches, and provides an in‑depth overview of the MoCo series (V1‑V3), including their architectures, training strategies, and experimental results on document image classification and text‑line detection tasks.
Contrastive LearningMoCoVision Transformers
0 likes · 12 min read

This article explains CLIP’s multimodal contrastive pre‑training, its simple yet effective architecture, code implementation, and how its zero‑shot capability can surpass supervised ImageNet models by leveraging a 400‑million image‑text dataset and shared semantic embeddings.
AICLIPContrastive Learning
0 likes · 7 min read

After the BERT era, this article reviews the limitations of pre‑trained language models for semantic matching, discusses negative‑sample sampling, data‑augmentation techniques, contrastive learning methods such as ConSERT and SimCSE, and practical deployment considerations in vector‑based retrieval systems.
Contrastive LearningData Augmentationpretrained language models
0 likes · 20 min read

This article introduces graph representation learning, explains the Graph Information Bottleneck (GIB) framework for obtaining robust graph embeddings, and presents AD‑GCL, a contrastive learning method that leverages GIB principles to improve graph neural network performance without requiring task labels.
Contrastive LearningGraph Neural NetworksGraph Representation
0 likes · 15 min read


Code DAODec 22, 2021 · Artificial Intelligence
This article explains SimCLR, the 2020 Google Research framework that advances self‑supervised visual pre‑training by using extensive data augmentations, a ResNet encoder, a projection‑head MLP, and the NT‑Xent loss to learn robust image representations that outperform many prior methods on ImageNet and other benchmarks.
Computer VisionContrastive LearningNT-Xent loss
0 likes · 7 min read

This article introduces a simple five‑line implementation of R‑Drop, a contrastive self‑supervised learning technique that leverages dropout‑induced perturbations to improve model robustness, explains the underlying principle, provides the exact PyTorch code, and compares it with the ConSERT method.
Contrastive LearningDropoutPyTorch
0 likes · 5 min read

This article introduces graph representation learning, explains the Graph Information Bottleneck (GIB) framework for obtaining robust graph embeddings, and presents AD‑GCL, a contrastive learning method that leverages GIB principles to improve robustness and performance without requiring task labels.
Contrastive LearningGraph Neural NetworksRobustness
0 likes · 16 min read

The author shares personal experiences as a Meituan algorithm engineer, emphasizing the critical role of labeled data, the emergence of contrastive (self‑supervised) learning across computer vision, NLP, and recommendation systems, and offers practical advice for algorithm engineers to stay competitive.
AI researchAlgorithm EngineeringContrastive Learning
0 likes · 8 min read

This talk explains contrastive learning fundamentals, typical image‑domain models such as SimCLR, MoCo and SwAV, and shows how their principles—positive/negative sample construction, encoder design, loss functions, alignment and uniformity—can be applied to improve dual‑tower retrieval and ranking models, embedding normalization, temperature scaling, and graph‑based recommender systems.
Contrastive LearningInfoNCEdual-tower models
0 likes · 40 min read

This article explains how contrastive learning, originally popular in computer‑vision, can be interpreted and applied to recommendation‑system recall and coarse‑ranking models, covering its theoretical roots, typical architectures like SimCLR, MoCo and SwAV, and practical tricks such as in‑batch negatives, embedding normalization, temperature scaling, and graph‑based extensions.
Contrastive LearningGraph Neural NetworksSelf-Supervised Learning
0 likes · 40 min read

This paper proposes HiT, a hierarchical transformer model with momentum contrast for video-text retrieval, addressing limitations in existing multimodal learning methods by introducing hierarchical cross-modal contrast matching and momentum cross-modal contrast to improve retrieval performance.
Contrastive LearningHCMMCC
0 likes · 9 min read

This article reviews recent research on graph self‑supervised learning, focusing on contrastive learning fundamentals, the SimCLR‑style framework, representative models such as GRACE and its adaptive augmentation extension GCA, experimental evaluations, and future directions for graph contrastive methods.
Contrastive LearningGCAGrace
0 likes · 16 min read

This article reviews recent advances in graph contrastive learning, introducing foundational concepts, the SimCLR framework, and representative models such as GRACE and its adaptive augmentation variant GCA, followed by experimental results, analysis, and future research directions.
Contrastive LearningGCAGrace
0 likes · 16 min read

This article reviews self‑supervised learning techniques, common computer‑vision pretext tasks, contrastive loss functions, popular frameworks such as SimCLR, MoCo and SimSiam, and demonstrates their application to OCR captcha recognition with detailed implementation and experimental results.
Computer VisionContrastive LearningDeep Learning
0 likes · 22 min read

This article explains the fundamentals of contrastive learning, reviews typical models such as SimCLR, MoCo, SwAV, BYOL, SimSiam and Barlow Twins, and demonstrates how these methods are applied to Weibo text and multimodal (text‑image) representation tasks like hashtag generation and image‑text matching.
Contrastive LearningNLPRepresentation Learning
0 likes · 18 min read

This article surveys self‑supervised learning techniques for computer‑vision tasks, explains common pretext tasks and contrastive loss designs, reviews representative models such as SimCLR, MoCo, SmAV and SimSiam, and demonstrates their practical impact on a captcha‑OCR system with measurable accuracy gains.
Computer VisionContrastive LearningDeep Learning
0 likes · 23 min read

This article explains the concept of contrastive learning, its relationship to self‑supervised and metric learning, describes key system components and loss functions, reviews major image, NLP and multimodal models such as SimCLR, MoCo, SwAV, BYOL, and demonstrates how contrastive learning is applied to Weibo hashtag generation, similar‑post retrieval, and text‑image matching using CD‑TOM and W‑CLIP models.
AIContrastive LearningRepresentation Learning
0 likes · 19 min read


58 TechAug 5, 2021 · Artificial Intelligence
This article presents a comprehensive study of text representation techniques—from weighted word‑vector methods to supervised SimBert and unsupervised contrastive learning models—applied to large‑scale unstructured data in 58's information‑security workflows, evaluating their effectiveness for classification and content‑recall tasks.
BERTContrastive LearningPretrained Models
0 likes · 11 min read

ConSERT introduces a contrastive self‑supervised framework that enhances BERT‑derived sentence embeddings by applying efficient embedding‑level data augmentations, achieving significant improvements on semantic textual similarity tasks, especially in low‑resource settings, and outperforming previous state‑of‑the‑art methods.
BERTContrastive Learningself-supervised
0 likes · 20 min read

ConSERT is a contrastive self‑supervised framework that fine‑tunes BERT with augmented sentence views and NT‑Xent loss to overcome embedding collapse, delivering roughly 8% higher STS performance than prior methods, remaining robust in few‑shot and supervised scenarios, and now deployed in Meituan’s NLP pipelines.
BERTContrastive LearningNLP
0 likes · 20 min read

This article explores the landscape of text matching in NLP, covering problem types, three model interaction levels, sentence embedding techniques, supervised and unsupervised approaches, and the role of contrastive learning with alignment and uniformity metrics.
BERTContrastive LearningNLP
0 likes · 12 min read


Amap TechDec 30, 2020 · Artificial Intelligence
The Amap team introduced LRC‑BERT, a contrastive‑learning‑based knowledge‑distillation framework that employs a novel COS‑NCE loss, gradient‑perturbation, and a two‑stage training schedule, enabling a 4‑layer student model to retain about 97 % of BERT‑Base accuracy while being 7.5× smaller and 9.6× faster, and it has already improved real‑world traffic‑event extraction performance.
BERTCOS-NCE lossContrastive Learning
0 likes · 16 min read
