Tagged articles
ViT
13 articles · Page 1 of 1
Researchers from Northwestern Polytechnical University and HKUST propose Dynamic Gated Pathways (DGP), a method that lets each LLM layer dynamically attend to all ViT layers, improving multimodal benchmarks by learning per-layer, per-sample routing weights instead of using a fixed visual projection.
DGPDynamic Gated PathwaysLLM
0 likes · 18 min read

NASA and IBM release an open-source lunar foundation model trained on 17 years of Lunar Reconnaissance Orbiter data across 11 modalities and two resolutions, enabling detection of polar ice, young volcanic structures, and craters with performance matching or exceeding baselines, integrated into the TerraTorch toolkit for reproducible research.
IBMLROLunar Foundation Model
0 likes · 7 min read

The paper introduces CaRE, a scalable continual‑learning framework that leverages a bi‑level routing mixture‑of‑experts to successfully train Vision Transformers on over 300 non‑overlapping tasks, outperforming existing baselines and accompanied by a new 1,000‑class benchmark, OmniBenchmark‑1K.
Bi-Level RoutingCaREContinual Learning
0 likes · 11 min read

The ViT³ paper, a CVPR 2026 best‑paper finalist, introduces test‑time training to compress visual context, achieving 4.6× faster inference and 90 % lower GPU memory on 1248×1248 images, while outlining six design principles and demonstrating its adaptability to classification, detection, segmentation, and generation tasks.
CVPR 2026High-Resolution VisionLinear attention
0 likes · 16 min read

The article analyzes how data‑parallel (DP) load imbalance hampers large‑scale multimodal model training, details LoongForge's two‑stage adaptive data‑reallocation method that builds a precise compute‑cost model and dynamically redistributes samples, and presents experimental results showing up to 10% throughput gains on massive DP clusters.
DP load balancingData ParallelLoongForge
0 likes · 16 min read


AIWalkerMay 19, 2026 · Artificial Intelligence
EUPE introduces a three‑stage “scale‑then‑shrink” distillation pipeline that first trains a large proxy model to absorb heterogeneous expert knowledge and then compresses it into an 86M encoder, achieving state‑of‑the‑art performance on image classification, dense prediction and vision‑language tasks on an iPhone with only 62 ms latency.
EUPEViTedge AI
0 likes · 16 min read

This article explains the Vision Transformer (ViT) architecture, compares it with CNNs and traditional NLP Transformers, details its encoding process and attention mechanisms, and demonstrates a practical leaf‑disease classification project that showcases ViT’s role in multimodal AI systems.
AI FundamentalsViTdeep learning
0 likes · 10 min read

The article analyzes the Base‑to‑New generalization problem of CLIP‑based visual‑language models, explains why standard prompt tuning (CoOp) forgets base knowledge, and presents the KgCoOp framework that adds a knowledge‑guided loss to keep learned prompts close to hand‑crafted ones, dramatically improving unseen‑class performance while preserving efficiency.
CLIPGeneralizationKnowledge-guided Optimization
0 likes · 12 min read

The article analyzes why standard prompt tuning (CoOp) causes catastrophic forgetting in visual‑language models, introduces the KgCoOp framework that adds a knowledge‑guided loss to regularize prompts, and shows through extensive experiments on 11 benchmarks that KgCoOp improves unseen‑class accuracy, harmonic mean, and efficiency while discussing trade‑offs and limitations.
Catastrophic ForgettingKnowledge-guided OptimizationPrompt Tuning
0 likes · 11 min read


Amap TechJul 11, 2025 · Artificial Intelligence
The USP framework introduces masked latent modeling within a VAE space to pre‑train ViT encoders, enabling seamless weight transfer to both image classification, segmentation, and diffusion‑based generation tasks, dramatically speeding up DiT and SiT models while preserving strong visual representations.
Image GenerationPretrainingSelf-Supervised Learning
0 likes · 13 min read

This article provides an in‑depth, English‑language overview of Vision Transformer (ViT), covering its Transformer‑based architecture, patch‑to‑token conversion, token and position embeddings, fine‑tuning strategies such as 2‑D interpolation, experimental results versus CNNs, and the model’s broader significance for multimodal AI research.
Computer VisionFine‑tuningPatch Embedding
0 likes · 25 min read

This tutorial walks through the complete process of fine‑tuning a Vision Transformer (ViT) model for 14‑class flower image classification on ModelScope, covering dataset preparation, model loading, training configuration, evaluation, and inference with practical code examples.
ModelScopePythonViT
0 likes · 14 min read

This article walks readers through building, training, and evaluating a Vision Transformer (ViT) model for a five‑class flower classification task, providing detailed code snippets, model architecture explanations, training script adjustments, and experimental results that highlight the importance of pre‑trained weights.
Pretrained ModelsPyTorchViT
0 likes · 13 min read
