Skip to content
Tagged articles

cross-modal alignment

3 articles · Page 1 of 1
Data Party THU
Data Party THU
Oct 22, 2026 · Artificial Intelligence

3D Vision-Language Models: From Geometry to Open-Vocabulary & Embodied Interaction

This tutorial surveys 3D vision-language models, covering geometric representations (point clouds, meshes, Gaussian splatting), CLIP-style cross-modal alignment, taxonomy of embedding-based vs. generative architectures, and emerging applications in recognition, scene understanding, 3D generation, and embodied AI, highlighting the distinction between similarity matching and language generation capabilities.

3D Gaussian splatting3D vision-language modelsCLIP
0 likes · 29 min read
3D Vision-Language Models: From Geometry to Open-Vocabulary & Embodied Interaction
Machine Heart
Machine Heart
Oct 17, 2026 · Artificial Intelligence

RAVEL: Two Simple Tweaks Double Vision Encoder Evaluation Correlation for MLLMs

Researchers propose RAVEL, a training-free method to evaluate vision encoders for multimodal LLMs by measuring cross-modal nearest-neighbor consistency with stabilized PCA whitening and patch-level matching, achieving 0.85 Spearman correlation across 210 models, outperforming prior methods by 36-101%.

Multimodal Large Language ModelsPCA WhiteningPatch-Level Matching
0 likes · 13 min read
RAVEL: Two Simple Tweaks Double Vision Encoder Evaluation Correlation for MLLMs
Bighead's Algorithm Notes
Bighead's Algorithm Notes
Jul 30, 2026 · Artificial Intelligence

How MSH‑LLM Fuses Multi‑Scale Hypergraphs with Large Language Models for Time‑Series Analysis

The paper introduces MSH‑LLM, a multi‑scale hypergraph framework that aligns natural language and time‑series modalities via a cross‑modal alignment module and mixed prompts, achieving state‑of‑the‑art performance on 27 real‑world datasets across forecasting, classification, few‑shot and zero‑shot tasks.

MSH-LLMcross-modal alignmentlarge language models
0 likes · 18 min read
How MSH‑LLM Fuses Multi‑Scale Hypergraphs with Large Language Models for Time‑Series Analysis