Tagged articles
MLLM
12 articles · Page 1 of 1
Fudan and NTU researchers propose SimpleVLN, a vision-language navigation framework that unlocks state-of-the-art performance by using native multimodal large language models without architectural changes, combining observation selection, action chunking, and a three-stage training pipeline for real-world robot deployment.
Action ChunkingDAggerMLLM
0 likes · 10 min read

MOON 3.0 shifts e-commerce multimodal representation from direct encoding to explicit attribute reasoning, using Multi-head Modality Fusion, joint contrastive and reinforcement learning, and fine-grained residual enhancement to improve fine-grained retrieval and classification across multiple benchmarks.
Contrastive LearningMLLMMOON 3.0
0 likes · 24 min read

Researchers from Shanghai Jiao Tong University, NUS, Meituan, and others built UrbanGround, a real-scale interactive Hong Kong environment using 3D geographic data, to evaluate MLLM agents on local perception, navigation persistence, and dynamic adaptation, revealing models excel at local tasks but fail at long-range navigation and dynamic recovery.
Embodied AIHong KongMLLM
0 likes · 15 min read

Audio-Omni, a unified multimodal audio model presented at SIGGRAPH 2026, combines a frozen large multimodal language model with a trainable diffusion generator to achieve state‑of‑the‑art understanding, generation, and instruction‑based editing across general sounds, music, and speech, leveraging a million‑scale AudioEdit dataset and a hybrid conditioning architecture.
Audio-OmniAudioEditDiffusion Generation
0 likes · 11 min read

Monet introduces a training paradigm that lets multimodal large language models reason directly in a continuous latent visual space, replacing external tool calls with implicit visual embeddings, and demonstrates significant gains on both in‑distribution perception tasks and out‑of‑distribution abstract visual reasoning through a three‑stage supervised fine‑tuning and a novel visual‑latent policy optimization.
Latent EmbeddingMLLMmultimodal
0 likes · 15 min read

The article analyzes enterprise testing challenges and presents the AIO intelligent testing platform, which combines cloud‑native architecture, MLLM‑RAG dual engines, and a knowledge‑graph to automate test case generation, improve coverage, and cut maintenance costs, backed by concrete benchmarks and multi‑modal inputs.
AI TestingMLLMRAG
0 likes · 18 min read

Retrv‑R1, a reasoning‑driven multimodal large language model framework, tackles the precision‑efficiency dilemma of universal multimodal retrieval by introducing a two‑stage coarse‑to‑fine pipeline, an information‑compression module, a detail‑inspection mechanism, and a three‑stage training strategy, achieving SOTA performance across accuracy, efficiency, and generalization benchmarks.
EfficiencyGeneralizationMLLM
0 likes · 21 min read

The paper introduces the Effective Chart Dataset (ECD), a large, high‑quality, diverse synthetic chart collection and the ECDBench benchmark, detailing a five‑stage modular synthesis pipeline, extensive QA generation, and experiments that show consistent performance gains for open‑source multimodal large language models on chart‑understanding tasks.
AIMLLMbenchmark
0 likes · 9 min read

MetaQuery introduces learnable queries that connect a frozen multimodal LLM with diffusion models, enabling knowledge‑enhanced image generation, reconstruction, and editing while preserving state‑of‑the‑art multimodal understanding, and achieves new SOTA results across multiple benchmarks.
AI researchMLLMMetaQuery
0 likes · 18 min read


ArchitectMar 24, 2025 · Artificial Intelligence
This article provides a systematic review of recent advances in multimodal alignment for large language models, covering key contributions, application scenarios, dataset construction, evaluation benchmarks, future challenges, and insights from LLM alignment research to guide both academia and industry.
AI safetyMLLMdataset construction
0 likes · 26 min read

The 2024 advertising team introduced a suite of AI‑driven techniques—including a trustworthy feedback network, a large‑scale human‑annotated dataset, multimodal large language model representations, and online ranking architecture upgrades—to dramatically improve the quality, coverage, and personalization of generated ad creatives.
AIGCAdvertisingImage Generation
0 likes · 10 min read


AntTechMar 14, 2025 · Artificial Intelligence
The CVPR 2025 paper "MP-GUI: Modality Perception with MLLMs for GUI Understanding" presents a novel algorithm that enhances multimodal large language models' ability to perceive and reason about graphical user interfaces by integrating text, visual, and spatial signals through specialized perception modules and a dynamic fusion gate, achieving state‑of‑the‑art performance on multiple GUI benchmarks.
CVPR2025Computer VisionGUI Understanding
0 likes · 5 min read
