MOON 3.0 shifts e-commerce multimodal representation from direct encoding to explicit attribute reasoning, using Multi-head Modality Fusion, joint contrastive and reinforcement learning, and fine-grained residual enhancement to improve fine-grained retrieval and classification across multiple benchmarks.
Researchers from Shanghai Jiao Tong University, NUS, Meituan, and others built UrbanGround, a real-scale interactive Hong Kong environment using 3D geographic data, to evaluate MLLM agents on local perception, navigation persistence, and dynamic adaptation, revealing models excel at local tasks but fail at long-range navigation and dynamic recovery.
Audio-Omni, a unified multimodal audio model presented at SIGGRAPH 2026, combines a frozen large multimodal language model with a trainable diffusion generator to achieve state‑of‑the‑art understanding, generation, and instruction‑based editing across general sounds, music, and speech, leveraging a million‑scale AudioEdit dataset and a hybrid conditioning architecture.
Monet introduces a training paradigm that lets multimodal large language models reason directly in a continuous latent visual space, replacing external tool calls with implicit visual embeddings, and demonstrates significant gains on both in‑distribution perception tasks and out‑of‑distribution abstract visual reasoning through a three‑stage supervised fine‑tuning and a novel visual‑latent policy optimization.
The article analyzes enterprise testing challenges and presents the AIO intelligent testing platform, which combines cloud‑native architecture, MLLM‑RAG dual engines, and a knowledge‑graph to automate test case generation, improve coverage, and cut maintenance costs, backed by concrete benchmarks and multi‑modal inputs.
Retrv‑R1, a reasoning‑driven multimodal large language model framework, tackles the precision‑efficiency dilemma of universal multimodal retrieval by introducing a two‑stage coarse‑to‑fine pipeline, an information‑compression module, a detail‑inspection mechanism, and a three‑stage training strategy, achieving SOTA performance across accuracy, efficiency, and generalization benchmarks.
The paper introduces the Effective Chart Dataset (ECD), a large, high‑quality, diverse synthetic chart collection and the ECDBench benchmark, detailing a five‑stage modular synthesis pipeline, extensive QA generation, and experiments that show consistent performance gains for open‑source multimodal large language models on chart‑understanding tasks.
MetaQuery introduces learnable queries that connect a frozen multimodal LLM with diffusion models, enabling knowledge‑enhanced image generation, reconstruction, and editing while preserving state‑of‑the‑art multimodal understanding, and achieves new SOTA results across multiple benchmarks.
This article provides a systematic review of recent advances in multimodal alignment for large language models, covering key contributions, application scenarios, dataset construction, evaluation benchmarks, future challenges, and insights from LLM alignment research to guide both academia and industry.
The 2024 advertising team introduced a suite of AI‑driven techniques—including a trustworthy feedback network, a large‑scale human‑annotated dataset, multimodal large language model representations, and online ranking architecture upgrades—to dramatically improve the quality, coverage, and personalization of generated ad creatives.
The CVPR 2025 paper "MP-GUI: Modality Perception with MLLMs for GUI Understanding" presents a novel algorithm that enhances multimodal large language models' ability to perceive and reason about graphical user interfaces by integrating text, visual, and spatial signals through specialized perception modules and a dynamic fusion gate, achieving state‑of‑the‑art performance on multiple GUI benchmarks.
