Tagged articles
multimodal fusion
22 articles · Page 1 of 1
Sharpa Robotics' World Synesthesia Model (WSM), accepted at CoRL 2026, unifies visual geometry, tactile contact, proprioception, and action history into a reusable world model state, enabling a 22-DoF five-finger hand to achieve robust, generalizable in-hand rotation across unseen objects and real-world perturbations through clean depth supervision and recurrent memory.
CoRL 2026Sim-to-RealWorld Models
0 likes · 12 min read


AntTechSep 2, 2026 · Artificial Intelligence
This article summarizes four ECCV 2026 papers: a dynamic cross-layer injection framework for deep vision-language fusion, an event-augmented VLA model enabling robot operation in extreme darkness and blur, a predictive differentiable rendering method using 2D Gaussians for high-fidelity video prediction, and a data-scaling approach for high-resolution weather forecasting that demonstrates clear scaling laws.
Data ScalingECCV 2026Embodied AI
0 likes · 10 min read

The article maps the evolution of AI agents from single-task executors to multi-agent, multimodal, embodied, self‑learning, and cross‑platform systems, outlining four key directions—multimodal fusion, embodied intelligence, continuous self‑learning, and pervasive operation—backed by recent research, industry demos, and Gartner forecasts.
AI Agent EvolutionAgentic AIContinuous Self‑Learning
0 likes · 10 min read

The article analyzes InfraNet, a quality‑aware RGB‑IR detection framework that separates training and inference assumptions, introduces a scalar gate (QualGate) to modulate RGB contribution, and demonstrates improved robustness and accuracy across multiple infrared object‑detection benchmarks.
InfraNetQualGateRGB-IR detection
0 likes · 9 min read

This survey reviews state‑of‑the‑art research up to Q1 2026 on integrating tactile sensing with vision and language for embodied AI, presenting a four‑stage fusion pipeline, a hierarchical taxonomy of datasets, methods, sensors, and highlighting current evaluation challenges and future directions.
Embodied AIRoboticsdatasets
0 likes · 13 min read

Vision‑language models turn continuous images into discrete tokens through patch extraction, encoding, and projection, enabling Transformers to reason jointly over vision and text, but this compression introduces limits in spatial reasoning, counting, and resolution sensitivity that users must understand.
Self-AttentionVision-Language Modelscounting
0 likes · 22 min read

TacRefineNet leverages high‑resolution tactile sensors, multimodal fusion of fingertip touch and proprioception, and a goal‑conditioned refinement network to achieve millimeter‑level grasp adjustments without vision or 3D models, demonstrating zero‑shot deployment and robust generalization across diverse automotive‑factory parts in both simulation and real‑world tests.
Sim-to-RealZero-Shot Learninggrasp refinement
0 likes · 8 min read

DeepFusion combines radar, historical precipitation, numerical weather prediction, and terrain data through independent encoders and attention‑based multi‑scale fusion, achieving high‑resolution 0‑2 hour heavy‑rain forecasts and demonstrating the benefits of multi‑modal deep learning for short‑term precipitation prediction.
Attention MechanismDeepFusionNWP
0 likes · 13 min read

The article analyses AI‑augmented reality intent‑recognition systems, detailing multi‑modal data fusion, three‑way interaction architectures, and adaptive response mechanisms, and demonstrates their impact across medical surgery, elderly care, accessibility, and product design while outlining technical challenges and design methodologies.
AIARHuman-Computer Interaction
0 likes · 20 min read

The DMF framework introduces a modality‑enriched Decoupled Target Attention (DTA) and a Complementary Modality Modeling (CMM) strategy that together close the semantic gap between ID and multimodal features, delivering up to 5.3% CTCVR lift, 7.43% GMV increase, and a three‑fold throughput gain in large‑scale e‑commerce recommendation scenarios.
A/B testingCMMCTR prediction
0 likes · 13 min read

This article examines how a major internet platform leverages large‑model AI—through multimodal fusion, script‑recognition fine‑tuning, and an automatic model‑iteration framework—to overcome precision, adversarial, and cross‑scenario challenges in fraud detection, and how agent‑based tools further boost operational efficiency.
Agent AutomationAnti-FraudModel Iteration
0 likes · 24 min read

The article analyzes how architecture innovation—through sparse, multimodal, and dynamic designs—will break the compute bottleneck of large models, reshape pre‑training hierarchies, and drive three distinct 2026 pathways for both model efficiency and agent competition.
2026 predictionsAI agentsSparse Models
0 likes · 12 min read

This article examines the cutting‑edge AI techniques—multimodal fusion, deep‑learning disease detection, reversible repair, diffusion‑Transformer models, GAN‑based pattern generation, and AR navigation—that enable millimetre‑level digital restoration and cultural democratization of the Dunhuang murals.
AIARCultural Heritage
0 likes · 14 min read

This article summarizes four recent arXiv papers on time‑series forecasting, covering a hierarchical knowledge‑distillation framework for extreme events, a graph‑enhanced multimodal fusion network, an interpretable unsupervised anomaly detector, and an adaptive masking loss that improves prediction accuracy.
Time Seriesadaptive maskinganomaly detection
0 likes · 10 min read


AIWalkerJun 24, 2025 · Artificial Intelligence
The article surveys 117 recent multimodal‑fusion papers, classifies them into improvement‑based and combination‑based approaches, highlights representative works such as TimeXL, OGP‑Net, MMR‑Mamba and FusionSight, and provides a free collection of papers, classic models and code repositories for researchers.
AI researchComputer VisionExplainable AI
0 likes · 8 min read

This article details Xiaohongshu's technical approaches to solving decentralized content distribution by enhancing side‑information usage, integrating multimodal signals across the recommendation pipeline, applying graph‑based models, and implementing interest exploration and protection mechanisms, while also outlining future research directions.
decentralized-distributiongraph modelsinterest-exploration
0 likes · 24 min read

This article introduces M2Doc, a plug‑in multimodal fusion approach that equips visual‑only object detectors with textual and semantic awareness, detailing its early‑ and late‑fusion modules, experimental validation on DocLayNet, M6Doc and PubLayNet, and future research directions.
AIM2DocObject Detection
0 likes · 8 min read

A team of university students built an AI‑powered eye‑disease diagnostic system using federated learning and cloud services, achieving 97.48% accuracy and winning a national award, while outlining future plans for 3D visualization and immersive medical interaction.
AIFederated Learningmedical imaging
0 likes · 8 min read


AntTechSep 28, 2023 · Artificial Intelligence
IEEE has officially released three new international standards—IEEE 2884-2023 for face recognition, IEEE 2891-2023 for fingerprint recognition, and IEEE 2859-2023 for multimodal fusion—developed by Ant Group and partners to provide unified, secure and cost‑effective testing frameworks for biometric systems worldwide.
Biometric StandardsIEEEmultimodal fusion
0 likes · 5 min read

The authors introduce a reinforcement‑learning‑driven memory network that augments long‑range dependencies for continuous valence‑arousal emotion prediction in movies, integrating five multimodal features and a DDPG‑based update policy, which yields state‑of‑the‑art performance across multiple affective‑analysis and summarization benchmarks.
Reinforcement LearningVA affect modellong‑term dependencies
0 likes · 16 min read

This presentation explores how deep semantic role labeling and multimodal data fusion of biomedical literature can build fine‑grained knowledge graphs that enable drug repurposing, describing the AGAC corpus, modeling approaches, evaluation results, and future research directions.
AIBiomedical NLPSemantic Role Labeling
0 likes · 13 min read


JD TechJun 12, 2021 · Artificial Intelligence
The paper presents DeepDualMapper, a gated‑fusion deep network that combines aerial imagery and vehicle trajectory data to automatically generate high‑precision maps, detailing its architecture, gated and refinement modules, and experimental validation on three city datasets.
Trajectory DataU-Netaerial imagery
0 likes · 7 min read
