「multimodal」の検索結果
125 件Reasoning vision-language-action (VLA) models pair physical control with natural-language rationales that supe
Vision-language models (VLMs) increasingly support construction hazard monitoring, yet their frequent false al
Video games provide a practical setting for collecting vision-language-action (VLA) data, whose acquisition in
Recent multimodal agents have shown promising progress in embodied planning and web interaction. However, exis
Disturbances can invalidate the conditions required by a robot's next action even when much of its task progra
Continuous glucose monitors, smartwatches, meal logs, and health profiles form a rich multimodal personal cont
AI-generated images have reached unprecedented realism, while instruction-driven AI editors re-synthesize imag
Chest radiography (CXR) diagnosis is critical for thoracic disease assessment, yet challenged by the need to i
Hamilton-Jacobi (HJ) reachability provides certified backward reachable tubes (BRTs) for safety-critical robot
Recent work has improved computer-use agents (CUAs) by combining retrieved task-relevant tutorials and look-ah
Large foundation models often answer even when the available visual or textual evidence is insufficient to sup
Multimodal language models continue to improve on broad music understanding benchmarks, but which musical feat
AIRoA-0 (A-0) is a bimanual manipulation system learned from 16,151 hours of handheld demonstrations, with no
Vision-Language Models (VLMs) hold promise for zero-shot video task-progress estimation in robot learning, yet
**Purpose:** Ultrasound biometry is widely used across various clinical applications, including prenatal and c
Actor--critic methods rely on critic gradients to improve continuous-action policies, yet finite-sample guaran
A model pretrained to predict a customer's next event can estimate the probability of future events without tr
Multimodal fusion is studied under hybrid federation, where data are partitioned across samples and feature bl
Generative recommendation has been widely adopted in large-scale industrial recommendation systems, where mult
Spatial multi-omics technologies jointly profile diverse molecular modalities with spatial context, providing
Recent works have observed implicit cross-modal alignment between independently trained unimodal models. Howev
We study the spectral structure of the self-attention matrix in Transformer models through an idealized spectr
Scientific discovery builds on accurate observations interpreted through domain knowledge and reasoning. For s
Modern learning systems increasingly combine pretrained models with downstream heads. Despite the growing impo
A brain MRI scan can carry an unknown mix of artifacts, so restoration has to be blind, yet most deep-learning
The Musical Metaverse (MM) enables geographically distributed musicians, audiences, sound engineers, and AI ag
Timely and accurate crop health diagnosis is essential for sustainable agricultural production, yet accurate d
Every multimodal-LLM multiple-choice benchmark ends with a scoring rule that converts a model's response, ofte
Accurate preoperative prediction of lung adenocarcinoma invasiveness is important for surgical planning and in
While Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced multimodal reasoning, e
With the popularization of livestreaming applications, automatic camera tuning has become indispensable for or
Remote sensing image fusion and semantic interpretation are usually optimized separately, so reconstruction qu
Reaction data underpin machine learning for reaction prediction, condition recommendation, and retrosynthetic
Reinforcement learning (RL) elevates joint audio-video generation, but optimizing heterogeneous, modality-spec
Robust driver-state modelling requires synchronized physiological, behavioural, and contextual signals, yet ex
Previous research shows that vision-language (VL) models struggle to understand fine-grained image details and
Complex documents such as scientific papers contain rich information in tables, figures, and equations; howeve
As streaming generation becomes the dominant serving paradigm for both text-only and multimodal large language
Automated liver ultrasound report generation improves the diagnosis of liver diseases by producing clinically
LLM planning often relies on reactive executors (e.g., ReAct) that generate a single action at each step to re
Cross-Domain Few-Shot Segmentation (CD-FSS) aims to segment objects from unseen domains using only a few annot
Transfer learning from pretrained backbones has become standard practice in multi-sensor computer vision---yet
Surgical scene understanding is pivotal for computer-assisted intervention, yet demands compositional reasonin
Humans imagine scene changes under hypothetical motions, an ability central to spatial reasoning and robotic p
Multimodal large language models (MLLMs) can generate detailed video captions, yet they may overemphasize mino
Foundational vision models have become the de facto standard for many vision tasks due to their strong perform
Autonomous mobility is essential for sustained lunar surface operations, as communication delays and line-of-s
Earth observation (EO) workflows require selecting among known outcomes, estimating confidence, and processing
Multimodal retrieval must integrate complementary evidence from views that may be missing, noisy, or unequally
Geospatial text spotting involves locating and transcribing geographic labels, such as road names, district na
Omni-modal large language models (Omni-LLMs) typically process large numbers of multimodal tokens from audio-v
Multimodal test-time adaptation (TTA) enables pretrained multimodal models to accommodate distribution shifts
An image that is hard to classify on its own may have a helpful neighbor in the same unlabeled batch. Zero-sho
Multimodal large language models (MLLMs) have shown strong potential in robotic surgery for question answering
Image-text corpora contain copies of one image, captions that describe one image in different ways, captions r
Multi-source remote sensing image classification benefits from complementary spectral and structural informati
Multi-source remote sensing data classification has received growing attention recently. However, existing met
Cloth-changing person re-identification (CC-ReID) is still very challenging, and no method clearly dominates:
Misleading charts can lead vision-language models to conclusions that conflict with underlying data. Existing
Infrared and visible image fusion integrates complementary information from both modalities to provide a more
Interleaved multimodal chain-of-thought reasoning improves the visual reasoning capabilities of multimodal lar
Understanding how objects and their spatial relationships evolve in 3D space over time remains challenging for
Widespread image sharing on social media has increased the need for visual privacy recognition to identify ina
Jointly trained multimodal networks frequently underutilize weaker modalities, as faster-learning modalities d
3-D road anomaly segmentation is essential for risk-aware perception in autonomous driving. Its central challe
3D generation, editing, and completion are typically treated as regenerating the complete 3D asset under task-
Clinical evidence is inherently relational: medical images are interpreted with prior studies, cross-modal exa
Hyperspectral videos provide rich spectral signatures for robust tracking under challenging conditions such as
Engineering drawings specify mechanical parts through orthographic projections. Recognizing which part a drawi
In virtual environments, choosing appropriate outfits requires contextual harmony with surrounding scenes, yet
Cross-view object correspondence (CVOC) aims to establish associations of the same target between query and se
Computed tomography (CT) provides diverse patient information and various clinical tasks, for which numerous d
Open-world robotic mobile manipulation requires acting in physical environments with only partial information.
Pre-touch sensing, or sensing information about an object before contact, is an attractive modality for robot
Many manipulation goals are easier to visualize than to specify numerically through explicit geometric constra
We release all 3,718 episodes from the ArmnetBench v0.1 evaluation (arXiv:2607.24481), which contains 600 tele
Vision-language-action (VLA) models offer a promising path toward general-purpose robot manipulation. While in
Robust multimodal perception for soft robotic grasping is challenged by modality-dependent noise, semantic amb
Vision-language-action (VLA) policies can handle noncritical stages of long-horizon manipulation yet fail duri
The Generalized Singular Value Decomposition (GSVD) is a central tool for comparing two linear operators that
Recent advances in Vision-Language-Action (VLA) models have enabled fine manipulation capabilities, yet perfor
General-purpose robot policies must work across robots, tasks, and environments, yet the variation that makes
Language models can analyze and assess student texts using predefined rubrics and deliver structured feedback,
Accurate house price prediction is essential for real estate buyers, sellers, agents, and financial institutio
Visual-text compression renders long contexts as images and is engineered around how much of the text a vision
We present See, Think, Use, a protocol that traces each answer of a vision-language model to perception, reaso
Humans continuously acquire knowledge from carefully crafted materials such as books and tutorial videos, carr
Multimodal Large Language Models (MLLMs) have made substantial progress in 3D scene understanding from multi-v
Vision-Language Models (VLMs) and Vision-Language-Action (VLA) models process hundreds of visual tokens, makin
High-resolution three-dimensional (3D) microstructure characterization remains difficult to undertake at scale
Robot foundation models now act in a closed loop, yet their safety is evaluated one variation at a time: robus
Vision-language models for remote sensing answer questions about satellite images by generating text: every an
Diffusion driving vision-language-action models repeatedly execute the backbone at every denoising stage, incu
Embodied agents that answer questions about their route need a memory of what they saw, and scene graphs are a
Vision-language models (VLMs) suffer from visual hallucination, such as saying an object that is not present i
The spatial intelligence of large vision-language models (LVLMs) requires the ability to combine local visual
Reinforcement learning with verifiable rewards (RLVR) has become an effective post-training paradigm for visio
Embodied question answering asks an agent to navigate, observe, and then answer questions about what it saw, y
Most robot policies, whether trained by imitation learning (IL) or reinforcement learning (RL), map observatio
Vision-language-action (VLA) models can generate task-oriented robot actions, but they do not guarantee safe e
This report presents GatedVLA, our entry for the Physical AI AV (PAI-AV) track. Our learned vision-language-ac
Robots manipulating in cluttered spaces must often plan from partial views where foreground objects occlude th
Agentic robots combine a vision-language brain, a tool-using harness, and a vision-language-action (VLA) polic
Vision-language-action (VLA) models predict chunks of future actions, yet deployed robots waste time in two wa
Diffusion-based vision-language-action (VLA) models cascade pretrained vision-language models (VLMs) with diff
Garment flattening and folding require robots to identify garment structure during manipulation and adapt thei
Vision-language models can interpret instructions and plan manipulation tasks, yet struggle when acting direct
Simulation-based VLA evaluation often treats matching task, seed, and episode identifiers as sufficient eviden
Vision-language action (VLA) models excel for end-to-end autonomous driving, yet their tendency to over-invoke
A robot's next action can depend on recent motion or earlier visual evidence absent from its current observati
The MetaFine Open Competition (RoboFineMani workshop, CoRL 2026) evaluates fine-grained manipulation beyond bi
Reinforcement learning (RL) is increasingly used to adapt pretrained vision-language-action models (VLAs). We
Most agentic robotic systems use vision-language models (VLMs) either to orchestrate predefined skills or to d
Computing equilibria is a fundamental algorithmic problem in game theory and economics. Although general frame
Can a vision-language-action (VLA) policy signal likely task failure from its own action probabilities? We int
Embodied surgical AI requires reliable multimodal data, yet surgical data collection remains costly, difficult
Scaling humanoid motion foundation models is constrained by the scarcity of diverse, robot-executable data and
Inserting an unseen part requires sub-millimetre precision and the correct orientation of keyed features. Curr
Variational inference with normalizing flows provides a flexible posterior approximation for Bayesian model ca
Audio systems aim to maximise the listener's perceived quality, traditionally evaluated through mean opinion s
The neighborhood topology of particle swarm optimization (PSO) determines information propagation and regulate
To facilitate the solving of complex problems, evolutionary multitask optimization is regarded as a promising
Plurality-voting ensembles aggregate the predictions of multiple base classifiers and output the most voted cl
Sensing-aided beam prediction can reduce the beam-training overhead of millimeter-wave (mmWave) systems by lev
Artificial intelligence increasingly serves as a natural-language interface to complex technical systems, lett