What Remains in Sight? Autoregressive Video Decoding as Representation-Guided Context Rewriting
Long-horizon video generation is increasingly moving toward autoregressive rollout, where each newly generated
- 用途
- 生成
- 難易度
- Hard
- コスト
- High
「video」の検索結果
85 件Long-horizon video generation is increasingly moving toward autoregressive rollout, where each newly generated
Video games provide a practical setting for collecting vision-language-action (VLA) data, whose acquisition in
Counterfactual sketch animation explores how a static sketch evolves under a hypothetical intervention. We pre
Multimodal language models continue to improve on broad music understanding benchmarks, but which musical feat
AIRoA-0 (A-0) is a bimanual manipulation system learned from 16,151 hours of handheld demonstrations, with no
Sensorized human demonstrations offer scalable data for mobile manipulation, but embodiment differences compli
Vision-Language Models (VLMs) hold promise for zero-shot video task-progress estimation in robot learning, yet
For effective resource management, infrastructure planning, and sustainable tourism, it is really important to
Deep learning models for electronic health records achieve strong predictive performance but provide little in
Generative recommendation has been widely adopted in large-scale industrial recommendation systems, where mult
Pose-driven human video diffusion animates a person from a single reference image and a target pose sequence,
While state of the art for image and video generation, the fundamental reasons for the effectiveness of genera
Increasingly complex neural models predict blood-oxygen-level-dependent (BOLD) responses to naturalistic stimu
Despite recent advances in CUAs, their development remains constrained by the limited diversity, controllabili
Complex video editing requires understanding complex instructions while jointly fulfilling multiple editing re
Recent advancements in sign language processing can be attributed to developments in both large-scale dataset
Reinforcement learning (RL) elevates joint audio-video generation, but optimizing heterogeneous, modality-spec
Robust driver-state modelling requires synchronized physiological, behavioural, and contextual signals, yet ex
Real-time omnimodal assistants are expected to support people in everyday life, but audiovisual understanding
Tool-using language-model agents often execute actions that their domain policies forbid. We present LeanGuard
Effective world modeling requires compressing salient history information that facilitates future prediction.
State-of-the-art bronchoscopy guidance systems and computer-aided diagnosis methods have emerged as important
Learning from human data offers a scalable path toward embodied intelligence, yet it requires models to accura
We present Isekai3D Synthetic Data Generation (SDG), a platform for simulating and capturing synthetic 3D game
Multimodal large language models (MLLMs) can generate detailed video captions, yet they may overemphasize mino
High frame rate HDR video is important in applications such as autonomous driving and scientific imaging, wher
Video dubbing aims to synthesize lip movements that match target speech while preserving the speaker identity,
Streaming digital humans produce detailed video while continuing speech as new text arrives. High-resolution d
AI-generated videos often depict people within detailed scenes while leaving their small facial regions poorly
Multimodal retrieval must integrate complementary evidence from views that may be missing, noisy, or unequally
Omni-modal large language models (Omni-LLMs) typically process large numbers of multimodal tokens from audio-v
Fingerspelling - the sequential signing of letters that compose proper names, technical terms, and out-of-voca
We present a GPU-native volumetric-video system for real-time reconstruction of graphics-compatible textured t
End-to-end autonomous driving policies require effective visual representations that capture both spatial scen
Autoregressive video diffusion models (AR-VDMs) enable real-time, long-horizon video generation but degrade ra
Few-step autoregressive video diffusion enables efficient generation, yet maintaining consistency over long ro
Understanding how objects and their spatial relationships evolve in 3D space over time remains challenging for
Long-form multi-shot video editing requires an intended edit to remain coherent across abrupt changes in scene
Supervised low-light image and video enhancement has achieved remarkable progress, yet current models remain f
Skeleton-based action recognition is a pivotal task in computer vision; however, conventional Graph Convolutio
Safe autonomous driving requires more than recognizing the current scene: the ego vehicle must anticipate how
Hyperspectral videos provide rich spectral signatures for robust tracking under challenging conditions such as
World-action models (WAMs) use video-generation priors to jointly predict future observations and robot action
Inertial sensors are moving into clothing, from sensorized sportswear to garments instrumented with hundreds o
Cross-view object correspondence (CVOC) aims to establish associations of the same target between query and se
Recent interactive video world models generate visually compelling videos from a single image, following user-
As robot learning moves beyond the tabletop, many tasks require mobility, adjustable reach, active perception,
A robot that acts around people needs a world model of the human: a belief over the person's body state and a
Ball-balancing robots (ballbots) must lean to accelerate, and the lean is limited by the wheel torques and by
Contact transitions allow humanoid robots to redistribute object support across the whole body, enabling manip
Universal humanoid motion tracking is essential for enabling humanoid robots to perform diverse tasks in human
World Action Models (WAMs) have recently shown great promise in robotic control, benefiting from the future im
Anticipating financial outcomes requires synthesizing evolving evidence and reasoning under uncertainty, makin
Humans continuously acquire knowledge from carefully crafted materials such as books and tutorial videos, carr
Monocular depth estimation aims to predict depth maps from single RGB images (forgoing the need for stereo cam
Robust 4D reconstruction of deformable endoscopic scenes from monocular videos remains challenging due to non-
Recent advances in generative AI have enabled multiple pathways for high-fidelity video synthesis: text-to-vid
RL locomotion policies trained under nominal simulation conditions may encounter distribution shifts that comp
In human-robot co-manipulation, the robot's trajectory should accommodate the human's, where human sensorimoto
Dexterous in-hand manipulation is commonly formulated around explicit object pose estimation, yet reliable pos
Navigation world models predict future observations conditioned on navigation actions to support planning, but
Latent-space path planning (LSPP) compresses the configuration space of a robotic manipulator into a compact,
Cross-country sentiment analysis faces three fundamental challenges: language-specific biases distort comparis
Humanoid robots operating in shared, dynamic environments must respond to rapidly approaching objects while ma
Streaming 3D reconstruction models keep past video frames in a recurrent state, fast weights from test-time tr
State of the art latent dynamics world models achieve impressive performance for robot planning. But do they a
Modern robot policies often perform expensive inference to generate action chunks, making serving a latency bo
World action models (WAMs) learn latent variables from observations and use these to both predict the evolutio
Data flywheels promise continuous improvement via insights from deployment data. Understanding how the deploye
Planning with world models enables test-time adaptation for embodied agents, offering superior generalization
Large-scale egocentric human videos provide rich and scalable manipulation experience for robot policy learnin
Automated endoscope guidance reduces the need for continuous manual camera control during minimally invasive s
Scaling humanoid motion foundation models is constrained by the scarcity of diverse, robot-executable data and
Embodied agents are usually organized around individual tasks, yet the physical world keeps changing between t
The short-time Fourier transform (STFT) characterizes the local frequency content of time-varying signals by e
Computationally expensive simulations and real-world observations often provide data at a lower temporal resol
Recent work has shown that, in zero-sum games, an optimizer can extract $Ω(\sqrt{T})$ strategic surplus---cumu
Transactions differ in how their value changes with execution time and relative position. Ethereum's EIP-1559
Can algorithms be learned and evolved as models, rather than repeatedly redesigned as programs? We explore thi
The input space of single-spike neural networks decomposes into causal pieces, and the number of causal pieces
Indivisible resources allocated in advance may need to be reallocated when capacity reductions make existing a
The ability to represent temporal information is often hypothesized to underlie the efficiency and learning ca
Spiking neural networks (SNNs) have increasingly incorporated rich neuronal dynamics to enhance temporal proce
We investigate the growth trajectory of online platforms operating as market makers in two-sided matching mark
Fast and accurate qubit-state assignment is essential for feedback, calibration, and error correction in quant