Multimodal perception
Listening to the Motion
Question
Audio-visual segmentation often mistakes visually salient but silent objects for sounding objects.
Approach
Use spectral-kinematic alignment to make audio retrieve motion evidence, then use that prior to guide object queries.
Status
Paper metadata and full code release are being prepared.