Abstract
Video understanding in multimodal language models remains limited by contextlength: models often miss key transition frames and struggle to maintaincoherence across long time scales. To address this, we adapt Native SparseAttention (NSA) to video-language models. Our method, VideoNSA, adaptsQwen2.5-VL through end-to-end training on a 216K video instruction dataset. Weemploy a hardware-aware hybrid approach to attention, preserving denseattention for text, while employing NSA for video. Compared totoken-compression and training-free sparse baselines, VideoNSA achievesimproved performance on long-video understanding, temporal reasoning, andspatial benchmarks. Further ablation analysis reveals four key findings: (1)reliable scaling to 128K tokens; (2) an optimal global-local attentionallocation at a fixed budget; (3) task-dependent branch usage patterns; and (4)the learnable combined sparse attention help induce dynamic attention sinks.