VLMs Excel on MCQs but Fail Open Long Video Reasoning
Post analyzes VLM performance on long video datasets like Video-MME and LongVideoBench, noting strong results on multiple-choice tasks but failure on open-ended multi-step reasoning. VLMs achieve 100% on 4-option questions but can't answer without options. Questions behavior in real-world video understanding.






