Charades-STA

Overview edit

Variants: Charades-STA

Associated Benchmarks

This dataset is used in 3 benchmarks:

• Video Retrieval - Metrics: text-to-video Mean Rank, text-to-video Median Rank, text-to-video R@1, text-to-video R@10, video-to-text Mean Rank, video-to-text Median Rank, video-to-text R@1, video-to-text R@10
• Moment Retrieval - Metrics: R@1 IoU=0.5, R@1 IoU=0.7, R@5 IoU=0.5, R@5 IoU=0.7, R@1 IoU=0.3, mIoU
• Temporal Sentence Grounding - Metrics: [email protected], [email protected], [email protected], [email protected]

Recent Benchmark Submissions

Research Papers

Recent papers with results on this dataset:

• DeCafNet: Delegate and Conquer for Efficient Temporal Grounding in Long Videos (2025) -
• LD-DETR: Loop Decoder DEtection TRansformer for Video Moment Retrieval and Highlight Detection (2025) -
• FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding (2024) -
• VideoLights: Feature Refinement and Cross-Task Alignment Transformer for Joint Video Highlight Detection and Moment Retrieval (2024) -
• LLaVA-MR: Large Language-and-Vision Assistant for Video Moment Retrieval (2024) -
• TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning (2024) -
• Saliency-Guided DETR for Moment Retrieval and Highlight Detection (2024) -
• Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval (2024) -
• UniMD: Towards Unifying Moment Retrieval and Temporal Action Detection (2024) -
• InternVideo2: Scaling Foundation Models for Multimodal Video Understanding (2024) -
• Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding (2024) -
• BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videos (2023) -
• Towards Weakly Supervised End-to-end Learning for Long-video Action Recognition (2023) -
• Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detection (2023) -
• Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding (2023) -
• UnLoc: A Unified Framework for Video Localization Tasks (2023) -
• D3G: Exploring Gaussian Prior for Temporal Sentence Grounding with Glance Annotation (2023) -
• Background-aware Moment Detection for Video Moment Retrieval (2023) -
• Query-Dependent Video Representation for Moment Retrieval and Highlight Detection (2023) -
• SimVTP: Simple Video Text Pre-training with Masked Autoencoders (2022) -