TNL2K

Tracking by natural language

Dataset Information
Introduced
2021
License
Custom
Homepage
Official Website
Contents

Overview

Tracking by Natural Language (TNL2K) is constructed for the evaluation of tracking by natural language specification. TNL2K features:

  • Large-scale: 2,000 sequences, contains 1,244,340 frames, 663 words, 1300 / 700 for the train / testing respectively

  • High-quality: Manual annotation with careful inspection in each frame

  • Multi-modal: Providing visual and language annotation for each sequence

  • Adversarial-samples: Randomly adding adversarial samples for research on adversarial attack and defence

  • Significant-appearance-variation: Containing videos with cloth/face change for pedestrian

  • Heterogeneous: Containing RGB, thermal, Cartoon, Synthetic data

  • Multiple-baseline: Tracking-by-BBox, Tracking-by-Language, Tracking-by-Joint-BBox-Language

Source: Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmark

Variants: TNL2K

Associated Benchmarks

This dataset is used in 2 benchmarks:

Recent Benchmark Submissions

Task Model Paper Date
Visual Object Tracking SPMTrack-G SPMTrack: Spatio-Temporal Parameter-Efficient Fine-Tuning with … 2025-03-24
Visual Object Tracking SPMTrack-B SPMTrack: Spatio-Temporal Parameter-Efficient Fine-Tuning with … 2025-03-24
Visual Object Tracking SPMTrack-L SPMTrack: Spatio-Temporal Parameter-Efficient Fine-Tuning with … 2025-03-24
Visual Object Tracking MCITrack-B224 Exploring Enhanced Contextual Information for … 2024-12-15
Visual Object Tracking MCITrack-L384 Exploring Enhanced Contextual Information for … 2024-12-15
Visual Object Tracking RTracker-L RTracker: Recoverable Tracking via PN … 2024-03-28
Visual Object Tracking LoRAT-L-378 Tracking Meets LoRA: Faster Training, … 2024-03-08
Visual Object Tracking LoRAT-g-378 Tracking Meets LoRA: Faster Training, … 2024-03-08
Visual Object Tracking ODTrack-B ODTrack: Online Dense Temporal Token … 2024-01-03
Visual Object Tracking ODTrack-L ODTrack: Online Dense Temporal Token … 2024-01-03
Visual Object Tracking ARTrackV2-L ARTrackV2: Prompting Autoregressive Tracker Where … 2023-12-28
Visual Object Tracking SeqTrack-L384 Unified Sequence-to-Sequence Learning for Single- … 2023-04-27
Visual Object Tracking DropTrack DropMAE: Masked Autoencoders with Spatial-Attention … 2023-04-02
Visual Tracking JointNLT Joint Visual Grounding and Tracking … 2023-03-21
Visual Tracking UNINEXT-H Universal Instance Perception as Object … 2023-03-12
Visual Tracking OSTrack Joint Feature Learning and Relation … 2022-03-22
Visual Tracking AdaSwitcher Towards More Flexible and Accurate … 2021-03-31
Visual Object Tracking AdaSwitcher Towards More Flexible and Accurate … 2021-03-31
Visual Tracking TransT Transformer Tracking 2021-03-29

Research Papers

Recent papers with results on this dataset:

External Links: