Awesome RGB-Event Tracking

Recent Advances in RGB-Event (RGB-E) Tracking.

🧸 We indicate different types with colored squares:

🟦 Event: Only Event data

🟩 RGB-E: RGB-E Tracking

🟧 RGB-X: RGB with any modality, including RGB-E Tracking

---

Links for a quick jump: 🔥Benchmarks🔥 🔥CVPR 2024🔥, ICCV 2023, CVPR 2023, Journals 2023, ArXiv, Early Works.

Benchmarks

🟦 Event    -   [EventVOT]Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline (CVPR24)[Paper][Code]

🟩 RGB-E    -   [FELT]Long-term Frame-Event Visual Tracking: Benchmark Dataset and Baseline (Arxiv24)[Paper] [Code]

🟩 RGB-E    -   [CRSOT]Cross-Resolution Object Tracking using Unaligned Frame and Event Cameras (Arxiv24)[Paper] [Code]

🟩 RGB-E    -   [VisEvent]Reliable Object Tracking via Collaboration of Frame and Event Flows (TCYB23)[Paper][Code]

🟩 RGB-E    -   [COESOT]Revisiting Color-Event based Tracking: A Unified Network, Dataset, and Metric (Arxiv22)[Paper] [Code]

🟩 RGB-E    -   [FE108]Object Tracking by Jointly Exploiting Frame and Event Domain (ICCV21)[Paper] [Code]

CVPR 2024

🟧 RGB-X    -   [SDSTrack]Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Tracking[Paper][Code]

🟧 RGB-X    -   [OneTracker]Unifying Visual Object Tracking with Foundation Models and Efficient Tuning[Paper]

🟧 RGB-X    -   [Un-Track]Single-Model and Any-Modality for Video Object Tracking[Paper]

🟦 Event    -   [HDETrack]Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline[Paper][Code]

ICCV 2023

🟩 RGB-E    -   [OneTracker]Unifying Visual Object Tracking with Foundation Models and Efficient Tuning[Paper] [Code]

CVPR 2023

🟧 RGB-X    -   [ViPT]Visual Prompt Multi-Modal Tracking[Paper][Code]

🟩 RGB-E    -   [AFNet]Frame-Event Alignment and Fusion Network for High Frame Rate Tracking[Paper] [Code]

Journals 2023

🟦 Event    -   [DANet]Distractor-aware Event-based Tracking (TIP23)[Paper]

🟩 RGB-E    -   [VisEvent]Reliable Object Tracking via Collaboration of Frame and Event Flows (TCYB23)[Paper][Code]

🟩 RGB-E    -   [UEPM]A Universal Event-Based Plug-In Module for Visual Object Tracking in Degraded Conditions (IJCV23)[Paper]

ArXiv

🟩 RGB-E    -   [Mamba-FETrack]Frame-Event Tracking via State Space Model[Paper] [Code]

🟧 RGB-X   -   [SeqTrackv2] Unified Sequence-to-Sequence Learning for Single- and Multi-Modal Visual Object Tracking[Paper] [Code]

🟩 RGB-E    -   [FELT]Long-term Frame-Event Visual Tracking: Benchmark Dataset and Baseline[Paper] [Code]

🟩 RGB-E    -   [CRSOT]Cross-Resolution Object Tracking using Unaligned Frame and Event Cameras[Paper] [Code]

Early works

🟦 Event    -   [MonTrack]Learning Graph-embedded Key-event Back-tracing for Object Tracking in Event Clouds (NIPS22)[Paper][Code]

🟦 Event    -   [STNet]Spiking Transformers for Event-based Single Object Tracking (CVPR22)[Paper][Code]

🟩 RGB-E    -   [CEUTrack]Revisiting Color-Event based Tracking: A Unified Network, Dataset, and Metric (Arxiv22)[Paper] [Code]

🟩 RGB-E    -   [FENet]Object Tracking by Jointly Exploiting Frame and Event Domain (ICCV21)[Paper] [Code]