Published on Tue Aug 04 2020

MOR-UAV: A Benchmark Dataset and Baselines for Moving Object Recognition in UAV Videos

Murari Mandal, Lav Kush Kumar, Santosh Kumar Vipparthi

MOR is one of the essential tasks to support various UAV-based applications including aerial surveillance, search and rescue, event recognition, urban and rural scene understanding. We annotate 89,783 moving object instances collected from 30 UAV videos, consisting of 10,948 frames.

0
0
0
Abstract

Visual data collected from Unmanned Aerial Vehicles (UAVs) has opened a new frontier of computer vision that requires automated analysis of aerial images/videos. However, the existing UAV datasets primarily focus on object detection. An object detector does not differentiate between the moving and non-moving objects. Given a real-time UAV video stream, how can we both localize and classify the moving objects, i.e. perform moving object recognition (MOR)? The MOR is one of the essential tasks to support various UAV vision-based applications including aerial surveillance, search and rescue, event recognition, urban and rural scene understanding.To the best of our knowledge, no labeled dataset is available for MOR evaluation in UAV videos. Therefore, in this paper, we introduce MOR-UAV, a large-scale video dataset for MOR in aerial videos. We achieve this by labeling axis-aligned bounding boxes for moving objects which requires less computational resources than producing pixel-level estimates. We annotate 89,783 moving object instances collected from 30 UAV videos, consisting of 10,948 frames in various scenarios such as weather conditions, occlusion, changing flying altitude and multiple camera views. We assigned the labels for two categories of vehicles (car and heavy vehicle). Furthermore, we propose a deep unified framework MOR-UAVNet for MOR in UAV videos. Since, this is a first attempt for MOR in UAV videos, we present 16 baseline results based on the proposed framework over the MOR-UAV dataset through quantitative and qualitative experiments. We also analyze the motion-salient regions in the network through multiple layer visualizations. The MOR-UAVNet works online at inference as it requires only few past frames. Moreover, it doesn't require predefined target initialization from user. Experiments also demonstrate that the MOR-UAV dataset is quite challenging.

Thu Jan 21 2021
Computer Vision
Anti-UAV: A Large Multi-Modal Benchmark for UAV Tracking
Unmanned Aerial Vehicle (UAV) offers lots of applications in both commerce and recreation. Monitoring the operation status of UAVs is crucially important. To facilitate research on this topic, we propose a dataset, Anti-UAV.
0
0
0
Mon Mar 26 2018
Computer Vision
The Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking
Unmanned Aerial Vehicles (UAVs) are used to fuel numerous important applications in computer vision. However, very limited UAV datasets are proposed, and they focus only on a specific task such as visual tracking or object detection in relatively constrained scenarios.
0
0
0
Thu Jan 30 2020
Computer Vision
ERA: A Dataset and Deep Learning Benchmark for Event Recognition in Aerial Videos
The ERA dataset is designed to have a significant intra-class variation and inter-class similarity. The website is https://lcmou.io/ERA_Dataset/
0
0
0
Fri Jan 31 2020
Computer Vision
AU-AIR: A Multi-modal Unmanned Aerial Vehicle Dataset for Low Altitude Traffic Surveillance
Unmanned aerial vehicles (UAVs) with mounted cameras have the advantage of capturing aerial (bird-view) images. The availability of aerial visual data and recent advances in object detection algorithms led the computer vision community to focus on object detection tasks on aerial images.
0
0
0
Wed Jun 27 2018
Computer Vision
Hierarchical Deep Co-segmentation of Primary Objects in Aerial Videos
Primary object segmentation plays an important role in understanding videos generated by unmanned aerial vehicles. We propose a hierarchical deep-co-segmentation approach that repeatedly divides a video into two sub-videos formed by the odd and even frames, respectively.
0
0
0
Thu Jan 16 2020
Computer Vision
Vision Meets Drones: Past, Present and Future
Drones, or general UAVs, equipped with cameras have been fast deployed with a wide range of applications, including agriculture, aerial photography, and surveillance. To promote and track the evelopments of object detection and tracking algorithms, we have organized two challenge workshops in conjunction with ECCV 2018, and ICCV 2019.
0
0
0