UAV-GESTURE: A Dataset for UAV Control and Gesture Recognition

Asanka G Perera, Yee Wei Law, Javaan Chahl

Abstract

Current UAV-recorded datasets are mostly limited to action recognition and object tracking, whereas the gesture signals datasets were mostly recorded in indoor spaces. Currently, there is no outdoor recorded public video dataset for UAV commanding signals. Gesture signals can be effectively used with UAVs by leveraging the UAVs visual sensors and operational simplicity. To fill this gap and enable research in wider application areas, we present a UAV gesture signals dataset recorded in an outdoor setting. We selected 13 gestures suitable for basic UAV navigation and command from general aircraft handling and helicopter handling signals. We provide 119 high-definition video clips consisting of 37151 frames. The overall baseline gesture recognition performance computed using Pose-based Convolutional Neural Network (P-CNN) is 91.9 %. All the frames are annotated with body joints and gesture classes in order to extend the dataset's applicability to a wider research area including gesture recognition, action recognition, human pose recognition and situation awareness.

paper

Download

This dataset is available for academic research only. Please send an email to asanka.perera@mymail.unisa.edu.au to get the video dataset download link.

Download the estimated annotations obtained using OpenPose.

Per-video MATLAB files

Per-frame JSON files

Download 3 split sets.

Splits

The complete code is available here.

If you use this data in your publications please cite our paper "UAV-GESTURE: A Dataset for UAV Control and Gesture Recognition".