Automatic Object Detection, Labelling, and Localization by Camera’s Drone System

Abstract

This work explores the designing a system of an automated unmanned aerial vehicles (UAV( for objects detection, labelling, and localization using deep learning. This system takes pictures with a low-cost camera and uses a GPS unit to specify the positions. The data is sent to the base station via Wi-Fi connection.

The proposed system consists of four main parts. First, the drone, which was assembled and installed, while a Raspberry Pi4 was added and the flight path was controlled. Second, various programs that were installed and downloaded to define the parts of the drone and its preparation for flight. In addition, this part included programs for both Raspberry Pi4 and servo, along with protocols for communication, video transmission, and sending and receiving signals between the drone and the computer. Third, a real-time, modified, one dimensional convolutional neural network (1D-CNN) algorithm, which was applied to detect and determine the type of the discovered objects (labelling). Fourth, GPS devices, which were used to determine the location of the drone starting and ending points . Trigonometric functions were then used for adjusting the camera angle and the drone altitude to calculate the direction of the detected object automatically.

According to the performance evaluation conducted, the implemented system is capable of meeting the targeted requirements.