System and method for generating flight instructions based on image recognition

Abstract

The flight instruction generation system based on image recognition of the present invention includes a camera assembly and an image processing unit, and the system also includes a first model library, a second model library, an algorithm program, and a flight instruction generation unit; the first model library contains multiple sets of The model storage space is used to store the main body characteristic model, and the said model storage space can be erased or written in real time; the second model library is used to store the general model of the main body; the instruction generating unit is used for one or more The judgment result generates a flight control command. The invention can realize purely visual control of commonly used actions (such as gesture control), can replace traditional remote control equipment to a certain extent, and reduces the difficulty of flying device control. The specially added visual control camera function can realize the Selfie action, which is one of the main requirements in drone aerial photography, and the shooting process does not require the operator to operate any physical remote control equipment, which is conducive to creative expression. When the main body returns after passing through obstacles, it is automatically identified and locked.

Description

technical field [0001] The invention belongs to the technical field of automatic control, and relates to an image recognition processing technology, a flying device control technology based on image recognition processing, and a flying device control method. Background technique [0002] The complexity of control has increased the technical threshold for the popularization of three-dimensional flying devices. Taking the aircraft controlled by the traditional pure manual remote control method as an example, to complete the control of all degrees of freedom of the aircraft, at least the remote control device must have the ability to control multiple degrees of freedom such as ascending / descending, left / right rotation, forward / backward, left / right movement, etc. For the operator, it is necessary to accurately control the control keys (joystick) with multiple degrees of freedom according to the flight experience and the real-time attitude or situation of the flying device, or ev...

AI Technical Summary

Problems solved by technology

For example, if the positioning accuracy of the terminal used for coordinate positioning is within 2 meters, it is very likely that the shooting subject will deviate from the position (center) of the picture when the equipment carried by the flying device is used for aerial photography, resulting in poor picture quality.

At the same time, this type of positioning system is also easily affected by signal strength, especially by buildings, etc.

Although the following system based on visual recognition can solve the shortcomings of the coordinate positioning system through visual tracking and image processing technology, it brings new problems: for example, changes in the shape or color of the target object may cause the system to be unable to continue tracking; the target object passes through obstacles. Easy to follow behind; easy to lose more when the target object changes, such as turning around or entering a complex background

Images