Method and device for realizing virtual reality by using unmanned aerial vehicle based on computer vision

Abstract

The invention discloses a method and a device for realizing virtual reality by using an unmanned aerial vehicle based on computer vision. The method comprises the following steps: acquiring and operating by using a variety of sensors to obtain real-time gesture information of a controller, and feeding a gesture control signal of the controller back into a plurality of flight attitudes of the unmanned aerial vehicle in real time to achieve one-to-one correspondence between the attitudes of the unmanned aerial vehicle and the gesture of the controller, so as to control angles and directions of a plurality of airborne cameras of the unmanned aerial vehicle to obtain a visual image expected by the controller; shooting real-time video information of the surrounding environment and returning the real-time video information to virtual reality equipment by the airborne cameras of the unmanned aerial vehicle; receiving the real-time video information of the surrounding environment, shot by the airborne cameras of the unmanned aerial vehicle, by the virtual reality equipment, performing 3D processing, rendering, and displaying on a display device in real time. Through the method and the device, a user experience is improved, a user can use the unmanned aerial vehicle for special-purpose detection conveniently, and the controllability and the funniness of the unmanned aerial vehicle are enhanced.

Description

technical field [0001] The invention relates to the field of virtual reality interaction of unmanned aerial vehicles, in particular to a method for adjusting the flight attitude of multiple unmanned aerial vehicles and taking pictures of multiple aerial vehicles according to the change of the gesture information of the controller at the position in front of the depth of field camera equipped on the virtual reality device. A method and a device for displaying received real-time video information on a display screen of a virtual reality device after 3D processing and rendering by an image processing device. Background technique [0002] With the rapid development of unmanned aerial vehicle technology, more and more unmanned aerial vehicles have entered people's life scenes. By setting up cameras on unmanned aerial vehicles, you can obtain rich and colorful aerial video information. How to better watch aerial photography Video information, in order to be more convenient to oper...

AI Technical Summary

Problems solved by technology

[0006] In order to overcome the deficiencies of the prior art, the present invention provides a computer vision-based method and device for realizing virtual reality by using an unmanned aerial vehicle, which solves the difficulty in controlling the unmanned aerial vehicle in the prior art and the inability to observe the onboard camera of the unmanned aerial vehicle in real time Problems with captured video information

Images