Unmanned aerial vehicle cluster video picture rendering and post-processing method, medium and device

Abstract

The invention provides an unmanned aerial vehicle cluster video picture rendering and post-processing method, a medium and a device, relates to the technical field of image processing, and can avoid the problem of high time consumption caused by data decoding and information post-processing by adopting a computer CPU, effectively improve the rendering processing efficiency and meet the real-time requirement. According to the method, a shader is adopted to carry out rendering processing and information post-processing on a video stream or a picture; for the video stream, hardware decoding is carried out on a data packet downloaded by the unmanned aerial vehicle to extract first shell data, YUV compressed data in the first shell data is packaged into second shell data for rendering, and the attribute of the second shell data is called as a shader resource; for the picture, the downloaded picture is decompressed to obtain YUV data, and format conversion calculation is performed by adopting a shader; and finally, the textures corresponding to the shader resources enter a custom shader pipeline to carry out an information post-processing flow. The technical scheme provided by the invention is suitable for an image processing process.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to a method, medium and device for rendering and post-processing video images of drone clusters. Background technique [0002] As the data bandwidth brought by the UAV cluster continues to increase, the amount of video data downloaded from the mission loads carried by it to the ground station also increases, which can provide higher quality video data for intelligence processing software. Take H.264 data as an example for the data stream downloaded from the UAV payload to the ground station equipment. Due to the large amount of high-definition video data, the data decoding and calculation process with the help of computer CPU in the past consumes a lot of time and cannot meet the real-time requirements of video data. At the same time, it also greatly occupies the computing resources of the processor, which is not conducive to the use of other UAV modules such as int...

AI Technical Summary

Problems solved by technology

[0004] The more common high-definition video hard-decoded data display rendering directly relies on the fixed pipeline method to directly display the video memory data such as data format conversion, and the rendering data cannot be obtained and post-processed in the fixed pipeline, and the data operation is lost. Flexibility, which is not conducive to the subsequent intelligence processing against it

Images