A multi-scale unstructured gigapixel VR panoramic photography system

Abstract

The embodiment of the invention discloses a multi-scale unstructured gigapixel VR panoramic photography system, which comprises a wide field ring camera array, a narrow field ring camera array, an image processing device, a multi-camera image mosaic device and a VR display device. The wide field ring camera array acquires a plurality of wide field images, and the narrow field ring camera array acquires a plurality of narrow field images. The image processing device compresses a plurality of wide-field images and a plurality of narrow-field images based on the preview angle feedback informationfed back by the VR display device, and decodes and decompresses the compressed images after collecting the images in parallel. Multi-camera image mosaic equipment adopts ZNCC algorithm according to the calibration parameter matrix to decompress the decoded multi-wide field of view images and multi-narrow field of view images for multi-scale fusion to generate gigapixel-level ring image. megapixelVR panoramic video can be captured and displayed.

Description

technical field [0001] Embodiments of the present invention relate to the field of image technology, and in particular to a multi-scale unstructured one-gigapixel VR panoramic photography system. Background technique [0002] With the development of the existing VR technology and the development of the related camera industry, in the field of computer and computer photography, video acquisition and image capture have made great progress and development in terms of scale and performance. Today, VR video is still limited in two aspects. On the spatial scale, its scalability is still greatly limited by the video imaging quality of existing cameras. On the time scale, its imaging delay and corresponding imaging frame rate are still limited. It is limited to the frame rate of the existing imaging system and the real-time performance of the system. Therefore, in the field of high-definition surveillance or in systems such as VR and other circular panoramic imaging photography, ho...

AI Technical Summary

Problems solved by technology

[0003] In the existing real-time video acquisition system, due to the limitations of data flow and computational complexity, it is often impossible to achieve billion-pixel parallel real-time output and processing. There are often very large contradictions between them, so the current real-time video acquisition is often difficult to take into account the overall video stream information of the wide field of view and the video detail information of the narrow field of view

In addition, for such an ultra-wide field of view on-site display, the traditional display method also has very large limitations, which is not only very unfriendly to the user experience, but also often cannot display 360-degree global video in a reasonable way information

Images