Method and system for splicing panoramic images in real time based on multi-path image signal processing

Abstract

The invention discloses a method and a system for splicing panoramic images in real time based on multi-path image signal processing, achieving built-in direct and real-time splicing, ISP processing,coding, storing and outputting. The technical scheme is as follows: the system comprises a multi-path shooting module, a multi-path image signal processing module, an image data splicing processing module and a video coding module, wherein the multi-path shooting module is used for synchronous shooting of images in an original format; each path of the image signal processing module is correspondingly connected with a path of shooting module, the image data in the original format are processed into visual data, meanwhile, a clock signal is provided for the corresponding shooting module so as toensure synchronism of all the images shot by the shooting module; the image data splicing processing module is connected with each path of image signal processing module and is used for processing the visual data output by each path of image signal processing module into panoramic image data, meanwhile, a uniform clock signal is sent to each path of image signal processing module so as to ensurethe synchronism; and the video coding module is connected with the image data splicing processing module and is used for coding pictures or video files of the panoramic image data.

Description

Technical field [0001] The present invention relates to panoramic image splicing technology, in particular to a splicing method and system that requires higher real-time and accuracy of panoramic image splicing. Background technique [0002] There are currently three main methods for generating panoramic video content: [0003] The first solution is implemented as follows: use a camera to shoot a mirror to record a panoramic video. Among them, the role of the mirror is to reflect the environment image to the camera. According to the different types of the reflective surface of the mirror, there are mainly hyperboloid, parabolic, egg-shaped, etc. The pitch angle range of the reflected light covering the environment varies depending on the design, ranging from tens of degrees to more than one hundred degrees, and the level is 360 degrees. The process of its use is usually to take a photo or video first, record the photo or video file of the image reflected by the mirror, and then ...

AI Technical Summary

Problems solved by technology

In this way, because it involves the linkage of multiple cameras, the operation is cumbersome and it is inconvenient to trigger at the same time

When shooting with multiple cameras, each channel of video will be independently processed and encoded by ISP, which will lead to a decrease in data accuracy, out-of-sync videos, and inconsistent video color and brightness, resulting in the inability to achieve the best splicing effect

Multiple cameras also add to the cost

At the same time, the processing process needs to import the files of multiple cameras into the computer, and the files cannot be missed, otherwise they cannot be spliced, which is troublesome and cannot be output in real time

Images