Method and system for splicing panoramic images in real time based on single-path image signal processing

Abstract

The invention discloses a method and a system for splicing panoramic images in real time based on single-path image signal processing for realizing direct and real-time image splicing in a machine. According to the technical scheme, the system comprises a multi-path shooting module, an image data splicing processing module, an image signal processing module and a video coding module, wherein the multi-path shooting module is used for synchronous shooting of multiple paths of videos; the image data splicing processing module is used for carrying out synchronous control on the shooting of the multi-path shooting module, receiving each frame of video image shot by the multi-path shooting module, and splicing the video images into a panoramic video frame; the image signal processing module isused for providing a clock signal for the image data splicing processing module for carrying out synchronous control on the shooting of the multi-path shooting module, receiving the panoramic video frame transmitted by the image data splicing processing module, carrying out image signal processing on each panoramic video frame, and converting into RGB or YUV data; and the video coding module is used for receiving the RGB or YUV data transmitted by the image signal processing module, encoding the data into a video format file or a picture format file, and storing the video format file or the picture format file.

Description

technical field [0001] The invention relates to panoramic image mosaic technology, in particular to a mosaic method and system with higher requirements for real-time and precision of panoramic image mosaic. Background technique [0002] At present, there are three main ways to generate panoramic video content: [0003] The first solution is implemented as follows: use a camera to shoot a mirror to record a panoramic video. Among them, the function of the mirror is to reflect the environment image to the camera. According to the different types of reflective surfaces of the reflector, there are mainly hyperboloids, paraboloids, egg shapes, etc. The pitch angle range of the reflected light coverage environment varies according to the design, ranging from tens of degrees to more than a hundred degrees, and the horizontal is 360 degrees. The process of its use is usually to take a photo or video first, record the photo or video file of the image reflected by the mirror, and t...

AI Technical Summary

Problems solved by technology

In this way, because it involves the linkage of multiple cameras, the operation is cumbersome and it is inconvenient to trigger at the same time

When shooting with multiple cameras, each channel of video will be independently processed and encoded by ISP, which will lead to a decrease in data accuracy, out-of-sync videos, and inconsistent video color and brightness, resulting in the inability to achieve the best splicing effect

Multiple cameras also add to the cost

At the same time, the processing process needs to import the files of multiple cameras into the computer, and the files cannot be missed, otherwise they cannot be spliced, which is troublesome and cannot be output in real time

Images