Multi-channel panoramic video real-time monitoring system and method

Abstract

The invention discloses a multi-channel panoramic video real-time monitoring method, which mainly solves the problem of real-time fusion of multi-channel panoramic video. The method comprises the following implementation steps of: obtaining a video through a camera or by importing a video file; then, extracting characteristic points of video frames, and solving a homography matrix between corresponding video frames to describe a coordinate position relation between video channels; determining a relative position relation between the multi-channel video frames to obtain a fusion order of the multi-channel video frames; selecting two video frames to be processed currently according to the fusion order, searching an optimal seam line in a public region of two video frames, and establishing afusion search table of channel information and pixel coordinate transformation relation; and fusing the multi-channel video frames into panoramic video frames according to the fusion search table, and displaying the obtained panoramic video frames in real time according to an appointed frame rate, thereby implementing the real-time monitoring on the multi-channel panoramic video. The system and the method are excellent in real-time property and strong in availability, and are independent from hardware.

Description

technical field [0001] The invention belongs to the technical field of panoramic video splicing, in particular to a multi-channel panoramic video real-time monitoring system, which can be applied to panoramic real-time monitoring of stations, supermarkets, and traffic sections. Background technique [0002] In recent years, people's demand for video surveillance is increasing day by day. Traditional surveillance solutions use several cameras to capture scenes from different perspectives (see figure 1 ), and return scene information to multiple independent windows of the client to realize monitoring (see figure 2 ). Due to the spatial complexity of the monitoring site, especially the partial overlap of the monitoring areas, the monitoring personnel need to monitor multiple windows, analyze information correlation and realize target identification and tracking. Monitoring is inconvenient and not intuitive. [0003] With the development of panoramic image technology, panora...

AI Technical Summary

Problems solved by technology

[0006] 3. Zhuang Yueting, Chen Ming, Wu Fei, etc. A method for generating panoramic videos based on multi-view video streams. Publication number: CN101146231, Publication date: 2008.03.19. Described a method for panoramic video stitching based on video streams. Its characteristics The reason is that it is necessary to correspond to the synchronous frames in each video stream first, and then generate a panoramic video, which cannot be used for real-time monitoring

[0008] 1. The hardware device is highly dependent, and it is necessary to use special hardware devices to determine the positional relationship of the video channel and video fusion, and the scalability is poor;

[0009] 2. The fusion speed is slow, and it is difficult to realize real-time monitoring of multi-channel panoramic video;

[0010] 3. The usability of the system is not strong, and the working mode is single. It can only realize real-time video splicing of 2 to 4 channels or can only complete non-real-time splicing of videos by importing video files.

Images