Real-time panoramic video stitching system based on embedded platform

Abstract

The invention relates to a real-time panoramic video stitching system based on an embedded platform. The real-time panoramic video stitching system based on the embedded platform comprises a panoramiccamera, a cloud platform server and an intelligent terminal; wherein the panoramic camera comprises an image acquisition device and a host; the image acquisition device comprises an image sensing module, an analog-to-digital conversion module, a digital signal processing module and a USB interface; the host comprises a master control processing module, a distortion reduction module, a view angleconversion module, an image stitching module, an image enhancement module and a wireless communication module; and the panoramic camera is connected with the cloud platform server and the intelligentterminal through the wireless communication module. By means of the real-time panoramic video stitching system based on the embedded platform, the algorithm complexity of the video stitching is greatly simplified, the power consumption of the hardware implementation is reduced, the problems of image registration, projection transformation and image fusion in the video stitching algorithm are realized fast, and the problems of large amount of operation and poor real-time performance of the video stitching algorithm are solved.

Description

technical field [0001] The invention relates to the field of video splicing, in particular to a real-time panoramic video splicing system based on an embedded platform. Background technique [0002] With the development of integrated circuits and computer technology, computer vision and computer image processing technology have developed rapidly, bringing great convenience to people's lives. Panoramic video has been used in different fields because of its wide field of view and high resolution, and can be used in various fields such as parking lot video surveillance, smart home, and augmented reality (AR). [0003] The essence of panoramic video stitching technology is based on image stitching, but due to the time continuity and the requirements of video codec transmission efficiency, video stitching has higher requirements for real-time and correctness. The basic process of image stitching mainly includes: image acquisition, image preprocessing, image registration, project...

AI Technical Summary

Problems solved by technology

[0005] In terms of computing power, Beijing Times Tuoling Technology uses cloud computing technology to complete panoramic stitching in the cloud in the patent "a processing method and system for panoramic video stitching"; although the use of cloud computing resources improves the stitching speed, but There will be delay problems in the process of uploading videos, which cannot meet real-time performance, and will occupy more system resources

A panoramic video surveillance system based on the ARM platform is used to complete image registration and splicing, which requires a high cost and requires an ARM processor with good performance and memory resources, and there will be a big problem with power consumption

Images