Video real-time processing and synthesizing system and method

Abstract

The invention provides a video real-time processing and synthesizing system and method. The system comprises a video acquisition device, an audio acquisition device, a video acquisition height adjustment device, a display adjustment device, a video matting synthesis device and a real-time output device. According to the invention, the switching of a plurality of visual angles and real-time combination of multiple backgrounds are achieved, automatic adjustment and correction can be carried out according to the height of a portrait, the optical axis of the camera and the optical axis of a humaneye are automatically adjusted to be unified, processed videos can be provided for a user in real time, used equipment is simple and convenient, cost is low, operation technical difficulty is low, andthe requirements of common people can be met.

Description

technical field [0001] The invention relates to the field of video processing, in particular to a system and method for real-time video processing and synthesis. Background technique [0002] With the development of computers and the Internet, video has become an indispensable part of life, ordinary users are increasingly dependent on video, and the quality requirements of video shooting are also getting higher and higher. At the same time, online video programs are also In a blowout development. [0003] In traditional video shooting, the collection of portraits cannot be accurately focused according to the height of the portrait, so the portraits in the video are often adjusted out of proportion. The upper body of people who are low will be stretched, etc., resulting in image distortion that is difficult to correct. For example, problems such as video display portrait imbalance have caused great visual impact on users watching videos. [0004] In addition, the traditiona...

AI Technical Summary

Problems solved by technology

[0003] In traditional video shooting, the collection of portraits cannot be accurately focused according to the height of the portrait, so the portraits in the video are often adjusted out of proportion. The upper body of a low person will be stretched, etc., resulting in image distortion that is difficult to correct. For example, the video shows that the proportion of the portrait is out of balance, which has caused a great visual impact on the users watching the video.

[0004] In addition, the traditional method of switching between multiple cameras in the vertical plane to achieve height matching has the disadvantage that when switching to a camera position away from the bottom of the display screen, the optical axis of the subject’s eyes will be separated from the optical axis of the camera (see above or the subtitles on the lower screen to sing songs or read poems, etc.), so that the characters in the final video cannot form visual communication with the viewers, and there will be situations such as "rolling eyes" by the subject

[0005] The existing image keying synthesis technology cannot achieve real-time combination of video keying and 3D models and other backgrounds, nor can it achieve multi-angle switching during shooting, and does not support multiple video and audio acquisition devices

[0006] Moreover, the existing video shooting technology is based on green screen or blue screen as the background video shooting, but also because the cost and technical threshold requirements of video processing are too high, it cannot meet the requirements of the public, and there is no way to enter the life of the public.

Images