Method for converting flat video to tridimensional video based on real-time dialog between human and machine

Abstract

The invention relates to a method for changing a plane video to a stereoscopic video, based on real time human-computer conversation, which belongs to the multimedia technical field of computers. The method comprises that: a computer divides a whole video sequence into sub-sequences that have related contents; a user designates any frame of each sub-sequence as a key frame; the computer carries out wave-filtration to all plane video frames to enhance image edge information and sharpen the edge of the foreground objects of the video frame; foreground object segmentation is carried out to the key frames and non-key frames and profile curves and depth maps are extracted until depth map sequences corresponding to all the frames of the original plane video sequence are generated; the smoothed depth map sequences are utilized for rendering and generating multi-visual angle views corresponding to each moment, and the views are synthesized into stereoscopic video frames; the stereoscopic video frames of all the moments are composed into the stereoscopic video sequences. As the method is based on the real time human-computer conversation, the precise depth map of each frame can be obtained, thus well realizing the changing from the plane video to the stereoscopic video and finally obtaining the stereoscopic video with better effect.

Description

technical field [0001] The invention belongs to the technical field of computer multimedia, and in particular relates to a technology for converting common plane video into stereoscopic video. technical background [0002] Through the research on the elements of human physiological stereo vision, it is found that when human beings see the same scene with left and right eyes, they will have a three-dimensional sense due to the existence of "parallax". Traditional video sequences are single-channel planar video sequences, while stereoscopic video sequences include multiple (two or more) planar video sequences, and the views of each planar video sequence at the same time have "parallax" Information can provide the corresponding left-eye view sequence and right-eye view sequence for the viewer, which is also the reason why an immersive stereoscopic effect can be produced when watching a stereoscopic video. [0003] For a long time, realistic stereoscopic video has been loved by...

AI Technical Summary

Problems solved by technology

However, the effect of the stereoscopic video generated by this technical solution depends on the accuracy of the segmentation algorithm, while the existing computer automatic segmentation algorithm has a relatively high dependence on the content of the video sequence, and the robustness of the algorithm is low

In addition, there is no mature foreground and foreground object position judgment and motion relationship analysis algorithm, so the user needs to manually assign the corresponding depth

Images