Communication method, transmitting equipment and system for 3D video

Abstract

The embodiment of the invention relates to a communication method, transmitting equipment and a system for 3D video. The method comprises the steps of: acquiring video image data of a scene acquired by an image acquisition device, wherein the video image data comprises at least one depth map and at least two color maps; and performing encode processing on the video image data and then transmittingthe video image data. The system comprises the transmitting equipment and receiving equipment, wherein the transmitting equipment can acquire at least one depth map and at least two color maps of thescene through the image acquisition device; the acquired depth map is accurate and reliable, and the acquisition of video images has stronger real-time performance; and the receiving equipment can mend reconstructed images by using the multiple acquired color maps during viewpoint reconstruction, thereby improving the reconstruction effect of the images and having stronger practicability and real-time performance.

Description

technical field [0001] The present invention relates to the field of video technology, in particular to a 3D video communication method, sending device, and system. Background technique [0002] At present, the traditional video is a carrier of two-dimensional image information. It can only show the content of the object and ignore the depth information such as the distance and position of the object, which is incomplete. As the subject of video observation, human beings need to obtain more pictures than a two-dimensional image information to obtain the necessary spatial information, so as to obtain a picture that conforms to the human visual experience of observing the world with two eyes. [0003] 3D video technology can provide a picture with depth information that conforms to the principle of human stereo vision, so that it can truly reproduce the scene of the objective world, showing the depth, layering and authenticity of objects in the scene, which is also an importan...

AI Technical Summary

Problems solved by technology

If you want to obtain the video images of object 4a and object 1b at the virtual viewpoint o2, since the actually obtained video image information does not contain the image information of part 1a0 of object 1a, the image reconstructed at the o2 viewpoint will lack Part 1a0 of the object 1a, so there will be holes in the part 1a0, which makes the reconstructed image seriously distorted and the reconstruction effect is poor

[0011] In the process of realizing the present invention, the inventor found that the prior art has at least the following defects: the stereo matching algorithm in the prior art must depend on the brightness and color of the scene Therefore, the obtained disparity / depth map has many errors, and the effect of virtual viewpoint reconstruction based on the depth map is poor. The resulting image is inaccurate, and the stereo matching algorithm is complex, and the real-time performance of obtaining the disparity / depth map is not strong, and the current technology cannot be commercialized; while in the existing technology, a single depth camera is used to obtain depth information to reconstruct large disparity When the image of the virtual viewpoint is used, a large "hole" will be generated, and it cannot be repaired. The reconstructed image is seriously distorted, the reconstruction effect is poor, and the practicability is not strong.

Images