Method for generating 3D panoramic image from dense point cloud

Abstract

The invention discloses a method for generating a 3D panoramic image from dense point cloud. In the method, a 360-degree panoramic image and a corresponding 360-degree depth image are used for rendering a correct image a virtual camera should see through deploying one virtual camera in each direction, after the panoramic image and the corresponding depth image are acquired, a pair of 3D panoramicimages can be generated, a correct parallax error relation can be generated for any direction, depth perception is not changed along with a difference between a viewing angle and an original camera placement angle, a vertical parallax error causing discomfort of human eyes is avoided, and thus immersion and comfort level of a user when the user watches panoramic 3D by using VR head-mounted equipment can be greatly improved. In addition, a base line distance B of the virtual camera can also be adjusted according to sizes of shooting scenes, and thus different levels of 3D feeling is achieved.

Description

Technical field [0001] The invention belongs to the technical field of 3D panoramic images, and specifically relates to a method for generating 3D panoramic images from dense point clouds. Background technique [0002] Currently, the Virtual Reality market is hot. Among them, panoramic video has become one of the fastest products in the VR market due to its low production cost and short cycle. The production of panoramic video is usually by multiple cameras (more than or equal to 2) shooting the scene at the same time, and then post-stitching to get a 360x180 degree panoramic picture. When the user uses a VR helmet to watch, he can turn his head at will. To get the visual content of the entire scene. However, in order to improve the immersion of the VR scene, a more attractive content is 360-degree 3D panoramic video. 360 3D panoramic video also provides a sense of depth of field while allowing users to rotate their heads freely. Users get a three-dimensional 360-degree video ...

AI Technical Summary

Problems solved by technology

[0004] 1. Only the part facing the camera can get a sense of depth, while the sense of depth in other directions will gradually disappear;

[0005] 2. When the vertical parallax is introduced in the non-camera-facing direction, the left and right eye images will produce vertical parallax in the non-camera-facing direction, causing discomfort to the human eye

This will lead to an increase in the amount of data, heavy and redundant stitching work in the later stage, and the inability to shoot videos, etc.