Projected image generation method and device, and method for mapping image pixels and depth values

Abstract

A method for generating a projected image of a three-dimensional space is disclosed. The projected image generation method according to one embodiment of the present invention comprises the steps of:estimating, on the basis of a reference coordinate system, multiple image obtained poses and multiple depth obtained poses, including the obtained position and obtained angle of each of multiple obtained images and multiple obtained depth values obtained of an actual three-dimensional space; obtaining, on the basis of the reference coordinate system, a user pose including the position and angle ofa user in a virtual three-dimensional space corresponding to the actual three-dimensional space; and generating a projected image formed by projecting the multiple obtained depth values onto at leastone of the multiple obtained images on the basis of a corresponding image obtained pose and at least one corresponding depth obtained pose, corresponding to the user pose.

Description

technical field [0001] The present invention relates to image generation, in particular to a three-dimensional space projection image generation method and its device, and a mapping method between image pixels and depth values. Background technique [0002] Various methods for representing indoor and outdoor environments with digital information have been introduced since more than 100 years ago. Cameras are introduced to acquire image information of the environment, and various rangefinders are introduced to acquire depth information of the environment. And, recently, a sensor system has been released on the market. The above-mentioned sensor system obtains images and depth values ​​at the same time through Google's JUMP or Samsung's Project Beyond, etc., and after making a three-dimensional (3D) image Display) to the user. [0003] However, the above-mentioned system can only acquire data at one location, so there is a limitation that only information related to a specif...

AI Technical Summary

Problems solved by technology

That is, since the user cannot move away from the path where the image was obtained, the above method has limitations such as being mainly applicable to creating content for experiencing the form of amusement equipment such as a roller coaster.

[0007] And, in the case of using an omnidirectional camera to capture an image, after making a binocular image by moving the field of view in left and right directions based on the center point of the corresponding image, the above-mentioned Image, the above method can view the captured image in three dimensions by rotating 360 degrees in terms of the characteristics of the omnidirectional camera, but there is a limitation that the observation cannot be separated from the shooting path

[0008] As observed above, the conventional technology has the problem of being unable to provide realistic three-dimensional images corresponding to the user's arbitrary movement and arbitrary rotation for indoor and outdoor environments.

Images