Three-dimensional scene modeling method and device, electronic device, readable storage medium and computer equipment

Abstract

The invention discloses a three-dimensional scene modeling method and device, an electronic device, a readable storage medium and computer equipment. The three-dimensional scene modeling method includes collecting the depth image of the scene, collecting the visible light image of the scene, processing the depth image and the visible light image to identify the occluded object and the category of the occluded object in the scene, and measuring the depth information indicated by the depth image and the visible light image. The measured color information and category calculate the estimated depth information and estimated color information of the occluded object, and construct the three-dimensional color model of the scene according to the measured depth information, measured color information, estimated depth information and estimated color information. The 3D scene modeling method in the embodiment of the present invention jointly estimates the depth information and color information of the occluded part of the object based on the measured depth information, color information and the identified category of the occluded object, thereby supplementing the missing depth information and color information, Improve the integrity of the 3D modeling of the scene.

Description

Technical field [0001] The present invention relates to three-dimensional modeling, and more particularly, to a method of modeling three-dimensional scenes, three-dimensional scene modeling apparatus, the electronic apparatus, the nonvolatile computer readable storage medium and computer equipment. Background technique [0002] Existing three-dimensional scene modeling is usually the depth image of a scene captured by a depth camera, and take a two-dimensional visible light image by the visible light camera, depth information and color information in conjunction with the two-dimensional image of the visible light image of the scene depth three-dimensional modeling. But inevitably there are scenes occluded objects, the camera can not get to the depth of objects in the scene depth information occluded part, so it can not be three-dimensional modeling, three-dimensional modeling of the object scene image obscured part in the three-dimensional scene modeling integrity. Inventive con...

AI Technical Summary

Problems solved by technology

However, there are inevitably occluded objects in the scene, and the depth camera cannot obtain the depth information of the occluded part of the object in the scene. Therefore, it is impossible to perform 3D modeling on the occluded part of the object during 3D scene modeling. 3D modeling of video scenes the integrity of

Images