Augmenting depth map representation with reflectivity map representation

A technology of reflectivity map and depth map, applied in the field of 3D representation, can solve problems such as reducing user experience

Active Publication Date: 2018-03-27
CTRL LABS CORP
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, creating a 3D representation of an object using only its depth map representation in the traditional way has the disadvantages of
For example, using only the depth information of captured objects in the scene for the 3D representation of the scene does not provide detailed information on the surfaces of the objects, which degrades the user experience due to the effect of the 3D scene resulting from the depth map representation of the captured objects

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Augmenting depth map representation with reflectivity map representation
  • Augmenting depth map representation with reflectivity map representation
  • Augmenting depth map representation with reflectivity map representation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] Figure 1A is a block diagram of a system environment including a virtual reality (VR) system 100 according to one embodiment. VR system 100 includes VR headset 140 and imaging device 115 each coupled to VR console 120 . For simplicity, only one VR helmet 140 , one imaging device 115 and one VR console 120 are shown in the VR system 100 . In alternative embodiments not shown, VR system 100 may include multiple VR headsets 140, imaging device 115, VR console 120, and additional or different components. Likewise, the functions performed by the various entities included in VR system 100 may vary in different embodiments.

[0023] VR headset 140 is a head-mounted display (HMD) that presents media to a user. Examples of media presented by VR headset 140 include one or more images, video, audio, or some combination thereof. In some embodiments, VR headset 140 may also function as an augmented reality (AR) and / or mixed reality (MR) headset. In these embodiments, VR headset...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A solution for generating a 3D representation of an object in a scene is provided. A depth map representation of the object is combined with a reflectivity map representation of the object to generatethe 3D representation of the object. The 3D representation of the object provides more complete and accurate information of the object. An image of the object is illuminated by structured light and is captured. Pattern features rendered in the captured image of the object are analyzed to derive the depth map representation and the reflectivity map representation of the illuminated object. The depth map representation provides the depth information while the reflectivity map representation provides the surface information (e.g., reflectivity) of the illuminated object. The 3D representation ofthe object can be enhanced with additional illumination projected onto the object and additional images of the object.

Description

technical field [0001] The present disclosure relates generally to the field of structured light imaging and, more particularly, to enhancing three-dimensional (3D) representations of objects using reflectance map representations of objects. Background technique [0002] The 3D representation of the scene or objects in the scene is used to render images for a virtual reality (VR) system that provides a virtual experience to a user of the VR system. However, creating a 3D representation of an object using only its depth map representation in a conventional manner has drawbacks. For example, using only depth information of captured objects in the scene for a 3D representation of the scene does not provide detailed information of the surfaces of the objects, which degrades user experience due to the effect of the 3D scene resulting from the depth map representation of the captured objects. Contents of the invention [0003] Embodiments of the disclosed invention include a sy...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G02B27/01G02B27/22
CPCG06T2207/10024G06T2207/30201G06T15/50G06T2207/10016G06T2207/10152G06T2200/08G06T2200/04G06T7/521G02B27/01G02B27/0149G02B2027/0138G02B2027/0156G02B30/23
Inventor 尼他耶·罗马诺纳达夫·格罗辛格
Owner CTRL LABS CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap