Unlock instant, AI-driven research and patent intelligence for your innovation.

Spatial relationships for integrating visual images of the physical environment into virtual reality

A technology of physical environment and visual images, applied in the field of virtual reality, can solve problems such as less help

Active Publication Date: 2021-11-23
QUALCOMM INC
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, such systems are generally limited to providing mechanisms for the user to interact with only virtual objects that exist in the VR simulation, and do little to help with the problems discussed above

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Spatial relationships for integrating visual images of the physical environment into virtual reality
  • Spatial relationships for integrating visual images of the physical environment into virtual reality
  • Spatial relationships for integrating visual images of the physical environment into virtual reality

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] figure 1 To illustrate a functional block diagram of a head mounted display (HMD) 100 capable of performing the processes discussed herein. In one example, HMD 100 is a user device capable of integrating a visual image of a physical environment into a virtual reality image (eg, process 400 described below). In general, control unit 106 is coupled to receive visual images 103 of the physical environment from visual camera 102 . The control unit 106 is configured to then integrate the visual image 103 into the virtual image generated by the VR engine 122 . The virtual image is then displayed to the user by means of the display 126 . In one implementation, display 126 , vision camera 102 , depth camera 104 , control unit 106 , sensor 105 , and / or user interface 108 are integrated into a single unit that can be worn by a user of HMD 100 . In another implementation, the control unit 106 is separate from the HMD 100 . That is, control unit 106 may be coupled to HMD 100 vi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a method for use with a head mounted display in a physical environment comprising obtaining depth information of the physical environment and capturing a visual image of the physical environment. The method also includes determining a spatial relationship between a user of the head-mounted display and one or more physical objects included in the physical environment based on the depth information. The visual image is then segmented based on the spatial relationship to generate a segmented image including the one or more physical objects. The segmented image is then overlaid on a virtual image to display both the virtual image and the one or more physical objects on the head mounted display.

Description

technical field [0001] Aspects of the invention relate generally to virtual reality and, in particular, to integrating visual images of the physical environment into virtual images presented on head-mounted displays. Background technique [0002] Virtual reality (VR) is an emerging technology that provides users with an immersive multimedia or computer simulation environment. Such environments may simulate the user's physical presence in a fictional world or a world modeled after a real location. VR technology can present graphics, audio, and other sensory enhancements to a user to improve the user's experience within the virtual environment. [0003] However, some of today's VR technologies are still challenging. For example, many VR headsets block the user's view of the real world (ie, the physical environment). That is, in order to present a more immersive visual appearance to the user, the VR headset may completely or mostly block the user's view of everything except ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06F3/0481G06F3/0484G06T19/00
CPCG06F3/011G06T19/006G06F3/04817G06F3/012G06F3/04815G06F3/0484G06F3/017G02B27/0172G06F3/005G02B2027/0138
Inventor 埃文·罗伯特·希尔德雷特弗朗西斯·伯纳德·麦克杜格尔
Owner QUALCOMM INC