The system with a headset display HMD device and the method in this system

Abstract

A system (100) includes a head mounted display (HMD) device (102) including at least one display (112, 114) and at least one sensor (210) to provide posture information of the HMD device. The system further includes a sensor integrator module (304) and an application processor (204), the sensor integrator module is connected to at least one sensor, and is used to determine the motion vector of the HMD device based on the posture information, and the application processor is used to determine the motion vector based on the posture information. Pose of the HMD device, rendering the first texture (122, 322). The system further includes a motion analysis module (302) for determining a first velocity field (128, 328) having a value for at least a subset of pixels of the first texture and a synthesizer (224). A pixel velocity, compositor for rendering (140, 334) a second texture based on the first texture, the first velocity field, and the motion vector of the HMD, and providing the second texture to a display of the HMD device.

Description

technical field [0001] The present disclosure relates generally to head-mounted display systems, and more particularly to low-latency motion compensation and stabilization in head-mounted display systems. Background technique [0002] A virtual reality (VR) system replicates a physically existing environment that simulates many places in the real world, or an imagined world using fully computer-generated three-dimensional (3D) images of "scenes" in that world. Similarly, augmented reality (AR) systems "augment" physical presence in the real world with computer-generated 3D images that overlay simultaneously captured images of the real world. Thus, both VR and AR systems attempt to provide an accurate sense of "presence" in a real, augmented or imagined world. Typically, this sense of presence is facilitated through the use of head-mounted display (HMD) devices that provide separate left-eye and right-eye displays. Together, these displays render a stereoscopic or 3D repres...

AI Technical Summary

Problems solved by technology

However, because HMD devices typically allow the user to move freely, the user's head may perceivably move in the time between starting to render the texture and displaying the resulting rendered texture

Therefore, the image displayed at the HMD device at a certain point in time may lag behind the user's head movement

Also, virtual objects in the scene may be "in motion", so if the frame is rendered at the correct time, the rendered position of the virtual object may be different from where the object should appear

Images