Head mounted display performing post render processing

Abstract

A head mounted display (HMD) system is disclosed for presentation of visual images in which a post render processing unit (PRU) is built into the HMD to offload operations usually performed by the graphics processing unit (GPU) in the computer that is rendering the computer graphical images (CGI). The PRU takes advantage of local access to tracking and other sensors to reduce the latency traditionally associated with augmented and virtual reality operation.

Description

CROSS REFERENCE TO RELATED APPLICATIONS[0001]The present application claims the benefit and priority to provisional application 62 / 115,874, the contents of which are hereby incorporated by reference.[0002]The present application also claims the benefit and priority to the following provisional application Nos. 62 / 135,905“Retroreflective Light Field Display”; 62 / 164,898 “Method of Co-Located Software Object Protocol,” 62 / 165,089 “Retroreflective Fiducial Surface”; 62 / 190,207 “HMPD with Near Eye Projection,” each of which are also hereby incorporated by reference.FIELD OF THE INVENTION[0003]An embodiment of the present invention relates to the art of head mounted displays used to present rendered visual images to users in augmented reality (AR) and virtual reality (VR) applications.BACKGROUND OF THE INVENTION[0004]Currently augmented reality (AR) and virtual reality (VR) devices are being manufactured and sold to customers for use in many fields such as business operations, industrial...

AI Technical Summary

Benefits of technology

The patent describes a technology that reduces latency in augmented reality and virtual reality applications, such as correcting for movement of the user's head or eyes. This technology can also be used when the external computer is slow or overloaded. Additionally, the patent suggests that the technology can perform other adaptations and corrections.

Problems solved by technology

Some limitations arise in these systems because the rendered images must, necessarily, lag behind the real time movements of the user as data from head or eye tracking means in the headsets are transmitted back to these processing systems.

Further, added processing is often necessary to compensate for deficiencies in the display technology due to optical problems such as spherical and chromatic aberration in the lens systems.

However, in many cases the post render fixup of the images in the prior art system of FIG. 1 is inadequate to provide an acceptable user experience.

This is due, in part, to various sources of latency.

For example, in the case of AR / VR games, some games may have greater frame complexity and require higher frame rates than others.

That is the capability of the computer system may be limited and the computer system may be multitasking.

Additionally, in the case of an AR / VR program, there may be portions of the program in which the complexity of the program varies.

As a result, the frame update rates may be lower than desired and there may be uneven loading, which can create an unacceptable user experience.

Images