Depth based foveated rendering for display systems

A technology for display devices and users, applied in stereoscopic systems, 3D image processing, data processing input/output processes, etc., can solve problems such as complex visual perception systems

Active Publication Date: 2020-01-10
MAGIC LEAP INC
View PDF22 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the complexity of the human visual perception system, it is a challenge to generate AR technologies that promote comfortable, natural-feeling, rich presentation of virtual imagery elements among other virtual or real-world imagery elements

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Depth based foveated rendering for display systems
  • Depth based foveated rendering for display systems
  • Depth based foveated rendering for display systems

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0107] Rendering virtual content for augmented and virtual display systems is computationally intensive. Among other things, computational intensity may use undesirably large amounts of memory, result in high latency, and / or may require the use of powerful processing units, which may have high cost and / or high energy consumption.

[0108] In some embodiments, methods and systems conserve computing resources, such as memory and processing time, by reducing the resolution of virtual content located at locations away from the gaze point of the user's eyes. For example, the system may render virtual content at a relatively high resolution (e.g., the highest resolution) at or near the gaze point of the user's eyes, while utilizing one or more lower resolutions for virtual content further away from the gaze point. . The virtual content is presented by a display system that can display the virtual content at multiple different depths (e.g., multiple different depth planes, such as t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Methods and systems for depth-based foveated rendering in the display system are disclosed. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes using different wavefront divergence. Some embodiments include monitoring eye orientations of a user of a display system based on detected sensor information. A fixation point is determined based on the eye orientations, the fixation point representing a three-dimensional location with respect to a field of view. Location information of virtual objects to present is obtained, with the location information indicating three-dimensional positions of the virtual objects. Resolutions of at least one virtual object is adjusted based on a proximity of the at least one virtual object to the fixation point. The virtual objects are presented to a user by display system with the at least one virtual object being rendered according to the adjusted resolution.

Description

[0001] priority claim [0002] This application claims priority to: U.S. Provisional Application No. 62 / 644,365, filed March 16, 2018; U.S. Provisional Application No. 62 / 475,012, filed March 22, 2017; U.S. Provisional Application No. 62 / 486,407, filed; and U.S. Provisional Application No. 62 / 539,934, filed August 1, 2017. The aforementioned patent application is hereby incorporated by reference in its entirety for all purposes. [0003] incorporated by reference [0004] This application incorporates by reference each of the following patent applications and publications in their entireties: U.S. Patent Application No. 14 / 555,585, filed November 27, 2014, published as U.S. Publication No. 2015 / 0205126 on July 23, 2015; U.S. Application No. 14 / 690,401, filed April 18, 2015, published October 22, 2015 as U.S. Publication No. 2015 / 0302652; U.S. Application No. 14 / 212,961, filed March 14, 2014, now published as Aug. 2016 U.S. Patent No. 9,417,452, published July 16; U.S. Applica...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N13/383H04N13/344
CPCG02B27/0172G02B27/0093G06F3/013G06T7/246H04N13/383H04N13/398G02B2027/0178G02B2027/0134G02B2027/0147G02B2027/0185H04N2213/002H04N13/395H04N13/344G06T15/00G06T2210/36H04N13/279G06F3/011G06F3/012G06F3/0346G06T19/006H04N13/341
Inventor I·L·C·杨L·E·埃德温V·马瑟T·M·达尔林普尔J·舍费尔C·卡尔里斯勒郑惠全吴哲宇P·普雷斯勒X·张A·C·卡尔森N·E·萨梅茨N·U·罗柏纳
Owner MAGIC LEAP INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products