Predictive, foveated virtual reality system

A camera and line-of-sight vector technology, applied in stereoscopic systems, mechanical mode conversion, instruments, etc., can solve problems such as eye fatigue, large amount of image data, and lag time

Active Publication Date: 2019-05-21
APPLE INC
View PDF14 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] However, regular VR and AR systems can also have latency issues that can cause eye strain, headaches and/or nausea
For example, conventional virtual reality and augmented reality systems may involve a significant lag time between the time the user looks in a particular direction and the time the system is able to d

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Predictive, foveated virtual reality system
  • Predictive, foveated virtual reality system
  • Predictive, foveated virtual reality system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] Embodiments of a virtual reality device implementing a predictive foveal virtual reality system are described. Methods and systems for virtual reality (VR) and / or augmented reality (AR) devices (eg, headsets or headsets) may include predictive foveal virtual reality systems. A predictive foveal virtual reality system can be configured to capture a view of the world around a system user, augment the captured data, generate an augmented view of the world, and display this view to the user via the system's display.

[0024] As noted above, the predictive foveal virtual reality system may also be configured to capture (and render) image data using more than one resolution, such as to potentially reduce overall overhead, cost, workload, as described herein. For example, a virtual reality system may include one or more cameras (or camera systems) configured to capture both low-resolution and high-resolution image data. Low (or lower) resolution image data may be captured for...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A predictive, foveated virtual reality system may capture views of the world around a user using multiple resolutions. The system may include one or more cameras configured to capture lower resolutionimage data for a peripheral field of view while capturing higher resolution image data for a narrow field of view corresponding to a user's line of sight. Additionally, the system may also include one or more sensors or other mechanisms, such as gaze tracking modules or accelerometers, to detect or track motion. The system may also predict, based on a user's head and eye motion, the user's futureline of sight and may capture image data corresponding to a predicted line of sight. When the user subsequently looks in that direction the system may display the previously captured (and augmented)view.

Description

Background technique [0001] Virtual reality (VR) allows a user to experience and / or interact with an immersive artificial environment such that the user feels as if they are actually in that environment. For example, a virtual reality system can display a stereoscopic scene to a user to create an illusion of depth, and the computer can adjust the content of the scene in real time to provide the illusion that the user is moving within the scene. When a user views an image through a virtual reality system, the user can thus feel as if they are moving within the scene from a first-person perspective. Similarly, augmented reality (AR) combines computer-generated information with real-world imagery to enhance or add content to a user's view of the world. Accordingly, simulated environments of virtual reality and / or augmented content of augmented reality can be used to provide an interactive user experience for a variety of applications, such as interacting with virtual training en...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06F1/16
CPCG06F3/011G06F3/013H04N13/344H04N13/366H04N13/25H04N13/398G02B27/017G02B2027/0187H04N13/383G02B27/0172G02B2027/0138G02B2027/0147H04N13/376H04N13/38H04N13/373
Inventor A·施庞特
Owner APPLE INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap