Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Systems and methods for 360 video capture and display based on eye tracking including gaze based warnings and eye accommodation matching

a technology of eye tracking and 360 video, applied in the field of display technology, can solve the problems of substantial encoding, processing and power requirements of applications and standards, and achieve the effect of reducing the number of eyes, and ensuring the quality of the video

Inactive Publication Date: 2020-07-30
INTEL CORP
View PDF0 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

The patent text describes a system for controlling video capture and display using eye tracking technology. The system includes components such as a computer system, graphics processing units, and a data processing system. The technical effects of the patent include improved video capture and display capabilities, improved eye tracking technology, and reduced power requirements for processing and display. The system can be used in various applications such as 3D displays, head mounted displays, and streaming multi-processors. The patent also describes a method for providing warnings and accommodating eye accommodation. Overall, the patent aims to provide a more efficient and effective solution for controlling video and display in various applications.

Problems solved by technology

These applications and standards, however, have substantial encoding, processing and power requirements.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Systems and methods for 360 video capture and display based on eye tracking including gaze based warnings and eye accommodation matching
  • Systems and methods for 360 video capture and display based on eye tracking including gaze based warnings and eye accommodation matching
  • Systems and methods for 360 video capture and display based on eye tracking including gaze based warnings and eye accommodation matching

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0270 may include a video encoding system comprising a plurality of cameras, wherein the plurality of cameras have complementary fields of view that extend the field of view beyond that captured by a single camera, a programmable processor, and memory including a set of instructions which, if executed by the programmable processor, cause the programmable processor to capture video within a viewport of the plurality of cameras. The system may also include logic to determine a region of interest for a user based on eye tracking information, encode the video for at least one of the plurality of cameras at high resolution based on the eye tracking information, and encode the video for at least another of the plurality of cameras at low resolution based on the eye tracking information.

example 2

[0271 may include the system of example 1, wherein the at least one of the plurality of cameras is positioned in the center of the region of interest.

example 3

[0272 may include the system of example 2, wherein the at least another camera is positioned adjacent the at least one of the plurality of cameras.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Systems and methods may provide for capturing 360 degree video, and multi-resolution encoding, processing and displaying of the video based on a field of view (FOV) and region of interest (ROI) for a viewer. The ROI may be determined based on eye tracking information (ETI) and the video may be encoded for viewports within the FOV at a high resolution and for other viewports outside the FOV at a lower resolution. ROI in the video may be encoded at a high resolution and areas outside of the ROI may be encoded at a lower resolution. The ETI enables the selective display of one or more warnings based on the gaze of a user to improve the efficiency of the warning. 3D glasses having variable lens may be used to adjust the focal distance of a virtual display to match a virtual distance of an object based on stereo distance cues.

Description

CROSS-REFERENCED TO RELATED APPLICATIONS[0001]This application claims the benefit of priority to U.S. patent application Ser. No. 15 / 488,878 filed Apr. 17, 2017.TECHNICAL FIELD[0002]Embodiments generally relate to display technology, and more particularly, to the use of eye tracking for controlling 360 video capture and display, providing warnings and matching eye accommodation.BACKGROUND OF THE DESCRIPTION[0003]Modern displays are being implemented in increasingly wider and more varied types of applications including, for example, three-dimensional (3D) displays, head mounted displays (HMDs), heads-up displays (HUDs), virtual displays, and the like. These applications enable technologies such as 3D, Virtual Reality (VR), Augmented Reality (AR), and other immersive viewing environments. Further, High Definition (HD) video enables more accurate, precise and useful implementations of these displays. Also, improved video standards such as High Dynamic Range (HDR) enable enhanced displa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(United States)
IPC IPC(8): H04N5/232H04N13/271H04N13/25H04N13/383H04N13/344H04N21/218H04N19/132H04N21/2343H04N21/4223H04N19/179H04N21/4728H04N19/17H04N21/81H04N21/442H04N21/4402H04N19/167H04N13/243G02B27/01G06F3/01H04N5/225G03B37/04G03B17/56
CPCH04N21/4728G06F3/013G02B27/0172H04N13/383H04N21/234363H04N13/344H04N19/167H04N5/2258H04N19/179H04N21/816H04N13/271G03B37/04H04N21/21805H04N21/44218H04N21/4223G03B17/561H04N21/440263H04N19/132H04N5/23238H04N19/17H04N13/243H04N13/25G06T3/4038H04N23/698H04N23/45
Inventor HICKS, RICHMONDWANG, CHANGLIANGAVADHANAM, SATYANARAYANAJOHNSTON, ROBERT J.BISWAL, NARAYAN
Owner INTEL CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com