Image enhancement devices with gaze tracking

An image, foveation technology used in the field of electronic devices displaying mixed reality content

Pending Publication Date: 2020-10-16
APPLE INC
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Cameras can be used to capture real-world images

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image enhancement devices with gaze tracking
  • Image enhancement devices with gaze tracking
  • Image enhancement devices with gaze tracking

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] The electronic device may be provided with a display. The display can be used to display supplemental content overlaid on real world content. Supplemental content may include, for example, enhancements, such as computer-generated text and graphics, and may include enhanced image content, such as real-world image data that has been modified by adjusting image properties such as contrast, magnification, and other characteristics.

[0014] The electronic device may use information such as information from a gaze tracking system and other information when displaying image enhancements. For example, zooming in on a portion of a real-world image for a low-vision user should only be done when the user's gaze is relatively stationary, to avoid motion sickness effects. Electronic devices may analyze real-world images to identify content of interest (eg, location and motion of objects, recognition of faces and other items, presence of text, locations of edges of objects, etc.). ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An electronic device may have a display and a camera. Control circuitry in the device can gather information on a user's point of gaze using a gaze tracking system and other sensors, can gather information on the real-world image such as information on content, motion, and other image attributes by analyzing the real-world image, can gather user vision information such as user acuity, contrast sensitivity, field of view, and geometrical distortions, can gather user input such as user preferences and user mode selection commands, and can gather other input. Based on the point-of-gaze information and / or other gathered information, the control circuitry can display the real-world image and supplemental information on the display. The supplemental information can include augmentations such asicons, text labels, and other computer-generated text and graphics overlaid on the real world image and can include enhanced image content such as magnified portions of the real-world image.

Description

[0001] This patent application claims priority to U.S. Patent Application 16 / 280,786, filed February 20, 2019, and Provisional Patent Application 62 / 643,023, filed March 14, 2018, which are hereby incorporated by reference in their entirety. Background technique [0002] The present disclosure relates generally to electronic devices, and more particularly to electronic devices that display mixed reality content. [0003] A mixed reality device can have a camera and a display. Cameras capture images of the real world. Content such as text and graphics can then be overlaid on the real world image to produce a mixed reality image. [0004] Presenting mixed reality content to users can be challenging. Presenting mixed reality images to a user may be interrupted, for example, by head and eye movements. Users may have different visual abilities. If care is not taken, mixed reality images will be presented that cause disorientation or motion sickness and make it difficult for the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G02B27/01G09G3/00
CPCG02B27/017G02B2027/011G02B2027/0112G02B2027/0118G02B2027/0138G02B2027/014G02B2027/0187G06F3/013G09G3/001G09G2320/0626G09G2320/066G09G2320/0686G09G2354/00G06F3/012G02B27/0093G06T11/001G06F3/011G06V40/193G06V20/20G06F3/017G06T7/20G06T3/40G06T5/007G06T2207/20192G02B27/0179G02B27/00G06T19/006G06V40/172
Inventor R·萨马达尼C·G·甘巴哥塔E·H·克莱曼N·P·鲍尼尔
Owner APPLE INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products