Method and apparatus for gaze point mapping

一种注视点、点位置的技术，应用在注视点映射领域，能够解决不方便、转换的做法复杂等问题

Active Publication Date: 2014-01-08
APPLE INC
View PDF7 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The use of IR sources as markers to determine gaze transitions from scene images to reference images is complex and inconvenient

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and apparatus for gaze point mapping
  • Method and apparatus for gaze point mapping

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0078] According to one embodiment, the present invention provides a method and apparatus that allow mapping a point of gaze from a scene image onto a reference image taken from a different position.

[0079] For this, a set of characteristic features (reference features) in the reference image is utilized.

[0080] According to one embodiment, these characteristic features are identified by some feature detection algorithm capable of searching for identifiable features in the reference image. According to one embodiment, the feature detection algorithm is chosen such that it is also able to recognize detected features again in subsequently captured images taken from different positions. Using feature detection algorithms, characteristic features such as reference points, lines or areas can then be re-identified again in subsequently captured images of the scene, even if the scene images were taken from different locations.

[0081] Suitable features detectable by feature det...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An apparatus for mapping a gaze point of a subject on a scene image to a gaze point in a reference image, wherein said scene image and said reference image have been taken by a camera from a different position, said apparatus comprising: A module for executing a feature detection algorithm on said reference image to identify a plurality of characteristic features and their locations in said reference image; a module for executing said feature detection algorithm on said scene image to re-identify said plurality of characteristic features and their locations in said scene image; a module for determining a point transfer mapping that transforms point positions between said scene image and said reference image based on the locations of said plurality of characteristic features detected in said reference image and said scene image; a module for using said point transfer mapping to map a gaze point which has been determined in said scene image to its corresponding point in said reference image.

Description

technical field [0001] The present invention relates to methods and devices for gaze point mapping, in particular for mapping gaze directions of objects to gaze points in a scene. Background technique [0002] The problem to be solved is to find the point or object or more specifically part of the object's surface that a (possibly moving) person is looking at. There is an existing solution to this problem, which is described below and can be broken down into several separate parts. [0003] First, find the person's gaze direction (or its proxies, such as pupil / CR combination, corneal center, pupil / heterochromic edge, etc. [0004] This gaze direction is mapped onto the scene image captured by the head-mounted scene camera or any fixed-position scene camera. The head-mounted scene camera is fixed relative to the eyes, so this mapping can be done once the corresponding calibration has been performed. [0005] The next step is to map the gaze point in the scene image capture...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): A61B3/113G06T7/00
CPCG06F3/013G06T5/50A61B3/113G06T7/003G06T7/337G06V40/193G06V10/462
Inventor 蒂尼斯·威廉姆斯简·霍夫曼
Owner APPLE INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap