Computer-implemented gaze interaction method and apparatus

An implementation method and computer technology, applied in the input/output of user/computer interaction, computer components, calculation, etc., can solve the problems of failing to disclose intuitive methods

Inactive Publication Date: 2017-02-22
ITU BUSINESS DEV AS
View PDF6 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these documents fail to disclose an intuitive way for a person to initiate communication with a remote object that person encounters in the real or physical world and sees through his or her wearable computing device or on the computing device.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Computer-implemented gaze interaction method and apparatus
  • Computer-implemented gaze interaction method and apparatus
  • Computer-implemented gaze interaction method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0074] figure 1 A side view of a wearable computing device worn by a person is shown. The wearable computing device includes a see-through type display 104, an eye tracker 102, a scene camera 107, also denoted a forward looking camera, and side sticks or temples 110 for carrying the device.

[0075] The person's line of sight 105 is shown with a dashed line extending from one of the person's eyeballs to the object of interest 101 , shown as a light bulb. The lights illustrate in simple form the scene in front of that person. Generally, a scene is what is in front of that person and / or a scene camera as viewed by that person.

[0076] That person's gaze can be estimated by the eye tracker 102 and represented in vector form, eg, denoted as a gaze vector. The gaze vector intersects the display 103 in a point-of-regard 106 . Since the display 103 is a see-through display, the person sees the light directly through the display.

[0077] The scene camera 107 captures an image ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A computer-implemented method of communicating via interaction with a user-interface based on a person's gaze and gestures, comprising: computing an estimate of the person's gaze comprising computing a point-of- regard on a display through which the person observes a scene in front of him; by means of a scene camera, capturing a first image of a scene in front of the person's head (and at least partially visible on the display) and computing the location of an object coinciding with the person's gaze; by means of the scene camera, capturing at least one further image of the scene in front of the person's head, and monitoring whether the gaze dwells on the recognised object; and while gaze dwells on the recognised object: firstly, displaying a user interface element, with a spatial expanse, on the display face in a region adjacent to the point-of-regard; and secondly, during movement of the display, awaiting and detecting the event that the point-of- regard coincides with the spatial expanse of the displayed user interface element. The event may be processed by communicating a message.

Description

technical field [0001] Eye tracking is about to become integrated in various types of consumer products such as mobile devices like smartphones or tablets, or mobile devices such as wearable computing devices, WCDs including head-mounted displays (HMDs) The evolution of technology. Such devices may be referred to in more general terms as mobile devices. Background technique [0002] US2013 / 0135204 discloses a method for unlocking the screen of a head mounted display using eye tracking information. The HMD or WCD may be in a locked mode of operation after a certain period of inactivity by the user. The user can try to unlock the screen. The computing system can generate a display of the active object on a display screen of the computing system. With the aid of the line of sight estimation, the HMD or WCD may determine that the path associated with the user's eye movement substantially matches the path associated with the moving object on the display, and switch into an un...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/0484H04L12/28
CPCG06F3/012G06F3/013G06F3/04842H04L12/2814G06F3/0482
Inventor 丹·维茨内尔·汉森迪亚科·马尔丹贝吉
Owner ITU BUSINESS DEV AS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap