Systems and methods for providing feedback by tracking user gaze and gestures

A line-of-sight and gesture technology, applied in the input/output of user/computer interaction, the input/output process of data processing, instruments, etc., can solve the problem that the KINECT device does not allow the user to click the pointer

Inactive Publication Date: 2012-10-24
SONY COMPUTER ENTERTAINMENT INC
View PDF2 Cites 99 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the KINECT device only recognizes limited gesture types, and the user can control the pointing of the pointer, but the KINECT device does not allow the user to click the pointer, requiring the user to hover for a few seconds to make a selection

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Systems and methods for providing feedback by tracking user gaze and gestures
  • Systems and methods for providing feedback by tracking user gaze and gestures
  • Systems and methods for providing feedback by tracking user gaze and gestures

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] Embodiments of the present invention relate to user interface techniques that provide feedback to users based on user line of sight and secondary user input, such as hand gestures. In one embodiment, a camera-based tracking system tracks the user's gaze direction to detect whether objects displayed in the user interface are being viewed. Tracking systems also recognize hand gestures or other body gestures to control the subject's actions or movements, using, for example, separate cameras and / or sensors. Exemplary gesture input can be used to mimic mental or magical forces that can pull, push, position, or otherwise move or control a selected object. The user's interaction mimics the user's feeling that the user's mind controls objects in the user interface, similar to the mind control abilities that the user has seen in movies (such as the ability in Star Wars).

[0029] In the following description, numerous details are set forth. It will be apparent, however, to one...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

User interface technology that provides feedback to the user based on the user's gaze and a secondary user input, such as a hand gesture, is provided. A camera-based tracking system may track the gaze direction of a user to detect which object displayed in the user interface is being viewed. The tracking system also recognizes hand or other body gestures to control the action or motion of that object, using, for example, a separate camera and / or sensor. The user interface is then updated based on the tracked gaze and gesture data to provide the feedback.

Description

technical field [0001] The present invention relates to providing feedback based on user interaction with a user interface generated by a computer system based on multiple user inputs such as tracked user gaze and user gestures. Background technique [0002] Portable or home video game consoles, portable or desktop personal computers, set-top boxes, audio or video consumer devices, personal digital assistants, mobile phones, media servers, and personal audio and / or video players and recording devices, and other types of Capabilities are improving. These devices have enormous information processing capabilities, high-quality audio and video input and output, large storage capacities, and also have wired and / or wireless Internet access capabilities. [0003] These computing devices typically require a separate control device, such as a mouse or game controller, to interact with the user interface of the computing device. Users typically use a pointer or other selection tool ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/0346G06F3/038
CPCG06F3/017G06F3/013
Inventor 埃里克·J·拉森
Owner SONY COMPUTER ENTERTAINMENT INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap