Unlock instant, AI-driven research and patent intelligence for your innovation.

Detection of hand gestures using gesture language discrete values

A technology of hand posture and hand, applied in the field of detecting multi-modal user interaction actions, which can solve the problems of expensive implementation, unattractive integration, high complexity, etc.

Active Publication Date: 2018-08-31
MICROSOFT TECH LICENSING LLC
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Current solutions for identifying and / or recognizing hand pose(s) may exist, however they are mostly immature, insufficiently accurate and / or high in complexity while requiring a high degree of computational resources for extensive computer vision processing and / or machine learning
Such techniques may rely on the entire hand skeletal joints and / or complex machine learning algorithms to detect and / or classify hand poses, which can make such implementations expensive and unattractive for integration, preventing them from being targeted for broad use Adopted

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Detection of hand gestures using gesture language discrete values
  • Detection of hand gestures using gesture language discrete values
  • Detection of hand gestures using gesture language discrete values

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] According to some embodiments of the present disclosure, there are provided for estimating one or more runtime hands by analyzing one or more images depicting the movement of the user's hand(s) with respect to a plurality of predefined hand gestures. The runtime sequence of the data set is a system and method for detecting the user's hand posture by identifying the runtime sequence as a valid hand posture. The detection of hand gestures performed by the user and depicted in one or more images is based on a discrete architecture, in which discrete hand values ​​are used as building blocks to define the hand poses and / or hands that constitute the hand gesture movement. Each hand posture can include one or more hand postures and / or hand movements, and each hand posture and / or hand movement is represented as a record of hand posture feature or hand movement feature record, respectively Pre-defined hand feature records. Hand feature records are each defined by a unique set ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Computer implemented method for detecting a hand gesture of a user, comprising: (a) Receiving sequential logic models each representing a hand gesture. The sequential logic model maps pre-defined handposes and motions each represented by a hand features record defined by discrete hand values each indicating a state of respective hand feature. (b) Receiving a runtime sequence of runtime hand datasets each defined by discrete hand values scores indicating current state hand features of a user's moving hand which are inferred by analyzing timed images depicting the moving hand. (c) Submitting the runtime hand datasets and the pre-defined hand features records in SSVM functions to generate estimation terms for the runtime hand datasets with respect to the hand features records. (d) Estimatingwhich of the hand gestures best matches the runtime sequence depicted in the timed images by optimizing score functions using the estimation terms for the runtime hand datasets.

Description

Background technique [0001] With the development of the computerized environment, the use of human machine interfaces (HMI) has increased significantly. There is an increasing need for more natural human-machine user interface (NUI) methods (such as, for example, voice and / or gaze) and more specifically hand gesture interactions to replace and / or supplement traditional HMIs, such as keyboards, pointing devices, and / Or touch interface. This can be used, for example, to eliminate and / or reduce the need for intermediary devices (such as keyboards and / or pointing devices), support submission-free interaction, improve accessibility for (multiple) groups of people with disabilities, and / or provide multi-modality Interactive environment. There may be current solutions for identifying and / or recognizing hand gesture(s), but most of them are immature, with insufficient accuracy and / or high complexity, and require high computing resources for extensive computer vision processing and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/03G06F3/038G06K9/00
CPCG06F3/017G06F3/03G06F3/038G06V40/28G06F18/2411G06F3/0304G06F2203/0381G06T7/248G06V40/113G06T2207/20081G06T2207/30196
Inventor D·弗里德曼K·卡蒙E·克里普卡Y·恩格尔Y·沙皮罗
Owner MICROSOFT TECH LICENSING LLC