Unlock instant, AI-driven research and patent intelligence for your innovation.

Hand Gesture API using finite state machines and discrete values ​​of Gesture Language

A hand posture, hand technology, applied in the input/output of user/computer interaction, computer components, mechanical mode conversion, etc., can solve the complexity of construction posture, inaccuracy of posture recognition, high cost and complexity And other issues

Active Publication Date: 2022-04-05
MICROSOFT TECH LICENSING LLC
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Current implementations of NUIs, such as gesture-based HMIs, can be immature and thus present major setbacks for developers who want to integrate gesture-HMI into applications, such as inaccuracies in gesture recognition and complexity in constructing gestures
In addition, current implementations typically involve machine learning and extensive computer vision processing, which requires significant processing resources, which in turn can lead to high cost and complexity of the application, preventing the solution from being adopted and becoming widespread

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hand Gesture API using finite state machines and discrete values ​​of Gesture Language
  • Hand Gesture API using finite state machines and discrete values ​​of Gesture Language
  • Hand Gesture API using finite state machines and discrete values ​​of Gesture Language

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] According to some embodiments of the present disclosure, systems and methods are provided for creating and providing a hand gesture(s) API to allow programmers to map hand gesture(s) to software application functionality. The hand pose(s) are constructed using a pose dataset that defines a number of discrete hand pose values ​​each representing a particular characteristic (property) of the hand pose(s) and / or motion and discrete motion values. Each of the hand gestures and / or hand motions is represented by a feature record, such as a feature vector, feature matrix, and / or feature table. Hand gesture features may include, for example, hand selection (left, right, both, and / or any), palm rotation, palm orientation, finger orientation (per finger), finger flexion (per finger), finger contact (every two one or more fingers) and / or relative finger positions (every two or more fingers).

[0023] Hand motion features may include, for example, motion attributes such as, for e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A system for associating a computerized hand pose model with application functionality, comprising: (a) a storage device storing a plurality of hand pose signature records and hand motion signature records. Each hand pose feature record and hand motion feature record is defined by a set of discrete pose values ​​and discrete motion values, respectively. (b) An interface to receive instructions from the programmer. (c) Memory for storing codes. (d) one or more processors coupled to the interface, storage, and memory for executing code including: 1) for defining the Code instructions for hand gestures. 2) Code instructions for associating unique logical sequences with application functions in accordance with code instructions for detecting unique sequences during application runtime in response to analysis of images depicting movement of the user's hand(s). A logical sequence to initiate the execution of a function.

Description

Background technique [0001] The major technological advances of our time in computerized environments have significantly increased human-computer interaction. Traditional human-machine interfaces (HMIs), typically employing input / output devices such as keyboards, pointing devices, and / or touch interfaces, may have met previous needs, but as HMIs become highly intense, more natural interfaces are required. Such a natural interface can employ one or more different techniques to provide the user with a simple, straightforward, and friendly interface while avoiding the use of intervening hardware elements. In addition, two or more natural human user interface (NUI) methods can be combined to provide a A comprehensive solution for computerized home appliances) interaction. Current implementations of NUIs, such as gesture-based HMIs, can be immature, thus presenting significant setbacks, such as inaccuracies in gesture recognition and complexity in constructing gestures, for devel...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/01G06F3/03G06V40/20G06F3/04883G06V10/772
CPCG06F3/0304G06F3/017G06V40/28G06V10/772G06F18/28G06F3/04883
Inventor K·卡蒙
Owner MICROSOFT TECH LICENSING LLC