Three-dimensional dynamic finger text input system and method based on depth image

A technology of three-dimensional dynamic and depth images, applied in the field of digital image processing and human-computer interaction, can solve the problem of low output text rate and achieve high text input rate

Inactive Publication Date: 2018-10-12
CHONGQING UNIV OF POSTS & TELECOMM
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method has the problem of low output text rate and is not suitable for general text output rate requirements

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional dynamic finger text input system and method based on depth image
  • Three-dimensional dynamic finger text input system and method based on depth image
  • Three-dimensional dynamic finger text input system and method based on depth image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The technical solutions in the embodiments of the present invention will be described clearly and in detail below with reference to the drawings in the embodiments of the present invention. The described embodiments are only some of the embodiments of the invention.

[0027] The technical scheme that the present invention solves the problems of the technologies described above is:

[0028] Such as figure 1 Shown is a three-dimensional dynamic finger text input system and method that collects data through a depth camera. The system mainly includes: A1 to A9: A1 is a data interface module compatible with the data collection device, A5 is a static registration gesture recognition module, A7 is the finger gesture recognition module, A8 is the phrase prediction module, and A9 is the specific gesture recognition module. Among them, the data interface module includes the hand contour information interface component A2, the absolute position information interface component A3...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a three-dimensional dynamic finger text input system and method based on a depth image. The method comprises the following steps: firstly, obtaining 3D coordinate information ofhand contour information and hand joint points; matching with a specific static gesture, extracting a descending fingertip amplitude characteristic, and judging a knocking action; obtaining all possible words by knocking finger sequences; and knocking a 3D coordinate of a tail end of a finger, knocking finger information and a language model based on the word frequency, obtaining candidate wordsby using a Bayesian model, calculating the confidence of a word phrase with the greatest probability relative to the word, obtaining a maximum probability phrase of the word, and finally, and finally,outputting the candidate words and possible phrases. Specific gestures are recognized, and the output candidate words and the phrases are selected and operated, or the selected words are deleted. Thethree-dimensional dynamic finger text input method based on the depth image provided by the invention improves the speed and accuracy of air text input.

Description

technical field [0001] The invention belongs to the field of digital image processing and human-computer interaction, in particular to a three-dimensional dynamic finger gesture recognition system and method using a real-sensing camera capable of obtaining depth images as a data acquisition device. Background technique [0002] Ten-finger typing, as the most effective text input method, has been widely used on physical keyboards. According to reports, for the average person, the typing speed on a physical keyboard can achieve 60 to 100 words per minute. Therefore, in order to use this most effective text input method more flexibly, many researchers are currently trying to realize ten-finger typing on a touch screen or even on any plane. For a touch screen, whether it is a mobile phone or a tablet computer, the design of the keyboard, especially the layout of the key letters, is almost the same as that on the physical keyboard. Especially for slightly larger tablet computer...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06K9/00
CPCG06F3/017G06V20/64G06V40/117G06V40/113
Inventor 李红波孟萌张轩
Owner CHONGQING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products