Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Implementation method of gesture mouse of self-service equipment

A technology of self-service equipment and implementation methods, applied in the input/output process of data processing, input/output of user/computer interaction, instruments, etc., can solve problems such as not being hygienic enough, and the interaction process is not smooth and efficient enough to ensure accuracy , Guaranteed smooth operation, natural and efficient interactive experience

Active Publication Date: 2020-04-24
SHANDONG SYNTHESIS ELECTRONICS TECH
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, for machines in public places such as self-service equipment (consultation, guidance, business processing, etc.), it will have defects: 1. The interaction process is not smooth and efficient; 2. Not hygienic enough

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Implementation method of gesture mouse of self-service equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0024] This embodiment discloses a method for realizing a self-service device gesture mouse, such as figure 1 As shown, the method includes the following steps:

[0025] S01), collect gesture interaction images, and use the camera installed on the self-service device to collect the video recorded during the interaction process between the target gesture and the self-service device. In this embodiment, two types of gestures are taken as examples, the palm represents the general state of the mouse, and the fist represents the left-click operation of the mouse. Extract images from the recorded video according to certain rules (such as the number of frames at the same interval) to form an original image set;

[0026] S02), marking the target gesture, using image labeling software to mark the category of the target gesture in the original image set and the specific position in the picture to form a specific format data set;

[0027] S03), building a target gesture detector. Many...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an implementation method of a gesture mouse of self-service equipment, which is used for driving the mouse in the self-service equipment by analyzing a video acquired by a camera and recognizing and tracking a gesture in real time so as to finish corresponding operation, and the method is driven by the video, natural and efficient in interactive experience, free of limb contact and very sanitary. Secondly, through target gesture detection and target gesture tracking, the balance between resource occupation and mouse action effect is ensured; the target gesture detectionmodel is operated under the condition of no man-machine interaction; when the model is detected, the gesture tracking model is used for tracking, and meanwhile, in order to guarantee the classification accuracy of the position and the target gesture, the target gesture detection model is executed regularly in the gesture tracking process, so that good experience of the gesture mouse is guaranteed, the gesture recognition accuracy can be guaranteed, and the operation fluency can also be guaranteed.

Description

technical field [0001] The invention relates to a method for realizing a gesture mouse of a self-service device, and belongs to the technical field of machine vision and human-computer interaction. Background technique [0002] Since the birth of PC, the way of human-computer interaction is mainly through the mouse and keyboard. During the interaction process, people input information by moving the mouse or typing on the keyboard. The characteristics of this method are: 1. It requires people to complete these mechanical tasks more accurately. Action; 2. There must be physical contact between people and equipment. For office scenes, there is no problem. But for machines in public places such as self-service equipment (consultation, guidance, business processing, etc.), it will have defects: 1. The interaction process is not smooth and efficient; 2. It is not hygienic enough. Contents of the invention [0003] Aiming at the defects of the prior art, the present invention p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06K9/00
CPCG06F3/017G06V40/28Y02D10/00
Inventor 张琨朱锦雷张传锋
Owner SHANDONG SYNTHESIS ELECTRONICS TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products