Method for adaptively adjusting gain, mapped to interface, of gesture movement

Abstract

The invention discloses a method for adaptively adjusting a gain, mapped to an interface, of gesture movement. The method comprises the following steps in sequence: S1, capturing a video; S2, detecting one hands and the face of a user; S3, recognizing width information of the hand in the video; S4, acquiring position information of hand movement of the user; S5, calculating a movement speed of the hand of the user in a physical operation space; S6, calculating an adaptive cursor movement speed by adopting a function, related to the movement speed of the hand of the user, of a gain between a cursor constructed in allusion to the current gesture interaction system and the movement speed of the hand of the user; S7, carrying out weighted summation on the cursor movement speed and carrying out smooth processing; S8, calculating a movement increment which is inter-frame output by the cursor on a display screen; S9, carrying out responding on the display screen, and repeating the steps S4 to S9. According to the method, the relative stability of the gain between the cursor and the hand of the user still can be kept when the distance between the hand of the user and a camera in the direction of an optical axis changes, so that the natural and stable control of the cursor is realized.

Description

technical field [0001] The invention relates to the fields of machine vision technology and human-computer interaction control, in particular to a gain adaptive adjustment method for mapping gesture motion to an interface. Background technique [0002] In recent years, vision-based gesture interaction technology is increasingly becoming the main development direction of non-contact human-computer interaction technology due to its natural, direct, device-free, and easy-to-share advantages, and is gradually widely used in the interaction of large-screen terminals. technically. The commonly used operation method is gesture roaming, which maps the movement of the user's palm in the physical space to the movement of the cursor on the display screen to realize the operation of the cursor. In this field, the velocity-oriented mapping method has been widely used. [0003] During vision-based gesture interaction, the mapping from the human hand to the camera is often unstable due t...

AI Technical Summary

Problems solved by technology

This change in CD gain alters the motion requirements of the interactive task and the visual scale of the task, resulting in unnatural and unexpected movements that are prone to manipulation errors

Too small or too large CD gain value will affect the interaction accuracy, user fatigue, control stability, etc., reduce the interaction usability, and reduce the user experience

Images