Android man-machine interaction method based on MediaPipe gesture recognition model
A gesture recognition and human-computer interaction technology, applied in the field of image recognition, can solve problems such as inability to achieve real-time detection, poor user experience, and increased use delay, so as to improve user experience, improve operation efficiency, and reduce use delay. Effect
Pending Publication Date: 2022-05-10
成都市挟翼劼世科技有限公司
View PDF0 Cites 1 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] Due to the deep layers of the neural network model and the huge amount of parameters in the existing gesture recognition technology, the gesture recognition technology currently deployed on the mobile phone is basically unable to achieve real-time detection. At the same time, some gesture recognition technologies need to provide additional storage space. The storage space interaction further increases the use delay and makes the user experience extremely poor
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0043] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention are clearly and completely described. Obviously, the described embodiments are part of the embodiments of the present invention, not all of them. example. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.
[0044] The invention provides an Android human-computer interaction method based on the MediaPipe gesture recognition model, comprising the following steps:
[0045] S1: Turn on the camera of the mobile phone to obtain each frame of the image of the hand;
[0046] S2: Input the image of the hand obtained in step S1 into the gesture recognition model, and return the position information of the key points of the hand in real time; t...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses an Android man-machine interaction method based on a MediaPipe gesture recognition model, and the method comprises the steps: S1, starting a cellphone camera, and obtaining each frame of image of a hand; s2, inputting the image of the hand obtained in the S1 into a gesture recognition model, and returning position information of key points of the hand in real time; s3, judging which action is made according to the key point information obtained in the S2, and obtaining action information; and S4, converting the action information obtained in the S3 into an operation instruction of the mobile phone, and performing real-time operation on the mobile phone. According to the Android man-machine interaction method based on the MediaPipe gesture recognition model, a gesture recognition technology based on computer vision is adopted, gesture information is collected through a front camera of a mobile phone, man-machine interaction is achieved, and the Android man-machine interaction method based on the MediaPipe gesture recognition model is achieved. According to the Android man-machine interaction method based on the MediaPipe gesture recognition model provided by the invention, a user can operate a mobile phone across the air without touching a screen, and the method is suitable for an application scene that both hands of the user are inconvenient to touch the screen of the mobile phone.
Description
technical field [0001] The invention belongs to the technical field of image recognition and relates to a gesture recognition algorithm, in particular to an Android human-computer interaction method based on a MediaPipe gesture recognition model. Background technique [0002] In recent years, with the development of society, human-computer interaction has gradually become an indispensable part of daily life. In daily life, the communication between people is usually supplemented by gestures to convey some information or express a certain intention. As a means of interaction in line with human daily habits, it is the most intuitive and natural way of interpersonal communication. Gestures Recognition is an indispensable key technology for the new generation of human-computer interaction. At present, there are two types of gesture recognition: the first type is a gesture recognition system that uses data gloves as input devices. This direction requires the interactor to wear d...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06V40/20G06N3/04G06F3/01
CPCG06F3/017G06F3/014G06N3/045
Inventor 孔祥杰王辉张俊曦叶辉
Owner 成都市挟翼劼世科技有限公司