Gesture recognition method and system based on portable intelligent device and ultrasonic signal

Abstract

The invention discloses a gesture recognition method and system based on a portable intelligent device and an ultrasonic signal. The method comprises the steps of sending ultrasonic waves of a specific frequency; receiving specific-frequency ultrasonic waves and a near-field attenuation mechanism; Disclosed is a deep learning model and machine learning model combined with a gesture recognition method; the system is composed of a smart phone, an installable APP, a background model and service. The ultrasonic ranging principle and the Doppler frequency shift effect are utilized, gesture detection and recognition are achieved, various kinds of control over multimedia are further completed through gestures, control is convenient and easy, a sound production module and a pickup module of an existing intelligent terminal are utilized, extra equipment is not needed. And various gestures can be customized for control, the interactive experience of the user is enhanced, the invention can be used for scenes such as smart home, automatic driving, VR/AR games and entertainment, and better man-machine interaction experience can be provided for the disabled.

Description

technical field [0001] The invention relates to the field of information technology, in particular to a gesture recognition method and system based on portable smart devices and ultrasonic signals. Background technique [0002] In recent years, the development of artificial intelligence technology has made great progress, and the industry is generally optimistic about the development of artificial intelligence. Applications in face recognition, human behavior recognition, target detection, target tracking, voice recognition and other fields continue to emerge, becoming the driving force for a new round of technological development. The popularity of mobile devices and smart devices has led to more and more contact and communication between people and machines, and thus there is an increasing demand for human-computer interaction methods. [0003] From the traditional command line interaction (CLI) to the graphical interface interaction (GUI), the interactive experience betw...

AI Technical Summary

Problems solved by technology

[0004] The current mobile devices or smart devices are similar to smart watches and smart phones, which mainly use human-computer interaction methods such as buttons and touch screens to interact. Although they can basically meet daily needs, the experience is not good, especially in many occasions, such as driving. The screen is very inconvenient and can be a safety hazard

Although some devices or software have achieved partial sound control, the experience is still not very good due to the impact of accuracy and surrounding noise environment

Images