Mobile wearable non-contact interaction system and method

Abstract

The invention discloses a mobile wearable non-contact interaction system and method. The system specifically comprises an image acquisition module, a gesture identification module, an embedded microcontroller module, a voice acquisition module, a voice processing module and a bone conduction module which are physically integrated to form equipment capable of being mounted on the head of a user or a portable wearable whole body. The system integrates the interaction functions of gesture detecting and tracking, voice identification and the like; the interaction method is capable of converting interaction information into a control instruction required by a terminal and transmitting the control instruction to the terminal through a network to realize terminal control; in addition, the bone conduction technology is creatively added, so that personalized services can be provided for the user and a new platform enjoying television entertainment can be provided for people with hearing impairment; an existing set-top box is modified, so that the application range of the system can be greatly expanded, the system cost can be reduced, and great convenience is also brought to the user.

Description

technical field [0001] The invention belongs to the technical field of computer vision and human-computer interaction, and in particular relates to a mobile wearable non-contact interactive system and method. Background technique [0002] With the development of science and technology, people's lives are becoming more and more convenient, and the functions of home appliances are becoming more and more powerful, providing a variety of personalized services; at present, the control of home appliances mainly depends on keyboards and keyboard buttons. Functionality; cumbersome user learning mechanisms make interaction more difficult. In order to make the communication between human and computer more natural, and to make the communication between human and computer as natural as the communication between human and human, it is necessary to make full use of various sensory information channels of human beings, such as speech, gestures, body movements, etc. [0003] At present, sm...

AI Technical Summary

Problems solved by technology

[0003] At present, smart TVs have become very popular, and at the same time, smart TV control technology has also been in full swing. In the existing technology, the human-computer interaction scheme with smart TVs is mainly through the fixed camera and microphone on the smart TV body. There is often a certain distance from the TV, so this solution not only lacks mobility but also has the disadvantage of wasting resources

[0004] At the same time, the high-definition video resources of smart TVs come from TV set-top boxes. With the continuous improvement of user needs, the functions of set-top boxes are becoming more and more abundant. Traditional remote control solutions have disadvantages such as multiple buttons and complicated operations that affect user interaction. Not satisfied with this traditional way of interaction

Images