Human-machine interaction mode combing voice information with gesture information and implementation device thereof

A technology of human-computer interaction and gesture information, applied in the field of human-computer interaction, can solve problems such as limited and difficult, and achieve the effects of high accuracy, simplified design complexity, and efficient human-computer interaction control.

Inactive Publication Date: 2016-08-17
WUHAN MINGKO WISDOM TECH CO LTD
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Improving the reliability and accuracy of pure voice-based human-computer interaction methods and gesture-based human-computer interaction methods is limited by the current cognition of the brain information processing model and computer processing capabilities, so it is difficult to improve in the short term. a qualitative leap

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human-machine interaction mode combing voice information with gesture information and implementation device thereof
  • Human-machine interaction mode combing voice information with gesture information and implementation device thereof
  • Human-machine interaction mode combing voice information with gesture information and implementation device thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0030] The human-computer interaction method combining voice information and gesture information proposed by the present invention combines the advantages of two independent human-computer interaction processes of voice control and gesture control, cleverly avoids their respective limitations, and describes specific commands through voice. Abstract methods are described by gestures to synthesize a complete human-computer interaction command.

[0031] figure 1 It is a flow chart of the human-computer interaction method of combining voice information and gesture information provided by the present invention. The human-computer interaction processing system includes a gesture image acquisition 102 , a voice signal acquisiti...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a human-machine interaction mode combing voice information with gesture information and an implementation device thereof. The human-machine interaction mode simultaneously uses the voice information and the gesture information to express a complicated control instruction so as to realize human-machine interaction in one-time interaction process. The device includes a camera, a voice sensor, and an image and voice processing system. With the specific scene description extracted from the gesture information, the complicated human-machine interaction control via voice can be carried out accurately, the communication efficiency of the human-machine interaction is greatly improved, and the user experience is improved. The human-machine interaction mode combing the voice information with the gesture information has the advantages of high accuracy and low complexity compared with other modes, and can be applied to devices having voice and image sensors conveniently.

Description

technical field [0001] The invention relates to the field of human-computer interaction, in particular to a human-computer interaction mode and an implementation method for input recognition combined with voice information and gesture information. Background technique [0002] With the development of technologies such as embedded general-purpose processors and the Internet of Things (IoT), people have higher and higher requirements for the control experience of smart devices that can be seen everywhere. However, the traditional and reliable human-computer interaction method requires direct contact between the human and the controlled, and interacts through entities such as touch screens and buttons. This human-computer interaction method is technically mature, reliable, and has a high accuracy rate. But with the advancement of technology, people began to demand more efficient and direct human-computer interaction. [0003] As the most direct way of human-computer interacti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01
Inventor 许汉荆
Owner WUHAN MINGKO WISDOM TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap