Smart home voice control system combined with video channel and control method thereof

A smart home and video channel technology, applied in the direction of user/computer interaction input/output, instrument, character and pattern recognition, etc., can solve problems such as unrecognizable

Active Publication Date: 2011-12-28
SOUTH CHINA UNIV OF TECH
View PDF4 Cites 71 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to solve the shortcomings and deficiencies of the existing technology, the present invention provides a smart home voice control system combined with a video channel and its control method. Compared wi

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Smart home voice control system combined with video channel and control method thereof
  • Smart home voice control system combined with video channel and control method thereof
  • Smart home voice control system combined with video channel and control method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0067] Such as figure 1 As shown, the smart home voice control system combined with the video channel of the present invention includes a gesture detection module, a face detection module, a recognition system module, an instruction judgment module, and an instruction display and confirmation module connected in sequence. The recognition system module includes a lip language part and a voice part, and the lip language part includes a sequentially connected face tracking and positioning module, a lip language video input module, and a lip language recognition module; the voice part includes a sequentially connected voice input module , Speech recognition module.

[0068] Such as figure 1 As shown, the above-mentioned control system is realized by the following method:

[0069] 1. Gesture detection: The gesture detection module uses haar wavelet transform and LBP feature extraction, selects Adaboost classifier to detect fixed gestures, and judges whether the user has gained co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a smart home voice control system combined with a video channel and a control method thereof. The system comprises a gesture detection module, a human face detection module, a recognition system module, a command judgment module and a command display and confirmation module which are sequentially connected. The recognition system module comprises a lip language part and a voice part, wherein the lip language part comprises a human face tracking and positioning module, a lip language video input module and a lip language recognition module which are sequentially connected; and the voice part comprises a voice input module and a voice recognition module which are sequentially connected. By detecting control gestures and recognizing human faces and lip language information to supplement the recognized voice information, the accuracy of control commands is improved and the feasibility of using voices to control a smart home is increased. The smart home voice control system combined with the video channel has very strong interference resistance, can be widely used for various complex environment modes and is particularly suitable for the situation of high noise because of a great number of people in home environments.

Description

technical field [0001] The invention relates to a video voice recognition technology, in particular to a smart home voice control system combined with a video channel and a control method thereof. Background technique [0002] At present, most of the complicated home appliances are remote controlled through the keyboard input mode of the remote control. remote control. Language is the most direct and convenient way of communication and expression for human beings. If speech recognition technology is adopted, the original passive static structure can be transformed into a smart tool with active recognition of speech execution, so as to meet the growing needs of people. [0003] In recent years, speech recognition technology has developed very rapidly, and many automatic speech recognition products have appeared, such as the ViaVoice speech system developed by IBM. However, these systems still lack strong anti-interference ability, because it can only obtain information from...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06K9/00G06K9/62
Inventor 徐向民梁卓锐王玥
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products