The invention relates to a front man-
machine interaction voice recognition method and a front man-
machine interaction voice
recognition system based on
computer vision assistance. According to the method and the
system, video
signal input is added in the traditional voice recognition flow, and then the simultaneous recognition with the voice
signal is realized; voice assistance is carried out in human face recognition and human face lip
movement recognition, and whether a target to be recognized is speaking or not is judged; and meanwhile, through human face recognition and auxiliary positioning, the orientation of a speaker is judged, and in addition, enhancement
processing is carried out on a sound source
signal in the specified direction by utilizing the corresponding orientation. Withthe method and the
system, the recognition accuracy for voice command and voice input information of clients can be effectively enhanced under the specific environments, including the man-
machine interaction use situations in which the clients need to face the device from the just front side, such as self-service retail terminals,
bank self-service terminals and insurance self-service terminals.