Information processing device, information processing method and program

Abstract

The invention relates to an information processing device, an information processing method and a program. The information processing device includes an audio-based speech recognition processing unit which is input with audio information as observation information of a real space, executes an audio-based speech recognition process, thereby generating word information that is determined to have a high probability of being spoken, an image-based speech recognition processing unit which is input with image information as observation information of the real space, analyzes mouth movements of each user included in the input image, thereby generating mouth movement information, an audio-image-combined speech recognition score calculating unit which is input with the word information and the mouth movement information, executes a score setting process in which a mouth movement close to the word information is set with a high score, thereby executing a score setting process, and an information integration processing unit which is input with the score and executes a speaker specification process.

Description

technical field [0001] The present invention relates to an information processing device, an information processing method and a program. More specifically, the present invention relates to an information processing device, an information processing method, and a program that enable information such as images and sounds to be input from an external environment and analyze the external environment based on the input information, specifically, specify a position of an object and recognize objects such as speakers. Background technique [0002] A system that performs communication or interactive processing between a human and an information processing device such as a PC or a robot is called a human-computer interaction system. In such a human-computer interaction system, an information processing device such as a PC or a robot receives image information or audio information, analyzes the received information, and recognizes a human voice or motion. [0003] When a person tra...

AI Technical Summary

Problems solved by technology

[0007] However, in such a deterministic integration processing method using uncertain and asynchronous data input from a camera and a microphone in the system of the related art, there is a problem in that only data with insufficient robustness and low accuracy can be obtained

In this process, however, since only mouth movements are the subject to be evaluated, there is the problem that, for example, a user chewing gum will also be recognized as a speaker

Images