Behavior identification system and identification method combined with audio and video

Abstract

The present invention relates to a behavior identification system and an identification method combined with audio and video, wherein the system comprises a data analysis module, a database and a calculating module. The database is used for storing a plurality of different audio-video relation modules, wherein each audio-video relation module comprises a characteristic acquisition parameter and an audio-video relation parameter; the data analysis module obtains corresponding gesture images and voice data and introduces them into each characteristic acquisition parameter, so as to form image characteristic sequences and voice characteristic sequences corresponding to each audio-video relation module, and the data analysis module calculates a plurality of audio-video state parameters by using each audio-video relation parameter; and the calculating module calculates the identification probabilities corresponding to each audio-video relation parameter by using the audio-video state parameters, the image characteristic sequences and the voice characteristic sequences, in order to select the maximum of all the calculated probabilities as the object parameter.

Description

technical field [0001] The present invention relates to a behavior recognition system and a recognition method thereof, in particular to a behavior recognition system and a recognition method that combines images and voices and recognizes correct behaviors through their sequence correspondence. Background technique [0002] Please refer to Figure 1A The image recognition schematic diagram of the prior art shown and Figure 1B A schematic diagram of speech recognition in the prior art is shown. [0003] In the prior art, the recognition technology includes image recognition and voice recognition. In terms of image recognition technology, the recognition host 2 stores various image samples, and a camera module 11 captures the user's gestures to form a gesture image, and matches the gesture image with the image samples to find out the execution corresponding to the gesture image. instruction. What's more, the image feature extraction operation is performed on the entire ges...

AI Technical Summary

Problems solved by technology

[0007] It can be seen that the above-mentioned existing behavior identification system and its identification method obviously still have inconvenience and defects in structure and use, and need to be further improved urgently.

In order to solve the above-mentioned problems, the relevant manufacturers have tried their best to find a solution, but for a long time no suitable design has been developed, and the general product has no suitable structure to solve the above-mentioned problems. This is obviously the relevant industry. Urgent problem

Images