Fraud recognition method combining with audio analysis and video analysis, device and storage medium

Abstract

The invention provides a fraud recognition method combining with audio analysis and video analysis, a device and a storage medium. The method comprises the following steps: cutting an audio and videosample to obtain audio and video fragments, and distributing a fraud label for each audio and video fragment; decoding and preprocessing each audio and video fragment to obtain an audio fragment and avideo fragment of each audio and video fragment; extracting voice features and expression features from each audio fragment and each video fragment, respectively; combining the voice features of eachaudio fragment and the expression features of each video fragment with a fraud labeling training support vector machine, acquiring a voice analysis model and an expression analysis model; collectingaudio and video data of an object to be recognized; extracting the voice features and the expression features of the audio and video data; inputting the voice features and the expression featrues intothe voice analysis model and the expression analysis model respectively, and outputting the fraud probabilities P1 and P2 of the object to be recognized; and carrying out weighted calculation on P1 and P2, thus obtaining the fraud recognition result of the object to be recognized.

Description

technical field [0001] The present invention relates to the technical field of computer information processing, in particular to a fraud identification method, device and computer-readable storage medium combining audio analysis and video analysis. Background technique [0002] At present, fraud identification is generally achieved through face-to-face interviews, which is extremely dependent on the experience and judgment of analysts, which consumes a lot of time and manpower, and the analysis results are often inaccurate and objective. There are also professional instruments and equipment to judge whether the testee is suspected of fraud by detecting a series of indicators such as breathing, pulse, blood pressure, and skin resistance. However, such equipment is usually expensive and easily constitutes a violation of the human rights of the testee. Contents of the invention [0003] In order to solve the deficiencies in the prior art, the present invention provides a meth...

AI Technical Summary

Problems solved by technology

[0002] At present, fraud identification is generally achieved through face-to-face interviews, which is extremely dependent on the experience and judgment of analysts, which consumes a lot of time and manpower, and the analysis results are often inaccurate and objective

There are also professional instruments and equipment to judge whether the tested person is suspected of fraud by detecting a series of indicators such as breathing, pulse, blood pressure, and skin resistance. However, such equipment is usually expensive and easily constitutes a violation of the human rights of the tested person.

Images