The invention relates to the technical field of video analysis, in particular to a video
stream multi-mode
content security dynamic auditing
system and method. According to the invention, through the
conjoint analysis of the
hue ratio change of the continuous image frames and the
focus area heat map, the
hue sudden change and concentrated concern area in the
video image can be accurately identified, the potential violation fragment can be effectively positioned, and on this basis, the interaction behavior analysis mechanism of the image and audio bimodal data is introduced, so that the accuracy of the image and audio bimodal data interaction behavior analysis is improved. Therefore, the recognition of the sudden behavior is not limited to a single visual or auditory clue any more, the
modal jump behavior segment is constructed when the image action and the
voice change are synchronously highlighted, and then the
time sequence overlapping
point location in the
modal sudden change process is further captured, so that the positioning precision of the abnormal interruption behavior is enhanced, and the positioning accuracy of the abnormal interruption behavior is improved. And multi-dimensional measurement and scoring of the burst area are realized in combination
with trend information of frame-level dominant
weight change, so that the recognition coverage rate and the response capability of dynamic content auditing on violation behaviors are improved.