A multimedia material real-time compliance inspection method and device

Abstract

The application discloses a multimedia material real-time compliance inspection method and device. The method comprises the following steps: extracting an image from a multimedia data node; performing feature extraction on the image through an edge computing node to output an initial compliance score and generate a binary mask matrix; obtaining a real-time online processing request volume and a queue load state, and calculating a confidence trigger threshold value according to the real-time online processing request volume and the queue load state; when the initial compliance score exceeds the confidence trigger threshold value, sending the image and the binary mask matrix to a cloud-side fine review model; dividing the image into multiple image blocks in the cloud-side fine review model, eliminating image blocks with a corresponding mask value of zero, and converting image blocks with a corresponding mask value of one into a visual feature sequence and inputting the visual feature sequence into a self-attention calculation network for classification reasoning. The application can pre-process useless background blocks to reduce reasoning delay and prevent the collapse of a computing power queue under high-concurrency working conditions.

Images