Video content validity visual analysis method and system based on multi-modal emotion

Abstract

The invention discloses a video content validity visual analysis method and system based on multi-modal emotion. The method comprises the following steps: collecting a specific type of video and a label of a validity objective index thereof; extracting sentiment data of various modes in the video; on the basis of the extracted emotion data, determining effectiveness factors in combination with actual requirements of the field, and obtaining numerical values of different effectiveness factors through calculation; analyzing the correlation between the effectiveness factor and the effectiveness objective index to obtain a correlation result of the effectiveness factor; and displaying correlation results of the extracted emotion data and the validity factors in different visual forms, so that a user can perform multi-level exploration from the whole to the local by taking the emotion as a principal line. The video content effectiveness is analyzed by means of a visualization method, the method has the advantages in the aspects of quantifying video content effectiveness factors and achieving objective analysis, and an analysis result with visual impact can be provided for a user in a visual and effective mode.

Description

technical field [0001] The invention belongs to the fields of information technology and visualization technology, and in particular relates to a method and system for visually analyzing the effectiveness of video content based on multimodal emotion. Background technique [0002] With the rapid development of multimedia technology, video resources have increased massively. All kinds of videos often contain multiple modal information such as images, sounds, and texts. The multi-modal emotional content in videos plays an important role in the transmission of information and the expression of ideas. For speech videos, the importance of emotional content is mainly reflected in the following aspects: First, the emotional ups and downs and fluctuations contained in the speech affect the advancement of the speech content, and are also directly related to the audience's emotions, which contain rich, full Emotional speeches can often leave a deeper impression on the audience; second...

AI Technical Summary

Problems solved by technology

[0003] At present, there are many speech training institutions and public speaking experts on the market who are responsible for training students' public speaking skills in various environments, but these organizations and individuals cannot agree on the methods and principles of many speeches, even in specific speeches. In the competition, different judges also have different views on speech skills

Images