Video content validity visual analysis method and system based on multi-modal emotion

A video content and effectiveness technology, applied in the fields of information technology and visualization, can solve the problems that the methods and principles of speech cannot be unified

Active Publication Date: 2021-12-03
INST OF SOFTWARE - CHINESE ACAD OF SCI
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, there are many speech training institutions and public speaking experts on the market who are responsible for training students' public speaking skills in various environments, but th

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video content validity visual analysis method and system based on multi-modal emotion
  • Video content validity visual analysis method and system based on multi-modal emotion
  • Video content validity visual analysis method and system based on multi-modal emotion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] In order to enable those skilled in the art to better understand the present invention, the method and system for visual analysis of video content effectiveness based on multimodal emotion provided by the present invention will be further described in detail below in conjunction with the accompanying drawings, but this does not constitute a limitation of the present invention .

[0034] The present invention mainly includes the following contents (wherein the description is made for the field of lectures, and the present invention can also be applied to teaching videos, entertainment videos and other video types):

[0035] 1. Emotional data collection and processing process

[0036] The emotional data collection and processing process mainly includes specific fields: 1) data collection, 2) data preprocessing, 3) emotional validity factor calculation, and 4) correlation analysis. Emotional data includes three modalities: image, sound, and text, and two types: discrete a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a video content validity visual analysis method and system based on multi-modal emotion. The method comprises the following steps: collecting a specific type of video and a label of a validity objective index thereof; extracting sentiment data of various modes in the video; on the basis of the extracted emotion data, determining effectiveness factors in combination with actual requirements of the field, and obtaining numerical values of different effectiveness factors through calculation; analyzing the correlation between the effectiveness factor and the effectiveness objective index to obtain a correlation result of the effectiveness factor; and displaying correlation results of the extracted emotion data and the validity factors in different visual forms, so that a user can perform multi-level exploration from the whole to the local by taking the emotion as a principal line. The video content effectiveness is analyzed by means of a visualization method, the method has the advantages in the aspects of quantifying video content effectiveness factors and achieving objective analysis, and an analysis result with visual impact can be provided for a user in a visual and effective mode.

Description

technical field [0001] The invention belongs to the fields of information technology and visualization technology, and in particular relates to a method and system for visually analyzing the effectiveness of video content based on multimodal emotion. Background technique [0002] With the rapid development of multimedia technology, video resources have increased massively. All kinds of videos often contain multiple modal information such as images, sounds, and texts. The multi-modal emotional content in videos plays an important role in the transmission of information and the expression of ideas. For speech videos, the importance of emotional content is mainly reflected in the following aspects: First, the emotional ups and downs and fluctuations contained in the speech affect the advancement of the speech content, and are also directly related to the audience's emotions, which contain rich, full Emotional speeches can often leave a deeper impression on the audience; second...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00
Inventor 马翠霞黄泽远马腾飞宋建成邓小明王宏安
Owner INST OF SOFTWARE - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap