Unlock instant, AI-driven research and patent intelligence for your innovation.

Short video classification method and system, equipment and storage medium

A classification method and classification system technology, applied in neural learning methods, character and pattern recognition, image data processing, etc., can solve the problems of ignoring the correlation of modal features, lack of more effective guidance for fusion methods, etc., and achieve high information complexity Degree and redundancy, purpose and advantages are concise and easy to understand, and the effect of improving accuracy

Pending Publication Date: 2021-12-03
SHANGHAI MININGLAMP ARTIFICIAL INTELLIGENCE GRP CO LTD
View PDF3 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0012] 4) Most of the existing feature fusion methods ignore the correlation of different modal features in the feature space, and lack more effective guidance on the fusion method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Short video classification method and system, equipment and storage medium
  • Short video classification method and system, equipment and storage medium
  • Short video classification method and system, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be described and illustrated below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application. Based on the embodiments provided in the present application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0059] Obviously, the accompanying drawings in the following description are only some examples or embodiments of the present application, and those skilled in the art can also apply the present application to other similar scenarios. In addition, it can also be understood that although such development efforts may be complex and lengthy, for those of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a short video classification method and system, and the method comprises: a bimodal feature fusion step: inputting a to-be-classified short video into a pre-trained feature fusion model, embedding the extracted visual and sound feature vectors into a shared subspace for deep fusion, and after using multi-modal comparison loss and optimizing network parameters, outputting to-be-classified short videos with feature fusion; and a classification reasoning step: inputting the to-be-classified short videos after feature fusion into the pre-trained classification model, completing short video reasoning and classification, and outputting a classification result of the to-be-classified short videos. According to the invention, deep fusion is carried out by using the visual and audio dual-mode features of the short videos, and the classification accuracy of the short videos is remarkably improved.

Description

technical field [0001] The present application relates to the field of video classification, in particular to a short video method, system, computer equipment and computer-readable storage medium based on bimodal feature fusion. Background technique [0002] At present, short video has become one of the most representative products of today's new media era, and it has begun to be more and more integrated into the lives of the public. Although some research work has achieved relatively ideal performance in solving traditional video classification problems, due to the natural characteristics of short videos and strong editing, existing models are not suitable for direct application to short video classification tasks. [0003] Research in the field of video classification has made tremendous progress. At present, the existing multi-modal feature fusion video classification method mainly solves the classification problem by extracting the features of different modalities and p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/08G06T1/00
CPCG06N3/084G06T1/0021G06F18/253
Inventor 范清唐大闰
Owner SHANGHAI MININGLAMP ARTIFICIAL INTELLIGENCE GRP CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com