Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Training method and application method of video content description model, equipment and medium

A technology for video content and description models, applied in the computer field

Pending Publication Date: 2022-04-22
SOUTH UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The methods in the related art only focus on generating unique sentences that are as accurate as possible, and cannot generate open-ended descriptions like humans

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Training method and application method of video content description model, equipment and medium
  • Training method and application method of video content description model, equipment and medium
  • Training method and application method of video content description model, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] Embodiments of the present invention are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals designate the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention.

[0055]In the description of the present invention, it should be understood that the orientation descriptions, such as up, down, front, back, left, right, etc. indicated orientations or positional relationships are based on the orientations or positional relationships shown in the drawings, and are only In order to facilitate the description of the present invention and simplify the description, it does not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a video content description model training method, an application method, equipment and a medium, and the training method comprises the steps: obtaining a target video and the content description of the target video, extracting a verb and a template from the content description, carrying out the coding processing and feature sampling of the verb and the template, and obtaining a first hidden variable feature, the method comprises the following steps: performing feature extraction on a target video to obtain a target visual feature, and performing data approximation processing on a priori hidden variable encoder and a language decoder according to a first hidden variable feature and the target visual feature to obtain a video content description model. Different descriptions are generated by using different expressions.

Description

technical field [0001] The present invention relates to the technical field of computers, in particular to the technical field of video content description, and relates to a training method, application method, equipment and medium of a video content description model. Background technique [0002] In recent years, with the continuous development of information technology and the iterative upgrade of smart devices, people are more inclined to use video to convey information, which makes the scale of various types of video data larger and larger, but also brings great challenges. For example, hundreds of thousands of video data are uploaded to the server every minute on the video content sharing website. It is time-consuming and labor-intensive to manually review whether these videos comply with the rules, but the method of video description can significantly improve the review work. Efficiency, saving a lot of time and labor costs. Video content description technology can b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06N3/04G06N3/08G06V10/774G06V10/75G06V10/40G06V10/82
CPCG06N3/08G06N3/045G06F18/214
Inventor 郑锋刘柱
Owner SOUTH UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com