Video question and answer data set labeling method and device, storage medium and electronic equipment

A data set and video technology, applied in the field of computer vision, can solve the problems of long time and low efficiency, and achieve the effect of improving the efficiency of labeling and avoiding the quality of labeling.

Active Publication Date: 2022-07-05
ZHEJIANG UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to solve the time-consuming and low-efficiency defects of the video question-answer data set labeling method in the prior art, and provide a video question

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video question and answer data set labeling method and device, storage medium and electronic equipment
  • Video question and answer data set labeling method and device, storage medium and electronic equipment
  • Video question and answer data set labeling method and device, storage medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0031] In order to make the above objects, features and advantages of the present invention more clearly understood, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. However, the present invention can be implemented in many other ways different from those described herein, and those skilled in the art can make similar improvements without departing from the connotation of the present invention. Therefore, the present invention is not limited by the specific embodiments disclosed below. The technical features in each embodiment of the present invention can be combined correspondingly on the premise that there is no conflict with each other.

[0032] In the description of the present invention, it should be understood that the terms "first" and "second" are only...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a video question and answer data set labeling method and device, a storage medium and electronic equipment, and belongs to the field of computer vision. According to the method, the labeling efficiency is improved through an artificial intelligence network construction auxiliary labeling technology, the video question and answer model is used for outputting predicted content positioning and question answers for the sample, the prediction result is provided for manual proofreading, and the labeling result is finally generated after manual proofreading; therefore, the range of manually searching answers to video questions is reduced to a certain extent. According to the method and the device, the initial annotation information can be automatically generated by the neural network model, manual operation is only needed to automatically check and adjust the model generation information, and if errors exist, the errors can be corrected, so that the annotation efficiency of the video question and answer data set is greatly improved, and the annotation quality problem caused when the model is directly adopted for prediction is also avoided.

Description

technical field [0001] The invention belongs to the field of computer vision, and in particular relates to a video question answering data set labeling method, device, storage medium and electronic equipment. Background technique [0002] With the faster and faster generation and collection of multimedia data, content-based video understanding research is developing rapidly, and video question answering is one of the typical techniques. Video question answering refers to analyzing the answer to the question and the time segment (starting time, ending time) of the question based on the input video (including subtitles) and the question for the video. [0003] The video question answering model needs to rely on high-quality annotated data for training, and the current video question answering dataset has the defects of few samples and low quality. Therefore, it is necessary to further annotate the video question answering data to construct a high-quality video question answeri...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/783G06F16/732G06F16/9032G06K9/62G06N3/04
CPCG06F16/7844G06F16/7847G06F16/7328G06F16/732G06F16/90332G06N3/047G06N3/044G06F18/41G06F18/253G06F18/214
Inventor 肖俊王书舒吴超王朝张志猛
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap