Data processing method and device, electronic equipment and storage medium

A data processing and data technology, applied in the field of data processing, can solve problems such as rough methods, and achieve the effect of overcoming the corresponding relationship and achieving good performance.

Pending Publication Date: 2022-04-12
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] First, the method is relatively rough, and the learning of the corresponding relationship between video and text content depends entirely on time matching

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium
  • Data processing method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

[0025] The block diagrams shown in the drawings are merely functional entities and do not necessarily correspond to physically separate entities. That is, these functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices entity.

[0026] The flow charts shown ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a data processing method and device, electronic equipment and a storage medium. The method comprises the steps that action representation, object representation and video overall representation corresponding to video frame data in label-free data are extracted; extracting verb representation, noun representation and sentence overall representation of text data corresponding to the video frame data in the label-free data; and according to the action representation, the object representation and the video overall representation corresponding to the video frame data and the verb representation, the noun representation and the sentence overall representation corresponding to the text data, determining the corresponding degree between the video frame data and the text data, and taking the corresponding degree as a tag associated with the video frame data and the text data. According to the technical scheme provided by the embodiment of the invention, the corresponding relationship between the video and the text content on finer granularity can be well learned, and the performance is better when the task is migrated to a downstream task.

Description

technical field [0001] The present application relates to the technical field of data processing, and in particular, to a data processing method and device, electronic equipment, and a storage medium. Background technique [0002] In the past two years, the self-supervised video representation scheme based on time-aligned video and text realizes representation learning on the model by learning the temporally aligned correspondence between video and text, and improves the effect of downstream video-related tasks. . Since the large-scale unlabeled video-text data set is relatively complex and large in scale, and the text data comes from automatic speech recognition, the comparison of video-text data is inaccurate, which makes the model learn the correspondence between video and text on this data set. The relationship is quite challenging. A common solution is: MIL-NCE proposes the idea of ​​using multi-instance learning, so that the text corresponding to the video and the tex...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/783G06F16/78
Inventor 庄嘉鑫高雨婷李珂孙星郭晓威黄飞跃
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap