Acquisition method, device, electronic device and storage medium of data characteristics
A technology of data features and acquisition methods, applied in instruments, computing, character and pattern recognition, etc., can solve the problems of extracting image and text features, unable to effectively use image and text correlation, and low processing efficiency.
Active Publication Date: 2020-03-27
BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF16 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0005] The embodiment of the present application provides a data feature acquisition method, device, electronic equipment, and storage medium to solve the problem of extracting image and text features in the related art that cannot effectively utilize the correlation between images and text, and lead to low processing efficiency The problem
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0027] Exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that the present application can be more thoroughly understood, and the scope of the present application can be fully conveyed to those skilled in the art.
[0028] figure 1 It is a flow chart of the steps of a data feature acquisition method provided in the embodiment of this application, such as figure 1 As shown, the method may include:
[0029] Step 101, acquire a multimedia sample, where the multimedia sample includes image information and text information.
[0030] A multimedia sample refers to a sample including multimedia information uploaded locally by a us...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present application provides a data feature acquisition method, device, electronic equipment, and storage medium, including: acquiring a multimedia sample including image information and text information; respectively extracting the first image feature of the image information and the first text feature of the text information ; Import the first image feature and the first text feature into the attention mechanism model, and output the second text feature based on the attention of the first image feature, and / or the second image feature based on the attention of the first text feature. Based on the attention mechanism, this application captures the correlation between the first image feature and the first text feature, and obtains the second text feature and / or the second image feature with the attention mechanism applied, so that the second text feature and the first The second image feature includes the correlation between image information and text information. The feature applied to the attention mechanism obtained in this application is realized based on an end-to-end attention mechanism model, which reduces the dependence of application scenarios on multiple models.
Description
technical field [0001] The embodiments of the present application relate to the technical field of image classification, and in particular, to a data feature acquisition method, device, electronic device, and storage medium. Background technique [0002] Recently, with the wide application of deep learning technology in multimedia sample classification processing and other related fields, many multimedia sample classification functions have been developed for mobile terminal applications, and the information display and recommendation functions of applications have been optimized to improve user experience. [0003] In related technologies, in a real scene, after uploading an image, a general user will add a simple text description to the image. The current image classification function is based on the image and the corresponding text description, using post-fusion technology After processing, the corresponding feature can be obtained. This feature can be used to carry out t...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/62
CPCG06F18/21G06F18/24
Inventor 张志伟王希爱王树强
Owner BEIJING DAJIA INTERNET INFORMATION TECH CO LTD