Check patentability & draft patents in minutes with Patsnap Eureka AI!

Text image matching method and device thereof, equipment and storage medium

A text image and text technology, applied in the field of image processing, can solve the problem of low matching accuracy of text and image, and achieve the effect of improving matching accuracy

Pending Publication Date: 2021-10-19
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the above technical solution, the text-image matching accuracy of the developed image feature extraction model and the text feature extraction model is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text image matching method and device thereof, equipment and storage medium
  • Text image matching method and device thereof, equipment and storage medium
  • Text image matching method and device thereof, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0092] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

[0093] Before describing the various embodiments shown in this application, several concepts involved in this application are firstly introduced:

[0094] 1) Artificial Intelligence (AI)

[0095] Artificial intelligence is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human int...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a text image matching method and a device thereof, equipment and a storage medium, and relates to the technical field of image processing. The method comprises the following steps: acquiring a first text and a first image; obtaining text features of at least two scales corresponding to the first text; fusing the text features of the at least two scales to obtain a first multi-scale fusion feature corresponding to the first text; acquiring image features of at least two scales corresponding to the first image; fusing the image features of the at least two scales to obtain a second multi-scale fusion feature corresponding to the first image; based on the first multi-scale fusion feature and the second multi-scale fusion feature, obtaining a feature similarity between the first text and the first image; and determining a matching relationship between the first text and the first image based on the feature similarity. According to the scheme, through natural language processing and computer vision technologies, the feature similarity condition of texts and images in different feature scales is considered, and the matching accuracy between the texts and the images is improved.

Description

technical field [0001] The present application relates to the technical field of image processing, in particular to a text image matching method, device, equipment and storage medium. Background technique [0002] Image processing is an important research direction in the field of computer vision. Building an image classification model based on machine learning and performing image recognition through the image classification model is a widely used image recognition method. [0003] In related technologies, when it is necessary to find a matching image for the text information input by the user, an image feature extraction model and a text feature extraction model can be constructed based on machine learning, where the text feature extraction model is used to extract the text corresponding to the user input The text feature vector of the image feature extraction model is used to obtain the image feature vector corresponding to each candidate image, and select the matching de...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06F40/289G06F40/30
CPCG06F40/289G06F40/30G06F18/22G06F18/253
Inventor 郜晨阳蔡冠羽蒋忻洋张均宫毅非彭湃孙星郭晓威黄小明黄飞跃
Owner TENCENT TECH (SHENZHEN) CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com