Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Text image matching method and device thereof, computer equipment and storage medium

A text image, matching method technology, applied in the field of image processing, can solve the problems of image matching, undetermined local features, poor accuracy, etc., to achieve the effect of improving accuracy

Pending Publication Date: 2021-10-19
TENCENT TECH (SHENZHEN) CO LTD
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the above technical solution, only through the method of image-text feature alignment calculation, there may be situations where it is impossible to determine whether the image matches through the local features of the text. For example, "thin" belongs to the local text feature. It is impossible to determine whether the image matches through the local image features. , which leads to poor accuracy for text-image matching

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text image matching method and device thereof, computer equipment and storage medium
  • Text image matching method and device thereof, computer equipment and storage medium
  • Text image matching method and device thereof, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with aspects of the present application as recited in the appended claims.

[0065] It should be understood that "several" mentioned herein refers to one or more, and "multiple" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and / or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character " / " gener...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a text image matching method and a device thereof, computer equipment and a storage medium, and belongs to the technical field of image processing. The method comprises the following steps: acquiring a first feature and a second feature; obtaining the first feature by encoding text features of at least two scales contained in the first text; obtaining the second feature by encoding image features of at least two scales contained in the first image, and obtaining a first feature similarity between the first feature and the second feature; weighting the first feature and the second feature based on the first feature similarity to obtain a first weighted feature and a second weighted feature; based on the first feature, the second feature, the first weighted feature and the second weighted feature, obtaining a second feature similarity between the first text and the first image; and obtaining matching information based on the second feature similarity. Through the scheme, the accuracy of text image feature matching is improved.

Description

technical field [0001] The embodiments of the present application relate to the technical field of image processing, and in particular to a text image matching method, device, computer equipment, and storage medium. Background technique [0002] Image processing is an important research direction in the field of computer vision. Building an image classification model based on machine learning and performing image recognition through the image classification model is a widely used image recognition method. [0003] In related technologies, when it is necessary to find a matching image for the text information input by the user, the global text feature vector corresponding to the text input by the user can be extracted based on the machine learning method through the predefined image text feature alignment method, and The global image feature vector corresponding to each candidate image, or extract the local text feature vector corresponding to the text input by the user, and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06K9/46G06N3/04
CPCG06N3/045G06F18/22
Inventor 郜晨阳蔡冠羽蒋忻洋张均宫毅非彭湃孙星郭晓威黄小明黄飞跃
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com