Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Translation-Based Multimodal Modeling Method and Its Application in Product Retrieval

A modeling method and multi-modal technology, applied in digital data information retrieval, special data processing applications, character and pattern recognition, etc., can solve problems such as incomplete acquisition of users and insufficient multi-modal feature space

Active Publication Date: 2020-11-17
SHANDONG UNIV
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0015] On the one hand, the multimodal feature space obtained with the above method is not built around ranking;
[0016] On the other hand, measuring the relationship between the query and the product and the product and the user separately cannot fully capture the complex relationship between the user, the query and the product

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Translation-Based Multimodal Modeling Method and Its Application in Product Retrieval
  • Translation-Based Multimodal Modeling Method and Its Application in Product Retrieval
  • Translation-Based Multimodal Modeling Method and Its Application in Product Retrieval

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0092] It should be pointed out that the following detailed description is exemplary and intended to provide further explanation to the present application. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.

[0093] It should be noted that the terminology used here is only for describing specific implementations, and is not intended to limit the exemplary implementations according to the present application. As used herein, unless the context clearly dictates otherwise, the singular is intended to include the plural, and it should also be understood that when the terms "comprising" and / or "comprising" are used in this specification, they mean There are features, steps, operations, means, components and / or combinations thereof.

[0094] Most current item retrieval methods ignore users' visual preferences for items. In this invention, we pr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a translation-based multimodal modeling method and its application in commodity retrieval, including: constructing positive correlation data sets and negative correlation data sets for all commodities; Space obtains the implicit representation of the final visual features of each commodity and the implicit representation of textual features; fuses the implicit representation of the final visual features of each commodity with the implicit representation of textual features to obtain the fused The implicit representation of ; based on the transformation matrix of the translation model, the implicit representation is mapped to the latent space, and the hidden representation vector of each commodity after mapping is obtained; the new query text is mapped to the latent space using the transformation matrix based on the translation model, Calculate the distance between the hidden representation vector of the product corresponding to the new query text and the hidden representation vector of each product; sort the distances from small to large, and output the top-ranked set products as product retrieval results.

Description

technical field [0001] The invention relates to a product retrieval method and system based on multi-modal shopping preferences. Background technique [0002] With the vigorous development of e-commerce, the way people buy goods has been greatly changed. The convenience of online shopping enables e-commerce users to buy most of the goods they want by just moving their fingers. Generally speaking, current product search engines (provided by e-commerce sites such as Tmall and JD.com) require users to express their shopping needs through text queries, and then return a sorted product list according to the degree of relevance. The results returned to the user include not only textual information (such as brand, price, description, etc.) of each item, but also visual information (ie, a picture of each item). [0003] In order to buy the desired product, the user will carefully check each product in the list based on the given information, which takes a lot of time. In order to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/9535G06K9/62G06Q30/06
CPCG06Q30/06G06F18/253
Inventor 郭洋洋程志勇聂礼强许信顺
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com