Retrieval model training method and device, retrieval method and device, electronic equipment and storage medium

Abstract

The invention provides a three-dimensional model retrieval model training method. The method comprises the following steps: rendering a three-dimensional model in a three-dimensional model database to obtain a corresponding multi-view rendering grayscale image; in the trained query image small batch, performing color conversion on the query image to obtain a corresponding data enhancement image; sending the data enhancement image and the corresponding mask image into a query image encoder to obtain a query code corresponding to the query image; sending the multi-view rendering grayscale image corresponding to the three-dimensional model into a rendering encoder to obtain a rendering code corresponding to the multi-view rendering grayscale image corresponding to the three-dimensional model; sending the query code and the rendering code into an attention mechanism module to obtain a specific code of the three-dimensional model for the current query image; and optimizing by utilizing the loss function to obtain a three-dimensional model retrieval model.

Description

technical field [0001] The invention relates to the geometric processing field of computer graphics, in particular to a three-dimensional model retrieval model training method and device, a three-dimensional model retrieval method and device, electronic equipment and a storage medium. Background technique [0002] Multimedia retrieval, including image retrieval and 3D model retrieval, has always been a very basic and important frontier hot issue in the field of computer vision and graphics. One of its research challenges is how to characterize the similarity relationship between retrieved images of different modalities and 3D models. Due to the development of deep learning and 3D model datasets with rich objects and categories, as well as its wide range of applications, including scene reconstruction, 3D printing, virtual reality and e-commerce platforms, the task of 3D model retrieval based on a single real image has recently gained a lot of attention. more attention. In ...

AI Technical Summary

Problems solved by technology

[0004] Aiming at the deficiencies of the prior art, the main purpose of the present invention is to propose a 3D model retrieval model training method and device, a 3D model retrieval method and device, electronic equipment and storage media, which can overcome the difficulties in image-based 3D model retrieval tasks. Problems such as sample mining, interference of category information on retrieval, and coupling of color and shape features

Images