Three-dimensional model retrieval method based on LSTM network multi-modal information fusion

Abstract

The invention discloses a three-dimensional model retrieval method based on LSTM network multi-modal information fusion, and the method comprises the steps: for a given three-dimensional model, extracting a plurality of views of the three-dimensional model arranged according to a rotation angle sequence; extracting skeleton characteristics of a plurality of views in a multi-task and multi-angle manner, and obtaining structured information of the three-dimensional model according to the skeleton characteristics; extracting view feature vectors of a plurality of views, and inputting the view feature vectors into a layer of LSTM network structure; checking whether other feature vectors need to be extracted continuously or not; connecting the skeleton feature vector with the view feature vector subjected to one layer of LSTM to form a new feature vector, and inputting the new feature vector into a second layer of LSTM network structure for fusion; checking whether other to-be-fused featurevectors exist or not, if yes, forming a new feature vector again and inputting the new feature vector into the next layer of LSTM network structure for fusion; and taking the output of the last fusion as the final feature vector Q of the three-dimensional model, and finishing the final detection process of the three-dimensional model in combination with a similarity measurement method.

Description

technical field [0001] The invention relates to a three-dimensional model retrieval method. In particular, it relates to a 3D model retrieval method based on LSTM network multimodal information fusion. Background technique [0002] In recent years, thanks to the rapid development of related technologies, the number of 3D models has developed rapidly. On the one hand, the emergence and development of depth cameras make it possible to obtain 3D models by collecting the real world; on the other hand, the enhancement of graphics card and CPU performance, as well as the emergence of 3D modeling software, make virtual modeling simple and easy. . In addition, the rapid development of the Internet makes the dissemination of models easier and faster [1]-[4] . In view of this, 3D models are more and more widely used in various industries [6][7] . In the process of actual use, with the gradual increase of the 3D model database and the particularity of the 3D model data, it become...

AI Technical Summary

Problems solved by technology

Experiments show that the choice of different viewpoints can significantly affect the performance of view-based algorithms

Images