Three-dimensional object retrieval method based on multi-view classification

A three-dimensional object, multi-view technology, applied in the field of computer vision, can solve the problems of incomplete perspective features of three-dimensional object images, complex three-dimensional modeling, and difficulty in building and describing three-dimensional models.

Active Publication Date: 2019-07-30
XIDIAN UNIV
View PDF8 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the perspective characteristics of the 3D object image obtained by the first method are not comprehensive; the establishment and description of the 3D model by the second method are relatively difficult; the third method cannot directly retrieve the 3D object, and the 3D information must be converted to convert into two-dimensional information for description, classification and identification
[0004] To sum up, the existing technology cannot realize the image description of three-dimensional objects in all directions and multiple perspectives when searching for three-dimensional objects, and cannot directly retrieve three-dimensional objects, and requires complex three-dimensional modeling

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional object retrieval method based on multi-view classification
  • Three-dimensional object retrieval method based on multi-view classification
  • Three-dimensional object retrieval method based on multi-view classification

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] Due to the particularity of the three-dimensional model, the three-dimensional object is greatly affected by environmental factors in the real scene, such as lighting, shadows, occlusion, etc., and at the same time, it is integrated and multi-faceted, and the feature diversity is more, which is not as good as the relative unity of the two-dimensional plane. Therefore, the present invention will The two-dimensional plane is associated with the three-dimensional object, and the three-dimensional object is represented by a two-dimensional plane.

[0053] The present invention constructs an image database by sampling three-dimensional objects in two-dimensional planes with multiple perspectives, and extracts appropriate features from the images in the database, and sends them into a BOW (bag of word) word bag model for training to build a vocabulary tree to Improve the retrieval accuracy of 3D objects.

[0054] See figure 1 , figure 1 It is a flowchart of a three-dimensio...

Embodiment 2

[0087] See Figure 2a-2b , Figure 2a-2b are sample images under different viewing angles provided by the embodiment of the present invention, where, Figure 2a is the sample image sampled in the upper left, Figure 2b is the sample image sampled in the upper right. After multi-view transformation, a series of samples are obtained.

[0088] See Figure 3a~3b , Figure 3a~3b is a multi-view image generated from sample images under different viewing angles provided by the embodiment of the present invention, wherein, Figure 3a yes Figure 2a The multi-view map generated from the sample image sampled in the upper left, Figure 3b yes Figure 2b Multi-view map generated from the sample image sampled on the upper right.

[0089] It can be seen from the figure that each three-dimensional object has a corresponding image transformation, including the rotation and tilt deformation of the image. The two transformations are added together to form an analogy to the difference i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a three-dimensional object retrieval method based on multi-view classification. The method comprises the steps of obtaining an original image; processing the original image toobtain a multi-view image; processing the multi-view image to obtain a feature descriptor; processing the feature descriptor to obtain a vocabulary tree; and retrieving a to-be-retrieved image in thevocabulary tree to obtain the serial number of the original image. According to the method, a multi-view classification algorithm is adopted to obtain an omnibearing multi-view feature image of the three-dimensional object in a two-dimensional plane, the three-dimensional object can be directly retrieved, the method is simple, convenient and easy to implement, and the problem that the retrieval performance is reduced due to view angle changes of the object shot by a user in three-dimensional image retrieval is solved.

Description

technical field [0001] The invention belongs to the technical field of computer vision, and in particular relates to a three-dimensional object retrieval method based on multi-view classification. Background technique [0002] As an important means for human beings to understand the world, computer vision technology has been widely concerned by researchers. Due to the rapid development and popularization of camera technology, people are exposed to a variety of explosive image information through multimedia devices such as mobile phones. Nowadays, two-dimensional images are widely used in transportation, medical, military and other fields. Image retrieval is an information processing technology for image information processing. Researchers have done a lot of work and achieved rich results. In real life, what people face is a three-dimensional object, and the real three-dimensional scene is what people come into contact with every day. With the development of three-dimensiona...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T19/20G06T3/00G06T5/20G06K9/62G06F16/36
CPCG06T19/20G06T3/0006G06T5/20G06F16/374G06T2219/2016G06T2207/20024G06F18/23213
Inventor 李静张念曾李尔康
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products