Hand-drawn scene three-dimensional modeling method combining multi-perspective projection with three-dimensional registration

Abstract

The invention provides a hand-drawn scene three-dimensional modeling method combining multi-perspective projection with three-dimensional registration. The three-dimensional modeling method comprises steps that standardized preprocessing is performed on all three-dimensional models in a three-dimensional model base, virtual cameras are arranged at vertexes of a regular polyhedron, projection pictures at all angles of each three-dimensional model are shot to represent visual shapes of the three-dimensional model, visual features of all the projection pictures of each three-dimensional model are extracted, and a three-dimensional model feature base is established according to the visual features; users draw two-dimensional hand-drawn pictures of each three-dimensional model of a three-dimensional scene needing showing and character labels of the two-dimensional hand-drawn drawings by hands, images are shot through cameras, processing on image regions is performed, visual features of hand-drawn pictures are extracted, character label regions subjected to processing serve as retrieval key words, similarity calculation is performed on visual features of hand-drawn pictures and three-dimensional model features of the three-dimensional model feature base, retrieval is performed to obtain three-dimensional models of a three-dimensional scene, three-dimensional models with largest similarity are projected to corresponding positions through a three-dimensional registration algorithm, and then show of three-dimensional modeling of the hand-drawn scene and a three-dimensional is achieved.

Description

technical field [0001] The invention relates to a hand-painted scene three-dimensional modeling method combined with multi-view projection and three-dimensional registration, and belongs to the technical field of three-dimensional model retrieval and augmented reality. Background technique [0002] With the development of 3D technology, 3D models and 3D scenes, which are closer to the real world to describe 3D space, have been more and more widely used in many fields such as transportation, medicine and entertainment. For the display of 3D scenes, the first technical problem to be solved is: "how to build a 3D model". However, the cost of building a 3D model is often enormous. Moreover, with the development of 3D modeling methods, the increase of 3D model-related applications, and the rapid development of the Internet, the number of available 3D models is also increasing rapidly; this makes it possible to display 3D scenes through existing 3D models. main development trend...

AI Technical Summary

Problems solved by technology

However, with the continuous development of applications, the display methods of the existing technologies inevitably expose some problems that cannot be ignored

For example: the isolation of the system from reality due to over-emphasis on the user's sense of immersion

Images