3D Shape Model Specification via 2D Texture Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional techniques for acquiring and editing three-dimensional shape data face challenges in accurately designating a range of three-dimensional point groups, leading to reduced accuracy and inconsistencies, especially when generating two-dimensional textures from multiple images or dealing with occlusion portions.
Innovation Solution
An image processing apparatus that specifies a partial area of a three-dimensional shape model by displaying captured images from multiple cameras, allowing users to designate areas intuitively and accurately through a display control unit, designation unit, and specification unit, utilizing methods like graph cut for high-accuracy range selection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a polygon (mesh) is used to specify three-dimensional shape, then the specification process can be simplified, but the accuracy of the specified three-dimensional shape is reduced
Solution Approach 1:
The patent introduces a two-dimensional texture as an intermediary layer between the user interface and the three-dimensional mesh. Users designate ranges on the 2D texture (which is easier to handle), and the system automatically maps these designations to the corresponding 3D mesh areas, thus maintaining both ease of operation and specification accuracy.
Solution Approach 2:
The patent transforms the 3D specification problem into a 2D problem by projecting the three-dimensional mesh onto a two-dimensional texture. This dimensionality reduction allows users to work with flat images rather than complex 3D surfaces, improving ease of operation while preserving accuracy through coordinate mapping between 2D and 3D spaces.
2Area of stationary object
If a two-dimensional texture is generated from multiple images, then more complete surface coverage is achieved, but inconsistencies occur at seams
Solution Approach 1:
The patent allows users to designate ranges that extend beyond visible seam areas on the 2D texture. By enabling partial actions (designations that may cross seam boundaries) and having the system handle the coordination automatically through multi-image data, the solution achieves complete coverage without requiring manual seam alignment.
Solution Approach 2:
The patent uses multiple captured images as source copies to generate the composite 2D texture. Each original image serves as a reference copy that the system can refer to when resolving seam inconsistencies, ensuring that the final texture maintains accuracy across multiple source materials.
3Device complexity
If a two-dimensional texture is generated from one image, then processing is simplified, but portions that cannot be recognized (occlusion portions) cannot be specified
Solution Approach 1:
The patent creates a 2D texture system that serves multiple functions: it works with single images for simple cases and automatically integrates multiple images when occlusion portions need to be covered. This multi-functional approach allows the same basic mechanism to handle both simplified processing and comprehensive coverage requirements.
Solution Approach 2:
The patent performs preliminary determination of whether multiple images are needed based on the presence of occlusion portions. Before texture generation, the system assesses the coverage requirements and pre-configures the appropriate number of source images, thereby simplifying the overall process while ensuring complete coverage when necessary.
4Area of stationary object
If multiple cameras are used to capture images, then complete three-dimensional coverage is achieved, but the complexity of range specification increases
Solution Approach 1:
The patent merges multiple camera images into a single composite 2D texture representation. By combining the data from multiple cameras into one unified 2D interface, the system maintains complete 3D coverage capability while simplifying the specification process to a single 2D designation operation rather than multiple coordinated operations.
Data Source
AI summary
An image processing apparatus according to an embodiment of the present invention specifies a partial area of a three-dimensional shape model that is generated based on a plurality of captured images obtained by a plurality of cameras. The image processing apparatus includes: a display control unit configured to display a display image based on a captured image of at least one camera of the plurality of cameras on a display unit; a designation unit configured to designate an area on the display image displayed by the display control unit; and a specification unit configured to specify an area on a three-dimensional shape model, which corresponds to an area designated by the designation unit on the display image, based on captured images of two or more cameras of the plurality of cameras.