3D Texture Generation Using Virtual Viewpoints for UV Development

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In three-dimensional computer graphics, the existing methods for generating texture images from 3D shape data often result in low-quality images with color voids due to the positional relationship between 3D model elements and camera viewpoints, leading to crushed shapes and incomplete color information.

Innovation Solution

An image processing apparatus that divides 3D shape data into groups, associates each group with viewpoint information, and generates a texture image using a two-dimensional map, incorporating virtual viewpoints to ensure complete color coverage, even when real camera viewpoints are not available.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If UV development is performed using only real camera viewpoints, then the process is simple and uses available data, but fragments may be crushed into lines and color information cannot be appended

Engineering Contradiction:
Improvecolor information completenessVSAvoidviewpoint system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the viewpoint system into two distinct types: real camera viewpoints and virtual camera viewpoints. This segmentation allows each type to serve its specific function - real cameras provide actual captured images while virtual cameras provide supplementary viewpoints for fragments that cannot be colored from real camera perspectives, thereby ensuring complete color information coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Virtual camera viewpoints act as an intermediary solution between the limitation of real camera positions and the requirement for complete fragment coloring. When a fragment is crushed into a line shape from real camera viewpoints and cannot receive color information, the virtual camera viewpoints serve as mediators to provide alternative projection angles that enable successful UV development and color assignment.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If multiple camera viewpoints are used to cover all polygons, then complete color coverage is achieved, but the positional relationship may still result in crushed fragment shapes

Engineering Contradiction:
Improvetexture image qualityVSAvoidprocessing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements a dynamic viewpoint selection mechanism where the system evaluates the positional relationship between each fragment and available camera viewpoints in real-time. Based on this evaluation, it dynamically determines whether to use real camera viewpoints or virtual camera viewpoints for each specific fragment, optimizing both texture quality and processing efficiency adaptively.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the viewpoint parameter dynamically - switching between real camera viewpoints and virtual camera viewpoints based on the geometric characteristics of each fragment. This parameter change allows the system to maintain high texture image quality by selecting the most appropriate viewpoint type for each fragment while avoiding unnecessary processing overhead.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If virtual viewpoints are introduced to ensure complete color coverage, then all fragments can be colored, but the system complexity increases

Engineering Contradiction:
Improvefragment coloring completenessVSAvoidviewpoint management complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the viewpoint management into distinct real and virtual categories, with clear differentiation in their functions and usage conditions. This segmentation simplifies the overall management complexity by providing a structured framework where each viewpoint type has well-defined roles and selection criteria.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements self-service functionality where it automatically evaluates whether each fragment requires real or virtual camera viewpoints based on geometric analysis. This self-service mechanism eliminates the need for manual viewpoint assignment and reduces management complexity through automated, rule-based decision-making.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20240428519A1Image processing apparatus, image processing method, and storage medium
Publication Date: 2024.12.26 CANON KK
  • US20240428519A1 patent drawing
  • US20240428519A1 patent drawing
  • US20240428519A1 patent drawing

AI summary

Depending on the positional relationship between the element configuring a 3D model and the camera viewpoint, it is not possible to color the fragment generated by UV development, and as a result of that, a texture image of low image quality including color voids is obtained. In the UV development, the fragment is generated by setting camera parameters of the virtual camera.