Seamless 3D Mesh Texturing via Region-Based Image Assignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 3D object data modeling techniques face challenges in minimizing texture distortion when mapping images from different angles onto a triangular mesh, leading to seams between triangles, which affects the accuracy and smoothness of the rendered image.

Innovation Solution

A method that optimizes the assignment of images to triangles by maximizing resolution, minimizing boundary length, and reducing boundary crossings, involving a process to reassign images based on mismatch factors to reduce gradient variations and achieve seamless texturing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If images are assigned to triangles based on maximizing resolution, then image quality is improved, but seams and texture distortion occur at boundaries between triangles assigned to different images

Engineering Contradiction:
Improveimage resolutionVSAvoidtexture seam alignment
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent segments the mesh surface into regions, each assigned to a single source image. By dividing the surface into contiguous regions and assigning each region to one image, the method avoids the seam problem that occurs when multiple images are assigned at the triangle level, while still maximizing resolution within each region.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different assignment criteria to different regions of the mesh. Each region is optimized for its specific characteristics, with images assigned to maximize resolution locally while maintaining seamless boundaries. This allows high resolution in areas where it matters most without compromising overall seamlessness.

Inventive Principle:
Principle #3Local quality

2Area of stationary object

If multiple images are used to cover the entire object surface, then complete coverage is achieved, but gradient variations and visual discontinuities appear at image boundaries

Engineering Contradiction:
Improvesurface coverageVSAvoidboundary smoothness
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent performs preliminary optimization of image assignment before final rendering. By预先 assigning images to regions and optimizing the assignment to minimize gradient variations at boundaries, the method prevents visual discontinuities before they occur, ensuring smooth transitions across the entire surface.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses gradient variation as a feedback metric to evaluate and optimize image assignments. By calculating gradient variations at boundaries and using this information to adjust assignments, the method continuously improves boundary smoothness while maintaining complete surface coverage.

Inventive Principle:
Principle #23Feedback

3Productivity

If images are assigned independently to each triangle, then resolution optimization is simplified, but boundary length and number of seams increase

Engineering Contradiction:
Improveassignment efficiencyVSAvoidboundary length
Core Design Contradiction:
ProductivityVSLength of stationary object

Solution Approach 1:

The patent transitions from triangle-level assignment to region-level assignment, adding a spatial dimension to the optimization problem. By working with contiguous regions rather than individual triangles, the method reduces the total boundary length while maintaining resolution optimization, effectively solving the problem in a higher-dimensional space.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS9224238B2Seamless texturing of 3D meshes of objects from multiple views
Publication Date: 2015.12.29 GOOGLE LLC
  • US9224238B2 patent drawing
  • US9224238B2 patent drawing
  • US9224238B2 patent drawing

AI summary

Methods and systems for texturing of three-dimensional (3D) object data models are provided. An example method may include receiving information indicating a geometry of an object receiving a plurality of images of the object. The method may also include assigning images of the plurality of images that have a resolution above a threshold to a plurality of polygons that approximate the geometric surface of the object. The method may also include determining adjacent polygons that are assigned to different images of the plurality of images so as to identify boundaries of images and minimizing such boundaries. The method may also include determining a mismatch factor for boundaries of the modified boundaries of images and reassigning images in boundaries having a mismatch factor above a threshold so as to reduce a gradient variation between the images in the modified boundaries.