3D Face Texture Alignment via Supplementary Feature Points

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods fail to correctly apply texture images to pre-modeled face shapes due to mismatched facial features, making it difficult to accurately project and display 3D face models in computer graphics applications.

Innovation Solution

An image processing apparatus and method that acquires feature points, calculates supplementary feature points, and transforms images to match the structure of a given 3D face shape, allowing for correct application of texture images by segmenting the image into triangular regions and using both feature and supplementary points for alignment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a texture image is applied to a pre-modeled face shape, then the face model can be generated quickly, but the facial features in the face shape and texture image do not match up

Engineering Contradiction:

Improveface model generation speedVSAvoidfeature alignment accuracy

Core Design Contradiction:

ProductivityVSManufacturing precision

Solution Approach 1:

The patent performs preliminary actions by acquiring feature points from the texture image and calculating supplementary feature points before applying the texture to the 3D face shape. This pre-processing ensures that corresponding features are identified and aligned in advance, resolving the mismatch problem while maintaining efficient generation speed.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent replaces manual or mechanical alignment methods with an automated computational system that uses feature point detection and geometric transformation algorithms. This substitution enables precise feature matching between texture and shape through mathematical calculations rather than physical adjustment.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If feature points are used to transform the image, then the structure can be matched, but supplementary feature points are needed for complete alignment

Engineering Contradiction:

Improvefeature point detection accuracyVSAvoidprocessing complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the feature extraction process into two distinct parts: detecting key feature points (eyes, nose, mouth) and calculating supplementary feature points based on geometric relationships. This segmentation allows the system to handle complex alignment tasks through manageable, modular processing steps.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces supplementary feature points as an intermediary element that bridges the gap between detected feature points and the complete facial structure. These supplementary points serve as intermediate references that facilitate accurate transformation and alignment of the texture image to match the 3D face shape.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS8698796B2Image processing apparatus, image processing method, and program

Publication Date: 2014.04.15 SONY GROUP CORP

AI summary

In an image processing apparatus, a feature point acquirer acquires feature points, which are characteristic points on a face in an image presenting a face. A supplementary feature point calculator calculates supplementary feature points on the basis of the feature points acquired by the feature point acquirer. An image transform unit utilizes the feature points and the supplementary feature points to transform the image so as to match the structure of a face in a projected image that depicts the surface of a given three-dimensional face shape projected onto a flat plane.