3D Facial Mesh UV Map Generation for Virtual Image Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current face creation technologies in image processing applications suffer from low efficiency and depth distortion issues, as they lack the ability to accurately represent the three-dimensional structure of a real face in generated virtual facial images.

Innovation Solution

An image processing method that constructs a three-dimensional facial mesh from a target image, transforms it into a UV map to carry vertex position data, and uses this data to determine face creation parameters, ensuring the generated virtual facial image accurately matches the three-dimensional structure of the real face.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual adjustment of face creation parameters is used, then users can customize virtual facial images, but the face creation efficiency is low and time-consuming

Engineering Contradiction:
Improveface creation efficiencyVSAvoidtime for adjusting parameters
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent replaces the manual mechanical adjustment system with an automated image processing system. A neural network model automatically extracts facial features from input images and generates face creation parameters, eliminating the need for manual parameter adjustment by users and significantly improving face creation efficiency

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service face creation by automatically processing user-uploaded images to generate virtual facial images. The neural network model autonomously completes the entire parameter extraction and image generation process without requiring user intervention in parameter adjustment, making the service more efficient and user-friendly

Inventive Principle:
Principle #25Self-service

2Manufacturing precision

If traditional face creation methods are used, then virtual facial images can be generated, but depth distortion occurs and three-dimensional structure accuracy is poor

Engineering Contradiction:
Improvethree-dimensional structure accuracyVSAvoiddepth distortion
Core Design Contradiction:
Manufacturing precisionVSObject-affected harmful factors

Solution Approach 1:

The patent introduces three-dimensional spatial dimension into the face creation process by using a neural network model that processes images in 3D space. The model extracts depth information and spatial relationships from 2D images to generate accurate 3D facial structures, eliminating depth distortion and improving three-dimensional structure accuracy

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system changes the parameter representation from traditional 2D coordinate-based parameters to 3D spatial parameters including depth, width, and height dimensions. This parameter transformation enables accurate representation of facial three-dimensional structure and eliminates depth distortion in generated virtual facial images

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20230306685A1Image processing method, model training method, related apparatuses, and program product
Publication Date: 2023.09.28 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US20230306685A1 patent drawing
  • US20230306685A1 patent drawing
  • US20230306685A1 patent drawing

AI summary

Embodiments of this application disclose an image processing method performed by a computer device. The method includes: constructing a three-dimensional facial mesh corresponding to a target object according to a target image of the target object; transforming the three-dimensional facial mesh into a target UV map, the target UV map carrying position data of vertices on the three-dimensional facial mesh; determining target face creation parameters according to the target UV map; and generating, on the basis of the target face creation parameters, a target virtual facial image corresponding to the target object. The method can make a three-dimensional structure of a virtual facial image generated by face creation comply with a three-dimensional structure of a real face, thereby improving the accuracy and efficiency of the virtual facial image generated by face creation.