3D Character Morphology Correction via Automated Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In virtual reality and game applications, creating realistic 3D character expressions is challenging due to morphological differences between 3D characters and real faces, leading to inefficient manual corrections that consume manpower and time.

Innovation Solution

An image processing method that acquires and corrects the morphology of target parts in 3D characters by using description and contour information to match the expected morphology, eliminating the need for manual adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual correction method is used to adjust the morphology of 3D character faces, then the expression accuracy can be improved, but the correction efficiency and productivity deteriorate due to high manpower consumption and time requirements

Engineering Contradiction:
Improveexpression accuracyVSAvoidcorrection efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent replaces the manual mechanical correction process with an automated image processing system. The system uses computer vision algorithms to automatically detect facial landmarks, extract morphology features, and adjust 3D character expressions without manual intervention, thereby maintaining accuracy while dramatically improving efficiency

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a digital copy of the reference image's facial morphology and applies it to the 3D character. By copying key facial features and expressions from the reference image through automated processing, the system achieves accurate expression transfer without requiring manual morphological adjustment

Inventive Principle:
Principle #26Copying

2Productivity

If automated image processing is applied to correct morphology, then productivity and efficiency are improved, but the manufacturing precision and accuracy of expression matching may deteriorate

Engineering Contradiction:
Improvecorrection efficiencyVSAvoidexpression accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent implements feedback mechanisms where the processed 3D character expressions are continuously compared with the reference image morphology. The system uses feedback loops to iteratively refine the expression matching, ensuring high accuracy while maintaining automated efficient processing

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary actions by pre-processing the reference image to extract facial landmarks, contours, and morphology features before the actual correction process. This preliminary preparation enables the automated system to accurately understand the target expression and apply it precisely to the 3D character

Inventive Principle:
Principle #10Preliminary action

3Reliability

If detailed morphology adjustment is performed manually to achieve precise expression matching, then the expression realism is improved, but the time consumption and duration of action increase significantly

Engineering Contradiction:
Improveexpression realismVSAvoidcorrection time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the facial morphology into multiple key regions and landmarks (eyes, eyebrows, nose, mouth, cheeks). By dividing the complex morphology adjustment into manageable segments, the automated system can efficiently process each region while maintaining overall expression realism, significantly reducing total correction time

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20230368395A1Image processing method, apparatus and device, storage medium and computer program
Publication Date: 2023.11.16 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US20230368395A1 patent drawing
  • US20230368395A1 patent drawing
  • US20230368395A1 patent drawing

AI summary

Some embodiments of this application disclose an image processing method, including: acquiring an image-to-be-processed, the image-to-be-processed including a target part of an object, the morphology of the target part being a first morphology, and the first morphology being not matched with an expected morphology; acquiring description information corresponding to the first morphology, and acquiring contour information of the target part in the first morphology; and correcting the morphology of the target part based on the description information and the contour information so as to correct the morphology of the target part from the first morphology to a second morphology, the second morphology being matched with the expected morphology. By adopting some embodiments of the disclosure, manpower resources can be saved, and the morphology correction efficiency is improved.