3D Model-Assisted Digital Painting for Accurate Face Contours

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional digital painting techniques struggle to apply realistic digital paint to objects, especially faces, in digital images due to limitations in viewing contours from a single perspective, leading to cartoonish results and requiring specialized knowledge for three-dimensional interactions.

Innovation Solution

A computing device fits a three-dimensional model to objects in digital images, allowing users to interact with multiple perspectives and apply digital paint directly to two-dimensional texture maps, simplifying controls and enabling paint transfer between objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional two-dimensional digital painting techniques are used, then the operation is simple, but the realism and accuracy of paint application to contours is poor

Engineering Contradiction:
Improvepaint application accuracyVSAvoidoperational simplicity
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent introduces a three-dimensional model layer between the two-dimensional image and the painting operation. Users interact with a 3D model that represents the object's surface geometry, allowing paint to be applied accurately to contours and surfaces while maintaining intuitive 2D interaction. The system automatically handles the complex 3D coordinate transformations and surface mapping.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent uses a 3D model as an intermediary between the user's painting actions and the final 2D image output. This intermediary model captures the object's surface geometry and enables realistic paint application by serving as a bridge that translates simple user gestures into accurate surface-based painting operations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If three-dimensional surface interaction techniques are used, then the paint application realism is improved, but the device complexity and user expertise required increase

Engineering Contradiction:
Improvepaint application accuracyVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system automatically performs complex 3D model fitting, perspective calculation, and coordinate transformation operations without requiring user intervention. The computing device autonomously handles the mathematical computations and geometric transformations needed to map 2D painting gestures onto 3D surfaces, eliminating the need for users to manually manage complex 3D parameters.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces complex manual 3D manipulation operations with automated computational processes. Instead of requiring users to perform intricate 3D rotations and transformations, the system uses algorithms to automatically fit 3D models to objects and compute the appropriate painting transformations, substituting mechanical user actions with intelligent software processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If three-dimensional model fitting is performed, then multiple perspectives and realistic painting are enabled, but the processing time and computational resources increase

Engineering Contradiction:
Improveperspective flexibilityVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs 3D model fitting and perspective calculations in advance, before the actual painting operation begins. By pre-computing the 3D model parameters and perspective transformations, the system reduces the computational burden during the interactive painting phase, allowing users to paint efficiently without real-time computational delays.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a 3D model copy or representation of the object that can be manipulated independently. This digital twin or surrogate model allows the system to perform repeated perspective calculations and transformations on the copy without affecting the original image processing, enabling flexible perspective changes with reduced computational overhead on the actual painting data.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10755459B2Object painting through use of perspectives or transfers in a digital medium environment
Publication Date: 2020.08.25 ADOBE INC
  • US10755459B2 patent drawing
  • US10755459B2 patent drawing
  • US10755459B2 patent drawing

AI summary

Techniques and systems are described herein that support improved object painting in digital images through use of perspectives and transfers in a digital medium environment. In one example, a user interacts with a two-dimensional digital image in a user interface output by a computing device to apply digital paint. The computing device fits a three-dimensional model to an object within the image, e.g., the face. The object, as fit to the three-dimensional model, is used to support output of a plurality of perspectives of a view of the object with which a user may interact to digitally paint the object. As part of this, digital paint as specified through the user inputs is applied directly by the computing device to a two-dimensional texture map of the object. This may support transfer of digital paint by a computing device between objects by transferring the digital paint using respective two-dimensional texture maps.