Automatic Face Modification Using Feedback-Driven Mask Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users lack an efficient and user-friendly method to automatically modify facial images and videos on social media and online dating platforms, as existing photo editing software is often expensive, requires expertise, and is dependent on human skill and patience, without considering cultural and personal preferences for attractiveness.

Innovation Solution

A system and method for automatic face modification using face detection, alignment, projection to a face space, and server-based modification instructions, allowing users to select preferred modifications and learn from feedback to adapt to changing beauty standards.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual photo editing software is used, then picture modification can be done, but it requires expertise and special training

Engineering Contradiction:
Improveease of useVSAvoidcomplexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs automatic face detection, alignment, and modification without requiring user intervention. The computer automatically identifies facial features, applies appropriate filters and enhancements, and generates modified images, making the service self-executing rather than requiring manual operation by users

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical photo editing operations with automated computer vision and image processing algorithms. Instead of requiring users to manually adjust parameters and apply edits, the system uses automated detection and modification algorithms to perform all editing tasks programmatically

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If professional photo editing programs are used, then modification quality can be improved, but cost increases

Engineering Contradiction:
Improvemodification qualityVSAvoidcost
Core Design Contradiction:
Manufacturing precisionVSEase of manufacture

Solution Approach 1:

The system uses pre-trained models and templates for face modification that can be replicated and distributed to multiple users. Instead of requiring each user to purchase expensive professional software, the modification algorithms are copied and made accessible through the service platform at lower cost

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent creates a universal photo modification system that handles multiple types of edits (face alignment, filtering, enhancement, retouching) through a single integrated platform. This multi-functional approach eliminates the need for users to purchase multiple specialized software programs, reducing overall cost while maintaining comprehensive modification capabilities

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If automated modification is implemented, then ease of use improves, but cultural and personal preferences may be ignored

Engineering Contradiction:
ImproveautomationVSAvoidcultural adaptability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system dynamically adapts modification parameters based on detected cultural and personal characteristics. Instead of applying fixed automated edits, the system adjusts filtering, enhancement, and retouching parameters according to the user's cultural background, gender, age, and personal preferences, making the automation flexible and context-aware

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent incorporates feedback mechanisms where user responses to modified images are collected and used to refine future modifications. The system learns from user preferences and cultural patterns, continuously improving its ability to provide culturally appropriate and personally tailored automated edits

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9491263B2Systems and methods for automatically modifying a picture or a video containing a face
Publication Date: 2016.11.08 SNAP INC
  • US9491263B2 patent drawing
  • US9491263B2 patent drawing
  • US9491263B2 patent drawing

AI summary

Systems and methods for automatically adjusting a picture or a video containing a face, by detecting the face in a picture, constructing a face-structure mask for the face, obtaining a set of model face-structure masks and modification instructions, and modifying the face. The disclosure further provides for displaying the modified picture, receiving user feedback regarding the modifications, and processing the user feedback.