Synthetic Face Data Generation for Neural Network Training

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current neural networks face performance issues in face identification tasks due to inadequate training data, particularly underrepresentation of certain facial features or attributes, leading to suboptimal performance in unconstrained environments with variations like occlusions, head pose, illumination, and facial expressions.

Innovation Solution

A system utilizing a first neural network, such as a Generative Adversarial Network (GAN), generates synthetic images to supplement the training dataset, addressing data deficiencies by producing high-quality images with desired attributes, which are then used to train second neural networks for improved face identification.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If sufficient training images are collected to improve neural network accuracy, then face identification performance is improved, but cost and time consumption increase significantly

Engineering Contradiction:
Improveface identification accuracyVSAvoiddata collection time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent uses Generative Adversarial Networks (GANs) to generate synthetic face images that copy the essential characteristics of real face images. These synthetic images serve as training data, replacing the need to collect large quantities of real images. The GAN architecture includes a generator that creates synthetic images and a discriminator that evaluates them, enabling the system to produce realistic training data without physical data collection.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If real training datasets are used to train neural networks, then initial training can be performed, but the datasets lack diversity and cause suboptimal performance in unconstrained environments

Engineering Contradiction:
Improveperformance across various attributesVSAvoiddiversity of training data
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent employs attribute manipulation techniques to transform existing face images into diverse synthetic training images by changing parameters such as occlusion levels, head pose angles, illumination conditions, and facial expressions. This allows the training dataset to cover a wide range of unconstrained environment conditions without collecting images under each specific condition.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If more diverse training data is collected to cover different attributes and conditions, then robustness is improved, but the complexity and cost of data collection increase

Engineering Contradiction:
Improverobustness in unconstrained environmentsVSAvoiddata collection system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces GANs as an intermediary system that bridges the gap between limited real training data and the need for diverse training scenarios. The GANs generate intermediate synthetic images that fill in the gaps for rare or difficult-to-obtain conditions (such as extreme poses or occlusions), eliminating the need for complex multi-condition data collection systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240412491A1Using neural networks to generate synthetic data
Publication Date: 2024.12.12 NVIDIA CORP
  • US20240412491A1 patent drawing
  • US20240412491A1 patent drawing
  • US20240412491A1 patent drawing

AI summary

Apparatuses, system, and techniques use one or more first neural networks to generate one or more synthetic data to train one or more second neural networks based, at least in part, on one or more performance metrics of one or more second neural networks.