Synthetic 3D Flight Scenes for Automated Object Labeling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for data collection and annotation for deep learning systems, particularly for autonomous intelligence and surveillance missions, are manual, time-consuming, expensive, and lack consistency, often requiring real-world data that may not be available.

Innovation Solution

A system utilizing synthetic three-dimensional (3D) modeling and simulation to generate image data, apply a mask to identify objects, and label them using a cursor on target (COT) lookup table, creating a training dataset for AI systems to identify real-world objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual data collection methods are used, then real-world environmental data can be captured, but the process is time-consuming and expensive

Engineering Contradiction:
Improvedata availabilityVSAvoiddata collection time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent creates synthetic 3D models that replicate real-world environments and objects. These virtual copies allow unlimited data generation without traveling to actual locations, eliminating the time-consuming manual collection process while maintaining realistic environmental conditions for training AI systems.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces manual mechanical data collection operations with automated computer-generated synthetic data. Instead of physically traveling to locations and manually capturing images, the system uses virtual reality engines to generate identical training data automatically, dramatically reducing time and human resource requirements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If manual data collection methods are used, then real-world data can be obtained, but the process is expensive and lacks consistency

Engineering Contradiction:
Improvedata consistencyVSAvoiddata collection cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent uses virtual copies of real-world environments that can be replicated infinitely with consistent parameters. Each synthetic scene can be generated with precise control over lighting, geometry, and object placement, ensuring uniform data quality without the variability introduced by manual collection methods.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent systematically varies parameters such as camera angles, lighting conditions, and object positions in controlled ways to generate diverse yet consistent training data. This allows comprehensive coverage of edge cases and varying conditions without the cost and inconsistency of manual data collection.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If real environmental data is captured manually, then authentic object information is obtained, but the process requires significant human skill and time

Engineering Contradiction:
Improveobject identification accuracyVSAvoiddata collection process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent creates virtual replicas of real-world objects and environments with precise geometric and photometric properties. These synthetic copies maintain the authentic information needed for object identification while eliminating the complex manual processes required to capture and annotate real-world data.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system automatically generates, annotates, and curates training data without human intervention. The synthetic environment self-provides ground truth labels through its programmed geometry and object definitions, eliminating the need for skilled annotators and simplifying the entire data preparation process.

Inventive Principle:
Principle #25Self-service

4Loss of information

If manual annotation is performed, then labeled data is produced, but the process is time-consuming and operator-dependent

Engineering Contradiction:
Improvedata labeling qualityVSAvoidannotation time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The synthetic data generation system automatically provides precise ground truth annotations through its programmed 3D models and rendering engine. Objects are automatically segmented, labeled, and positioned with pixel-level accuracy without requiring human annotators, eliminating both time consumption and operator skill dependencies.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system pre-computes all necessary annotations and ground truth labels during the synthetic data generation process itself. Rather than annotating data after collection, the labeling information is built into the virtual environment from the start, eliminating the separate time-consuming annotation step entirely.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250278933A1Flight mission learning using synthetic three-dimensional (3D) modeling and simulation
Publication Date: 2025.09.04 THE BOEING CO
  • US20250278933A1 patent drawing
  • US20250278933A1 patent drawing
  • US20250278933A1 patent drawing

AI summary

An apparatus for labeling an object includes a processor and a memory. The processor creates a synthetic three-dimensional (3D) modeling environment scene, generates image data synthetically generated by an in-flight camera simulation, the image data being within the 3D modeling environment scene based on an orientation of a camera and including one or more objects; uses a mask to identify the one or more objects in the 3D modeling environment scene, labels the identified one or more objects using a cursor on target (COT) lookup table, and stores the labeled identified one or more objects and flight metadata in a database as part of a training dataset to thereby train an artificial intelligence (AI) system. The AI system identifies a real object corresponding to the label of the one or more identified one or more objects in the COT lookup table. The real object is a real-world, target object.