GAN Wireframe Rendering for Digital Image Layout Training

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional machine learning techniques fail to generate visually pleasing digital image layouts due to their pixel-level processing, which does not capture the subtleties of graphic element arrangements and geometries, requiring manual user interaction.

Innovation Solution

A generative adversarial network (GAN) system employing wireframe rendering is used to train a generator module to refine digital image layouts, allowing it to address spatial patterns and geometric parameters, thereby generating visually pleasing layouts automatically without user intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional machine learning techniques process digital images at pixel level, then processing is simple and straightforward, but it fails to capture subtleties of graphic element arrangements and geometries

Engineering Contradiction:
Improvelayout arrangement precisionVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transforms the processing approach from pixel-level (2D grid) to parameter-level (geometric primitives with attributes). Instead of processing individual pixels, the system represents graphic elements as parametric objects with properties like position, size, shape, and arrangement relationships, enabling precise capture of layout subtleties without pixel-level complexity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system changes the representation parameters from pixel values to geometric parameters (coordinates, dimensions, shapes, and spatial relationships). This parameter transformation allows the machine learning model to directly learn from meaningful layout attributes rather than raw pixel data, improving measurement precision for layout arrangements

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If manual user interaction is used to specify arrangement of graphic elements, then layout accuracy is high, but productivity is low

Engineering Contradiction:
Improvelayout accuracyVSAvoidlayout generation speed
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The system implements self-service by training a machine learning model to automatically generate and refine digital image layouts without continuous manual intervention. The model learns from training data containing graphic elements and their arrangements, then independently generates new layouts by processing input elements through the trained generator, achieving both accuracy and productivity

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent incorporates feedback mechanisms where the generator produces layout candidates and the discriminator evaluates them against ground truth data. This adversarial feedback loop allows the system to iteratively improve layout accuracy automatically, replacing manual refinement while maintaining high precision through learned design principles

Inventive Principle:
Principle #23Feedback

3Extent of automation

If conventional machine learning techniques are used for layout generation, then implementation is simple, but the system requires manual user interaction

Engineering Contradiction:
Improvelayout generation automationVSAvoidsystem complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The patent segments the layout generation task into distinct functional modules: a generator that creates layout candidates and a discriminator that evaluates them. This segmentation allows the complex automation task to be divided into manageable components, each handling specific aspects of layout generation while working together to achieve full automation

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system combines multiple machine learning components (generator network, discriminator network, and training framework) into a composite adversarial system. This composite structure integrates different functional elements that individually handle specific aspects of layout generation, achieving high automation through their coordinated interaction

Inventive Principle:
Principle #40Composite materials

Data Source

PatentUS10997464B2Digital image layout training using wireframe rendering within a generative adversarial network (GAN) system
Publication Date: 2021.05.04 ADOBE INC
  • US10997464B2 patent drawing
  • US10997464B2 patent drawing
  • US10997464B2 patent drawing

AI summary

Digital image layout training is described using wireframe rendering within a generative adversarial network (GAN) system. A GAN system is employed to train the generator module to refine digital image layouts. To do so, a wireframe rendering discriminator module rasterizes a refined digital training digital image layout received from a generator module into a wireframe digital image layout. The wireframe digital image layout is then compared with at least one ground truth digital image layout using a loss function as part of machine learning by the wireframe discriminator module. The generator module is then trained by backpropagating a result of the comparison.