Latent Space Interpolation for Distinctive Game Content Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current procedural generation methods in video games often result in a lack of variety in virtual environments, leading to 'procedural oatmeal' scenarios where generated environments appear similar despite differences, failing to provide a desirable and satisfactory gaming experience.

Innovation Solution

A content generation system utilizing machine learning models, specifically convolutional neural networks, to generate varied animations and actions by interpolating between predefined actions within a latent space, allowing for increased customization and immersion without significant developer time or data overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If procedural generation is used to generate virtual environments, then the number of possible environments can be increased without adding significant overhead in terms of data distribution or developer time, but the generated environments frequently lack distinctiveness and variety

Engineering Contradiction:
Improvenumber of possible environmentsVSAvoidlack of distinctiveness
Core Design Contradiction:
Adaptability or versatilityVSObject-generated harmful factors

Solution Approach 1:

The system pre-trains a machine learning model on a dataset of reference images depicting environments with desired visual characteristics. This preliminary training establishes a foundation of aesthetic principles and visual patterns that the model will later use to generate distinct and visually appealing virtual environments, preventing the 'procedural oatmeal' effect of generic, indistinctive generation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system employs a feedback mechanism where the machine learning model generates candidate environment images, which are then evaluated against learned aesthetic criteria and constraints. The model receives feedback on the quality and distinctiveness of generated images and iteratively adjusts its generation process to produce more varied and visually distinctive environments while maintaining coherence with the game's artistic direction.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If a large number of customisable elements are introduced into a gaming environment, then variety in character appearance can be increased, but the visual impact remains similar and does not significantly address consumer experience

Engineering Contradiction:
Improvecharacter appearance varietyVSAvoidsimilar visual impact
Core Design Contradiction:
Adaptability or versatilityVSObject-generated harmful factors

Solution Approach 1:

The system uses parameter changes in the latent space of the machine learning model to generate diverse character appearances. By varying the latent vectors that control different aspects of character generation (such as body type, clothing style, accessories, and visual effects), the system can produce characters with significantly different visual impacts and aesthetic qualities, moving beyond superficial variations to create truly distinctive appearances.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If procedural generation constraints are made loose to increase variety, then more diverse environments can be generated, but the environments become jarring or discontinuous and potentially unsuitable for the content

Engineering Contradiction:
Improveenvironment diversityVSAvoidenvironment suitability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system dynamically adjusts generation constraints based on the specific generation context and desired outcomes. The machine learning model can adapt its generation parameters in real-time, tightening constraints when coherence and suitability are at risk and loosening them when variety is needed, allowing the system to navigate the trade-off between diversity and reliability dynamically rather than using fixed constraints.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system applies different levels of constraint to different aspects of environment generation. Certain elements that are critical for suitability and coherence (such as functional relationships between objects, basic geometric consistency, and contextual appropriateness) are constrained more strictly, while other elements that contribute to variety (such as decorative details, color schemes, and layout variations) are allowed greater freedom, achieving both diversity and reliability through differentiated constraint application.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12141905B2Content generation system and method
Publication Date: 2024.11.12 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12141905B2 patent drawing
  • US12141905B2 patent drawing
  • US12141905B2 patent drawing

AI summary

A content generation system operable to generate one or more actions to be performed by an agent, the system comprising an input receiving unit operable to receive two or more actions for the agent, a model generation unit operable to input the actions to a machine learning model so as to generate a trained machine learning model, and an action generation unit operable to generate an action to be performed by the agent, wherein the generation comprises the selection of a latent space interpolation state associated with the trained machine learning model.