Style Transfer Program for Video Game Buffer Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current style transfer technologies in video games do not effectively enhance the representational power of images provided to users by applying style transformations in a manner that is flexible and context-aware, particularly in units of buffers used for rendering.

Innovation Solution

A non-transitory computer readable medium and method that includes a style transfer program executed by a server, which acquires buffer data, applies style transfer based on multiple style images, and outputs transformed data, allowing for real-time style changes and precise control over image representation by utilizing neural networks and optimizing processes for blending multiple styles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If style transfer is applied to entire images, then style transformation is achieved, but flexibility and context-awareness are reduced

Engineering Contradiction:
Improveflexibility of style transformationVSAvoidcontrol precision over image representation
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent divides the image into multiple buffers (e.g., depth buffer, normal buffer, texture buffer) and applies style transfer to each buffer independently. This segmentation enables flexible and context-aware style transformation by allowing different styles to be applied to different visual elements, thereby resolving the contradiction between flexibility and control precision.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If style transfer is applied in units of buffers, then representational power and flexibility are increased, but processing complexity increases

Engineering Contradiction:
Improverepresentational power of imageVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent employs a universal style transfer processing framework that handles multiple buffer types (depth, normal, texture, etc.) through a common pipeline. This multi-functional approach increases representational power while managing processing complexity by reusing the same style transfer engine across different buffer types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent performs preliminary classification and organization of buffers before applying style transfer. By pre-processing and categorizing buffers according to their types and purposes, the system reduces subsequent processing complexity while maintaining the ability to apply sophisticated multi-buffer style transformations.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If multiple style images are used for style transfer, then representational power is increased, but processing time and computational resources increase

Engineering Contradiction:
Improvevariety of style representationVSAvoidprocessing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent allows selective application of style transfer to only certain buffers that benefit most from style transformation, rather than uniformly processing all buffers. This partial action approach enables the use of multiple style images to enhance representational power while reducing overall processing time by focusing computational resources on critical buffers.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12136179B2Style transfer program and style transfer method
Publication Date: 2024.11.05 SQUARE ENIX HLDG CO LTD
  • US12136179B2 patent drawing
  • US12136179B2 patent drawing
  • US12136179B2 patent drawing

AI summary

A style transfer program causes a server to implement an acquisition function of acquiring buffer data from a buffer used for rendering, a style transfer function of applying style transfer based on one or more style images to the buffer data, and an output function of outputting data after the style transfer is applied.