3D Game Item Generation Using NeRF and CLIP Personalization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Creating characters and their accoutrements for computer simulations such as computer games is time-consuming.

Innovation Solution

A system utilizing a neural radiance field (NeRF) and a Contrastive Language-Image Pre-training (CLIP) model to generate hyper-personalized game items from text input, enabling rapid creation of virtual character accoutrements in under two minutes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional methods are used to create characters and accoutrements for computer simulations, then the quality and detail of the characters can be maintained, but the process becomes time-consuming

Engineering Contradiction:

Improvecharacter creation speedVSAvoidtime to create characters and accoutrements

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical modeling processes with automated neural radiance field (NeRF) generation from images. The system automatically converts 2D images into 3D character models and accoutrements using machine learning algorithms, eliminating the need for time-consuming manual 3D modeling while maintaining high quality results

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates accurate 3D copies of characters and accoutrements from 2D images. By capturing images from multiple angles and using NeRF technology, the system generates precise three-dimensional representations that can be directly used in computer simulations, drastically reducing creation time while preserving detail

Inventive Principle:

Principle #26Copying

2Ease of manufacture

If manual modeling techniques are used, then control over character details is maintained, but the complexity and time required increase significantly

Engineering Contradiction:

Improveease of character creationVSAvoidcomplexity of character creation system

Core Design Contradiction:

Ease of manufactureVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary automated system that acts as a bridge between simple image input and complex 3D character output. The NeRF-based system serves as this intermediary, automatically handling the complex transformations from 2D images to 3D models, thereby simplifying the user's task while managing the underlying complexity

Inventive Principle:

Principle #24Intermediary (Mediator)

3Adaptability or versatility

If custom character creation is enabled, then player personalization is improved, but the processing time and computational resources increase

Engineering Contradiction:

Improvecharacter personalization capabilityVSAvoidtime to generate personalized characters

Core Design Contradiction:

Adaptability or versatilityVSDuration of action of moving object

Solution Approach 1:

The system performs preliminary actions by pre-processing images and pre-generating base NeRF models before the actual character customization is needed. By having the computational framework ready and pre-processed, the system can rapidly generate personalized characters when requested, reducing the perceived processing time for end users

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS20260000992A1Hyper-personalized game items

Publication Date: 2026.01.01 SONY INTERACTIVE ENTERTAINMENT LLC

AI summary

Two dimensional images are converted to a 3D neural radiance field (NeRF), which is modified based on text personalized to a player and input to resemble the accoutrement for a character demanded by the text. A model scores how well an image matches a line of text to produce a final 3D NeRF, which may be converted to a polygonal mesh and imported into a computer simulation such as a computer game.