Reinforcement Learning Agent for Virtual Environment Vertex Culling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for optimizing virtual environment content generation are inefficient, particularly in reducing processing power requirements for immersive VR content, as they often rely on labor-intensive and limited optimization techniques such as brute force vertex culling, which are not suitable for widespread application.

Innovation Solution

A machine learning-based approach using a reinforcement learning agent is employed to efficiently cull vertices in virtual environments by training the agent to navigate and identify geometry, optimizing the content representation by reducing unnecessary data and improving rendering speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional brute force optimization methods are used to cull vertices in virtual environments, then some optimization is achieved, but the process becomes labor-intensive and time-consuming with limited optimization results

Engineering Contradiction:
Improveoptimization efficiencyVSAvoidtime-consuming process
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent replaces traditional mechanical brute force optimization methods with a machine learning-based system. A trained machine learning model automatically analyzes virtual environment data, identifies visible geometry, and determines which vertices to cull, substituting manual or simple algorithmic approaches with an intelligent system that learns from training data to make optimization decisions efficiently

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The machine learning model performs self-service by autonomously navigating the virtual environment, identifying visible geometry, and determining culling decisions without human intervention. The system trains on virtual environment data and then independently applies this knowledge to optimize content generation, making the optimization process self-sufficient and automated

Inventive Principle:
Principle #25Self-service

2Manufacturing precision

If high-quality immersive VR content is generated with detailed geometry, then content quality is improved, but processing power requirements increase significantly

Engineering Contradiction:
Improvecontent qualityVSAvoidprocessing power requirements
Core Design Contradiction:
Manufacturing precisionVSPower

Solution Approach 1:

The patent extracts and removes unnecessary geometry from virtual environments by using a machine learning model to identify visible geometry and cull invisible vertices. This extraction process removes redundant data that does not contribute to visual quality, thereby reducing processing power requirements while maintaining the quality of visible content

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies local quality optimization by maintaining high geometric detail only in regions visible to the camera while reducing or removing detail in invisible regions. The machine learning model determines visibility on a local basis for different parts of the virtual environment, allowing high-quality representation where needed and efficient culling where not needed

Inventive Principle:
Principle #3Local quality

3Reliability

If comprehensive geometry is retained in virtual environments to ensure all objects are visible, then content completeness is maintained, but data size and processing requirements increase

Engineering Contradiction:
Improvecontent completenessVSAvoiddata size
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent uses feedback mechanisms where the machine learning model is trained on virtual environment data including camera positions and visible geometry. The model learns from this feedback what geometry is actually visible and uses this knowledge to make accurate culling decisions, ensuring that visible geometry is preserved while invisible geometry is removed

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12033284B2System, method and storage medium for identification of one or more aspects of a virtual environment
Publication Date: 2024.07.09 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12033284B2 patent drawing
  • US12033284B2 patent drawing
  • US12033284B2 patent drawing

AI summary

A system for improving a discovery process for a virtual environment, the system comprising an environment discovery unit operable to perform a discovery process comprising navigation of the virtual environment and identification of one or more aspects of the virtual environment, a performance analysis unit operable to evaluate the effectiveness of the discovery process, and a discovery update unit operable to modify future operation of the environment discovery unit in dependence upon the evaluation.