AI Virtual Object Builder for XR Creation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing XR platforms hinder user engagement and creativity as they require advanced skills and resources to create and populate rich, realistic virtual worlds, limiting participation to only experts, and preventing non-tech-savvy users from customizing their XR experiences.

Innovation Solution

An AI Builder system that interprets user commands through natural language processing and gestural inputs to build or edit virtual objects, using a library of templates, generative adversarial networks, and real-world object importation, allowing users to create complex objects and environments with ease.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional manual methods are used to create complex virtual objects in XR worlds, then the quality and complexity of created objects can be high, but the time and skill requirements increase dramatically

Engineering Contradiction:
Improveobject creation qualityVSAvoidcreation time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent replaces manual mechanical operations with an AI-powered virtual builder that automatically generates 3D models from 2D images. The system uses machine learning algorithms to perform the complex task of converting 2D inputs into 3D outputs, eliminating the need for users to manually manipulate complex modeling tools while maintaining high creation quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an AI virtual builder as an intermediary between the user's 2D image input and the final 3D virtual object. This intermediary automatically performs the complex transformation process, allowing users to create high-quality virtual objects without needing to understand or perform the intermediate steps of 3D modeling.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If expert-level skills are required to create sophisticated virtual objects, then the quality of XR worlds can be high, but user participation and engagement decrease

Engineering Contradiction:
Improveobject creation qualityVSAvoiduser accessibility
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent replaces complex manual 3D modeling operations with an AI system that automatically generates 3D models from simple 2D images. This substitution eliminates the need for users to acquire expert-level skills in 3D modeling software, making high-quality object creation accessible to users with basic digital literacy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent uses 2D images as simplified copies or representations of the desired 3D objects. Instead of requiring users to create complex 3D models from scratch, the system accepts easily obtainable 2D images (such as photos or drawings) and automatically generates the corresponding 3D models, significantly lowering the barrier to entry.

Inventive Principle:
Principle #26Copying

3Manufacturing precision

If manual 3D modeling processes are used, then detailed and realistic virtual objects can be created, but the complexity and resources required increase

Engineering Contradiction:
Improveobject detail qualityVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent replaces complex manual 3D modeling processes with an AI-powered automatic generation system. The AI virtual builder handles the computationally intensive tasks of interpreting 2D images and generating corresponding 3D models, reducing the operational complexity users must manage while maintaining high output quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent segments the object creation process into distinct input and output stages, with the AI system handling the complex intermediate transformation. Users simply provide 2D images as input and receive 3D models as output, without needing to navigate or understand the complex intermediate processing steps.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12254564B2Artificial intelligence-assisted virtual object builder
Publication Date: 2025.03.18 META PLATFORMS INC
  • US12254564B2 patent drawing
  • US12254564B2 patent drawing
  • US12254564B2 patent drawing

AI summary

Aspects of the present disclosure are directed to an artificial intelligence (“AI”) application running in conjunction with an artificial reality (“XR”) space. The AI Builder responds to user commands, verbal or gestural, to build or edit spaces or objects in space. If the requested object is of a type recognized by the AI Builder, then the AI Builder builds the object from one or more stored templates. The new object's location is determined by the objects that already exist in the user's XR environment and on commands or gestures from the user. If the AI Builder does not recognize the requested object, the user can show an image to the AI Builder, and the AI builds a 3D object in the XR space according to that image. To ease collaboration among users, the AI Builder may present its user interface as a non-player character within the XR world.