AI Builder for XR Virtual Object Creation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing XR platforms limit user engagement by requiring technical expertise to create and populate rich, realistic artificial worlds, making it inaccessible to non-tech-savvy users.

Innovation Solution

The AI Builder system allows users to create and edit virtual objects in XR environments using verbal and gestural commands, leveraging natural-language processing and generative adversarial networks to interpret user inputs and build objects from templates, descriptions, or real-world imports.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional manual creation methods are used in XR platforms, then manufacturing precision and reliability of virtual objects are improved, but device complexity and ease of operation deteriorate, requiring expert-level skills

Engineering Contradiction:
Improvevirtual object creation qualityVSAvoiduser accessibility
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

An AI assistant serves as an intermediary between the user and the complex XR creation tools. The AI interprets natural language commands and translates them into precise virtual object creation instructions, bridging the gap between simple user input and complex system operations. This mediator handles the technical complexity while maintaining ease of use for end users.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces manual mechanical interaction with XR creation tools (drag-and-drop interfaces, parameter adjustment controls, and complex menus) with voice-based natural language processing. This substitution eliminates the need for users to navigate complex graphical interfaces and instead uses speech recognition and AI interpretation to achieve the same creation goals with simpler input methods.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If expert-level manual creation is used to build complex virtual worlds, then manufacturing precision is improved, but loss of time increases significantly

Engineering Contradiction:
Improvevirtual world creation qualityVSAvoidcreation time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-processing and pre-structuring virtual object data before final placement. The AI assistant prepares object configurations, relationships, and environmental integrations in advance based on high-level user descriptions, so that when objects are created, they are already optimized and ready for immediate use without requiring iterative manual adjustments.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent transforms the creation process from manual parameter-by-parameter adjustment to AI-driven parameter optimization. The system automatically determines optimal parameters for virtual objects based on natural language context, spatial relationships, and design principles, converting a time-consuming manual tuning process into an automated parameter generation process that maintains high precision while reducing time investment.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If simple object creation interfaces are provided, then ease of operation is improved, but manufacturing precision and reliability deteriorate, limiting objects to simple geometries

Engineering Contradiction:
Improveinterface simplicityVSAvoidvirtual object complexity
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The creation process is segmented into distinct phases: natural language interpretation, object specification extraction, geometric parameter generation, and environmental integration. Each phase handles specific aspects of complexity independently, allowing the interface to remain simple while the backend processes progressively build sophisticated virtual objects through structured decomposition of the creation task.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20250139891A1Artificial Intelligence-Assisted Virtual Object Builder
Publication Date: 2025.05.01 META PLATFORMS INC
  • US20250139891A1 patent drawing
  • US20250139891A1 patent drawing
  • US20250139891A1 patent drawing

AI summary

Aspects of the present disclosure are directed to an artificial intelligence (“AI”) application running in conjunction with an artificial reality (“XR”) space. The AI Builder responds to user commands, verbal or gestural, to build or edit spaces or objects in space. If the requested object is of a type recognized by the AI Builder, then the AI Builder builds the object from one or more stored templates. The new object's location is determined by the objects that already exist in the user's XR environment and on commands or gestures from the user. If the AI Builder does not recognize the requested object, the user can show an image to the AI Builder, and the AI builds a 3D object in the XR space according to that image. To ease collaboration among users, the AI Builder may present its user interface as a non-player character within the XR world.