Unified Virtual Space Interface for Multi-User XR Content Creation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Constructing XR/VR/AR applications is challenging for end-users, requiring single-user processes with editors like Unity3D, which separates edit, compile, and runtime phases, limiting natural multi-user interaction.

Innovation Solution

The ConstructiveLabs system allows users to edit and create content directly within a virtual space using a unified interface that enables direct manipulation of state through message passing between objects, eliminating the need for separate edit and compile phases, and facilitates multi-user collaboration by generating selection and tool palette virtual objects responsive to user gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a single-user editor application like Unity3D is used with separate edit, compile, and runtime phases, then the application can be constructed with proper compilation and execution separation, but multi-user collaboration and natural interaction are limited

Engineering Contradiction:
Improvemulti-user collaboration capabilityVSAvoidseparate editor and compile phases
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges the editor application and runtime execution into a unified virtual space environment where editing, compilation, and execution occur simultaneously. Multiple users can interact with and modify the virtual space in real-time without requiring separate development and runtime environments, thus enabling multi-user collaboration while eliminating the need for distinct compile phases.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The virtual space serves multiple functions simultaneously: it acts as both the development environment and the runtime execution environment. Users can create, edit, and interact with virtual objects within the same persistent space, making the system universal for both development and operation without requiring separate toolchains.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If traditional editor applications with compile phases are used, then proper software development lifecycle is maintained, but user interaction becomes less natural and more constrained

Engineering Contradiction:
Improvenatural user interactionVSAvoidcompile time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system enables continuous editing and interaction within the virtual space without interrupting the workflow for compilation steps. Users can continuously modify objects, add new elements, and interact with the environment in real-time, maintaining a continuous creative process rather than alternating between edit and compile phases.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The virtual space and its objects are pre-configured to support direct manipulation and interaction from the outset. The environment is designed to be immediately editable and interactive, eliminating the need for preliminary compilation steps before users can begin natural interaction with the content.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If separate edit and compile phases are required, then software reliability is improved through proper build processes, but productivity and collaboration efficiency decrease

Engineering Contradiction:
Improvecontent creation speedVSAvoidsoftware build process
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system dynamically adapts the development process by allowing incremental changes and real-time updates within the virtual space. The environment supports dynamic modification of objects and scenes without requiring complete recompilation, enabling faster iteration and content creation while maintaining system stability through controlled updates.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12130999B2User interface for multi-user application with human interface devices
Publication Date: 2024.10.29 ROBERTS MICHAEL MR
  • US12130999B2 patent drawing
  • US12130999B2 patent drawing
  • US12130999B2 patent drawing

AI summary

A method of editing and creating content of a virtual space maintained within a virtual space hosting system is provided. The virtual space hosting system includes a plurality of user devices each of which is connected to one or more human interface devices for displaying the virtual world to a respective user and allowing user gestures by the user to be detected. The method comprises: generating a selection virtual object and, in response to detected user gestures, selecting a virtual object within the virtual space and consequently generating a tool palette virtual object, and, in response to detection of palette interaction gestures from the user, changing the tool palette representation and/or the selected object.