Dynamic Virtual Content Colocation via Persistent Coordinates

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Virtual reality systems face limitations in creating immersive and realistic experiences due to issues like motion sickness, computational burden, and the inability to effectively integrate shared environments, while augmented and mixed reality systems struggle with consistent virtual object placement across multiple user environments.

Innovation Solution

The development of systems and methods for colocating virtual content using persistent coordinate data and relational data from head-wearable devices, allowing virtual objects to be displayed consistently across multiple user environments by determining corresponding coordinate data and adjusting their display accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If virtual reality systems present a full 3D virtual environment to replace the real environment, then immersion and realism are improved, but motion sickness increases and computational burden increases

Engineering Contradiction:
Improveimmersion and realismVSAvoidmotion sickness
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent merges virtual and real environments by allowing users to see both virtual content and real-world surroundings simultaneously through transparent or translucent display components. This hybrid approach maintains immersion in virtual elements while preserving awareness of the physical environment, thereby reducing motion sickness caused by complete environmental replacement.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system dynamically adjusts the degree of virtual environment replacement based on user needs and context. Users can switch between fully immersive virtual modes and augmented modes where real environment is visible, allowing flexible adaptation that reduces motion sickness when complete virtual replacement is not necessary.

Inventive Principle:
Principle #15Dynamics

2Reliability

If virtual reality systems present a full 3D virtual environment, then immersion is improved, but computational burden (storage, processing power) increases

Engineering Contradiction:
ImproveimmersionVSAvoidcomputational burden
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

Instead of rendering complete 3D virtual environments at all times, the system renders only the necessary virtual elements partially or selectively. Virtual content is presented only where needed in the user's field of view, reducing computational load while maintaining sufficient immersion for the specific task at hand.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system uses 2D displays that simulate 3D virtual environments through careful rendering of visual cues, rather than requiring actual 3D hardware. Virtual objects are represented as images that convey three-dimensional information through perspective, shading, and layering techniques, reducing the computational and hardware requirements while maintaining the illusion of immersion.

Inventive Principle:
Principle #26Copying

3Object-affected harmful factors

If augmented reality systems overlay virtual content on the real environment, then motion sickness is reduced, but consistent virtual object placement across multiple users is difficult to achieve

Engineering Contradiction:
Improvemotion sicknessVSAvoidvirtual object placement consistency
Core Design Contradiction:
Object-affected harmful factorsVSManufacturing precision

Solution Approach 1:

The patent introduces a coordinate transformation system that acts as an intermediary between different users' reference frames. Each user has their own head-mounted display with unique positioning and orientation, but the system translates virtual object coordinates into each user's specific reference frame, ensuring consistent placement across all users while allowing for individual device variations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system adds a mathematical transformation dimension to handle the complexity of multi-user coordination. By representing spatial relationships through coordinate transformations that account for each user's head position, orientation, and display characteristics, the system achieves precise virtual object placement consistency across multiple users despite hardware variations.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20240371116A1Dynamic colocation of virtual content
Publication Date: 2024.11.07 MAGIC LEAP INC
  • US20240371116A1 patent drawing
  • US20240371116A1 patent drawing
  • US20240371116A1 patent drawing

AI summary

Disclosed herein are systems and methods for colocating virtual content. A method may include receiving first persistent coordinate data, second persistent coordinate data, and relational data. A third persistent coordinate data and a fourth persistent coordinate data may be determined based on input received via one or more sensors of a head-wearable device. It can be determined whether the first persistent coordinate data corresponds to the third persistent coordinate data. In accordance with a determination that the first persistent coordinate data corresponds to the third persistent coordinate data, it can be determined whether the second persistent coordinate data corresponds to the fourth persistent coordinate data. In accordance with a determination that the second persistent coordinate data corresponds to the fourth persistent coordinate data, a virtual object can be displayed using the relational data and the second persistent coordinate data via a display of the head-wearable device. In accordance with a determination that the second persistent coordinate data does not correspond to the fourth persistent coordinate data, the virtual object can be displayed using the relational data and the first persistent coordinate data via the display of the head-wearable device. In accordance with a determination that the first persistent coordinate data does not correspond to the third persistent coordinate data, the method may forgo displaying the virtual object via the display of the head-wearable device.