Hologram Positioning via Camera Mediator in Extended Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing extended reality (ER) systems face challenges in providing intuitive and efficient interaction methods with holograms across different immersive platforms, particularly between 3D and 2D environments, leading to varying levels of complexity and user experience.

Innovation Solution

A computer system and method that allows holograms to be moved from one location to another within an ER scene by defining a triggering action, enabling progressive movement and concurrent scene panning, ensuring the hologram remains visible and interactable across different immersive platforms, including VR, AR, and MR systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If holograms are moved to locations outside the current perspective view in 2D ER platforms, then the hologram can be positioned at the desired destination, but the user loses visibility of the hologram during movement

Engineering Contradiction:
Improvehologram positioning capabilityVSAvoidvisibility of hologram during movement
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent introduces a camera as an intermediary device that captures and displays the hologram's movement in real-time. The camera view acts as a mediator between the hologram movement and user observation, allowing users to see the hologram being moved to locations outside the original perspective view without breaking immersion or requiring platform-specific interactions

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If different interaction methods are used for 2D and 3D ER platforms, then each platform can optimize its user experience, but the system complexity increases and consistency across platforms deteriorates

Engineering Contradiction:
Improveplatform-specific optimizationVSAvoidinteraction method diversity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements a universal camera-based interaction model that works across both 2D and 3D ER platforms. Instead of creating separate interaction paradigms for each platform type, the system uses camera views as a common interface that adapts to different platform capabilities, allowing the same fundamental interaction pattern (selecting camera view → moving hologram) to function consistently across VR headsets, AR glasses, and 2D display devices

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Rather than having the hologram directly respond to platform-specific gestures or commands, the patent inverts the approach by using camera views as the primary interface. The user selects a camera view, and the system automatically handles the hologram movement logic, reversing the traditional model where the hologram would directly respond to user input based on platform capabilities

Inventive Principle:
Principle #13The other way round (Inversion)

3Manufacturing precision

If manual dragging and dropping is used to move holograms in 2D ER platforms, then precise positioning is achieved, but the interaction complexity and time required increase significantly

Engineering Contradiction:
Improvehologram positioning precisionVSAvoidtime to move hologram
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by allowing users to select a destination camera view before the hologram actually moves. The system prepares the movement path and calculates the destination based on the selected camera's position and orientation, enabling the hologram to be transported directly to the correct location without requiring incremental manual adjustments or dragging operations

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240338105A1Extended reality service that customizes actions based on immersive platform types
Publication Date: 2024.10.10 HEIZENRADER LLC
  • US20240338105A1 patent drawing
  • US20240338105A1 patent drawing
  • US20240338105A1 patent drawing

AI summary

Techniques for enabling an action to be performed with respect to a hologram that is displayed in a scene are disclosed. A location for a hologram is defined. Defining the location includes defining a triggering action that, when detected, causes the hologram to progressively move from whatever location the hologram is located at a time when the triggering action is detected to the defined location. In response to detection of the triggering action, the hologram progressively moves to the second location.