Holographic Object Rendering via Physical Relationship Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mixed reality technologies face limitations in interactive functionality between virtual and real-world objects, particularly in simulating realistic physical interactions within mixed reality environments.

Innovation Solution

A computer system and method that identifies and modifies holographic objects based on physical relationships with real-world objects, including properties and movements, to enhance user interaction and realism by dynamically reconfiguring holographic objects' audiovisual characteristics and behaviors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If holographic objects are displayed in mixed reality environments, then visual information and spatial presence are improved, but interactive functionality and physical realism deteriorate

Engineering Contradiction:
Improvevisual informationVSAvoidinteractive functionality
Core Design Contradiction:
Illumination intensityVSAdaptability or versatility

Solution Approach 1:

The system implements feedback by detecting physical objects in the real world and using that information to dynamically modify holographic objects. Sensors capture real-world object properties (position, orientation, physical characteristics) and feed this data back to the holographic rendering system, which adjusts the virtual objects' behavior, appearance, and interactions accordingly. This closed-loop feedback mechanism enables realistic physical interactions between holographic and real objects, resolving the contradiction between visual display quality and interactive functionality.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces intermediary components including physical sensors, processing systems, and rendering engines that mediate between the real physical world and the virtual holographic world. These intermediaries translate physical object properties into corresponding holographic properties, enabling realistic interactions without direct contact between virtual and physical objects. The intermediary system bridges the gap by converting real-world physical data into virtual reality interactions, thereby enhancing interactive functionality while maintaining visual fidelity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If holographic objects are made more interactive with real-world objects, then user engagement and realism improve, but system complexity and computational requirements worsen

Engineering Contradiction:
Improveinteractive functionalityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the complex interaction task into distinct functional modules: physical object detection sensors, data processing units, holographic rendering engines, and interaction management systems. Each module handles a specific aspect of the interaction, from detecting real-world objects to rendering appropriate holographic responses. This segmentation reduces overall system complexity by distributing computational loads and enabling independent optimization of each component, while still achieving comprehensive interactive functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements universal interaction mechanisms that can handle multiple types of objects and interactions through a single integrated system. The holographic system uses general-purpose detection algorithms and rendering techniques that work across diverse object types (physical objects, virtual objects, mixed reality elements). This multi-functionality reduces system complexity by avoiding the need for separate specialized systems for each interaction type, while maintaining high adaptive capability across different scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3475841B1Relational rendering of holographic objects
Publication Date: 2021.05.26 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP3475841B1 patent drawingFigure 1
  • EP3475841B1 patent drawingFigure 2
  • EP3475841B1 patent drawingFigure 3

AI summary

Computer systems, methods, and storage media for rendering a holographic object in accordance with a physical relationship between the holographic object and an identified physical object. Virtual properties are assigned to a physical object, and in response to detecting a change to the physical relationship between the holographic object and the physical object, the holographic object is rendered according to a modification defined, at least in part, by the change to the physical relationship and by the properties assigned to the physical object.