Mixed Reality Object Interaction Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Mixed reality systems lack the ability to effectively manage interactions between virtual and real objects within the same environment, failing to reconcile and present a cohesive view of both elements beyond superimposed virtual images.

Innovation Solution

A see-through mixed reality display device that uses a common object definition with a set of attributes to create individual instances of both real and virtual objects, allowing the system to manage relationships and interactions between them, with features like gaze detection and adjustable inter-pupillary distance alignment for optimal user viewing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual images are superimposed onto real world environments using positioning data, then virtual imagery can be displayed in the real world, but the system cannot reconcile or manage interactions between virtual objects and real objects

Engineering Contradiction:
Improveinteraction management capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments objects into distinct virtual and real categories with separate tracking and rendering pipelines, while using a common attribute definition system to enable controlled interactions between them. This segmentation allows independent management of each object type while maintaining the ability to reconcile their interactions through shared attribute schemas.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If a common object definition with common set of attributes is used for both real and virtual objects, then the system can manage relationships and interactions between them, but the device complexity increases

Engineering Contradiction:
Improveobject interaction managementVSAvoidsystem architecture complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies universality by creating a common object definition framework that serves multiple functions: it defines both virtual and real objects, manages their individual attributes, and enables interaction management between them. This multi-functional attribute system reduces the need for separate management mechanisms for different object types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If gaze detection and adjustable inter-pupillary distance alignment are implemented, then accurate alignment and immersive viewing are achieved, but the device complexity and manufacturing difficulty increase

Engineering Contradiction:
Improvealignment accuracyVSAvoiddevice manufacturing difficulty
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The system performs preliminary gaze detection and inter-pupillary distance measurement before rendering virtual content, allowing the display to pre-align virtual objects with the user's actual gaze direction. This preliminary measurement and adjustment enables accurate alignment without requiring complex real-time mechanical adjustment mechanisms during content delivery.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9767720B2Object-centric mixed reality space
Publication Date: 2017.09.19 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9767720B2 patent drawing
  • US9767720B2 patent drawing
  • US9767720B2 patent drawing

AI summary

A see-through, near-eye, mixed reality display apparatus providing a mixed reality environment wherein one or more virtual objects and one or more real objects exist within the view of the device. Each of the real and virtual have a commonly defined set of attributes understood by the mixed reality system allowing the system to manage relationships and interaction between virtual objects and other virtual objects, and virtual and real objects.