Mixed Reality Third-Party Object Environmental Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems for integrating externally-developed content into software applications, particularly in mixed reality (MR) contexts, fail to adapt to the physical environment, resulting in content that is unreflective of reality and disruptive to the user experience.

Innovation Solution

The implementation of a method to display third-party objects in MR applications by selecting and constraining them based on real-world portions of the MR environment, using a remote computing system to receive and select objects that are suitable for the physical environment, allowing for dynamic integration and adaptation of content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If third-party objects are integrated into MR applications without environmental adaptation, then content integration capability is improved, but user experience quality deteriorates due to disruptive and unreflective content

Engineering Contradiction:
Improvecontent integration capabilityVSAvoiduser experience quality
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system changes parameters of third-party objects (position, orientation, scale, appearance) based on sensed environmental data to ensure they are consistent with the physical environment. This allows content integration while maintaining user experience quality through contextual adaptation.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

Third-party objects automatically adapt to the physical environment through sensor-based detection and automated adjustment of their display parameters, eliminating the need for manual configuration and ensuring consistent user experience across different environments.

Inventive Principle:
Principle #25Self-service

2Reliability

If third-party objects are selected based on real-world environmental sensing, then user experience quality is improved, but computational burden on local device increases

Engineering Contradiction:
Improveuser experience qualityVSAvoidcomputational burden
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system uses sensor data as an intermediary to communicate environmental characteristics between the physical world and third-party object selection, enabling context-aware content integration without requiring complex computational analysis at the local device.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs selective environmental sensing and parameter adjustment only for relevant third-party objects based on basic sensor data, rather than comprehensive analysis of all objects, reducing computational burden while maintaining user experience quality.

Inventive Principle:
Principle #16Partial or excessive action

3Adaptability or versatility

If third-party objects are constrained by real-world portions of MR environment, then contextual relevance is improved, but device complexity increases

Engineering Contradiction:
Improvecontextual relevanceVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system applies different constraint parameters to different third-party objects based on their specific relationship to real-world environmental portions, ensuring each object is appropriately adapted to its local context without uniformly complicating the entire system.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10467816B2Mixed reality objects
Publication Date: 2019.11.05 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10467816B2 patent drawing
  • US10467816B2 patent drawing
  • US10467816B2 patent drawing

AI summary

Examples are disclosed herein that relate to mixed reality objects. One example provides a computing device comprising a logic machine and a storage machine holding instructions executable by the logic machine to execute a mixed reality application, the mixed reality application defining a third-party object slot, present a mixed reality environment, and upon detecting a condition associated with the third-p arty object slot, send to a remote computing system a request to fill the third-party object slot, the request based on sensing of a real-world portion of the mixed reality environment with a sensor of the computing device. The instructions are further executable to receive a third-party object from the remote computing system selected by the remote computing system based on the request, and display the third-party object in the third-party object slot such that the third-party object is constrained by a real-world portion of the mixed reality environment.