Digital Project File Presentation with Mixed Reality Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The presentation of mixed reality project files across different devices and physical environments poses challenges, as annotations may become unclear due to changes in the physical environment, and virtual reality displays often block the physical environment from view.

Innovation Solution

A digital project file is created with a geometric representation of a real physical space and user-created annotations, allowing for display in different rendering formats, where real surfaces can be rendered as virtual in one format but not in another, enabling consistent spatial and contextual association across various devices and environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If mixed reality project files are displayed in different physical environments, then the physical environment context is preserved, but the annotation clarity deteriorates due to environmental changes

Engineering Contradiction:
Improvedisplay adaptability across different physical environmentsVSAvoidannotation clarity
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent creates a virtual copy of the real physical space as a geometric representation, allowing the annotation to be displayed in multiple physical environments without losing its original contextual meaning. The geometric representation serves as a portable copy that preserves spatial relationships and annotation clarity regardless of the actual physical environment.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transitions from displaying annotations directly in the physical environment to representing the physical space as a virtual geometric model. This dimensional transformation allows the annotation to maintain its spatial context while being adaptable to different physical environments, resolving the contradiction between environmental adaptability and annotation clarity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If virtual reality displays are used to block the physical environment, then immersive virtual experience is achieved, but the physical environment context is lost

Engineering Contradiction:
Improveimmersive virtual experienceVSAvoidphysical environment context
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The geometric representation of physical space serves multiple functions: it can be displayed in virtual reality mode for immersive experience, in mixed reality mode to preserve physical context, or in various other rendering formats. This multi-functionality allows the same data structure to adapt to different display requirements, resolving the contradiction between immersive experience and physical context preservation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically adjusts the rendering format based on the display device and user requirements. The geometric representation can be rendered as fully virtual, partially virtual (mixed reality), or in other formats, allowing the system to adapt between immersive virtual experience and physical environment context preservation as needed.

Inventive Principle:
Principle #15Dynamics

3Ease of manufacture

If real surfaces are displayed as virtual renderings, then virtual rendering capability is improved, but the connection to real physical space is weakened

Engineering Contradiction:
Improvevirtual rendering capabilityVSAvoidspatial association with real space
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The system performs preliminary action by capturing and storing the geometric representation of the physical space along with spatial metadata before the actual display. This pre-computed geometric model includes information about the spatial relationships between objects and surfaces, ensuring that when the virtual rendering is displayed, the spatial association with the real physical space is maintained through accurate positional and orientational data.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10553031B2Digital project file presentation
Publication Date: 2020.02.04 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10553031B2 patent drawing
  • US10553031B2 patent drawing
  • US10553031B2 patent drawing

AI summary

Examples are disclosed that relate to representing a digital project file. One example provides a computing device comprising a logic device and a storage device holding instructions executable to obtain a digital project file comprising a geometric representation of a real physical space, and a user-created annotation associated with a location in the representation. The instructions are further executable to display a representation of the file in a first rendering format, receive a request to display a representation of the file in a second rendering format in which one or more real surfaces of the real physical space are displayed as a virtual rendering, the one or more real surfaces not being displayed as the virtual rendering the first digital rendering format, and, in response to the request, display the representation of the file in the second format.