Mixed Reality Display for Collaborative Virtual Object Manipulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality systems often fail to effectively integrate virtual imagery with the real world environment, and existing collaboration systems lack the ability to provide a mixed virtual and real-world experience for users, limiting interactive and shared information manipulation.

Innovation Solution

A see-through, near-eye, mixed reality display device that uses sensors to determine the 3D location, orientation, and gaze of users, allowing for the creation of a collaborative environment where virtual representations of shared data can be manipulated and viewed by multiple users, with varying permission levels and biometric authentication.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If augmented reality systems present virtual images before the user's eyes, then virtual imagery can be integrated with the real world environment, but the user cannot see beyond the virtual images presented

Engineering Contradiction:
Improveintegration of virtual and real worldVSAvoidblockage of real world view
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The display device presents virtual images at specific locations in the user's field of view while maintaining transparency or see-through capabilities in other areas, allowing selective integration of virtual content without completely blocking the real world environment. This enables local enhancement of reality rather than total replacement.

Inventive Principle:
Principle #3Local quality

2Ease of operation

If collaboration systems allow users to share and manipulate information, then interactive collaboration is enabled, but the systems lack mixed virtual and real-world experience capabilities

Engineering Contradiction:
Improveinformation sharing and manipulationVSAvoidmixed virtual and real-world experience
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system merges traditional collaboration system functionality (information sharing, manipulation, and interaction) with augmented reality capabilities, creating a unified platform where virtual collaborative objects can be manipulated in the real world environment. This integration allows users to interact with shared information both virtually and physically simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If multiple users are included in the collaboration environment with different permission levels, then security and access control are improved, but system complexity increases

Engineering Contradiction:
Improvesecurity and access controlVSAvoiduser management and permissions
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The collaboration system automatically manages user permissions, access levels, and environmental definitions without requiring manual configuration for each user interaction. The system self-adjusts based on user identities and predefined collaboration parameters, reducing the operational complexity of managing multiple users with different access levels.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9122321B2Collaboration environment using see through displays
Publication Date: 2015.09.01 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9122321B2 patent drawing
  • US9122321B2 patent drawing
  • US9122321B2 patent drawing

AI summary

A see-through, near-eye, mixed reality display device and system for collaboration amongst various users of other such devices and personal audio/visual devices of more limited capabilities. One or more wearers of a see through head mounted display apparatus define a collaboration environment. For the collaboration environment, a selection of collaboration data and the scope of the environment are determined. Virtual representations of the collaboration data in the field of view of the wearer, and other device users are rendered. Persons in the wearer's field of view to be included in collaboration environment and who are entitled to share information in the collaboration environment are defined by the wearer. If allowed, input from other users in the collaboration environment on the virtual object may be received and allowed to manipulate a change in the virtual object.