Mixed Reality View Manipulation via Gesture Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing networked meeting technologies that implement mixed reality do not allow remote participants to modify or change their view or perspective within the mixed reality environment, providing a synchronized but non-realistic representation of participant interaction.

Innovation Solution

Participants can interact with data processing devices to alter their view or perspective in the mixed reality environment using gestures and movements, allowing changes such as zooming, panning, rotating, and moving their representation within the environment, which is then reflected in real-time to other participants.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If the host controls and synchronizes the participant's view to maintain a unified mixed reality environment, then the environment consistency is improved, but the participant interaction realism deteriorates

Engineering Contradiction:
Improveenvironment consistencyVSAvoidparticipant interaction realism
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by enabling the participant's view to be dynamically adjustable rather than fixed. The system allows the participant to independently control their viewpoint, camera angle, and perspective in the mixed reality environment, transforming a static synchronized view into a dynamic, user-controlled view that adapts to individual interaction needs while maintaining overall environment consistency.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent segments the view control function from the host's centralized control. Instead of a single unified view controlled by the host, the system divides view control into individual participant perspectives, allowing each participant to have independent view adjustment capabilities while still being part of the same shared mixed reality environment.

Inventive Principle:
Principle #1Segmentation

2Device complexity

If the participant's view is synchronized to the host's perspective, then the system complexity is reduced, but the ease of operation for individual participants deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidparticipant view control
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent implements self-service by enabling participants to independently control their own views without requiring host intervention or complex system coordination. Each participant can directly manipulate their camera, perspective, and viewpoint through intuitive interfaces on their personal devices, making the system easier to operate for individuals while distributing the complexity across multiple independent client devices rather than centralized server control.

Inventive Principle:
Principle #25Self-service

3Manufacturing precision

If the mixed reality environment provides a fixed representation of participants, then the manufacturing precision of the environment is improved, but the adaptability to individual participant needs deteriorates

Engineering Contradiction:
Improveenvironment representation accuracyVSAvoidview customization
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies parameter changes by allowing dynamic modification of view parameters such as camera position, angle, zoom level, and perspective projection. Instead of a fixed environmental representation, the system enables participants to adjust these parameters in real-time to customize their viewing experience according to individual needs while maintaining consistent environmental rendering for all participants.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10891014B2Remote view manipulation in communication session
Publication Date: 2021.01.12 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10891014B2 patent drawing
  • US10891014B2 patent drawing
  • US10891014B2 patent drawing

AI summary

Disclosed techniques enable participants of a communication session that is rendered within a mixed reality environment to change their view or perspective in the mixed reality environment. The participants may alter their view or perspective in the mixed reality environment using a data processing device displaying the communication session. The participant may interact with a data processing device displaying the communication session to cause the change in their view or perspective in the mixed reality environment. The participant interaction may include user touch and/or gestures with an associated data processing device to cause the change in the participant's view or perspective in the mixed reality environment. The participant may use a plurality of fingers on a display of the data processing device to zoom, pan or rotate their view or perspective in the mixed reality environment. Also, the participant may move the data processing device to cause their view or perspective in the mixed reality environment to change.