Virtual Mobile Infrastructure Orientation Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing virtual mobile infrastructure systems face challenges in synchronizing orientation changes between client and remote devices, leading to a degraded user experience due to differences in local and remote UI orientations, especially on mobile devices that can rotate their screens.

Innovation Solution

A system and method that involves a client application on a mobile device registering device orientation changes and sending orientation event messages to a server, which generates synthetic accelerometer signals to update the remote UI orientation, ensuring the local UI is synchronized with the remote UI by transforming the display stream accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the local UI orientation is changed to match the remote UI orientation, then the user experience is improved, but additional network traffic is generated for communicating orientation changes

Engineering Contradiction:
Improveuser experienceVSAvoidnetwork traffic
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential orientation information (orientation type and transformation matrix) from the complete display stream, sending only these critical parameters over the network rather than the entire video feed. This selective extraction minimizes network traffic while maintaining the ability to synchronize UI orientations effectively.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system implements partial action by sending orientation change notifications only when actual orientation changes occur, rather than continuously streaming orientation data. This event-driven approach reduces network traffic to the minimum necessary while still achieving complete UI synchronization when needed.

Inventive Principle:
Principle #16Partial or excessive action

2Ease of operation

If orientation synchronization is implemented, then the user experience is improved, but the system complexity increases

Engineering Contradiction:
Improveuser experienceVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary orientation synchronization module that acts as a mediator between the local UI system and remote UI system. This module receives display streams, extracts orientation information, applies transformation matrices, and adjusts the local UI accordingly, centralizing the complexity in a dedicated component rather than distributing it throughout the entire system.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system uses parameter changes by representing orientation states through discrete parameters (orientation types and transformation matrices) rather than complex geometric calculations. This parameterization simplifies the synchronization logic by reducing continuous orientation data to manageable discrete states that can be easily compared and applied.

Inventive Principle:
Principle #35Parameter changes

3Stability of the object's composition

If the display stream is transformed to compensate for orientation changes, then the UI alignment is improved, but the processing time increases

Engineering Contradiction:
ImproveUI alignmentVSAvoidprocessing time
Core Design Contradiction:
Stability of the object's compositionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing transformation matrices for common orientation changes. When an orientation change is detected, the system retrieves the pre-computed transformation matrix and applies it immediately, rather than calculating the transformation in real-time during the orientation change event, thus reducing processing delay.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11416969B2System, method and computer program product for remoting orientation changes
Publication Date: 2022.08.16 HYPORI INC
  • US11416969B2 patent drawing
  • US11416969B2 patent drawing
  • US11416969B2 patent drawing

AI summary

A mobile device comprising a client application configured to receive a display stream for a virtual display of a virtual device, render a remote display in a local system user interface (UI), register a device orientation change of the mobile device, send an orientation change event message to the server, change the local system UI orientation to match the new orientation of the remote system UI based on receipt of a UI orientation signal that indicates a new orientation of the remote system UI of the virtual device, transform the display stream to compensate for changing the local system UI orientation to match the new orientation of the remote system UI and render the remote display from the transformed display stream.