HMD Virtual Screen Orientation Control for Mobile Terminals

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for displaying a mobile terminal screen on a Head Mounted Display (HMD) do not adequately account for the orientation of the mobile terminal, leading to suboptimal user experience.

Innovation Solution

An information processing apparatus that determines the display orientation of a virtual screen on the HMD based on the orientation of the mobile terminal, whether in portrait, landscape, or flat states, using a coordinate system and orientation information to ensure alignment with the mobile terminal's state.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the mobile terminal screen is displayed on the HMD without considering orientation, then the display function is achieved, but the usability and user experience deteriorate due to misalignment with the mobile terminal's actual orientation

Engineering Contradiction:
ImproveusabilityVSAvoiddisplay control complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system continuously monitors the mobile terminal's orientation state and uses this feedback to dynamically adjust the virtual screen's display orientation on the HMD. This ensures the displayed content always aligns with the actual physical orientation of the mobile terminal, improving usability without requiring complex manual configuration.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The display orientation of the virtual screen is made dynamic rather than static. The system automatically adapts the virtual screen's orientation based on real-time detection of the mobile terminal's state, allowing the display to flexibly respond to changes in orientation without requiring system redesign or complex control mechanisms.

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If the virtual screen orientation is fixed regardless of mobile terminal state, then the display system is simple, but the adaptability to different usage scenarios deteriorates

Engineering Contradiction:
Improveorientation adaptabilityVSAvoidorientation detection and control
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs self-service by automatically detecting the mobile terminal's orientation state and autonomously adjusting the virtual screen's display orientation accordingly. This eliminates the need for manual user intervention or complex configuration interfaces, achieving high adaptability through automated self-adjustment mechanisms.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The display control system is designed to handle multiple orientation states (portrait, landscape, and various intermediate angles) through a unified detection and control mechanism. This universal approach allows the system to adapt to different usage scenarios without requiring separate control logic for each orientation, maintaining simplicity while achieving versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250239236A1Information processing apparatus for controlling image display, information processing system, storage medium storing information processing program, and information processing method
Publication Date: 2025.07.24 CANON KK
  • US20250239236A1 patent drawing
  • US20250239236A1 patent drawing
  • US20250239236A1 patent drawing

AI summary

An information processing apparatus, includes a processor, and a memory storing a program which, when executed by the processor, causes the information processing apparatus to perform image acquisition processing for acquiring a captured image, and perform display control processing for displaying, on a display, a composite image obtained by the captured image and a virtual screen being composited, wherein, in the display control processing, control is performed so that in a case where a mobile terminal is in a portrait state when viewed from a user, the virtual screen is displayed in the portrait state on the display, and that in a case where the mobile terminal is in a landscape state when viewed from the user, the virtual screen is displayed in the landscape state on the display.