Dynamic Coordinate Axis Adjustment for HMD Mirroring
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display systems for mobile terminal devices, such as smartphones, face operability issues due to fixed coordinate axes on touch panels, which can hinder user interaction when mirroring images on head-mounted displays (HMDs).
Innovation Solution
A display system that includes a head-mounted display (HMD) and a coupled information processing device with sensors like acceleration, gyro, and geomagnetic sensors to detect orientations and adjust coordinate axes, allowing for mode switching between absolute and relative input modes based on the HMD's connection and user's visual field.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the coordinate axis orientation on the touch panel is fixed, then the device structure is simple, but the operability for the user is insufficient
Solution Approach 1:
The coordinate axis orientation is changed from fixed to dynamic, allowing automatic adjustment based on the HMD's wearing orientation. Sensors detect the device orientation and the system automatically rotates the coordinate axes to maintain proper touch input alignment, resolving the contradiction between operational ease and structural simplicity.
Solution Approach 2:
The system performs self-adjustment of coordinate axes without requiring manual user intervention. The automatic orientation detection and coordinate transformation occur autonomously based on sensor data, improving operability while avoiding complex manual adjustment mechanisms.
2Ease of operation
If the coordinate axis is adjusted based on sensor detection, then the operability is improved, but the device complexity increases
Solution Approach 1:
Existing sensors in the mobile device (accelerometer, gyro, magnetometer) are repurposed for coordinate axis orientation detection. These sensors originally serve other functions but are now also used to determine device orientation for touch input correction, avoiding additional hardware complexity while improving operability.
Solution Approach 2:
The system changes the orientation parameters of the coordinate axes based on sensor data rather than adding physical adjustment mechanisms. This software-based parameter transformation achieves accurate touch input alignment without increasing hardware complexity.
3Adaptability or versatility
If mode switching between absolute and relative coordinates is implemented, then the adaptability is improved, but the control complexity increases
Solution Approach 1:
The system pre-configures two coordinate input modes (absolute and relative) and automatically selects the appropriate mode based on the HMD connection state. This preliminary preparation of multiple modes enables adaptability without requiring complex real-time decision-making control.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Improves user operability by dynamically adjusting coordinate axes and switching input modes, enhancing interaction with the touch panel when the HMD is in use, thereby improving the mirroring experience.
Implementation Method 1
a first sensor for detecting an orientation of the position input unit
Implementation Method 2
a first sensor for detecting an orientation of the position input unit
Implementation Method 3
a first sensor for detecting an orientation of the position input unit
Implementation Method 4
a third sensor for detecting a position of the information processing device
Data Source
AI summary
A display system includes an HMD mounted on a head of a user, and a smartphone to which the HMD is coupled, and the smartphone includes a touch sensor that accepts a position input operation and detects coordinates of an operating position with reference to set coordinate axes, a magnetic sensor that detects an orientation of the touch sensor, and an adjustment unit that adjusts an orientation of the coordinate axes, based on a detection result of the magnetic sensor.