Smartphone Mode Switching for HMD Relative Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
User operability is insufficient when using a smartphone with a Head-Mounted Display (HMD) due to the need to operate the touch panel while visually recognizing a mirrored image, leading to challenges in accurately receiving inputs in absolute or relative coordinates.
Innovation Solution
An information processing apparatus with a coupling section that switches between absolute and relative coordinate input modes based on its connection to a display device, featuring a mode switching unit, position input unit, and display controller that manages the visibility and luminance of a pointer object and trajectory on the display, allowing inputs to be received in either mode depending on the connection status.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the smartphone displays a mirrored image on HMD and the user operates the touch panel while visually recognizing the mirrored image, then the user can access content on the HMD, but the user operability becomes insufficient due to difficulty in accurately receiving inputs
Solution Approach 1:
The system dynamically switches between absolute coordinate mode and relative coordinate mode based on connection status. When connected to HMD, it uses relative coordinates where touch positions are interpreted as movements from a reference point, making operations intuitive even without visual feedback on the smartphone screen. When disconnected, it switches to absolute coordinates for precise positioning on the visible display.
Solution Approach 2:
The coordinate system parameter changes based on connection state. The mode switching unit changes the coordinate interpretation mode from absolute to relative, and the display controller adjusts pointer visibility and luminance parameters to optimize usability in each scenario.
2Measurement precision
If the smartphone operates in absolute coordinate mode for precise touch input, then input precision is improved, but the usability deteriorates when the user cannot directly view the smartphone display while wearing HMD
Solution Approach 1:
The system dynamically adapts the coordinate mode based on connection status. When connected to HMD, relative coordinate mode is activated where touch inputs are interpreted as movements from a reference point rather than absolute positions, making operations intuitive without requiring visual feedback on the smartphone screen.
Solution Approach 2:
Instead of requiring the user to visually confirm absolute positions on the smartphone screen, the system inverts the approach by using relative movements from a reference point, similar to how traditional remote controls or game controllers work without visual feedback.
3Ease of operation
If the smartphone operates in relative coordinate mode for improved usability without visual feedback, then ease of operation is improved, but input precision for absolute positioning deteriorates
Solution Approach 1:
The system dynamically switches coordinate modes based on connection status. When disconnected from HMD, absolute coordinate mode is activated to restore precise positioning capability when the display is visible and absolute positioning is needed.
4Illumination intensity
If the smartphone maintains high display luminance for visibility, then display visibility is improved, but battery consumption increases
Solution Approach 1:
The display controller dynamically adjusts the luminance of the smartphone display based on connection status. When connected to HMD, the luminance is reduced or the display is turned off since the mirrored image is displayed on the HMD, saving battery power while maintaining visibility through the HMD display.
Data Source
AI summary
The smartphone includes an I/F unit that can be coupled with an HMD, a touch sensor, and a mode switching unit. The mode switching unit is configured to switch, depending on whether the I/F unit is coupled with the HMD, between a first mode in which an input detected by the touch sensor is received as an input in an absolute coordinate, and a second mode in which an input detected by the touch sensor is received as an input in a relative coordinate, to execute the first mode or the second mode.