HMD Virtual Image Control via Linked Secondary Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of head-mounted display (HMD) devices face difficulties in precisely controlling virtual images displayed on glasses, as they need to use gestures, voice inputs, or touch the arms of the eyeglasses without physically interacting with the virtual image, making precise control challenging.
Innovation Solution
A method and apparatus for processing an additional screen linked to an actual screen, where a second device captures and analyzes images of a first device to determine the location and direction of its screen, allowing the display of additional screens near the primary screen and linking them for user input control, enabling precise control of virtual images through user inputs on both devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If HMD devices display virtual images for users to view, then the display function is provided, but the user cannot precisely control the virtual image without physical interaction
Solution Approach 1:
The patent introduces a second device (such as a mobile device or computer) as an intermediary control interface. This device displays an additional screen that mirrors or relates to the virtual image content on the HMD, allowing users to control the virtual image through touch or other input methods on the second device rather than requiring complex gesture recognition or voice commands in the air.
Solution Approach 2:
The patent creates a copy of the virtual image interface on a second device. The additional screen on the second device replicates or corresponds to the virtual image displayed in the HMD, enabling users to interact with a tangible copy of the interface that can be precisely controlled through traditional input methods.
2Adaptability or versatility
If HMD devices provide augmented reality functions, then user convenience is improved, but control precision of virtual elements deteriorates
Solution Approach 1:
The patent segments the control function from the display function. The HMD device maintains its augmented reality display capability while the control function is separated and assigned to a second device. This segmentation allows each device to optimize its specific function without compromising the other.
Solution Approach 2:
The second device serves as an intermediary that bridges the gap between the user and the virtual image in the augmented reality environment, providing a tangible interface for precise control while the HMD continues to provide the augmented reality experience.
3Device complexity
If users control virtual images through gestures or voice inputs, then device simplicity is maintained, but control precision deteriorates
Solution Approach 1:
The patent creates a tangible copy of the virtual interface on a second device that the user can physically interact with. This copy allows for precise control through touch or other traditional input methods, overcoming the imprecision of gesture or voice recognition while maintaining the augmented reality experience in the HMD.
Data Source
AI summary
A method and an apparatus for processing a screen by using a device are provided. The method includes obtaining, at the second device, a display screen displayed on the first device and information related to the display screen according to a screen display request regarding the first device, determining, at the second device, an additional screen based on the display screen on the first device and the information related to the display screen, and displaying the additional screen near the display screen on the first device.