Transparent Display Interaction Logic for Virtual Real Object Distinction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Transparent displays often cause information muddling and confusion for users when virtual objects overlap with real objects, making it difficult to distinguish between the two, especially when users interact with objects on the other side of the display.
Innovation Solution
An interactive method and apparatus that includes a processor to detect pointing operations on a transparent display, determining whether the operation triggers the display and if prompt information is present, allowing users to interact with either the prompt information or the object on the other side by using a combination of information capturing devices and a transparent display with touch panel capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If virtual objects are displayed on the transparent display, then information can be superimposed on real objects, but information muddling and confusion occurs when virtual objects overlap with real objects
Solution Approach 1:
The system performs preliminary detection of the user's pointing operation and determines in advance whether to trigger the transparent display and what type of interaction is needed. By detecting the pointing operation before displaying information, the system can prepare the appropriate response (prompt information or object interaction) to avoid information muddling
Solution Approach 2:
The interaction is segmented into distinct types: interaction with prompt information and interaction with real objects. The system divides the display area into trigger locations with prompt information and areas where real objects are visible, allowing users to clearly distinguish between different interaction targets and avoid confusion
2Illumination intensity
If the transparent display is made more transparent, then users can see through to real objects better, but virtual object information becomes less visible
Solution Approach 1:
The transparent display applies different display characteristics to different regions. At trigger locations where prompt information is displayed, the display can enhance visibility through localized brightness or contrast adjustments, while maintaining high transparency in other areas where real objects need to be clearly visible
Data Source
AI summary
A method and an apparatus for interaction with virtual and real images are provided. The method includes following steps: detecting a pointing operation of a user for the transparent display and determining whether the pointing operation triggers the transparent display by a processor; if the pointing operation triggers the transparent display, determining whether prompt information is presented at a trigger location of the pointing operation on the transparent display; if the prompt information is presented, interacting with the prompt information; and if the prompt information is not presented, interacting with an object on a side of the transparent display opposite to a user pointed by the pointing operation.