Midair Display Device Operation Detection with Depth Cues
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display devices fail to ensure full operability of operations performed on three-dimensional objects displayed in midair, as users experience poor response and unintended operations due to misperception of icon positions and distances.
Innovation Solution
A display device comprising a display unit, an operation detection unit, and a control unit that adjusts the display mode of midair images based on user operations, using a detection reference and depth cues to enhance user perception and accuracy of interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a capacitive touch sensor is used to detect operations on midair three-dimensional objects, then operation detection capability is provided, but full operability and accuracy of operations are not ensured due to user misperception of icon positions and distances
Solution Approach 1:
The system displays reference information (depth cues) that provide feedback to users about the actual positions and distances of icons in midair. This feedback loop allows users to adjust their perception and operations, improving both ease of operation and measurement precision by aligning user perception with actual icon positions.
Solution Approach 2:
Reference information acts as an intermediary between the midair icons and the user. This intermediary provides depth cues and positional information that help users accurately perceive icon locations and distances, thereby improving operation accuracy without requiring direct contact or complex sensor adjustments.
2Ease of operation
If display mode is adjusted based on user operations, then operability is improved, but device complexity increases due to additional detection and control mechanisms
Solution Approach 1:
The display device integrates multiple functions into a unified system: the display unit serves both as the interface for showing icons and as the medium for displaying reference information; the operation detection unit detects both user operations and positional information; the control unit coordinates display mode adjustments based on operation results. This multi-functionality improves operability while minimizing the addition of separate complex components.
Solution Approach 2:
The patent combines the display of icons and reference information in the same midair space, merges operation detection with positional tracking, and integrates control functions into a unified system. This merging approach enhances operability by creating a cohesive interaction model while avoiding the complexity of separate independent systems.
3Measurement precision
If reference information is displayed in midair, then user perception of icon positions is enhanced, but display area and space requirements increase
Solution Approach 1:
Reference information is displayed locally near specific icons or in relevant regions of the midair display space, rather than uniformly across the entire display area. This localized approach enhances perception accuracy for specific icons while minimizing the overall space required, as reference information is only shown where needed for each interaction context.
Solution Approach 2:
The system utilizes the depth dimension (z-axis) in addition to the horizontal and vertical planes, displaying reference information at different depths relative to icons. This dimensional approach allows rich perceptual feedback without requiring excessive lateral display area, as information is distributed through the third dimension of midair space.
Data Source
AI summary
A display device includes: a display unit that displays, at a remote position, a display image that includes a first image and a second image; an operation detection unit that detects an operation by a user on the display image; and a display control unit that adjusts a display mode for at least one of the first image and the second image based upon the operation detected by the operation detection unit.