Transparent Flat Plate Back-Projection for Direct AR Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Interacting with remote virtual objects in augmented reality (AR) is difficult due to complex technology and methods like ray casting, which are less direct than hand-touch interaction, leading to reduced intuition.
Innovation Solution
An image processing method and apparatus that utilize a transparent flat plate to back-project objects onto the plate based on user interaction, allowing stereoscopic or monoscopic viewing and interaction, with the ability to adjust object flattening based on distance, enabling direct hand interaction without binocular disparity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If ray casting method is used to interact with remote virtual objects, then interaction capability is achieved, but intuitiveness deteriorates due to being less direct than hand-touch interaction
Solution Approach 1:
The patent creates a virtual copy of the physical transparent plate at the remote location, allowing users to interact with the virtual object through the copied interface. This copying approach enables direct hand-touch interaction with the virtual object's representation, maintaining intuitiveness while achieving remote interaction capability without complex ray casting algorithms
Solution Approach 2:
The transparent plate serves as an intermediary device between the user's hand and the remote virtual object. By projecting the virtual object onto the physical plate and allowing direct touch interaction with the plate, the system mediates the interaction in a way that feels direct and intuitive, avoiding the complexity of virtual ray casting while maintaining interaction effectiveness
2Measurement precision
If stereoscopic image is displayed for 3D viewing, then depth perception is improved, but binocular disparity causes interaction difficulty
Solution Approach 1:
The patent segments the viewing experience into two distinct modes: a first operation mode for stereoscopic 3D viewing that provides depth perception, and a second operation mode for monoscopic 2D interaction that eliminates binocular disparity. This segmentation allows each mode to optimize for its specific purpose without compromising the other
Solution Approach 2:
The system dynamically switches between stereoscopic and monoscopic display modes based on the user's interaction needs. When the user needs to interact with the virtual object, the system transitions to monoscopic mode to eliminate binocular disparity and facilitate direct hand interaction, while maintaining the ability to switch back to stereoscopic mode for enhanced depth perception when interaction is not required
Data Source
AI summary
Disclosed are an image processing method and an apparatus for performing the same. An image processing method according to one embodiment comprises the steps of: acquiring information about sensing a user; and displaying a back-projection image obtained by back-projecting at least one object that is visible through a transparent flat plate onto the transparent flat plate on the basis of the information.