AR Marker Segmentation for Detailed Virtual Object Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) technologies using AR markers struggle to enable detailed interactions with virtual objects, such as flipping pages or opening boxes, and require additional devices like touch panels for user operation recognition, which limits user experience and accuracy.
Innovation Solution
An image processing device and method that includes an augmented-reality marker detecting unit, an operation-marker detecting unit, an operation detecting unit, and a virtual-object control unit to detect and respond to user operations on operation markers within a captured image, allowing deformation and display of virtual objects in real-time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional AR technology uses AR markers for detecting virtual object position, then the basic AR function is achieved, but detailed interactions with virtual objects cannot be realized
Solution Approach 1:
The marker is divided into two distinct parts: an AR marker for detecting virtual object position and an operation marker for recognizing user operations. This segmentation allows the system to handle both basic AR functionality and detailed interactions using a single integrated marker, avoiding the need for additional devices while enabling versatile interactions.
2Adaptability or versatility
If additional devices like touch panels are added to detect user operations, then interaction capability is improved, but device complexity increases
Solution Approach 1:
The operation marker is merged with the AR marker into a single integrated marker structure. This combining allows the system to detect both virtual object position and user operations through one marker, eliminating the need for additional touch panels or operation detection devices while maintaining full interaction capability.
Solution Approach 2:
The integrated marker serves multiple functions: it acts as both an AR marker for position detection and an operation marker for gesture recognition. This multi-functionality allows a single device with camera and image processing capabilities to provide comprehensive AR interactions without requiring specialized additional hardware.
3Device complexity
If gesture recognition from captured images is implemented, then additional devices are eliminated, but recognition accuracy decreases
Solution Approach 1:
The operation marker uses distinct visual characteristics (such as color patterns or specific design features) to encode operation information. This allows the image processing system to accurately recognize user operations by detecting these visual changes in the captured image, maintaining high recognition accuracy without requiring additional sensing devices.
Data Source
AI summary
An image processing device includes: an augmented-reality marker detecting unit that detects, from a captured image, an augmented reality marker indicating that a virtual object is to be displayed; an operation-marker detecting unit that detects, from the captured image, an area of an operation marker that is provided so as to correspond to the augmented reality marker; an operation detecting unit that detects, from the area of the operation marker, a user's operation on the operation marker; a virtual-object control unit that deforms a virtual object corresponding to the augmented reality marker in accordance with the user's operation; and a drawing unit that draws the deformed virtual object in the captured image in a superimposed manner.