AR Marker Virtual Object Orientation Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) systems in mobile devices struggle to allow users to easily display virtual objects in the desired direction when recognizing AR markers, often resulting in incorrect orientations if the photographer deviates from the intended viewing angle.
Innovation Solution
An image processing device with a detecting section for AR markers, a recognizing section, an imaging direction identifying section, and a display control section that allows users to switch between default and imaging direction display modes, enabling the virtual object to be oriented based on the user's desired viewing direction by calculating and applying a rotation angle to align the virtual object with the imaging direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the virtual object is displayed so that its front side is directed toward the same direction as the front side of the AR marker, then the display direction is determined based on the marker pattern, but the user cannot easily view the virtual object from different angles (back side or side views)
Solution Approach 1:
The patent applies the Dynamics principle by making the virtual object rotatable around its display position. The virtual object can dynamically change its orientation based on user input, allowing it to face different directions (front, back, left, right sides) while maintaining its position on the AR marker. This resolves the contradiction by enabling both easy viewing from any angle and flexible adaptability to user preferences.
2Productivity
If the photographer captures an image from the back side or side of the AR marker, then the imaging function works, but the virtual object is displayed backward or sideways making it difficult to view
Solution Approach 1:
The patent enables the virtual object to dynamically rotate to face the desired direction regardless of the camera's imaging angle. When the camera captures the AR marker from the back or side, the user can rotate the virtual object to face the correct direction, ensuring the virtual object remains visible and properly oriented while maintaining full imaging functionality.
3Adaptability or versatility
If rotation control is implemented to allow the virtual object to face different directions, then viewing flexibility is improved, but the device complexity increases
Solution Approach 1:
The patent replaces any potential mechanical rotation control with a software-based solution. The virtual object's rotation is achieved through digital transformation and coordinate system manipulation in the display processing, eliminating the need for physical mechanical components. This substitution reduces device complexity while maintaining full rotation control functionality.
Data Source
AI summary
An object of the present invention to enable easy display of a virtual object toward a direction desired by a user, when performing a superimposed display of the virtual object in a captured image containing an augmented reality marker. In the present invention, a CPU identifies the direction of an AR marker detected from within an actual image captured in an image sensor as an imaging direction, rotates the virtual object so that the front side of the virtual object is directed toward the imaging direction in a state where the front side of the virtual object is directed toward a reference direction (for example, front side direction) of the AR marker, and performs a superimposed display of the virtual object on the area of the AR marker.