AR Viewpoint Alignment via 3D Spatial Modeling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In Augmented Reality (AR) systems, virtual objects such as photographs or pictures may not align correctly with the real space's viewpoint, leading to a mismatch in angles of view, which can disrupt the immersive experience of augmenting the real world.
Innovation Solution
An information processing apparatus and method that display additional images corresponding to a user's viewpoint in the real world, guiding the user to a position where the virtual object's viewpoint matches the real space's, by constructing a three-dimensional model of the real world and estimating the position and posture of the additional image for accurate superimposition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If virtual objects are displayed in AR space according to positions of real objects, then the AR system can provide additional information superimposed on real space, but the angle of view in AR space may not agree with that in real space depending on the viewing angle, causing mismatch between virtual and real viewpoints
Solution Approach 1:
The patent transitions from 2D display coordinates to 3D spatial coordinates by constructing a three-dimensional model of the real world. This allows virtual objects to be positioned and oriented in three-dimensional space, enabling the viewpoint of additional images to correspond with the user's actual viewpoint in real space, thereby resolving the angle of view mismatch issue
Solution Approach 2:
The system changes the parameters used for positioning virtual objects from simple 2D screen coordinates to 3D spatial parameters including position and posture (orientation). By estimating the position and posture of additional images in three-dimensional space and adjusting display parameters accordingly, the system achieves viewpoint alignment between virtual and real worlds
2Ease of operation
If additional images are displayed without considering viewpoint correspondence, then the AR system can show virtual objects easily, but the immersive experience is disrupted due to angle of view mismatch
Solution Approach 1:
The system performs preliminary construction of a three-dimensional model of the real world and pre-estimates the position and posture of additional images before displaying them. This preliminary spatial arrangement ensures that when images are displayed, their viewpoints already correspond with the user's viewpoint, maintaining both ease of operation and viewpoint reliability
Data Source
Figure 1
Figure 2
Figure 3
AI summary
[Object] To present, to a user, an additional image, which is a virtual object, in a manner superimposed on a real-space image at a position corresponding to a viewpoint in the real space. [Solution] According to the present disclosure, provided is an information processing apparatus including a processing unit configured to display an additional image corresponding to a viewpoint of a user in the real world, and guide the user to the vicinity of the viewpoint in the real world where the additional image has been acquired.