AR Device Spatial Alignment via Camera-Display Coordinate Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) technologies fail to provide a realistic and stereoscopic experience by accurately positioning virtual objects in relation to real objects, lacking sufficient spatial and directional alignment.
Innovation Solution
A method and device that compute the distance and angle between an AR device and a capturing device, determining the position of a virtual object relative to a real object, and displaying it in a stereoscopic manner, allowing the virtual object to be aligned with the user's view direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a separate camera is used to identify invisible parts, then the part can be identified, but the part cannot be exactly positioned and a sufficient realistic feeling or 3D effect is not achieved
Solution Approach 1:
The patent combines the camera with the AR display device into an integrated system. The camera captures images of real objects while the display device renders virtual objects, and both are merged into a single coordinate system through coordinate transformation. This integration ensures that virtual objects are positioned accurately relative to real objects captured by the camera, achieving both precise positioning and realistic 3D effects.
Solution Approach 2:
The patent introduces a coordinate transformation module as an intermediary that maps coordinates between the camera's coordinate system and the display device's coordinate system. This intermediary enables accurate positioning by transforming the captured real object coordinates into the virtual rendering space, ensuring that virtual objects appear at the correct positions relative to real objects.
2Device complexity
If virtual objects are displayed without considering device angle and distance, then the system is simpler, but spatial alignment and directional accuracy are poor
Solution Approach 1:
The patent performs preliminary coordinate transformation and calibration before displaying virtual objects. The system pre-establishes the coordinate system relationship between the camera and display device, and pre-calculates transformation matrices. This preliminary action ensures that when virtual objects are displayed, they are automatically and accurately aligned with the real objects in the correct spatial positions and orientations, without requiring complex real-time adjustments.
Data Source
AI summary
Disclosed is an AR device and method for controlling the same. According to an embodiment of the present disclosure, the method for controlling the AR device computes a distance between the AR device and a capturing device connected with the AR device via wired/wireless communication and receives an angle of the capturing device and computes an angle of the AR device. The method determines information related to a distance to a real object captured by the capturing device, computes an augmented position of a virtual object corresponding to the real object, and displays the virtual object in the augmented position on a display. The AR device of the present disclosure may be associated with an artificial intelligence module, a robot, a virtual reality (VR) device, a device related to a 5G service, and the like.