AR Image Stability Using Depth Data Pixel Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented reality (AR) images often lose their sense of reality and stability when the spatial placement of objects changes as the user moves, leading to inappropriate and unnatural display, especially when frames are missing, causing the AR image to shake and lose its correct positioning in the reality space.
Innovation Solution
A method and program that utilize depth data to accurately determine the location of virtual image pixels within the reality space, allowing for transparent processing and adjustment based on depth ranges, ensuring the AR image remains stable and correctly positioned even when frames are missing, by integrating depth data with color data and using it to correct the display of virtual image data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional AR methods overlay pre-generated computer graphics on photographed images, then the implementation is simple and compatible with smartphones, but the AR image shakes and loses correct positioning when the user moves or frames are missing
Solution Approach 1:
The patent introduces depth data as an additional dimension beyond the traditional 2D image coordinates. Each pixel is represented not only by (x, y) coordinates but also by depth information z, forming a 3D coordinate system. This depth dimension enables accurate spatial placement of virtual objects in the real world, preventing the shaking and positioning errors that occur in conventional 2D-based AR methods when users move.
2Measurement precision
If depth data is added to each pixel of virtual image data, then the AR image can be accurately positioned in reality space, but the data transmission and processing complexity increases
Solution Approach 1:
The patent performs depth calculation in advance during the content generation phase. Instead of calculating depth information in real-time during AR rendering, the system pre-calculates depth values for each pixel based on the virtual camera's position and the 3D model geometry. This preliminary action stores depth data alongside color data, enabling efficient real-time AR rendering without complex runtime calculations, thus reducing device complexity while maintaining high measurement precision.
Data Source
AI summary
Embodiments of the inventive concept described herein relate to a method and a program for providing augmented reality image using depth data. According to an embodiment of the inventive concept, a method for providing an AR image using depth data includes a step S120 (a virtual image data receiving step) of receiving, by a client, virtual image data from a server, a step S140 (a display location determining step) of determining, by the client, a location, at which each pixel is to be displayed in a reality space, based on the depth data, and a step S160 (a virtual image data displaying step) of displaying the virtual image data in the reality space based on the determined location.