AR Display Depth Analysis for Location-Based Games
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Location-based games struggle to effectively express depth and front/back relationships of virtual objects in augmented reality displays, as 2D camera images lack depth information, making it difficult to accurately composite virtual elements into real-world scenery.
Innovation Solution
An augmented reality system that captures real-world images, analyzes depth information using pixel relative distances, and generates virtual display data to accurately position virtual objects on real map information, allowing for appropriate compositing and display of virtual objects in relation to real-world geography.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual objects are composited onto 2D camera images in augmented reality displays, then the entertainment value and immersive experience are improved, but the accuracy of depth expression and front/back relationships deteriorates due to lack of depth information in 2D images
Solution Approach 1:
The patent applies dimensionality change by transitioning from 2D image coordinates to 3D spatial coordinates. The conversion unit converts 2D coordinates of imaging subjects in the captured image to 3D coordinates by calculating relative distances, thereby adding the depth dimension. This enables accurate expression of front/back relationships and depth information when compositing virtual objects, resolving the contradiction between entertainment value and depth accuracy.
2Device complexity
If virtual objects are composited onto real-world images without depth analysis, then the processing complexity is reduced, but the positioning accuracy and realism of virtual objects deteriorates
Solution Approach 1:
The patent applies preliminary action by performing depth information analysis and 2D-to-3D coordinate conversion in advance before compositing virtual objects. The conversion unit calculates relative distances and converts coordinates beforehand, so that when virtual objects are composited, their positioning is already optimized for depth accuracy. This preliminary processing ensures positioning accuracy without adding excessive complexity to the real-time compositing operation.
3Measurement precision
If depth information is analyzed for every pixel in the captured image, then the accuracy of virtual object positioning is improved, but the processing time and computational load increases
Solution Approach 1:
The patent applies local quality by focusing depth information analysis and coordinate conversion only on pixels that correspond to imaging subjects (objects of interest) rather than processing every pixel uniformly. The system identifies imaging subjects in the captured image and performs 2D-to-3D conversion specifically for these regions, maintaining high positioning accuracy for virtual objects while reducing overall processing time and computational load compared to full-image processing.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enhances entertainment value by providing a more realistic and immersive experience through accurate representation of distance and positioning of virtual objects within the real-world environment, improving the overall augmented reality display in location-based games.
Implementation Method 1
an imaging portion 145a for analyzing, as depth information, relative distances to imaging subjects of individual pixels that structure the real-world image that has been captured
Data Source
AI summary
An augmented reality displaying system for displaying a virtual object through compositing on an image taken of the real world, comprising: a camera for capturing an image of the real world; a location information acquiring portion for acquiring, as location information, the coordinates and orientation at the instant of imaging by the camera; an image analyzing portion for analyzing, as depth information, the relative distances to imaging subjects for individual pixels that structure the real world image that has been captured; a virtual display data generating portion for generating virtual display data, on real map information that includes geographical information in the real world, based on the location information acquired by the location information acquiring portion; and a compositing processing portion for displaying the virtual display data, generated by the virtual display data generating portion, superimposed on an image captured by the camera in accordance with the depth information.