Augmented Reality Depth Determination Using Single Camera Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems face difficulties in determining the depth relationship between a three-dimensional shaped object and a virtual object without requiring a multi-camera head, making it challenging to accurately display the positional relationship between the two, especially in applications like medical preoperative conferences.
Innovation Solution
An augmented reality system that includes a three-dimensional data acquisition unit, a shaping unit for creating a shaped object, an imaging unit for capturing images, a camera parameter calculation unit to determine the relative positional relationship, and a display unit for displaying the virtual object based on the calculated parameters, allowing for the easy recognition of the positional relationship between the shaped and virtual objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a multi-camera head is used to calculate depth information, then the depth relationship between shaped object and virtual object can be determined, but the system configuration becomes complicated
Solution Approach 1:
The patent extracts the depth calculation function from the complex multi-camera system and implements it through software processing using a single camera. By extracting the essential function (depth calculation) and implementing it through image processing algorithms rather than hardware complexity, the system achieves depth relationship determination without requiring a multi-camera head, thus resolving the contradiction between measurement precision and device complexity
Solution Approach 2:
The patent replaces the mechanical/optical system of multiple cameras with a computational approach using a single camera and image processing algorithms. Instead of using multiple physical sensors to capture depth information, the system uses software-based depth calculation from single-camera images, substituting a mechanical system with a computational one to reduce hardware complexity while maintaining depth determination capability
2Ease of manufacture
If a virtual object is simply superimposed on a captured image based on posture information, then the implementation is simple, but the depth relationship between shaped object and virtual object cannot be represented
Solution Approach 1:
The patent adds depth information (a new dimension) to the traditional 2D augmented reality display. By calculating and utilizing depth relationships between the shaped object and virtual object, the system transforms simple 2D superposition into 3D-aware rendering, where virtual objects are positioned at appropriate depths relative to the physical object. This resolves the contradiction by enhancing information completeness while maintaining implementation feasibility through computational methods
3Reliability
If a 3D printed shaped object is used for preoperative conference, then the actual size and tactile feedback are available, but temporal and financial costs are high
Solution Approach 1:
The patent uses a virtual copy (computer-generated model) of the anatomical structure instead of a physical 3D printed copy. This virtual model provides the same information about actual size and spatial relationships but can be generated and modified instantly without the time and cost of physical printing. The virtual object is superimposed on the shaped object to provide augmented reality visualization, achieving reliable size representation while eliminating the temporal costs of 3D printing
Solution Approach 2:
The patent changes the state of the model from physical (3D printed) to digital (virtual), which fundamentally alters the parameters of time and cost while preserving the essential function of representing actual size. By using a virtual model that can be rapidly generated and modified through software, the system maintains accurate size representation but eliminates the lengthy and expensive 3D printing process
Data Source
AI summary
An augmented reality providing system and method, an information processing device, and a non-transitory computer readable recording medium recorded with a program are provided. An augmented reality providing system includes a unit for acquiring three-dimensional data, a unit for generating three-dimensional shaping data of a first model from the three-dimensional data, a unit for shaping and outputting a shaped object on the basis of the three-dimensional shaping data, imaging a unit for imaging the shaped object, a unit for calculating a camera parameter from the captured image, a unit for generating a second model including a region of interest that is a non-shaping target from the three-dimensional data, and a unit for determining a depth relationship between the shaped object and the second three-dimensional model on the basis of the camera parameter, and a virtual object of the region of interest in front of the shaped object is displayed.