AR Display Volume Estimation Using Integrated 3D Range Sensing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems struggle with accurately identifying and estimating the mass of objects due to reliance on two-dimensional image information and the need for external sensors, which can lead to significant deviations in mass estimation and require separate external devices.
Innovation Solution
An augmented reality display device equipped with a camera and range sensor to capture three-dimensional object shapes, allowing for precise volume and mass calculations by integrating a processor to detect object types, recognize three-dimensional shapes, and display augmented reality images with physical quantities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If two-dimensional image information is used for object identification and mass estimation, then the system structure is simple, but the mass estimation accuracy greatly deviates from the actual value
Solution Approach 1:
The patent transitions from two-dimensional image information to three-dimensional shape information by introducing depth measurement capabilities. The processor acquires three-dimensional shape data of objects and calculates volume based on this 3D information, which significantly improves mass estimation accuracy compared to traditional 2D image analysis.
2Measurement precision
If external sensors are installed in separate devices for accurate measurement, then the measurement precision is improved, but the device complexity and requirement for separate devices increases
Solution Approach 1:
The patent integrates the range sensor and processor into the augmented reality display device itself, combining multiple functions (display, image capture, depth measurement, and physical quantity calculation) into a single unified device. This eliminates the need for separate external sensing devices while maintaining high measurement precision.
3Measurement precision
If external devices with sensors are prepared for object measurement, then the measurement capability is improved, but the ease of operation deteriorates due to requiring separate devices
Solution Approach 1:
The augmented reality display device is designed to perform multiple functions: displaying augmented reality images, capturing images of the real world, measuring depth/distance to objects, recognizing object types, calculating three-dimensional shapes, and estimating physical quantities. This multi-functional integration allows the device to operate independently without requiring separate measurement tools, significantly improving ease of operation.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate calculation and notification of object physical quantities, such as volume and mass, using a single device without external sensors, improving estimation accuracy and eliminating the need for separate devices.
Implementation Method 1
a range sensor configured to measure a distance to each of a plurality of measurement points on a real object to be captured by the out-camera
Data Source
AI summary
An augmented reality display device comprises: a display; an out-camera for capturing an image of a field of view of a user; a range sensor configured to measure a distance to each of a plurality of measurement points on a real object to be captured by the out-camera; and a processor connected to the display, the out-camera, and the range sensor, respectively, and the processor is configured to: detect a type of the real object captured in a captured image generated by the out-camera; recognize a three-dimensional shape of the real object based on distance data to each of the measurement points detected by the range sensor; estimate a volume of the real object based on the three-dimensional shape of the real object; and display, on the display, an augmented reality image indicating a physical quantity of the real object which is based on the volume.