Mobile 3D Box Measurement for Reflective Surface Dimensioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mobile devices with 3D imaging systems face challenges in accurately fusing 2D and 3D imagery due to inconsistencies in image streams and interference from sunlight, especially when targeting highly reflective surfaces, which confounds accurate dimensioning of objects.
Innovation Solution
A system and method for 3D box segmentation and measurement using a mobile device equipped with 3D image sensors, including infrared illuminators and LIDAR systems, to capture and analyze 3D imaging data, identify planes, edges, and corners of irregularly shaped objects, and perform volume dimensioning by iteratively refining corner and edge detection through radius searching and plane segmentation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 2D and 3D imagery are fused to dimension objects, then measurement capability is improved, but accuracy deteriorates due to inconsistencies in image streams and interference from sunlight on reflective surfaces
Solution Approach 1:
The patent segments the imaging process into separate 2D and 3D capture channels, processing them independently through dedicated algorithms before fusion. The 2D image processor handles reflective surface issues separately from the 3D point cloud generation, allowing each to optimize for its specific challenges without compromising the other.
Solution Approach 2:
The patent introduces an intermediary processing layer that includes a depth map generator and point cloud processor as mediators between the raw image sensors and the final measurement output. These intermediaries filter and reconcile inconsistencies between 2D and 3D data streams, acting as buffers that prevent direct conflicts from propagating to the final measurement.
2Reliability
If infrared imaging is used to penetrate sunlight interference, then measurement reliability is improved, but device complexity increases due to additional sensors and processing requirements
Solution Approach 1:
The patent designs the mobile device's imaging system to perform multiple functions through shared hardware components. The same camera array and processor used for standard 2D photography also handle 3D stereo vision, infrared imaging, and depth mapping by switching modes or processing different data streams, thereby reducing the need for entirely separate dedicated systems.
Solution Approach 2:
The system employs periodic switching between different imaging modes (2D, 3D, infrared) based on the measurement task requirements. Rather than continuously activating all sensors, the system cycles through appropriate modes for each phase of measurement, reducing overall system complexity and power consumption while maintaining reliability when needed.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables precise and accurate measurement of irregularly shaped objects by iteratively refining corner and edge detection, compensating for imaging inconsistencies and reflective surfaces, thereby improving the accuracy of 3D imaging-based volume dimensioning.
Implementation Method 1
light detection and ranging (LIDAR) systems to enable the camera to derive depth information
Implementation Method 2
infrared or laser illuminators
Implementation Method 3
infrared or laser illuminators
Data Source
AI summary
A mobile device is capable of being carried by a user and directed at a target object. The mobile device may implement a system to dimension the target object. The system, by way of the mobile device, may image the target object to and receive a 3D image stream, including one or more frames. Each frame may include a plurality of points, where each point has an associated depth value. Based on the depth value of the plurality of points, the system, by way of the mobile device, may determine one or more dimensions of the target object.