Mobile Imaging Control Using Plane Estimation for Faster 3D Modeling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating three-dimensional models from two-dimensional image data acquired by mobile objects, such as drones, require extensive processing of large amounts of data, leading to increased processing time.
Innovation Solution
A mobile object and control device that associate image data with three-dimensional data, perform plane estimation, and determine acquisition distances based on plane determination to reduce image data, using a stereo camera, laser scanner, or time-of-flight camera for data acquisition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a large amount of two-dimensional image data is acquired with imaging ranges overlapped with each other for SfM processing, then the three-dimensional model generation accuracy is improved, but the processing time increases
Solution Approach 1:
The patent performs preliminary plane estimation using three-dimensional data before acquiring two-dimensional image data. By determining in advance that the imaging target is a plane, the system can optimize the imaging strategy and reduce unnecessary image acquisitions, thereby reducing processing time while maintaining three-dimensional model generation accuracy
Solution Approach 2:
The patent changes the imaging parameters dynamically based on plane estimation results. When a plane is detected, the system adjusts the imaging strategy to acquire fewer images with optimized overlap rates, thereby reducing the total amount of image data to be processed while maintaining sufficient accuracy for three-dimensional model generation
2Productivity
If image data acquisition distance is reduced to decrease overlap, then the number of images required is reduced, but the quality of three-dimensional reconstruction may deteriorate
Solution Approach 1:
The patent applies different imaging strategies to different regions based on plane estimation. For planar regions, it uses optimized acquisition distances that balance overlap and efficiency. This localized approach ensures sufficient reconstruction quality for planes while improving overall acquisition efficiency
Solution Approach 2:
The patent dynamically adjusts the image acquisition distance based on real-time plane estimation results. The system can change the overlap rate and acquisition distance adaptively, allowing it to maintain high reconstruction quality when needed while improving efficiency in suitable conditions
Data Source
AI summary
A mobile object includes a mobile object main body, an imaging device that is included in the mobile object main body and that performs imaging of a target object, the imaging device including an image data acquisition device and a three-dimensional data acquisition device that are calibrated, and a control device that acquires, for the target object, unit image data in which image data acquired for each angle of view of the image data acquisition device and three-dimensional data acquired by the three-dimensional data acquisition device are associated with each other from the imaging device, performs plane estimation on an imaging target, based on the three-dimensional data, determines whether the imaging target is a plane, and in the case where it is determined that the imaging target is the plane, determines a first distance until next unit image data is acquired based on information on the plane.