Image Processing Apparatus Plane-Based Data Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing techniques for generating three-dimensional models from two-dimensional image data using Structure from Motion (SfM) require processing large amounts of overlapping image data, leading to increased processing time.
Innovation Solution
An image processing method that involves acquiring and associating unit image data with three-dimensional data, estimating planes from the three-dimensional data, grouping image data belonging to the estimated planes, and selecting necessary image data based on overlapping rates to reduce the overall image data required for processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a large amount of two-dimensional image data is acquired with imaging ranges overlapped for SfM processing, then the three-dimensional model generation accuracy is improved, but the processing time increases
Solution Approach 1:
The patent segments the target object into multiple planar surfaces and identifies image data corresponding to each plane. By processing images plane-by-plane rather than treating all images uniformly, the system reduces the overall processing time while maintaining the accuracy needed for three-dimensional model generation.
Solution Approach 2:
The patent extracts and selects only the necessary image data required to form each plane from the large set of acquired images. By taking out only the essential images needed for plane reconstruction, the system eliminates redundant processing of overlapping images while preserving the accuracy required for SfM.
2Loss of time
If image data is reduced by selecting only necessary images for plane formation, then the processing time decreases, but the completeness of three-dimensional data may be compromised
Solution Approach 1:
The patent introduces a planar dimension as an intermediate step between raw images and three-dimensional models. By organizing images according to the planes they represent and processing in this intermediate dimensional space, the system ensures completeness of three-dimensional data while reducing processing time through selective image usage.
Solution Approach 2:
The patent uses the estimated plane information as feedback to guide the selection of necessary image data. The plane estimation results inform which images are essential for accurate plane formation, creating a feedback loop that ensures data completeness while optimizing the selection process to reduce processing time.
Data Source
AI summary
An image processing method includes a step of acquiring, from an image data acquisition device and a three-dimensional data acquisition device that are calibrated, a plurality of pieces of unit image data in which image data and three-dimensional data are associated with each other, for a target object, for each angle of view of the image data acquisition device; a step of estimating a plane, based on a plurality of pieces of three-dimensional data included in the plurality of pieces of unit image data; a step of acquiring image group data by grouping a plurality of pieces of image data included in a plurality of pieces of unit image data belonging to the estimated plane; and a step of selecting image data necessary to form the plane from among the plurality of pieces of image data included in the image group data. Thus, image data can be reduced.