Multi-Camera 3D Shape Generation with Abnormal Camera Exclusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating three-dimensional shape data using images from multiple cameras can result in flickering and strange visual effects due to intermittent frame losses, leading to alternately different three-dimensional models even with still objects.
Innovation Solution
An image processing apparatus that identifies abnormalities in image capturing apparatuses and generates three-dimensional shape data using images from other apparatuses, excluding the abnormal ones, ensuring stable data generation and reducing flickering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If three-dimensional shape data is generated by using images from all image capturing apparatuses, then the data generation speed is improved, but flickering and visual instability occur when some apparatuses experience intermittent frame losses
Solution Approach 1:
The system extracts and identifies abnormal image capturing apparatuses that are causing frame losses, then excludes only those specific apparatuses from the three-dimensional model generation process while continuing to use images from normal apparatuses. This selective extraction approach maintains high generation speed by preserving useful data sources while eliminating the cause of flickering.
Solution Approach 2:
The system implements a feedback mechanism that continuously monitors image capture status from each apparatus, detects abnormalities in real-time, and dynamically adjusts the data generation process. When frame losses are detected, the system feeds back this information to exclude the affected apparatus, thereby maintaining visual stability without permanently reducing the number of active cameras.
2Reliability
If three-dimensional shape data is generated by excluding images from apparatuses with detected abnormalities, then visual stability is improved, but the quantity of usable images is reduced
Solution Approach 1:
Instead of excluding all images from apparatuses that experience any abnormality, the system extracts only the specific abnormal frames or intervals causing issues while retaining other valid frames from the same apparatus. This selective extraction preserves the maximum quantity of usable images while eliminating only the problematic portions that cause flickering.
3Manufacturing precision
If all image capturing apparatuses are used continuously, then the coverage and completeness of three-dimensional data is improved, but intermittent abnormalities cause alternating shape variations in the generated models
Solution Approach 1:
The system uses feedback from abnormality detection to dynamically control which apparatus images are included in each frame's processing. When abnormalities are detected, the feedback mechanism temporarily excludes affected apparatuses for that specific frame or interval, then reinstates them when normal operation resumes. This maintains long-term completeness while ensuring short-term shape consistency.
Data Source
AI summary
An image processing apparatus obtains multiple silhouette images corresponding to the images captured by multiple image capturing apparatuses for corresponding frames forming a moving image; in a case where an abnormality is detected in at least one of the plurality of images, identifies a frame and an image capturing apparatus corresponding to the image in which the abnormality is detected; and generates three-dimensional shape data of the object by using the plurality of images, wherein in a case of generating the three-dimensional shape data in a plurality of frames corresponding to a period from detecting the abnormality to satisfying a predetermined condition, the three-dimensional shape data is generated by not using the image corresponding to the identified image capturing apparatus.