3D Model Tracking Beyond Overlapping Camera Coverage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D model generation techniques fail to handle objects that move out of the capture area, leading to discontinuous and unnatural virtual viewpoint images.
Innovation Solution
A system that calculates velocity and position vectors to estimate the object's location outside the capture area, allowing for continuous 3D model generation by duplicating and orienting the model at estimated positions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If the object moves out of the generation area, then the object can be captured in a wider range, but the 3D model generation stops and the object disappears suddenly
Solution Approach 1:
The system performs preliminary actions by calculating velocity and position vectors before the object exits the generation area. This allows the system to predict the object's trajectory and prepare for continuous tracking even when the object moves outside the visible capture area, preventing sudden disappearance in the virtual viewpoint images
Solution Approach 2:
The system introduces velocity and position vectors as intermediary elements that bridge the gap between captured images and 3D model generation. These vectors serve as mediators to estimate object locations outside the generation area, enabling continuous model generation without direct visual input from all imaging devices
2Manufacturing precision
If multiple imaging devices are used to capture objects from different viewpoints, then the 3D model accuracy is improved, but the system complexity increases
Solution Approach 1:
The system segments the complex multi-device capture process into distinct functional components: image acquisition from multiple viewpoints, 3D model generation from segmented data, velocity/position vector calculation, and virtual viewpoint rendering. This segmentation allows each component to be optimized independently while maintaining overall system accuracy
Solution Approach 2:
The imaging system is designed with multi-functionality where the same array of imaging devices serves multiple purposes: capturing objects within the generation area for 3D model creation, tracking objects that exit the area using velocity vectors, and providing data for virtual viewpoint generation. This universal usage reduces the need for additional specialized equipment
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A 3D model representing a three-dimensional shape of an object existing in an area in which image capturing areas overlap is generated (110) by using a plurality of moving images obtained by a plurality of imaging devices. Then, in a case where the object corresponding to the generated 3D model goes out of the area, a velocity vector at the time of the object crossing a border of the area is calculated (113). Then, based on the calculated velocity vector and the position at the time of the obj ect crossing the border of the area, the position of the object after the object goes out of the area is estimated (114). Further, a 3D model representing a three-dimensional shape of the object at the estimated position is estimated (115).