3D Model Tracking Beyond Camera Overlap Using Velocity Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D model generation techniques fail to handle objects that go out of the capture area, leading to sudden disappearance in virtual viewpoint images, particularly in scenarios like ball games where the object exceeds the image capturing area.
Innovation Solution
A system that calculates a velocity vector when an object crosses the border of the capture area, estimates its position outside the area, and duplicates the 3D model at that position, ensuring continuous 3D model generation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the 3D model generation is performed only within the overlap area of multiple imaging devices, then the manufacturing precision of the 3D model is improved, but the adaptability of the system to objects moving outside the capture area deteriorates
Solution Approach 1:
The system calculates the velocity vector of the object at the moment it exits the capture area, and uses this velocity information to predict and generate 3D model data for the object's position outside the capture area. This preliminary action of capturing velocity data enables continuous 3D model generation even when the object moves beyond the overlap area of multiple imaging devices.
2Loss of information
If the object exits the capture area, then the loss of information is minimized by using velocity vector calculation, but the device complexity increases due to additional calculations and duplicate model management
Solution Approach 1:
The system creates a duplicate of the 3D model at the estimated position outside the capture area based on the velocity vector calculation. This copying approach allows the system to maintain object tracking continuity without requiring complex real-time rendering or reconstruction algorithms, thereby minimizing information loss while keeping the added complexity manageable.
3Productivity
If real-time 3D model generation is performed using multiple imaging devices, then the productivity of virtual viewpoint image generation is improved, but the reliability of the system deteriorates when objects move outside the capture area
Solution Approach 1:
The system continuously monitors the position of objects relative to the capture area boundaries and provides feedback when an object approaches or exits the area. This feedback mechanism triggers the velocity vector calculation and duplicate model generation processes, ensuring that the system can maintain reliable continuous 3D model generation even as objects move in and out of the capture area, without disrupting the overall productivity of virtual viewpoint image generation.
Data Source
AI summary
A 3D model representing a three-dimensional shape of an object existing in an area in which image capturing areas overlap is generated by using a plurality of moving images obtained by a plurality of imaging devices. Then, in a case where the object corresponding to the generated 3D model goes out of the area, a velocity vector at the time of the object crossing a border of the area is calculated. Then, based on the calculated velocity vector and the position at the time of the object crossing the border of the area, the position of the object after the object goes out of the area is estimated. Further, a 3D model representing a three-dimensional shape of the object at the estimated position is estimated.