Transformation Matrix Deriving Device for Video-Sensor Trajectory Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video analysis technologies face challenges in accurately estimating the position of moving objects, particularly when occlusion or camera range limitations occur, leading to incomplete tracking of players or objects in sports videos.
Innovation Solution
A position estimation apparatus that combines video analysis with data from position sensors, using a transformation matrix to align and integrate trajectories from both video and sensor data, enabling accurate position estimation even during occlusion or camera range limitations by generating and matching first and second trajectories in different coordinate systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If only video captured by a camera is used for position estimation, then the system complexity is low, but the position estimation accuracy deteriorates when occlusion or camera range limitations occur
Solution Approach 1:
The patent combines video data from a camera with positional data from a position sensor to create a composite trajectory. The video processing unit extracts positional information from video frames, while the position sensor provides independent position measurements. These two data sources are merged in the trajectory generation unit to produce a more reliable motion trajectory that maintains accuracy even when one data source is compromised by occlusion or out-of-range conditions.
2Reliability
If video analysis alone is used, then the ease of operation is high, but the reliability of position estimation deteriorates during occlusion or camera range limitations
Solution Approach 1:
The patent introduces a transformation matrix as an intermediary element that coordinates between the video coordinate system and the position sensor coordinate system. This matrix enables seamless integration of data from both sources by providing a mathematical transformation that aligns their reference frames. The trajectory matching unit uses this intermediary transformation to reliably associate video-detected positions with sensor-measured positions, ensuring consistent and reliable position estimation across different coordinate systems.
3Reliability
If multiple data sources are integrated, then the position estimation reliability improves, but the device complexity increases
Solution Approach 1:
The patent divides the position estimation system into distinct functional modules: a video processing unit that handles camera data, a position sensor processing unit that handles sensor data, and a trajectory generation unit that integrates both. This segmentation allows each module to specialize in processing its specific data type while maintaining clear interfaces through the transformation matrix. The modular architecture reduces overall system complexity by making each component independent and manageable, while still achieving reliable position estimation through their coordinated operation.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
According to an arrangement, a transformation matrix deriving device includes a first trajectory generator, a second trajectory generator, a trajectory matcher, and a deriver. The first trajectory generator is configured to generate a first trajectory of a moving object, detected from a video, in a first coordinate system. The second trajectory generator is configured to generate a second trajectory of a moving object in a second coordinate system, from time-series data of positional information. The trajectory matcher is configured to associate the first trajectory with the second trajectory to be a motion trajectory of the same moving object based on a similarity between the trajectories. The deriver is configured to derive a transformation matrix that transforms the second coordinate system into the first coordinate system by using the first trajectory and the second trajectory associated with each other.