Multi-Kinect V2 Motion Tracking with Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Single Kinect V2 sensors face challenges with narrow field of vision, serious self-occlusion, and inability to distinguish the front of the human body, leading to inaccurate bone data collection, which is not suitable for industrial applications and affects human-computer interaction and ergonomics evaluation.
Innovation Solution
A multi-Kinect V2 system is implemented with sensors arranged to optimize the number, installation height, and orientation, using a client-server model to track human bodies from different angles, ensuring stable tracking of joints in self-occlusion states, and integrating data from multiple sensors to achieve more accurate and robust bone tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple Kinect V2 sensors are introduced to solve self-occlusion and narrow field of vision, then tracking accuracy and coverage are improved, but device complexity and computing burden increase
Solution Approach 1:
The system divides the tracking task among multiple independent Kinect V2 sensors, each responsible for capturing data from specific angular regions. This segmentation allows each sensor to operate independently while contributing to the overall tracking accuracy, resolving the contradiction between improved measurement precision and increased device complexity.
Solution Approach 2:
The patent merges data from multiple Kinect V2 sensors through a data fusion algorithm that integrates bone joint information from different angular perspectives. This combining approach enhances tracking accuracy and robustness while managing system complexity through coordinated operation of multiple sensors.
2Device complexity
If multiple Kinect V2 sensors are connected to a single computer, then the number of computers is reduced, but computing burden increases and real-time performance deteriorates
Solution Approach 1:
The system segments the computing task by assigning each Kinect V2 sensor to a dedicated client computer for local processing. This segmentation distributes the computing burden across multiple devices, maintaining real-time performance while reducing the complexity of managing multiple sensors on a single computer.
Solution Approach 2:
The patent introduces a server as an intermediary that receives processed data from multiple client computers and performs data fusion. This intermediary approach allows the system to maintain real-time performance through distributed processing while consolidating results centrally, resolving the contradiction between reduced device complexity and maintained productivity.
3Area of stationary object
If sensors are arranged to maximize coverage, then tracking range is improved, but mutual interference between sensors increases
Solution Approach 1:
The system assigns different operational characteristics to different sensors based on their positions. Each sensor is configured with specific detection parameters optimized for its local angular region, allowing maximum coverage while minimizing mutual interference through localized optimization of detection qualities.
Solution Approach 2:
The data fusion algorithm incorporates feedback mechanisms that adjust tracking results based on information from multiple sensors. This feedback approach allows the system to maximize coverage by utilizing data from all sensors while compensating for mutual interference through intelligent data processing and coordination.
Data Source
AI summary
An unmarked body motion tracking system based on multi-Kinect V2 is provided and includes: Kinect V2s, configured to acquire depth data and joint data; analysis modules, configured to analyze data collection characteristics of single Kinect V2 and transmission device assembly requirements; clients, configured to receive and process data collected by Kinect V2s. A process of the data processing includes: based on the data collection characteristics of the single Kinect V2, a client-server model is built to track a human body from different directions; output modules, configured to output layout modes and tracking results of the Kinect V2s. According to the data collection characteristics of the single Kinect V2 and the transmission device assembly requirements, the disclosure minimizes the mutual interference between the opposite Kinect V2s, tracks the human body from different directions, and ensures that the joints in the self-occlusion state are stably tracked by sensors at other angles.