Target Detection and Tracking System for Body Parts and Props
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current natural user interface systems face challenges in accurately detecting and tracking human body parts and props within a computing environment, often producing false positives and requiring complex reconciliation processes.
Innovation Solution
A target detection and tracking system is implemented, comprising a target proposal system that identifies candidate body parts and props, and a target tracking system that reconciles these identifications using depth images and classification maps, enabling accurate tracking and control of game characters or application interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a target proposal system is used to identify candidate body parts and props, then the system can process images and generate detections, but it produces many false positives requiring complex reconciliation
Solution Approach 1:
The system divides the detection task into two independent modules: a target proposal system that generates candidate detections quickly, and a target tracking system that reconciles and validates these candidates. This segmentation allows each module to optimize for its specific function - the proposal system for speed and the tracking system for accuracy - while working together to solve the overall contradiction.
Solution Approach 2:
The target tracking system acts as an intermediary between the target proposal system and the final output. It receives the raw detections from the proposal system, applies reconciliation logic to eliminate false positives, and produces the final accurate tracking data. This intermediary layer resolves the contradiction by filtering out incorrect detections while maintaining processing efficiency.
2Ease of operation
If traditional input devices are used to control computing applications, then control precision is maintained, but user interaction becomes less natural and immersive
Solution Approach 1:
The system replaces traditional mechanical input devices (keyboard, mouse, controller) with a camera-based vision system that captures body movements. This substitution maintains or improves control accuracy through precise pose estimation and tracking, while significantly enhancing the naturalness and ease of operation by allowing users to interact through natural physical movements rather than artificial input gestures.
3Measurement precision
If the target proposal system processes all pixels to identify body parts and props, then detection coverage is maximized, but processing time and computational resources increase
Solution Approach 1:
The system segments the image processing workload by first generating a set of candidate detections through the target proposal system, then focusing the computationally intensive reconciliation and tracking only on these candidates rather than processing every pixel in detail. This segmentation dramatically reduces processing time while maintaining comprehensive detection coverage through the candidate generation stage.
Data Source
AI summary
A system and method for detecting and tracking targets including body parts and props is described. In one aspect, the disclosed technology acquires one or more depth images, generates one or more classification maps associated with one or more body parts and one or more props, tracks the one or more body parts using a skeletal tracking system, tracks the one or more props using a prop tracking system, and reports metrics regarding the one or more body parts and the one or more props. In some embodiments, feedback may occur between the skeletal tracking system and the prop tracking system.