Human Body Tracking via Position Relationship Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted display systems in virtual reality and augmented reality environments face challenges in tracking human body portions when they move out of the camera's field of view, leading to discontinuous motion detection and operation.
Innovation Solution
A human body portion tracking method and system that predicts the location of missing body parts using three-dimensional coordinates and position relationships between sections of the body, employing an image capturing apparatus and a processor to identify reference points and calculate the coordinates of body parts even when they are outside the camera's view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the camera field of view is used to detect human body motion, then the detection is simple and direct, but the tracking is interrupted when body parts move out of the field of view
Solution Approach 1:
The system performs preliminary action by establishing a position relationship model between body sections when all sections are visible. This pre-established model is then used to predict and continue tracking body parts even when they move out of the camera's field of view, preventing tracking interruption.
Solution Approach 2:
The position relationship model acts as an intermediary between the visible body sections and the invisible ones. By using the known position relationship as a mediator, the system can infer the location of body parts outside the field of view based on the positions of visible parts, maintaining continuous tracking.
2Area of stationary object
If multiple cameras are used to expand field of view coverage, then more body parts can be tracked, but the system complexity increases
Solution Approach 1:
Instead of expanding coverage by adding more cameras in spatial dimensions, the system transitions to a different dimension by using temporal information and predictive modeling. The position relationship model allows the system to track body parts outside the current field of view by predicting their positions based on previous frames and established relationships.
3Device complexity
If the camera field of view is fixed, then the camera structure is simple, but body parts moving beyond the view cannot be tracked
Solution Approach 1:
The system performs preliminary action by establishing a position relationship model between body sections when all sections are visible. This pre-established model is then used to predict and continue tracking body parts even when they move out of the camera's field of view, preventing tracking interruption.
Solution Approach 2:
The system creates a virtual copy or representation of the body part's position and motion trajectory based on the position relationship model. This virtual copy allows the system to continue tracking the body part's motion even when the actual body part is outside the camera's field of view, maintaining adaptability without changing the physical camera system.
Data Source
AI summary
A human body portion tracking method is provided and including obtaining a first image from an image capturing apparatus; identifying a first reference point and a second reference point from the first image; determining a position relationship between a first section and a second section of the human body portion according to three-dimensional coordinates of the first reference point and the second reference point; obtaining a second image from the image capturing apparatus; identifying a third reference point from the second image.