Full-body Tracking via Existing Camera Image Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional full-body tracking systems require users to wear devices and install additional equipment to expand the tracking space, limiting its applicability and necessitating specific devices for tracking.
Innovation Solution
The system utilizes existing cameras in the tracking space, such as surveillance and mobile device cameras, to capture image data for full-body tracking, enabling expansion of the tracking space without additional devices and allowing use on devices without inherent tracking capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If additional devices are introduced to expand the tracking space, then the tracking space can be expanded, but the device complexity and cost increase
Solution Approach 1:
The system enables existing cameras to serve dual purposes: their original function plus full-body tracking. By processing image data from surveillance cameras, moving object cameras, and mobile terminal cameras, the system makes these existing devices multi-functional without requiring additional tracking-specific equipment.
Solution Approach 2:
The system allows existing cameras to serve themselves for tracking purposes. Cameras that are already deployed for other purposes automatically contribute to full-body tracking when their image data is processed by the tracking system, eliminating the need for separate tracking devices.
2Measurement precision
If users wear devices for full-body tracking, then tracking accuracy is improved, but the ease of operation and user comfort deteriorate
Solution Approach 1:
The system extracts the tracking function from wearable devices and relocates it to existing environmental cameras. By removing the requirement for users to wear tracking devices, the system maintains tracking accuracy through image data processing while significantly improving ease of operation and user comfort.
Solution Approach 2:
The system replaces the mechanical wearable tracking device with an optical/image-based tracking approach. Instead of using physical sensors on the user's body, the system uses image data from existing cameras to capture and process body motion, eliminating the need for wearable equipment.
3Reliability
If specialized tracking devices are required, then tracking reliability is improved, but the adaptability and accessibility of the system deteriorate
Solution Approach 1:
The system enables full-body tracking functionality across diverse devices and platforms by processing image data from various camera sources. This allows smartphones, head-mounted displays, and other devices without built-in tracking functions to access full-body tracking capabilities, significantly improving adaptability while maintaining reliability through consistent image data processing.
Data Source
AI summary
According to an embodiment of the present disclosure, the processing circuitry of the full-body tracking system communicates with various cameras located in the tracking space to acquire image data captured by the cameras. For the acquisition of the image data, a camera that has already been introduced into the tracking space for another purpose. The processing circuitry performs tracking and skeleton estimation for each user in the tracking space using the acquired image data. The processing circuitry authenticates a target user on which full body tracking is performed, and acquires position information and skeleton information of the authenticated target user from the result of the tracking and the skeleton estimation. Then, the processing circuitry reflects the body motion of the target user on the virtual avatar in the XR space using the acquired position information and skeleton information of the target user.