Body-Mounted Camera System for Avatar Pose Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented, virtual, and mixed reality environments, users immersed in these systems often have difficulty being aware of their own location and pose, leading to potential collisions and a diminished experience for both the user and observers, as they cannot see their own body within the virtual environment.
Innovation Solution
A body-mounted housing system equipped with multiple cameras capturing 3D images of the user's body, a spring-loaded dislocatable joint to prevent accidental camera dislocation, and a processor-based body pose module that derives and renders a user's body pose data to display an avatar, allowing users to see their own body and others to view their position accurately.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If users are immersed in augmented reality or virtual reality environments, then they can interact with virtual objects and experiences, but they cannot see their own body and location, leading to disorientation and potential collisions
Solution Approach 1:
The patent creates a virtual copy (avatar) of the user's body that mirrors their actual pose and movements. Multiple cameras capture the user's body from different angles, and this visual data is processed to generate a realistic avatar representation that displays on screens or head-mounted displays, allowing users to see themselves in the virtual environment without breaking immersion
Solution Approach 2:
The system introduces an intermediary avatar between the user and the virtual environment. Instead of directly showing raw camera feeds or no visual feedback at all, the processed avatar serves as a mediator that presents the user's body in a comprehensible and immersive way, bridging the gap between physical reality and virtual representation
2Measurement precision
If multiple cameras are mounted on the body to capture 3D images, then accurate body pose tracking is achieved, but the device complexity and risk of accidental dislocation increase
Solution Approach 1:
The camera system is divided into multiple independent camera modules mounted at different locations on the body (e.g., head, torso, limbs). Each camera independently captures images from its specific viewpoint, and the system processes these segmented visual data streams separately before integrating them into a comprehensive 3D pose model, which simplifies individual camera design and mounting
Solution Approach 2:
The camera mounting system incorporates flexible or adjustable mechanisms that allow cameras to maintain proper orientation and positioning despite body movements. This dynamic adaptation ensures continuous accurate tracking without requiring rigid, complex fixed mounting structures
3Measurement precision
If cameras are mounted on the body to track user position, then accurate location awareness is provided, but accidental camera dislocation can occur during movement
Solution Approach 1:
The camera mounting system includes protective elements such as spring-loaded shock absorbers, flexible mounting brackets, or cushioning materials positioned between the camera and the body surface. These elements are pre-installed to absorb impact forces from accidental collisions or sudden movements, preventing camera dislocation before it occurs
Solution Approach 2:
The system incorporates preliminary counter-measures such as secure locking mechanisms, friction-based retention systems, or magnetic attachments that actively resist dislocation forces. These mechanisms are designed to counteract the tendency of cameras to detach during vigorous physical activity, applying opposing forces to maintain stable positioning
Data Source
AI summary
A method of deriving data of a user's body pose in an enhanced reality system includes, with at least one camera coupled to a body-mounted housing, capturing at least one image in three-dimensional (3D) space of at least one extremity of a body of a user on which the body-mounted housing is mounted, and with a processor executing a body pose module, deriving data of a user's body pose based on the at least one image captured by the camera.