Skeletal Data Tracking for Spatially Accurate Multi-User Sessions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multi-user communication systems fail to effectively utilize skeletal data to display virtual objects and participants in a three-dimensional environment, leading to inconsistencies in spatial representation and interaction within shared virtual spaces.
Innovation Solution
A system and method that utilizes skeletal data from multiple electronic devices to dynamically update the visual appearance of virtual objects and participants based on spatial changes, ensuring accurate spatial representation and interaction within a shared three-dimensional environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If skeletal data is utilized to dynamically update virtual objects and participant representations, then spatial representation accuracy and interaction fidelity are improved, but system complexity and computational requirements increase
Solution Approach 1:
The system segments skeletal data processing into distinct modules: data reception from multiple electronic devices, spatial property change detection, and visual appearance updates. Each module handles specific aspects of the skeletal data pipeline independently, reducing overall system complexity while maintaining high spatial representation accuracy.
Solution Approach 2:
The system performs preliminary processing of skeletal data by detecting spatial property changes before updating visual appearances. This preliminary detection and classification of spatial changes enables more efficient rendering and reduces real-time computational burden while preserving measurement precision.
2Reliability
If skeletal data from multiple devices is processed and shared, then interaction accuracy in shared virtual spaces is improved, but data transmission requirements and network bandwidth increase
Solution Approach 1:
The system extracts only the essential spatial property changes from skeletal data for transmission and processing. Instead of sharing complete skeletal datasets from multiple devices, the system identifies and transmits only the critical spatial changes needed for accurate interaction representation, reducing data volume while maintaining interaction accuracy.
Solution Approach 2:
The system applies local quality optimization by transmitting different data representations to different participants based on their specific viewing angles and interaction needs. Each participant receives tailored spatial update information rather than universal high-fidelity data streams, reducing overall network bandwidth requirements while preserving interaction accuracy for each user.
Data Source
AI summary
Some examples of the disclosure are directed to systems and methods for displaying a virtual object within a multi-user communication session based on skeletal data associated with one or more participants in the multi-user communication session. Some examples of the disclosure are directed to systems and methods for displaying a visual indication of a participant within a multi-user communication session based on skeletal data associated with the participant in the multi-user communication session. In some examples, while a first electronic device is in a communication session with a second electronic device that is collocated with the first electronic device in a physical environment, the first electronic device receives first data provided by the second electronic device that includes skeletal data associated with a user of the second electronic device.