XR Pose Validity Signaling for Communication Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented and mixed reality systems, the validity of pose and interactivity streams is challenging to determine and signal effectively, especially in multi-user and multi-device scenarios, leading to issues with communication efficiency and pose correction, particularly when devices move out of valid operation ranges or lose synchronization.
Innovation Solution
An apparatus that includes a processor and memory to transmit, receive, and signal pose and interactivity streams, determining validity criteria and confidence levels, and adjusting pose information based on these criteria, using recurrent neural networks for pose estimation and correction, and signaling validity states through RTP and RTCP protocols to ensure efficient communication and correction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If pose and interactivity streams are transmitted continuously from multiple devices, then real-time AR/VR experience is maintained, but communication efficiency decreases and data errors increase when devices move out of valid ranges
Solution Approach 1:
The system performs preliminary validity assessment on pose data before transmission. The client device determines whether pose information meets validity criteria (such as being within field of view or within valid operation ranges) before including it in the stream, preventing invalid data from being transmitted in the first place
Solution Approach 2:
The system extracts only the valid portion of pose data for transmission. When pose information is determined to be invalid (e.g., device moved out of valid range), only the valid components or corrected values are included in the transmitted stream, reducing unnecessary data transmission
2Measurement precision
If validity criteria are strictly enforced for pose data, then data quality is improved, but device complexity increases due to multiple validation checks
Solution Approach 1:
The validity determination is segmented into multiple independent criteria that can be evaluated separately. The system checks different aspects of pose validity (field of view, operation ranges, synchronization) as distinct criteria, allowing for modular implementation and easier management of validation logic
Solution Approach 2:
The client device performs self-validation of its own pose data before transmission. The device autonomously determines whether its pose information meets validity criteria and handles invalid data cases without requiring complex server-side validation, reducing overall system complexity
Data Source
AI summary
An apparatus comprising: at least one processor; and at least one non-transitory memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to: transmit a pose and interactivity stream to a server, the pose and interactivity stream comprising data based on information obtained from at least one sensor; determine a validity of the pose and interactivity stream, the validity comprising at least one criterion for which the data within the pose and interactivity stream is considered valid; signal at least one parameter that defines the validity of the pose and interactivity stream; and signal a current state of the validity of the pose and interactivity stream.