XR Sensitive Object Feature Transformation for Private Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR technologies collect sensitive user data, which can be accessed by servers and degrade the user experience when attempts to protect this data result in degraded interactions with virtual objects.
Innovation Solution
XR devices transform sensitive object features using transform keys, transmitting substituted information to servers, allowing users to interact with virtual representations while preventing access to original sensitive data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the XR device transmits original sensitive object data to the server, then the server can process and enable interactions with the sensitive object, but the server gains access to sensitive information compromising user privacy
Solution Approach 1:
The patent creates a virtual copy of the sensitive object that preserves its interactive properties and visual appearance while containing no actual sensitive information. The virtual object is generated by replacing the sensitive object in the XR environment, allowing other users to interact with it as if it were the original, while the original sensitive data remains only on the user's local device and is never transmitted to the server.
Solution Approach 2:
The patent extracts the sensitive information from the object data before transmission. By identifying and removing sensitive portions of the captured environment data, the system transmits only non-sensitive visual information to the server, enabling processing and interaction while preventing privacy exposure.
2Object-affected harmful factors
If the XR device blurs sensitive objects before transmission, then the server cannot access sensitive information, but other users cannot interact with or see the sensitive object, degrading the XR experience
Solution Approach 1:
Instead of blurring the sensitive object, the patent creates a functional virtual copy that replaces the sensitive object in the shared XR environment. This virtual copy maintains full interactivity and visual fidelity for other users while containing no sensitive information, thus preserving both privacy and user experience without the degradation caused by blurring.
3Object-affected harmful factors
If the XR device does not transmit sensitive object data, then user privacy is preserved, but the server cannot process the object and other users cannot interact with it
Solution Approach 1:
The patent generates a virtual object that serves as a placeholder for the sensitive object in the shared XR environment. This virtual copy enables the server to process and transmit interaction data to other users, maintaining full XR functionality and social interaction while the actual sensitive data remains exclusively on the user's local device and is never transmitted.
Data Source
AI summary
Systems and methods are provided herein for providing privacy while allowing interactions with virtual representations of sensitive objects. This may be accomplished by an extended reality (XR) system receiving information associated with a real-world environment of a user. The XR system may transmit the received information to one or more devices (e.g., server, XR device, etc.) for processing. Before transmitting the received information, the XR system can use the received information to identify and categorize objects in the real-world environment to identify sensitive objects. To protect the privacy of the sensitive objects, the XR system transforms features of the sensitive objects using one or more transform keys prior to transmitting the information to the one or more devices. The XR system may also update the transform keys after a first time period to further protect the privacy of the sensitive objects.