XR Object Overlay for Electronic Message-Object Association
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Ordinary text messages or emails that include instructions associated with real-world objects are not self-executory and rely on recipient reading comprehension and memory, disassociating them from the physical object.
Innovation Solution
A method and system for surfacing an extended reality (XR) object corresponding to an electronic message, where the message includes an attachment flag or metadata associated with a real-world object, and the XR object is presented when the object is detected within the recipient's field of view, serving as a reminder for actions related to the object.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If ordinary text messages or emails are used to convey instructions associated with real-world objects, then the method is simple and device complexity is low, but the association between the electronic message and the physical object is lost, reducing reliability
Solution Approach 1:
The patent introduces an XR object as an intermediary element that bridges the electronic message and the real-world object. When the recipient views the physical object through a camera, an XR object is overlaid on the object's location, creating a visual connection between the message instructions and the actual object. This intermediary XR representation restores the association that was lost in traditional text-based communication.
Solution Approach 2:
The patent creates a virtual copy (XR object) of the real-world object and places it at the object's physical location. This digital twin or virtual representation serves as a visual anchor for the electronic message, allowing the recipient to see both the physical object and its corresponding message instructions in the same field of view, thereby reinforcing the association between them.
2Reliability
If XR objects are presented to enhance message-object association, then reliability and compliance improve, but device complexity and processing requirements increase
Solution Approach 1:
The system automatically detects when a recipient is viewing a physical object through their camera and autonomously generates and displays the corresponding XR object with message instructions. No manual intervention is required from the recipient to activate or configure the feature - the system self-activates based on camera usage detection, reducing the perceived complexity for the end user while maintaining high reliability.
Solution Approach 2:
The XR object's visibility and presentation parameters are dynamically adjusted based on detected camera movements, object recognition confidence levels, and user interaction states. The system modifies rendering parameters, opacity, and positioning in real-time to optimize performance and reduce unnecessary computational overhead while maintaining effective message delivery.
Data Source
AI summary
In one implementation, a method for surfacing an XR object corresponding to an electronic message. The method includes: obtaining an electronic message from a sender; in response to determining that the electronic message is associated with a real-world object, determining whether a current field-of-view (FOV) of a physical environment includes the real-world object; and in accordance with a determination that the current FOV of the physical environment includes the real-world object, presenting, via the display device, an extended reality (XR) object that corresponds to the electronic message in association with the real-world object.