Snapshot Messaging with Physical Markers for Eyewear AR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable electronic devices lack effective methods for enabling users to establish social connections and maintain interpersonal awareness through augmented reality (AR) using real-world objects as anchor points.
Innovation Solution
A system and method for electronic eyewear devices that capture and recognize physical markers in the user's field of view, allowing users to establish connections with remote partners by projecting AR content at corresponding marker-endpoints or user-endpoints, using 2D or 3D snapshot messages that blend seamlessly with the physical environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If wearable electronic devices project AR content to establish social connections, then interpersonal awareness and social connections are improved, but device complexity and processing requirements increase
Solution Approach 1:
The system performs preliminary actions by capturing images and identifying physical markers in advance. When a user looks at a marked object, the device already has the snapshot and marker information ready, enabling rapid AR content projection without real-time processing delays. This preliminary preparation reduces the computational burden during actual social interaction moments.
Solution Approach 2:
The system creates 2D or 3D copy messages representing real-world objects and snapshots. These digital copies are transmitted between users to convey information about their environment and activities. By using simplified representations rather than full sensory data, the system maintains interpersonal awareness while managing device complexity.
2Manufacturing precision
If the device captures and processes real-time images for AR projection, then the realism and immersion of AR experiences are improved, but energy consumption and processing time increase
Solution Approach 1:
Instead of continuous real-time processing, the system uses periodic action by capturing snapshots at specific moments and triggering AR content projection based on discrete events (when the user looks at a marked object). This event-driven approach maintains AR realism while significantly reducing continuous energy consumption compared to constant real-time processing.
Solution Approach 2:
The system performs preliminary image capture and processing before the actual AR projection is needed. Snapshots are taken and prepared in advance, so when a trigger event occurs, the device can quickly project pre-processed AR content rather than processing images in real-time, thereby reducing energy consumption during active use.
3Ease of operation
If the system uses physical markers as anchor points for AR content, then ease of establishing social connections is improved, but the requirement for physical markers and additional setup steps increases
Solution Approach 1:
The system makes physical markers universal by allowing any physical object to serve as an anchor point for AR content and social connections. Users can mark existing objects in their environment rather than requiring specialized equipment. This multi-functional approach allows everyday objects to become communication anchors, simplifying the establishment of social connections while reducing the need for dedicated setup procedures.
Data Source
AI summary
Systems and methods are described for sending a snapshot message using an electronic eyewear device by a first user capturing an image, identifying a physical marker in the captured image, and determining that the physical marker in the captured image has been within a field of view of the electronic eyewear device for a predetermined amount of time. A 3D snapshot including an object is captured and, each time the identified object appears in a field of view of the electronic eyewear device, a representation of the object is sent for display to a second user as if the real object was sent. The representation of the object may include the snapshot image, the object extracted from the snapshot image, a stored representation of the object, augmented reality content representing the object, etc.