AR Annotation Synchronization via Context-Aware Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) systems lack collaborative connectivity for multiple users, particularly in mixed reality environments, where object recognition and annotation management are challenging due to the need for shared reference views and coordination of annotations across users, and the limitations of shared drop points.
Innovation Solution
A method for providing synchronous, anchored real-time annotations across similar media objects in an AR environment by generating object/unique identifier information, coordinating plane information across devices, and using context-aware matching to lock annotations to a landmark and plane, allowing for synchronized annotation control and management among users.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If object recognition is used to provide sidebar annotations in related art, then just in time information requirements are met, but collaborative connectivity is lacking
Solution Approach 1:
The system segments the annotation system into independent components: object detection modules on each device, identifier generation modules, and coordination modules. Each device independently detects objects and generates annotations, then coordinates with other devices through identifier matching, enabling both precise timing and collaborative connectivity
Solution Approach 2:
The patent introduces a coordinator component that acts as an intermediary between multiple devices. The coordinator receives plane information and object identifiers from different devices, performs context-aware matching, and distributes synchronized annotations back to the appropriate devices, enabling collaborative functionality while maintaining individual device autonomy
2Adaptability or versatility
If a shared projected object is used for distributed AR experiences, then multiple entities can interact, but mixed reality systems cannot use this approach due to plane complexity requirements
Solution Approach 1:
Instead of requiring a single shared projected object, the system creates virtual copies of the same object on each user's device. Each device generates its own instance of the object with local plane information, but all instances are coordinated through identifier matching, reducing the complexity of plane coordination while maintaining multi-user interaction
Solution Approach 2:
The patent transitions from 2D plane-based coordination to a multi-dimensional approach by incorporating device identifiers, object identifiers, and context information. This additional dimensional layer allows the system to match objects across different planes and devices without requiring complex plane-to-plane mapping
3Adaptability or versatility
If a shared reference view is created for object annotation, then annotations can be jointly shared, but coordination of movements across users becomes complex
Solution Approach 1:
The system extracts the essential identification information (object identifiers and unique device identifiers) from the complex plane and movement data. By coordinating based on these extracted identifiers rather than full plane coordinates, the system enables annotation sharing while significantly reducing movement coordination complexity
Solution Approach 2:
The patent performs preliminary matching of object identifiers and device identifiers before annotations are created or moved. This pre-coordination establishes the mapping relationships in advance, so that when objects move or annotations are updated, the system can automatically maintain synchronization without complex real-time coordination
4Reliability
If context-aware matching is performed across devices, then object synchronization is achieved, but processing requirements increase
Solution Approach 1:
The system applies context-aware matching selectively based on local conditions. Each device performs matching operations only for objects relevant to its context and view, rather than processing all objects from all devices. This localized approach maintains high matching accuracy while reducing overall processing energy consumption
Data Source
AI summary
An augmented reality (AR) environment synchronization method, includes, for each of a plurality of devices associated with respective users in the AR environment, receiving plane information, and generating object/unique identifier information; across the devices, coordinating the plane information; performing context-aware matching of the object/unique identifier information across the devices to generate a match between respective objects sensed by the devices; and providing synchronization control to the devices, to permit an annotation of the matched object to be locked to a landmark and the plane of one of the devices with respect to others of the devices.