Multiuser AR Costume Synchronization via Garment Symbol Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality devices cannot effectively create a multiuser experience where multiple users can interact and be depicted together in a shared augmented reality environment, as they only allow alterations to a single image of a physical scene, failing to incorporate changes from different perspectives.
Innovation Solution
The method involves capturing visual scenes using camera devices, identifying embedded symbols on users' garments, and generating virtual augmentations to create animated costumes, which are then rendered in a sequence of frames, allowing multiple users to be depicted together in a shared augmented reality world, with their appearances and actions synchronized across different devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If augmented reality devices only allow alterations to a single image of a physical scene, then the device complexity is reduced, but the multiuser experience and interaction capability are limited
Solution Approach 1:
The system segments the augmented reality environment into multiple independently controllable zones or layers. Each user can have their own augmented reality overlay applied to different portions of the physical scene, allowing simultaneous multiuser experiences without requiring complete system redesign. This segmentation enables diverse user interactions within the same physical space while maintaining manageable system architecture.
Solution Approach 2:
The augmented reality device is designed with universal functionality to serve multiple users simultaneously. The system can detect and track multiple users, apply different augmented reality overlays to each user's view, and maintain synchronization across all user experiences. This multi-functional capability allows a single device to support various user scenarios without requiring separate specialized systems for each user.
2Ease of operation
If the system captures and processes visual scenes from multiple perspectives to create shared augmented reality, then the multiuser interaction quality improves, but the processing time and computational resources increase
Solution Approach 1:
The system performs preliminary actions by pre-processing visual scenes and pre-positioning augmented reality elements before actual user interaction begins. The system captures and processes images from multiple perspectives in advance, builds spatial maps of the environment, and pre-loads relevant augmented reality content. This preliminary preparation reduces real-time processing requirements during actual multiuser interaction, improving both interaction quality and reducing processing time delays.
Solution Approach 2:
The system implements feedback mechanisms that continuously monitor user positions, movements, and interactions to dynamically adjust the augmented reality display. By receiving real-time feedback about user actions and environmental changes, the system can optimize processing priorities and adjust computational resources accordingly. This feedback loop ensures that processing time is allocated efficiently to only those elements currently needed for active user interactions, improving overall system responsiveness.
3Adaptability or versatility
If the system generates virtual augmentations and renders sequences of frames for multiple users, then the immersive experience improves, but the device complexity and computational requirements increase
Solution Approach 1:
The rendering system uses a nested structure where virtual augmentations are layered within the augmented reality environment. Multiple levels of virtual content can be nested within each other, with different levels serving different users or purposes. This nesting approach allows complex immersive experiences to be built from simpler constituent elements, making the overall rendering system more manageable while maintaining high-quality immersive experiences for multiple users simultaneously.
Solution Approach 2:
The system transitions from two-dimensional image processing to three-dimensional spatial rendering to enhance immersive experience. By adding the dimension of depth and spatial positioning, the system can create more engaging multiuser interactions. Virtual augmentations are rendered in three-dimensional space rather than simply overlaid on two-dimensional images, allowing users to interact with content from multiple angles and perspectives. This dimensional transformation improves immersion while the system manages the increased complexity through optimized rendering techniques and selective 3D processing.
Data Source
AI summary
Techniques for displaying an augmented reality environment. Embodiments capture a visual scene for display. An embedded symbol associated with a garment worn by the first user within the visual scene is identified. Embodiments generate a virtual augmentation corresponding to the first user that is animated based on the captured visual scene. The virtual augmentation alters an appearance of the first user, such that the first user is depicted as wearing a virtual costume, the virtual costume determined to have a predefined relationship with the identified embedded symbol. A sequence of frames is rendered that depicts the first user augmented with the virtual augmentation in the augmented reality environment and depict at least a portion of the first user as wearing the virtual costume.