Multi-User AR Image Synchronization via Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems, such as Microsoft Hololens, only support superimposing virtual objects onto real-world images for a single user, limiting mutual interactions between multiple users and restricting the application of augmented reality technology.
Innovation Solution
An image processing and transmission method and apparatus that allows real-time capture and synchronization of images between two augmented reality devices, enabling interactive augmented reality between multiple users by generating and displaying augmented reality images based on the images captured by both devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a single-ended AR system is used to superimpose virtual objects onto real-world images, then the system implementation is simple, but the interaction between multiple users is lost and the application scope is limited
Solution Approach 1:
The system is divided into multiple independent AR devices, each capable of capturing real-world images, generating virtual objects, and displaying augmented reality content. Each device operates autonomously while maintaining synchronization with others through image sharing, enabling multi-user interaction without requiring a centralized complex system architecture.
Solution Approach 2:
Real-world images captured by one AR device serve as an intermediary medium that is shared with other AR devices. This intermediary enables users to view and interact with each other's real-world environments and virtual objects, facilitating multi-user interaction while keeping individual device complexity manageable.
2Productivity
If real-time image synchronization between multiple AR devices is implemented, then interactive AR experience is improved, but the data transmission and processing load increases
Solution Approach 1:
Only essential image data required for interaction is extracted and transmitted between devices, rather than transmitting complete high-resolution images. This extraction of necessary information maintains interactive experience quality while significantly reducing data transmission volume and energy consumption.
Solution Approach 2:
The real-world images captured by each AR device serve multiple functions: they are used for local augmented reality display, shared with other devices for their display, and serve as the basis for generating virtual objects. This multi-functionality reduces redundant data transmission and processing.
Data Source
AI summary
The present disclosure relates to methods and systems for generating augmented reality. The method may include capturing a first image in a viewing range of a first augmented reality device in real time via a camera of the first augmented reality device, and synchronizing the first image to a second augmented reality device, the first augmented reality device being a device for providing an augmented reality image to a first user in the first display, and the second augmented reality device being a device for providing an augmented reality image to a second user in a second display. The method further includes receiving a second image from the second augmented reality device, the second image being an image returned in real time by the second augmented reality device after augmenting the first image by the second augmented reality device. The method further includes generating the augmented reality image to the first display at the first augmented reality device based on the first image and the second image, and displaying the augmented reality image in the first display at the first augmented reality device.