VR Screen Mirroring for External Device Control in the Metaverse
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable electronic devices, such as AR and VR glasses, lack effective methods for seamlessly integrating and controlling external devices within metaverse environments, limiting user interaction and immersion.
Innovation Solution
An electronic device with a display, communication module, and processor that identifies and mirrors external device screens based on marker images, allowing registration and control through a server, enabling VR content generation and user input coordination.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If wearable electronic devices provide basic VR/AR display functions, then device simplicity is maintained, but user interaction capabilities with external devices are limited
Solution Approach 1:
The wearable electronic device is designed to perform multiple functions: displaying VR/AR content, capturing images/videos through external devices, mirroring external device screens, and providing user interaction interfaces. This multi-functional approach allows a single device to replace multiple separate devices, enhancing adaptability without proportionally increasing complexity.
Solution Approach 2:
The wearable device acts as an intermediary between the user and external devices (smartphones, tablets, computers). It captures images/videos from external devices, displays them in VR/AR environments, and provides control interfaces, thereby mediating the interaction and enhancing user experience without requiring direct connection between all external devices and the virtual environment.
2Ease of operation
If the device integrates multiple functions for external device control, then user interaction is enhanced, but the device structure becomes more complex
Solution Approach 1:
The patent combines multiple control functions (image capture, video recording, screen mirroring, and interaction control) into a single integrated wearable device. The processor coordinates these functions through a unified system that manages external device connections, VR/AR content generation, and user interface presentation, thereby simplifying the user experience despite the multifunctional capability.
3Reliability
If the device provides seamless integration with external devices, then user immersion is improved, but system coordination complexity increases
Solution Approach 1:
The wearable device implements feedback mechanisms where the processor continuously monitors the state of external devices, adjusts VR/AR content generation accordingly, and coordinates screen mirroring operations. This feedback loop ensures seamless integration by dynamically adapting the system behavior based on external device status, user actions, and environmental conditions.
Solution Approach 2:
The device performs preliminary actions by pre-establishing connections with external devices, pre-processing images and videos for VR/AR display, and pre-configuring control interfaces before actual user interaction begins. This preparation reduces the coordination complexity during active use, as the system is already configured and ready for seamless operation.
Data Source
AI summary
An electronic device is provided. The electronic device includes a display, a communication module, and at least one processor operatively connected to the display and the communication module, wherein the at least one processor is configured to activate a virtual reality (VR) application, identify at least one marker image included in a VR content based on displaying the VR content related to a first external device connected through the communication module while the VR application is executed, identify an area for mirroring a screen of the first external device based on the at least one marker image, based on matching of account information included in the at least one marker image and account information of the VR application, and display a screen of the first external device on the area.