External Display Content Continuity Using Virtual AR Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users wearing augmented reality (AR) devices experience content disruption when external display devices go out of view or come into view, disrupting the seamless mixed reality experience.
Innovation Solution
An electronic device equipped with a camera, communication circuit, and display, which identifies external display devices in and out of view, produces virtual objects, and reproduces content accordingly, ensuring continuous AR service.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the AR device relies on the external display device being within view to provide content, then the system structure remains simple, but the content service continuity is disrupted when the display device leaves the view
Solution Approach 1:
The patent creates a virtual object that copies the external display device's appearance and reproduces its content when the display device leaves the view. The virtual object is generated based on image information captured by the camera and stored display device characteristics, allowing content continuity without the physical display device being visible
Solution Approach 2:
The processor acts as an intermediary between the external display device and the user's view. It receives content from the display device, processes it through image recognition and virtual object generation, and delivers continuous content delivery even when the display device is out of view
2Ease of operation
If the AR device continuously monitors the external display device position, then content transition smoothness is improved, but the energy consumption increases
Solution Approach 1:
The system uses periodic camera capture and image processing to monitor the external display device position. Instead of continuous monitoring, the camera captures images at intervals, and the processor determines whether the display device is in view based on these periodic samples, reducing energy consumption while maintaining smooth content transitions
Solution Approach 2:
The system implements feedback through camera-based detection of the external display device position. The processor continuously receives image information, determines the display device's presence in the view, and adjusts content delivery accordingly, enabling smooth transitions while optimizing energy usage through event-driven processing
3Adaptability or versatility
If the AR device displays content within the virtual object area, then the mixed reality experience is optimized, but the risk of overlapping with real objects increases
Solution Approach 1:
The patent applies local quality by making the virtual object's display area adaptive to its spatial position and characteristics. The content is reproduced within the virtual object's boundaries, which are determined based on the external display device's original position and size information, ensuring content remains localized and avoids overlapping with unrelated real-world objects
Solution Approach 2:
The system resolves potential overlapping by utilizing depth information and spatial positioning in three-dimensional space. The virtual object is positioned and sized according to the external display device's spatial characteristics, creating a layered mixed reality experience where virtual content coexists with real objects without harmful overlap
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
An electronic device includes a camera, a communication circuit, and at least one processor configured to receive, via the communication circuit, information related to content reproduced by an external display device, obtain, by the camera, a first image including the external display device, based on the external display device being identified to be outside of an identifiable range of the camera, generate a virtual object corresponding to the external display device, obtain the content reproduced by the external display device, based on the information related to the content reproduced by the external display device, and reproduce the obtained content within an area of the virtual object.