Wearable Display Overlay for External Object Integration in VR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable devices in VR, AR, and MR environments struggle to effectively integrate external objects into virtual spaces, limiting user interaction and immersion.
Innovation Solution
A wearable device equipped with a camera, display, and processing circuitry identifies metadata of external objects, tracks their movement, and overlays their image portions onto virtual spaces, allowing seamless integration of external objects into the displayed environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If external objects are integrated into virtual spaces in VR/AR/MR environments, then user interaction and immersion are enhanced, but device complexity increases
Solution Approach 1:
The patent uses metadata as an intermediary to bridge external objects and virtual spaces. The processor identifies metadata corresponding to external objects captured by the camera, then uses this metadata to generate image portions that are integrated into the virtual space. This intermediary approach allows seamless integration without requiring complex direct mapping mechanisms.
Solution Approach 2:
The patent creates image portions that are copies or representations of external objects and integrates them into the virtual space. Instead of directly manipulating or tracking every detail of external objects, the system generates simplified image portions based on camera captures and metadata, reducing computational complexity while maintaining immersion.
2Ease of operation
If metadata identification and image portion generation are performed in real-time, then user interaction responsiveness is improved, but processing time and energy consumption increase
Solution Approach 1:
The system performs preliminary identification of metadata corresponding to external objects as they are captured by the camera. By preparing and processing metadata in advance before full integration into the virtual space, the system reduces real-time processing requirements and improves responsiveness without significant time loss.
3Adaptability or versatility
If the virtual space is continuously updated with external object image portions, then immersion is enhanced, but energy consumption increases
Solution Approach 1:
The system updates the virtual space with external object image portions periodically or triggered by specific events (such as object movement or user interaction), rather than continuously. This periodic update approach maintains immersion by keeping the virtual space current while significantly reducing energy consumption compared to continuous real-time updates.
Data Source
AI summary
A wearable device may comprise: a camera; a display; at least one processor comprising processing circuitry; and a memory storing instructions, wherein at least one processor, individually and/or collectively, is configured to execute the instructions and to cause the wearable device to: receive, while a virtual space is displayed on the display, an input requesting display, on the display, of an external object within an external space around the wearable device; identify metadata corresponding to the external object designated by the input; identify a first area regarding movement of the external object, from the metadata based on the identification of the metadata; identify a first image portion of a first image, corresponding to the first area within the first image obtained by the camera; and change a first virtual space, corresponding to the first area within the virtual space and displayed on the display, to the first image portion of the first image.