Head Mounted Display Screen Overlay via Camera Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of virtual reality head-mounted displays (HMDs) face the inconvenience of needing to remove and reposition the device to check notifications on their mobile devices, which can cause power drain and require invasive app installations.
Innovation Solution
A system and method that uses a head-mounted display with a video camera to detect and superimpose the mobile device screen onto the HMD's display, allowing users to view notifications without removing the HMD by orienting their head to capture the device screen, utilizing region detection processors and image processing techniques.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user removes the HMD to check mobile device notifications, then they can view the content clearly, but the immersive experience is interrupted and power is drained
Solution Approach 1:
The patent combines the mobile device screen viewing function with the HMD display system. The HMD camera captures the mobile device screen, and the processed image is displayed on the HMD's display device, merging the notification viewing function into the immersive environment without requiring the user to remove the HMD.
Solution Approach 2:
The patent introduces an intermediary processing system consisting of the HMD camera, processor, and display device. This intermediary system captures the mobile device screen through the camera, processes the image data, and presents it on the HMD display, allowing indirect viewing of notifications while maintaining the immersive experience.
2Ease of operation
If the user removes the HMD to check mobile device notifications, then they can view the content, but the immersive experience is broken
Solution Approach 1:
The patent merges the mobile device notification viewing into the HMD's immersive display environment. By capturing the mobile screen through the HMD camera and displaying it on the HMD's display device, the system allows notification checking without breaking the immersive experience, as everything is viewed through the HMD lens.
Solution Approach 2:
The intermediary processing system acts as a bridge between the mobile device and the user's immersive experience. The camera captures the notification content, the processor handles the image data, and the display device presents it within the immersive environment, maintaining experience continuity while enabling notification access.
3Ease of operation
If traditional methods are used to check notifications, then mobile device content can be viewed, but app installations and synchronisation are required
Solution Approach 1:
The system enables the HMD to independently capture and display mobile device notifications without requiring additional apps on the mobile device or complex synchronization setups. The HMD's camera directly captures the screen content, and the onboard processor handles the display, making the system self-sufficient and eliminating setup complexity.
Solution Approach 2:
The patent creates a visual copy of the mobile device screen content by capturing it with the HMD camera and displaying it on the HMD's display device. This optical copying method eliminates the need for digital synchronization, app installations, or data transfer protocols, simplifying the system requirements while achieving the same notification viewing goal.
Data Source
Figure 1
Figure 2
AI summary
A system for displaying a mobile device screen comprises a head mounted display for displaying a first content to a user, a video camera mounted on the head mounted display, the video camera operable to capture a video image of a scene in front of the user, a region detection processor operable to detect a region of the captured video image comprising a mobile device screen, and an image processor operable to replace a corresponding region of the displayed first content in the head mounted display with the detected region of the captured video image comprising the mobile device screen.