Head-Mounted Display Image Processing for Shielded Mode Transition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Head-mounted displays of the shielded type pose challenges in providing visibility of the surrounding situation without discomfort, especially when transitioning between virtual and real-world views, leading to potential safety issues and increased power consumption due to the need for additional processing and camera integration for augmented or mixed reality applications.
Innovation Solution
An image processing apparatus with a signal processing unit, correction unit, and synthesis unit that acquires and corrects captured images, synthesizes virtual objects with real-world images, and controls the display panel to minimize delay and power consumption, allowing seamless transition between virtual and real-world views without removing the headset.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a shielded head-mounted display is used to block external vision for immersive virtual reality, then immersion in virtual content is improved, but visibility of the surrounding situation deteriorates
Solution Approach 1:
The patent segments the display function into two modes: a shielded mode for immersive virtual reality and a transparent mode for viewing the surrounding situation. The liquid crystal panel can be selectively controlled to switch between these modes, allowing the user to partition the functionality based on immediate needs rather than having a fixed design.
Solution Approach 2:
The patent introduces a dynamic switching mechanism that allows the head-mounted display to transition between shielded and transparent states. The liquid crystal panel's optical properties can be dynamically changed by applying or removing voltage, enabling real-time adaptation between immersion and awareness modes.
2Reliability
If a camera is added to provide surrounding visibility during virtual reality mode, then safety is improved, but power consumption increases
Solution Approach 1:
The patent utilizes the display panel's own capability to display captured images directly, eliminating the need for separate camera processing and display systems. The liquid crystal panel serves dual purposes: as the primary display for virtual content and as a window for displaying real-world captured images, reducing overall system power consumption.
Solution Approach 2:
The liquid crystal panel performs multiple functions: displaying virtual reality content, displaying captured real-world images for safety awareness, and switching between transparent and opaque states. This multi-functionality reduces the need for additional dedicated components, thereby lowering power consumption.
3Object-affected harmful factors
If external images are displayed during virtual reality content to show surrounding situation, then awareness of environment is improved, but immersion in virtual content deteriorates
Solution Approach 1:
The patent employs dynamic switching between shielded and transparent modes, allowing the user to transition between immersive virtual reality and environmental awareness as needed. This dynamic control resolves the contradiction by making the system adaptable to different user priorities at different times.
Solution Approach 2:
The patent enables periodic switching between immersion mode and awareness mode, allowing users to alternately experience full virtual reality immersion and check their surrounding environment. This periodic transition satisfies both requirements by providing them at different intervals rather than simultaneously.
4Manufacturing precision
If various correction processes are performed on captured images before synthesis, then image quality is improved, but processing delay increases
Solution Approach 1:
The patent performs only the essential correction processes needed for adequate image quality rather than exhaustive corrections. By selecting and applying only the necessary corrections (such as basic distortion correction and color balance), the system achieves sufficient image quality while minimizing processing delay.
Data Source
AI summary
Disclosed herein is an image processing apparatus including: a signal processing unit configured to acquire data of a captured image; a correction unit configured to correct the captured image to an image suitable for display; a synthesis unit configured to synthesize an image for synthesis transmitted from an apparatus, which is not provided integrally with the image processing apparatus, with the captured image; and an image display controlling unit configured to control a display panel to display the synthesized image. The correction unit carries out, from among processes for correcting the captured image to the image suitable for display, part of the correction processes for the captured image before the synthesis by the synthesis unit and carries out remaining correction processes for the image after the synthesis.