HMD Image Processing Seamless Real-Virtual Transition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Non-transmissive Head-Mount Displays (HMDs) disrupt the user's sense of immersion in virtual environments by abruptly transitioning from real to virtual spaces, causing a disorienting scene change.
Innovation Solution
An image processing apparatus that acquires panoramic image data, generates background image data projected onto a virtual sphere, synthesizes it with three-dimensional model data to create a seamless visual field image, and outputs this to a display device, allowing the user to see a natural transition between real and virtual environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a non-transmissive HMD displays a virtual game space, then the user experiences a complete virtual environment, but the abrupt transition from real to virtual space impairs the user's sense of immersion
Solution Approach 1:
The system performs preliminary action by capturing the real-world panoramic image before the user enters the virtual game space. This captured image is then used as the background for the virtual space, creating a seamless transition. The background image is prepared in advance to match the user's real-world view, so when the virtual space is displayed, the transition is smooth rather than abrupt.
2Loss of information
If panoramic image data is captured and projected onto a virtual sphere, then the background represents the user's real surroundings, but additional processing is required to synthesize with three-dimensional model data
Solution Approach 1:
The system merges the panoramic background image data with three-dimensional model data of the virtual game space. The background image data representing real surroundings is combined with the virtual object data in a synthesis process, allowing both real and virtual elements to coexist in the final displayed image. This merging preserves information from both sources while creating a unified visual experience.
Data Source
AI summary
An image processing apparatus connected to a display device to be mounted on the head of a user acquires panoramic image data representing a captured image around the user and generates background image data representing the panoramic image data projected onto a projection plane having a predetermined shape that is virtually disposed around the position of a user's viewpoint in a virtual space. The image processing apparatus synthesizes model image data generated on the basis of predetermined three-dimensional model data with the background image data, thereby generating synthesized image data, and outputs a visual field image of the user generated on the basis of the synthesized image data to the display device.