Virtual Camera Position Adjustment for VR to MR Mode Transition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In head-mounted displays (HMDs), switching between virtual reality (VR) and mixed reality (MR) modes causes sudden changes in the position or size of virtual objects due to differences in virtual camera placement, disrupting the user's immersive experience.
Innovation Solution
An image processing apparatus that adjusts the virtual camera's position based on the user's gaze information, particularly when the gaze is minimal, such as during blinking, to smoothly transition between VR and MR modes without perceived changes in object size or position.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the virtual camera position is changed to switch between VR and MR modes, then the display mode adaptability is improved, but the user experience stability deteriorates due to sudden changes in object position and size
Solution Approach 1:
The system performs preliminary action by detecting gaze information in advance and determining the appropriate timing for virtual camera position changes. By using gaze detection before mode switching, the system prepares for the transition at the optimal moment, ensuring that position changes occur when they will be least noticeable to the user, thus maintaining experience stability while enabling mode adaptability.
Solution Approach 2:
The system implements feedback by continuously monitoring gaze information and using it to control the virtual camera position changes. The gaze detection provides real-time feedback about user attention, allowing the system to adjust camera positioning dynamically based on where the user is looking, thereby smoothing transitions between VR and MR modes without disrupting the user experience.
2Manufacturing precision
If the virtual camera position is adjusted based on gaze information, then the image quality is improved by preventing sudden object size changes, but the device complexity increases due to gaze detection requirements
Solution Approach 1:
The HMD device integrates multiple functions including gaze detection, virtual camera control, and mode switching within a single system. By making the device universal and multi-functional, the gaze detection capability serves multiple purposes: it improves image quality during transitions, enables adaptive mode switching, and provides user interaction data, thereby reducing the relative impact of added complexity while achieving multiple benefits simultaneously.
Data Source
AI summary
An image processing apparatus displaying an image of an appearance of a virtual object from a virtual camera to a head mounted display. Memories store programs including instructions for obtaining degree information indicating a degree of gaze for the virtual object of a user wearing the head mounted display and changing an optical axis position of the virtual camera. Selectively switching one of the images to another, includes a virtual image corresponding to an appearance of a virtual space from the virtual camera in which the virtual object is arranged, and a mixed image in which a captured image is overlapped by an image corresponding to an appearance of the virtual object, and the head mounted display displays the image as the display image, and changing the position of the virtual camera in the optical axis direction based on the degree information when the plurality of images is selectively switched.