Tele-Existence HMD View Switching to Reduce VR Sickness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The integration of tele-existence technology with head-mounted displays (HMDs) faces challenges in maintaining user experience due to discomfort and VR sickness caused by changes in the HMD's height position, which can disrupt the immersive experience by altering the view-point of real and virtual objects.
Innovation Solution
An information processing system that includes an acquisition unit for capturing real-world images, an image generation unit for creating AR images with virtual objects, and a detection unit to switch between AR and VR modes when the HMD's height position changes, ensuring a seamless and comfortable user experience by adjusting the display to remove real-world objects and present virtual objects from new view-points.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the HMD position in the height direction changes to provide head tracking functionality, then the sense of immersion into the video world is improved, but VR sickness and discomfort occur due to altered view-points of real and virtual objects
Solution Approach 1:
The system dynamically switches between AR mode and VR mode based on the detected change in HMD position. When the HMD moves vertically beyond a threshold, the system transitions from displaying the first image (AR mode with real-world objects) to the second image (VR mode without real-world objects), making the display adaptable to head position changes and preventing VR sickness
Solution Approach 2:
The display content is segmented into two distinct modes: AR mode showing both real and virtual objects, and VR mode showing only virtual objects. This segmentation allows the system to provide appropriate visual content for different head positions, maintaining immersion while avoiding the harmful effects of viewpoint mismatch
2Adaptability or versatility
If the view-point of real and virtual objects is maintained consistent with the robot's imaging device position, then the tele-existence experience is improved, but the HMD's head tracking function cannot be effectively utilized
Solution Approach 1:
The system dynamically adjusts the viewpoint reference between the robot's imaging device position and the HMD's detected head position. In AR mode, the viewpoint is based on the robot's position for authentic tele-existence. In VR mode, the viewpoint switches to the HMD's head position to enable effective head tracking, thus accommodating both requirements
Data Source
AI summary
A control device generates a first image in which, together with an object in the real world appearing in an image captured by a camera of a robot, a virtual object appears and which presents an exterior appearance of the virtual object while the position of the camera of the robot is set as a view-point. An HMD displays the first image generated by the control device. In a case in which the position of the HMD in the height direction changes, the control device generates a second image from which the object in the real world is deleted and which presents the exterior appearance of the virtual object viewed from a new view-point according to the change in the position of the HMD in the height direction. The HMD displays the second image in place of the first image.