Omnidirectional Image Selection for Viewpoint Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users experience a mismatch between their physical relation to objects in their real-life environment and the virtual environment when viewing omnidirectional images, leading to a reduced sense of immersion due to discrepancies in camera viewpoint and object positioning.
Innovation Solution
A method and processor system that select an omnidirectional image based on metadata matching the physical relation between the camera viewpoint and objects in the scene to the user's current environment, using viewer data to identify the best matching image and adjust the display to align with the user's proprioceptive awareness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a fixed camera viewpoint is used to capture omnidirectional images, then the image capture process is simple, but the user experience suffers from mismatch between real-life physical relation and virtual scene perspective
Solution Approach 1:
The system dynamically selects different omnidirectional images from a plurality of captured images based on the user's current physical state (sitting or standing). When the user is detected to be sitting, a first omnidirectional image captured at a lower viewpoint is selected; when standing, a second omnidirectional image captured at a higher viewpoint is selected. This dynamic adaptation resolves the contradiction by making the capture process remain simple while the displayed perspective adapts to user conditions.
Solution Approach 2:
The system changes the parameter of camera viewpoint height by selecting from pre-captured images taken at different heights. Instead of physically moving the camera, the system changes the viewpoint parameter by selecting appropriate images based on user detection, thereby maintaining operational simplicity while improving immersion reliability.
2Reliability
If multiple omnidirectional images are captured from different viewpoints to match user positions, then user immersion is improved, but the system complexity increases
Solution Approach 1:
Multiple omnidirectional images are captured in advance from different viewpoints (sitting and standing positions) before the user views them. This preliminary capture of diverse viewpoint images allows the system to simply select from pre-prepared options based on detected user state, improving immersion without requiring complex real-time processing or multiple cameras.
Solution Approach 2:
The system creates multiple copies of omnidirectional images from the same scene but captured at different viewpoints. These copied images from various perspectives are stored and selected based on user state, allowing the system to provide viewpoint-matched content without complex real-time rendering or multiple physical cameras.
3Ease of manufacture
If the camera viewpoint height does not match the user's viewing height, then the omnidirectional image can be captured more easily, but the user experiences sensory mismatch reducing immersion
Solution Approach 1:
The image capture process is segmented into multiple separate captures at different viewpoints (sitting height and standing height). Instead of requiring a single complex adjustable-height capture, the system divides the task into multiple simpler captures taken at fixed, easily achievable heights, then selects the appropriate segment based on user state.
Data Source
Figure 1A~1B
Figure 2A~2B
Figure 3
AI summary
Some embodiments involve obtaining access to a number of omnidirectional images which each represent a different viewpoint relative to the scene, and to metadata which is indicative of a physical relation between the respective viewpoint and a physical object present in the scene. Viewer data may be obtained which is indicative of a current physical relation between a viewpoint of the user and a same type of physical object in a current viewing environment of the user. An omnidirectional image may then be selected for display by comparing the viewer data to the metadata of the omnidirectional images. In other embodiments, an omnidirectional image may have been selected, e.g., from a number of omnidirectional images or by being the only available image, and the user may be instructed to assume a viewpoint in which the physical relation to the physical object in the user's current viewing environment corresponds to the physical relation as indicated by the selected image's metadata.