Virtual Viewpoint Path Interpolation to Reduce Motion Sickness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for generating virtual viewpoint paths in virtual viewpoint images are prone to unintended deviations due to user operational errors, leading to steep changes that can cause visual motion sickness, especially when playback speeds vary.
Innovation Solution
A system that includes an obtaining module for a first virtual viewpoint path, a selecting module to choose multiple viewpoints, and a generating module to interpolate between these viewpoints, thereby smoothing the path.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a user manually designates position information for virtual viewpoints at short intervals, then a virtual viewpoint path can be easily generated with continuous input, but unintended deviations and steep changes may occur due to operational errors
Solution Approach 1:
The patent introduces an intermediary processing step between manual input and final path generation. A smoothing algorithm acts as a mediator that processes the raw user-inputted position information, filtering out operational errors and steep changes while preserving the overall intended path. This intermediary layer resolves the contradiction by allowing easy manual input while ensuring precision through automated smoothing.
Solution Approach 2:
The system performs self-correction by automatically detecting and smoothing steep changes in the virtual viewpoint path without requiring additional user intervention. The smoothing algorithm analyzes the input path and autonomously adjusts position information to eliminate unintended deviations, enabling the system to serve itself in correcting operational errors.
2Object-affected harmful factors
If playback speed of the virtual viewpoint image is increased to reduce the effect of steep changes, then visual motion sickness may be reduced, but the overall viewing time increases
Solution Approach 1:
The patent converts the harmful effect of steep changes in the virtual viewpoint path into a benefit by using it as a criterion for smoothing. The system identifies steep changes (which cause motion sickness) and applies smoothing algorithms to eliminate them, thereby transforming the problem of steep changes into an opportunity to improve viewer comfort without affecting playback speed or viewing time.
3Object-affected harmful factors
If the virtual viewpoint path is smoothed by interpolating between selected viewpoints, then steep changes are reduced and visual comfort is improved, but the complexity of the path generation process increases
Solution Approach 1:
The patent applies segmentation by dividing the virtual viewpoint path into discrete segments between selected key viewpoints. The smoothing process operates on these segmented portions independently, interpolating position information between key points. This segmentation approach simplifies the overall process by breaking down the complex smoothing task into manageable segments rather than processing the entire path at once.
Data Source
AI summary
A key frame setting part reads out a base virtual viewpoint path that has been generated and is stored in a virtual viewpoint path memory part. A key frame number receiving part obtains an input value as the number of key frames. A key frame setting part selects virtual viewpoint parameters of the obtained number of key frames, from the virtual viewpoint parameters of the respective frames included in the virtual viewpoint path that has been read out. A virtual viewpoint path regenerating part interpolates virtual viewpoint parameters corresponding to the respective frames between key frames, based on the virtual viewpoint parameters of the key frames that are stored in a key frame storage part.