Saliency-Based Panning Speed Control for Panoramic Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Consuming panoramic and 360° images can be tedious and inefficient due to the need for substantial head movements or repeated inputs to view entire images, especially on devices not designed for such displays, as users struggle to examine areas behind them or navigate large fields of view effectively.
Innovation Solution
A method that varies panning speeds of images based on saliency, allowing users to efficiently move through images by determining panning speeds based on the importance of displayed and non-displayed areas, enabling faster movement through less important regions and slower movement through salient areas, thereby enhancing the viewing experience in virtual reality and other displays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If panoramic images are displayed with uniform panning speed, then the entire image can be viewed systematically, but important areas may be missed or viewed too quickly
Solution Approach 1:
The patent applies dynamics by making the panning speed variable rather than uniform. The system dynamically adjusts panning speed based on the saliency of different image regions, slowing down when approaching important areas and speeding up through less important areas. This resolves the contradiction by adapting the operation to preserve important information while maintaining ease of use through automated speed control.
Solution Approach 2:
The system uses feedback from saliency detection algorithms to control panning speed. The saliency map provides continuous feedback about the importance of different regions, and this feedback is used to automatically adjust the panning speed without requiring user intervention. This resolves the contradiction by using automated feedback-based control to preserve important information while keeping the operation simple.
2Loss of information
If head-worn displays require substantial head movements to view areas behind the user, then the entire panoramic image can be examined, but the viewing process becomes difficult and uncomfortable
Solution Approach 1:
The patent applies dynamics by enabling the field of view to move dynamically through the panoramic image without requiring proportional head movements. The system dynamically adjusts the displayed portion based on saliency, allowing the view to jump to or linger on important areas regardless of the user's head position. This resolves the contradiction by decoupling image navigation from physical head movement effort.
Solution Approach 2:
The system performs self-service by automatically navigating the panoramic image based on saliency detection, without requiring the user to perform substantial head movements. The displayed portion automatically adjusts to show important areas, and the panning speed automatically varies to ensure important regions are viewed adequately. This resolves the contradiction by making the system navigate itself based on content importance rather than user physical effort.
3Adaptability or versatility
If devices not designed for panoramic displays are used, then panoramic images can be viewed on standard devices, but the user must provide lengthy and repeated inputs to view the entire image
Solution Approach 1:
The patent applies dynamics by making the panning speed variable based on saliency rather than uniform. The system dynamically speeds up through less important areas and slows down in important areas, automatically optimizing the viewing time. This resolves the contradiction by using adaptive speed control to reduce total viewing time while maintaining compatibility with standard devices.
Solution Approach 2:
The system changes the parameter of panning speed based on the saliency of different image regions. By varying this parameter dynamically, the system optimizes the time required to view the entire image, spending more time on important areas and less time on less important areas. This resolves the contradiction by using parameter variation to reduce overall viewing time while maintaining device compatibility.
Data Source
AI summary
A method, apparatus and computer program product are provided for varying panning speeds of images based on saliency such that 360-degree images, panoramic images, video images and/or other wide view area images may be efficiently displayed by varying the panning speed such that the user focuses on salient portions of the image. A panning speed is determined based on the currently displayed area and its saliency relative to the saliency of non-displayed or peripheral portions. As a user pans from one area to another, while the user pans over a salient portion of the image, the actual reflected panning may occur at a relatively slower speed than when the user pans over an area not including a salient portion, or a less salient portion.