Foveated Display Recording With Boundary-Aware Resampling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Recording foveated image data for playback on non-foveated displays can lead to undesired noticeability of multiple different resolutions.
Innovation Solution
Implementing a record block that dynamically resamples multi-resolution image data to generate a consistent resolution format for recording or outputting to different electronic displays, using boundary data to demarcate adjustable regions and adjust resolutions accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If foveated image data with multiple resolutions is recorded for playback on non-foveated displays, then the content can be displayed on various display types, but the multiple different resolutions become noticeably visible and degrade playback quality
Solution Approach 1:
The system performs preliminary resampling of the foveated image data at the time of recording, converting multi-resolution content into a consistent resolution format before storage. This pre-processing ensures that when the content is later played back on non-foveated displays, no resolution artifacts are visible and the playback quality is maintained without requiring real-time processing during playback.
2Manufacturing precision
If multi-resolution image data is dynamically resampled to generate consistent resolution format, then playback quality is improved, but processing time and computational resources increase
Solution Approach 1:
The resampling operation is performed in advance during the recording phase rather than in real-time during playback. By completing the computationally intensive resampling process before the content is stored, the system achieves high playback quality without incurring processing delays during actual usage, effectively moving the time cost to a less critical phase of the workflow.
Solution Approach 2:
The system creates a processed copy of the foveated image data in a consistent resolution format suitable for non-foveated displays. This copied version is generated through resampling and stored separately, allowing the original multi-resolution data to be preserved while providing an optimized version for playback, thus avoiding the need to process the original data repeatedly during playback operations.
3Manufacturing precision
If multi-resolution image data is processed and recorded, then content quality is maintained, but storage space and resource utilization increase
Solution Approach 1:
The system generates and stores a single-resolution copy of the foveated content that is optimized for non-foveated displays. This copy contains the essential visual information in a format suitable for standard displays, allowing the original high-resolution multi-resolution data to be archived or discarded, thereby reducing storage requirements while maintaining adequate content quality for the target display type.
Data Source
AI summary
A system may include a display for displaying an image frame that is divided into regions having respective resolutions based on display image data. The system may also include image processing circuitry to generate the display image data based on multi-resolution image data and generate record image data based on the multi-resolution image data. Generating the record image data may include obtaining boundary data indicative of locations of boundaries between the regions resampling the multi-resolution image data based on the boundary data. Resampling the multi-resolution image data may include performing a first resampling on a first portion of the multi-resolution image data corresponding to a first region and performing a second resampling, different from the first resampling, on a second portion of the multi-resolution image data corresponding to a second region.