Frame Rate Conversion for 2D and 3D Image Sequences
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display technologies face challenges in adjusting frame rates for both two-dimensional (2D) and three-dimensional (3D) image sequences, particularly in generating intermediate images to enhance frame rates without degrading image quality or mixing viewpoint information in 3D displays.
Innovation Solution
A method and apparatus that determine whether an input image sequence is 2D or 3D, generating appropriate intermediate images to create output sequences at increased frame rates, including 2D intermediate images through motion estimation or compensation, and 3D output sequences by alternating and combining left- and right-viewpoint images, with options for doubling or quadrupling the frame rate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If intermediate images are generated to increase frame rate, then productivity is improved, but device complexity increases
Solution Approach 1:
The patent segments the frame rate conversion process into distinct pathways: one for 2D images and another for 3D images. Each pathway handles intermediate image generation independently, allowing the system to process different image types without cross-interference. This segmentation reduces overall system complexity by breaking down the complex frame rate adjustment into manageable, specialized modules.
Solution Approach 2:
The patent implements dynamic processing where the system automatically detects whether an input image is 2D or 3D and dynamically adjusts the processing pathway accordingly. This dynamic adaptation allows the system to optimize its complexity level based on the actual input type, applying simpler or more appropriate processing methods for each case rather than using a fixed complex algorithm for all inputs.
2Productivity
If 3D intermediate images are generated by combining left and right viewpoint images, then frame rate is improved, but image quality deteriorates due to viewpoint information mixing
Solution Approach 1:
The patent segments the 3D image processing into separate left-viewpoint and right-viewpoint channels. Intermediate images are generated independently for each viewpoint by processing only images from that specific viewpoint, preventing any mixing of viewpoint information. This segmentation ensures that each eye receives clean, uncontaminated 3D information while still achieving the desired frame rate increase through intermediate image insertion.
3Reliability
If frame rate is increased for 2D images, then motion blurring is reduced, but processing time increases
Solution Approach 1:
The patent performs preliminary detection of image type (2D or 3D) before committing to a processing pathway. This preliminary action allows the system to prepare and execute the most efficient processing route in advance, minimizing actual processing time. By detecting the image type upfront, the system can pre-configure the appropriate intermediate image generation strategy, avoiding time-consuming trial-and-error or post-processing adjustments.
Data Source
AI summary
Provided are a method and apparatus for displaying a two-dimensional (2D)/three-dimensional (3D) image, and apparatus to execute the same, the method including determining whether an input image sequence having a first frame rate is a 2D image sequence or a 3D image sequence, wherein, if the input image sequence is a 2D image sequence, generating a 2D output image sequence having a second frame rate, the 2D output image sequence including the input image sequence and a 2D intermediate image generated from the input image sequence, and wherein, if the input image sequence is a 3D image sequence, generating a 3D output image sequence having a third frame rate, where a left-viewpoint intermediate image, a right-viewpoint intermediate image and the input image sequence are repeatedly included in the 3D output image sequence, the left-viewpoint intermediate image is determined from at least one left-viewpoint image in a left-viewpoint image sequence included in the input image sequence, and the right-viewpoint intermediate image is determined from at least one right-viewpoint image in a right-viewpoint image sequence included in the input image sequence.