Selective Pixel Repetition for High-Frame-Rate Video Artifact Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for upgrading motion pictures from 24 frames-per-second to 48 frames-per-second result in undesirable artifacts due to the repetition of entire frames, especially in scenes with complex or chaotic motion, which degrades the image quality and creates a stuttering effect, incompatible with contemporary high-frame-rate presentation standards.
Innovation Solution
A method that selectively repeats only the corrupted pixels from affected frames, rather than entire frames, allowing uncorrupted pixels to be treated normally for interpolation, thereby minimizing repetition and maintaining seamless motion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If entire frames are repeated when corrupted pixels are detected, then image corruption is prevented, but image quality degrades and stuttering artifacts occur
Solution Approach 1:
The patent divides the frame into individual pixels and evaluates each pixel independently for corruption. Instead of treating the entire frame as a single unit, the system segments the decision-making process at the pixel level, allowing selective repetition of only corrupted pixels while maintaining normal interpolation for uncorrupted pixels. This segmentation resolves the contradiction by preventing whole-frame repetition artifacts while still protecting against corruption.
Solution Approach 2:
The patent applies different quality treatments to different parts of the same frame based on local corruption assessment. Uncorrupted pixels receive normal interpolation treatment for smooth motion, while only corrupted pixels receive repetition treatment for protection. This local differentiation resolves the contradiction by maintaining high image quality in uncorrupted regions while ensuring reliability in corrupted regions.
2Speed
If frame rate is doubled from 24 to 48 fps, then motion smoothness improves, but artifacts from low-frame-rate photography become more noticeable
Solution Approach 1:
The patent extracts and removes the harmful artifact-causing elements (corrupted pixels) from the frame before interpolation. By identifying and isolating corrupted pixels through quality assessment, the system prevents these elements from contributing to motion artifacts during high-frame-rate conversion. This extraction approach allows smooth high-frame-rate playback while eliminating the source of artifacts.
Solution Approach 2:
The patent converts the potentially harmful effect of corrupted pixels into a benefit by using quality assessment to identify them. The corruption detection mechanism, which might seem like an additional complication, actually benefits the process by preventing corrupted pixels from causing artifacts. The harmful corruption is transformed into useful information for selective pixel treatment.
3Productivity
If motion vector analysis is used for interpolation, then new frames can be synthesized, but complex or chaotic motion causes corruption
Solution Approach 1:
The patent introduces dynamic quality assessment that adapts to the complexity of motion in each pixel. The system dynamically evaluates whether a pixel's motion is too complex or chaotic for reliable interpolation, and adjusts its treatment accordingly. This dynamic approach resolves the contradiction by enabling synthesis for simple motions while protecting against corruption in complex motions.
Solution Approach 2:
The patent implements a feedback mechanism where the results of motion vector analysis are evaluated for quality, and corrupted pixels are identified and marked for repetition. The quality assessment feedback loop allows the system to detect when interpolation has failed due to complex motion and correct it by repeating the previous pixel value. This feedback approach maintains productivity while ensuring reliability.
Data Source
AI summary
Previously-produced motion pictures are enhanced for theatrical exhibition, at double the frame rate at which they were originally produced. New, rendered images are interpolated between each of the images of the original motion picture. For image pixels containing excessively complex motion, those pixels are corrected to eliminate such complexity. This correction is accomplished by selecting the specific pixels that are too complex to be made a part of a synthesized image, rejecting them, and repeating only those appropriate pixels as they appeared in the previous frame; and by treating all other pixels in other images in a normal manner, known in the art. The pictures are projected through digital means at 48 frames-per-second. The invention allows for upgrade of previously-produced motion pictures for high-frame-rate presentation without repeating any frames, improving the quality of presentation by eliminating any appearance consistent with low-frame-rate photography and presentation.