Motion Compensation for Consistent Image Regions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic apparatuses struggle to provide smooth motion compensation in areas where motion is consistently maintained, leading to phenomena such as freezing or jumping of motion, which can result in an uncomfortable viewing experience.
Innovation Solution
The electronic apparatus identifies areas where motion is consistently maintained within an input image, calculates motion information and representative motion information, and applies motion correction values to these areas to perform motion compensation, thereby generating an output image with smooth motion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If motion compensation is applied to the entire image uniformly, then processing is simplified, but motion freezing and jumping occur in areas where motion is not consistent
Solution Approach 1:
The patent divides the input image into multiple regions based on motion characteristics. A motion detection unit identifies regions with consistent motion patterns, and a motion compensation unit applies different compensation strategies to different regions. This segmentation allows the system to apply motion compensation selectively only where needed, avoiding uniform processing complexity while improving motion smoothness in critical areas.
Solution Approach 2:
The patent implements local quality by applying different motion compensation parameters to different regions of the image. Regions with consistent motion receive enhanced compensation to eliminate freezing and jumping, while regions with inconsistent or no motion receive minimal or no compensation. This localized approach optimizes motion smoothness where it matters most without unnecessarily complicating processing elsewhere.
2Reliability
If motion correction values are applied to all areas, then motion consistency is improved, but artifacts are generated in areas where motion is not maintained
Solution Approach 1:
The system segments the image into motion-consistent regions and motion-inconsistent regions. By detecting which regions maintain consistent motion patterns across frames, the system applies motion correction values only to those specific regions. This prevents artifacts from being generated in areas where motion correction would not be appropriate, while still achieving motion consistency where it can be reliably detected.
Solution Approach 2:
The patent employs feedback mechanisms where motion detection units continuously monitor motion patterns and provide feedback to the motion compensation unit. This feedback loop allows the system to adjust correction values dynamically based on actual motion behavior, applying corrections only when motion consistency is confirmed and avoiding artifact generation in regions where motion patterns break down.
3Productivity
If frame interpolation is performed without motion compensation, then processing speed is maintained, but motion smoothness deteriorates due to freezing and jumping
Solution Approach 1:
The patent segments the frame interpolation process into two stages: first, rapid frame interpolation without full motion compensation to maintain processing speed; second, targeted motion compensation applied only to motion-consistent regions to improve motion smoothness. This segmentation allows the system to achieve both speed and quality by avoiding the computational burden of full motion compensation across the entire image for every frame.
Solution Approach 2:
The system applies local quality by performing comprehensive motion compensation only in regions where motion consistency is detected, while using simpler interpolation methods for the rest of the image. This selective approach maintains overall processing speed while significantly improving motion smoothness in critical areas, resolving the contradiction between productivity and reliability.
Data Source
AI summary
An electronic apparatus including memory storing one or more instructions and at least one processor that is connected with the memory and controls the electronic apparatus, wherein the at least one processor is configured to, by executing the one or more instructions, identify an area where a motion is maintained in an input image, identify motion information of the identified area and representative motion information of the identified area, identify a motion correction value based on the identified motion information and the identified representative motion information, perform motion compensation for an input frame included in the input image by applying the identified motion correction value to the identified area, obtain an interpolation frame by applying the identified motion correction value to the identified area, and obtain an output image based on the input frame for which the motion compensation was performed and the obtained interpolation frame.