Signal Processing Device Frame Skipping Threshold Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional moving image encoding techniques at high resolution and low bit rates result in image quality degradation due to inadequate frame skipping algorithms, which are not scene-specific and fail to accurately determine motion, leading to unnatural images and inefficient compression.
Innovation Solution
A signal processing device that dynamically adjusts the frame skipping threshold using pixel movement information, angular velocity sensor data, and frequency information to determine whether to skip frames, ensuring only necessary frames are skipped, thereby increasing the number of bits allocated for encoding and maintaining natural image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If simple frame skipping algorithm is used to reduce frame rate, then target bit rate is achieved, but visual quality becomes significantly unnatural
Solution Approach 1:
The patent changes the parameter used for frame skipping determination from simple frame count to pixel difference magnitude. By calculating the actual pixel-level differences between frames and using these quantitative measurements to decide which frames to skip, the system achieves better visual quality while maintaining target bit rate.
Solution Approach 2:
The patent replaces the mechanical/simple frame skipping approach with a computational/image processing-based approach. Instead of uniformly skipping frames based on simple counters, the system uses pixel difference calculations and motion analysis to intelligently determine which frames should be skipped, substituting brute-force methods with sophisticated image analysis.
2Quantity of substance
If pixel difference between input frame and reference frame is used to determine frame skipping, then frames with small motion are skipped, but frames with high-frequency components suffer degradation
Solution Approach 1:
The patent applies local quality analysis by examining pixel differences in specific regions and contexts rather than treating the entire frame uniformly. By analyzing local motion patterns and frequency characteristics in different areas, the system can make nuanced decisions about which frames to skip, preserving quality in high-frequency regions while still achieving compression in appropriate areas.
Solution Approach 2:
The patent introduces dynamic adjustment of frame skipping decisions based on real-time analysis of pixel difference magnitudes and motion characteristics. Rather than using a static threshold, the system dynamically adapts its frame skipping strategy based on the actual content and motion patterns observed in each sequence of frames.
3Device complexity
If same algorithm is applied to any scenes to determine frame skipping, then processing is simplified, but compression efficiency decreases in scenes with large motion
Solution Approach 1:
The patent makes the frame skipping algorithm dynamic by adjusting its behavior based on the characteristics of each scene. The system analyzes motion magnitudes and patterns and adapts its frame skipping threshold and strategy accordingly, allowing it to be more aggressive in low-motion scenes and more conservative in high-motion scenes, thereby optimizing compression efficiency across diverse content.
Solution Approach 2:
The patent changes the parameters of the frame skipping algorithm based on scene characteristics. By monitoring motion magnitudes, pixel difference distributions, and other scene-specific metrics, the system dynamically adjusts its frame skipping parameters to match the content being encoded, improving compression efficiency without requiring multiple complex algorithms.
Data Source
AI summary
A frame skipping process suited to a scene is achieved by providing an encoder which encodes input image data, an encoding determination unit which compares image movement information with a threshold to determine whether or not encoding is to be performed, a frame skipping controller which performs a frame skipping control if encoding is not to be performed, and a threshold correction unit which corrects the encoding determination threshold based on the result of the encoding process. The image movement information used in the encoding determination unit is any one or a combination of pixel movement information obtained by a representative point matching scheme performed by a pixel movement calculation unit, angular velocity sensor information obtained from a lens controller, and frequency information obtained from an image processor.