Electronic Device Frame Processing for Smooth Video Output
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices struggle to output frames smoothly to display devices due to inefficient calculation efficiency when using full resolution frames for color space conversion, resulting in a frame per second (FPS) of only 7 to 10, which is not sufficient for a seamless video experience.
Innovation Solution
The electronic device captures and processes a combination of frames with full and half resolutions, converting and encoding them to output frames with the half-resolution frames being magnified to match the full-resolution frames, thereby improving calculation efficiency and increasing FPS.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If full resolution frames are used for color space conversion, then image quality is maintained, but calculation efficiency deteriorates and FPS decreases to 7-10
Solution Approach 1:
The patent segments the frame processing into two types: full resolution frames (N frames) and half resolution frames (M frames). By dividing the processing workload and using different resolution levels for different frames, the system achieves both high image quality and high FPS. The half resolution frames are processed at lower computational cost while full resolution frames maintain quality, resolving the contradiction between processing speed and quality.
Solution Approach 2:
The patent applies local quality by using different resolution levels for different frames based on their importance or content characteristics. Important frames are processed at full resolution while less critical frames are processed at half resolution. This localized approach to quality optimization allows the system to maintain high FPS while preserving image quality where needed.
2Productivity
If half resolution frames are used for color space conversion, then calculation efficiency improves and FPS increases to 14-17, but image quality deteriorates
Solution Approach 1:
The patent segments frames into full resolution and half resolution categories, processing them differently. Half resolution frames are used for frames where computational efficiency is prioritized, while full resolution frames are used for frames where image quality is critical. This segmentation allows the system to achieve high FPS through half resolution processing while maintaining image quality through selective full resolution processing.
Solution Approach 2:
The patent changes the resolution parameter dynamically based on frame characteristics and processing requirements. By alternating between full resolution and half resolution frame processing, the system optimizes the balance between computational efficiency and image quality. The resolution parameter is adjusted to achieve 14-17 FPS while maintaining acceptable image quality for the application.
3Measurement precision
If all frames are processed at full resolution, then image quality is consistent, but processing time increases and smooth video output is achieved only at low FPS
Solution Approach 1:
The patent segments the frame processing pipeline into fast-track (half resolution) and quality-track (full resolution) paths. This segmentation allows the system to reduce processing time for frames that don't require full resolution, thereby decreasing overall processing time while maintaining image quality consistency for critical frames. The interlaced storage of different resolution frames enables efficient processing and smooth video output.
Solution Approach 2:
The patent implements periodic action by alternating between full resolution and half resolution frame processing in an interlaced manner. The processing unit captures (N+M) frames with alternating resolution levels, creating a periodic pattern that optimizes both processing time and image quality. This periodic mixing of resolution levels allows the system to achieve high FPS while maintaining acceptable quality consistency.
Data Source
AI summary
An electronic device includes a display unit; a memory unit; and a processing unit electrically connected to the display unit and the memory unit, the processing unit capturing (N+M) frames displayed by the display unit, N and M being positive integers, the N frames having a first resolution, the M frames having a second resolution, the first resolution being larger than the second resolution, the processing unit converting a color space of the (N+M) frames and encoding the (N+M) frames, the processing unit magnifying a size of each of the M frames to be equal to a size of each of the N frames, the processing unit encapsulating and outputting the (N+M) frames.