Video Frame Interpolation Around Dynamic UI Overlays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The display of dynamic user interfaces (UI) surfaces, such as advertisements, on electronic devices interferes with video frame interpolation, leading to reduced video fluency and definition due to changes in UI surfaces affecting motion calculation.
Innovation Solution
The electronic device divides the video surface into multiple areas and determines a frame interpolation area based on UI surface coverage, using an independent frame interpolation chip to perform processing only on areas not covered by UI surfaces.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If frame interpolation processing is performed on the entire video surface, then video fluency and definition are improved, but power consumption increases and processing efficiency decreases when UI surfaces are present
Solution Approach 1:
The video surface is divided into multiple regions based on UI surface coverage status. The system identifies regions covered by UI surfaces and excludes them from frame interpolation processing, while applying interpolation only to regions not covered by UI surfaces. This segmentation approach maintains video fluency in relevant areas while reducing overall power consumption by avoiding unnecessary processing in UI-covered regions.
2Reliability
If frame interpolation processing is performed on the entire video surface, then video definition is improved, but processing time increases and efficiency decreases
Solution Approach 1:
The video surface is segmented into UI-covered regions and non-UI-covered regions. The system determines which regions require frame interpolation based on UI coverage status, applying processing only to appropriate regions. This reduces total processing time and improves efficiency while maintaining video definition quality in regions where it is most needed.
Solution Approach 2:
Instead of performing frame interpolation on the entire video surface (excessive action), the system applies partial interpolation only to regions not covered by UI surfaces. This partial action approach maintains sufficient video definition where required while significantly reducing processing time and improving overall efficiency.
3Adaptability or versatility
If dynamic UI surfaces are displayed on the video, then user interaction and advertising capabilities are improved, but motion calculation accuracy deteriorates affecting frame interpolation
Solution Approach 1:
The system segments the video surface into regions based on UI coverage and uses this information to determine where frame interpolation should be applied. By excluding UI-covered regions from interpolation processing, the system avoids motion calculation errors caused by UI surface changes, while still allowing flexible UI display in those regions.
Solution Approach 2:
The system applies different processing qualities to different regions: frame interpolation is applied to regions without UI coverage for high motion calculation accuracy, while UI-covered regions are processed differently to accommodate dynamic UI content. This local quality approach allows both accurate motion interpolation and flexible UI display in their respective regions.
Data Source
AI summary
A frame interpolation method includes in a case that the AP master chip obtains a video surface of a to-be-displayed target video, performing area division on the video surface, to obtain M areas, where M is an integer greater than 1; determining a frame interpolation area from the M areas according to whether there is UI surface coverage in the video surface; and performing, by the independent frame interpolation chip, frame interpolation processing on the frame interpolation area.