Adaptive Video Processing Circuitry Using Sub-Frame Metadata
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video processing systems fail to effectively convert high-definition video content for display on small screens, such as handheld devices, resulting in reduced image quality due to limitations in screen resolution and human eye perception, leading to loss of details like facial expressions and text.
Innovation Solution
A video processing system that generates sub-frame metadata, allowing for the creation of sub-frames tailored to specific screen sizes and resolutions, which are then processed and displayed on target video players, enhancing image quality on smaller screens by dividing scenes into sub-scenes and adjusting metadata accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If video content is converted for small screens using conventional compression methods, then storage requirements are reduced, but image quality and detail perception deteriorate
Solution Approach 1:
The video frame is divided into multiple sub-frames, each representing a specific region of interest. This segmentation allows selective processing where high-quality detail is preserved in important regions (facial expressions, text) while other regions use standard compression, resolving the contradiction between storage efficiency and image quality.
Solution Approach 2:
Different quality levels are applied to different regions of the video frame. Regions containing important details (faces, text, action elements) receive enhanced processing and higher quality encoding, while less important background areas use standard compression. This local quality approach maintains overall image quality while managing storage requirements.
2Ease of operation
If video is displayed on small screens with limited resolution, then device portability is improved, but detail perception capability deteriorates
Solution Approach 1:
The system performs preliminary identification of important regions and generation of corresponding sub-frames before the viewing process. This advance preparation ensures that critical details are captured and prepared for enhanced display, compensating for the limitations of small screen resolution and maintaining detail perception capability on portable devices.
Solution Approach 2:
The patent introduces a temporal dimension by creating multiple sub-frames from a single video frame that can be displayed across multiple time periods. This allows the viewer to examine details that would otherwise be lost in a single static low-resolution display, effectively recovering detail perception capability on small portable screens.
3Productivity
If conventional video encoding is used for HD content, then compression efficiency is improved, but adaptability to different screen sizes deteriorates
Solution Approach 1:
The system dynamically adjusts the number, size, and positioning of sub-frames based on the target display characteristics. Different screen sizes and resolutions trigger different sub-frame configurations, allowing the same encoded video data to adapt efficiently to various display devices from mobile phones to large screens while maintaining compression efficiency.
Solution Approach 2:
The sub-frame encoding structure serves multiple functions simultaneously: it provides efficient compression, enables adaptability to different screen sizes, and preserves detail information. This multi-functional approach resolves the contradiction between compression efficiency and adaptability, as the same encoding framework achieves both goals.
Data Source
AI summary
Video player circuitry used with encoded source video and a display. Decoder circuitry receives encoded source video and decodes the encoded source video to produce a sequence of full frames of video data. Pre-processing circuitry, pursuant to sub-frame information, generates a plurality of sequences of sub-frames of video data from the sequence of full frames of video data, a first sequence of the plurality of sequences of sub-frames of video data having a different center point within the sequence of full frames of video data than that of a second sequence of the plurality of sequences of sub-frames of video data. Post-processing circuitry, pursuant to supplemental information, modifies the plurality of sequences of sub-frames of video data to produce an output. Interface circuitry that delivers the output for subsequent presentation on the display.