Merge Buffer Reducing Kernel Communication Latency in Video Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cellular handsets face limitations in video processing due to stringent power requirements and limited image sensor and lens size, leading to high communication latency and power consumption during video processing.
Innovation Solution
Implementing a merge buffering system in a virtual machine environment within a mobile multimedia processor, where video data is stored in a merge buffer and communicated to the kernel via function calls or kernel remote procedure calls when the buffer is full, reducing the need for frequent and costly kernel interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If frequent kernel interactions are used for video processing, then video processing responsiveness is improved, but communication latency and power consumption increase
Solution Approach 1:
The patent implements a merge buffer that collects and pre-processes multiple kernel interaction requests before actually communicating with the kernel. This preliminary buffering action allows the system to maintain responsive video processing by having requests ready while reducing communication latency by batching multiple interactions into fewer, more efficient kernel calls.
2Speed
If frequent kernel interactions are used for video processing, then video processing responsiveness is improved, but power consumption increases
Solution Approach 1:
The merge buffer performs preliminary collection and processing of kernel interaction requests, consolidating multiple smaller interactions into fewer larger batches. This reduces the total number of kernel interactions required, thereby decreasing power consumption while maintaining video processing responsiveness through the buffered request mechanism.
Solution Approach 2:
The patent merges multiple individual kernel interaction requests into a single consolidated communication cycle through the merge buffer. By combining multiple requests that would otherwise be sent separately, the system reduces the frequency of kernel interactions, which directly lowers power consumption while preserving video processing performance.
3Loss of time
If merge buffering is implemented, then communication latency and power consumption are reduced, but device complexity increases
Solution Approach 1:
The merge buffer acts as an intermediary component between the video processing application and the kernel. This intermediate buffering layer absorbs the complexity of request consolidation and scheduling, shielding the upper layers from direct kernel interaction complexity while reducing communication latency through batched requests.
Solution Approach 2:
The merge buffer is implemented as a universal mechanism that handles multiple types of kernel interactions (function calls, remote procedure calls) through a single unified buffering structure. This multi-functional approach reduces overall system complexity by providing a single pattern for handling various communication scenarios rather than requiring separate optimization for each interaction type.
Data Source
AI summary
Methods and systems for reducing communication during video processing utilizing merge buffering are disclosed and may include storing data in a merge buffer in the virtual machine layer in a wireless communication device comprising a virtual machine user layer, a native user layer, a kernel, and a video processor. The data may then be communicated to the kernel via the native user layer. The data may include function calls, and/or kernel remote procedure calls. The data may be communicated via an application programming interface. Video data may be processed in the video processor based on the communicated data. The virtual machine user layer may include a Java environment. The data may be communicated to the kernel via the native user layer when the merge buffer is full or filled to a predetermined level.