Moving Window Image Stream Region Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing client-host systems face bandwidth issues due to differences in image processing capabilities between client and host devices, leading to disrupted interactions and reduced bandwidth for other functions when encoding images for display.
Innovation Solution
A system that analyzes image streams within a moving window session, defines regions based on image content, and adjusts compression schemes and graphics settings to optimize image transmission, allowing the client device to send an indicator of the target display area's size and position, and receive optimized images from the host device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If the host device encodes (compresses) the images before sending to the client device, then the bandwidth consumption is reduced, but the image quality and processing accuracy deteriorate due to compression artifacts and loss of detail
Solution Approach 1:
The patent divides the host display area into multiple regions of interest (ROIs) and processes each region independently. By segmenting the image stream into multiple smaller regions, the system can apply different compression schemes to different regions, preserving critical visual information while reducing overall bandwidth consumption. This segmentation allows selective encoding that maintains image quality where needed while compressing less critical areas.
Solution Approach 2:
The patent implements differential compression where different regions of the display area receive different levels of compression based on their importance. Critical regions with high visual information density or user interaction potential are compressed less, while less important regions are compressed more aggressively. This local quality approach ensures that bandwidth is consumed efficiently while maintaining necessary image processing accuracy in key areas.
2Manufacturing precision
If the host device sends the full-resolution image stream to the client device, then the image quality is maintained, but the bandwidth consumption increases significantly
Solution Approach 1:
The patent extracts only the necessary portions of the full-resolution image stream by identifying and transmitting only the regions of interest. Instead of sending the complete high-resolution image, the system extracts and transmits specific regions that contain critical visual information or require user interaction. This extraction approach maintains image quality for essential content while dramatically reducing the total bandwidth consumption by omitting redundant or less important areas.
3Manufacturing precision
If the client device processes images with higher image processing capabilities, then the display quality is improved, but the device complexity and power consumption increase
Solution Approach 1:
The patent implements dynamic adjustment of image processing capabilities based on the specific requirements of each region and the available bandwidth. The system dynamically determines the appropriate processing level for each region of interest, adjusting compression ratios and processing intensity in real-time. This dynamic approach allows the client device to maintain high display quality where needed while reducing overall processing complexity and power consumption by applying lighter processing to less critical regions.
Data Source
AI summary
In one general aspect, a computer-readable storage medium storing instructions that when executed cause one or more processors to perform a process that can include sending from a client device to a host device an indicator of a size of a target display area of a moving window session with respect to a host display area of an application operating at the host device where the application can be remotely controlled via the client device. The process can include analyzing a stream of images associated with the target display area of the moving window session and defining at the client device a plurality of regions within the target display area based on the analyzing. The process can also include modifying the moving window session without terminating the moving window session and without establishing a new moving window session.