Multi-Resolution Image Data Transmission for Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Increasing the resolution and frame rate of image data in image processing systems leads to increased latency due to insufficient processing speed and data transmission speed, particularly in systems where real-world movements are immediately reflected in the display.
Innovation Solution
An image processing system that produces data of multiple resolutions, extracts and connects pixel strings according to a given rule, and transmits them in a stream, adjusting the connection pixel number such that data for 1/(N+1) frames are transmitted with respect to one frame of another resolution, reducing latency by optimizing data transmission and processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the resolution and frame rate of image data are increased, then the image quality and realism are improved, but the processing time and transmission time increase causing latency
Solution Approach 1:
The image data is divided into multiple resolutions (first resolution and second resolution lower than the first), allowing different parts of the image to be processed and transmitted at different detail levels. This segmentation enables the system to maintain high resolution where needed while reducing overall data volume and processing time.
Solution Approach 2:
Different regions of the image are assigned different resolution qualities based on their importance. The image processing apparatus transmits pixel data for specific regions at the first (higher) resolution while other regions are transmitted at the second (lower) resolution, optimizing the balance between image quality and transmission efficiency.
2Productivity
If the frame rate is increased to improve responsiveness, then the immediacy of image display is improved, but the data transmission load increases causing latency
Solution Approach 1:
The high frame rate image data is segmented into multiple resolution levels, allowing the system to transmit essential frame information at high speed while maintaining the ability to provide higher resolution when bandwidth permits. This enables high frame rates without proportionally increasing transmission latency.
Solution Approach 2:
The system dynamically changes the resolution parameter of transmitted image data based on transmission conditions and requirements. By adjusting the resolution parameter, the system can maintain high frame rates while controlling data transmission volume and latency.
3Adaptability or versatility
If multiple resolutions are transmitted to maintain both quality and responsiveness, then the adaptability is improved, but the data volume and processing complexity increase
Solution Approach 1:
The image processing apparatus segments the image data into predetermined regions and assigns different resolutions to different regions. This structured segmentation simplifies the management of multi-resolution data compared to handling entire images at multiple resolutions, reducing processing complexity while maintaining adaptability.
Data Source
AI summary
An image pickup apparatus includes an image data production unit which produces data of images of a plurality of resolutions, from an image frame obtained by picking up an image of a target object as a moving picture for each pixel string which configures a row, and an image sending unit which extracts, from the data of the images of the plurality of resolutions, pixel strings of a region requested from a host terminal and connect the extracted pixel strings for each number of pixels determined in accordance with a given rule to produce a stream and then transmit the stream to the host terminal. The image sending unit adjusts a connection pixel number of data of an image of a particular resolution such that, where N is an integer, data for 1/(N+1) frame are transmitted with respect to one frame of data of an image of the other resolution.