Image Pickup Apparatus Dynamic Pixel String Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Increasing the resolution and frame rate of image data in image processing systems leads to increased latency due to insufficient processing speed and data transmission speed, particularly in systems where real-time reflection of movement in the actual world is required.
Innovation Solution
An image pickup apparatus and information processing system that produce and transmit image data by dividing pixel strings into units based on a given rule, allowing for flexible determination of fixed or variable unit sizes depending on the image type, and a display apparatus that receives and processes these units to minimize latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the resolution and frame rate of image data are increased to improve image quality and processing accuracy, then the data amount to be processed increases, but the processing speed and data transmission speed become insufficient, causing latency to increase
Solution Approach 1:
The patent divides image data into multiple pixel strings along the horizontal direction, treating each pixel string as an independent processing unit. This segmentation allows the system to process and transmit image data in smaller, manageable chunks rather than handling the entire high-resolution image at once, thereby reducing processing time and latency while preserving the ability to achieve high resolution through proper assembly of the segmented units
2Productivity
If the resolution and frame rate are increased to improve image quality, then the data amount increases, but the processing speed and transmission speed are insufficient, causing latency to increase
Solution Approach 1:
The patent segments image data into multiple pixel strings that can be processed and transmitted independently. This allows the system to maintain high frame rates by processing smaller units concurrently rather than being bottlenecked by the total data volume of high-resolution images, thus achieving both high productivity and reduced latency
Solution Approach 2:
The patent dynamically adjusts the number of pixel strings to be processed based on the image type and requirements. By making the processing unit count variable rather than fixed, the system can optimize the balance between processing speed and image quality in real-time, allowing high frame rates without excessive latency when conditions permit
3Device complexity
If the unit number of pixels for connection is fixed to simplify processing, then the processing complexity decreases, but the adaptability to different image types and requirements is reduced
Solution Approach 1:
The patent makes the unit number of pixels for connection a variable parameter that can be dynamically adjusted based on image type and processing requirements. This dynamic configuration allows the same basic processing architecture to adapt to different scenarios (e.g., different resolutions, frame rates, and image types) without increasing fundamental processing complexity, thus achieving both simplicity and versatility
Data Source
AI summary
An image pickup apparatus includes: an image data production unit configured to produce data of a plurality of kinds of images from an image frame obtained by picking up an image of an object as a moving picture for each of pixel strings which configure a row; and an image sending unit configured to extract a pixel string in a region requested from a host terminal from within the data of each of the plurality of kinds of images and connect the pixel strings to each other for each unit number of pixels for connection determined on the basis of a given rule to produce a stream and then transmit the stream to the host terminal. The image sending unit switchably determines whether the unit number of pixels for connection is to be set to a fixed value or a variable value in response to the kind of each image.