Plenoptic Camera Readout Control for Display Delay Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In plenoptic image capturing apparatuses with microlens arrays, there is a temporal delay between the actual object and its displayed video due to the processing time for display, especially as the number of pixels increases, and skipping pixels to reduce this delay is not feasible without considering the microlens and pixel arrangement.
Innovation Solution
The apparatus includes a lens array, an image sensor, a display unit, a recording unit, and a readout control unit with specific readout modes to prioritize pixel readout based on microlens positions, allowing for efficient data reading and display processing to minimize delays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the number of pixels in the image sensor is increased to improve image quality, then the image capturing performance is improved, but the processing time for display increases causing noticeable delay between the actual object and displayed video
Solution Approach 1:
The patent divides the pixel array into multiple regions (first region and second region) based on their spatial positions and microlens associations. The readout control unit selectively reads out pixels from different regions in different sequences, segmenting the readout process to prioritize certain areas for display while maintaining others for recording, thereby reducing display delay without sacrificing overall image quality
Solution Approach 2:
The patent performs preliminary readout of pixels in the first region that correspond to microlens positions before completing the full raster scan. By reading out and preparing display data from specific pixel regions in advance, the system reduces the time needed to display the image while still capturing information from all pixels for recording purposes
2Loss of information
If a raster scan scheme is used to read out all pixels sequentially to form complete video data, then the video data is complete, but the delay between actual object and displayed video becomes noticeable
Solution Approach 1:
The patent segments the pixel readout process into multiple regions and sequences. Instead of reading all pixels in a single raster scan sequence, the system divides pixels into first region (prioritized for display) and second region (processed subsequently), allowing incomplete but representative video data to be displayed while maintaining the ability to record complete data
Solution Approach 2:
The patent applies partial readout action by reading out only certain pixel regions (first region) immediately for display purposes, rather than completing the full raster scan before display. This partial action provides sufficient video data for timely display while the system maintains the capability to process complete data for recording
3Loss of time
If pixels are skipped at predetermined intervals to reduce display delay, then the display time is reduced, but the expected display image cannot be formed without considering microlens array arrangement
Solution Approach 1:
The patent applies local quality by differentiating pixel regions based on their specific positions and microlens associations. Instead of uniform pixel skipping, the system selectively reads out pixels from the first region (associated with specific microlens positions) while maintaining the structural integrity of the display image through region-based processing that respects the microlens array arrangement
Solution Approach 2:
The patent introduces the microlens position information as an intermediary factor in the readout control process. The readout control unit uses microlens position data to determine which pixels should be read out first, acting as a mediator between the microlens array structure and the pixel readout sequence, thereby enabling timely display while maintaining image quality
Data Source
AI summary
An image capturing apparatus comprises a lens array, an image sensor, a display unit, a recording unit configured to record the video data read out from the image sensor, a readout control unit which has a first readout mode of reading out video data of pixels in first regions coinciding with a position relative to each lens and a second readout mode of reading out video data of pixels in second regions, and a control unit configured to perform control, upon reading out video data from the image sensor in the first readout mode, to read out video data from the image sensor in the second readout mode and display a video obtained from the video data read out in the first readout mode, and to record the video data read out in the second readout mode.