Image-Capturing Device Virtual Pixel Synthesis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing image synthesis-capable cameras are limited by the size of micro-lenses, resulting in pixel sizes and resolution equivalent to the micro-lenses, and the number of photoelectric conversion elements is restricted by miniaturization, limiting the adjustability of the image synthesizing plane's depth.
Innovation Solution
An image-capturing device with a photographic optical system, a photoelectric conversion element array, and a micro-lens array, utilizing filter matrix data to create pixel data at specific image forming planes, allowing for image synthesis with pixels smaller than micro-lenses, and adjusting the image forming plane's position along the optical axis to optimize resolution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the number of photoelectric conversion elements is increased to improve image synthesizing plane adjustability, then finer adjustment of image synthesizing plane position is achieved, but the size of individual photoelectric conversion elements must be reduced which limits miniaturization and increases device complexity
Solution Approach 1:
The patent transitions from physical pixel arrangement to mathematical pixel synthesis. Instead of increasing photoelectric conversion elements physically, it uses filter matrix data to create virtual pixels through mathematical processing of light flux distributions, adding a computational dimension to resolve the contradiction between adjustability and physical constraints
Solution Approach 2:
The patent changes the parameter of pixel definition from physical photoelectric conversion element size to virtual pixel size determined by filter matrix data. This allows pixel size to be smaller than micro-lens size without physical constraints, enabling finer image synthesizing plane adjustment without increasing device complexity
2Measurement precision
If pixel size is reduced to increase resolution, then image resolution improves, but the number of photoelectric conversion elements must increase which is limited by miniaturization
Solution Approach 1:
The patent creates virtual pixel copies through filter matrix data processing. Instead of physically reducing pixel size by adding more photoelectric conversion elements, it generates multiple virtual pixel representations from the same physical elements, achieving higher resolution without increasing physical density
Solution Approach 2:
The patent introduces a computational dimension where pixel size is defined mathematically rather than physically. Virtual pixels can be smaller than physical micro-lenses because their size is determined by filter matrix data and light flux distribution calculations, not by physical photoelectric conversion element dimensions
3Measurement precision
If filter matrix data is applied to create pixel data with distribution centers at projection image centers, then high-definition images with four times resolution are achieved, but the processing complexity increases
Solution Approach 1:
The patent performs preliminary filtering by applying filter matrix data to create pixel data at a specific image forming plane before image synthesis. This pre-processing step organizes light flux distribution data in advance, making the subsequent synthesis process more efficient and manageable despite the increased resolution requirement
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables the generation of high-definition images with four times the resolution of traditional cameras by using virtual pixels and adjusting the focal plane within a specific range relative to the micro-lens array, overcoming the limitations of micro-lens size and photoelectric conversion element density.
Implementation Method 1
a micro-lens array disposed between the photographic optical system and the photoelectric conversion element array and made up with a plurality of micro-lenses arrayed therein
Implementation Method 2
a photoelectric conversion element array made up with a plurality of photoelectric conversion elements, each of which receives a light flux having been transmitted through the photographic optical system and outputs a signal
Data Source
AI summary
An image-capturing device includes: a photographic optical system; a photoelectric conversion element array made up with a plurality of photoelectric conversion elements arrayed therein; a micro-lens array made up with a plurality of micro-lenses arrayed therein; a data creation unit that creates pixel data at a plurality of pixels on a specific image forming plane by applying filter matrix data to output signals provided from the plurality of photoelectric conversion elements; and an image synthesis unit that synthetically generates an image on the specific image forming plane at a given position assumed along an optical axis of the photographic optical system, based upon the pixel data. The filter matrix data assume a two-dimensional data array pattern conforming to a specific intensity distribution with a distribution center thereof set at an element corresponding to a central position of a projection image of each of the plurality of pixels.