Imaging method and imaging device

Abstract

To provide an imaging method and an imaging device that can obtain reconstructed images at high speed and high resolution.SOLUTION: A method has a step for superimposing the image of the 10 imaging targets and a plurality of projection patterns onto a linear image sensor 3 with at least two or more unit elements arranged one-dimensionally, and a step for performing optimization calculations in the light gathering direction of the linear image sensor 3 based on the plurality of one-dimensional imaging data acquired by the linear image sensor 3.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an imaging method and imaging apparatus for reconstructing a two-dimensional image or a three-dimensional image from imaging data acquired by an image sensor. [Background technology]

[0002] Conventionally, single pixel imaging (SPI) and high-speed camera technology using CCD / CMOS are known as technologies for reconstructing two-dimensional or three-dimensional images from imaging data acquired by an image sensor.

[0003] SPI is a technology that reconstructs an image of an object by repeatedly capturing images of the object by focusing light onto an image sensor that has been superimposed with a special projection pattern, and then performing statistical processing, linear transformation, optimization calculations, etc. based on the multiple captured image data. In addition, since SPI uses a photodiode, which is a unit element of the image sensor, it has a higher degree of freedom in the wavelength band that can be captured compared to high-speed camera technology using CCD / CMOS, and in principle, high-speed imaging based on the high-speed response of the photodiode is possible.

[0004] The imaging device of Patent Document 1 reconstructs a three-dimensional image using SPI, and includes a spatial light modulator provided between a light source that irradiates illumination light and an object to be imaged, a lens arranged so that the illumination light patterned by the spatial light modulator is imaged on the object to be imaged, and an imaging element that acquires imaging data carried by the reflected or transmitted light of the illumination light from the object to be imaged, and changes a multi-value two-dimensional projection pattern displayed on the spatial light modulator over time, captures the relationship between the projection pattern displayed on the spatial light modulator and the imaging data acquired for each unit element of the imaging element when the projection pattern is displayed for each display of the projection pattern, reconstructs a two-dimensional element image for each unit element based on the imaging data captured for each projection pattern, and reconstructs a three-dimensional image of the object to be imaged based on the reconstructed two-dimensional element image for each unit element, thereby providing excellent resolution and resolution in the depth direction. The imaging element used in Patent Document 1 is a two-dimensional array of unit elements. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2020-136837 A (pages 5 to 6, Figure 1) Summary of the Invention [Problem to be solved by the invention]

[0006] However, in order to obtain a high-resolution three-dimensional image using the imaging device of Patent Document 1, it is necessary to reconstruct a high-resolution two-dimensional elemental image by capturing imaging data based on many projection patterns for each unit element, which results in a problem that the imaging process takes a long time.

[0007] The present invention has been made in view of the above problems, and has an object to provide an imaging method and imaging apparatus capable of obtaining a reconstructed image at high speed and with high resolution. [Means for solving the problem]

[0008] In order to solve the above problems, the imaging method of the present invention comprises: forming an image of the image pickup target and light having a plurality of projection patterns superimposed thereon on a linear image sensor having at least two unit elements arranged one-dimensionally; and performing an optimization calculation for the light collecting direction of the linear image sensor based on a plurality of one-dimensional imaging data acquired by the linear image sensor. According to this feature, the one-dimensional imaging data acquired by the linear image sensor is continuous data without duplication or loss in the direction perpendicular to the light collection direction, and the data is not compressed, so that an optimization calculation is performed in the light collection direction based on multiple one-dimensional imaging data, and the result is combined with data in the direction perpendicular to the light collection direction to obtain a high-resolution reconstructed image at high speed with a small number of projection patterns. In addition, the imaging method of the present invention does not require mechanical scanning by forming an image of the imaging target and light in which multiple projection patterns are superimposed on the linear image sensor, and therefore can be applied to the imaging of various imaging targets.

[0009] The method is characterized by comprising a step of performing an optimization calculation in a light collecting direction of the linear image sensor, and then performing an optimization calculation in a direction perpendicular to the light collecting direction. According to this feature, first, an optimization calculation is performed in the light-collection direction of the linear image sensor, which has many overlaps and defects, and then a two-stage optimization calculation is performed in the direction perpendicular to the light-collection direction, thereby making it possible to obtain a reconstructed image with higher resolution.

[0010] The optimization calculation of the focusing direction of the linear image sensor is characterized by performing a calculation based on Equation 1 based on matrix A representing the irradiation of the multiple projection patterns, matrix B for finding the total variation, vector X^ representing one line in the focusing direction of the image to be reconstructed, and vector y representing the shooting data, thereby minimizing the squared error of one line in the focusing direction between the shooting data and the reconstructed image, and the total variation in one line in the reconstructed image. According to this feature, one line is reconstructed by performing an optimization calculation for each line in the focusing direction, and a similar optimization calculation is repeated a predetermined number of times according to the number of pixels of the imaged object, thereby obtaining a reconstructed image at high speed and with high resolution.

[0011]

number

[0012] The optimization calculation of the light collecting direction of the linear image sensor and the optimization calculation of the direction perpendicular to the light collecting direction are characterized in that the same mathematical formula is used. According to this feature, a reconstructed image can be obtained quickly and with high resolution.

[0013] The matrix A is characterized in that it includes matrix conditions that represent a physical photographing process in which a plurality of the projection patterns are irradiated and one-dimensionally collected by an optical system. According to this feature, a reconstructed image can be obtained quickly and with high resolution.

[0014] The imaging device of the present invention comprises: a spatial light modulator that outputs a plurality of projection patterns; a linear image sensor having at least two unit elements arranged one-dimensionally; an imaging means for forming an image of an object to be imaged and light in which the plurality of projection patterns are superimposed on the linear image sensor; and an analysis means for performing an optimization calculation for the light collecting direction of the linear image sensor based on a plurality of one-dimensional imaging data acquired by the linear image sensor. According to this feature, the one-dimensional imaging data acquired by the linear image sensor is continuous data without duplication or loss in the direction perpendicular to the light collection direction, and the data is not compressed, so that an optimization calculation is performed in the light collection direction based on multiple one-dimensional imaging data, and the result is combined with data in the direction perpendicular to the light collection direction to obtain a high-resolution reconstructed image at high speed with a small number of projection patterns. In addition, the imaging device of the present invention does not require mechanical scanning by forming an image of the imaging target and light in which multiple projection patterns are superimposed on the linear image sensor, and therefore can be applied to the imaging of various imaging targets.

[0015] The analyzing means performs an optimization calculation in a light collecting direction of the linear image sensor, and then performs an optimization calculation in a direction perpendicular to the light collecting direction. According to this feature, by performing two-stage optimization calculations in the light collecting direction of the linear image sensor and in a direction perpendicular to the light collecting direction, a reconstructed image with higher resolution can be obtained.

[0016] The spatial light modulator is characterized in that it is a digital micromirror device. According to this feature, it becomes possible to output a detailed projection pattern at high speed, so that a reconstructed image can be obtained at higher speed and with higher resolution.

[0017] The imaging means is characterized in that it is a cylindrical lens. According to this feature, it is possible to one-dimensionally form an image of the imaging target and light in which a plurality of projection patterns are superimposed on the linear image sensor with a simple configuration. [Brief description of the drawings]

[0018] [Figure 1] FIG. 1 is a schematic diagram illustrating an imaging device according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a diagram showing the procedure of an imaging method in an embodiment. [Diagram 3]1A is an imaging target, and FIG. 1B is a reconstructed image of the imaging target reconstructed by an imaging method using the imaging device of the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] The inventors have discovered that, similar to single-pixel imaging (SPI), light with a projection pattern superimposed on an image of the subject is focused onto a linear image sensor in which unit elements are arranged one-dimensionally, and this shooting is repeated while changing the projection pattern, and based on the multiple one-dimensional imaging data obtained, optimization calculations are performed on the light collection direction of the linear image sensor. This makes it possible to reconstruct images with improved resolution while significantly reducing the number of shots compared to SPI, and also enables image reconstruction with improved resolution at a frame rate significantly higher than high-speed camera technology using CCD / CMOS.

[0020] The image reconstruction is performed by performing an optimization calculation for each line in the light collection direction to reconstruct one line. This process can be expressed as follows using the following mathematical formula 2.

[0021]

number

[0022] Here, X is a vector representing one line in the light collection direction of the object to be found, A is a matrix representing the irradiation of multiple projection patterns and the light collection by the optical system, and B is a vector representing the intensity data when multiple projection patterns are irradiated. For example, if the number of pixels of the imaging target is N×N pixels and the number of times the projection pattern is irradiated is M, the row vector of matrix A represents a certain projection pattern (N-dimensional vector), and if the number of times the projection pattern is irradiated is M, M different row vectors will be lined up in the column direction, and matrix A will be an M×N matrix. Also, the size of vector X is N×1, and the size of vector B is M×1.

[0023] If the inverse matrix of matrix A could be found, vector X could be easily found. However, since there is no inverse matrix for this matrix A, vector X^ is estimated by performing the following optimization using the above-mentioned formula 1, with the condition that the total variation of vector X^ is sparse.

[0024] The present invention reconstructs a two-dimensional image or a three-dimensional image at high speed and with high resolution by performing an optimization calculation in the light collection direction of the linear image sensor based on a plurality of one-dimensional imaging data acquired by one-dimensionally forming an image on the linear image sensor for each projection pattern. Preferably, in addition to the optimization calculation in the light collection direction, an optimization calculation in a direction perpendicular to the light collection direction is performed to reconstruct a two-dimensional image or a three-dimensional image at high speed and with higher resolution. The following formula 1 is used for this two-stage optimization calculation.

[0025]

number

[0026] Here, A is a matrix representing the irradiation of multiple projection patterns, B is a matrix for calculating the total variation, X^ is a vector representing one line in the light collection direction of the image to be reconstructed, and y is a vector representing the shooting data, and the optimization calculation using the above formula minimizes the square error between the shooting data and one line in the light collection direction of the image to be reconstructed, and the total variation in one line in the image to be reconstructed. Furthermore, matrix A includes the conditions of the matrix representing the physical shooting process of irradiation of multiple projection patterns and one-dimensional focusing by the optical system. Note that various parameters that reflect errors and the like according to the shooting conditions may be added to the above formula.

[0027] Preferably, the matrix B in the formula (1) is a matrix for calculating the total variation, and is a matrix for performing an operation to obtain the difference between adjacent pixels of the vector X^. This optimization operation reconstructs one line in the light collection direction of the imaging target, and this operation is repeated a total of N times in the direction perpendicular to the light collection direction to reconstruct an image of N×N pixels. That is, this optimization operation reconstructs an image compressed in the light collection direction, making it possible to reconstruct an image of N×N pixels. Preferably, a similar optimization is performed in the direction perpendicular to the light collection direction to reconstruct an image of N×N pixels from which noise has been removed.

[0028] Furthermore, in the formula (1) used in the optimization calculation, the matrix A includes the matrix conditions representing the physical imaging process of irradiating a plurality of projection patterns and focusing the light one-dimensionally by the optical system, thereby improving the analysis accuracy of the one-dimensional imaging data acquired by the linear image sensor, and enabling a reconstructed image to be obtained quickly and with high resolution.

[0029] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An imaging method and an imaging apparatus according to the present invention will be described below with reference to the following embodiments. EXAMPLES

[0030] (Imaging device) As shown in FIG. 1, the imaging device 1 in this embodiment is mainly composed of a spatial light modulator 2 capable of outputting a plurality of projection patterns onto a modulation surface 2a, a linear image sensor 3 in which unit elements are arranged one-dimensionally, a lens 4 that forms an image of an object to be imaged 10 onto the modulation surface 2a of the spatial light modulator 2, a cylindrical lens 5 as an imaging means that one-dimensionally forms light in which the image of the object to be imaged 10 and the projection pattern output onto the modulation surface 2a of the spatial light modulator 2 are superimposed onto the linear image sensor 3, an A / D converter 6 that converts the one-dimensional imaging data acquired by the linear image sensor 3 from analog data to digital data, and a personal computer 7 as an analysis means that performs optimization calculations based on the plurality of digitally converted one-dimensional imaging data and the projection pattern data of the spatial light modulator 2.

[0031] The personal computer 7 includes a memory unit that stores one-dimensional imaging data corresponding to each projection pattern output to the modulation surface 2a of the spatial light modulator 2, an analysis unit that performs two-stage optimization calculations based on the multiple one-dimensional imaging data stored in the memory unit, and a display unit that inputs image data reconstructed by the analysis unit and displays the reconstructed image.

[0032] The spatial light modulator 2 is a digital micromirror device (DMD), and has a modulation surface 2a on which a plurality of pixel regions capable of modulating the light intensity of output light relative to input light are arranged, and it is possible to perform two or more value light intensity modulation in each of the plurality of pixel regions on the modulation surface 2a based on a set projection pattern. By using a DMD as the spatial light modulator 2, a detailed projection pattern can be output at high speed.

[0033] In this embodiment, the spatial light modulator 2 is described as outputting a black and white binary two-dimensional random pattern (see FIG. 1) as a projection pattern, but it is not limited to this, and it may be possible to output a two-dimensional random pattern consisting of three or more values ​​including values ​​having gray levels in addition to black and white, thereby reducing the number of one-dimensional imaging data required for image reconstruction and facilitating analysis. Also, the projection pattern is not limited to a random pattern, and may be set to a pattern using a Hadamard transform or a discrete cosine transform (DCT) to obtain a reconstructed image at a higher speed.

[0034] The linear image sensor 3 is a Linea HS 32k (16384 pixels, 300 KHz / line) manufactured by Teledyne DALSA.

[0035] Theoretically, the linear image sensor in the imaging method of the present invention may have two unit elements arranged one-dimensionally.

[0036] The lens 4 is a biconvex lens, and forms an image of the imaging target 10 on the modulation surface 2 a of the spatial light modulator 2 .

[0037] The imaging means is a plano-convex cylindrical lens 5, which collects the image of the object to be imaged 10 formed on the modulation surface 2a of the spatial light modulator 2 by the lens 4 and the light that is a superimposed image of the projection pattern output to the modulation surface 2a of the spatial light modulator 2, and forms a one-dimensional image on the linear image sensor 3.

[0038] In this embodiment, the light collecting direction of the linear image sensor 3 is the direction in which light is collected by the cylindrical lens 5, i.e., the short side direction of the linear image sensor 3 (see Figure 1), and the direction perpendicular to the light collecting direction of the linear image sensor 3 is the direction in which light is not collected by the cylindrical lens 5, i.e., the long side direction of the linear image sensor 3 (see Figure 1), in other words, the direction in which the unit elements that make up the linear image sensor 3 are arranged one-dimensionally.

[0039] (Imaging Method) Next, an imaging method using the imaging device 1 in this embodiment will be described with reference to the flowchart in Fig. 2. First, an image of the imaging target 10 is formed on the modulation surface 2a of the spatial light modulator 2 by the lens 4 (step S01), a preset projection pattern is output to the modulation surface 2a of the spatial light modulator 2 (step S02), and light in which the image of the imaging target 10 and the projection pattern output to the modulation surface 2a of the spatial light modulator 2 are superimposed is one-dimensionally formed on the linear image sensor 3 by the cylindrical lens 5 (step S03).

[0040] Next, when one-dimensional imaging data is acquired by the linear image sensor 3 (step S04), the one-dimensional imaging data is converted from analog data to digital data by the A / D converter 6 (step S05), and the digitally converted one-dimensional imaging data is linked to the projection pattern data output to the modulation surface 2a of the spatial light modulator 2 at the time of shooting and stored in the memory unit of the personal computer 7 (step S06).

[0041] Next, the personal computer 7 determines whether the number of one-dimensional imaging data stored in the storage unit has reached the same number as the preset number of imaging times (step S07). Note that steps S02 to S07 are repeated while changing the projection pattern output to the modulation surface 2a of the spatial light modulator 2 until the number of one-dimensional imaging data stored in the storage unit reaches the preset number of imaging times.

[0042] Next, when the number of one-dimensional imaging data stored in the memory unit reaches a preset number of shots, the analysis unit performs an optimization calculation (step S08) in the focusing direction of the linear image sensor 3 based on the multiple one-dimensional imaging data and the projection pattern data using the above-mentioned formula, and then performs an optimization calculation (step S09) in the direction perpendicular to the focusing direction of the linear image sensor 3 using the same formula.

[0043] Next, in the analysis section, step S0 8 and step S0 9 An image is reconstructed (step S10) by combining the results of the optimization calculations in the above steps, and the reconstructed image is displayed on the display unit (step S11).

[0044] The spatial light modulator 2 is connected to the personal computer 7, and information such as the preset number of times of shooting and the projection pattern output to the modulation surface 2a of the spatial light modulator 2 for each shooting is shared with the personal computer 7.

[0045] In this way, the imaging method using the imaging device 1 in this embodiment involves concentrating the light, which is a superimposition of the image of the object to be imaged 10 and the multiple projection patterns output to the modulation surface 2a of the spatial light modulator 2, using the cylindrical lens 5 to form a one-dimensional image on the linear image sensor 3.The multiple one-dimensional imaging data acquired by the linear image sensor 3 are compressed in the focusing direction of the linear image sensor 3, but are not compressed in the direction perpendicular to the focusing direction, resulting in continuous data without duplication or loss.Therefore, an optimization calculation is performed in the focusing direction of the linear image sensor 3 based on the multiple one-dimensional imaging data acquired for each projection pattern, and then an optimization calculation is performed in the direction perpendicular to the focusing direction of the linear image sensor 3.By combining these results, a reconstructed image can be obtained quickly and with high resolution using a small number of projection patterns.

[0046] The imaging method using the imaging device 1 in this embodiment allows image reconstruction with improved resolution while significantly reducing the number of times of shooting compared to conventional SPI, and also allows a significantly higher frame rate and image reconstruction with improved resolution compared to high-speed camera technology using CCD / CMOS. The reason why this enables image reconstruction with improved resolution is that, compared to SPI, which captures images by focusing light in which a projection pattern is superimposed on an image of an object to be captured on a point sensor consisting of one unit element, the linear image sensor 3 has unit elements arranged one-dimensionally, thereby increasing the number of unit elements, and therefore the amount of information that can be acquired in one shot is greater. In more detail, since the linear image sensor 3 has unit elements arranged one-dimensionally, the spatial resolution is high in the longitudinal direction of the linear image sensor 3, i.e., in the direction perpendicular to the light collecting direction of the linear image sensor 3. Therefore, the one-dimensional imaging data obtained by collecting light with a projection pattern superimposed on the image of the object to be imaged 10 using a cylindrical lens 5 and forming a one-dimensional image on the linear image sensor 3 is compressed in the collecting direction and can be regarded as low-resolution point data similar to SPI, but is not compressed in the direction perpendicular to the collecting direction and can be regarded as high-resolution continuous data without duplication or loss.

[0047] In this way, the one-dimensional imaging data acquired by the linear image sensor 3 is continuous high-resolution data without overlap or loss in the direction perpendicular to the light collection direction of the linear image sensor 3, so a large amount of information can be acquired in one shooting, and the correlation of each piece of data is reasonably clear even without performing optimization calculations based on the multiple one-dimensional imaging data acquired for each projection pattern. Therefore, in order to reconstruct an image from the multiple one-dimensional imaging data acquired for each projection pattern, it is only necessary to find the correlation of the data in the light collection direction by performing optimization calculations based on the data in the light collection direction of the linear image sensor 3, which can be regarded as at least low-resolution point data, and as a result, it is possible to reduce the number of shootings required for image reconstruction and reconstruct an image with increased resolution.

[0048] Furthermore, in the imaging method using the imaging device 1 of this embodiment, two-stage optimization calculations are performed, one in the focusing direction of the linear image sensor 3 and the other in a direction perpendicular to the focusing direction, and the same mathematical formula is used for these optimization calculations, so that a reconstructed image can be obtained faster and with higher resolution.

[0049] Here, the results of comparing the imaging method using the imaging device 1 of this embodiment with high-speed camera technology using CMOS will be described. As the image sensor used in the high-speed camera technology, a 120MXS CMOS sensor (13272 x 9176 pixels) manufactured by Canon was used. The CMOS sensor has a frame rate of 9.4 fps, and requires 11.3 Gbps for data transfer. In contrast, the linear image sensor 3 constituting the imaging device 1 of this embodiment is a Linea HS 32k (16384 pixels, 300 KHz / line) manufactured by Teledyne DALSA. The inventors have verified that in the imaging method using the imaging device 1 of this embodiment, a sufficiently high-resolution reconstructed image (16384 x 16384 pixels) can be obtained with a number of projection patterns that is 50% of one line.

[0050] When estimating the imaging performance of the imaging method using the imaging device 1 of this embodiment under these conditions, the number of projection patterns is 8192, so it is estimated that an image of 16384 x 16384 pixels can be acquired at a frame rate of 37 fps (≒ 300 KHz / 8192). In this way, it was confirmed that the imaging method using the imaging device 1 of this embodiment enables image reconstruction with improved resolution at a significantly higher frame rate than high-speed camera technology using CMOS.

[0051] Moreover, data transfer by the imaging method using the imaging device 1 of this embodiment requires 1 Gbps, which implies that the imaging method using the imaging device 1 of this embodiment is equipped with a data compression function.

[0052] In addition, the results of comparing the imaging method using the imaging device 1 of this embodiment with SPI will be described. Considering reconstructing an image of 16384 x 16384 pixels with SPI, when using an optimization method (compressed sensing), about 10% of the number of pixels of the reconstructed image, i.e., about 26.8 million projection patterns, are required, and when using deep learning, about 2% of the number of pixels of the reconstructed image, i.e., 5.4 million projection patterns are required. In the imaging method using the imaging device 1 of this embodiment, the number of projection patterns required to reconstruct an image of 16384 x 16384 pixels is 8192, so it was confirmed that it is possible to reconstruct an image with improved resolution while significantly reducing the number of shots compared to SPI.

[0053] Although the linear image sensor 3 is assumed to have one line, by using a sensor with multiple lines, the number of times of shooting can be further reduced and image reconstruction can be performed. In this case, since the light receiving angle changes for each line of the linear image sensor, the matrix A in the optimization calculation formula is set for each line.

[0054] In addition, the imaging method using the imaging device 1 in this embodiment does not require mechanical scanning, as the image of the object 10 and light superimposed with multiple projection patterns are one-dimensionally focused on the linear image sensor 3 by the cylindrical lens 5, and therefore can be applied to the imaging of various objects.

[0055] In this embodiment, a mode of reconstructing a two-dimensional image from one-dimensional imaging data using one linear image sensor 3 has been described; however, the present invention is not limited to this. For example, a three-dimensional image may be reconstructed by applying the principle of triangulation by arranging multiple linear image sensors and acquiring one-dimensional imaging data from different angles.

[0056] Although the embodiments of the present invention have been described above with reference to the drawings, the specific configuration is not limited to these embodiments, and the present invention also includes modifications and additions that do not deviate from the gist of the present invention.

[0057] For example, in the above embodiment, the same formula is used in the two-stage optimization calculation, but this is not limited thereto, and for example, a different formula may be used in the optimization calculation in the direction perpendicular to the focusing direction.

[0058] In addition, in the above embodiment, image reconstruction is performed by analyzing one-dimensional imaging data using an optimization calculation formula. However, image reconstruction may be performed by deep learning.

[0059] Furthermore, the linear image sensor is not limited to a plurality of unit elements arranged one-dimensionally and continuously, but may be a plurality of point sensors used in SPI arranged at predetermined intervals.

[0060] Furthermore, the spatial light modulator is not limited to a DMD, but may be any device capable of performing modulation with high precision and high speed.

[0061] In addition, in the above embodiment, an embodiment has been described in which an image of the object to be imaged is formed on the modulation surface of the spatial light modulator and superimposed on the projection pattern, but the present invention is not limited to this. The projection pattern outputted to the modulation surface of the spatial light modulator may be irradiated onto the object to be imaged and superimposed on the image of the object to be imaged.

[0062] Furthermore, the imaging means is not limited to a cylindrical lens, but may be anything that can one-dimensionally image the light in which the image of the object to be imaged and the projection pattern are superimposed on the linear image sensor.

[0063] Furthermore, the light in which the image of the subject to be imaged and the projection pattern are superimposed need only be of a wavelength to which the linear image sensor is sensitive, and the image of the subject to be imaged may be obtained by illumination light from a light source set for shooting, or may be obtained by natural light such as sunlight. [Explanation of symbols]

[0064] 1 Imaging equipment 2. Spatial Light Modulator 2a Modulation surface 3. Linear image sensor 4 Lenses 5 Cylindrical lens (imaging means) 6 A / D Converter 7 Personal computer (analysis means) 10 Imaging target

Claims

1. forming an image of the light, in which the image of the object to be imaged and the plurality of projection patterns are superimposed, on a linear image sensor having at least two unit elements arranged one-dimensionally; and performing an optimization calculation for a light collection direction of the linear image sensor based on a plurality of one-dimensional imaging data acquired by the linear image sensor.

2. 2. The imaging method according to claim 1, further comprising a step of performing an optimization calculation in a direction perpendicular to the light collecting direction of the linear image sensor after performing the optimization calculation in the light collecting direction of the linear image sensor.

3. The imaging method according to claim 1 or 2, characterized in that the optimization calculation of the focusing direction of the linear image sensor is performed based on a matrix A representing the irradiation of the multiple projection patterns, a matrix B for determining the total variation, a vector X^ representing one line in the focusing direction of the image to be reconstructed, and a vector y representing the shooting data, by performing a calculation based on Equation 1, thereby minimizing the squared error of one line in the focusing direction between the shooting data and the reconstructed image, and the total variation in one line in the reconstructed image. [0010]

4. 4. The imaging method according to claim 3, wherein the same formula is used for the optimization calculation of the light collection direction of the linear image sensor and the optimization calculation of the direction perpendicular to the light collection direction.

5. 5. The imaging method according to claim 3, wherein the matrix A includes matrix conditions that represent a physical imaging process of irradiating a plurality of the projection patterns and one-dimensionally focusing the light by an optical system.

6. a spatial light modulator that outputs a plurality of projection patterns; a linear image sensor having at least two unit elements arranged one-dimensionally; an imaging means for forming an image of an object to be imaged and light in which the plurality of projection patterns are superimposed on the linear image sensor; and an analysis means for performing an optimization calculation for the light collection direction of the linear image sensor based on a plurality of one-dimensional imaging data acquired by the linear image sensor.

7. 7. The imaging apparatus according to claim 6, wherein the analyzing means performs an optimization calculation in a light collecting direction of the linear image sensor, and then performs an optimization calculation in a direction perpendicular to the light collecting direction.

8. 7. The imaging apparatus of claim 6, wherein the spatial light modulator is a digital micromirror device.

9. 7. The imaging apparatus according to claim 6, wherein said imaging means is a cylindrical lens.

Images