Imaging device and imaging method

Abstract

To provide an imaging device capable of achieving both angular resolution and spatial resolution or switching between the angular resolution and the spatial resolution with a simple configuration.SOLUTION: An imaging device includes an optical sensor with a plurality of sensor elements, a main lens that guides light from an object to the optical sensor, and a microlens array arranged between the optical sensor and the main lens. The microlens array has a three-layer structure of a first electrode that is transparent to visible light, a second electrode that includes a plurality of openings and is transparent to visible light that faces the first electrode, and a dielectric polymer that is arranged between the first electrode and the second electrode. When a voltage is applied, a lens is formed in the opening, and the imaging device operates selectively in a first mode having good angular resolution and a second mode having good spatial resolution depending on the level of the applied voltage.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an imaging device and an imaging method. [Background technology]

[0002] With the recent development of content including three-dimensional (hereinafter referred to as "3D") images, research on plenoptic cameras has progressed. Plenoptic cameras differ from conventional cameras that record two-dimensional light intensity distributions in that they directly obtain information on the light intensity distribution in three-dimensional space.

[0003] In a plenoptic camera, a microlens array is placed between the main lens and the image sensor to capture an aerial image as a group of light rays from a number of point light sources. Depending on the optical arrangement of the plenoptic camera, there are configurations with good angular resolution (characteristics related to perspective) and configurations with good spatial resolution (characteristics related to resolution).

[0004] As a configuration for enhancing spatial resolution, a plenoptic camera using a microlens array with different focal lengths has been proposed (see, for example, Patent Document 1). This plenoptic camera uses two or more microlens arrays with fixed shapes to capture microimages from image planes at different distances, enhancing spatial resolution in the depth direction.

[0005] On the other hand, there are known variable-focus zoom lenses that combine a liquid concave lens, in which a liquid is sealed in a transparent film, with a convex lens (see, for example, Patent Document 2), and microlens arrays that adjust the optical characteristics of an optical scatterer formed in an opening in an electrode by adjusting the applied voltage (see, for example, Patent Document 3). [Prior art documents] [Patent documents]

[0006] [Patent Document 1] U.S. Patent No. 8,400,555 [Patent Document 2] JP 2011-13578 A (Sony) [Patent Document 3] JP 2019-120947 A Summary of the Invention [Problem to be solved by the invention]

[0007] In general, it is said that there is a trade-off between angular resolution and spatial resolution in a plenoptic camera, and it is difficult to achieve both angular resolution and spatial resolution with a simple configuration. In Patent Document 1, the spatial resolution is increased by using multiple microlens arrays with fixed shapes, but there is no mention of achieving both spatial resolution and angular resolution or switching between them.

[0008] An object of the present invention is to provide an imaging device having a simple configuration that can achieve both angular resolution and spatial resolution or that can switch between the two. [Means for solving the problem]

[0009] In one aspect of the present invention, an imaging device includes a light sensor having a plurality of sensor elements, a main lens that guides light from an object to the light sensor, and a microlens array disposed between the light sensor and the main lens, The microlens array has a three-layer structure including a first electrode that is transparent to visible light, a second electrode that has a plurality of openings and is transparent to visible light and faces the first electrode, and a dielectric polymer that is disposed between the first electrode and the second electrode. Lenses are formed in the openings by application of a voltage. The imaging device selectively operates in a first mode with good angular resolution and a second mode with good spatial resolution depending on the level of the applied voltage. Effect of the Invention

[0010] An imaging device that can achieve both angular resolution and spatial resolution or switch between them with a simple configuration is realized. [Brief description of the drawings]

[0011] [Figure 1A] FIG. 1 is a diagram illustrating an optical system with good angular resolution. [Figure 1B] FIG. 1 is a diagram illustrating an optical system with good spatial resolution. [Diagram 2] 4A to 4C are schematic diagrams illustrating the operation of the optical system when a first mode with good angular resolution is selected in the imaging device of the embodiment. [Diagram 3] FIG. 13 is a schematic diagram illustrating the operation of the optical system when a second mode with good spatial resolution is selected in the imaging device of the embodiment; [Figure 4] FIG. 11 is a diagram illustrating adjustment of the focal length in the second mode. [Diagram 5] FIG. 1 is a diagram illustrating an example in which the imaging device according to the embodiment is used as a normal camera. [Figure 6] 1A to 1C are diagrams illustrating a setup for stereoscopic imaging using an imaging apparatus according to an embodiment. [Figure 7] 4 shows an image captured by controlling on / off of a voltage applied to a microlens array according to an embodiment. [Figure 8] 1 is a block diagram of an information processing apparatus incorporating an imaging apparatus according to an embodiment of the present invention. [Figure 9] 4 is a flowchart of an imaging method according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Fig. 1A is a schematic diagram of a plenoptic optical system focusing on angular resolution, and Fig. 1B is a schematic diagram of a plenoptic optical system focusing on spatial resolution. The configuration of Fig. 1A is called "Plenoptic 1.0", and the configuration of Fig. 1B is called "Plenoptic 2.0". As described later, the imaging device of the embodiment realizes both "Plenoptic 1.0" and "Plenoptic 2.0" by achieving both angular resolution and spatial resolution or making them switchable in a single imaging device.

[0013] In Fig. 1A, a light ray emitted from a point on an object OB is guided to a microlens ML1 on a microlens array MLA via a main lens Lmain. The light ray incident on the microlens ML1 is split into multiple light rays according to the direction of the light contained in the light ray, and exposes pixels P1, P2, and P3 of an image sensor IS.

[0014] In FIG. 1A, only three pixels are shown, but if the diameter of the microlens ML1 is 100 μm and one side of the pixel of the image sensor IS is 10 μm, then 10 × 10 information can be obtained in the angular direction. The distance between the microlens array MLA and the image sensor IS is the focal length f of the microlens array. The focal length f refers to the distance between the principal point pp, defined by the refractive index and curvature radius of the microlens array, and the focal point of the microlens. In FIG. 1A, the convex side of the lens faces away from the image sensor IS, but it can also face the image sensor IS side.

[0015] In the configuration of Fig. 1B, light rays emitted from a point on an object OB are collected by multiple microlenses as a virtual image on the image plane IP of the main lens Lmain. This configuration has a lower angular resolution than Fig. 1A, but because the light collected by each microlens is detected, it has a high ability to distinguish between multiple objects at different spatial positions.

[0016] The distance a from the microlens array MLA to the image plane IP of the main lens 30 and the distance b from the microlens array MLA to the image sensor IS are determined by the focal length f of the microlens. 1 / f=1 / a+1 / b In the configuration of FIG. 1B, f≠b.

[0017] In the embodiment, a variable-focus microlens array is used, the curvature of which can be controlled by controlling the applied voltage. The position of the microlens array is fixed, and the array is switched between a mode with good angular resolution and a mode with good spatial resolution by controlling the applied voltage and driving at least one of the main lens and the optical sensor.

[0018] (Switch between 1st and 2nd modes) Fig. 2 is a schematic diagram of an image capturing device 10 according to an embodiment. In Fig. 2, the image capturing device 10 operates in a first mode (see Fig. 1A) having good angular resolution. The image capturing device 10 includes a main lens 30, an optical sensor 11, and a microlens array 20 disposed between the main lens 30 and the optical sensor 11.

[0019] The microlens array 20 has a three-layer structure including a first electrode 21 that is transparent to visible light, a second electrode 23 having a plurality of openings 24 formed therein, and a dielectric polymer 22 disposed between the first electrode 21 and the second electrode 23. The first electrode 21 and the second electrode 23 are connected to a variable voltage source 26.

[0020] The dielectric polymer 22 is polyvinyl chloride (PVC), polymethyl methacrylate (PMMA), polyurethane (PU), polystyrene (PSt), polyvinyl acetate (PVAc), polyvinyl alcohol (PVA), polycarbonate (PC), polyethylene terephthalate (PET), polyacrylonitrile (PAN), silicone rubber (SR), etc. A material that is transparent to visible light and has good voltage responsiveness can be appropriately selected as the dielectric polymer 22. In the embodiment, PVC is used, which is easily handled and deforms greatly when subjected to the action of an electric field.

[0021] At least one of a plasticizer, an ionic liquid, and an ionic surfactant may be added to the dielectric polymer 22. The plasticizer provides flexibility to the dielectric polymer 22. The ionic liquid and the ionic surfactant can promote deformation of the dielectric polymer 22 and reduce the applied voltage. The dielectric polymer 22 may be dissolved in a suitable solvent.

[0022] When a first voltage is applied to the microlens array 20, a predetermined amount of the dielectric polymer protrudes from the opening 24 of the second electrode 23. The protruding polymer functions as a lens 25. The shape of the lens 25 is determined by the applied voltage, the type of dielectric polymer, the surface tension acting on the dielectric polymer, and the like.

[0023] The openings 24 have a size and shape that allows lenses 25 to be formed in the openings 24 by deformation of the dielectric polymer 22 when a voltage is applied to the microlens array 20. The planar shape of the openings 24 can be designed according to the application of the lens, such as a circle, an ellipse, an oval, or a rectangle. The planar arrangement of the openings 24 can be freely set, such as a lattice arrangement or a honeycomb arrangement. The image quality of the displayed image depends on the amount of light entering through the lenses 25 formed in the openings 24, and high image quality can be obtained by arranging the openings in such a way that the aperture ratio, which represents the area occupied by the openings, is high. The aperture ratio is preferably 50% or more.

[0024] The range of voltage applied to the microlens array 20 is 800 V or less, and more preferably 600 V or less. The voltage actually applied differs depending on whether the operation of the imaging device 10 prioritizes angular resolution or spatial resolution. Even in the same operation mode, the voltage is also affected by the size of the opening 24 of the electrode 23, the thickness of the second electrode 23, and the like.

[0025] The focal length of the lenses 25 of the microlens array 20 depends on the protruding displacement of the polymer (lens thickness) and can be controlled by the applied voltage. In this sense, the microlens array 20 may be called an "active lens." The focal length of the lenses 25 is 0.1 mm to 10 mm, depending on the diameter of the opening 24. The amount of light entering the lens depends on the brightness of the image, and it is desirable that it is as high as possible. The F-number (= focal length / lens diameter), which is a guideline for this, is preferably 8.0 or less.

[0026] The main lens 30 is a single-focus lens. The main lens 30 is disposed between the optical sensor 11 and the object to be photographed, and focuses light rays from a point on the object onto the lens 25 of the microlens array 20.

[0027] The optical sensor 11 is a CCD sensor, a CMOS sensor, or the like having a plurality of sensor elements 111. The CCD sensor, the CMOS sensor, or the like digitally detects the amount of incident light and outputs an electrical signal according to the intensity of the incident light. Each sensor element 111 may be provided with a color filter of red (R), blue (B), green (G), or the like.

[0028] When lenses 25 are formed in the microlens array 20 by applying a voltage, light rays from an object are collected by the main lens 30 and enter the lens 25. The light rays incident on the lens 25 are split into multiple sensor elements 111 covered by the lens 25. A three-dimensional image with good angular resolution is formed by computing information obtained by each sensor element 111.

[0029] In Fig. 3, the imager 10 operates in a second mode with better spatial resolution. The components of the imager 10 are the same as those in Fig. 2, including a main lens 30, a light sensor 11, and a microlens array 20 disposed between the main lens 30 and the light sensor 11.

[0030] When a voltage V2 different from that shown in FIG. 2 is applied to the microlens array 20, the protrusion amount or curvature of the lenses 25 formed in the openings 24 changes, and the focal length of the microlens array 20 changes.

[0031] Assume that the main lens 30 is a single-focus lens and the position of the microlens array 20 is fixed. The focal length of the microlens array 20 is shortened by voltage control to adjust the positions of the main lens 30 and the optical sensor 11. A virtual image on the image plane IP is focused by multiple lenses 25, and images at different spatial positions are captured by the sensor elements 111 in the areas covered by each lens 25.

[0032] 1A is not equal to the distance "b" in FIG. 1B (b ≠ f), but by changing the focal length of the microlens array 20, the distance a to the image plane IP can be adjusted to capture a 3D image with good spatial resolution. The distance b from the lens 25 to the incident surface of the optical sensor 11 may be adjusted.

[0033] (Change focal length) The microlens array 20 is capable of not only switching between the first mode and the second mode, but also adjusting the focal length in the first mode or the second mode.

[0034] Fig. 4 shows the adjustment of the focal length in the second mode with good spatial resolution. For example, only the microlens array 20 may be fixed, and the positions of the main lens 30 and the optical sensor 11 may be made variable. In Fig. 4(A), the voltage applied to the microlens array 20 is set to V1, and a lens 25 with a small curvature is formed in the aperture 24. A virtual image on the image plane IP of the main lens 30 is condensed by each lens 25 and captured by the sensor element 111 covered by this lens 25.

[0035] 4B, the voltage applied to the microlens array 20 is set to V2 (V2>V1) which is larger than V1, and lenses 25 having a larger curvature than those in FIG. 4A are formed in the aperture 24. A virtual image on the image plane IP of the main lens 30 is focused by each lens 25 and captured by the corresponding sensor element 111 of the optical sensor 11. According to the change in the focal length of the lens 25, the position of the optical sensor 11 is adjusted to adjust the distance b from the lens 25 to the sensor plane, and also to adjust the distance from the lens 25 to the image plane IP.

[0036] By using one microlens array 20 and controlling the voltage applied to the microlens array 20, it is possible to obtain closer spatial information or more distant spatial information.

[0037] This change in focal length by controlling the applied voltage can also be applied to adjusting the focal length in the first mode of Fig. 2. The position of the microlens array 20 is fixed, and the positions of the optical sensor 11 and main lens 30 are made variable to change the voltage applied to the microlens array 20. If the focal length of the lens 25 formed in the opening 24 when a voltage V1 is applied is "f", then by applying a voltage V2 larger than V1, the curvature of the lens 25 formed in the opening 24 can be increased and f can be shortened.

[0038] Even if the position of the microlens array 20 is fixed, by adjusting the positions of the optical sensor 11 and the main lens 30, it is possible to obtain angle information from a closer or more distant space.

[0039] (Switching to normal camera) 5 shows an example in which the imaging device 10 of the embodiment is used as a normal camera. When a voltage is applied to the microlens array 20, a lens 25 is formed in the opening 24 of the second electrode 23, and the imaging device 10 functions as a plenoptic camera. By turning off the voltage applied to the microlens array 20, the imaging device 10 can be used as a normal camera.

[0040] When no voltage is applied to the microlens array 20, no lens 25 is formed in the opening 24. The light emitted from the object and collected by the main lens 30 passes through the microlens array 20 as is and is collected on the optical sensor 11.

[0041] A focal point F of the main lens 30 is located at the incident surface of the light sensor 11. If the position of the microlens array 20 is fixed, the position of at least one of the main lens 30 and the light sensor 11 is adjusted so that the light beam collected by the main lens 30 is focused at the incident surface of the light sensor 11. In this arrangement, two-dimensional light intensity information is captured by the light sensor 11.

[0042] By controlling the on / off of the voltage applied to the microlens array 20, it is possible to switch between the function of a plenoptic camera and the function of a normal camera.

[0043] (Experimental Example) Fig. 6 shows a setup for stereoscopic photography using the imaging device 10 of the embodiment. As shown in Fig. 6(A), an object 50 is photographed by the imaging device 10. Fig. 6(B) shows the object 50 actually used for photography.

[0044] A plurality of lenses 25 are formed when a voltage is applied to the microlens array 20. For convenience of illustration, the first electrode 21, the second electrode 23, the dielectric polymer 22 sandwiched between the electrodes, the openings 24, etc. are omitted, and only the formed lenses 25 are shown.

[0045] The distance b from the microlens array 20 to the incident surface of the optical sensor 11 is adjusted between 0.1 and 0.5 mm. The distance L from the microlens array 20 to the main lens 30 is adjusted between 1 mm and 10 mm. The specifications of the embodiment are as follows.

[0046] (1) Imaging system specifications (1-1) Optical sensor 11 (image sensor) - Number of pixels: 35 megapixels Pixel size: 4.8μm (1-2) Main lens 35 Size: 60mmΦ ·Focal length: 80mm (2) Active lens specifications (2-1) Second electrode 23 (anode) Material: Stainless steel Opening diameter / pitch: 50μm / 60μm Layout: Grid layout (2-2) Dielectric polymer 22 Composition: PVC with dibutyl adipate plasticizer (addition amount 83wt%) Thickness: 0,2mmt (2-3) First electrode 21 (cathode) Material: ITO film Thickness: 0.1mmt ·Surface resistance: 30Ω / sq. or less ·Light transmittance (wavelength 550nm): 85% or more (2-4) Lens characteristics Applied voltage: 600V ·Focal length: 0.4mm F-number: 8.0

[0047] 7 shows images captured depending on whether a voltage applied to the microlens array 20 is on or off. In (A) of FIG. 7, when the voltage applied to the microlens array 20 is off, the light beam collected by the main lens 30 passes through the microlens array 20 without being focused by the microlens array 20. No image is formed on each of the lenses 25 that make up the microlens array 20. The light that passes through the microlens array 20 forms a two-dimensional image on the optical sensor 11.

[0048] In FIG. 7B, when the voltage applied to the microlens array 20 is 400 V, a light image from an object 50 is formed on each of the lenses 25 constituting the microlens array 20 .

[0049] The image 7-1 is an image obtained by combining the outputs from a plurality of sensor elements 111 covered by four lenses in the area 7a of the microlens array 20.

[0050] The image 7-2 is an image obtained by combining the outputs from a plurality of sensor elements 111 covered by four lenses in the region 7b of the microlens array 20.

[0051] The image 7-3 is an image obtained by combining the outputs from a plurality of sensor elements 111 covered by four lenses in the area 7c of the microlens array 20.

[0052] By changing the positions of the regions 7a, 7b, and 7c in the microlens array 20, the viewpoint position of the obtained image shifts from the bottom to the top. Similarly, in the regions of the microlens array 20 arranged from the right side to the left side on the paper surface, the viewpoint position of the obtained image shifts from left to right. By synthesizing the outputs from all the sensor elements 111 through arithmetic processing, a stereoscopic image with depth is obtained.

[0053] (Application to information processing devices) The imaging device 10 of the embodiment is applicable to information processing devices such as smartphones and tablet terminals.

[0054] 8 is a block diagram of an information processing device 100 incorporating the imaging device 10 of the embodiment. The information processing device 100 includes the imaging device 10, an integrated circuit board 51 such as a System-on-Chip (SoC), a display device 52, a recording device 53, an input / output device 54, a power supply 55, and a wireless communication device 56. These devices are connected to each other via a signal bus.

[0055] As described above, the imaging device 10 is capable of switching between a plenoptic camera and a normal camera by controlling the voltage, switching between angular resolution and spatial resolution modes in the plenoptic camera, and adjusting the focal length in each mode.

[0056] The integrated circuit board 51 is equipped with an image processor such as a GPU (Graphical Processing Unit) 511 and a control processor such as a CPU (Central Processing Unit) 512. The CPU 512 performs on / off control of the voltage applied to the microlens array 20 of the imaging device 10 and adjusts the applied voltage level. The GPU 511 performs digital arithmetic processing on the electric signal output from the optical sensor 11 of the imaging device 10 to generate image data. When the imaging device 10 is in a plenoptic camera mode, the digital arithmetic processing by the GPU 511 may be performed based on a three-dimensional image measurement method. The digital arithmetic processing may include correction of the image data, noise removal, and the like.

[0057] The recording device 53 stores information acquired or generated by the information processing device 100, commands, parameters, programs, etc. required for the operation of the information processing device 100. The recording device 53 includes both a memory built into the information processing device 100 and an external memory that is detachably connected.

[0058] The input / output device 54 includes a user interface such as a touch panel, a microphone, and a speaker.

[0059] A power supply 55 supplies power necessary for the operation of each unit of the information processing device 100. A wireless communication device 56 performs short-range wireless communication such as infrared communication as well as communication with a wireless base station via an antenna.

[0060] The display device 52 displays image data generated by the GPU 511, image data stored in the recording device 53, image data corresponding to commands inputted by the input / output device 54, and the like.

[0061] The imaging device 10 of the embodiment uses a thin three-layer microlens array 20, and can change the focal length of the microlens array 20 simply by controlling the voltage application, making it suitable for application to small information processing terminals and mobile terminals.

[0062] 9 is a flowchart of an imaging method according to an embodiment. When the camera is turned on (S11), it is determined whether the camera is in normal camera mode or plenoptic camera mode (S12). If the camera is in normal camera mode (YES in S12), the voltage applied to the microlens array (abbreviated as "MLA" in the figure) is turned off (S7). At least one of the main lens 30 and the optical sensor 11 may be moved along the optical axis so that light passing through the main lens 30 is focused on the incident surface of the optical sensor 11.

[0063] If the normal camera mode is not selected (NO in S12), it is determined whether or not a mode with good spatial resolution has been selected (S13). If a mode with good spatial resolution has been selected (YES in S13), a voltage V1 is applied to the microlens array (S15). At least one of the positions of the main lens 30 and the optical sensor 11 may be adjusted along the optical axis so that the image plane of the main lens 30 is on the incident side of the microlens array and the light collected by the microlens array 20 forms an image on the incident surface of the optical sensor 11.

[0064] If a mode with good spatial resolution has not been selected (NO in S13), it is determined whether a mode with good angular resolution has been selected (S14). If a mode with good angular resolution has been selected (YES in S14), a voltage V2 smaller than V1 is applied to the microlens array to adjust the focal length (S16). At least one of the main lens 30 and the optical sensor 11 may be moved along the optical axis so that the light beam transmitted through each point of the main lens 30 is split into multiple light beams by each lens 25 of the microlens array 20 and enters the sensor element 111 of the optical sensor 11.

[0065] 9, it is possible to switch between a normal camera and a plenoptic camera, and to select a mode with good spatial resolution and a mode with good angular resolution in the plenoptic camera, using a single microlens array 20. Moreover, regardless of whether a normal camera or a plenoptic camera is used, the focal length of the microlens array 20 can be adjusted simply by controlling the applied voltage. [Explanation of symbols]

[0066] 10. Imaging device 11 Optical Sensor 20 Microlens Array 21 1st electrode 22 Dielectric Polymers 23 2nd electrode 24 aperture 25 Lenses 30 Primary Lens 100 Information processing device 51 Integrated Circuit Board 511 GPU 512 CPU IS Image Sensor

Claims

1. An imaging device having a light sensor having a plurality of sensor elements, a main lens that guides light from an object to the light sensor, and a microlens array disposed between the light sensor and the main lens, The microlens array has a three-layer structure including a first electrode that is transparent to visible light, a second electrode that has a plurality of openings and is transparent to visible light and faces the first electrode, and a dielectric polymer that is disposed between the first electrode and the second electrode. Lenses are formed in the openings by application of a voltage. the imaging device selectively operates in a first mode having good angular resolution and a second mode having good spatial resolution according to a level of the applied voltage; A focal length of the microlens array in the second mode is set to be shorter than a focal length of the microlens array in the first mode in response to a level of the voltage; an image plane of the main lens in the second mode is located between the main lens and the microlens array, and an image plane of the main lens in the first mode is located at the microlens array. Imaging device.

2. In the first mode, a light beam incident on one lens of the microlens array is split into at least two sensor elements of the plurality of sensor elements; 2. The imaging device according to claim 1, wherein in the second mode, the light beam incident on the one lens is irradiated onto one of the plurality of sensor elements.

3. 3. The imaging device according to claim 1, wherein the imaging device functions as a normal camera by turning off the voltage applied to the microlens array and using the image plane as the plurality of sensor elements.

4. 4. The imaging device according to claim 1, wherein the focal length of the microlens array is made variable by changing the level of the voltage applied to the microlens array in the first mode and / or the second mode.

5. 1. An imaging method for an imaging device including an optical sensor having a plurality of sensor elements, a main lens that guides light from an object to the optical sensor, and a microlens array disposed between the optical sensor and the main lens, comprising: The microlens array is formed of a first electrode transparent to visible light, a second electrode having a plurality of openings and facing the first electrode, and a dielectric polymer disposed between the first electrode and the second electrode; applying a voltage to the microlens array to form lenses in the apertures; selectively operating the imaging device between a first mode having good angular resolution and a second mode having good spatial resolution according to a level of the voltage applied to the microlens array; A focal length of the microlens array in the second mode is set to be shorter than a focal length of the microlens array in the first mode in response to a level of the voltage; an image plane of the main lens in the second mode is located between the main lens and the microlens array, and an image plane of the main lens in the first mode is located at the microlens array. Imaging method.

6. In the first mode, a light beam incident on one lens of the microlens array is split into at least two sensor elements of the plurality of sensor elements; 6. The imaging method according to claim 5, wherein in the second mode, the light beam incident on the one lens is irradiated onto one of the plurality of sensor elements.

7. 7. The imaging method according to claim 5, wherein the image pickup device functions as a normal camera by turning off the voltage applied to the microlens array and using the image plane as the plurality of sensor elements.

8. The imaging method according to any one of claims 5 to 7, characterized in that the focal length of the microlens array is made variable by changing the level of the voltage applied to the microlens array in the first mode and / or the second mode.

9. applying a second voltage to the microlens array to form the lenses in the apertures when the second mode is selected; directing light from an image plane formed by the main lens to a plurality of lenses of the microlens array; The light incident on each of the plurality of lenses is condensed onto N sensor elements. The imaging method according to any one of claims 5 to 8.

Images