Optical devices

Abstract

To provide an optical device that can suppress the reduction in the amount of light reaching the imaging surface of an image sensor. To provide an optical device that can shorten the calculation time of the control unit. [Solution] The optical device comprises a liquid crystal panel that displays an encoded aperture pattern, an optical system including a lens, an image sensor including a plurality of sensor elements and a plurality of color filters, and a control unit connected to the liquid crystal panel, the optical system, and the image sensor, wherein the liquid crystal panel includes a polarizing plate that modulates infrared light and transmits visible light.

Description

Technical Field

[0001] Embodiments of the present invention relate to an optical device.

Background Art

[0002] Devices that transmit infrared light have been developed. In particular, imaging systems that transmit infrared light and visible light through an image sensor have been developed (see Patent Document 2).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] This embodiment provides an optical device capable of suppressing a decrease in the amount of light reaching the imaging surface of an image sensor. Further, this embodiment provides an optical device capable of shortening the calculation time of a control unit.

Means for Solving the Problems

[0005] An optical device according to an embodiment includes: a liquid crystal panel that displays an encoded aperture pattern; an optical system including a lens; an image sensor including a plurality of sensor elements and a plurality of color filters; a control unit connected to the liquid crystal panel, the optical system, and the image sensor; and the liquid crystal panel includes a polarizing plate that modulates infrared light and transmits visible light.

Brief Description of the Drawings

[0006] [Figure 1] Figure 1 is an exploded perspective view showing an example of the configuration of an optical device according to an embodiment. [Figure 2] Figure 2 is a schematic diagram illustrating the principle of calculating the distance to the subject using the captured image. [Figure 3] Figure 3 is a perspective view that explains Figure 2 in more detail. [Figure 4] Figure 4 is a plan view showing an example of an encoded aperture pattern. [Figure 5] Figure 5 is a plan view showing an example of a coded aperture pattern. [Figure 6] Figure 6 shows an example of a schematic configuration of the optical device according to the embodiment. [Figure 7] Figure 7 shows the operation of the optical device. [Figure 8] Figure 8 shows an example of an equivalent circuit for a liquid crystal panel. [Figure 9] Figure 9 is a cross-sectional view showing an example of the structure of a liquid crystal panel. [Modes for carrying out the invention]

[0007] The embodiments of the present invention will be described below with reference to the drawings. Note that the disclosure is merely an example, and modifications that can be easily conceived by those skilled in the art while maintaining the spirit of the invention are naturally included within the scope of the present invention. Furthermore, in order to clarify the explanation, the drawings may schematically represent the width, thickness, shape, etc., of each part compared to the actual embodiment, but these are merely examples and do not limit the interpretation of the present invention. In addition, in this specification and in each drawing, elements similar to those described above in previously shown drawings are denoted by the same reference numerals, and detailed explanations may be omitted as appropriate.

[0008] The embodiments described herein are not general in nature, but rather embodiments that illustrate the same or corresponding specific technical features of the present invention. Hereinafter, an optical apparatus according to one embodiment will be described in detail with reference to the drawings.

[0009] In this embodiment, the first direction X, the second direction Y, and the third direction Z are orthogonal to each other, but they may intersect at angles other than 90 degrees. The direction toward the tip of the arrow in the third direction Z is defined as up or upward, and the direction opposite to the direction toward the tip of the arrow in the third direction Z is defined as down or downward. The first direction X, the second direction Y, and the third direction Z may also be referred to as the X direction, the Y direction, and the Z direction, respectively.

[0010] Furthermore, when referring to "the second member above the first member" and "the second member below the first member," the second member may be in contact with the first member or may be located away from the first member. In the latter case, a third member may be interposed between the first member and the second member. On the other hand, when referring to "the second member above the first member" and "the second member below the first member," the second member is in contact with the first member.

[0011] Furthermore, assuming that there is an observation position for observing the optical device on the tip side of the arrow in the third direction Z, viewing from this observation position toward the XY plane defined by the first direction X and the second direction Y is called a planar view. Viewing a cross-section of the optical device in the XZ plane defined by the first direction X and the third direction Z, or in the YZ plane defined by the second direction Y and the third direction Z, is called a cross-sectional view.

[0012] [Embodiment] Figure 1 is an exploded perspective view showing an example of the configuration of an optical device OPD according to an embodiment. The optical device OPD shown in Figure 1 comprises a liquid crystal panel PNL, an image sensor IS, and an optical system OPS. The image sensor IS is located on the back side of the liquid crystal panel PNL. The optical system OPS is located between the liquid crystal panel PNL and the image sensor IS.

[0013] In other words, in the optical device OPD, the liquid crystal panel PNL, the optical system OPS, and the image sensor IS are arranged in this order along the third direction Z. The optical system OPS includes at least one lens. The optical device OPD can also be described as an imaging device that images a subject via the liquid crystal panel PNL, the optical system OPS, and the image sensor IS.

[0014] Note that FIG. 1 is a diagram for explaining the positional relationship in the third direction Z of the liquid crystal panel PNL, the optical system OPS, and the imaging device IS. In FIG. 1, the sizes, shapes, etc. of the liquid crystal panel PNL, the optical system OPS, and the imaging device IS are simply shown.

[0015] The liquid crystal panel PNL includes a polarizing plate PL1, a liquid crystal element LCD, and a polarizing plate PL2. The liquid crystal element LCD includes an array substrate, a counter substrate, and a liquid crystal layer. The liquid crystal layer is disposed between the array substrate and the counter substrate.

[0016] The liquid crystal panel PNL according to the embodiment becomes a transparent state (transmission state) when no electric field acts on the liquid crystal layer, and becomes an absorption state (coloring state, light shielding state, light reduction state) when an electric field acts on the liquid crystal layer. The liquid crystal panel PNL may be driven by a simple matrix method or an active matrix method.

[0017] In the optical device OPD of the embodiment, when the liquid crystal panel PNL is in the transparent state, the light transmitted through the liquid crystal panel PNL and the optical system OPS is incident on the imaging device IS. Thereby, the optical device OPD can capture an image based on the light incident on the imaging device IS.

[0018] When the liquid crystal panel PNL is in the absorption state, an encoded aperture pattern is displayed on the liquid crystal panel PNL. Although details will be described later, the encoded aperture pattern includes a plurality of incident light control regions. The light transmitted through the liquid crystal panel PNL in the state where the encoded aperture pattern is displayed and the optical system OPS is incident on the imaging device IS. Thereby, the optical device OPD can calculate the distance to the subject from the image based on the light incident on the imaging device IS by the encoded aperture technology.

[0019] <Encoded Aperture Technology> Figure 2 is a schematic diagram illustrating the principle of calculating the distance to the subject using the captured image. As described above, the optical device OPD comprises a liquid crystal panel PNL, an image sensor IS, and an optical system OPS. The optical system OPS is positioned between the liquid crystal panel PNL and the image sensor IS. The optical system OPS has at least one lens. However, the configuration of the optical system OPS is not limited to this, and may have other necessary components in addition to the lens.

[0020] This section explains how to calculate the distance to the subject object (OBJ). Generally, when an image sensor (IS) photographs a subject object (OBJ), the subject object (OBJ) can be photographed in focus by changing the distance between the optical system (OPS) and the image sensor (IS). However, as shown in Figure 2, if the subject object (OBJ) is photographed when it is not in focus, a discrepancy occurs between the focal point (FP) and the imaging plane of the image sensor (IS). As a result, blurring occurs in the image based on the light incident on the image sensor (IS).

[0021] Figure 3 is a perspective view that explains Figure 2 in more detail. Figure 3 shows the lens LNS included in the optical system OPS, the image OPI obtained when light passes through the lens LNS (optical system OPS), the focal point FP, the image IMG1 located between the focal point FP and the lens LNS, the image IMG2 located further away from the focal point FP, and the imaging plane IF of the image sensor IS. The imaging plane IF is a plane composed of a fourth direction u, which is parallel to the first direction X, and a fifth direction v, which is parallel to the second direction Y. The image ISI is captured on the imaging plane IF.

[0022] The image OPI obtained when light passes through the lens LNS (optical system OPS) is the image transmitted through the liquid crystal panel PNL, as shown in Figure 2. The liquid crystal panel PNL displays an image of the coded aperture pattern in the XY plane. Therefore, it can be said that the image OPI contains coded aperture data.

[0023] Images IMG1 and IMG2 are blurred images containing similar information to the coded aperture. Because image IMG1 is located between the focal point FP and lens LNS, it has the same shape as image OPI but is a different size. Because image IMG2 is located further away from the focal point FP, it has a point-symmetric shape to image OPI and is a different size.

[0024] It is possible to measure the distance from the focal point FP (FP) from the degree of blur in images IMG1 and IMG2. However, if the distance between image IMG1 and the FP, and the distance between image IMG2 and the FP, are the same, the degree of blur will be the same. If the shape of image OPI when transmitted through the lens LNS (optical system OPS) is point-symmetric, then the shapes of image IMG1 and image IMG2 will be the same. This is because the shapes of image IMG1 and image IMG2 are the same as the shape of image OPI.

[0025] Therefore, as shown in Figure 3, the image OPI uses a non-point-symmetric shape. This makes it possible to obtain information on whether the image ISI captured on the imaging plane IF is closer to or further away from the focal point FP, as well as information on the distance between the image ISI and the focal point FP.

[0026] As shown in Figure 3, when the image ISI captured on the imaging plane IF is image IMG2, the shape of the image ISI is point-symmetric to the image OPI. Therefore, it can be seen that the image ISI is farther from the focal point FP. Although not shown in Figure 3, when the image ISI is image IMG1, the position of the image ISI is the same as that of the image OPI, so it can be seen that the image ISI is closer to the lens LNS than the focal point FP.

[0027] This section describes the coded aperture pattern displayed on a liquid crystal panel (PNL). The coded aperture pattern uses a non-point-symmetric image. Figures 4 and 5 are plan views showing examples of coded aperture patterns.

[0028] Although not shown in the diagram, the liquid crystal panel PNL consists of a display area for displaying images and a non-display area outside the display area. The display area has a light control area PCA. The area of ​​the display area other than the light control area PCA is provided with a light shielding area BM.

[0029] The incident light control region PCA shown in Figures 4 and 5 has a circular shape corresponding to the lens LNS. The incident light control region PCA has multiple light transmission regions TA and multiple light shielding regions LSA. In Figures 4 and 5, the areas marked with dots are the light shielding regions LSA. The multiple light transmission regions TA and multiple light shielding regions LSA are formed by controlling the voltage applied to the liquid crystal layer of the liquid crystal panel PNL.

[0030] Figure 4 shows an example in which multiple light-transmitting regions TA and multiple light-shielding regions LSA are arranged in a matrix. In Figure 4, each of the multiple light-transmitting regions TA and each of the multiple light-shielding regions LSA have, for example, a square shape. These square-shaped light-transmitting regions TA or light-shielding regions LSA are combined to form a non-point-symmetric image (encoded aperture pattern).

[0031] In the example shown in Figure 5, the shapes of each of the multiple light-transmitting regions TA and each of the multiple light-shielding regions LSA are part of an annular shape. The light-transmitting regions TA or light-shielding regions LSA, which are part of this annular shape, are combined to form a non-point-symmetric image (encoded aperture pattern).

[0032] When imaging an object OBJ, light from the object OBJ passes through an encoded aperture pattern displayed on the liquid crystal panel PNL (see Figures 2 and 3). The light that has passed through this encoded aperture pattern then passes through the lens LNS (optical system OPS). The light that passes through the lens LNS forms the image OPI as it passes through the lens LNS (optical system OPS) as described above.

[0033] The image ISI captured on the image sensor IF has a shape similar to or point-symmetric to the image OPI. As described above, when the subject OBJ is photographed while it is not in focus, a discrepancy occurs between the focal point FP and the position of the image sensor IF on the image sensor IS. As a result, blurring occurs in the image ISI.

[0034] The nature of this blurring depends on the point spread function determined by the shape of the coded aperture pattern. For the ISI image with this blurring, decoding is performed based on the point spread function unique to the coded aperture pattern. This yields a decoded image with improved blurring and depth information (distance) corresponding to the position in the decoded image.

[0035] As described above, according to the coded aperture technique, the distance to the subject OBJ is calculated based on the blurring that occurs in the image ISI captured on the imaging plane IF.

[0036] Here, we will discuss the problems with optical devices (OPDs) that use liquid crystal panels (PNLs). As shown in Figure 1, the liquid crystal panel PNL is equipped with polarizers PL1 and PL2. When light is transmitted through polarizers PL1 and PL2, a certain percentage of the transmitted light is absorbed.

[0037] If light is absorbed by polarizers PL1 and PL2, the amount of light reaching the imaging plane IF of the image sensor IS decreases. As a result, the signal-to-noise ratio at the imaging plane IF decreases, which may reduce the accuracy of encoded information.

[0038] Therefore, it becomes necessary to compensate for the reduced light. For example, this could be done by increasing the exposure time at the image sensor (IS) or by increasing the rate at which the detected light is converted into electric current.

[0039] The image sensor (IS) is also equipped with a sensor element (e.g., a CMOS sensor) and a color filter. Light from the subject (OBJ) is detected as red (R), green (G), and blue (B) information through the color filter of the image sensor (IS). In the case of light from the subject (OBJ) that passes through the coded aperture pattern of the liquid crystal panel (PNL), if the red (R), green (G), and blue (B) gradations are saturated, there is a risk that appropriate coded aperture data will be lost. In other words, if the red (R), green (G), and blue (B) gradations are saturated in the image passing through the liquid crystal panel (PNL), the degree of blur will be the same even after passing through the coded aperture pattern of the liquid crystal panel (PNL), and there is a risk that depth information will not be obtained.

[0040] Furthermore, the red (R), green (G), and blue (B) information detected by the image sensor IS is converted to grayscale. Using this grayscale information, the control unit of the optical device OPD calculates the distance to the subject OBJ. When an image sensor equipped with a color filter detects a subject in this way, there is a risk that the calculation time required to convert the red (R), green (G), and blue (B) information to grayscale information will be long.

[0041] In this embodiment, polarizers that transmit visible light while changing only the infrared light are used as polarizers PL1 and PL2 of the liquid crystal panel PNL. This suppresses the reduction in the amount of light reaching the imaging surface IF of the image sensor IS. Furthermore, even when the red (R), green (G), and blue (B) gradations are saturated, it is possible to measure the distance to the subject OBJ more accurately. In addition, since there is no need to convert red (R), green (G), and blue (B) to grayscale, the calculation time of the control unit of the optical device OPD can be shortened.

[0042] <Configuration of the optical device> Figure 6 shows an example of a schematic configuration of the optical device of the embodiment. The optical device OPD shown in Figure 6 includes a liquid crystal panel PNL, an optical system OPS, an image sensor IS, and a control unit CTL. In Figure 6, the third direction Z coincides with the principal axis direction of the optical system OPS.

[0043] As described above, the liquid crystal panel PNL comprises a polarizer PL1, a liquid crystal element LCD, and a polarizer PL2. Polarizers PL1 and PL2 polarize only infrared (IR) light, while transmitting visible light.

[0044] The image sensor IS includes, for example, a plurality of sensor elements arranged in a matrix and a plurality of color filters corresponding to the sensor elements. The plurality of sensor elements may be, for example, the CMOS sensors described above. However, the sensor elements are not limited to this and may be other photoelectric conversion elements, such as CCD sensors. The plurality of sensor elements include a plurality of sensor elements that detect visible light and a plurality of sensor elements that detect infrared light.

[0045] Light incident on the imaging surface IF of the image sensor IS passes through a color filter. The red (R), green (G), and blue (B) information of the light (visible light) that has passed through the color filter is detected by multiple sensor elements.

[0046] In the optical device OPD of this embodiment, the light from the subject OBJ includes visible light and infrared light. The infrared light is modulated by the liquid crystal panel PNL. This modulated infrared light is detected by a sensor element that detects infrared light in the image sensor IS. By using the coded aperture technique described above, it is possible to obtain depth information of the subject OBJ.

[0047] Visible light is not modulated by the liquid crystal panel PNL and passes through the liquid crystal panel PNL. This transmitted visible light is detected by the visible light detection sensor element of the image sensor IS. This makes it possible to obtain the color information of the subject OBJ.

[0048] Figure 7 shows the operation of the optical device. In the optical device (OPD), the following operation is performed by control signals from the control unit (CTL). First, an image of the subject (OBJ) is captured, including the encoded aperture pattern displayed on the liquid crystal panel (PNL). This capture is performed using both infrared and visible light (step S101).

[0049] The amount of visible light does not change even when passing through the liquid crystal panel PNL. The sensor element of the image sensor IS detects red (R), green (G), and blue (B) light. The detected light is converted into an electric current by photoelectric conversion. This current value is amplified at a predetermined amplification factor and transmitted to the control unit CTL as red (R), green (G), and blue (B) information (step S111). The amplification factor of the current value should be set to an extent that the white balance of red (R), green (G), and blue (B) can be maintained.

[0050] Infrared light is modulated by the liquid crystal panel PNL. Therefore, the intensity of infrared light decreases as it passes through the liquid crystal panel PNL. This reduced intensity infrared light is detected by the sensor element of the image sensor IS. After converting the infrared light into an electric current via photoelectric conversion, the converted current is amplified at an amplification factor different from that of visible light. The amplified current is transmitted to the control unit CTL as coded aperture data (step S121).

[0051] Only infrared light is modulated in the liquid crystal panel PNL. Therefore, coded aperture data is assigned only to infrared light, and not to visible light. Visible light contains the color information (red (R), green (G), and blue (B)) of the subject OBJ.

[0052] The control unit CTL generates a two-dimensional color image containing color information based on the current converted from visible light (step S112). The control unit CTL calculates the distance between the optical device OPD and the subject OBJ based on the current converted from infrared light and calculates distance information (step S122).

[0053] The control unit CTL synthesizes the above-mentioned color two-dimensional image and the above-mentioned distance information. This generates a two-dimensional image that includes both color information and distance information (step S102).

[0054] The liquid crystal panel PNL of the optical device OPD in this embodiment has a polarizing plate that polarizes infrared light and transmits visible light. Depth information (position) is measured based solely on information from infrared light. Visible light is used to detect the color information of the subject OBJ. Therefore, the brightness of the visible light does not change, and there is no need to adjust the white balance of red (R), green (G), and blue (B).

[0055] As mentioned above, measuring distance using color information required converting the color information to grayscale. In the optical device OPD of this embodiment, distance is measured using infrared light without using color information. Therefore, there is no need to convert color information to grayscale, and the calculation time can be reduced.

[0056] Furthermore, when a CMOS sensor is used as the sensor element of an image sensor (IS), the CMOS sensor is often made using silicon (Si). Silicon (Si) has a high photoelectric conversion rate for infrared light. Therefore, an image sensor (IS) with a CMOS sensor has the advantage that the signal-to-noise ratio (S / N ratio) may be higher when using infrared light than when using visible light.

[0057] <LCD panel configuration> Figure 8 shows an example of an equivalent circuit of a liquid crystal panel. The liquid crystal panel PNL comprises a display area DA that displays an encoded aperture pattern, a plurality of pixels PX, a plurality of scan lines GL, and a plurality of signal lines SL. The plurality of scan lines GL and the plurality of signal lines SL intersect with each other.

[0058] The liquid crystal panel PNL comprises driver DR1 and driver DR2 outside the display area DA. Multiple scan lines GL are electrically connected to driver DR1. Multiple signal lines SL are electrically connected to driver DR2. Drivers DR1 and DR2 are controlled by a control unit.

[0059] Pixel PX is located at the intersection of scan line GL and signal line SL. Furthermore, pixel PX is demarcated by two scan lines GL and two signal lines SL.

[0060] Each pixel PX comprises a switching element SW, a pixel electrode PE, and a common electrode CE facing the pixel electrode PE. The switching element SW is electrically connected to the scan line GL and the signal line SL. The pixel electrode PE is electrically connected to the switching element SW. In other words, the pixel electrode PE is electrically connected to the signal line SL via the switching element SW. The common electrode CE is formed across multiple pixels PX. A common potential is applied to the common electrode CE.

[0061] Driver DR1 supplies a scan signal to each scan line GL. Driver DR2 supplies a video signal to each signal line SL. In the switching element SW, which is electrically connected to the scan line GL to which the scan signal is supplied, the signal line SL and the pixel electrode PE conduct, and a voltage corresponding to the video signal supplied to the signal line SL is applied to the pixel electrode PE. The liquid crystal layer LC is driven by the electric field generated between the pixel electrode PE and the common electrode CE. More specifically, the electric field generated between the pixel electrode PE and the common electrode CE changes the orientation of the liquid crystal molecules in the liquid crystal layer LC from its initial orientation state when no voltage is applied. Through this operation, an encoded aperture pattern is displayed in the display area DA.

[0062] Figure 9 is a cross-sectional view showing an example of the structure of a liquid crystal panel. The liquid crystal panel PNL comprises a substrate SUB1, a substrate SUB2, a liquid crystal layer LC, a polarizer PL1, and a polarizer PL2. The liquid crystal layer LC is held between substrates SUB1 and SUB2. Polarizer PL1 is provided in contact with substrate SUB1. Polarizer PL2 is provided in contact with substrate SUB2. Substrate SUB1, liquid crystal layer LC, and substrate SUB2 constitute a liquid crystal element LCD.

[0063] In addition to the switching element SW, pixel electrode PE, common electrode CE, etc., the substrate SUB1 includes a base material BA1, an insulating layer INS, an insulating layer DIE, and an alignment film AL1. The substrate SUB1 also includes the scan line GL, signal line SL, driver DR1, and driver DR2 shown in Figure 1.

[0064] The substrate BA1 is formed from a light-transmitting glass substrate, resin substrate, or the like. The substrate BA1 has a main surface S1A facing the substrate SUB2 and a main surface S1B on the opposite side of the main surface S1A.

[0065] The switching element SW is formed on the main surface S1A side of the substrate BA1 and is covered by an insulating layer INS. In the example shown in Figure 9, for the sake of explaining the embodiment, the switching element SW is shown in a simplified manner, and the scanning line GL and signal line SL are not shown. In reality, the insulating layer INS may include multiple insulating layers. The switching element SW includes semiconductor layers and various electrodes formed on these layers.

[0066] The pixel electrode PE is formed on an insulating layer INS and is positioned for every set of pixels PX. The pixel electrode PE is covered by an insulating layer DIE. A common electrode CE is provided across multiple pixels PX. The common electrode CE is formed on an insulating layer DIE and faces the pixel electrode PE via the insulating layer DIE.

[0067] Each pixel electrode PE is electrically connected to a switching element SW through a contact hole CH that penetrates the insulating layer INS. The pixel electrodes PE and common electrodes CE are transparent electrodes formed from transparent conductive materials such as indium tin oxide (ITO) or indium zinc oxide (IZO).

[0068] The alignment film AL1 covers the common electrode and is in contact with the liquid crystal layer LC. The alignment film AL1 is, for example, a photo-alignment film that has undergone photo-alignment treatment.

[0069] The substrate SUB2 comprises a base material BA2 and an alignment film AL2. The base material BA2 is formed from a light-transmitting glass substrate, resin substrate, or the like. The base material BA2 has a main surface S2A facing the substrate SUB1 and a main surface S2B on the opposite side of the main surface S2A.

[0070] The alignment film AL2 is provided in contact with the substrate BA2 and is in contact with the liquid crystal layer LC. The alignment film AL2 is a photo-alignment film that has undergone photo-alignment treatment, just like the alignment film AL2.

[0071] An insulating layer or a light-shielding layer facing the switching element SW may be provided between the alignment film AL2 and the substrate BA2.

[0072] A polarizer PL1 is bonded to the main surface S1B of substrate BA1, and a polarizer PL2 is bonded to the main surface S2B of substrate BA2. In other words, the first substrate BA1 is provided between the liquid crystal layer LC and the polarizer PL1. The second substrate BA2 is provided between the liquid crystal layer LC and the polarizer PL2. To put it another way, the first substrate SUB1 is provided between the liquid crystal layer LC and the polarizer PL1. The second substrate SUB2 is provided between the liquid crystal layer LC and the polarizer PL2. As described above, polarizers PL1 and PL2 polarize infrared light and transmit visible light.

[0073] The optical device of this embodiment can suppress the reduction in the amount of light reaching the imaging surface of the image sensor. The optical device of this embodiment can shorten the calculation time of the control unit.

[0074] In this disclosure, the current obtained by photoelectric conversion of visible light is referred to as the first current. The amplification factor of the first current is referred to as the first amplification factor. The current obtained by photoelectric conversion of infrared light is referred to as the second current. The amplification factor of the second current is referred to as the second amplification factor. The second amplification factor is different from the first amplification factor.

[0075] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of Symbols]

[0076] CTL...Control unit, FP...Focus, IF...Imaging plane, IMG1...Image, IMG2...Image, IS...Image sensor, LCD...Liquid crystal element, LNS...Lens, OBJ...Subject, OPD...Optical device, OPS...Optical system, PL1...Polarizer, PL2...Polarizer, PNL...Liquid crystal panel, S101...Step, S102...Step, S111...Step, S112...Step, S121...Step, S122...Step.

Claims

1. A liquid crystal panel that displays an encoded aperture pattern, Optical system including lenses, An image sensor including multiple sensor elements and multiple color filters, A control unit connected to the liquid crystal panel, the optical system, and the image sensor, Equipped with, The aforementioned liquid crystal panel is an optical device comprising a polarizing plate that modulates infrared light and transmits visible light.

2. The optical apparatus according to claim 1, wherein the plurality of sensor elements include a plurality of sensor elements for detecting visible light and a plurality of sensor elements for detecting infrared light.

3. With the coded aperture pattern displayed on the liquid crystal panel, the subject is imaged using infrared light and visible light. The visible light passing through the liquid crystal panel is converted into a first current by photoelectric conversion, the first current is amplified at a first amplification factor, and the first current amplified at the first amplification factor is transmitted to the control unit as color information. The infrared light captured by the liquid crystal panel is converted into a second current by photoelectric conversion, the second current is amplified at a second amplification factor different from the first amplification factor, and the second current amplified at the second amplification factor is transmitted to the control unit as coded aperture data. The control unit generates a color two-dimensional image based on the first current amplified at the first amplification factor. The control unit calculates distance information between the subject and the optical device based on the second current amplified by the second amplification factor. The optical apparatus according to claim 1, wherein the control unit synthesizes the two-dimensional color image and the distance information to generate a two-dimensional image that includes both the color information and the distance information.

4. The optical apparatus according to claim 1, wherein the coding aperture pattern has a shape that is not point-symmetric.

5. The aforementioned liquid crystal panel is First substrate and The second circuit board and A liquid crystal layer provided between the first substrate and the second substrate, Equipped with, The polarizing plate comprises a first polarizing plate and a second polarizing plate. The first substrate is provided between the liquid crystal layer and the first polarizing plate, The optical apparatus according to claim 1, wherein the second substrate is provided between the liquid crystal layer and the second polarizing plate.

Images