Diffraction optical element, imaging device, and program

The diffractive optical element with multi-gradation phase distributions enhances light utilization and reduces noise, facilitating high-quality stereoscopic imaging of dynamic objects by improving light efficiency and frame rates.

JP2024171188APending Publication Date: 2024-12-11NIPPON HOSO KYOKAI
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2023088134
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-29
Publication Date
2024-12-11

AI Technical Summary

Technical Problem

Diffractive optical elements with two-gradation phase distributions suffer from high-order diffracted light generation, leading to low light utilization efficiency, which results in reduced image quality due to noise and the need for longer exposure times, making it difficult to capture high-quality stereoscopic images of dynamic objects.

Method used

A diffractive optical element that splits incoherent light into multiple directions using a phase distribution of three or more gradations, combined with linear polarizers at different angles, to improve light utilization efficiency and reduce noise during hologram imaging.

Benefits of technology

The improved light utilization efficiency allows for high-quality stereoscopic imaging with reduced noise and increased frame rates, enabling clear imaging of dynamic objects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024171188000001_ABST
    Figure 2024171188000001_ABST
Patent Text Reader

Abstract

To provide a diffraction optical element and an imaging device with which the efficiency of light utilization is improved.SOLUTION: Provided is an imaging device for dividing incoherent light into first and second divided light, adding different phase distributions to the first and the second divided light, and then causing the first and the second divided light to interfere with each other to form a hologram and capturing an image. The imaging device is characterized in that the first and the second divided light, respectively, are divided into three or four directions with even light intensity by a diffraction optical element that adds an n grayscale (n>2) phase distribution of a one-dimensional or a two-dimensional period, and each of the divided rays of light is passed through a linear polarizer differing in the angle of transmission axis, with a plurality of holograms in mutually different phase shift quantities formed thereby and the plurality of holograms imaged simultaneously.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a diffractive optical element, an imaging device, and a program, and more particularly to a diffractive optical element used for imaging by incoherent holography, an imaging device using the same, and a program for designing a diffractive optical element. [Background technology]

[0002] Holography is a technology for acquiring and reconstructing three-dimensional information of an object. In particular, incoherent holography technology has the characteristic that it can capture holograms of objects using light sources with low spatial coherence, such as sunlight, general indoor lighting, and fluorescent light, and can realize stereoscopic imaging under natural light environments (Non-Patent Document 1). For this reason, incoherent holography does not require consideration of eye-safety issues that should be considered when introducing a stereoscopic imaging method using a laser light source, and does not have the problem of interference between multiple laser light sources, making it possible to realize a passive stereoscopic imaging method. Furthermore, it has better spatial frequency characteristics than conventional cameras, making it a promising candidate for capturing high-definition images.

[0003] In general, to obtain three-dimensional information by holography, it is necessary to detect phase information or complex amplitude information (combination of phase information and amplitude information). A phase shift method is often used to detect this information (for example, Patent Document 1). The phase shift method is a technique for detecting phase information or complex amplitude information by imaging multiple holograms with different light phase shift amounts (i.e., light and dark positions of fringes) and analyzing them. When imaging multiple holograms required for the phase shift method, a time-division phase shift method (for example, Patent Document 1, Non-Patent Document 2) is often used in which the phase of light is shifted sequentially using a spatial light modulator such as a piezoelectric element or liquid crystal, and a hologram is imaged each time. However, this method requires imaging multiple times (at least three times) to detect phase information or complex amplitude information, and the subject needs to be stationary during imaging, making it difficult to apply to video imaging.

[0004] Therefore, in order to apply it to video imaging, a spatial division phase shift method has been proposed in which multiple holograms required for the phase shift method are imaged at once (Patent Documents 2 to 5). In Patent Documents 2 to 5, light reflected, transmitted, or scattered from an object to be imaged is modulated by a two-level diffractive optical element. Although the form of the optical element and the arrangement and configuration of the optical system differ in each document, what they all have in common is that a two-level phase distribution is imparted to light by a binary diffractive optical element in which a two-level uneven structure is periodically arranged. The light to which the binary periodic phase distribution has been imparted is divided into multiple directions according to the periodicity by the phenomenon of diffraction, and each is imparted with a different phase shift amount and propagates. This allows multiple holograms required for the phase shift method to be formed simultaneously on the image sensor surface, and multiple holograms can be imaged at once by imaging once. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 6416270 [Patent Document 2] Patent No. 7122153 [Patent Document 3] Patent Publication No. 2021-131457 [Patent Document 4] JP 2021-184033 A [Patent Document 5] JP 2022-97130 A [Non-patent literature]

[0006] [Non-Patent Document 1] Joseph Rosen, et al., “Roadmap on Recent Progress in FINCH Technology”, Journal of Imaging, (2021), vol. 7, 197. [Non-Patent Document 2] Myung K. Kim, “Full color natural light holographic camera,” Optics Express, (2013) vol. 21, pp. 9636-9642, Summary of the Invention [Problem to be solved by the invention]

[0007] However, when a diffractive optical element with a two-level phase distribution is used, high-order diffracted light is generated, and the light utilization efficiency is reduced. When light is divided into four directions using the checkered periodic two-level diffractive optical element of Patent Documents 2, 3, and 4, the light utilization efficiency of the incident light in each hologram is theoretically 16%, and the overall light utilization efficiency is 16% x 4 = 64%. When a line-shaped periodic two-level diffractive optical element of Patent Document 5 is used, the light is divided into three directions, the light utilization efficiency of the incident light in each hologram is 29%, and the overall light utilization efficiency is 29% x 3 = 87%. That is, in the case of four divisions, 100-64 = 36%, and in the case of three divisions, 100-87 = 13% are the energy of the high-order diffracted light components, which are lost.

[0008] When light utilization efficiency decreases, the following two problems arise. First, the effect of noise in the image sensor becomes more pronounced when capturing images with the image sensor, leading to a decrease in the image quality of 3D images. Second, to compensate for the amount of light when capturing holograms, a longer exposure time must be set, resulting in a decrease in frame rate. Furthermore, when capturing images of fast-moving objects or dynamic phenomena with a long exposure time, the hologram becomes blurred, degrading the quality of the reproduced image.

[0009] Therefore, in consideration of the above-mentioned problems, an object of the present invention is to provide a diffractive optical element and a design program thereof that improves light utilization efficiency, and to provide an imaging device that uses this diffractive optical element to suppress noise during hologram imaging and generate high-quality three-dimensional images. [Means for solving the problem]

[0010] In order to solve the above problems, an imaging device according to the present invention comprises: (1) An imaging device that splits incoherent light into first and second divided lights, imparts different phase distributions to the first and second divided lights, and then causes the first and second divided lights to interfere with each other to form and capture a hologram, wherein the imaging device splits the first and second divided lights with uniform light intensity in three or four directions using a diffractive optical element that imparts a one-dimensional or two-dimensional periodic phase distribution with n levels (n>2), and passes each of the split lights through linear polarizers with different angles of the transmission axis to form multiple holograms with different amounts of phase shift, and simultaneously captures the multiple holograms.

[0011] (2) It is preferable that the imaging device of (1) above further comprises an information processing device that acquires complex amplitude distributions from the multiple holograms by a phase shift method and generates a reconstructed image by a propagation calculation.

[0012] In order to solve the above problems, a diffractive optical element according to the present invention comprises: (3) A diffractive optical element having a one-dimensional periodic phase distribution, which is composed of 1×2N pixels (N is a natural number), each pixel having a basic phase array with n-level (n>2) phase values ​​as a repeating unit, and which is configured by arranging a plurality of such repeating units in the vertical and horizontal directions, and which divides a transmitted or reflected light wave into three lights of uniform intensity.

[0013] In order to solve the above problems, a diffractive optical element according to the present invention comprises: (4) A diffractive optical element having a two-dimensional periodic phase distribution, in which a basic phase array consisting of M×2N pixels (M>1, N is a natural number), each pixel having a phase value of n levels (n>2), is combined in the vertical direction with a duplicate of the basic array flipped upside down and left and right, to form a repeating unit of 2M×2N pixels, and multiple such repeating units are arranged in the vertical and horizontal directions, and the diffractive optical element divides a transmitted or reflected light wave into four lights of uniform intensity.

[0014] (5) In the diffractive optical element of (3) or (4) above, it is further preferable that the phase distribution is realized by a concave-convex structure made of an optical material having n levels of height (n>2).

[0015] (6) It is preferable that the diffractive optical element of (3) or (4) above further realizes the phase distribution using a metasurface having columnar protrusions whose size is less than the wavelength of the light source and whose in-plane shapes or distributions differ from one another.

[0016] In order to solve the above problems, the program according to the present invention comprises: (7) The computer is configured to perform at least each of the following steps: Step A: creating an initial array of phases consisting of a plurality of pixels, and periodically expanding the initial array to create an initial phase grating; Step B: A step of combining the initial phase grating and a predetermined amplitude distribution and performing a Fourier transform; Step C: A step of combining the phase distribution obtained by the Fourier transform and the target amplitude distribution and performing an inverse Fourier transform; Step D: extracting a basic array consisting of a plurality of pixels from the phase distribution obtained by the inverse Fourier transform; Step E: changing the phase of one pixel of the basic array, and periodically expanding the changed basic array to create a phase grating; Step F. A step of combining the phase grating with a predetermined amplitude distribution and performing a Fourier transform; Step G: A step of calculating a difference between an amplitude distribution obtained by the Fourier transform based on the phase grating and a target amplitude distribution; Step H. Evaluating the difference and selecting one of the base sequence and a modified base sequence; Step I: Periodically expanding the finally obtained basic array to determine the phase distribution of n levels (n>2) of the diffractive optical element; This is a program for executing the above. Effect of the Invention

[0017] The diffractive optical element designed according to the present invention can improve light utilization efficiency by suppressing high-order diffracted light. Also, the imaging device of the present invention can suppress noise during hologram imaging and generate high-quality three-dimensional images. [Brief description of the drawings]

[0018] [Figure 1] 1 is a diagram showing an imaging device according to a first embodiment of the present invention, which uses a diffractive optical element. [Figure 2A] 1 is an example of a phase distribution imparted by a one-dimensional periodic diffractive optical element. [Figure 2B] 1 is an example of a phase distribution imparted by a two-dimensional periodic diffractive optical element. [Figure 3A] This is an example of a domain split polarizer. [Figure 3B] 2 is another example of a domain split polarizer. [Figure 4] 11 is a flowchart showing an example of a method for designing the phase distribution of a diffractive optical element. [Diagram 5] 2B is a design example of the diffractive optical element of FIG. 2A. [Figure 6] 2B is a design example of the diffractive optical element of FIG. 2A. [Figure 7] 2C is a design example of the diffractive optical element of FIG. 2B. [Figure 8] 2C is a design example of the diffractive optical element of FIG. 2B. [Figure 9] 2C is a design example of the diffractive optical element of FIG. 2B. [Figure 10] FIG. 1 illustrates an example of a metasurface. [Figure 11A] FIG. 13 shows an example of a metasurface pillar-shaped protrusion. [Figure 11B] FIG. 13 shows an example of a metasurface pillar-shaped protrusion. [Figure 11C] FIG. 13 shows an example of a metasurface pillar-shaped protrusion. [Figure 12] 11 is a diagram showing an imaging device according to a second embodiment using a diffractive optical element of the present invention. [Figure 13] FIG. 13 is a diagram showing an imaging device according to a third embodiment using a diffractive optical element of the present invention. [Figure 14] This is the subject photographed during the verification experiment. [Figure 15] This is a hologram obtained in a verification experiment. [Figure 16] This is a reconstructed image obtained in a verification experiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0020] (First embodiment) 1 is a diagram showing an imaging device according to a first embodiment of the present invention using a diffractive optical element. This embodiment is an example of a hologram imaging device using a transmission type diffractive optical element 4 that imparts a multi-tone phase distribution with three or more tones. The device configuration of the embodiment of FIG. 1 includes a bandpass filter 1, a polarizer 2, a circularly polarized bifocal lens 3, a diffractive optical element 4, an area division polarizer 5, an imaging element 20, and an information processing device 30.

[0021] The bandpass filter 1 transmits only light of a specific wavelength band from the spatially and temporally incoherent light waves reflected, transmitted, or emitted from the object to be photographed, thereby improving the temporal coherence. The wavelength width of the light transmitted through the bandpass filter 1 is, for example, 1 nm to 100 nm, and a narrower transmitted wavelength width is preferable. Note that if the temporal coherence of the light source is sufficiently high, the bandpass filter 1 can be omitted. After applying the bandpass filter 1, the light enters the polarizer 2.

[0022] The polarizer 2 converts the incident light into linearly polarized light. The circularly polarized bifocal lens 3 generates right-handed circularly polarized light and left-handed circularly polarized light by inputting linearly polarized light (for example, polarized light tilted by 45 degrees), and imparts the phase of a lens with a different focal length to each of the right-handed circularly polarized light and the left-handed circularly polarized light. The polarizer 2 and the circularly polarized bifocal lens 3 provide a first divided light of right-handed circularly polarized light and a second divided light of left-handed circularly polarized light (either polarized light may be the first divided light or the second divided light). In this embodiment, the polarizer 2 and the circularly polarized bifocal lens 3 are used, but two circularly polarized lights with different phase states can be realized by a single element, for example, by using a polarized diffractive lens or a metasurface, and can also be realized by combining an element having linear birefringence, such as a birefringent lens or a liquid crystal lens, with a quarter-wave plate. The first divided light and the second divided light are incident on the diffractive optical element 4.

[0023] The first and second divided beams are divided in multiple directions by the diffractive optical element 4. In this embodiment, the diffractive optical element 4 imparts a phase distribution with n gradations (n>2) to both the first and second divided beams for forming a hologram.

[0024] Specific examples of the diffractive optical element 4 are shown in Figs. 2A and 2B. Fig. 2A is an example of a phase distribution given by a one-dimensional periodic diffractive optical element (periodic only in the x direction, constant in the y direction), and Fig. 2B is an example of a phase distribution given by a two-dimensional periodic diffractive optical element (periodic in the x direction and y direction). In each figure, the upper side shows a plan view of the phase distribution, and the lower side shows a change in the phase value in the x direction at a certain position in the y direction of the plan view. Both diffractive optical elements have a phase gradation number of 3 or more and have a periodic phase distribution in the one-dimensional or two-dimensional direction, and the phase distribution is selected so that the intensities of the 0th order light and ±1st order light in the one-dimensional case and the intensities of the four 1st order lights in the two-dimensional case are uniform. Therefore, when a one-dimensional periodic diffractive optical element 4 is used, the first and second divided lights are each divided into three, and when a two-dimensional periodic diffractive optical element 4 is used, the first and second divided lights are each divided into four. The divided light waves are incident on the area-division polarizer 5.

[0025] The area-divided polarizer 5 is composed of linear polarizers with different angles of the transmission axis, and may be set to any value as long as each angle is different. Specific examples of the area-divided polarizer 5 are shown in Figs. 3A and 3B. When a one-dimensional diffractive optical element (Fig. 2A) is used as the diffractive optical element 4, it is preferable to configure the area-divided polarizer 5 with three areas with transmission axes shifted by 60 degrees as shown in Fig. 3A. The first and second divided lights divided into three by the diffractive optical element 4 are incident on each of the three areas. When a two-dimensional diffractive optical element (Fig. 2B) is used, the area-divided polarizer 5 is configured with four areas with transmission axes shifted by 45 degrees as shown in Fig. 3B, so that three-dimensional information of the subject can be obtained with high accuracy. The first and second divided lights, which have orthogonal circular polarizations, become parallel linearly polarized lights by passing through the area-divided polarizer 5, interfere with each other, and form a hologram. At this time, different phase shift amounts are imparted to the interference fringes depending on the angles of the transmission axes of the polarizers of the area-divided polarizer 5. If the angle of the transmission axis of the polarizer is θ, the phase shift amount imparted to the hologram is 2θ. Therefore, by using the area division polarizer 5 in Fig. 3B, four holograms with phase shift amounts of 0, π / 2, π, and 3π / 2 [rad] can be simultaneously obtained.

[0026] The formed multiple holograms are photographed by the imaging element 20. Digital data of the photographed holograms is transferred to the information processing device 30, and an image can be reconstructed by applying the signal processing described later. In the above description of the optical system, no additional lenses are described other than the circularly polarized bifocal lens 3, but in order to increase the light utilization efficiency or to arbitrarily control the image magnification, a lens may be placed anywhere before the diffractive optical element 4, and this does not impair the function of the present invention.

[0027] Next, a method for designing the diffractive optical element 4 will be described. The phase distributions in Figs. 2A and 2B cannot be analytically determined and are designed by non-convex optimization calculations. Fig. 4 is a flowchart showing an example of a method for designing the phase distribution of the diffractive optical element 4 according to the present invention. The method for designing the diffractive optical element 4 in Fig. 2A will be described based on the flowchart in Fig. 4 and the design examples in Figs. 5 and 6.

[0028] Step S1: The smallest unit of the phase region is called a pixel. First, a basic phase array (initial array) of 1 pixel in the vertical direction and 2N pixels in the horizontal direction (N is a natural number) is created. Each pixel θ1 to θ 2N Any phase value may be set for θ1 to θ N For the phase value 0 radians, θ N+1 ~θ 2N The calculation time for the optimization calculation described below can be shortened by setting a phase value of 0.6391π radians for . Note that the above phase value is the value for two gradations when the diffraction efficiency of the 0th order light and ±1st order light components of the one-dimensional periodic phase distribution is theoretically the same.

[0029] Step S2: Based on the basic array (initial array) of phases created in step S1, the basic array of the same phase is periodically expanded to create a phase grating (initial phase grating). In other words, the basic array (initial array) of phases is used as a repeating unit, and the same array is replicated and arranged in the vertical and horizontal directions to form a two-dimensional (planar) phase distribution. Note that the phase values ​​have periodicity in the x direction, and a constant one-dimensional period in the y direction. It is desirable to have as many copies as possible, as long as the memory and calculation time of the computer used for designing allows, and it is desirable for the pixel size after the periodic expansion to be a square that is a power of two.

[0030] Step S3: Multiply the created phase distribution (initial phase grating) by an amplitude distribution of the same number of pixels to construct a two-dimensional complex amplitude distribution. The amplitude distribution may be a uniform amplitude distribution. This complex amplitude distribution is Fourier transformed to obtain a Fourier spectrum.

[0031] Step S4: In the obtained Fourier spectrum, the amplitude distribution is replaced with a target value (target amplitude distribution). In this design example, the target value is an amplitude distribution in which the light intensity of the 0th order light and ±1st order light components is 1, and the light intensity of the other diffracted light components is 0. A new Fourier spectrum is generated by combining the replaced amplitude distribution while maintaining the phase distribution of the Fourier spectrum.

[0032] Step S5: The new Fourier spectrum generated is subjected to an inverse Fourier transform.

[0033] Step S6: From the phase distribution obtained as a result of the inverse Fourier transform, the phase distribution of 1×2N pixels in the center is cut out, and the updated basic phase array φ1 to φ 2N In the phase distribution obtained by the inverse Fourier transform, the central portion has small distortion and noise.

[0034] Next, the basic phase arrangement φ1 to φ 2N The target phase distribution is designed using optimization calculations with the initial values. Note that the optimization calculation method is not limited to a specific one. Here, we will show a design method using the highly versatile simulated annealing method.

[0035] Step S7: In the basic phase array, the phase of one pixel is randomly changed (for example, φ2 is replaced by φ'2).

[0036] Step S8: The basic array of the changed phase is periodically expanded to create a phase grating. That is, the basic array of the changed phase is used as a repeating unit, and the same array is arranged multiple times (replicated) in the vertical and horizontal directions to form a two-dimensional (planar) phase distribution. In this embodiment, the phase value has periodicity in the x direction, is constant in the y direction, and has a one-dimensional period.

[0037] Step S9: This two-dimensional phase distribution (phase grating) is multiplied by an amplitude distribution of the same number of pixels to form a two-dimensional complex amplitude distribution. The amplitude distribution may be a uniform amplitude distribution. This complex amplitude distribution is Fourier transformed to obtain a Fourier spectrum.

[0038] Step S10: The difference E between the amplitude distribution of the obtained Fourier spectrum and the target amplitude distribution is calculated. The difference E can be evaluated by any method, for example, the mean squared error (MSE) of all elements. It can be seen that the smaller this difference E is, the more the phase distribution capable of generating a Fourier spectrum closer to the target (desired) amplitude distribution is obtained. Note that, if the ±1st order light of the amplitude distribution obtained by Fourier transform tends to be smaller than the 0th order light depending on the calculation area and optimization method, the ±1st order components of the desired amplitude distribution can be set stronger than the 0th order light to efficiently search for a solution.

[0039] Step S11: Next, the difference E is evaluated. Depending on the value of the difference E, it is determined whether to update the basic array of the phase, that is, whether to accept the change from φ2 to φ'2. 2N The difference between the Fourier spectrum of the complex amplitude distribution constructed based on and the target value is defined as E0, and E is compared with E0. If E is smaller than E0 (Yes), proceed to step S14, and if E is equal to or larger than E0 (No), proceed to step S12.

[0040] Step S12: Determine whether the current calculation process (processing to change the phase at one location) corresponds to a predetermined probability S %. S is preferably a value that decreases with the number of iterative calculations, for example, exp(-(E-E0) / kI), where k is the Boltzmann constant and I is the number of iterations. If the current calculation process corresponds to a probability of S % (Yes), proceed to step S14, and if not (No), proceed to step S13.

[0041] Step S13: Return to step S7 without updating the basic array. In other words, the basic array of the phase before the change is adopted (the change from φ2 to φ'2 is not accepted).

[0042] Step S14: Update the basic array to a basic array of a phase that reflects the change. That is, adopt the basic array of a phase in which one phase has been randomly changed in step 7 (accept the change from φ2 to φ'2). Then, proceed to step S15.

[0043] Step S15: Determine whether or not a termination condition for the design process of the phase grating is satisfied. The termination condition is, for example, that the value of the difference E converges or becomes equal to or less than a specified value. If the condition is satisfied (Yes), the design process is terminated. If the condition is not satisfied (No), return to step S7 and apply the updated phase to the basic arrays φ1 to φ 2N Then, a similar process is repeated to approach the target phase grating.

[0044] The final basic array is then periodically expanded to determine the phase grating (phase distribution) of the diffractive optical element.

[0045] As a supplementary note about step S12, in general, in optimization calculations, when E is smaller than E0, the base array is updated, whereas when E is larger than E0, the base array with the phase before the change is adopted. However, to prevent stagnation at a local solution, even when E is larger than E0, a base array with a phase in which one phase is randomly changed is adopted with a certain probability of S%. This method (so-called simulated annealing) makes it possible to obtain a global optimal solution.

[0046] By performing this type of non-convex optimization calculation processing, the phase distribution shown in Fig. 2A is obtained. The one-dimensional periodic diffractive optical element that diffracts in three directions in Fig. 2A has a smaller number of light divisions than a two-dimensional periodic diffractive optical element that diffracts in four directions, and therefore can improve the light amount of each hologram.

[0047] The phase distribution in Fig. 2B can be obtained by a similar design method. A method for designing the diffractive optical element 4 in Fig. 2B will be described based on the flowchart in Fig. 4 and the design examples in Figs.

[0048] Step S1: First, create a basic phase array (initial array) of M (M>1) pixels in the vertical direction and 2N (N is a natural number) pixels in the horizontal direction. 1,1 ~θ M,2N Any phase value may be set for , but the calculation time for the optimization calculation described below can be shortened by setting a phase value of 0 radians for the M × N pixels in the left half of the basic array and a phase value of π radians for the M × N pixels in the right half. Note that the above phase values ​​are two-level values ​​when the diffraction efficiencies of the four first-order light components of the two-dimensional periodic phase distribution are theoretically the same.

[0049] Step S2: Based on the basic array (initial array) of phases created in step S1, the basic array of the same phase is periodically expanded to create a phase grating (initial phase grating). Here, a similar basic array is inverted in the vertical and horizontal directions for the basic array (initial array) of phases, and the copies are combined in the vertical direction to form a phase distribution of 2M x 2N pixels. This 2M x 2N pixels is used as a repeating unit, and the same phase distribution is duplicated and arranged in the vertical and horizontal directions to form a two-dimensional (planar) phase distribution. The phase value is a two-dimensional period having periodicity in the x and y directions. It is desirable to have as many copies as possible as long as the memory and calculation time of the computer used for designing allows, and it is desirable for the pixel size after the periodic expansion to be a square and a power of two.

[0050] Step S3: The created two-dimensional phase distribution (initial phase grating) is multiplied by an amplitude distribution of the same number of pixels to form a two-dimensional complex amplitude distribution. The amplitude distribution may be a uniform amplitude distribution. This complex amplitude distribution is Fourier transformed to obtain a Fourier spectrum.

[0051] Step S4: In the obtained Fourier spectrum, the amplitude distribution is replaced with a target value (target amplitude distribution). In this design example, the target value is an amplitude distribution in which the light intensity of the four first-order light components is 1 and the light intensity of the other diffracted light components is 0. A new Fourier spectrum is generated by combining the replaced amplitude distribution while maintaining the phase distribution of the Fourier spectrum.

[0052] Step S5: The new Fourier spectrum generated is subjected to an inverse Fourier transform.

[0053] Step S6: From the phase distribution obtained as a result of the inverse Fourier transform, the phase distribution of the central part of M × 2N pixels corresponding to the basic phase array is cut out, and the updated basic phase array φ 1,1 ~φ M,2N get.

[0054] Next, the basic phase array φ 1,1 ~φ M,2N Using the initial value, the target phase distribution is designed using optimization calculations. As with the design of the phase distribution in FIG. 2A described above, the optimization calculation is not limited to a specific one. Here, we will show a design method using the highly versatile simulated annealing method.

[0055] Step S7: Randomly change the phase of one pixel in the basic phase array (for example, φ 2,2 φ' 2,2 (Replace with ).

[0056] Step S8: The basic array of the changed phase is periodically expanded to form a two-dimensional phase distribution. That is, the basic array of the changed phase is inverted vertically and horizontally and combined with a duplicated pattern in the vertical direction to form a phase distribution of 2M x 2N pixels. This is used as a repeating unit, and the same phase distribution is arranged multiple times (duplicated) in the vertical and horizontal directions to form a phase distribution with a two-dimensional period.

[0057] Step S9: This two-dimensional phase distribution (phase grating) is multiplied by an amplitude distribution of the same number of pixels to form a two-dimensional complex amplitude distribution. The amplitude distribution may be a uniform amplitude distribution. This complex amplitude distribution is Fourier transformed to obtain a Fourier spectrum.

[0058] Step S10: The difference E between the amplitude distribution of the obtained Fourier spectrum and the target amplitude distribution is calculated. The difference E can be evaluated by any method. It can be seen that the smaller the difference E, the more the phase distribution that can generate a Fourier spectrum closer to the target (desired) amplitude distribution is obtained.

[0059] Step S11: Next, the difference E is evaluated. Depending on the value of the difference E, it is determined whether or not to update the basic array of the phase, i.e., φ 2,2 From φ' 2,2 The basic array φ of the phase before the change is judged. 1,1 ~φ M,2N The difference between the Fourier spectrum of the complex amplitude distribution constructed based on and the target value is defined as E0, and E is compared with E0. If E is smaller than E0 (Yes), proceed to step S14, and if E is equal to or larger than E0 (No), proceed to step S12.

[0060] Step S12: Determine whether the current calculation process (processing to change one phase) corresponds to a predetermined probability S%. In order to prevent stagnation at a local solution, even if E is E0 or more, a basic phase arrangement in which one phase is randomly changed is adopted with a certain probability S%. Therefore, if the execution of the current calculation process corresponds to a probability of S% (Yes), proceed to step S14, and if not (No), proceed to step S13. Note that S is preferably a value that decreases with the number of iterative calculations, and is, for example, exp(-(E-E0) / kI). Note that in this embodiment, it is assumed that the simulated annealing method is used as the optimization calculation, but other optimization calculation methods such as the iterative Fourier transform method, genetic algorithm, stochastic gradient descent method, and quantum annealing may be used.

[0061] Step S13: Return to step S7 without updating the basic array. In other words, the basic array of the phase before the change is adopted (φ 2,2 From φ' 2,2 does not accept changes in

[0062] Step S14: The basic array is updated to a basic array of a phase that reflects the change. That is, the basic array of a phase in which one phase is randomly changed in step 7 is adopted (φ 2,2 From φ' 2,2 (Accept the change in the number of times of the change). Then, the process proceeds to step S15.

[0063] Step S15: Determine whether or not the end condition for the design process of the phase grating is satisfied. If the condition is satisfied (Yes), the design process is terminated. If the condition is not satisfied (No), return to step S7 and apply the updated phase to the basic array φ 1,1 ~φ M,2N Then, a similar process is repeated to approach the target phase grating.

[0064] The final basic array is then periodically expanded to determine the phase grating (phase distribution) of the diffractive optical element.

[0065] By such a non-convex optimization calculation process, the phase distribution shown in Fig. 2B is obtained. The diffractive optical element having the phase distribution shown in Fig. 2B is more robust to processing errors than the diffractive optical element shown in Fig. 2A.

[0066] The phase distribution of the diffractive optical element of Figures 2A and 2B can be designed by a computer that performs each step of the flowchart of Figure 4. That is, the design of the phase distribution according to this embodiment is realized by executing a program that performs each step (procedure) of the flowchart on a computer processor. The program makes the computer execute the operation of each step, thereby making the computer function as a design device for the phase distribution. That is, the computer functions as a design device for the phase distribution of the diffractive optical element in accordance with the program.

[0067] The program may be stored in a non-transitory computer-readable medium. Examples of the non-transitory computer-readable medium include a flash memory, a magnetic recording device, an optical disk, a magneto-optical recording medium, or a ROM (read only memory). The program may be distributed by, for example, selling, transferring, or lending a portable medium such as an SD (Secure Digital) card, a DVD (digital versatile disc), or a CD-ROM (compact disc read only memory) on which the program is stored. The program may also be distributed by storing the program in the storage of a server and transferring the program from the server to another computer. The program may also be provided as a program product.

[0068] A computer temporarily stores in a main storage device, for example, a program stored in a portable medium or a program transferred from a server. The computer then reads the program stored in the main storage device with a processor and executes processing in accordance with the read program with the processor. The computer may read the program directly from a portable medium and execute processing in accordance with the program. The computer may execute processing in accordance with the received program each time a program is transferred to the computer from the server. A program is information used for processing by an electronic computer and includes anything equivalent to a program. For example, data that is not a direct instruction to a computer but has the properties of defining computer processing falls under "something equivalent to a program."

[0069] The number of steps or phase values ​​of the phase distribution used in the present invention are not limited to those shown in Figures 2A and 2B. Depending on the results of the optimization calculation, a different phase distribution may be obtained, but this does not impair the advantages of the present invention.

[0070] The phase distribution designed as described above can be realized as a diffractive optical element (an optical element with a different thickness for each pixel) with an uneven structure and n levels of height (n>2) made of optical materials such as glass or transparent resin, for example, by using a manufacturing method such as grayscale exposure in lithography, nanoimprinting, or three-dimensional stereolithography using two-photon absorption.

[0071] The designed phase distribution can also be realized by a metasurface that controls the phase of multiple gradations by the size, shape, and distribution of a fine structure smaller than the wavelength. For example, FIG. 10 shows an example of a metasurface that realizes a region of different phases (φ1, φ2) by varying the thickness of the fine cylindrical protrusions. Furthermore, a phase region of n gradations (n>2) can be realized by controlling the thickness of the cylindrical protrusions in multiple stages or by controlling the density of the cylindrical protrusions. The phase can also be controlled by varying the shape (top surface shape) of the cylindrical protrusions. FIG. 11A shows a cylindrical protrusion with a rectangular top surface, and FIG. 11B shows a cylindrical protrusion with an elliptical top surface. Also, FIG. 11C shows a cylindrical protrusion with an L-shaped top surface. In this way, a phase region of n gradations (n>2) can be realized by varying the in-plane shape or distribution of the fine cylindrical protrusions in various ways.

[0072] A hologram imaging device (for example, FIG. 1) can be configured using a diffractive optical element that realizes the designed phase distribution. The diffractive optical element of the present invention can be applied to various hologram imaging devices. Note that, although typical optical systems are illustrated below, the present invention is not limited to these and can be applied to any self-interferometer.

[0073] (Second embodiment) Fig. 12 is a diagram showing an imaging device of a second embodiment using a diffractive optical element of the present invention. This embodiment is an example of a hologram imaging device using a reflective diffractive optical element 4 that imparts a multi-tone phase distribution with three or more tones. The device configuration of the embodiment in Fig. 12 includes a bandpass filter 1, a polarizer 2, a circularly polarized bifocal lens 3, a beam splitter (BS) 6, a diffractive optical element 4, an area division polarizer 5, an imaging element 20, and an information processing device 30. Descriptions of configurations common to the first embodiment will be omitted or simplified.

[0074] Incoherent light emitted from an object to be photographed passes through bandpass filter 1 to become light of a specific wavelength band, and is then linearly polarized by polarizer 2. By inputting linearly polarized light, circularly polarized bifocal lens 3 generates a first split light and a second split light (right-handed circularly polarized light and left-handed circularly polarized light with different focal lengths).

[0075] A portion of the first and second divided light passes through the beam splitter 6 and enters the diffractive optical element 4. The diffractive optical element 4 imparts a phase distribution of n levels (n>2) to each of the first and second divided light, and reflects both of them. As a result, the reflected first and second divided light are split in multiple directions by diffraction. The beam splitter 6 changes the direction of the first and second divided light reflected and split by the diffractive optical element 4, and directs them toward the area division polarizer 5.

[0076] The first and second circularly polarized divided lights become parallel linearly polarized lights and interfere with each other by passing through the area-divided polarizer 5. A different amount of phase shift is imparted to the interference fringes depending on the angle of the transmission axis of each area of ​​the area-divided polarizer 5. The imaging element 20 simultaneously captures multiple holograms and transfers digital data of the captured holograms to the information processing device 30.

[0077] According to this embodiment, by introducing the beam splitter 6, a compact optical system can be constructed.

[0078] (Third embodiment) Fig. 13 is a diagram showing an imaging device of a third embodiment using a diffractive optical element of the present invention. This embodiment is an example of a hologram imaging device in which a diffractive optical element 4 that imparts a multi-tone phase distribution with three or more tones is applied to the configuration of a polarization interferometer. The device configuration of the embodiment of Fig. 13 includes a bandpass filter 1, a polarizer 2, a polarizing beam splitter (PBS) 7, quarter-wave plates 8 to 10, a plane mirror 11, a concave mirror 12, a diffractive optical element 4, an area-dividing polarizer 5, an imaging element 20, and an information processing device 30. Descriptions of configurations common to the first and second embodiments will be omitted or simplified.

[0079] Incoherent light emitted from an object to be photographed passes through bandpass filter 1 to become light of a specific wavelength band, and is then converted into linearly polarized light by polarizer 2.

[0080] The polarizing beam splitter 7 transmits the p-polarized component (referred to as the first divided light) of the light that has passed through the polarizer 2, and reflects the s-polarized component (referred to as the second divided light) to change its traveling direction (downward in the drawing). As will be described later, after reflection by the mirror, the first divided light enters the polarizing beam splitter 7 as s-polarized light, and the second divided light enters the polarizing beam splitter 7 as p-polarized light, so the polarizing beam splitter 7 reflects the first divided light after reflection by the mirror to change its traveling direction (upward in the drawing), transmits the second divided light, and combines the first and second divided lights.

[0081] The quarter-wave plate 8 transmits the p-polarized light component (first split light) that has been transmitted through the polarizing beam splitter 7 and converts it to circularly polarized light. Furthermore, the quarter-wave plate 8 transmits the circularly polarized light reflected by the plane mirror 11 and incident thereon, converting it to s-polarized light and directing it to the polarizing beam splitter 7.

[0082] The quarter-wave plate 9 transmits the s-polarized light component (second split light) reflected by the polarizing beam splitter 7 and converts it to circularly polarized light. It also transmits the circularly polarized light reflected by the concave mirror 12 and incident thereon, converting it to p-polarized light and directing it to the polarizing beam splitter 7.

[0083] In this embodiment, the plane mirror 11 gives the first divided light a plane (infinite focal length) phase distribution, and the concave mirror 12 gives the second divided light a phase distribution of a predetermined focal length, but the plane mirror 11 and the concave mirror 12 may be any mirrors having different focal lengths (curvatures).

[0084] The quarter-wave plate 10 transmits the first and second split beams transmitted / reflected by the polarizing beam splitter 7, and converts them into right-handed and left-handed circularly polarized light, respectively.

[0085] The diffractive optical element 4 imparts a phase distribution of n levels (n>2) to the first and second divided beams, whereby the first and second divided beams are split in multiple directions. The first and second divided beams are incident on the area division polarizer 5.

[0086] The first and second circularly polarized divided lights become parallel linearly polarized lights and interfere with each other by passing through the area-divided polarizer 5. A different amount of phase shift is imparted to the interference fringes depending on the angle of the transmission axis of each area of ​​the area-divided polarizer 5. The imaging element 20 simultaneously captures multiple holograms and transfers digital data of the captured holograms to the information processing device 30.

[0087] According to this embodiment, by introducing the polarizing beam splitter 7, there is no loss of light when passing through the beam splitter, and the light utilization efficiency can be improved.

[0088] An image is reconstructed by applying the following calculation to a hologram captured by any of the above optical systems in information processing device 30. First, multiple holograms contained in the captured image are extracted, and a phase shift method is applied to obtain a complex amplitude distribution O(x,y) containing three-dimensional information of the subject. When a one-dimensional periodic diffraction grating is used, the number of holograms contained in the captured image is three, and the three-step phase shift method of the following formula (1) is applied.

[0089]

number

[0090] Here, I C ,I L ,I R are the intensity distributions of the holograms formed in the center, left side, and right side on the image sensor surface, respectively, and φ C ,φ L ,φ R represents the amount of phase shift imparted to each hologram. α and β are the ratio of the diffraction efficiency of the -1st order light to the 0th order light of the light modulation element, and the ratio of the diffraction efficiency of the +1st order light to the 0th order light, respectively. The values ​​of α and β can be easily measured by measuring the diffraction efficiency in advance. If the manufacturing error of the optical system is sufficiently small or its effect can be ignored, then setting α=β=1 will be equivalent to the usual three-step phase shift method.

[0091] When using a two-dimensional periodic diffraction grating, the number of holograms contained in the captured image is four, and the four-step phase shift method of the following equation (2) is applied.

[0092]

number

[0093] Here, I1, I2, I3, and I4 are the intensity distributions of the holograms, respectively, and φ1, φ2, φ3, and φ4 are the phase shift amounts of each hologram.

[0094] An image of the subject is obtained by performing the propagation calculation of the following equation (3) on the complex amplitude distribution O(x, y) obtained by the phase shift method.

[0095]

number

[0096] Here, FT[…], FT -1 […] are the Fourier transform and inverse Fourier transform operators. λ is the wavelength of the light source. Z r is the propagation distance.

[0097] (verification) The degree to which the light quantity is improved by the diffractive optical element with a multi-tone (n gradations, n>2) phase distribution of the present invention, compared to a diffractive optical element with two gradations, was verified. The diffraction efficiencies of conventional one-dimensional and two-dimensional diffractive optical elements with two gradations were 87% and 64%, respectively, whereas the diffraction efficiencies of the one-dimensional and two-dimensional diffractive optical elements with multi-tone of the present invention were 93% and 86%, respectively. From this result, the diffractive optical element of the present invention improves the light utilization efficiency, and therefore an imaging device using the diffractive optical element of the present invention can reduce the amount of noise and improve the frame rate.

[0098] Next, we carried out a simulation verification experiment to confirm whether a hologram can be captured using a multi-tone diffractive optical element. The optical system of the imaging device adopted the configuration shown in Figure 1, and the diffractive optical element used was the two-dimensional diffractive optical element shown in Figure 2B. In addition, to control the image magnification, a lens with a focal length of 250 mm was added in front of the bandpass filter.

[0099] The details of the optical system are as follows. Light source wavelength: 633nm - Circular polarizing bifocal lens focal length: 350mm, 300mm Distance between circularly polarized bifocal lens and image sensor: 330mm Aperture diameter of each optical element: 12mm Period of diffractive optical element: 78μm

[0100] The specifications of the imaging element are as follows: Image sensor width: 15mm Pixel pitch: 6.5μm - Number of pixels: 2048 x 2048 Gradation: 16bit

[0101] Using the above optical system, the subject shown in Fig. 14 was photographed. Fig. 15 shows a hologram acquired by the above optical system. Four holograms were extracted from this image, and the complex amplitude distribution was calculated using equation (2) to reconstruct the image. Fig. 16 shows the reconstructed image obtained as a result of the propagation calculation using equation (3). It can be seen that the subject was photographed using the present invention.

[0102] Although the above-mentioned embodiment has been described as a representative example, it is obvious to those skilled in the art that many modifications and substitutions can be made within the spirit and scope of the present invention. Therefore, the present invention should not be interpreted as being limited by the above-mentioned embodiment, and various modifications or changes can be made without departing from the scope of the claims. For example, the functions included in each block, each step, etc. described in the embodiment can be rearranged so as not to be logically inconsistent, and multiple configuration blocks, steps, etc. can be combined into one or divided. [Industrial Applicability]

[0103] The imaging device of the present invention can be used as a stereoscopic camera and is applicable to interference measurement and analysis devices such as a fluorescent three-dimensional microscope. [Explanation of symbols]

[0104] 1. Bandpass Filter 2 Polarizer 3 Circularly polarized bifocal lenses 4. Diffractive Optical Elements 5 Region segmented polarizer 6 Beam splitter 7 Polarizing Beam Splitter 8~10 1 / 4 wave plate 11 plane mirror 12 concave mirror 20. Image sensor 30 Information processing device

Claims

1. 1. An imaging device that divides incoherent light into a first divided light and a second divided light, imparts different phase distributions to the first divided light and the second divided light, and then causes the first divided light and the second divided light to interfere with each other to form a hologram and image the hologram, an imaging device which splits the first divided light and the second divided light into three or four directions with uniform light intensity using a diffractive optical element that imparts a one-dimensional or two-dimensional periodic phase distribution with n levels (n>2), passes each of the split light through linear polarizers with different angles of the transmission axis, thereby forming multiple holograms with different amounts of phase shift, and simultaneously images the multiple holograms.

2. 2. The imaging device according to claim 1, The imaging device further includes an information processing device that acquires complex amplitude distributions from the plurality of holograms by a phase shift method and generates a reconstructed image by a propagation calculation.

3. A diffractive optical element having a one-dimensional periodic phase distribution, which is composed of 1 x 2N pixels (N is a natural number), each pixel having a basic phase array with n phase values ​​of gradations (n ​​> 2), and which is arranged in multiple vertical and horizontal directions, and which divides a transmitted or reflected light wave into three lights of uniform intensity.

4. A diffractive optical element having a two-dimensional periodic phase distribution, the diffractive optical element being configured by arranging a plurality of repeating units in the vertical and horizontal directions, the repeating units being composed of M x 2N pixels (M>1, N is a natural number), each pixel having a phase value of n levels (n>2), and a basic phase array in which the basic array is mirror-mirrored and replicated and then vertically combined, the repeating units being composed of 2M x 2N pixels, the repeating units being arranged in the vertical and horizontal directions, the diffractive optical element dividing a transmitted or reflected light wave into four light beams of uniform intensity.

5. 5. The diffractive optical element according to claim 3, A diffractive optical element, characterized in that the phase distribution is realized by a concave-convex structure of an optical material having n levels of height (n>2).

6. 5. The diffractive optical element according to claim 3, A diffractive optical element, characterized in that the phase distribution is realized by a metasurface having columnar protrusions whose size is less than the wavelength of the light source and whose in-plane shapes or distributions differ from one another.

7. Your computer must have at least one of the following steps: Step A. Creating an initial array of phases consisting of a plurality of pixels, and periodically expanding the initial array to create an initial phase grating; Step B: A step of combining the initial phase grating and a predetermined amplitude distribution and performing a Fourier transform; Step C: A step of combining the phase distribution obtained by the Fourier transform and the target amplitude distribution and performing an inverse Fourier transform; Step D: Extracting a basic array consisting of a plurality of pixels from the phase distribution obtained by the inverse Fourier transform; Step E. Changing the phase of one pixel of the basic array and periodically expanding the changed basic array to create a phase grating; Step F. Combining the phase grating with a predetermined amplitude distribution and performing a Fourier transform; Step G: A step of calculating a difference between an amplitude distribution obtained by the Fourier transform based on the phase grating and a target amplitude distribution; Step H. Evaluating the difference and selecting one of the base sequence and a modified base sequence; Step I: Periodically expanding the finally obtained basic array to determine the phase distribution of n levels (n>2) of the diffractive optical element; A program for executing.

Citation Information

Patent Citations

  • Surge voltage absorbing circuit for converter

    JP1989016270A

  • Hologram photographing device and image reconstruction system

    JP2021131457A

  • Optical modulator and phase measuring device

    JP2021184033A

  • Light modulation element, hologram imaging device, and image reconstruction device

    JP2022097130A

  • Hologram recording device and image reconstructor

    JP7122153B2