Optical device, information processing method and program

The optical device improves shape measurement accuracy by using a light source with a finite-sized emitting surface and spectral light separation to enhance the precision of deriving surface texture and shape information.

JP2024160005AInactive Publication Date: 2024-11-08KK TOSHIBA
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2024151200
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-09-03
Publication Date
2024-11-08
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The spread of light during non-contact shape measurement reduces the accuracy of measuring the shape of objects.

Method used

An optical device that includes a light source with a finite-sized emitting surface, an optical element to reduce light divergence, a light selection section to split light into multiple spectral rays in different wavelength regions, and an image sensor to capture spectral images, combined with a derivation unit to determine irradiation areas and derive shape information based on light intensity.

Benefits of technology

Enhances shape measurement accuracy by allowing finer distinction of irradiation areas and improves the precision of deriving surface texture and shape information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024160005000001_ABST
    Figure 2024160005000001_ABST
Patent Text Reader

Abstract

To accurately derive shape information of an inspected object.SOLUTION: An optical device 1A comprises a light selection unit 30, an imaging element 40, and a derivation unit. The light selection unit 30 disperses an injected light beam R into a plurality of dispersed light beams L having wavelength regions being different from each other. The imaging element 40 images an inspected object B irradiated with the plurality of dispersed light beams L, and acquires a dispersed image. The derivation unit derives surface quality or shape information of the inspected object B from an identification result, in which an irradiation area E of each of the plurality of dispersed light beams L in the inspected object B is identified, on the basis of received light intensity of each of the plurality of dispersed light beams L included in the dispersed image.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] FIELD An embodiment of the present invention relates to an optical device, an information processing method, and a program. [Background technology]

[0002] In various industries, non-contact shape measurement of an object is important. For example, a method for acquiring the shape of an object by illuminating an object with spectroscopic light and acquiring an image of the spectroscopic light by an image sensor has been disclosed. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] U.S. Pat. No. 5,675,407 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the past, when light was split and irradiated onto the object, the light spread, which could reduce the measurement accuracy of the object's shape. [Means for solving the problem]

[0005] The optical device of the embodiment includes an irradiation unit, a light selection unit, an image sensor, and a lead-out unit. The irradiation unit includes a light source having a light-emitting surface of a finite size, and an optical element that reduces the divergence angle of a light beam that is divergent light or quasi-parallel light emitted from the light source. The light selection unit separates the light beam irradiated from the irradiation unit into a plurality of separated light beams in two or more mutually different wavelength regions, which are a first separated light beam in a first wavelength region and a second separated light beam in a second wavelength region. The image sensor images a subject irradiated with the plurality of separated light beams, and obtains a spectral image separated into at least the first wavelength region and the second wavelength region. The derivation unit derives surface property or shape information of the object from a result of identifying a first irradiation area of ​​the object where only the first spectral light beam in the first wavelength range is irradiated, a second irradiation area where the area of ​​the first spectral light beam and the area of ​​the second spectral light beam overlap, and a third irradiation area of ​​the object where only the second spectral light beam is irradiated, based on the received light intensities of each of the plurality of spectral light beams included in the spectral image. [Brief description of the drawings]

[0006] [Figure 1] Schematic diagram of an optical device. [Diagram 2] FIG. 2 is a block diagram showing a functional configuration of an information processing device. [Figure 3A] FIG. 4 is a diagram showing the wavelength spectrum of an irradiated area. [Figure 3B] FIG. 4 is a diagram showing the wavelength spectrum of an irradiated area. [Figure 3C] FIG. 4 is a diagram showing the wavelength spectrum of an irradiated area. [Figure 4] 1 is a flowchart showing the flow of information processing. [Diagram 5] Schematic diagram of an optical device. [Figure 6] Schematic diagram of an optical device. [Figure 7A] FIG. 4 is a diagram showing the wavelength spectrum of an irradiated area. [Figure 7B] FIG. 4 is a diagram showing the wavelength spectrum of an irradiated area. [Figure 7C] FIG. 4 is a diagram showing the wavelength spectrum of an irradiated area. [Figure 8] Schematic diagram of an optical device. [Figure 9]FIG. 4 is a schematic diagram showing the intensity distribution of spectral light rays. [Figure 10A] FIG. 4 is a diagram showing the wavelength spectrum of an irradiated area. [Figure 10B] FIG. 4 is a diagram showing the wavelength spectrum of an irradiated area. [Figure 10C] FIG. 4 is a diagram showing the wavelength spectrum of an irradiated area. [Figure 11] Schematic diagram of an optical device. [Figure 12A] FIG. [Figure 12B] FIG. [Figure 13] Hardware configuration diagram. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] The optical device of this embodiment will be described in detail below with reference to the accompanying drawings.

[0008] The drawings used in the description of the embodiments are schematic or conceptual, and the relationship between the thickness and width of each part, the size ratio between parts, etc. are not necessarily the same as those in reality. Even when the same part is shown, the dimensions and ratios of each part may be different depending on the drawing. In this specification and each drawing, elements similar to those described above with respect to the previous drawings are given the same reference numerals, and detailed descriptions are omitted as appropriate.

[0009] (First embodiment) FIG. 1 is a schematic diagram showing an example of an optical device 1A according to the present embodiment.

[0010] The optical device 1A is an example of an optical device. When the optical devices of this embodiment and the embodiments described below are collectively described, they may be simply referred to as the optical device 1.

[0011] The optical device 1A includes a light source 10, a light selection unit 30, an image pickup element 40, and an information processing device 50. The image pickup element 40 and the information processing device 50 are connected to each other so as to be able to exchange data or signals.

[0012] The light source 10 emits a light ray R. The light ray R is an example of an electromagnetic wave.

[0013] The light source 10 may be any light source as long as the light emitting surface 11 has a finite size and emits electromagnetic waves. The light emitting surface 11 is the emission surface of the light source 10 from which the light ray R is emitted. The light emitting surface 11 having a finite size means that the light source 10 is substantially larger than a point light source in the optical system.

[0014] The light beam R emitted by the light source 10 is, for example, visible light, X-rays, infrared rays, microwaves, etc. The light beam R emitted by the light source 10 may be either coherent light or incoherent light. The coherent light is, for example, a laser beam. The incoherent light is, for example, a light emitting diode (LED).

[0015] In this embodiment, the light source 10 is an LED as an example. The light source 10 is not limited to an LED, and may be an incandescent light bulb, a fluorescent tube, a mercury lamp, or the like. The light source 10 may be a light source that irradiates a laser, infrared light, or X-rays. The wavelength included in the light ray R emitted from the light source 10 may be determined according to the wavelength selectivity of the light selection unit 30 described later.

[0016] In this embodiment, the light ray R emitted from the light source 10 is an electromagnetic wave, for example, a case where the light ray R is visible light will be described as an example. Specifically, in this embodiment, the light ray R emitted from the light source 10 includes light rays having a wavelength in the visible light region of 400 nm to 800 nm will be described as an example. Note that the wavelength included in the light ray R is not limited to this wavelength.

[0017] The LED serving as the light source 10 of this embodiment may be an LED having a finite-sized light-emitting surface 11. In this embodiment, the light-emitting surface 11 is described assuming a size of 0.2 mm×0.2 mm. Note that the size of the light-emitting surface 11 is not limited to this size.

[0018] The specimen B is an object to be inspected in the optical device 1A. The specimen B may be any object that refracts or scatters the light beam R irradiated via the light selection unit 30 described later. The specimen B may be, for example, a living cell, an object including a laser welded region, etc., but is not limited thereto. The laser welded region is a region welded by a laser. The specimen B may be any of a solid, a liquid, and a gas. In this embodiment, a case where the specimen B is a solid will be described as an example.

[0019] The light selection unit 30 separates the light beam R emitted from the light source 10 into a plurality of light beams having mutually different wavelength regions. The separated light beam R will be referred to as a separated light beam L in the following description.

[0020] In this embodiment, the light selection unit 30 splits the light beam R emitted from the light source 10 into a first split light beam L1 in a first wavelength region and a second split light beam L2 in a second wavelength region. The first split light beam L1 and the second split light beam L2 are examples of split light beam L. The first wavelength region and the second wavelength region are different wavelength regions. The light selection unit 30 may be configured to split the split light beam L into three or more different wavelength regions, and is not limited to splitting the split light beam L into the first split light beam L1 and the second split light beam L2.

[0021] The light selecting unit 30 passes the first and second divided light rays L1 and L2, which are light rays R in different wavelength regions, from different wavelength selecting regions 31. The light selecting unit 30 may pass the first and second divided light rays L1 and L2 in different directions. That is, the light selecting unit 30 only needs to have the function of passing a plurality of light rays R in different wavelength regions through different positions in the light selecting unit 30 or in different directions from the light selecting unit 30.

[0022] In this embodiment, the light selecting section 30 has, as the multiple wavelength selecting regions 31, a first wavelength selecting region 31A and a second wavelength selecting region 31B.

[0023] The first wavelength selection region 31A and the second wavelength selection region 31B are disposed at different positions on a two-dimensional plane perpendicular to the optical axis Z in the light selection unit 30. The first wavelength selection region 31A and the second wavelength selection region 31B transmit light rays R in different wavelength regions.

[0024] "Passing light ray R" means at least one of transmitting light ray R and specularly reflecting light ray R. In either case of transmission or specular reflection, when light passes through the optical path that reaches the image sensor 40 (described later), both transmission and specular reflection are referred to as "passing". In this embodiment, a case where "passing" means "transmission" is described as an example.

[0025] The first wavelength selection region 31A passes a first spectral light beam L1 in a first wavelength region, and the second wavelength selection region 31B passes a second spectral light beam L2 in a second wavelength region.

[0026] For example, assume that the first spectral light ray L1 in the first wavelength region is a blue (e.g., wavelength 450 nm) light ray R. Also assume that the second spectral light ray L2 in the second wavelength region is a red (e.g., wavelength 650 nm) light ray R. In this case, the first wavelength selection region 31A passes the first blue spectral light ray L1 contained in the irradiated light ray R, and the second wavelength selection region 31B passes the second red spectral light ray L2 contained in the light ray R.

[0027] The first wavelength selection region 31A and the second wavelength selection region 31B may be realized, for example, by arranging a bandpass filter corresponding to the wavelength region of the light ray R to be passed in an opening provided in the light selection unit 30. Specifically, the first wavelength selection region 31A may be configured with a bandpass filter for the first wavelength region, and the second wavelength selection region 31B may be configured with a bandpass filter for the second wavelength region. The width of each of the bandpass filters in the first wavelength selection region 31A and the second wavelength selection region 31B may be, for example, 0.1 mm. Note that the width of the bandpass filter is not limited to this value.

[0028] The image sensor 40 captures an image of the subject B irradiated with the first and second spectral rays L1 and L2 to obtain a spectral image. A spectral image is an image obtained by dispersing light into a plurality of wavelength regions different from each other. In this embodiment, the image sensor 40 captures a spectral image dispersed into at least a first wavelength region and a second wavelength region.

[0029] The imaging element 40 is, for example, a charge-coupled device (CCD), a complementary metal-oxide semiconductor (CMOS), etc. Note that the imaging element 40 may be a hyperspectral camera capable of acquiring at least five or more different wavelength regions.

[0030] In this embodiment, a case will be described as an example where the imaging element 40 is an imaging element in which a photoelectric conversion element (photodiode) is arranged for each pixel. The imaging element 40 separates and receives at least a first divided light beam L1 and a second divided light beam L2 at each of a plurality of pixels. The light intensity of the light beam R received at each pixel may be referred to as received light intensity, intensity, or pixel value. Hereinafter, the light intensity of the light beam R received at each pixel will be referred to as a pixel value.

[0031] For example, the image sensor 40 may be configured to include multiple wavelength filters for each pixel. The multiple wavelength filters are filters that selectively transmit light rays R of different wavelengths. By including multiple wavelength filters for each pixel, the image sensor 40 can disperse light at each pixel. That is, the image sensor 40 can simultaneously capture spectral images obtained by dispersing light in the first wavelength region and the second wavelength region.

[0032] Next, the optical action of the optical device 1A will be described.

[0033] The first spectral light ray L1 in the first wavelength region included in the light ray R irradiated from the light source 10 passes through the first wavelength selection region 31A and reaches the specimen B. That is, a specific irradiation area EA on the surface of the specimen B is irradiated by the first spectral light ray L1. The irradiation area EA by the first spectral light ray L1 is an area bounded by an edge ray G1 that is emitted from an end of the light ray R in the first wavelength region, the light ray being of a finite size, of the light source 10, and that passes through an end of the first wavelength selection region 31A. That is, the irradiation area EA by the first spectral light ray L1 is an area defined by the edge ray G1.

[0034] On the other hand, the second spectral light ray L2 in the second wavelength region included in the light ray R irradiated from the light source 10 passes through the second wavelength selection region 31B and reaches the specimen B. That is, a specific irradiation region EB on the surface of the specimen B is irradiated by the second spectral light ray L2. The irradiation region EB by the second spectral light ray L2 is a region bounded by an edge ray G2 of the light ray R in the second wavelength region that is emitted from an end of the light emitting surface 11 of the finite size of the light source 10 and passes through an end of the second wavelength selection region 31B. That is, the irradiation region EB by the second spectral light ray L2 is a region defined by the edge ray G2.

[0035] Here, when the light emitting surface 11 of the light source 10 is a point light source, the illumination area EA by the first divided light beam L1 and the illumination area EB by the second divided light beam L2 do not overlap. The definition of non-overlapping also includes a case where only the boundaries between the illumination areas EA and EB overlap.

[0036] On the other hand, as described above, the light source 10 of the present embodiment has a finite size of the light emitting surface 11 of the light source 10. Therefore, there is an overlapping area between the illumination area EA by the first divided light beam L1 and the illumination area EB by the second divided light beam L2.

[0037] Specifically, as shown in FIG. 1, an irradiation area E of the subject B that is irradiated with the light beam R is divided into a first irradiation area E1, a second irradiation area E2, and a third irradiation area E3.

[0038] The first irradiation area E1 is an area on the subject B that is irradiated only with the first spectral light beam L1 in the first wavelength region. The second irradiation area E2 is an area on the subject B that is irradiated with the first spectral light beam L1 in the first wavelength region and the second spectral light beam L2 in the second wavelength region in an overlapping manner. The third irradiation area E3 is an area on the subject B that is irradiated only with the second spectral light beam L2.

[0039] The imaging element 40 captures an image of the subject B, in which a first irradiation area E1, a second irradiation area E2, and a third irradiation area E3 are formed by being irradiated with the first and second spectral light beams L1 and L2, to obtain a spectral image.

[0040] Next, the information processing device 50 will be described.

[0041] The information processing device 50 is connected to the imaging element 40 so as to be able to exchange data or signals with the imaging element 40. The information processing device 50 analyzes the spectroscopic image captured by the imaging element 40.

[0042] 2 is a block diagram showing an example of a functional configuration of the information processing device 50. The information processing device 50 includes a processing unit 52, a storage unit 54, and an output unit 56. The processing unit 52, the storage unit 54, and the output unit 56 are connected via a bus 58 so as to be able to exchange data or signals.

[0043] The storage unit 54 stores various data. The storage unit 54 is, for example, a semiconductor memory element such as a RAM or a flash memory, a hard disk, an optical disk, or the like. The storage unit 54 may be a storage device provided outside the information processing device 50. The storage unit 54 may also be a storage medium. Specifically, the storage medium may be a medium in which a program or various information is downloaded and stored or temporarily stored via a LAN (Local Area Network) or the Internet. The storage unit 54 may also be composed of multiple storage media.

[0044] The output unit 56 outputs various information. For example, the output unit 56 includes at least one of a display, a speaker, and a communication unit that communicates with an external device via a network.

[0045] The processing unit 52 includes an acquisition unit 52A, a derivation unit 52B, and an output control unit 52C. At least one of the acquisition unit 52A, the derivation unit 52B, and the output control unit 52C is realized, for example, by one or more processors. For example, each of the above units may be realized by having a processor such as a CPU (Central Processing Unit) execute a program, that is, by software. Each of the above units may be realized by a processor such as a dedicated IC (Integrated Circuit), that is, by hardware. Each of the above units may be realized by using both software and hardware. When multiple processors are used, each processor may realize one of the units, or may realize two or more of the units.

[0046] The acquisition unit 52A acquires a spectral image from the image sensor 40.

[0047] The derivation unit 52B specifies an irradiation region E of each of the plurality of spectral light beams L on the subject B based on the received light intensity of each of the plurality of spectral light beams L included in the spectral image acquired by the acquisition unit 52A. Then, the derivation unit 52B derives shape information of the subject B from this specification result.

[0048] In the present embodiment, the derivation unit 52B analyzes the spectral images acquired by the acquisition unit 52A to identify the irradiation regions E of the first and second spectral light beams L1 and L2 on the subject B. Then, from the identification results of the irradiation regions E, shape information of the subject B is derived.

[0049] Explain in detail.

[0050] 3A to 3C are diagrams showing examples of wavelength spectra of the first irradiation area E1, the second irradiation area E2, and the third irradiation area E3. In Fig. 3A to 3C, the horizontal axis indicates wavelength, and the vertical axis indicates pixel value. The pixel value may be normalized as necessary.

[0051] Fig. 3A is a diagram showing an example of a wavelength spectrum of a first irradiation area E1, Fig. 3B is a diagram showing an example of a wavelength spectrum of a second irradiation area E2, and Fig. 3C is a diagram showing an example of a wavelength spectrum of a third irradiation area E3.

[0052] 3A to 3C also show background noise N. The background noise N is an example of a dark current component. In this embodiment, the background noise N means the pixel values ​​of the spectral image obtained by the image sensor 40 before the light source 10 is turned on and the light ray R is emitted. In other words, the background noise N is the pixel value of each pixel of the spectral image when the light source 10 is turned off.

[0053] As shown in Fig. 3A, for the first irradiation area E1, a pixel value equal to or greater than the first threshold is obtained for the first spectral light L1 in the first wavelength area S1. As shown in Fig. 3B, for the second irradiation area E2, a pixel value equal to or greater than the first threshold is obtained for both the first wavelength area S1 and the second wavelength area S2. Also, as shown in Fig. 3C, for the third irradiation area E3, a pixel value equal to or greater than the first threshold is obtained for the second wavelength area S2. The first threshold may be a value that can be determined to be light received by irradiation with the light ray R.

[0054] As shown in FIGS. 3A to 3C, by combining pixel values ​​for both the first wavelength region S1 and the second wavelength region S2, the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3 can be distinguished.

[0055] On the other hand, even if only the pixel values ​​for the first wavelength region S1 are analyzed, it is not possible to distinguish between the first irradiation region E1 and the second irradiation region E2 (see FIG. 3A). Also, even if only the pixel values ​​for the second wavelength region S2 are analyzed, it is not possible to distinguish between the first irradiation region E1 and the second irradiation region E2 (see FIG. 3C). That is, it is only by using a combination of pixel values ​​for both the first wavelength region S1 and the second wavelength region S2 that it is possible to distinguish between the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3.

[0056] Returning to FIG. 2, the description will be continued. The derivation unit 52B identifies an irradiation area E of each of the first and second spectral light rays L1 and L2 in the subject B based on a first pixel value in the first wavelength region S1 and a second pixel value in the second wavelength region S2 included in the spectral image. The first pixel value is an example of a first received light intensity. The second pixel value is an example of a second received light intensity.

[0057] In detail, the derivation unit 52B identifies each of the first irradiation area E1, the second irradiation area E2, and the third irradiation area E3 in the spectral image by using a combination of pixel values ​​for the first wavelength area S1 and the second wavelength area S2.

[0058] In other words, the derivation unit 52B can distinguish between the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3 only by using a combination of pixel values ​​for the first wavelength region S1 and the second wavelength region S2. That is, the derivation unit 52B can distinguish the irradiation region E in more detail.

[0059] Then, the derivation unit 52B derives shape information of the subject B from the result of identifying the irradiation region E.

[0060] The shape information can be derived using calculation methods that are commonly used in calculating three-dimensional shapes using structured illumination, such as the phase shift method, the fringe projection method, and the light section method. However, the shape here also includes the fine surface shapes, i.e., irregularities and scratches. These fine surface shapes are also called surface textures. In other words, the shape described here also includes surface textures.

[0061] When deriving shape information using structured illumination, the finer the pattern of the irradiation area E, the more accurate the shape information derivation. In this embodiment, the derivation unit 52B uses a combination of pixel values ​​of the first wavelength region S1 and the second wavelength region S2 to distinguish and specify the irradiation area E into a first irradiation area E1, a second irradiation area E2, and a third irradiation area E3. Then, the derivation unit 52B derives shape information of the subject B from the specification result.

[0062] Therefore, the derivation section 52B can derive shape information of the subject B with high accuracy, compared to a case where a combination of pixel values ​​in the first wavelength region S1 and the second wavelength region S2 is not used.

[0063] In addition, in this embodiment, the derivation unit 52B can specify the irradiation area E by subdividing it into a first irradiation area E1, a second irradiation area E2, and a third irradiation area E3. This is because the light source 10 having the light emitting surface 11 with a finite size is used to form the second irradiation area E2 where the irradiation area E by the first and second spectral light rays L1 and L2 overlap on the subject B. Therefore, in this embodiment, the light source 10 having the light emitting surface 11 with a finite size is used, and the shape information can be derived with even higher accuracy by using a combination of pixel values ​​of the first wavelength region S1 and the second wavelength region S2.

[0064] In addition, by making the first wavelength selection region 31A and the second wavelength selection region 31B the same size, the first irradiation region E1 and the third irradiation region E3 can be made to be approximately the same size. This allows the first irradiation region E1 and the third irradiation region E3 to be specified and the shape information to be calculated with approximately the same shape accuracy in each irradiation region. In other words, there is an effect of reducing the variation in shape accuracy.

[0065] The size of the light-emitting surface 11 is S0, the size of the first wavelength selective region 31A is S1, the size of the second wavelength selective region 31B is S2, the distance from the light selecting unit 30 to the light source is D0, and the distance from the light selecting unit 30 to the irradiation region is D1. In this case, the size SE1 of the first irradiation region E1, the size SE2 of the second irradiation region E2, and the size SE3 of the third irradiation region E3 are respectively expressed by the following formulas (1), (2), and (3).

[0066] SE1=S1×D1 / D0...Formula (1) SE2=S0×D1 / D0...Equation (2) SE3=S2×D1 / D0...Equation (3)

[0067] In this case, if the size S0 of the light emitting surface 11 is expressed by the following formula (4), the first irradiation area E1 and the second irradiation area E2 can be made to be approximately the same size.

[0068] S0=S1...Equation (4)

[0069] This allows the first irradiation area E1 and the second irradiation area E2 to be specified, and the shape accuracy of each irradiation area can be made substantially equal when calculating the shape information. In other words, there is an effect of reducing the variation in shape accuracy.

[0070] Furthermore, when the size of the first wavelength selection region 31A and the size of the second wavelength selection region 31B are made equal and the size S0 of the light emitting surface 11 is made larger than them, that is, when the following formula (5) holds, the size SE1 of the first irradiation region E1 and the size SE2 of the second irradiation region E2 can be made equal.

[0071] S0>S1=S2...Equation (5)

[0072] Furthermore, there is an effect that it can be brighter because the light emitting surface 11 is large. Brightness improves the S / N (signal-to-noise ratio) during imaging. In other words, there is an effect that it is possible to reduce variations in shape precision.

[0073] In addition, it is preferable that the derivation unit 52B derives the shape information based on the first pixel value in the first wavelength region S1 and the second pixel value in the second wavelength region S2 after removing background noise N, which is an example of a dark current component.

[0074] The derivation unit 52B first compares the combination of pixel values ​​in the first wavelength region S1 and the second wavelength region S2 with the background noise N. In detail, the derivation unit 52B judges whether each of the pixel values ​​in the first wavelength region S1 and the second wavelength region S2 is greater than the pixel value of the background noise N. This judgment process allows the derivation unit 52B to suppress, for example, assuming that the irradiation region EB of the second spectral light beam L2 exists in the first irradiation region E1. In this embodiment, the derivation unit 52B removes the pixel value of the background noise N from each pixel value in the first wavelength region S1 and the second wavelength region S2. The pixel value of the background noise N may be measured in advance and stored in the storage unit 54. The derivation unit 52B then specifies the irradiation region E using the combination of pixel values ​​in the first wavelength region S1 and the second wavelength region S2 after the background noise N has been removed.

[0075] It is possible to reduce erroneous recognition of the irradiation area E by specifying the irradiation area E (the first irradiation area E1, the second irradiation area E2, and the third irradiation area E3) using the pixel values ​​of each of the first wavelength area S1 and the second wavelength area S2 from which the background noise N has been removed. In addition, by deriving shape information using this specification result, the derivation unit 52B can reduce derivation errors of the shape information of the subject B.

[0076] Next, the output control unit 52C will be described. The output control unit 52C outputs to the output unit 56 the result of the shape information derivation by the derivation unit 52B.

[0077] Next, a description will be given of an example of the flow of information processing executed by the information processing device 50. FIG.

[0078] First, the acquisition unit 52A acquires a spectral image from the image sensor 40 (step S100).

[0079] The derivation unit 52B identifies irradiation areas E of the subject B to which the first and second spectral rays L1 and L2 are respectively irradiated, based on the first pixel value in the first wavelength region S1 and the second pixel value in the second wavelength region S2 contained in the spectral image acquired in step S100 (step S102).

[0080] The derivation unit 52B derives shape information of the subject B from the identification result identified in step S102 (step S104).

[0081] The output control unit 52C outputs the result derived in step S104 to the output unit 56 (step S106). Then, this routine ends.

[0082] As described above, the optical device 1A of this embodiment includes the light selecting unit 30, the image pickup element 40, and the derivation unit 52B. The light selecting unit 30 splits the irradiated light beam R into a plurality of spectral light beams L having mutually different wavelength regions. The image pickup element 40 captures an image of the subject B irradiated with the plurality of spectral light beams L to obtain a spectral image. The derivation unit 52B derives shape information of the subject B from a result of identifying an irradiation region E of each of the plurality of spectral light beams L on the subject B based on the received light intensity of each of the plurality of spectral light beams L included in the spectral image.

[0083] In this manner, the optical device 1A of the present embodiment irradiates the subject B with a plurality of different spectral light beams L separated by the light selection unit 30. The derivation unit 52B then identifies an irradiation area E of each of the plurality of spectral light beams L on the subject B based on a spectral K image, which is an image of the subject B captured by the imaging element 40. That is, the derivation unit 52B can more finely distinguish the irradiation area E of the spectral light beams L of the plurality of wavelength regions by using a combination of pixel values ​​for each of the different wavelength regions. The derivation unit 52B then derives shape information of the subject B from the result of identifying the irradiation area E.

[0084] Therefore, the optical device 1A of this embodiment can derive shape information of the subject B with high accuracy.

[0085] Second Embodiment In this embodiment, a configuration further including an optical element in addition to the configuration of the optical device 1A of the first embodiment will be described.

[0086] 5 is a schematic diagram showing an example of an optical device 1B according to this embodiment. The optical device 1B has a configuration further including a lens 60 in addition to the configuration of the optical device 1A.

[0087] The lens 60 is an example of an optical element. The optical element reduces the divergence angle of the light ray R emitted from the light source 10. Specifically, the optical element converts the divergent light, which is the light ray R emitted from the light source 10, into quasi-parallel light.

[0088] Quasi-parallel light means light having a total divergence angle of 1 mrad or less of divergent light, which is the light beam R emitted from the light source 10. For this reason, quasi-parallel light includes parallel light.

[0089] In this embodiment, a case will be described as an example in which the optical element is a lens 60. Instead of the lens 60, a concave mirror may be used as the optical element.

[0090] The lens 60 is disposed between the light source 10 and the light selection unit 30. As in the first embodiment, the light source 10 will be described as an example in which the light source 10 is an LED.

[0091] Here, the lens 60 has a focal point. The light source 10 is disposed in a focal region of the lens 60. The focal region means the focal point of the lens 60 or the vicinity of the focal point. By disposing the light source 10 in this manner, the light ray R emitted from the light source 10 becomes quasi-parallel light by passing through the lens 60 and reaches the light selection unit 30.

[0092] As described in the first embodiment, the light emitting surface 11 of the light source 10 has a finite size. Therefore, the light ray R emitted from the light source 10 becomes a slightly divergent light. The total divergence angle of this divergent light is expressed by the following formula (6). The following formula (6) also holds when a concave mirror is used instead of the lens 60.

[0093] Θ=D / f...Equation (6)

[0094] In equation (6), Θ is the total angle of divergence, f is the focal length of the lens 60, and D is the size of the light emitting surface 11 of the light source 10.

[0095] For example, assuming that the focal length f is 200 mm, the total divergence angle Θ is 1 mrad (milliradian). Therefore, it can be said that the lens 60 can convert the divergent light into quasi-parallel light.

[0096] Next, the optical action of the optical device 1B will be described.

[0097] The light ray R emitted from the light source 10, which is an LED, is generally a diverging light, and its light distribution is approximately Lambertian. That is, the light ray R emitted from the light source 10 is a fan ray. A fan ray means a light ray spreading out in a fan shape. In this embodiment, the light ray R, which is a fan ray, passes through the lens 60 and becomes a quasi-parallel light RP with a slight divergence angle, and reaches the specimen B via the light selection unit 30. Therefore, the irradiation area E irradiated on the specimen B can be narrowed compared to the case where the fan ray is irradiated on the specimen B.

[0098] As in the first embodiment, the derivation unit 52B distinguishes between the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3 by combining pixel values ​​for both the first wavelength region S1 and the second wavelength region S2. That is, the derivation unit 52B distinguishes between and identifies the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3 in the spectral image by using a combination of pixel values ​​for the first wavelength region S1 and the second wavelength region S2 included in the spectral image.

[0099] When the derivation unit 52B derives shape information using such structured illumination, the accuracy of deriving the shape information improves as the pattern of the irradiation area E becomes finer. Therefore, in the optical device 1B of this embodiment, similarly to the above embodiment, it is possible to derive shape information of the subject B with high accuracy.

[0100] Furthermore, in the optical device 1B of this embodiment, the quasi-parallel light RP by the lens 60 is irradiated onto the subject B via the light selection unit 30. Therefore, the irradiation area E on the subject B can be made narrower than when the lens 60 is not used. Therefore, in the optical device 1B of this embodiment, a finer pattern of the irradiation area E (first irradiation area E1, second irradiation area E2, third irradiation area E3) can be formed on the subject B.

[0101] Therefore, in the optical device 1B of this embodiment, in addition to the effects of the first embodiment, shape information of the subject B can be derived with even higher accuracy.

[0102] (Third embodiment) In this embodiment, a case will be described in which a diffraction grating is used as the light selection section 30 of the optical device 1B of the second embodiment.

[0103] 6 is a schematic diagram showing an example of an optical device 1C of this embodiment. The optical device 1C is configured to include a diffraction grating 34 instead of the light selection section 30 of the optical device 1B of the second embodiment. The optical device 1B further includes an aperture member 32. The optical device 1C also includes a lens 62 instead of the lens 60.

[0104] The diffraction grating 34 is an example of a light selection section. In this embodiment, the diffraction grating 34 transmits light beams R in different wavelength regions in different directions.

[0105] Specifically, the diffraction grating 34 separates the irradiated light beam R into a plurality of separated light beams L having mutually different wavelength regions. In this embodiment, a case will be described as an example in which the diffraction grating 34 separates the irradiated light beam R into a first separated light beam L1 in a first wavelength region S1, a second separated light beam L2 in a second wavelength region S2, and a third separated light beam L3 in a third wavelength region. Note that the first wavelength region S1, the second wavelength region S2, and the third wavelength region are mutually different wavelength regions.

[0106] The diffraction grating 34 is formed, for example, on a flat glass substrate with convex portions formed at an equal pitch H. However, the diffraction grating 34 is not limited to this configuration as long as it has a function as a diffraction grating.

[0107] The aperture member 32 is disposed between the light source 10 and the lens 60. In this embodiment, as in the first embodiment, a case where the light source 10 is an LED will be described as an example. In addition, in this embodiment, a case where the size of the light emitting surface 11 of the light source 10 is 0.1 mm or less will be described as an example. Specifically, in this embodiment, a case where the size of the light emitting surface 11 of the light source 10 is 0.1 mm x 0.1 mm will be described as an example. Note that the size of the light emitting surface 11 is not limited to this size.

[0108] The aperture member 32 has an aperture 32A. The aperture 32A will be described assuming that it is, for example, a pinhole with a diameter of 0.1 mm. Note that the size of the aperture 32A is not limited to this size.

[0109] The lens 62 is similar to the lens 60 of the second embodiment. The lens 62 is disposed between the aperture member 32 and the diffraction grating 34. As in the second embodiment, the lens 62 may be replaced with a concave mirror.

[0110] The aperture 32A of the aperture member 32 is disposed at or substantially near the focal position of the lens 62. With such an arrangement, the light ray R emitted from the light source 10 passes through the aperture 32A and the lens 62 to become a quasi-parallel light RP, and reaches the diffraction grating 34.

[0111] The total divergence angle of the divergent light, which is the light ray R emitted from the light source 10, is expressed by the above formula (6) as described in the second embodiment. In this embodiment, in formula (6), D is the size of the aperture 32A.

[0112] For example, assume that the focal length f of the lens 62 is 500 mm. As described above, in this embodiment, assume that the size of the aperture 32A is 0.1 mm in diameter. In this case, the total divergence angle Θ is 0.2 mrad (milliradians). Therefore, it can be said that the aperture 32A and the lens 62 can convert the divergent light into quasi-parallel light RP.

[0113] Next, the optical action of the optical device 1C will be described.

[0114] The light ray R emitted from the light source 10, which is an LED, is generally a diverging light, and its light distribution is approximately Lambertian. That is, the light ray R emitted from the light source 10 is a fan ray. In this embodiment, the light ray R, which is a fan ray, passes through the opening 32A and the lens 62, becoming a quasi-parallel light RP having a slight divergence angle, and reaches the diffraction grating 34.

[0115] Here, the quasi-parallel light RP is generated by having a focal length of the lens 62 that is sufficiently large with respect to the size of the light emitting surface 11 or the opening 32A. The distance between adjacent light rays in a direction perpendicular to the optical axis Z, which are included in the light rays R that have been converted into the quasi-parallel light RP by passing through the lens 62, is approximately constant along the optical axis Z. In other words, these adjacent light rays reach the diffraction grating 34 without coming into contact with each other.

[0116] In this embodiment, the diffraction grating 34 irradiates a plurality of spectral light beams L (a first spectral light beam L1, a second spectral light beam L2, and a third spectral light beam R3) in different wavelength regions onto the subject B. Therefore, the derivation unit 52B can further distinguish a plurality of irradiation regions E by combining pixel values ​​corresponding to each of the plurality of wavelength regions.

[0117] 6 shows a first irradiation area E1, a second irradiation area E2, and a third irradiation area E3 as an example. In this embodiment, the first irradiation area E1 is an area in the subject B that is irradiated only with the first spectral light beam L1 in the first wavelength region S1. The second irradiation area E2 is an area in the subject B that is irradiated with the first spectral light beam L1 in the first wavelength region and the second spectral light beam L2 in the second wavelength region in an overlapping manner. The third irradiation area E3 is an area in the subject B that is irradiated with the first wavelength region S1, the second wavelength region S2, and the third wavelength region S3 in an overlapping manner.

[0118] Here, it is assumed that a light ray R with a wavelength λ is incident at an incident angle α with respect to the normal to the front or back surface of the glass substrate of the diffraction grating 34. In addition, it is assumed that the angle of the light ray direction of the spectral light ray L, which is the light ray R transmitted through the diffraction grating 34, with respect to the normal to the front or back surface of the glass substrate is β. Then, the following equation (7) is established.

[0119] sinβ-sinα=m×λ / H...Equation (7)

[0120] In formula (7), H is the pitch H of the diffraction grating 34. Furthermore, m is an integer of 1 or more.

[0121] In this embodiment, quasi-parallel light RP is incident on the diffraction grating 34. Therefore, the incident angle α is substantially 0. Here, when light rays R other than the quasi-parallel light RP are incident on the diffraction grating 34, light rays R at various angles are incident on the diffraction grating 34. In this case, as shown in the above formula (7), light rays R in various wavelength regions are transmitted in various directions and reach the subject B in a mixed state. Therefore, when light rays R other than the quasi-parallel light RP are incident on the diffraction grating 34, it becomes difficult for the derivation unit 52B to distinguish the irradiation area E according to the wavelength.

[0122] On the other hand, in this embodiment, the opening 32A and the lens 62 cause the quasi-parallel light RP to be incident on the diffraction grating 34. Therefore, the derivation unit 52B can identify the irradiation areas E of the spectral light beams L of different wavelength regions on the subject B by analyzing the spectral image according to wavelength. That is, the derivation unit 52B can easily distinguish the first irradiation area E1, the second irradiation area E2, and the third irradiation area E3 according to the wavelength region.

[0123] As described above, the angle β of the spectral light beam L passing through the diffraction grating 34 is expressed by the above formula (7). In the above formula (7), when m is 1 or -1, a strong diffraction grating 34 can be obtained. The spectral light beam L passing through this diffraction grating 34 is called ±1st order diffracted light. The passing angle of this ±1st order diffracted light is expressed by the following formula (8).

[0124] sinβ=±λ / H...Equation (8)

[0125] As shown in formula (8), the longer the wavelength, the larger the angle of the dispersed light beam L transmitted through the diffraction grating 34. That is, the diffraction grating 34 can change the direction, i.e., the angle, of the dispersed light beam L depending on the wavelength of the dispersed light beam L.

[0126] For example, it is assumed that the pitch H of the diffraction grating 34 is 2 μm. It is also assumed that the first wavelength region S1 is 650 nm, the second wavelength region S2 is 640 nm, and the third wavelength region is 640 nm.

[0127] 7A to 7C are diagrams showing examples of wavelength spectra of the first irradiation area E1, the second irradiation area E2, and the third irradiation area E3. In Fig. 7A to 7C, the horizontal axis indicates wavelength, and the vertical axis indicates pixel value. The pixel value may be normalized as necessary.

[0128] Fig. 7A is a diagram showing an example of a wavelength spectrum of a first irradiation area E1, Fig. 7B is a diagram showing an example of a wavelength spectrum of a second irradiation area E2, and Fig. 7C is a diagram showing an example of a wavelength spectrum of a third irradiation area E3.

[0129] As shown in Figures 7A to 7C, by combining pixel values ​​for the first wavelength region S1, the second wavelength region S2, and the third wavelength region S3, it is possible to distinguish the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3.

[0130] Therefore, in this embodiment, the derivation section 52B can be said to be able to distinguish between the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3 by combining pixel values ​​for each of the first wavelength region S1, the second wavelength region S2, and the third wavelength region S3.

[0131] On the other hand, even if only the pixel values ​​for the first wavelength region S1 are analyzed, it is not possible to distinguish between the first irradiation region E1 and the second and third irradiation regions E2 and E3. Also, even if only the pixel values ​​for the third wavelength region S3 are analyzed, it is not possible to distinguish between the third irradiation region E3 and the first and second irradiation regions E1 and E2.

[0132] In other words, by using a combination of pixel values ​​for each of the first wavelength region S1, the second wavelength region S2, and the third wavelength region S3, it is possible to distinguish between the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3.

[0133] Therefore, in the present embodiment, the derivation unit 52B identifies the irradiation area E of each of the first spectral light ray L1, the second spectral light ray L2, and the third light ray R3 in the subject B based on the first pixel value in the first wavelength region S1, the second pixel value in the second wavelength region S2, and the third pixel value in the third wavelength region S3 contained in the spectral image.

[0134] In detail, the derivation unit 52B identifies the first irradiation area E1, the second irradiation area E2, and the third irradiation area E3 in the spectral image by using a combination of pixel values ​​for each of the first wavelength area S1, the second wavelength area S2, and the third wavelength area S3.

[0135] In other words, the derivation unit 52B can distinguish between the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3 only by using a combination of pixel values ​​for each of the first wavelength region S1, the second wavelength region S2, and the third wavelength region S3. That is, the derivation unit 52B can distinguish between the irradiation regions E in more detail.

[0136] Then, the derivation unit 52B derives shape information of the subject B from the result of identifying the irradiation region E. In other words, the derivation unit 52B can distinguish between the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3 only by using a combination of pixel values ​​for the first wavelength region S1 and the second wavelength region S2. That is, the derivation unit 52B can distinguish the irradiation region E in more detail. Then, the derivation unit 52B derives shape information of the subject B from the result of identifying the irradiation region E.

[0137] As described above, when the derivation unit 52B derives shape information using such structured illumination, the finer the pattern of the irradiation area E, the more accurate the derivation of the shape information becomes.

[0138] In this embodiment, adjacent light rays in a direction perpendicular to the optical axis Z, which are included in the light ray R that has been converted into quasi-parallel light RP by passing through the lens 62, reach the subject B via the diffraction grating 34 without coming into contact with each other. By creating quasi-parallel light, it is possible to realize fine structured illumination that is independent of distance. Therefore, in this embodiment, it is possible to create illumination with a finer structure, and it is possible to realize a distribution of the irradiation area E with a finer structure than in the above embodiment.

[0139] In the present embodiment, the derivation unit 52B uses a combination of pixel values ​​in the first wavelength region S1, the second wavelength region S2, and the third wavelength region S3, thereby making it possible to distinguish and specify the irradiation region E into the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3. Therefore, the derivation unit 52B can derive shape information with high accuracy, compared to a case where a combination of pixel values ​​in the first wavelength region S1, the second wavelength region S2, and the third wavelength region S3 is not used.

[0140] Therefore, in addition to the effects of the above-described embodiments, the optical device 1C of this embodiment can derive shape information of the subject B with even higher accuracy.

[0141] (Fourth embodiment) In this embodiment, a configuration will be described in which a specific optical element is further provided in addition to the optical device 1A of the first embodiment.

[0142] 8 is a schematic diagram showing an example of an optical device 1D of this embodiment. The optical device 1D has a configuration further including an optical element 64 and a lens 66 in addition to the configuration of the optical device 1A.

[0143] The lens 66 causes the light ray R reflected by the subject B to form an image on the light receiving surface 41 of the image sensor 40 .

[0144] The optical element 64 is made of a transparent medium. Transparent means transparent to the incident light ray R. The transparent medium is, for example, glass, resin, quartz, sapphire, etc. The resin is, for example, acrylic, polycarbonate, etc. In this embodiment, a case where the transparent medium constituting the optical element 64 is acrylic will be described as an example.

[0145] The optical element 64 is provided with a reflecting surface 64B, an entrance surface 64A, and an exit surface 64C on the outer surface of a transparent medium.

[0146] The reflecting surface 64B is a parabolic or quasi-parabolic reflecting surface provided on the outer surface of the transparent medium. The reflecting surface 64B is, for example, a parabolic surface constituting a part of the outer surface of the transparent medium, on which aluminum is vapor-deposited. Therefore, the reflecting surface 64B functions as a reflecting surface that reflects the light ray R. In this embodiment, the description will be given assuming that the focal length of the reflecting surface 64B is 100 mm.

[0147] The incident surface 64A is a planar surface facing the reflecting surface 64B, and is disposed on the light emitting surface 11 of the light source 10. The incident surface 64A is provided near the focal position of the reflecting surface 64B, which is a parabolic surface. The light emitting surface 11 of the light source 10 and the incident surface 64A are disposed opposite to each other.

[0148] The exit surface 64C is disposed opposite the light selecting section 30.

[0149] The following description will be given on the assumption that the LED serving as the light source 10 of this embodiment has a light emitting surface 11 measuring 0.1 mm×0.1 mm.

[0150] The light ray R emitted from the light source 10 and incident on the incident surface 64A of the optical element 64 is refracted by the refraction action of the transparent medium and enters the transparent medium. Almost all of the light ray R incident on the transparent medium is guided within the transparent medium, and all of the guided light ray R is specularly reflected by the reflecting surface 64B.

[0151] Here, if there is no refraction effect due to the transparent medium, the light ray R is not refracted. Therefore, the light ray R spreads like a fan ray, and the light ray R that does not hit the reflecting surface 64B and is lost increases.

[0152] On the other hand, in this embodiment, due to the light guiding effect of the optical element 64, substantially all of the light rays R can be reflected toward the subject B via the light selection unit 30 by the reflecting surface 64B, which is a compact paraboloid.

[0153] As described above, the light source 10 is disposed at or near the focal point of the reflecting surface 64B. Therefore, the light ray R reflected by the reflecting surface 64B becomes a parallel light RP'. That is, the distance between adjacent light rays in a direction perpendicular to the optical axis Z, which are included in the light ray R that has been made into a parallel light RP by passing through the optical element 64, is approximately constant along the optical axis Z. That is, these adjacent light rays reach the light selection unit 30 without coming into contact with each other.

[0154] By creating parallel light RP', it is possible to realize fine structured illumination that is not dependent on distance. Therefore, in this embodiment, it is possible to create illumination with a finer structure, and it is possible to realize a distribution of the irradiation area E with a finer structure than the above embodiment.

[0155] The parallel light RP' irradiated to the light selecting unit 30 is dispersed as it passes through the light selecting unit 30, and reaches the subject B. Fig. 9 is a schematic diagram showing an example of the intensity distribution V of the spectral light L at a certain position on the optical path of the spectral light L. The subject B is irradiated with the spectral light L, and an image is captured by the image sensor 40, whereby the image sensor 40 obtains a spectral image.

[0156] As in the first embodiment, the derivation unit 52B identifies irradiation areas E of the light rays R in the different wavelength regions on the subject B based on pixel values ​​in the different wavelength regions included in the spectroscopic image. Then, shape information of the subject B is derived from the identification result.

[0157] 10A to 10C are diagrams showing examples of wavelength spectra of the first irradiation area E1, the second irradiation area E2, and the third irradiation area E3. In FIG. 10A to FIG. 10C, the horizontal axis indicates wavelength, and the vertical axis indicates pixel value. The pixel value may be normalized as necessary. In addition, FIG. 10A to FIG. 10C also show background noise N.

[0158] Fig. 10A is a diagram showing an example of a wavelength spectrum of a first irradiation area E1, Fig. 10B is a diagram showing an example of a wavelength spectrum of a second irradiation area E2, and Fig. 10C is a diagram showing an example of a wavelength spectrum of a third irradiation area E3.

[0159] As shown in Figures 10A to 10C, by combining pixel values ​​for the first wavelength region S1, the second wavelength region S2, and the third wavelength region S3, it is possible to distinguish the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3.

[0160] Therefore, in this embodiment, the derivation section 52B can be said to be able to distinguish between the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3 by combining pixel values ​​for each of the first wavelength region S1, the second wavelength region S2, and the third wavelength region S3.

[0161] On the other hand, even if only the pixel values ​​for the first wavelength region S1 are analyzed, it is not possible to distinguish between the first irradiation region E1 and the second and third irradiation regions E2 and E3. Also, even if only the pixel values ​​for the second wavelength region S2 are analyzed, it is not possible to distinguish between the second irradiation region E2 and the first and third irradiation regions E1 and E3. Also, even if only the pixel values ​​for the third wavelength region S3 are analyzed, it is not possible to distinguish between the third irradiation region E3 and the first and second irradiation regions E1 and E2.

[0162] In other words, it is only by using a combination of pixel values ​​for the first wavelength region S1, the second wavelength region S2, and the third wavelength region S2 that it is possible to distinguish between the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3.

[0163] Therefore, similarly to the above embodiment, the derivation unit 52B specifies the irradiation area E of each of the first spectral light ray L1, the second spectral light ray L2, and the third light ray R3 in the subject B based on the first pixel value in the first wavelength region S1, the second pixel value in the second wavelength region S2, and the third pixel value in the third wavelength region S3 included in the spectral image. In detail, the derivation unit 52B specifies the first irradiation area E1, the second irradiation area E2, and the third irradiation area E3 in the spectral image by using a combination of pixel values ​​for each of the first wavelength region S1, the second wavelength region S2, and the third wavelength region S3.

[0164] In other words, the derivation unit 52B can distinguish between the first irradiation region E1, the second irradiation region E2, and the third irradiation region E3 only by using a combination of pixel values ​​for each of the first wavelength region S1, the second wavelength region S2, and the third wavelength region S3. That is, the derivation unit 52B can distinguish between the irradiation regions E in more detail.

[0165] Then, the derivation unit 52B derives shape information of the subject B from the result of identifying the irradiation region E.

[0166] As described above, when the derivation unit 52B derives shape information using such structured illumination, the finer the pattern of the irradiation area E, the more accurate the derivation of the shape information becomes.

[0167] Therefore, in addition to the effect of the first embodiment, the optical device 1D of this embodiment can derive shape information of the subject B with even higher accuracy.

[0168] In addition, as in the above embodiment, it is preferable that the derivation unit 52B derives the shape information based on the first pixel value in the first wavelength region S1, the second pixel value in the second wavelength region S2, and the third pixel value in the third wavelength region S3 after removing background noise N.

[0169] Fifth embodiment In this embodiment, a configuration further including a cylindrical lens will be described.

[0170] 11 is a schematic diagram showing an example of an optical device 1E of this embodiment. The optical device 1E further includes a cylindrical lens 68 in addition to the configuration of the optical device 1A of the first embodiment.

[0171] 11 is a schematic diagram showing an example of an optical device 1E of this embodiment. The optical device 1E has a configuration further including a cylindrical lens 68 in addition to the configuration of the optical device 1A.

[0172] The cylindrical lens 68 is an example of an optical element. The cylindrical lens 68 forms an image of the light ray R that has passed through the light selection unit 30 on the subject B. The optical device 1E may be configured to include a concave mirror instead of the cylindrical lens 68. That is, the optical element used in this embodiment may be an optical element that can define an image plane and an object plane of the subject B. In this embodiment, a form in which the cylindrical lens 68 is used as the optical element will be described as an example.

[0173] The LED that is the light source 10 of this embodiment may be an LED having a finite-sized light-emitting surface 11, as in the first embodiment. In this embodiment, the description will be given assuming that the size of the light-emitting surface 11 is 3 mm×3 mm. Note that the size of the light-emitting surface 11 is not limited to this size.

[0174] In this embodiment, the light selecting unit 30 is disposed between the light source 10 and the cylindrical lens 68. In this embodiment, the light selecting unit 30 is disposed in the vicinity of and facing the light emitting surface 11 of the light source 10. The size of the wavelength selecting region 31 in the light selecting unit 30 is assumed to be substantially the same as the size of the light emitting surface 11 of the light source 10.

[0175] The wavelength selection region 31 of the light selection unit 30 is disposed on the object plane of the cylindrical lens 68. Therefore, the wavelength selection region 31 is projected (illuminated) onto the image plane of the cylindrical lens 68.

[0176] Here, at a position closer to the cylindrical lens 68 than the image plane of the cylindrical lens 68, the projected images of the first wavelength selection region 31A and the second wavelength selection region 31B included in the wavelength selection region 31 are overlapping projected images.

[0177] The closer to the cylindrical lens 68, the greater this overlap becomes.

[0178] Fig. 12A is a diagram showing an example of the intensity distribution of a projected image at a position A1 in Fig. 11. Fig. 12B is a diagram showing an example of the intensity distribution of a projected image at a position A2 in Fig. 11.

[0179] 11, 12A, and 12B, the overlap between the irradiation area EA by the first divided light beam L1 that has passed through the first wavelength selection region 31A and the irradiation area EB by the second divided light beam L2 increases as the position approaches the cylindrical lens 68. Therefore, the distance in the optical axis Z direction can be estimated from the presence or absence of overlap between the irradiation area EA and the irradiation area EB corresponding to each of the first wavelength selection region 31A and the second wavelength selection region 31B and the degree of overlap.

[0180] Therefore, in the optical device 1E of this embodiment, the derivation unit 52B, like the first embodiment, analyzes the spectral image acquired by the acquisition unit 52A to identify the irradiation area E of each of the first and second spectral light beams L1 and L2 on the subject B. Then, shape information of the subject B is derived from the identification result of the irradiation area E.

[0181] At this time, in this embodiment, the derivation unit 52B further estimates the distance in the direction of the optical axis Z from the presence or absence of overlap between the irradiation area EA and the irradiation area EB and the degree of overlap.

[0182] Therefore, in this embodiment, the derivation section 52B can estimate the three-dimensional shape of the subject B.

[0183] Such distance estimation processing is realized by storing in the processing unit 52 a combination of both pixel values ​​for each of the first wavelength region S1 and the second wavelength region S2 separated by the wavelength selection region 31, and the derivation unit 52B estimating the distance using this combination.

[0184] In other words, if an irradiation field (illumination distribution on a plane) is composed of only two areas: an irradiation area E where the first spectral light ray L1 in the first wavelength region S1 is present but the second spectral light ray L2 in the second wavelength region S2 is not present, and an irradiation area E where the second spectral light ray L2 in the second wavelength region S2 is present but the first spectral light ray L1 in the first wavelength region S1 is not present, then the irradiation field is on the imaging plane.

[0185] On the other hand, if there is an area where the two overlap, that is, an irradiation area E where the first spectral light ray L1 in the first wavelength region S1 exists and the second spectral light ray L2 in the second wavelength region S2 exists, it can be estimated that this area is on the cylindrical lens 68 side (the optical element side) rather than the image plane.

[0186] Therefore, according to the optical device 1E of this embodiment, in addition to the effects of the above-described embodiments, it is possible to derive the three-dimensional shape of the subject B as shape information.

[0187] Next, an example of the hardware configuration of the information processing device 50 in the above embodiment will be described.

[0188] FIG. 13 is an example of a hardware configuration diagram of an information processing device 50 according to the above embodiment and the modified example.

[0189] The information processing device 50 includes a control device such as a CPU 86, storage devices such as a ROM (Read Only Memory) 88, a RAM (Random Access Memory) 91, and a HDD (Hard Disk Drive) 92, an I / F unit 82 which interfaces with various devices, an output unit 81 which outputs various information such as output information, an input unit 94 which accepts operations by the user, and a bus 96 which connects each unit, and has a hardware configuration that utilizes a normal computer.

[0190] In the information processing device 50, the CPU 86 reads out a program from the ROM 88 onto the RAM 91 and executes it, thereby realizing each of the above-mentioned units on the computer.

[0191] The programs for executing the above-mentioned processes executed by the information processing device 50 may be stored in the HDD 92. The programs for executing the above-mentioned processes executed by the information processing device 50 may be provided by being pre-installed in the ROM 88.

[0192] The program for executing the above-mentioned processes executed by the information processing device 50 may be stored in a computer-readable storage medium such as a CD-ROM, CD-R, memory card, DVD (Digital Versatile Disk), or flexible disk (FD) in an installable or executable format file and provided as a computer program product. The program for executing the above-mentioned processes executed by the information processing device 50 may be stored on a computer connected to a network such as the Internet and provided by downloading the program via the network. The program for executing the above-mentioned processes executed by the information processing device 50 may be provided or distributed via a network such as the Internet.

[0193] Although the embodiment and the modified examples of the present invention have been described above, the above-mentioned embodiment and the modified examples are presented as examples and are not intended to limit the scope of the invention. This new embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. This embodiment and its modified examples are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0194] 1, 1A, 1B, 1C, 1D, 1E optical equipment 10 light source 30 Light selection unit 32 Opening material 34 Diffraction Grating 40 Image sensor 52B Derivation part 60 Lenses 62 Lens 64 Optical Elements 68 Cylindrical Lens

Claims

1. An illumination unit having one light source having a light-emitting surface of a finite size; a light selection unit that simultaneously separates a light beam, which is a divergent light or a quasi-parallel light beam, emitted from the one light source into a plurality of separated light beams having two or more mutually different wavelength regions, which are a first separated light beam in a first wavelength region and a second separated light beam in a second wavelength region; an imaging element that captures an image of a subject irradiated with the plurality of spectral light beams and obtains a spectral image that is spectrally separated into at least the first wavelength region and the second wavelength region; a derivation unit that derives surface texture or shape information of the object from a result of identifying a first irradiation area of ​​only the first spectral light beam in the first wavelength range, a second irradiation area where the area of ​​the first spectral light beam and the area of ​​the second spectral light beam overlap, and a third irradiation area of ​​only the second spectral light beam, on the object, based on the received light intensities of each of the plurality of spectral light beams included in the spectral image; An optical device comprising:

2. The lead-out portion is deriving the surface texture or the shape information from the identification result of identifying irradiation areas of the subject with the first spectral light beam and the second spectral light beam based on a first received light intensity in the first wavelength region and a second received light intensity in the second wavelength region included in the spectral image; 2. The optical device of claim 1.

3. The lead-out portion is deriving the surface texture or the shape information based on the first received light intensity and the second received light intensity after removing a dark current component; 3. The optical device according to claim 2.

4. The light selection unit is a first wavelength-selective region that transmits the first divided light beam and a second wavelength-selective region that transmits the second divided light beam; The first wavelength selection region and the second wavelength selection region are disposed at different positions from each other. The optical device according to any one of claims 1 to 3.

5. The irradiation unit includes: an optical element for reducing the divergence angle of the light beam emitted from the light source; the optical element is a lens, the light source is a surface light source and is disposed in a focal region of the lens; The lens converts the light beam emitted from the light source into quasi-parallel light, The quasi-parallel light is divided into at least two separated light beams that overlap each other by the light selection unit. The optical device according to any one of claims 1 to 4.

6. the optical element is a concave mirror, the light source is disposed at a focal region of the concave mirror; The concave mirror converts the light beam emitted from the light source into quasi-parallel light.

6. The optical device according to claim 5.

7. The light selection unit is a diffraction grating.

7. The optical device according to claim 5 or 6.

8. The irradiation unit includes: an optical element for reducing the divergence angle of the light beam emitted from the light source; The optical element is It is made of a transparent medium, A parabolic or quasi-parabolic reflecting surface is provided on the outer surface of the transparent medium; The light source is disposed in a focal region of the reflecting surface. The optical device according to any one of claims 1 to 4.

9. The optical element is a flat incidence surface facing the reflecting surface; The incident surface is disposed opposite to the light emitting surface of the light source.

9. The optical device according to claim 8.

10. The irradiation unit includes: an optical element for reducing the divergence angle of the light beam emitted from the light source; the optical element is a lens, The light source is a surface light source, The light selection unit is disposed between the light source and the lens, The lens forms an image of the light beam passing through the light selection unit on the subject, The light beam passing through the light selection unit becomes at least two of the divided light beams that overlap each other. The optical device according to any one of claims 1 to 4.

11. a size of a light emitting surface of a light source that irradiates the light beam is equal to a size of a first wavelength selection region that passes the first spectral light beam; 2. The optical device of claim 1.

12. a size of a light emitting surface of a light source that irradiates the light beam is larger than a size of a first wavelength selection region that passes the first spectral light beam; 2. The optical device of claim 1.

13. a step of simultaneously splitting a light beam, which is a divergent light or a quasi-parallel light beam irradiated from a single light source of an irradiation unit having a light-emitting surface of a finite size, into a plurality of split light beams having two or more mutually different wavelength regions, which are a first split light beam in a first wavelength region and a second split light beam in a second wavelength region; capturing an image of an object irradiated with the plurality of spectral light beams and acquiring a spectral image in which the spectral light beams are dispersed into at least the first wavelength region and the second wavelength region; a step of identifying a first irradiation area of ​​only the first spectral light beam in the first wavelength range, a second irradiation area where the area of ​​the first spectral light beam and the area of ​​the second spectral light beam overlap, and a third irradiation area of ​​only the second spectral light beam on the object based on the received light intensities of the plurality of spectral light beams included in the spectral image, and deriving surface texture or shape information of the object from the identification result; An information processing method comprising:

14. a computer connected to an image sensor that captures an image of a subject irradiated with a plurality of spectral rays dispersed by a light selection unit that simultaneously disperses a light beam, which is a divergent light or quasi-parallel light irradiated from a single light source of an irradiation unit having a single light source having a light-emitting surface of a finite size, into a plurality of spectral rays in two or more mutually different wavelength regions, which are a first spectral ray in a first wavelength region and a second spectral ray in a second wavelength region, and acquires a spectral image dispersed into at least the first wavelength region and the second wavelength region; a step of identifying a first irradiation region of only the first spectral light beam in the first wavelength range, a second irradiation region where the region of the first spectral light beam and the region of the second spectral light beam overlap, and a third irradiation region of only the second spectral light beam on the object based on the received light intensities of the plurality of spectral light beams included in the spectral image, and deriving surface texture or shape information of the object from the identification result; A program for executing.

Citation Information

Patent Citations

  • Detecting method of road surface difference

    JP1986082106A

  • Light emitting diode

    JP1989230274A

  • Inspecting apparatus of surface defect

    JP1992106461A

  • Illumination device for macroinspection, apparatus and method for macroinspection

    JP2001141657A

  • Three-dimensional shape inspection device

    JP2003148927A