Distance measuring device
By projecting patterned light from different bands of wave bands by two camera devices arranged side by side and searching for three-dimensional corresponding points, the measurement difficulties caused by low reflectivity or high light absorption are solved, and high-precision distance measurement of the surface of the object is achieved.
Patent Information
- Application Number
- CN202380028629.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-24
- Filing Date
- 2023-03-17
- Publication Date
- 2024-11-05
AI Technical Summary
In the case of low reflectivity or high light absorption, it is difficult to properly obtain the brightness gray scale of the dot pattern, resulting in the inability to measure the distance of the object surface with high precision.
Two camera devices arranged side by side are adopted to ensure the specificity of each pixel block by projecting patterned light from multiple light regions of different bands to the surface of the object by using stereo corresponding point search processing, thereby determining the distance of the object surface with high precision.
Regardless of the reflectivity and light absorption of the object surface, the distance on the object surface can be measured with high accuracy, improving the measurement accuracy.
Smart Images

Figure CN118900983A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a distance measuring device for measuring the distance to an object by processing an image acquired by a stereo camera. Background Art
[0002] In the past, a distance measuring device is known that measures the distance to an object by processing images acquired by a stereo camera. In this device, parallax is detected based on the images captured by each camera. The pixel block with the highest correlation with the object pixel block on one image (reference image) is searched on another image (reference image). The search range is set in the separation direction of the camera with the same position as the object pixel block as the reference position. The pixel offset of the pixel block extracted by the search relative to the reference position is detected as parallax. Based on the parallax, the distance to the object is calculated by triangulation.
[0003] In such a distance measuring device, it is further possible to project light of a unique pattern onto the object, thereby enabling the above-mentioned search to be performed with high accuracy even when there is no pattern on the surface of the object.
[0004] Patent Document 1 below describes a structure in which a diffractive optical element generates light in a dot pattern based on laser light emitted from a semiconductor laser. In this structure, the diffractive optical element has multiple levels of diffraction efficiency differences, and forms a dot pattern with multiple levels of brightness grayscale by using the diffraction efficiency differences.
[0005] Prior Art Literature
[0006] Patent Literature
[0007] Patent Document 1: Japanese Patent Application Publication No. 2013-190394 Summary of the invention
[0008] Problem that the invention aims to solve
[0009] However, sometimes the surface of an object has a low reflectivity or a high light absorption rate in a given wavelength band. In the structure of the above-mentioned Patent Document 1, if the wavelength of the laser light is included in the wavelength band, the brightness grayscale of the dot pattern cannot be properly acquired on the camera side. Therefore, it becomes difficult to properly perform the stereo corresponding point search process of the pixel block, and as a result, it becomes impossible to properly measure the distance to the surface of the object.
[0010] In view of the above-mentioned problems, an object of the present invention is to provide a distance measuring device capable of measuring the distance to the surface of an object with high accuracy regardless of the reflectivity and light absorptivity of the surface of the object.
[0011] Technical solutions to solve problems
[0012] The main mode of the present invention involves a distance measuring device comprising: a first camera unit and a second camera unit, which are arranged side by side so that their fields of view overlap; a projection unit, which projects pattern light with a given pattern distribution of multiple types of light regions with different wavelengths to the range where the fields of view overlap; and a measuring unit, which performs stereo corresponding point search processing on the images respectively acquired by the first camera unit and the second camera unit to measure the distance to the surface of the object onto which the pattern light is projected.
[0013] According to the distance measuring device involved in this mode, a plurality of types of light regions with different wavelengths are projected onto the surface of an object with patterned light distributed in a given pattern. Therefore, even if the surface of the object has a low reflectivity or a high light absorptivity for any of these wavelengths, the pattern of light based on the other wavelengths is included in the camera images of the first camera unit and the second camera unit. Therefore, the specificity of each pixel block can be maintained by the distribution pattern of light in the other wavelengths, and a stereo corresponding point search can be performed with high precision. Thus, the distance to the surface of the object can be measured with high precision.
[0014] Effects of the Invention
[0015] As described above, according to the present invention, it is possible to provide a distance measuring device capable of measuring the distance to the surface of an object with high accuracy regardless of the reflectivity and light absorptivity of the surface of the object.
[0016] The effects and significance of the present invention will become more apparent through the description of the following embodiments. However, the following embodiments are merely examples of implementing the present invention, and the present invention is not limited to the contents described in the following embodiments. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 It is a diagram showing a basic structure of a distance measuring device according to an embodiment.
[0018] Figure 2 It is a diagram showing the structure of a distance measuring device according to an embodiment.
[0019] Figure 3 (a) and Figure 3 (b) are diagrams schematically showing a method of setting a pixel block for the first image according to the embodiment.
[0020] Figure 4 (a) is a diagram schematically showing a state in which a target pixel block is set on a first image according to an embodiment. Figure 4 (b) schematically shows an embodiment of the present invention for searching Figure 3 FIG. 1 is a diagram showing a search range set on the second image based on the target pixel block of (a).
[0021] Figure 5 (a) is a diagram schematically showing the structure of an optical filter according to an embodiment. Figure 5 (b) is a diagram showing an enlarged region of a part of the optical filter according to the embodiment.
[0022] Figure 6 (a) and Figure 6 (b) are diagrams schematically showing light regions of light having passed through different types of filter regions according to the embodiment.
[0023] Figure 7 (a) and Figure 7 (b) are diagrams schematically showing light regions of light having passed through different types of filter regions according to the embodiment.
[0024] Figure 8 (a)~ Figure 8 (d) are graphs showing various spectral characteristics according to the embodiments. Figure 8 (e) is a graph showing the maximum brightness of each point light involved in the embodiment.
[0025] Fig. 9 (a)~ Fig. 9 (d) are graphs showing various spectral characteristics according to the embodiments. Fig. 9 (e) is a graph showing the maximum brightness of each point light involved in the embodiment.
[0026] Fig.10 (a)~ Fig.10 (d) are graphs showing various spectral characteristics according to the embodiments. Fig.10 (e) is a graph showing the maximum brightness of each point light involved in the embodiment.
[0027] Fig.11 This is a flowchart showing a process of setting the light emission amount (drive current) of each light source according to the embodiment.
[0028] Fig.12 1 is a diagram showing a configuration of a distance measuring device according to Modification Example 1. FIG.
[0029] Fig.13 (a)~ Fig.13 (d) are graphs showing various spectral characteristics according to Modification Example 1. Fig.13 (e) is a graph showing the maximum brightness of each point light according to Modification Example 1.
[0030] Fig.14 (a) is a diagram schematically showing the structure of the filter according to Modification Example 2. Fig.14(b) is a diagram showing an enlarged view of a part of the filter according to Modification Example 2.
[0031] However, the drawings are for illustration only and are not intended to limit the scope of the present invention. DETAILED DESCRIPTION
[0032] In the following, the embodiments of the present invention are described with reference to the accompanying drawings. For convenience, in each figure, orthogonal X, Y, and Z axes are added. The X-axis direction is the arrangement direction of the first camera unit and the second camera unit, and the positive direction of the Z-axis is the camera direction of each camera unit.
[0033] Figure 1 1 is a diagram showing a basic configuration of the distance measuring device 1 .
[0034] The distance measuring device 1 includes a first imaging unit 10 , a second imaging unit 20 , and a projection unit 30 .
[0035] The first camera unit 10 captures the range of the field of view 10a facing the positive direction of the Z axis. The second camera unit 20 captures the range of the field of view 20a facing the positive direction of the Z axis. The first camera unit 10 and the second camera unit 20 are arranged side by side in the X-axis direction so that the fields of view 10a, 20a overlap each other. The camera direction of the first camera unit 10 may be slightly tilted from the positive direction of the Z axis toward the direction of the second camera unit 20, and the camera direction of the second camera unit 20 may be slightly tilted from the positive direction of the Z axis toward the direction of the first camera unit 10. The positions of the first camera unit 10 and the second camera unit 20 in the Z-axis direction and the Y-axis direction are the same as each other.
[0036] The projection unit 30 projects pattern light 30a distributed in a given pattern to the overlapping range of the field of view 10a of the first imaging unit 10 and the field of view 10b of the second imaging unit 20. The projection direction of the pattern light 30a by the projection unit 30 is the positive direction of the Z axis. The pattern light 30a is projected onto the surface of the object A1 existing in the overlapping range of the fields of view 10a and 20a.
[0037] The distance measuring device 1 measures the distance D0 to the object A1 by searching for stereo corresponding points using the camera images captured by the first camera unit 10 and the second camera unit 20. At this time, the pattern light 30a is projected from the projection unit 30 onto the surface of the object A1. Thus, the pattern of the pattern light 30a is projected onto the camera images captured by the first camera unit 10 and the second camera unit 20. Therefore, even when there is no pattern on the surface of the object A1, the stereo corresponding point search can be performed with high accuracy, and the distance D0 to the surface of the object A1 can be accurately measured.
[0038] Here, the surface of the object A1 may have a high light absorption rate in a given wavelength band and a low reflectivity. In this case, if the wavelength band of the pattern light 30a is included in the wavelength band, the pattern of the pattern light 30a may not be properly captured by the first imaging unit 10 and the second imaging unit 20. Therefore, the above-mentioned stereo corresponding point search cannot be properly performed, and as a result, the distance D0 to the surface of the object A1 may not be measured with high accuracy.
[0039] Therefore, in the present embodiment, the pattern light 30a is configured such that a plurality of types of light regions having different wavelengths are distributed in a given pattern. Even if the surface of the object A1 has a low reflectivity or a high light absorptivity for any of these wavelengths, the pattern of light based on the other wavelengths will be captured by the first camera unit 10 and the second camera unit 20. Therefore, a stereo corresponding point search can be appropriately performed based on the pattern of light in the other wavelengths, and the distance to the surface of the object A1 can be measured with high precision.
[0040] Figure 2 1 is a diagram showing the structure of the distance measuring device 1 .
[0041] The first imaging unit 10 includes an imaging lens 11 and an imaging element 12. The imaging lens 11 focuses light from the field of view 10a onto an imaging surface 12a of the imaging element 12. The imaging lens 11 may not be a single lens, but may be composed of a combination of multiple lenses. The imaging element 12 is a monochrome image sensor. The imaging element 12 is, for example, a CMOS image sensor. The imaging element 12 may also be a CCD.
[0042] The second imaging unit 20 has the same structure as the first imaging unit 10. The second imaging unit 20 includes an imaging lens 21 and an imaging element 22. The imaging lens 21 focuses light from the field of view 20a onto an imaging surface 22a of the imaging element 22. The imaging lens 21 may not be a single lens, but may be composed of a combination of multiple lenses. The imaging element 22 is a monochrome image sensor. The imaging element 22 is, for example, a CMOS image sensor. The imaging element 22 may also be a CCD.
[0043] The projection unit 30 includes light sources 31 to 33 , an optical system 34 , an optical filter 35 , and a projection lens 36 .
[0044] Light sources 31 to 33 emit light of different wavelengths. For example, light source 31 emits light of a wavelength near orange, light source 32 emits light of a wavelength near green, and light source 33 emits light of a wavelength near blue. Light sources 31 to 33 are light emitting diodes. Light sources 31 to 33 may also be other types of light sources such as semiconductor lasers.
[0045] The optical system 34 includes collimating lenses 341 to 343 and dichroic mirrors 344 and 345 .
[0046] The collimating lenses 341 to 343 convert the light emitted from the light sources 31 to 33 into substantially parallel light. The dichroic mirror 344 transmits the light incident from the collimating lens 341 and reflects the light incident from the collimating lens 342. The dichroic mirror 345 transmits the light incident from the dichroic mirror 344 and reflects the light incident from the collimating lens 343. In this way, the light emitted from the light sources 31 to 33 is combined and guided to the filter 35.
[0047] The filter 35 generates pattern light 30a in which a plurality of light regions of different wavelengths are distributed in a given pattern based on the light of each wavelength band guided from the optical system 34. The structure and function of the filter 35 will be described later. Figure 5 (a) and (b) are described below.
[0048] The projection lens 36 projects the pattern light 30a generated by the filter 35. The projection lens 36 may not be a single lens, but may be composed of a combination of a plurality of lenses.
[0049] The distance measuring device 1 includes a first imaging processing unit 41 , a second imaging processing unit 42 , a light source driving unit 43 , a brightness adjusting unit 44 , a measuring unit 45 , a control unit 46 , and a communication interface 47 as a configuration of a circuit unit.
[0050] The first image processing unit 41 and the second image processing unit 42 control the image sensors 12 and 22 , and perform processes such as brightness correction and camera correction on pixel signals of the first image and the second image outputted from the image sensors 12 and 22 , respectively.
[0051] The light source driving section 43 drives each of the light sources 31 to 33 using the driving current value set by the brightness adjusting section 44 .
[0052] The brightness adjustment unit 44 sets the driving current value of the light sources 31 to 33 for the light source driving unit 43 based on the pixel signal (brightness) of the second image input from the second camera processing unit 42. More specifically, the brightness adjustment unit 44 sets the driving current value (luminous intensity) of the light sources 31 to 33 so that the maximum brightness of the light from the light sources 31 to 33 obtained based on the pixel signal from the second camera unit 20 is different from each other. For the processing of the brightness adjustment unit 44, refer to Fig.11 To explain.
[0053] The measuring unit 45 performs a comparison process on the first image and the second image inputted from the first imaging processing unit 41 and the second imaging processing unit 42 to search for stereo corresponding points, and acquires the distance to the surface of the object A1 for each pixel block on the first image. The measuring unit 45 transmits the acquired distance information of all pixel blocks to an external device via the communication interface 47.
[0054] That is, the measuring unit 45 sets a pixel block set as a distance acquisition target (hereinafter referred to as a "target pixel block") on the first image, and searches for a pixel block corresponding to the target pixel block within a predetermined search range on the second image, that is, a pixel block that best matches the target pixel block (hereinafter referred to as a "matching pixel block"). Then, the measuring unit 45 acquires a pixel offset between a pixel block on the second image that is located at the same position as the target pixel block (hereinafter referred to as a "reference pixel block") and the matching pixel block extracted from the second image through the above search, and performs a process of calculating the distance to the surface of the object A1 at the position of the target pixel block based on the acquired pixel offset.
[0055] The measuring unit 45 and the communication interface 47 may also be formed by a semiconductor integrated circuit including an FPGA (Field Programmable Gate Array). Alternatively, these units may also be formed by other semiconductor integrated circuits such as a DSP (Digital Signal Processor), a GPU (Graphics Processing Unit), and an ASIC (Application Specific Integrated Circuit).
[0056] The control unit 46 is constituted by a microcomputer or the like, and controls each unit according to a given program stored in a built-in memory.
[0057] Figure 3 (a) and (b) are diagrams schematically showing a method of setting the pixel block 102 of the first image 100 . Figure 3 (a) shows a method of setting the pixel block 102 for the entire first image 100. Figure 3 (b) shows an enlarged view of a part of the first image 100 .
[0058] like Figure 3 As shown in (a) and (b) of FIG. 1 , the first image 100 is divided into a plurality of pixel blocks 102 each including a given number of pixel regions 101. The pixel region 101 is a region corresponding to one pixel on the imaging element 12. That is, the pixel region 101 is the minimum unit of the first image 100. Figure 3 In the examples of (a) and (b) of FIG. 1 , nine pixel regions 101 arranged in three rows and three columns constitute one pixel block 102. However, the number of pixel regions 101 included in one pixel block 102 is not limited thereto.
[0059] Figure 4(a) is a diagram schematically showing a state where a target pixel block TB1 is set on the first image 100. Figure 4 (b) is a schematic diagram showing the search Figure 4 FIG. 2 is a diagram showing a search range R0 set on the second image 200 based on the target pixel block of (a).
[0060] exist Figure 4 In (b), for convenience, the second image 200 acquired from the second imaging unit 20 is divided into a plurality of pixel blocks 202 similarly to the first image 100. The pixel blocks 202 include the same number of pixel regions as the above-mentioned pixel blocks 102.
[0061] exist Figure 4 In (a), the target pixel block TB1 is the pixel block 102 to be processed among the pixel blocks 102 on the first image 100. Figure 4 In (b), the reference pixel block TB2 is a pixel block 202 located at the same position as the target pixel block TB1 on the second image 200 .
[0062] Figure 2 The measuring unit 45 determines the reference pixel block TB2 at the same position as the target pixel block TB1 on the second image 200. Then, the measuring unit 45 sets the determined position of the reference pixel block TB2 as the reference position P0 of the search range R0, and sets the range extending from the reference position P0 in the separation direction of the first camera unit 10 and the second camera unit 20 as the search range R0.
[0063] In the second image 200, the extension direction of the search range R0 is set to the direction in which the pixel block corresponding to the target pixel block TB1 (matching pixel block MB2) is offset from the reference position P0 due to parallax. Here, the search range R0 is set to extend from the reference position P0 to the right (with respect to the reference position P0). Figure 1 The search range R0 includes 12 pixel blocks 202 arranged in a direction corresponding to the X-axis direction of the pixel block 202. However, the number of pixel blocks 202 included in the search range R0 is not limited thereto. In addition, the starting point of the search range R0 is not limited to the reference pixel block TB2. For example, a position shifted to the right by several blocks from the reference pixel block TB2 may be set as the starting point of the search range R0.
[0064] The measuring unit 45 searches for a pixel block (matching pixel block MB2) corresponding to the target pixel block TB1 for the search range R0 thus set. Specifically, the measuring unit 45 shifts the search position by one pixel in the right direction from the reference pixel block TB2, and calculates the correlation value between the target pixel block TB1 and each search position. The correlation value can be, for example, SSD or SAD. Then, the measuring unit 45 determines the pixel block at the search position with the highest correlation in the search range R0 as the matching pixel block MB2.
[0065] Furthermore, the measuring unit 45 obtains the pixel offset of the matching pixel block MB2 relative to the reference pixel block TB2. Then, the measuring unit 45 calculates the distance to the surface of the object A1 by triangulation based on the obtained pixel offset and the separation distance between the first camera unit 10 and the second camera unit 20. The measuring unit 45 performs the same processing for all pixel blocks 102 (target pixel block TB1) on the first image 100. In this way, if the distances of all pixel blocks 102 are obtained, the measuring unit 45 sends the distance information to the external device via the communication interface 47.
[0066] In addition to being used in a fixed manner, the distance measuring device 1 having the above-described structure can also be provided, for example, at the end effector (gripping part, etc.) of a robot arm that performs operating actions in a factory. In this case, the control unit 46 of the distance measuring device 1 receives an instruction for distance acquisition from the robot controller via the communication interface 47 during the operating process of the robot arm. Based on the instruction, the control unit 46 causes the measuring unit 45 to measure the distance between the position of the end effector and the surface of the object A1 of the operating object, and sends the measurement result to the robot controller via the communication interface 47. The robot controller performs feedback control on the action of the end effector based on the received distance information. In this way, when the distance measuring device 1 is provided at the end effector, it is preferred that the distance measuring device 1 is small and lightweight.
[0067] Figure 5 (a) schematically shows Figure 2 FIG. 3 is a diagram showing the structure of the optical filter 35 . Figure 5 (b) is to Figure 5 A part of (a) is enlarged and shown. Figure 5 (a) and (b) of FIG. 1 show a state where the filter 35 is viewed from the light incident surface 35a side.
[0068] like Figure 5 As shown in (a) and (b) of FIG. 3 , a plurality of types of filter regions 351 to 354 are formed in a given pattern on the incident surface 35a of the filter 35. Figure 5 In (a) and (b), the types of filter regions 351 to 354 are indicated by different hatching types. The filter regions 351 to 353 selectively transmit light of different wavelength bands. Here, the transmission wavelength bands of the filter regions 351 to 353 correspond to the wavelength bands of light emitted from the light sources 31 to 33, respectively.
[0069] That is, the filter region 351 has a high transmittance mainly for the wavelength band of the light from the light source 31, and a low transmittance for other wavelength bands. The filter region 352 has a high transmittance mainly for the wavelength band of the light from the light source 32, and a low transmittance for other wavelength bands. The filter region 353 has a high transmittance mainly for the wavelength band of the light from the light source 33, and a low transmittance for other wavelength bands.
[0070] The transmittance of the filter region 354 is set low for any wavelength band of the light from the light sources 31 to 33. That is, the filter region 354 substantially blocks the light from the light sources 31 to 33.
[0071] The size of each filter area 351 to 354 is set to a size that substantially corresponds to one pixel on the imaging element 12 or 22, for example. Figure 5 The area B1 indicated by the dotted line in (b) is an area corresponding to the area of the pixel block formed by 3 pixels in the vertical direction and 3 pixels in the horizontal direction on the imaging elements 12 and 22 (the pixel blocks 102 and 202 used in the above-mentioned stereo corresponding point search). That is, when the distance D0 to the surface of the object A1 is at the reference distance (for example, the middle distance of the ranging range), the light of the area B1 is projected onto the area of the pixel block formed by 3 pixels in the vertical direction and 3 pixels in the horizontal direction on the imaging elements 12 and 22.
[0072] However, the size of each filter region 351 to 354 is not necessarily limited to the size corresponding to one pixel. The size of each filter region 351 to 354 may be larger or smaller than the size corresponding to one pixel. Figure 5 In (b), each filter area 351 to 354 is rectangular and has the same size as one another. However, the sizes of each filter area 351 to 354 may be different from one another, and the shapes may be other shapes such as square and circle.
[0073] The filter regions 351 to 354 are preferably configured to include filter regions of different types in the regions B1 corresponding to all pixel blocks used for the stereo corresponding point search, and are further preferably configured to include all types of filter regions 351 to 354 in these regions B1. In addition, it is preferred that the configuration pattern of the filter regions included in the region B1 corresponding to the pixel block is specific (random) for each pixel block at each search position at least within the search range R0 of the stereo corresponding point search.
[0074] By configuring the filter regions 351 to 354 in this way, as described later, the brightness of light passing through the filter regions 351 to 354 can be made different from each other, so that the brightness distribution of light in the pixel block can be made specific for each pixel block. This can improve the accuracy of the stereo corresponding point search, and as a result, the distance measurement accuracy can be improved.
[0075] The filter regions 351 to 354 are formed, for example, by the following steps.
[0076] First, a color resist for forming the filter region 351 is applied to the surface of a transparent glass substrate. Then, ultraviolet rays are irradiated while the region other than the filter region 351 is covered with a mask, thereby insolubilizing the color resist in the region corresponding to the filter region 351. When the insolubilization is completed, the mask is removed, and the unnecessary color resist is removed with an alkaline developer, and then a post-baking treatment is performed to cure the color resist in the filter region 351. In this way, the filter region 351 is formed on the glass substrate.
[0077] The above steps are sequentially performed for the filter regions 352 to 354. Thus, the filter regions 352 to 354 are sequentially formed on the glass substrate. In this way, all the filter regions 351 to 354 are formed on the glass substrate. After that, a protective film is formed on the surface of the filter regions 351 to 354. Thus, the formation of the filter 35 is completed.
[0078] Figure 6 (a), (b) and Figure 7 (a) and (b) schematically show the Figure 5 (b) is a diagram showing light regions of light that have passed through filter regions 351 to 354 respectively when light from light sources 31 to 33 is incident on the entire range.
[0079] exist Figure 6 (a) shows the penetration Figure 5 The distribution state of the light (spot light DT1) after the filter area 351 of (b) is Figure 6 (b) shows the Figure 5 (b) shows the distribution of light (spot light DT2) after the filter area 352. Figure 7 (a) shows the Figure 5 The distribution state of the light (spot light DT3) after the filter area 353 of (b) is Figure 7 In (b), it is shown that Figure 5 (b) shows the distribution state of the light-shielded area (the dark spot DT4) of the filter area 354.
[0080] from Figure 5 The area of (b) is merged and projected Figure 6 (a)~ Figure 7 (b) The point lights DT1 to DT3 and the lightless point DT4 are projected from other areas of the filter 35 in a distribution corresponding to the distribution of the filter areas 351 to 354. In this way, the point lights DT1 to DT3 and the lightless point DT4 projected from the filter 35 are irradiated onto the surface of the object A1 as pattern light 30a. Thereafter, the point lights DT1 to DT3 and the lightless point DT4 are reflected on the surface of the object A1 and are captured by the first camera unit 10 and the second camera unit 20. Thus, the first image 100 and the second image 200 on which the point lights DT1 to DT3 and the lightless point DT4 are projected can be obtained.
[0081] Here, the light emission amounts of the light sources 31 to 33 are set so that the maximum brightness of the point lights DT1 to DT3 and the dark point DT4 on the second image 200 differ from each other. More specifically, the light emission amounts of the light sources 31 to 33 are set so that the maximum brightness of the point lights DT1 to DT3 and the dark point DT4 on the second image 200 differ substantially equally in the order of brightness.
[0082] Figure 8 (a) to (e) are diagrams for explaining a method of setting the light emission amounts of the light sources 31 to 33 .
[0083] Figure 8 (a) is a graph showing the spectral outputs of the light sources 31 to 33. The spectral outputs of the light sources 31 to 33 are shown by solid lines, dotted lines, and broken lines, respectively. Here, the vertical axis of the graph is normalized by the maximum output of the light source 31.
[0084] Light source 31 emits light having a central wavelength of about 610 nm and a wavelength band width of about 80 nm. Light source 32 emits light having a central wavelength of about 520 nm and a wavelength band width of about 150 nm. Light source 33 emits light having a central wavelength of about 470 nm and a wavelength band width of about 100 nm.
[0085] Figure 8 (b) is a graph showing the spectral transmittance of the filter regions 351 to 353. The spectral transmittance of the filter regions 351 to 353 is shown by a solid line, a dotted line, and a dashed line, respectively. Here, the vertical axis of the graph is normalized by the maximum transmittance of the filter region 351.
[0086] The transmittance of the filter region 351 increases as the wavelength increases from about 570 nm, and the maximum transmittance is maintained above about 650 nm. The filter region 352 has a spectral characteristic of a maximum transmittance of about 520 nm and a transmission band width of about 150 nm. The filter region 353 has a spectral characteristic of a maximum transmittance of about 460 nm and a transmission band width of about 150 nm.
[0087] In addition, illustration of the spectral transmittance of the filter region 354 is omitted. The spectral transmittance of the filter region 354 is substantially zero near the emission wavelength band of the light sources 31 to 33 (here, 400 to 650 nm).
[0088] Figure 8 (c) is a graph showing the spectral reflectance of the surface of the object A1 as the measurement surface. Here, an example is given of a case where the reflectance of the measurement surface is constant regardless of the wavelength, that is, an example is given of a case where the reflectance of the measurement surface has no wavelength dependence. The vertical axis of the graph is normalized by the maximum reflectance.
[0089] Figure 8 (d) is a graph showing the spectral sensitivity of the first imaging unit 10 and the second imaging unit 20. The spectral sensitivity of the first imaging unit 10 and the second imaging unit 20 is mainly determined by the spectral transmittance of the imaging lenses 11 and 21 and the spectral sensitivity of the imaging elements 12 and 22. The vertical axis of the graph is normalized by the maximum sensitivity. Here, the spectral sensitivity is maximum near 600 nm.
[0090] Figure 8 (e) shows that the spectral outputs of the light sources 31 to 33, the spectral transmittances of the filter regions 351 to 354, the spectral reflectance of the measurement surface (the surface of the object A1), and the spectral sensitivities of the first imaging unit 10 and the second imaging unit 20 have Figure 8 Graphs showing the maximum brightness of the point lights DT1 to DT3 and the dark point DT4 in the second image 200 in the case of the characteristics of (a) to (d). Here, the vertical axis of the graph is normalized by the maximum brightness of the point light DT1.
[0091] In this case, the maximum brightness of the spot light DT3 is about 1 / 3 of the maximum brightness of the spot light DT1, and the maximum brightness of the spot light DT2 is about 2 / 3 of the maximum brightness of the spot light DT1. That is, when the reflectivity of the measurement surface does not have wavelength dependence, by setting the peak values of the spectral outputs of the light sources 31 to 33 to Figure 8 As in (a), the maximum brightness of the point lights DT1 to DT3 based on the lights from the light sources 31 to 33 can be made substantially uniformly different in the order of brightness.
[0092] Figure 2 The brightness adjustment unit 44 performs initial setting of the light emission (driving current value) of the light sources 31 to 33 in this way, so that the maximum brightness of the point lights DT1 to DT3 based on the light from the light sources 31 to 33 is roughly evenly different in the order of brightness. Therefore, if the reflectivity of the measurement surface (the surface of the object A1) is not wavelength-dependent, the maximum brightness of the point lights DT1 to DT3 on the first image 100 and the second image 200 has a roughly even grayscale difference. Therefore, in the above-mentioned stereo corresponding point search, the correlation value that is significantly peaked at the search position of the matching pixel block MB2 can be calculated. As a result, the position of the matching pixel block MB2 can be determined with high precision, and as a result, the distance can be measured with high precision.
[0093] On the other hand, when the light emission (driving current value) of the light sources 31 to 33 is initially set in this way, if the reflectivity of the measuring surface (the surface of object A1) has wavelength dependence, the maximum brightness of the point lights DT1 to DT3 on the first image 100 and the second image 200 will no longer have approximately equal grayscale differences.
[0094] Fig. 9 (c) is a graph showing the spectral reflectance of the reflectance of the measurement surface (the surface of the object A1) when the reflectance of the measurement surface has wavelength dependence. Fig. 9 (e) is a graph showing the maximum brightness of the point lights DT1 to DT3 and the dark point DT4 in the second image 200 in this case. Fig. 9 (a), (b), (d) and Figure 8 (a), (b), and (d) are the same.
[0095] The reflectivity of the measuring surface is Fig. 9 In the case of the spectral reflectance shown in (c), if the light sources 31 to 33 have Fig. 9 The spectral output is as shown in (a), then Fig. 9 As shown in (e), the grayscale difference between the maximum brightness of the point light DT2 and the maximum brightness of the point light DT1 becomes smaller. Therefore, in the second image 200, it becomes difficult to distinguish the area of the point light DT1 from the area of the point light DT2 by brightness, and these areas are easily merged into one area for detection. Therefore, accordingly, the specificity of the point distribution in the pixel block decreases, and the search accuracy of the stereo corresponding point search decreases.
[0096] However, in this case, although the specificity brought by the point lights DT1 and DT2 in the pixel block decreases, the specificity brought by the point light DT3 is maintained. In addition, even if it is assumed that the areas of the point lights DT1 and DT2 are merged into one area as described above, the pixel positions distributed in each pixel block in this area are likely to be different between pixel blocks. Therefore, in this case, it is also easy to maintain the specificity of the point pattern in each pixel block. Therefore, in this case, it is also possible to maintain the search accuracy of the stereo corresponding point search at a high level by driving each light source with the initial setting value.
[0097] In addition, in order to perform stereo corresponding point search with higher accuracy, when the reflectivity of the measuring surface has wavelength dependence, it is preferred to change the light emission (driving current value) of light sources 31 to 33 relative to the initial setting value according to the spectral reflectivity of the reflectivity of the measuring surface, thereby ensuring the brightness difference of the maximum brightness between the point lights.
[0098] Fig.10 (a) is a graph showing a method of adjusting the outputs of the light sources 31 to 33 in this case. Fig.10 (b)~(d) and Fig. 9 (b) to (d) are the same.
[0099] Here, the light emission amount (driving current value) of the light source 32 is set to be larger than Fig. 9 The case (a) is low. Therefore, if Fig.10 As shown in (e), the maximum brightness of the spot light DT2 decreases, and the grayscale difference in brightness between the spot light DT1 and the spot light DT2 is Figure 8 The case (e) is similarly ensured. In this way, the maximum brightness of the point lights DT1 to DT3 based on the lights from the light sources 31 to 33 differs substantially equally in the order of brightness.
[0100] Therefore, the specificity of the pattern of the point light DT1 to DT3 and the dark point DT4 in each pixel block is similar to Figure 8 The situation (e) is maintained in the same manner. Therefore, it is possible to perform a stereo corresponding point search with high accuracy.
[0101] Fig.11 3 is a flowchart showing the process of setting the light emission amount (driving current) of the light sources 31 to 33. Figure 2 The brightness adjustment unit 44 performs this processing.
[0102] The brightness adjustment unit 44 sets the driving current values of the light sources 31 to 33 to initial setting values (S101). When the reflectivity of the surface of the object A1 has no wavelength dependence, the initial setting values of the light sources are set to the maximum brightness of the light from the light sources 31 to 33. Figure 8In addition, when the reflectivity of the surface of the object A1 is at a given value (the assumed standard value), the initial setting value of each light source is set so that the maximum brightness of the light from the light sources 31 to 33 appropriately converges within the range of the grayscale (e.g., 0 to 255) of the brightness specified in the first camera processing unit 41 and the second camera processing unit 42. For example, the initial setting value of each light source is set so that the maximum brightness of the largest light source 31 becomes slightly smaller than the maximum grayscale of the range of grayscales of the specified brightness (e.g., about 80 to 90% of the maximum grayscale).
[0103] Next, the brightness adjustment unit 44 sets one of the light sources 31 to 33 as the target light source, and drives the light source with the driving current value set for the light source (S102). For example, the light source 31 is set as the target light source. In this way, in a state where only the target light source is illuminated, the brightness adjustment unit 44 causes one of the first camera unit 10 and the second camera unit 20 to perform imaging (S103). In the present embodiment, the imaging of step S103 is performed by the second camera unit 20.
[0104] The brightness adjustment unit 44 obtains the maximum brightness of the pixel based on the captured image (S104). Here, the second camera unit 20 performs the capturing, so the brightness adjustment unit 44 obtains the maximum brightness of the pixel based on the second image 200 acquired by the second camera unit 20. Thus, on the second image 200, the maximum brightness among the brightness output from the pixel incident with the point light (here, the point light DT1) from the target light source (light source 31) is obtained.
[0105] Afterwards, the brightness adjustment unit 44 determines whether the processing of steps S102 to S104 has been performed on all of the light sources 31 to 33 (S105). In the case where there are light sources that have not been processed (S105: No), the brightness adjustment unit 44 sets the next light source as the target light source and drives the light source with the initial setting value (current value) corresponding to the light source (S102). For example, the light source 32 is set as the target light source. Afterwards, the brightness adjustment unit 44 similarly performs the processing of steps S103 and S104 to obtain the maximum brightness of the pixel based on the second image 200. As a result, on the second image 200, the maximum brightness among the brightness output by the pixel incident with the point light (here, the point light DT2) from the target light source (light source 32) is obtained.
[0106] In this case, since there is still an unprocessed light source (light source 33) left (S105: No), the brightness adjustment unit 44 sets the next light source as the target light source and drives the light source with the initial setting value (current value) corresponding to the light source (S102). Thus, the last light source 33 is set as the target light source. After that, the brightness adjustment unit 44 similarly performs the processing of steps S103 and S104 to obtain the maximum brightness of the pixel based on the second image 200. Thus, on the second image 200, the maximum brightness among the pixel output brightness incident from the point light (here, the point light DT3) from the target light source (light source 33) is obtained.
[0107] In this way, if the maximum brightness based on the initial setting value is obtained for all the light sources 31 to 33 (S105: Yes), the brightness adjustment unit 44 determines whether the balance of the obtained maximum brightness is appropriate (S106). Specifically, the brightness adjustment unit 44 determines whether the maximum brightness obtained when the light sources 31 to 33 emit light is as expected. Figure 8 The judgment is made when there are approximately equal differences in the order of brightness as in (e).
[0108] That is, the brightness adjustment unit 44 determines whether the ratio of the maximum brightness obtained when the light source 32 emits light (corresponding to the maximum brightness of the point light DT2) to the maximum brightness obtained when the light source 31 emits light (corresponding to the maximum brightness of the point light DT1) is included in a given allowable range centered on 66%. Furthermore, the brightness adjustment unit 44 determines whether the ratio of the maximum brightness obtained when the light source 33 emits light (corresponding to the maximum brightness of the point light DT3) to the maximum brightness obtained when the light source 31 emits light (corresponding to the maximum brightness of the point light DT1) is included in a given allowable range centered on 33%.
[0109] These allowable ranges are set to be a range in which the maximum brightness adjacent to each other in the magnitude direction can be distinguished, that is, a range in which the point lights DT1 to DT3 can be distinguished according to the brightness in the pixel block and the pattern of the point lights DT1 to DT3 can maintain specificity. For example, these allowable ranges are set to be a range of about ±10% relative to the above-mentioned 66% and 33%.
[0110] The maximum brightness obtained when the light sources 31 to 33 emit light is as follows Figure 8 If there are approximately equal differences in the order of brightness as in (e) (S106: Yes), the brightness adjustment unit 44 ends the Fig.11 In this case, the light sources 31 to 33 are driven at initial setting values to perform actual distance measurement for the object A1.
[0111] On the other hand, when the maximum brightness obtained when the light sources 31 to 33 emit light does not differ substantially evenly in the order of brightness ( S106 : No), the brightness adjustment unit 44 performs a process of resetting the drive current values of the light sources 31 to 33 ( S107 ).
[0112] Specifically, the brightness adjustment unit 44 resets the driving current values of the light sources 31 to 33 based on the pre-maintained relationship between the brightness and the driving current value and the current maximum brightnesses, so that the maximum brightness based on the light emission of the light source 31 is slightly smaller than the maximum grayscale (for example, about 80% to 90% of the maximum grayscale), and relative to the maximum brightness, the maximum brightness based on the light emission of the light sources 32 and 33 is near the above ratio, i.e., 66% and 33%.
[0113] At this time, the brightness adjustment unit 44 determines whether any of the three maximum brightnesses obtained in step S104 is saturated, that is, whether it reaches the maximum grayscale of the grayscale of the specified brightness (for example, 0 to 255). In the case where the maximum brightness of any one is saturated, the brightness adjustment unit 44 sets the driving current value for the light source that has obtained the maximum brightness to be lower by the amount of the given grayscale than the driving current value calculated based on the relationship between the brightness and the driving current value and the maximum grayscale. In this case, the brightness adjustment unit 44 also resets the driving current value of the light sources 31 to 33 so that the maximum brightness based on the light emitted by the light sources 31 to 33 is roughly evenly different in the order of brightness.
[0114] In this way, after resetting the driving current values for the light sources 31 to 33, the brightness adjustment unit 44 returns the process to step S102, and obtains the maximum brightness of each light source when emitting light by using the reset driving current value (S102 to S105). Then, the brightness adjustment unit 44 compares the three obtained maximum brightnesses again, and determines whether these maximum brightnesses are substantially equally different in order of brightness (S106).
[0115] If the determination is yes, the brightness adjustment unit 44 ends the Fig.11 In this case, the light sources 31 to 33 are driven with the reset driving current values to perform actual distance measurement for the object A1.
[0116] On the other hand, if the judgment of step S106 is no, the brightness adjustment unit 44 resets the driving current value for the light sources 31 to 33 based on the relationship between the brightness and the driving current value in the same manner as described above, and returns the process to step S102. The brightness adjustment unit 44 resets the driving current value of the light sources 31 to 33 until the maximum brightnesses respectively obtained by the light emission of the light sources 31 to 33 differ approximately equally in the order of brightness (S106: No, S107). Then, if these maximum brightnesses differ approximately equally in the order of brightness (S106: Yes), the brightness adjustment unit 44 ends. Fig.11 Thus, the light sources 31 to 33 are driven by the driving current values finally set, respectively, and the actual distance measurement to the object A1 is performed.
[0117] <Effects of Implementation Methods>
[0118] According to the above-described embodiment, the following effects can be achieved.
[0119] like Figure 6 (a)~ Figure 7 As shown in (a), a plurality of types of light regions (spot lights DT1 to DT3) with different wavelengths are projected onto the surface of the object A1 with patterned light 30a distributed in a given pattern. Therefore, even if the surface of the object A1 has a low reflectivity or a high light absorptivity for any of these wavelengths, the pattern of light based on other wavelengths is included in the camera images of the first camera unit 10 and the second camera unit 20. Therefore, the specificity of each pixel block 102 can be maintained by the distribution pattern of light in other wavelengths, and a stereo corresponding point search can be performed with high precision. Therefore, the distance to the surface of the object A1 can be measured with high precision.
[0120] like Figure 8 As shown in (e), there are differences in maximum brightness between the multiple types of light regions (spot lights DT1 to DT3). Therefore, these light regions (spot lights DT1 to DT3) can be distinguished by brightness, and the specificity of each pixel block 102 can be improved by the distribution of these light regions (spot lights DT1 to DT3). Therefore, a stereo corresponding point search can be performed with high accuracy, and the distance to the surface of the object A1 can be measured with high accuracy.
[0121] like Figure 2 as well as Figure 5As shown in (a) and (b) of FIG. 1 , the projection unit 30 includes a filter 35, and the filter 35 has a plurality of filter regions 351 to 353 for respectively generating a plurality of light regions (spot lights DT1 to DT3) distributed in the same pattern as the pattern of the light regions (spot lights DT1 to DT3). Thus, it is possible to easily generate patterned light 30a in which a plurality of light regions (spot lights DT1 to DT3) are distributed in a desired pattern. In addition, since there is no deviation in diffraction efficiency (deviation in brightness grayscale) caused by manufacturing error or assembly error as in a diffractive optical element, it is possible to stably generate patterned light in which a plurality of light regions (spot lights DT1 to DT3) are distributed in a desired pattern.
[0122] like Figure 2 As shown, the projection unit 30 includes a plurality of light sources 31 to 33 that emit light of different wavelength bands and an optical system 34 that guides the light emitted from the plurality of light sources 31 to 33 to the filter 35. Thus, the filter 35 can be easily irradiated with light for generating a plurality of types of light regions (spot lights DT1 to DT3).
[0123] like Figure 8 As shown in (a) and (b), a plurality of light sources 31 to 33 are arranged corresponding to a plurality of types of filter regions 351 to 353, and each filter region 351 to 353 selectively extracts light from the corresponding light source 31 to 33. Thus, a plurality of types of light regions (spot lights DT1 to DT3) can be efficiently generated.
[0124] like Figure 8 As shown in (e), the maximum brightness of the light from each light source 31 to 33 obtained based on the pixel signal from the second camera unit 20 is different from each other. Therefore, multiple types of light areas (spot lights DT1 to DT3) can be distinguished by brightness, and the specificity of each pixel block 102 can be improved by the distribution of these light areas (spot lights DT1 to DT3). Therefore, stereo corresponding point search can be performed with high accuracy, and the distance to the surface of the object A1 can be measured with high accuracy.
[0125] like Fig.11As shown, the brightness adjustment unit 44 sets the light emission amount (driving current value) of the plurality of light sources 31 to 33 so that the maximum brightness of the light from each light source 31 to 33 obtained based on the pixel signal from the second camera unit 20 is different from each other (S101, S107). Thus, even when the reflectivity or light absorption rate of the surface of the object A1 has wavelength dependence, the maximum brightness of the light from each light source 31 to 33 can be made different from each other. Therefore, even when the reflectivity or light absorption rate of the surface of the object A1 has wavelength dependence, multiple types of light regions (point lights DT1 to DT3) can be distinguished by brightness, and the specificity of each pixel block 102 can be improved by the distribution of these light regions (point lights DT1 to DT3). Therefore, a stereo corresponding point search can be performed with high accuracy, and the distance to the surface of the object A1 can be measured with high accuracy.
[0126] exist Fig.11 In steps S101 and S107, the brightness adjustment unit 44 sets the light emission amounts (driving currents) of the plurality of light sources 31 to 33 so that Fig.10 As shown in (e), the maximum brightness of the light from each light source 31 to 33 obtained based on the pixel signal from the second camera unit 20 is roughly equally different in the order of brightness. As a result, the maximum brightness of the light from each light source 31 to 33 can be greatly different from each other. Therefore, multiple types of light areas (point lights DT1 to DT3) can be clearly distinguished by brightness, and the specificity of each pixel block 102 can be significantly improved by the distribution of these light areas (point lights DT1 to DT3). Therefore, the stereo corresponding point search can be performed with higher accuracy, and the distance to the surface of the object A1 can be measured with higher accuracy.
[0127] In the above embodiment, the light sources 31 to 33 are light emitting diodes. This can suppress the superposition of speckle noise in the captured images (first image 100 and second image 200) of the pattern light 30a. Therefore, the stereo corresponding point search can be performed with high accuracy, and the distance to the surface of the object A1 can be measured with high accuracy.
[0128] like Figure 7As shown in (b), the pattern light 30a includes a lightless area (lightless point DT4). As a result, the change in the brightness grayscale of the light areas (light points DT1 to DT3, lightless point DT4) can be increased, and the specificity of each pixel block 102 caused by the distribution of these light areas (light points DT1 to DT3, lightless point DT4) can be further improved. In addition, the lightless area (lightless point DT4) can be used to suppress the overlap of light areas (light points DT1 to DT3) with different wavelengths, and the brightness grayscale based on these light areas (light points DT1 to DT3) can be appropriately maintained. Therefore, the stereo corresponding point search can be performed with higher accuracy, and the distance to the surface of the object A1 can be measured with higher accuracy.
[0129] <Change Example 1>
[0130] In the above-described embodiment, the three light sources 31 to 33 corresponding to the point lights DT1 to DT3 , respectively, are arranged in the projection unit 30 . However, in the first modification, only one light source is arranged in the projection unit 30 .
[0131] Fig.12 1 is a diagram showing a configuration of a distance measuring device 1 according to Modification Example 1. FIG.
[0132] The projection unit 30 includes a light source 37, a collimating lens 38, a filter 35, and a projection lens 36. The light source 37 emits light of a wavelength band including the selected wavelength bands of the plurality of filter regions 351 to 353. The light source 37 is, for example, a white laser diode. The collimating lens 38 collimates the light emitted from the light source 37. The collimating lens 38 constitutes an optical system that guides the light from the light source 37 to the filter 35. The structures of the filter 35 and the projection lens 36 are the same as those in the above-mentioned embodiment. In addition, the structures other than the projection unit 30 are the same as those in the above-mentioned embodiment. Figure 2 The structure is the same.
[0133] Fig.13 (a) is a graph showing the spectral output of the light source 37, Fig.13 (b) is a graph showing the spectral transmittance of the filter regions 351 to 353 . Fig.13 (c)~(e) and Figure 8 (c) to (e) are the same.
[0134] The light source 37 has Fig.13 The spectral output characteristics of (a) are shown in FIG. 1 , and the filter regions 351 to 353 have Fig.13 In the case of the spectral transmittance characteristic of (b), if the spectral reflectance of the measurement surface (the surface of the object A1) and the spectral sensitivities of the first imaging unit 10 and the second imaging unit 20 are respectively Fig.13 The maximum brightness of the point lights DT1 to DT3 is as follows: Fig.13As shown in (e), there are roughly equal differences in the order of brightness.
[0135] Therefore, according to the structure of Modification Example 1, by simply emitting light from the light source 37, the maximum brightness of the point lights DT1 to DT3 can be made different from each other, and these maximum brightnesses can be made to be substantially evenly different in the order of brightness. Thus, similarly to the above-mentioned embodiment, the distance to the surface of the object A1 can be measured with high accuracy. In addition, the number of components of the projection unit 30 can be reduced, and the structure of the projection unit 30 can be simplified.
[0136] However, in the structure of Modification Example 1, since a light source is not arranged for each point light DT1 to DT3, it is not possible to adjust the light amount of the point light DT1 to DT3 according to the wavelength dependence of the reflectivity of the surface of the object A1 as in the above-mentioned embodiment. Therefore, in the case where the reflectivity of the surface of the object A1 has wavelength dependence, in order to perform a stereo corresponding point search with higher accuracy, it is preferable to arrange the light source 31 to 33 for each point light DT1 to DT3 as in the above-mentioned embodiment.
[0137] In addition, in the structure of the modification example 1, the brightness adjustment unit 44 adjusts the light emission amount (driving current value) of the light source 37 so that the maximum brightness based on the point lights DT1 to DT3 is not saturated and these maximum brightnesses are appropriately converged within the range of the gray scale (for example, 0 to 255) of the brightness specified in the first camera processing unit 41 and the second camera processing unit 42. In this case, the brightness adjustment unit 44 causes the light source 37 to emit light at an initial value to obtain the second image 200 before the distance measurement, and obtains the maximum brightness based on the second image 200. Then, when the maximum brightness is saturated or too low, the driving current value of the light source 37 is reset according to the relationship between the brightness and the driving current value so that the maximum brightness is slightly smaller than the highest gray scale. The maximum brightness of the point lights DT1 to DT3 is appropriately converged within the range of the gray scale (for example, 0 to 255) of the specified brightness.
[0138] <Change Example 2>
[0139] In the second modification, a light shielding wall is formed at the boundary between adjacent filter areas on the filter 35 .
[0140] Fig.14 (a) is a diagram schematically showing the structure of the optical filter 35 according to Modification Example 2. Fig.14 (b) is to Fig.14 A diagram showing an enlarged view of a part of (a).
[0141] like Fig.14As shown in (a) and (b), in modification example 2, a light shielding wall 355 is formed at the boundary between adjacent filter areas on the filter 35. The height of the light shielding wall 355 is the same as the thickness of the filter areas 351 to 354. The light shielding wall 355 is preliminarily formed in a matrix shape on the above-mentioned glass substrate constituting the filter 35. One square of the matrix corresponds to one filter area. On the glass substrate on which the light shielding wall 355 is formed in this way, the filter areas 351 to 354 are formed by the above-mentioned process. Thus, the structure Fig.14 Filter 35 having the structures of (a) and (b).
[0142] If the light shielding wall 355 is formed in this way, it is possible to suppress the overlap of point lights due to leakage when passing through adjacent filter areas, and to generate a good pattern light 30a in which each type of point light is clearly distinguished. This makes it possible to perform a stereoscopic corresponding point search with higher accuracy, and to measure the distance to the surface of the object A1 with higher accuracy.
[0143] <Other changes>
[0144] In the above-mentioned modification example 1, a light source 37 having a spectral output spanning a band of spectral transmittances of three filter regions 351 to 353 is arranged in the projection unit 30, but a light source having a spectral output spanning a band of spectral transmittances of two filter regions 352 and 353 and a light source having a spectral output corresponding to the band of spectral transmittance of the filter region 351 may also be arranged, or a light source having a spectral output spanning a band of spectral transmittances of two filter regions 351 and 352 and a light source having a spectral output corresponding to the band of spectral transmittance of the filter region 353 may also be arranged.
[0145] In this case, an optical system that combines the light from the two light sources and guides the light to the filter 35 is disposed in the projection unit 30. As long as the light source has a spectral output spanning two wavelength bands of spectral transmittance and has a maximum brightness based on the light of the two wavelength bands and Figure 8 (e) The spectral output characteristics of the other light source can be set to be different from the maximum brightness of the other light, and the output of the other light source can be set to be different from the maximum brightness of the other light. Figure 8 (e) may also be different.
[0146] In addition, in the above embodiment, if Figure 5 As shown in (a) and (b), four types of filter regions 351 to 354 are arranged in the filter 35, but the types of filter regions arranged in the filter 35 are not limited thereto. For example, two types of filter regions may be arranged in the filter 35, or five or more types of filter regions may be arranged in the filter 35.
[0147] In this case, a plurality of light sources may be configured so as to correspond one-to-one with the types of filter regions, or a light source having a spectral output corresponding to the spectral transmittance of the plurality of types of filter regions may be configured. That is, the number of light sources may be set to be less than the number of types of filter regions, and point lights of different wavelength bands may be generated from the plurality of types of filter regions based on the light from one light source. In this case, it is also sufficient to set the spectral output of each light source and the spectral transmittance of each filter region so that the maximum brightness of the point lights generated by all types of filter regions differ from each other. More preferably, the spectral output of each light source and the spectral transmittance of each filter region may be set so that the maximum brightness of these point lights differs approximately equally in the order of brightness.
[0148] In addition, various spectral characteristics are not limited to Figure 8 (a)~(d), Fig. 9 (a)~(d), Fig.10 (a) to (d) and Fig.13 (a) to (d). The spectral output of each light source and the spectral transmittance of each filter area can be appropriately changed as long as the maximum brightness of the point light generated by each filter area is different from each other. The wavelength band of each light source and each type of filter area is not limited to the light sources and wavelength bands shown in the above-mentioned embodiment and its modified examples.
[0149] In addition, the arrangement pattern of each type of filter area is not limited to Figure 5 The patterns of (a) and (b) can be changed appropriately. In this case, it is sufficient to set the configuration pattern of each type of filter area so that the configuration pattern of each type of point light in each pixel block becomes specific (random) at least within the search range R0.
[0150] In the above embodiment and its modified example, a transmissive filter 35 is exemplified, but a reflective filter may also be used. In this case, for example, a reflective film is formed between a glass substrate constituting the filter 35 and a material layer forming each filter region.
[0151] In addition, in the above-mentioned embodiment and its variation examples, multiple types of light regions with different wavelength bands are point lights DT1 to DT3, but these light regions may not necessarily be points. As long as the distribution pattern of the light region for each pixel block is specific (random) at least within the search range R0, the multiple types of light regions may also be shapes other than points.
[0152] Furthermore, in the above-mentioned embodiment, Fig.11In step S103, the second imaging unit 20 captures the surface of the object A1, but Fig.11 In step S103 , the surface of the object A1 may be photographed by the first imaging unit 10 , and the maximum brightness acquisition process of step S104 may be performed using the first image 100 acquired by the first imaging unit 10 .
[0153] In addition, in the above-mentioned embodiment and its modification, two imaging units, namely the first imaging unit 10 and the second imaging unit 20, are used, but three or more imaging units may be used. In this case, these imaging units are arranged so that the fields of view overlap with each other, and the pattern light 30a is projected within the range where these fields of view overlap. In addition, a stereo corresponding point search is performed between the imaging units that form a group.
[0154] In addition, the use of the distance measuring device 1 is not limited to Figure 1 The usage shown in the embodiment and the usage set in the end effector of the robot arm can also be used in other systems that use the distance to the surface of an object to perform a given control. In addition, the structure of the distance measuring device 1 is not limited to the structure shown in the above embodiment. For example, as the imaging element 12, 22, a light sensor array in which a plurality of light sensors are arranged in a matrix can also be used.
[0155] In addition, the embodiments of the present invention can be modified in various ways as appropriate within the scope of the technical concept shown in the claims.
[0156] Description of Reference Numerals
[0157] 1: Distance measuring device
[0158] 10: Camera Department No. 1
[0159] 10a, 20a: Field of view
[0160] 20: Camera Unit 2
[0161] 30: Projection Department
[0162] 30a: Pattern light
[0163] 31-33, 37: Light source
[0164] 34: Optical system
[0165] 35: Filter
[0166] 38: Collimating lens (optical system)
[0167] 44: Brightness adjustment unit
[0168] 45: Measurement Department
[0169] 351~354: Filter area
[0170] DT1~DT3: Point light (light area)
[0171] DT4: Dull spot (area without light).
Claims
1. A distance measuring device comprising: The first imaging unit and the second imaging unit are arranged side by side so that their fields of view overlap; A projection unit projects patterned light having a plurality of light regions of different wavelengths in a given pattern distribution into a range where the fields of view overlap; and The measuring unit performs a stereo corresponding point search process on the images respectively acquired by the first imaging unit and the second imaging unit to measure the distance to the surface of the object onto which the pattern light is projected.
2. The distance measuring device according to claim 1, wherein: There are differences in maximum brightness among the plurality of types of light regions.
3. The distance measuring device according to claim 1 or 2, wherein: The projection unit includes an optical filter, and a plurality of types of filter regions of the optical filter for respectively generating the plurality of types of light regions are distributed in a pattern similar to the pattern of the light regions.
4. The distance measuring device according to claim 3, wherein: The projection unit comprises: a plurality of light sources emitting light of different wavelength bands; and The optical system guides the light emitted from the plurality of light sources to the filter.
5. The distance measuring device according to claim 4, wherein: The plurality of light sources are arranged corresponding to the plurality of types of filter regions, respectively. Each of the filter regions selectively extracts light from the corresponding light source.
6. The distance measuring device according to claim 5, wherein: The maximum brightness of the light from each of the light sources acquired based on the pixel signal from the first imaging unit or the second imaging unit is different from each other.
7. The distance measuring device according to claim 5 or 6, wherein: The distance measuring device comprises: a brightness adjustment unit for adjusting the light emission amounts of the plurality of light sources respectively; The brightness adjustment unit sets the light emission amounts of the plurality of light sources so that maximum brightnesses of light from the respective light sources acquired based on the pixel signal from the first imaging unit or the second imaging unit differ from each other.
8. The distance measuring device according to claim 7, wherein: The brightness adjustment unit sets the light emission amounts of the plurality of light sources so that maximum brightnesses of light from the respective light sources acquired based on pixel signals from the first imaging unit or the second imaging unit differ substantially equally in order of brightness.
9. The distance measuring device according to claim 3, wherein: The projection unit comprises: a light source that emits light of a wavelength band including the selected wavelength bands of the plurality of types of filter regions; and an optical system that directs light from the light source to the filter, The light source has a spectral output such that the maximum brightness of light transmitted through the plurality of types of filter regions is different from each other.
10. The distance measuring device according to any one of claims 4 to 9, wherein: The light source is a light emitting diode.
11. The distance measuring device according to any one of claims 1 to 10, wherein: The patterned light includes an area without light.
