Three-dimensional shape measuring device, control method, and program
The three-dimensional shape measuring device addresses the limitations of conventional devices by projecting a variable striped pattern adjusted for distance, optimizing settings to cover a wide range efficiently and quickly.
Patent Information
- Application Number
- JP2023082011
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-18
- Publication Date
- 2024-11-28
AI Technical Summary
Conventional three-dimensional shape measuring devices using the phase shift method are limited by the focal lengths of their optical systems, requiring multiple devices for measuring targets at different distances, and suffer from prolonged measurement times when using raster-scanned parallel light.
A three-dimensional shape measuring device with a projector that projects a variable striped pattern, adjusted by a camera focused on the target, and a distance measuring device to set the pattern period based on the measured distance, using a table to determine optimal pattern settings for various distances, minimizing measurement time while covering a wide range.
The device achieves wide-ranging distance measurement without significantly increasing time, maintaining accuracy by optimizing pattern settings based on distance and focal length, thus enhancing measurement efficiency.
Smart Images

Figure 2024165648000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a three-dimensional shape measuring device, a control method, and a program. [Background technology]
[0002] Conventionally, devices that measure three-dimensional shapes using the principle of the phase shift method (hereinafter referred to as "three-dimensional shape measuring devices") have been developed (for example, see JP 2013-88261 A (Patent Document 1), JP 2016-31284 A (Patent Document 2), JP 2021-85797 A (Patent Document 3), and JP 2005-214653 A (Patent Document 4)). A three-dimensional shape measuring device using the phase shift method includes a projector that projects a light pattern onto a measurement target, and a camera that captures the measurement target onto which the light pattern is projected. Typically, the range of distance between the three-dimensional shape measuring device and the measurement target is limited according to the focal length of the optical system of the projector and the focal length of the optical system of the camera. Therefore, in general, when a user wants to measure multiple types of measurement targets at different distances from the three-dimensional shape measuring device, it is necessary to use multiple types of three-dimensional shape measuring devices separately.
[0003] Japanese Patent Laid-Open Publication No. 2018-146521 (Patent Document 5) discloses an apparatus including a projection unit capable of optically scanning parallel light to project pattern light in order to expand the range of distance to a measurement target. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2013-88261 A [Patent Document 2] JP 2016-31284 A [Patent Document 3] Patent Publication No. 2021-85797 [Patent Document 4] JP 2005-214653 A [Patent Document 5] JP 2018-146521 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, according to the device described in Patent Document 5, since parallel light is raster-scanned, it takes a long measurement time to measure a wide range.
[0006] An object of the present disclosure is to provide a three-dimensional shape measuring device, a control method, and a program that can measure a wide range of distances to a measurement target while suppressing an increase in measurement time. [Means for solving the problem]
[0007] A three-dimensional shape measuring device according to an aspect of the present disclosure includes a camera adjusted to focus on a measurement target, and a projector that projects a stripe pattern. The period of the stripe pattern projected by the projector is variable.
[0008] Preferably, the period of the stripe pattern is set in accordance with the measurement distance between the measurement object and the projector.
[0009] Preferably, the period of the stripe pattern is set based on a table that associates each of a plurality of distances between the measurement target and the projector with a period candidate.
[0010] Preferably, the projector has a unique focal length. In the table, the period candidates are set so that the amplitude of a first image captured by the camera when a stripe pattern is projected onto an object placed at a position corresponding to one of a plurality of distances from the projector is 50% or more of the amplitude of a second image captured by the camera when a focused binary image is projected onto the object. In the table, the greater the difference between the corresponding distance and the focal length, the longer the period candidate.
[0011] Preferably, the projector has a unique focal length. In the table, the period candidates are set so that the amplitude of a first image captured by the camera when a stripe pattern is projected onto an object placed at a position corresponding to one of a plurality of distances from the projector has 10 times or more the brightness variation of a second image captured by the camera when a uniform pattern is projected onto the object. In the table, the larger the difference between the corresponding distance and the focal length, the longer the period candidate.
[0012] Preferably, the projector has a unique focal length. In the table, the periodicity candidates are set to periodicity components corresponding to 50% or more of the amplitude of a second image captured by the camera when a focused binary image is projected onto the object, in a correlation between the periodicity components and amplitudes obtained by Fourier transforming a first image captured by the camera when a square wave pattern is projected onto an object placed at a position corresponding to one of a plurality of distances from the projector. In the table, the greater the difference between the corresponding distance and the focal length, the longer the periodicity candidates are.
[0013] Preferably, the projector has a unique focal length. In the table, the period candidates are set so that the amplitude of the first luminance measured by a luminance meter placed at a position corresponding to one of a plurality of distances from the projector when a stripe pattern is projected while being moved is 50% or more of the amplitude of the second luminance measured by the luminance meter when a binary image focused on the luminance meter is projected while being moved. In the table, the larger the difference between the corresponding distance and the focal length, the longer the period candidate.
[0014] Preferably, the projector has a unique focal length. In the table, the period candidates are set so that the amplitude of the first luminance measured by a luminance measuring device when a stripe pattern is projected while moving onto the luminance measuring device placed at a position corresponding to one of a plurality of distances from the three-dimensional shape measuring device is 10 times or more greater than the variation of the second luminance measured by the luminance measuring device when a uniform pattern is projected while moving onto the luminance measuring device. In the table, the greater the difference between the corresponding distance and the focal length, the longer the period candidate is.
[0015] Preferably, the three-dimensional shape measuring apparatus further includes a distance measuring device for measuring a measurement distance.
[0016] Preferably, the distance measuring device measures a distance between a partial range of the measurement target and the projector as the measurement distance, The partial range has a length of one period of the stripe pattern projected onto the measurement target.
[0017] Preferably, the three-dimensional shape measuring device further includes a distance measuring unit which measures a measurement distance based on a plurality of images obtained by the camera when a plurality of stripe patterns having different phases are projected onto the measurement object.
[0018] Preferably, the distance measurement unit measures the measurement distance using a partial range including pixels representing luminance of the optical axis of the projector in each of the plurality of images, the partial range having a length equivalent to one period of the stripe pattern projected onto the measurement target.
[0019] Preferably, the camera has an autofocus mechanism and is adjusted so that the focus is on the measurement target by the autofocus mechanism.
[0020] Preferably, the three-dimensional shape measuring device includes a plurality of cameras having different focal lengths, and among the plurality of cameras, a specific camera having the highest degree of focus on the measurement target is selected as the camera.
[0021] Preferably, the stripe pattern is sinusoidal.
[0022] A method for controlling a projector used for three-dimensional shape measurement according to one aspect of the present disclosure includes acquiring a measurement distance between a measurement object and the projector, and changing the period of a stripe pattern projected by the projector in accordance with the measured distance.
[0023] Preferably, changing the period of the stripe pattern includes reading out a period candidate corresponding to the measured distance from a table that associates each of a plurality of distances between the measurement object and the projector with a period candidate, and setting the period of the stripe pattern based on the read out period candidate.
[0024] Preferably, the projector has a fixed focal length. The control method further includes creating a table. Creating the table includes determining, for each of a plurality of distances, a periodic range of the stripe pattern in which, when the stripe pattern is projected onto an object placed at a position that is the distance away from the projector, the amplitude of a first image captured by a camera used for measuring the three-dimensional shape is 50% or more of the amplitude of a second image captured by the camera when a binary image in focus is projected onto the object, and setting the shortest period within the periodic range as a period candidate.
[0025] Preferably, the projector has a fixed focal length. The control method further includes creating a table. Creating the table includes determining, for each of a plurality of distances, a periodic range of the stripe pattern such that, when the stripe pattern is projected onto an object placed at a position away from the projector by the corresponding distance, the amplitude of a first image captured by a camera used for the three-dimensional shape measurement is 10 times or more greater than the luminance variation of a second image captured by the camera when a uniform pattern is projected onto the object, and setting the shortest period within the periodic range as a period candidate.
[0026] A program according to an aspect of the present disclosure causes a computer to execute the above-described method. Effect of the Invention
[0027] According to the present disclosure, a three-dimensional shape measuring device, a control method, and a program that can measure a wide range of distances to a measurement target while suppressing an increase in measurement time are realized. [Brief description of the drawings]
[0028] [Figure 1] 1 is a diagram illustrating an example of a system to which a three-dimensional shape measuring apparatus according to an embodiment is applied. [Diagram 2] 1 is a diagram illustrating an example of a hardware configuration of a three-dimensional shape measuring apparatus according to an embodiment. [Diagram 3] 1A and 1B are diagrams illustrating an example of a stripe pattern generated by a light modulation device. [Figure 4] FIG. 13 is a diagram showing the luminance value and phase shift amount of a certain pixel in four captured images corresponding to phase shift amounts of 0, π / 2, π, and 3π / 2. [Diagram 5] 1A and 1B are diagrams illustrating the influence of a luminance error on three-dimensional shape measurement. [Figure 6] 11A to 11C are diagrams showing examples of captured images when the focus degree of the projection optical system and the focusing optical system with respect to the measurement target is changed. [Figure 7] 13 is a diagram showing changes in contrast of a stripe pattern in a captured image and conversion accuracy from phase φ to height h with respect to the spatial frequency of the stripe pattern. FIG. [Figure 8] FIG. 13 is a diagram illustrating an example of a table. [Figure 9] FIG. 11 is a diagram illustrating a first method for setting period candidates. [Figure 10] FIG. 11 is a diagram illustrating a second method for setting period candidates. [Figure 11] FIG. 13 is a diagram illustrating a third method for setting period candidates. [Figure 12] 5 is a flowchart showing the flow of a method for controlling the projector by the processor. [Figure 13] FIG. 11 is a diagram showing a hardware configuration of a three-dimensional shape measuring device according to a first modified example. [Figure 14]FIG. 11 is a diagram illustrating a hardware configuration of a three-dimensional shape measuring device according to a second modified example. [Figure 15] FIG. 2 is a diagram showing an example of a captured image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0029] Hereinafter, with reference to the drawings, an embodiment and a modified example according to the present disclosure will be described. In the following description, the same parts and components are given the same reference numerals. Their names and functions are also the same. Therefore, detailed descriptions thereof will not be repeated. Note that the embodiment and modified examples described below may be combined as appropriate.
[0030] <Application examples of 3D shape measurement devices> 1 is a diagram illustrating an example of a system to which a three-dimensional shape measuring device according to an embodiment is applied. The system 1000 includes a three-dimensional shape measuring device 100 and a robot 200.
[0031] The three-dimensional shape measuring device 100 measures the three-dimensional shape of the measurement object 300 by using the principle of the phase shift method. The measurement object 300 includes a tray 302 and a plurality of workpieces 304 randomly stacked on the tray 302. The three-dimensional shape measuring device 100 outputs data indicating the measured three-dimensional shape (hereinafter referred to as "three-dimensional point cloud data") to the robot 200.
[0032] The robot 200 determines the workpiece 304 to be grasped based on the three-dimensional point cloud data received from the three-dimensional shape measuring device 100, and performs a pick-and-place operation on the workpiece 304 to be grasped. Specifically, the robot 200 grasps the workpiece 304 on the tray 302, and places the workpiece 304 on the conveyor belt 500.
[0033] It should be noted that the system to which the three-dimensional shape measuring device 100 is applied is not limited to the system 1000 shown in Fig. 1. The three-dimensional shape measuring device 100 is used for various purposes.
[0034] <Configuration of 3D shape measurement device> 2 is a diagram illustrating an example of a hardware configuration of a three-dimensional shape measuring device according to an embodiment. As illustrated in FIG. 2, the three-dimensional shape measuring device 100 includes a projector 1, a camera 2, a computer 3, and a distance measuring device 4.
[0035] The projector 1 includes a light source 11, a light modulation device 12, and a projection optical system 13. A light beam emitted from the light source 11 is modulated by the light modulation device 12 and projected onto the measurement target 300 via the projection optical system 13.
[0036] The light source 11 includes, for example, an LED (Light Emitting Diode), an extra-high pressure mercury lamp, or a halogen lamp. The light source 11 emits white light.
[0037] The light modulation device 12 modulates the light from the light source 11 to generate a projection image. The light modulation device 12 includes, for example, a digital micromirror device (DMD). In this embodiment, the light modulation device 12 can generate a stripe pattern as the projection image.
[0038] FIG. 3 is a diagram showing an example of a stripe pattern generated by a light modulation element. The upper part of FIG. 3 shows the luminance distribution of the stripe pattern. The lower part of FIG. 3 shows a graph in which the horizontal axis represents position and the vertical axis represents luminance value. As shown in the graph, the luminance value varies sinusoidally depending on the position. The light modulation device 12 changes the period L of the stripe pattern under the control of the computer 3. That is, the period L of the stripe pattern projected by the projector 1 is variable.
[0039] The projection optical system 13 enlarges and projects the projection image generated by the light modulation device 12 onto the measurement target. The projection optical system 13 has one or more lenses. The projection optical system 13 does not have an autofocus function. Therefore, the projector 1 has its own focal length.
[0040] 2, the camera 2 captures an image of the measurement target and generates image data (hereinafter, referred to as a "captured image"). The camera 2 includes an image sensor 21, a light collecting optical system 22, and an auto focus (AF) mechanism 23.
[0041] The image sensor 21 converts the intensity of the light obtained through the light collecting optical system 22 into an electric signal. The image sensor 21 includes, for example, a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS).
[0042] The light collecting optical system 22 is an optical system for collecting light incident from the outside, and typically includes one or more lenses.
[0043] The autofocus mechanism 23 controls the position of the light collecting optical system 22 so that the measurement target is brought into focus. The autofocus mechanism 23 adjusts the camera 2 so that the measurement target 300 is brought into focus.
[0044] The distance measuring device 4 measures the distance to the measurement target 300. The distance measuring device 4 is placed at the same height as the projector 1. Therefore, the distance measuring device 4 measures the distance between the projector 1 and the measurement target 300. Hereinafter, the distance measured by the distance measuring device 4 will be referred to as the "measured distance". The distance measuring device 4 is configured, for example, by a millimeter wave sensor that can measure the distance in a short time. However, the distance measuring device 4 is not limited to this, and may be configured by a known distance measuring sensor.
[0045] The distance measuring device 4 may measure the distance to, for example, a partial range 306 of the measurement target 300. By limiting the measurement range, the distance measuring device 4 can measure the measurement distance in a short time. The partial range 306 has a length of, for example, one period of the stripe pattern projected onto the measurement target 300.
[0046] The computer 3 controls the projector 1, the camera 2, and the distance measuring device 4. The computer 3 includes a processor 31, a memory 32, and a storage 33.
[0047] The processor 31 is configured, for example, by a central processing unit (CPU) or a micro-processing unit (MPU). The memory 32 is configured, for example, by a volatile storage device such as a dynamic random access memory (DRAM) or a static random access memory (SRAM). The storage 33 is configured, for example, by a non-volatile storage device such as a hard disk drive (HDD), a solid state drive (SSD), or a flash memory.
[0048] The storage 33 stores a program 34. The program 34 includes computer-readable instructions for controlling the projector 1, the camera 2, and the distance measuring device 4. The processor 31 executes the program 34 to control the projector 1, the camera 2, and the distance measuring device 4, and realizes various processes according to the present embodiment.
[0049] The program 34 may be provided not as a standalone program but as part of an arbitrary program. In this case, the program 34 cooperates with the arbitrary program to realize the processing according to the present embodiment. Even if the program does not include some of the modules, it does not deviate from the spirit of the three-dimensional shape measuring device 100 according to the present embodiment. In addition, some or all of the functions provided by the program 34 may be realized by dedicated hardware.
[0050] The storage 33 further stores a table 35. The table 35 is used to control the period L of the stripe pattern projected by the projector 1.
[0051] <Phase shift method> The processor 31 measures the three-dimensional shape of the measurement target 300 using, for example, the principle of the phase shift method disclosed in Patent Document 4. Specifically, the processor 31 controls the projector 1 to project a stripe pattern while shifting the phase. The processor 31 acquires, from the camera 2, multiple captured images corresponding to multiple phase shift amounts of the stripe pattern. For example, the processor 31 acquires four captured images when the phase shift amounts are 0, π / 2, π, and 3π / 2.
[0052] The luminance value of each pixel in a plurality of captured images is expressed by the following formula (1). Ii=acos(φ+δi)+b Equation (1) Ii represents the luminance value in the i-th captured image. a represents the contrast component. b represents the offset component. δi represents the phase shift amount corresponding to the i-th captured image. φ represents the phase.
[0053] In equation (1), the unknowns are a, b, and φ. Therefore, the processor 31 can calculate a, b, and φ for each pixel by acquiring at least three captured images.
[0054] 4 is a diagram showing the luminance value and phase shift amount of a pixel in four captured images corresponding to phase shift amounts of 0, π / 2, π, and 3π / 2. The processor 31 calculates the phase φ by specifying a cosine curve 50 that approximates the luminance values and phase shift amounts of the four captured images. Specifically, assuming that the luminance value in the captured image corresponding to the phase shift amount 0 is I0, the luminance value in the captured image corresponding to the phase shift amount π / 2 is I1, the luminance value in the captured image corresponding to the phase shift amount π is I2, and the luminance value in the captured image corresponding to the phase shift amount 3π / 2 is I3, the phase φ is calculated according to the following formula (2). tanφ=-(I3-I1) / (I2-I0) Equation (2)
[0055] The phase φ and the height h of the measurement target 300 captured in the pixel satisfy the following formula (3). h=(p / sinα)×(φ+2nπ) / 2π Equation (3) p represents the pitch of the stripe pattern. α represents the projection angle of the stripe pattern. n represents the order. Processor 31 converts the phase φ into height h according to equation (3) and generates three-dimensional point cloud data indicating the height h for each pixel.
[0056] The luminance value of each pixel shown in the captured image may contain an error due to the influence of noise and the like of the camera 2. Hereinafter, the error contained in the luminance value will be referred to as a "luminance error."
[0057] FIG. 5 is a diagram for explaining the influence of luminance error on three-dimensional shape measurement. In FIG. 5, curve 52 is a cosine curve that approximates the luminance values and phase shift amounts in a plurality of captured images. Curve 52 is specified using luminance values that include luminance errors. In FIG. 5, curve 54 is a cosine curve that approximates ideal luminance values and phase shift amounts that do not include luminance errors. As shown in FIG. 5, a phase error Δφ occurs between curve 52 and curve 54 due to the influence of luminance errors. That is, the phase φ calculated from curve 52 includes the phase error Δφ.
[0058] Due to the influence of the phase error Δφ, an error also occurs in the height h converted from the phase φ. In the example shown in Fig. 5, a phase error Δφ of 10° is included, so the height h converted from the phase φ includes an error of 10 mm. In this way, an error also occurs in the height h due to the influence of the brightness error.
[0059] The larger the luminance error, the larger the phase error Δφ becomes, and as a result, the error contained in the height h converted from the phase φ also becomes larger.
[0060] In addition, when the amplitude of the luminance value when the phase shift amount is changed becomes smaller, the influence of the luminance error becomes relatively larger. As a result, the phase error Δφ becomes larger, and the error included in the height h converted from the phase φ also becomes larger. Hereinafter, the error in the height h is also referred to as the "measurement error."
[0061] The amplitude of the luminance value when the phase shift amount is changed correlates with the contrast of the stripe pattern in the captured image. When the contrast of the stripe pattern in the captured image decreases, the amplitude of the luminance value when the phase shift amount is changed decreases. The contrast of the stripe pattern in the captured image depends on the focusing degree of the projection optical system 13 with respect to the measurement object 300 and the focusing degree of the focusing optical system 22 with respect to the measurement object 300.
[0062] Fig. 6 is a diagram showing examples of captured images when the focus of the projection optical system and the focusing optical system with respect to the measurement object is changed. The upper part of Fig. 6 shows three captured images when the focus of the projection optical system 13 with respect to the measurement object 300 is changed while the focus of the focusing optical system 22 with respect to the measurement object 300 is kept in focus. The lower part of Fig. 6 shows three captured images when the focus of the focusing optical system 22 with respect to the measurement object 300 is changed while the focus of the projection optical system 13 with respect to the measurement object 300 is kept in focus.
[0063] 6, when the focusing degree of the focusing optical system 22 is low while the projection optical system 13 is focused on the measurement object 300, the contrast of both the stripe pattern and the measurement object 300 decreases. Therefore, when the focusing degree of the focusing optical system 22 is low, the measurement accuracy of the height h of the measurement object 300 may be significantly reduced. Therefore, as described above, the camera 2 of this embodiment is adjusted by the autofocus mechanism 23 so that the focus is on the measurement object 300. This suppresses the reduction in measurement accuracy caused by the reduction in the focusing degree of the focusing optical system 22 on the measurement object 300.
[0064] As shown in the upper part of FIG. 6, when the focusing degree of the projection optical system 13 is low while the focusing optical system 22 is focused on the measurement object 300, the contrast of the measurement object 300 does not decrease, but the contrast of the stripe pattern decreases. By applying an autofocus mechanism to the projection optical system 13, the decrease in the contrast of the stripe pattern is prevented. Alternatively, by applying the parallel light disclosed in Patent Document 5 to the projection optical system 13, the decrease in the contrast of the stripe pattern is also prevented. However, when the autofocus mechanism is applied to the projection optical system 13, the measurement time increases. Also, when the configuration disclosed in Patent Document 5 is applied to the projection optical system 13, it takes a long measurement time to measure a wide range because the parallel light is raster scanned. Therefore, the three-dimensional shape measuring device 100 according to the present embodiment fixes the focal length of the projection optical system 13 and changes the period L of the stripe pattern so as to minimize the effect of the decrease in the contrast of the stripe pattern. As a result, the increase in the measurement time is suppressed compared to when the autofocus mechanism or the configuration disclosed in Patent Document 5 is applied to the projection optical system 13.
[0065] Fig. 7 is a diagram showing the change in contrast of the stripe pattern in the captured image and the conversion accuracy from phase φ to height h versus the spatial frequency of the stripe pattern. In Fig. 7, line 60 shows the change in contrast of the stripe pattern in the captured image versus the spatial frequency of the stripe pattern. Line 60 represents the MTF (Modulation Transfer Function) characteristic. Line 62 shows the change in conversion accuracy from phase φ to height h versus the spatial frequency of the stripe pattern.
[0066] As shown in FIG. 7, in general, the higher the spatial frequency of the stripe pattern, the lower the contrast. In other words, the shorter the period L of the stripe pattern, the lower the contrast. Also, the higher the spatial frequency of the stripe pattern, the higher the accuracy of the conversion from phase φ to height h. In other words, the shorter the period L of the stripe pattern, the higher the accuracy of the conversion from phase φ to height h. This is because the right-hand side of the above equation (3) used for the conversion from phase φ to height h contains a coefficient of the pitch p of the stripe pattern.
[0067] 7, the decrease in contrast of the stripe pattern in the captured image due to a decrease in the focus of the projection optical system 13 on the measurement target 300 can be suppressed by lengthening the period L of the stripe pattern. However, if the period L of the stripe pattern is made too long, the accuracy of the conversion from phase φ to height h decreases, and as a result, the measurement accuracy of the three-dimensional shape decreases. Therefore, the three-dimensional shape measuring apparatus 100 according to this embodiment sets the period L of the stripe pattern so that the error in height h (measurement error) is as small as possible, taking into consideration both the decrease in contrast of the stripe pattern in the captured image and the accuracy of the conversion from phase φ to height h.
[0068] Fig. 8 is a diagram showing an example of the table. As shown in Fig. 8, table 35 associates each of a plurality of distances between the measurement target and projector 1 with a period candidate. The period candidate represents the period of a stripe pattern (for example, a stripe pattern on a DMD) generated in light modulation device 12. The period candidate is set in advance so as to minimize the measurement error when measuring the three-dimensional shape of measurement target 300 at a position away from projector 1 by the corresponding distance. First to third setting methods of period candidate will be described below.
[0069] (First setting method) 9 is a diagram illustrating a first setting method of period candidates. When setting a period candidate corresponding to a target distance among a plurality of distances, an object prepared for setting the table 35 is placed at a position away from the projector 1 by the target distance.
[0070] In the first step of the first setting method, the projection optical system 13 is adjusted so that the object is focused. As described above, the projector 1 has an inherent focal length. Therefore, the focus adjustment of the projection optical system 13 is performed manually. For example, the user may adjust the focus of the projection optical system 13 while changing the position or lens type of the projection optical system 13.
[0071] Next, with the projection optical system 13 focused on the object, the processor 31 controls the projector 1 to project a binary image 80. The binary image 80 includes dark and bright areas. The luminance is uniform in each of the dark and bright areas.
[0072] The processor 31 acquires a first reference image captured by the camera 2 when the binary image 80 is projected from the projector 1 with the object in focus. The first reference image is an example of a "second image." The processor 31 calculates the amplitude of the luminance in the first reference image (hereinafter referred to as "reference amplitude").
[0073] In the second step of the first setting method, the user returns the focus of the projection optical system 13 to a default state. This returns the projector 1 to a state in which it has a specific focal length. The processor 31 controls the projector 1 to sequentially project a plurality of stripe patterns having different periods L from each other. Furthermore, the processor 31 acquires a captured image captured by the camera 2 when each stripe pattern is projected onto an object placed at a position away from the projector 1 by the target distance. The captured image is an example of a first image. The processor 31 calculates the amplitude of the luminance in each captured image. Hereinafter, the amplitude of the luminance of the captured image is also referred to as the "amplitude of the captured image."
[0074] The processor 31 determines a periodic range of the stripe pattern in which the amplitude of the captured image is 50% or more of the reference amplitude. The processor 31 sets the shortest period within the determined periodic range as a period candidate corresponding to the target distance.
[0075] In this manner, period candidates are set for all of the multiple distances. As described with reference to FIG. 6, when the degree of focus of the projection optical system 13 on the object decreases, the contrast of the stripe pattern in the captured image decreases. That is, the greater the difference between the target distance among the multiple distances and the focal length of the projector 1, the lower the contrast of the stripe pattern in the captured image. As described with reference to FIG. 7, by lengthening the period L of the stripe pattern, the decrease in contrast due to the decrease in the degree of focus of the projection optical system 13 on the object is suppressed. However, if the period L is made too long, the accuracy of conversion from phase φ to height h decreases, so the shortest period of the period range of the stripe pattern in which the amplitude of the captured image is 50% or more of the reference amplitude is set as the period candidate. The period range of the stripe pattern in which the amplitude of the captured image is 50% or more of the reference amplitude shifts in the direction of increasing the period as the difference between the target distance and the focal length of the projector 1 increases. Therefore, in table 35, the period candidate is longer as the difference between the corresponding distance and the focal length increases.
[0076] (Second setting method) 10 is a diagram illustrating a second setting method of period candidates. As in the first setting method, when setting a period candidate corresponding to a target distance among a plurality of distances, an object prepared for setting the table 35 is placed at a position away from the projector 1 by the target distance.
[0077] In a first step of the second setting method, the processor 31 controls the projector 1 to project a uniform pattern 82. The uniform pattern 82 is a pattern in which the brightness is uniform across the entire area. The processor 31 acquires a second reference image captured by the camera 2 when the uniform pattern 82 is projected. The second reference image is an example of a "second image." The processor 31 calculates the brightness variation in the second reference image. The brightness variation is represented by, for example, the difference between the minimum brightness value and the maximum brightness value. The brightness variation is also called noise.
[0078] In a second step of the second setting method, the processor 31 controls the projector 1 to sequentially project a plurality of stripe patterns having different periods L from each other. Furthermore, the processor 31 acquires a captured image captured by the camera 2 when each stripe pattern is projected onto an object placed at a position the target distance away from the projector 1. The captured image is an example of a first image. The processor 31 calculates the amplitude of the luminance of each captured image. Hereinafter, the amplitude of the luminance of the captured image is also referred to as the "amplitude of the captured image."
[0079] The processor 31 determines a periodic range of the stripe pattern in which the amplitude of the captured image is 10 times or more the luminance variation. The processor 31 sets the shortest period within the determined periodic range as a period candidate corresponding to the target distance.
[0080] As described with reference to FIG. 5, when the contrast of the stripe pattern in the captured image decreases, the influence of the brightness error becomes relatively large. The brightness variation calculated in the first step is proportional to the brightness error. Therefore, by determining the periodic range of the stripe pattern in which the amplitude of the captured image is 10 times or more the brightness variation, the influence of the brightness error on the contrast of the stripe pattern of the period within the determined periodic range becomes small. However, if the period L is made too long, the accuracy of conversion from phase φ to height h decreases, so the shortest period within the periodic range is set as the period candidate.
[0081] As described with reference to FIG. 6, when the degree of focus of the projection optical system 13 on the object decreases, the contrast of the stripe pattern in the captured image decreases. That is, the greater the difference between the target distance among the multiple distances and the focal length of the projector 1, the greater the contrast of the stripe pattern in the captured image. However, as described with reference to FIG. 7, by lengthening the period L of the stripe pattern, the decrease in contrast caused by the decrease in the degree of focus of the projection optical system 13 on the object is suppressed. Therefore, the period range of the stripe pattern in which the amplitude of the captured image is 10 times or more the brightness variation shifts in the direction of increasing the period as the difference between the target distance and the focal length of the projector 1 increases. Therefore, in table 35, the greater the difference between the corresponding distance and the focal length, the longer the period candidate is.
[0082] (Third setting method) 11 is a diagram illustrating a third setting method of period candidates. As in the first setting method, when setting a period candidate corresponding to a target distance among a plurality of distances, an object prepared for setting the table 35 is placed at a position away from the projector 1 by the target distance.
[0083] The first step of the third setting method is the same as the first step of the first setting method. By executing the first step, the processor 31 calculates the reference amplitude.
[0084] In the second step of the third setting method, the user returns the focus of the projection optical system 13 to the default state. This returns the projector 1 to a state having a specific focal length. The processor 31 then controls the projector 1 to project a square wave pattern 84. The square wave pattern 84 is a pattern in which dark areas and bright areas are alternately repeated. The luminance is uniform in each of the dark areas and bright areas.
[0085] The processor 31 acquires a captured image 86 captured by the camera 2 when a square wave pattern 84 is projected onto an object placed at a position the target distance away from the projector 1. The captured image 86 is an example of a "first image."
[0086] In the third step of the third setting method, the processor 31 performs a Fourier transform on the captured image 86. By performing a Fourier transform on the captured image 86, a correlation between the periodic component and the amplitude is obtained. The correlation between the period L of the stripe pattern and the amplitude is corresponding to the correlation between the period L and the amplitude obtained in the second step of the first setting method. Therefore, the processor 31 determines a periodic component range corresponding to an amplitude equal to or greater than 50% (threshold Th) of the reference amplitude from the correlation between the periodic component and the amplitude. The processor 31 sets the shortest periodic component within the determined periodic range as a period candidate.
[0087] In this way, period candidates are set for all of the multiple distances. According to the third setting method, the shortest period component in the period component range where the amplitude is 50% or more of the reference amplitude is set as the period candidate. As in the first setting method, the period component range where the amplitude is 50% or more of the reference amplitude shifts in the direction in which the periodic component becomes longer as the difference between the target distance and the focal length of the projector 1 increases. Therefore, in table 35, the greater the difference between the corresponding distance and the focal length, the longer the period candidate is.
[0088] According to the third setting method, it is not necessary to sequentially project a plurality of stripe patterns having different periods L. Therefore, the third setting method can create table 35 with fewer steps compared to the first setting method.
[0089] <How to control the projector> The method of controlling projector 1 by processor 31 includes a step of creating table 35 according to any one of the above-mentioned first to third setting methods. Creating table 35. After table 35 is created, processor 31 controls projector 1 according to the flowchart shown in FIG.
[0090] 12 is a flowchart showing the flow of a method for controlling a projector by a processor. In step S1, processor 31 acquires a measured distance from distance measuring device 4. In the next step S2, processor 31 changes the period L of the sinusoidal stripe pattern projected by projector 1 according to the measured distance.
[0091] Step S2 includes steps S21 and S22. In step S21, processor 31 reads out a period candidate corresponding to the measured distance from table 35 that associates each of a plurality of distances between the measurement target and projector 1 with the period candidate. In the next step S22, processor 31 sets period L of the stripe pattern based on the read period candidate.
[0092] For example, if a distance whose difference from the measured distance is within a specified range is present in table 35, processor 31 reads out a period candidate corresponding to that distance, and sets the read period candidate as the stripe pattern period L. If a distance whose difference from the measured distance is within a specified range is not present in table 35, processor 31 reads out two period candidates corresponding to two distances whose differences from the measured distance are small, and sets the stripe pattern period L by an interpolation calculation using the two read period candidates.
[0093] <Variation 1> The above-described first and second setting methods use captured images obtained by the camera 2. However, the first and second setting methods may set period candidates based on the luminance values of projected images at positions spaced a corresponding distance away, instead of the captured images.
[0094] 13 is a diagram showing a hardware configuration of a three-dimensional shape measuring device according to Modification 1. Three-dimensional shape measuring device 100A according to Modification 1 differs from three-dimensional shape measuring device 100 in that it includes a luminance measuring device 5.
[0095] The luminance meter 5 measures the luminance of the incident light. The luminance meter 5 is movable so that the distance from the projector 1 can be changed. The luminance meter 5 includes, for example, a photodiode or an optical power meter.
[0096] (First setting method according to modified example 1) In the first setting method according to the first modification, the luminance measuring device 5 is placed at a position that is the target distance away from the projector 1.
[0097] In a first step of the first setting method according to the first modification, the projection optical system 13 is adjusted so as to be focused on the luminance measuring device 5. Next, with the projection optical system 13 focused on the luminance measuring device 5, the processor 31 controls the projector 1 to project the binary image 80 while moving it.
[0098] The processor 31 calculates, as a reference amplitude, the amplitude of the luminance measured by the luminance meter 5 when the binary image 80 is projected while being moved with the luminance meter 5 focused.
[0099] In the second step of the first setting method according to the first modification, the user returns the focus of the projection optical system 13 to a default state. This returns the projector 1 to a state in which it has a specific focal length. The processor 31 controls the projector 1 to sequentially project a plurality of stripe patterns having different periods L from each other. Furthermore, the processor 31 calculates the amplitude of the luminance measured by the luminance meter 5 placed at a position the target distance away from the projector 1 when each stripe pattern is projected while being moved.
[0100] The processor 31 determines a periodic range of the stripe pattern in which the amplitude is 50% or more of the reference amplitude, and sets the shortest period within the determined periodic range as a period candidate corresponding to the target distance.
[0101] Even with the first setting method according to the first modification, the periodic range of the stripe pattern in which the amplitude is 50% or more of the reference amplitude shifts in the direction in which the period becomes longer as the difference between the target distance and the focal length of the projector 1 increases. Therefore, in table 35, the larger the difference between the corresponding distance and the focal length, the longer the period candidate becomes.
[0102] (Second setting method according to modified example 1) In the second setting method according to the first modification, the luminance measuring device 5 is placed at a position that is the target distance away from the projector 1.
[0103] In a first step of the second setting method according to the first modification, the processor 31 controls the projector 1 to project while moving the uniform pattern 82. The processor 31 calculates the luminance variation measured by the luminance meter 5 when the uniform pattern is projected while being moved.
[0104] In a second step of the second setting method according to the first modification, the processor 31 controls the projector 1 to sequentially project, while moving, a plurality of stripe patterns having different periods L. Furthermore, the processor 31 calculates the amplitude of the luminance measured by the luminance meter 5 placed at a position the target distance away from the projector 1 when each stripe pattern is projected while being moved.
[0105] The processor 31 determines a periodic range of the stripe pattern in which the amplitude of the luminance is 10 times or more the luminance variation. The processor 31 sets the shortest period within the determined periodic range as a period candidate corresponding to the target distance.
[0106] Even with the second setting method according to the first modification, the periodic range of the stripe pattern in which the luminance amplitude is 10 times or more the luminance variation shifts in the direction in which the period becomes longer as the difference between the target distance and the focal length of the projector 1 increases. Therefore, in table 35, the larger the difference between the corresponding distance and the focal length, the longer the period candidate becomes.
[0107] According to the three-dimensional shape measuring device 100A of the first modification, when setting period candidates on the table 35, it is not necessary to extract luminance from the image captured by the camera 2. This reduces the number of steps.
[0108] <Variation 2> In the above description, the three-dimensional shape measuring device 100 uses the camera 2 including the autofocus mechanism 23. However, the three-dimensional shape measuring device is not limited to a configuration including the camera 2 including the autofocus mechanism 23.
[0109] 14 is a diagram showing a hardware configuration of a three-dimensional shape measuring device according to Modification 2. Three-dimensional shape measuring device 100B according to Modification 2 differs from three-dimensional shape measuring device 100 in that it includes multiple cameras 2B instead of camera 2.
[0110] Each of the multiple cameras 2B differs from the camera 2 in that it does not include an autofocus mechanism 23. That is, each of the multiple cameras 2B has its own focal length. However, the focal lengths of the multiple cameras 2B are different from one another.
[0111] Processor 31 selects a specific camera from among the multiple cameras 2B that has the highest degree of focus on measurement object 300, and measures the three-dimensional shape using an image captured by the specific camera. Specifically, processor 31 may select camera 2B having a focal length closest to the measurement distance obtained from distance measuring device 4 as the specific camera. In this way, camera 2B adjusted to focus on measurement object 300 is used.
[0112] <Modification 3> The three-dimensional shape measuring device does not need to include the distance measuring device 4. In this case, the processor 31 may use the principle of the phase shift method to measure the distance (measured distance) between the projector 1 and the measurement object 300 based on a plurality of captured images obtained by the camera 2 when a plurality of stripe patterns with different phases are projected onto the measurement object 300. In other words, the processor 31 operates as a distance measuring unit that measures the distance between the measurement object 300 and the projector 1. This allows the cost required for the distance measuring device 4 to be reduced.
[0113] Since the measurement distance is unknown, the processor 31 causes the projector 1 to project a stripe pattern having a default period. The accuracy of the measurement distance is low because it is highly likely that the period does not correspond to the distance to the measurement target 300. However, by changing the period L of the stripe pattern according to the measurement distance, the measurement accuracy of the three-dimensional shape is improved compared to when a stripe pattern with a default period is used.
[0114] 15 is a diagram showing an example of a captured image. The processor 31 may calculate the measured distance by using a partial range 72 of the captured image 70 that includes pixels that represent the luminance of the optical axis of the projector 1. The partial range 72 has a length equivalent to one period of the stripe pattern.
[0115] The further away the light is from the optical axis of the projector 1, the more susceptible it is to the effect of lens distortion. Therefore, by calculating the measured distance using a portion of range 72 that includes the pixels that represent the brightness of the optical axis, the accuracy of the measured distance is improved.
[0116] <Modification 4> The stripe pattern is not limited to a sine wave pattern, and may be, for example, a pattern obtained by combining a plurality of sine waves, a sine wave pattern with partially changed frequency, or a step wave pattern.
[0117] <Additional Notes> As described above, the present embodiment includes the following disclosure.
[0118] [Configuration 1] A three-dimensional shape measuring device, A camera adjusted to focus on the measurement target, a projector that projects a stripe pattern; A three-dimensional shape measuring device, wherein the period of the stripe pattern projected by the projector is variable.
[0119] [Configuration 2] 2. The three-dimensional shape measuring device according to configuration 1, wherein a period of the stripe pattern is set according to a measurement distance between the measurement object and the projector.
[0120] [Configuration 3] 3. The three-dimensional shape measuring device according to configuration 2, wherein the period of the stripe pattern is set based on a table that associates each of a plurality of distances between the measurement target and the projector with period candidates.
[0121] [Configuration 4] the projector has a unique focal length; In the table, the period candidates are set so that an amplitude of a first image captured by the camera when the stripe pattern is projected onto an object placed at a position a corresponding one of the plurality of distances away from the projector has 50% or more of an amplitude of a second image captured by the camera when a focused binary image is projected onto the object; 4. The three-dimensional shape measuring apparatus according to configuration 3, wherein the period candidate is longer as the difference between the corresponding distance and the focal length is larger.
[0122] [Configuration 5] the projector has a unique focal length; In the table, the period candidates are set so that an amplitude of a first image captured by the camera when the stripe pattern is projected onto an object placed at a position a corresponding one of the plurality of distances away from the projector has 10 times or more a luminance variation of a second image captured by the camera when a uniform pattern is projected onto the object; 4. The three-dimensional shape measuring apparatus according to configuration 3, wherein the period candidate is longer as the difference between the corresponding distance and the focal length is larger.
[0123] [Configuration 6] the projector has a unique focal length; In the table, the periodicity candidate is set to a periodicity component corresponding to 50% or more of the amplitude of a second image captured by the camera when a focused binary image is projected onto the object, in a correlation between the periodicity component and the amplitude obtained by Fourier transforming a first image captured by the camera when a rectangular wave pattern is projected onto the object, the first image being captured by the camera when a square wave pattern is projected onto the object, the periodicity component corresponding to 50% or more of the amplitude of a second image captured by the camera when a focused binary image is projected onto the object, 4. The three-dimensional shape measuring apparatus according to configuration 3, wherein the period candidate is longer as the difference between the corresponding distance and the focal length is larger.
[0124] [Configuration 7] the projector has a unique focal length; In the table, the period candidate is set so that an amplitude of a first luminance measured by a luminance meter placed at a position a corresponding one of the plurality of distances away from the projector when the stripe pattern is projected while being moved onto the luminance meter is 50% or more of an amplitude of a second luminance measured by the luminance meter when a binary image in focus is projected onto the luminance meter while being moved; 4. The three-dimensional shape measuring apparatus according to configuration 3, wherein the period candidate is longer as the difference between the corresponding distance and the focal length is larger.
[0125] [Configuration 8] the projector has a unique focal length; In the table, the period candidates are set so that an amplitude of a first luminance measured by a luminance measuring device placed at a position a corresponding one of the plurality of distances away from the three-dimensional shape measuring device when the stripe pattern is projected while being moved is ten times or more than a variation in a second luminance measured by the luminance measuring device when a uniform pattern is projected onto the luminance measuring device while being moved; 4. The three-dimensional shape measuring apparatus according to configuration 3, wherein the period candidate is longer as the difference between the corresponding distance and the focal length is larger.
[0126] [Configuration 9] 8. The three-dimensional shape measuring device according to any one of configurations 2 to 7, further comprising a distance measuring device that measures the measurement distance.
[0127] [Configuration 10] the distance measuring device measures a distance between a part of the range of the measurement target and the projector as the measurement distance; 10. The three-dimensional shape measuring apparatus according to configuration 9, wherein the partial range has a length equivalent to one period of the stripe pattern projected onto the measurement object.
[0128] [Configuration 11] The three-dimensional shape measuring device according to any one of configurations 2 to 7, further comprising a distance measuring unit that measures the measurement distance based on a plurality of images obtained from the camera when a plurality of stripe patterns with different phases are projected onto the measurement object.
[0129] [Configuration 12] the distance measurement unit measures the measured distance using a partial range including a pixel representing a luminance of an optical axis of the projector in each of the plurality of images; 12. The three-dimensional shape measuring apparatus according to claim 11, wherein the partial range has a length equivalent to one period of the stripe pattern projected onto the measurement object.
[0130] [Configuration 13] 13. The three-dimensional shape measuring device according to any one of configurations 1 to 12, wherein the camera has an autofocus mechanism and is adjusted by the autofocus mechanism to focus on the measurement target.
[0131] [Configuration 14] Equipped with multiple cameras with different focal lengths, 13. The three-dimensional shape measuring device according to any one of configurations 1 to 12, wherein a specific camera that has the highest degree of focus on the measurement target is selected as the camera from among the plurality of cameras.
[0132] [Configuration 15] 15. The three-dimensional shape measuring device according to any one of configurations 1 to 14, wherein the stripe pattern is sinusoidal.
[0133] [Configuration 16] A method for controlling a projector used for three-dimensional shape measurement, comprising the steps of: Obtaining a measured distance between a measurement target and the projector; and changing a period of a stripe pattern projected by the projector in accordance with the measured distance.
[0134] [Configuration 17] Changing the period of the stripe pattern includes: reading out a period candidate corresponding to the measurement distance from a table in which each of a plurality of distances between the measurement target and the projector is associated with a period candidate; 17. The control method according to claim 16, further comprising: setting a period of the stripe pattern based on the read period candidate.
[0135] [Configuration 18] the projector has a fixed focal length; The control method further comprises creating the table, Creating the table includes, for each of the plurality of distances: determining a periodic range of the stripe pattern such that, when the stripe pattern is projected onto an object placed at a position away from the projector by the projector, the amplitude of a first image captured by a camera used for the three-dimensional shape measurement is 50% or more of the amplitude of a second image captured by the camera when a focused binary image is projected onto the object; 18. The control method according to claim 17, further comprising: setting the shortest period within the period range as the period candidate.
[0136] [Configuration 19] the projector has a fixed focal length; The control method further comprises creating the table, Creating the table includes, for each of the plurality of distances: determining a periodic range of the stripe pattern such that, when the stripe pattern is projected onto an object placed at a position away from the projector by the projector, the amplitude of a first image captured by a camera used for the three-dimensional shape measurement is 10 times or more the luminance variation of a second image captured by the camera when a uniform pattern is projected onto the object; 18. The control method according to claim 17, further comprising: setting the shortest period within the period range as the period candidate.
[0137] [Configuration 20] A program for causing a computer to execute the control method according to any one of configurations 17 to 19.
[0138] The embodiments disclosed herein should be considered to be illustrative and not restrictive in all respects. The scope of the present invention is defined by the claims, not the above description, and is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]
[0139] 1 projector, 2,2B camera, 3 computer, 4 distance measuring device, 5 luminance measuring device, 11 light source, 12 light modulation device, 13 projection optical system, 21 image sensor, 22 light collection optical system, 23 autofocus mechanism, 31 processor, 32 memory, 33 storage, 34 program, 35 table, 50 cosine curve, 52,54 curve, 60,62 line, 70,86 captured image, 72,306 range, 80 binary image, 82 uniform pattern, 84 rectangular wave pattern, 100,100A,100B three-dimensional shape measuring device, 200 robot, 300 measurement target, 302 tray, 304 workpiece, 500 conveyor belt, 1000 system.
Claims
1. A three-dimensional shape measuring device, A camera adjusted to focus on the measurement target, a projector that projects a stripe pattern; A three-dimensional shape measuring apparatus, wherein the period of the stripe pattern projected by the projector is variable.
2. The three-dimensional shape measuring apparatus according to claim 1 , wherein a period of the stripe pattern is set in accordance with a measurement distance between the measurement object and the projector.
3. The three-dimensional shape measuring device according to claim 2 , wherein the period of the stripe pattern is set based on a table in which each of a plurality of distances between the measurement target and the projector is associated with a period candidate.
4. the projector has a unique focal length; In the table, the period candidates are set so that an amplitude of a first image captured by the camera when the stripe pattern is projected onto an object placed at a position a corresponding one of the plurality of distances away from the projector has 50% or more of an amplitude of a second image captured by the camera when a binary image focused on the object is projected; The three-dimensional shape measuring apparatus according to claim 3 , wherein the period candidate is longer as the difference between the corresponding distance and the focal length increases.
5. the projector has a unique focal length; In the table, the period candidates are set so that an amplitude of a first image captured by the camera when the stripe pattern is projected onto an object placed at a position a corresponding one of the plurality of distances from the projector has 10 times or more a luminance variation of a second image captured by the camera when a uniform pattern is projected onto the object; The three-dimensional shape measuring apparatus according to claim 3 , wherein the period candidate is longer as the difference between the corresponding distance and the focal length increases.
6. the projector has a unique focal length; In the table, the periodic candidate is set to a periodic component corresponding to 50% or more of the amplitude of a second image captured by the camera when a focused binary image is projected onto the object, in a correlation between the periodic component and the amplitude obtained by Fourier transforming a first image captured by the camera when a rectangular wave pattern is projected onto the object, the first image being captured by the camera when a rectangular wave pattern is projected onto the object, the periodic component corresponding to 50% or more of the amplitude of a second image captured by the camera when a focused binary image is projected onto the object, The three-dimensional shape measuring apparatus according to claim 3 , wherein the period candidate is longer as the difference between the corresponding distance and the focal length increases.
7. the projector has a unique focal length; In the table, the period candidate is set so that an amplitude of a first luminance measured by a luminance meter placed at a position a corresponding one of the plurality of distances away from the projector when the stripe pattern is projected while being moved onto the luminance meter is 50% or more of an amplitude of a second luminance measured by the luminance meter when a binary image in focus is projected onto the luminance meter while being moved, The three-dimensional shape measuring apparatus according to claim 3 , wherein the period candidate is longer as the difference between the corresponding distance and the focal length increases.
8. the projector has a unique focal length; In the table, the period candidate is set so that an amplitude of a first luminance measured by a luminance measuring device placed at a position a corresponding one of the plurality of distances away from the three-dimensional shape measuring device when the stripe pattern is projected while being moved is ten times or more than a variation in a second luminance measured by the luminance measuring device when a uniform pattern is projected onto the luminance measuring device while being moved; The three-dimensional shape measuring apparatus according to claim 3 , wherein the period candidate is longer as the difference between the corresponding distance and the focal length increases.
9. The three-dimensional shape measuring apparatus according to claim 2 , further comprising a distance measuring device that measures the measurement distance.
10. the distance measuring device measures a distance between a part of the range of the measurement target and the projector as the measurement distance; The three-dimensional shape measuring apparatus according to claim 9 , wherein the partial range has a length equivalent to one period of the stripe pattern projected onto the measurement target.
11. The three-dimensional shape measuring device according to claim 2 , further comprising a distance measuring unit that measures the measurement distance based on a plurality of images obtained by the camera when a plurality of stripe patterns with different phases are projected onto the measurement object.
12. the distance measurement unit measures the measured distance using a partial range including a pixel representing a luminance of an optical axis of the projector in each of the plurality of images; The three-dimensional shape measuring apparatus according to claim 11 , wherein the partial range has a length equivalent to one period of the stripe pattern projected onto the measurement target.
13. The three-dimensional shape measuring device according to claim 1 , wherein the camera has an autofocus mechanism, and is adjusted so as to be in focus on the measurement target by the autofocus mechanism.
14. Equipped with multiple cameras with different focal lengths, The three-dimensional shape measuring apparatus according to claim 1 , wherein a specific camera having the highest degree of focus on the measurement target is selected as the camera from among the plurality of cameras.
15. The three-dimensional shape measuring apparatus according to claim 1 , wherein the stripe pattern is sinusoidal.
16. A method for controlling a projector used for three-dimensional shape measurement, comprising the steps of: Obtaining a measured distance between a measurement target and the projector; and changing a period of a stripe pattern projected by the projector in accordance with the measured distance.
17. Changing the period of the stripe pattern includes: reading out a period candidate corresponding to the measurement distance from a table in which each of a plurality of distances between the measurement target and the projector is associated with a period candidate; The control method according to claim 16 , further comprising: setting a period of the stripe pattern based on the read period candidate.
18. the projector has a fixed focal length; The control method further comprises creating the table, Creating the table includes, for each of the plurality of distances: determining a periodic range of the stripe pattern such that, when the stripe pattern is projected onto an object placed at a position away from the projector by the projector, the amplitude of a first image captured by a camera used for the three-dimensional shape measurement is 50% or more of the amplitude of a second image captured by the camera when a binary image focused on the object is projected; The control method according to claim 17 , further comprising: setting a shortest period within the period range as the period candidate.
19. the projector has a fixed focal length; The control method further comprises creating the table, Creating the table includes, for each of the plurality of distances: determining a periodic range of the stripe pattern such that, when the stripe pattern is projected onto an object placed at a position away from the projector by the projector, the amplitude of a first image captured by a camera used for the three-dimensional shape measurement is 10 times or more the luminance variation of a second image captured by the camera when a uniform pattern is projected onto the object; The control method according to claim 17 , further comprising: setting a shortest period within the period range as the period candidate.
20. A program causing a computer to execute the control method according to any one of claims 17 to 19.
Citation Information
Patent Citations
Three-dimensional shape measuring method and its apparatus
JP2005214653A
Three-dimensional shape measuring instrument, method for controlling three-dimensional shape measuring instrument, and program
JP2013088261A
Control system, robot system, and control method
JP2016031284A
Measurement device, measurement method, and robot
JP2018146521A
Three-dimensional shape measuring device and three-dimensional shape measuring method
JP2021085797A
