3D shape measuring device
The device addresses measurement errors in three-dimensional shape measurement by controlling and correcting light source intensity using a projection control section and illuminance sensor, ensuring consistent performance across varying environments.
Patent Information
- Application Number
- JP2024533205
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-12-06
- Filing Date
- 2023-12-04
- Publication Date
- 2024-12-04
- Estimated Expiration
- 2043-12-04
AI Technical Summary
Existing three-dimensional shape measuring devices using multiple light sources are prone to errors in shape measurement due to changes in light source characteristics caused by variations in the usage environment, such as temperature fluctuations.
A three-dimensional shape measuring device with a projection control section that adjusts the lighting and radiation intensity of multiple light sources, equipped with a striped pattern forming optical element and an illuminance sensor to detect and correct intensity changes, ensuring consistent light source performance.
The device effectively prevents large errors in three-dimensional shape measurement by adjusting light source characteristics, maintaining accuracy despite environmental changes.
Smart Images

Figure 0007594264000001 
Figure 0007594264000002 
Figure 0007594264000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a three-dimensional shape measuring device using a phase shift method. [Background technology]
[0002] A three-dimensional shape measuring device using a phase shift method is known as a device for measuring the three-dimensional shape of an object in a non-contact manner. In this three-dimensional shape measuring device, a process in which a sinusoidally varying stripe pattern is projected onto the surface of the object by a projection unit and then photographed by a photographing unit is carried out by sequentially shifting the phase of the stripe pattern by a predetermined angle (e.g., π / 2 or 2π / 3) to obtain a set of photographed images (e.g., four or three). Then, the set of photographed images is subjected to image processing to measure the three-dimensional shape of the object.
[0003] Here, as the projection unit, there are known ones that use a projector as described in Patent Document 1, for example, and ones that use a plurality of light sources arranged in a row and a stripe pattern forming optical element that passes the light from the light sources in a stripe pattern as described in Patent Document 2, for example. Compared to the former, the latter is capable of high-speed projection of a phase-shifted stripe pattern and also allows for lower power consumption and miniaturization. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2008-281491 A [Patent Document 2] JP 2011-242178 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, in the case of using multiple light sources as described in Patent Document 2, there are many cases where differences in the characteristics of the light sources change due to changes in the usage environment (for example, temperature changes during sequential measurement of many objects, etc.) If differences in the changes in the radiant intensity of the light from the light sources occur between the light sources, errors in the measurement of the three-dimensional shape become large.
[0006] The present invention has been made in consideration of the above-mentioned circumstances, and its object is to provide a three-dimensional shape measurement device that uses multiple light sources arranged in a row in a projection device and a stripe pattern forming optical element that passes the light from the light sources in a stripe pattern, which can prevent large errors in the measurement of three-dimensional shapes even if differences occur in the changes in the characteristics of the light sources between the light sources due to changes in the usage environment. [Means for solving the problem]
[0007] In order to achieve the above object, a three-dimensional shape measuring device according to an embodiment of the present invention includes a projection control unit, a projection unit which has a plurality of light sources arranged in a row, each of which has its lighting and light radiation intensity controlled by the projection control unit, and a stripe pattern forming optical element which passes the light from the light sources in a stripe pattern, and which projects a stripe pattern onto an article, the phase of which is shifted by a predetermined angle by each of the plurality of light sources being sequentially lit, an imaging unit which images the article onto which each of the stripe patterns is projected, to obtain a set of captured images, and which performs image processing on the set of captured images; and An illuminance sensor is attached to the light source side in the peripheral portion of the stripe pattern forming optical element, and the illuminance detected by the illuminance sensor is used to measure the number of articles in sequence. A change in the radiation intensity of each of the plurality of light sources is detected, and the radiation intensity of each of the plurality of light sources is calculated. To be within the reference range and a three-dimensional shape measurement processing unit for adjusting the three-dimensional shape of the object. do. Effect of the Invention
[0008] According to the three-dimensional shape measuring device of the present invention, even if differences occur between light sources in changes in the characteristics of the light sources due to changes in the usage environment, it is possible to prevent errors in the measurement of the three-dimensional shape from becoming large. [Brief description of the drawings]
[0009] [Figure 1] 1 is a plan view showing an outline of a three-dimensional shape measuring device according to an embodiment of the present invention. [Diagram 2] FIG. 4 is a waveform diagram showing a simplified timing of projection and photography of the three-dimensional shape measuring device of the above. [Diagram 3] 1A shows the components that make up the projection unit in the above-mentioned 3D shape measuring device, where (a) is a front view of multiple light sources, and (b) is a front view of the projection unit case that houses multiple light sources and a stripe pattern forming optical element. [Figure 4] 4 is a circuit diagram of a plurality of light sources of a projection unit in the three-dimensional shape measuring device of the same embodiment. FIG. [Diagram 5] 11A and 11B are planar cross-sectional views taken horizontally near the vertical center of a stripe pattern forming optical element in the above-mentioned 3D shape measuring device, in which (a) is an example in which a plurality of transparent parts are formed in a regular stripe pattern, and (b) is an example in which a plurality of cylindrical lenses are formed in a regular pattern. [Figure 6] 4 is a photograph showing an example of a set of images captured by the above-mentioned three-dimensional shape measuring device. [Figure 7] FIG. 13 is a plan view showing an outline of a modified example of the three-dimensional shape measuring device of the above. [Figure 8] 13 is a front view of a projection unit case accommodating a plurality of light sources and a stripe pattern forming optical element in a modified example of the three-dimensional shape measuring device of the above embodiment. FIG. [Figure 9] FIG. 2 is a block diagram showing a three-dimensional shape measurement processing unit of the three-dimensional shape measuring device implemented by a computer. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, an embodiment of the present invention will be described. As shown in Fig. 1, a three-dimensional shape measuring device 1 according to an embodiment of the present invention includes a projection control unit 2, a projection unit 3, an imaging unit 4, and a three-dimensional shape measurement processing unit 5. The three-dimensional shape measuring device 1 measures the three-dimensional shape of an object M using a phase shift method. Note that the solid lines (and dashed lines) with arrows between each unit in Fig. 1 (and Fig. 7) are schematic representations of each control signal, etc.
[0011] The projection control unit 2 controls the lighting and light radiation intensity of each of a plurality of light sources 31A, 31B, 31C, and 31D (described later) of the projection unit 3. The number of light sources is not particularly limited, but can be four or three, etc. In this embodiment, the number of light sources is four unless otherwise specified.
[0012] In detail, as shown in FIG. 2, during a projection period Ta synchronized with a synchronization signal SY, a current I is sequentially supplied to each of the plurality of light sources 31A, 31B, 31C, and 31D. A , I B , I C , I D (See FIG. 4) is supplied to emit light. The projection period Ta has a preset length. A PWM pulse current can be used to supply the current. The PWM period Tb has a preset length. The PWM pulse width Tc A , Tc B , Tc C , Tc D can be controlled for each of the light sources 31A, 31B, 31C, and 31D, and the wider the width, the higher the light radiation intensity becomes, and the narrower the width, the lower the light radiation intensity becomes. The projection period Ta is synchronized with the exposure period Td (signal EX in FIG. 2 indicates the timing of exposure) in the image capture unit 4. Also, in FIG. 2, the above-mentioned period Tb and pulse width Tc A , Tc B , Tc C , Tc D is enlarged for ease of understanding.
[0013] The projection unit 3 has a plurality of (four in this embodiment) light sources 31A, 31B, 31C, and 31D and a stripe pattern forming optical element 32. The plurality of light sources 31A, 31B, 31C, and 31D and the stripe pattern forming optical element 32 can be housed in a projection unit case 33.
[0014] The light sources 31A, 31B, 31C, and 31D are arranged in a row (horizontally). Each of the light sources 31A, 31B, 31C, and 31D can be composed of a plurality of light-emitting elements 310 (six in this embodiment) arranged in a row in the vertical direction, as shown in Fig. 3(a). The light-emitting elements 310 are connected in parallel or in series, or in a combination thereof, in terms of a circuit. For example, as shown in Fig. 4, the light sources 31A, 31B, 31C, and 31D can all be connected in series.
[0015] In Fig. 4, reference numeral 311 denotes a resistor for limiting current. Reference numerals 31Aa, 31Ba, 31Ca, and 31Da denote current inflow terminals, and reference numerals 31Ab, 31Bb, 31Cb, and 31Db denote current outflow terminals. It is possible to combine a plurality of current inflow terminals 31Aa, 31Ba, 31Ca, and 31Da and current outflow terminals 31Ab, 31Bb, 31Cb, and 31Db into one common terminal.
[0016] The stripe pattern forming optical element 32 passes light from the multiple light sources 31A, 31B, 31C, and 31D in a stripe pattern. As shown in FIG. 3(b) and FIG. 5(a), the stripe pattern forming optical element 32 has multiple transparent parts 32a regularly formed in a striped pattern (grid pattern). The multiple transparent parts 32a pass light from the multiple light sources 31A, 31B, 31C, and 31D. The area other than the multiple transparent parts 32a is a shielding part 32b that does not transmit light. In this embodiment, the stripe pattern forming optical element 32 is disposed close to the rear of the front surface of the projection unit case 33, and an opening 33a is formed in the front surface of the projection unit case 33. The light that passes through the multiple transparent parts 32a of the stripe pattern forming optical element 32 is emitted to the outside of the projection unit 3 through the opening 33a. In addition, in FIG. 3(b) and FIG. 5(a) (and FIG. 8), the shielded portion 32b of the stripe pattern forming optical element 32 is painted black for ease of understanding.
[0017] The stripe pattern forming optical element 32 may have a plurality of transparent portions 32a regularly arranged in stripes, or may have a plurality of cylindrical lenses 32c regularly arranged as shown in Fig. 5(b). Each of the plurality of cylindrical lenses 32c is a convex lens that refracts and collects light and radiates it to the outside. As a result, the light that passes through the stripe pattern forming optical element 32 becomes a stripe pattern. In the stripe pattern forming optical element 32 having such cylindrical lenses 32c, all light is transmitted, so the amount of emitted light can be increased.
[0018] In such a projection unit 3, the multiple light sources 31A, 31B, 31C, 31D are sequentially turned on to project stripe patterns P1, P2, P3, P4, the phase of which is sequentially shifted by a predetermined angle, onto the article M. The stripe patterns P1, P2, P3, P4 emitted from the projection unit 3 have light radiation intensity that changes in a sinusoidal manner. In this embodiment, the predetermined angle of the phase shift is π / 2. If the number of light sources is three, the predetermined angle is 2π / 3.
[0019] The operation of the projection unit 3 is simply to sequentially light up the multiple light sources 31A, 31B, 31C, and 31D, so that it is possible to project a phase-shifted stripe pattern at high speed, and it is also possible to reduce power consumption and make the unit compact. This compact size allows the projection unit 3 to be easily housed in a single housing 1a together with the photographing unit 4, which will be described next, as shown in Figure 1. Note that in Figure 1, the projection control unit 2 and the three-dimensional shape measurement processing unit 5, which are not housed in the housing 1a, are shown in block diagram form.
[0020] The photographing unit 4 photographs the article M onto which each of the stripe patterns P1, P2, P3, and P4 is projected, to obtain a set of photographed images as shown in Figs. 6(a) to (d). If the background of the article M (for example, a platform M' on which the article M is placed) is flat, each of the stripe patterns P1, P2, P3, and P4 projected onto the background will have a certain regularity. Each of the stripe patterns P1, P2, P3, and P4 projected onto the article M (a gable-shaped article in Figs. 6(a) to (d)) will be distorted. In this embodiment, there are four photographed images in one set. If the number of light sources is three, there will be three photographed images.
[0021] The three-dimensional shape measurement processing unit 5 processes the set of captured images. In the three-dimensional shape measurement processing unit 5, the distortion of each of the stripe patterns P1, P2, P3, and P4 projected onto the article M is phase analyzed, and the three-dimensional shape of the article M is measured.
[0022] Furthermore, the three-dimensional shape measurement processing unit 5 detects a change in the radiation intensity of the light from each of the plurality of light sources 31A, 31B, 31C, and 31D.
[0023] In detail, the three-dimensional shape measurement processing unit 5 can detect a change in the radiation intensity of light from each of the multiple light sources 31A, 31B, 31C, and 31D from the luminance of a predetermined position of each of the captured images in the set of captured images. For example, the predetermined position can be a part (for example, the part surrounded by squares indicated by symbols p1, p2, p3, and p4 in FIG. 6) in the background of the object M (for example, a platform M' on which the object M is placed) that is not influenced by the object M (i.e., regardless of the presence or absence of the object M).
[0024] 7 and 8, the three-dimensional shape measurement processing unit 5 has an illuminance sensor 51, and can detect a change in the radiation intensity of light from each of the multiple light sources 31A, 31B, 31C, and 31D from the illuminance detected by the illuminance sensor 51. For example, the illuminance sensor 51 can be attached to the light source side in a peripheral portion (a part of the shielding portion 32b) such as the upper or lower portion of the stripe pattern forming optical element 32, although this is not particularly limited (see FIGS. 7 and 8).
[0025] When the three-dimensional shape measurement processing unit 5 detects a change in the radiation intensity of each of the multiple light sources 31A, 31B, 31C, and 31D, it prevents the measurement error of the three-dimensional shape of the article M from becoming large in the following manner.
[0026] That is, the three-dimensional shape measurement processing unit 5 adjusts the light radiation intensity of each of the multiple light sources 31A, 31B, 31C, and 31D via the projection control unit 2 (see the dashed line with an arrow from the three-dimensional shape measurement processing unit 5 to the projection control unit 2 in Figs. 1 and 7). For example, when the light radiation intensity of the light sources 31A, 31B, 31C, and 31D decreases during sequential measurement of a large number of objects M and the degree of the decrease differs between the light sources, the light radiation intensity of each of the multiple light sources 31A, 31B, 31C, and 31D can be adjusted to fall within a reference range. The reference range is a range that is determined in advance at the time of calibration or the like, and may be the same for the multiple light sources 31A, 31B, 31C, and 31D, or may be a different range if brightness correction is performed during image processing in the three-dimensional shape measurement processing unit 5. The reference range may be determined by an absolute value or a relative value between the light sources.
[0027] Alternatively, the three-dimensional shape measurement processing unit 5 can adjust the exposure time (the length of the exposure period Td in FIG. 2), aperture value or gain in the imaging unit 4 (see the dashed line with an arrow pointing from the three-dimensional shape measurement processing unit 5 to the imaging unit 4 in FIGS. 1 and 7).
[0028] Alternatively, the three-dimensional shape measurement processing unit 5 can adjust (correct) the brightness of a set of captured images.
[0029] Specifically, the three-dimensional shape measurement processing unit 5 can be realized by a computer including a CPU 5a, a program memory 5b, a work memory 5c, an input / output interface 5d (input / output terminals are omitted in FIG. 9), etc. The program memory 5b can store an image processing program 5ba for performing image processing and a detection adjustment program 5bb for detecting changes in the radiation intensity of each of the multiple light sources 31A, 31B, 31C, and 31D and adjusting them as described above.
[0030] In this way, the three-dimensional shape measuring device 1 can prevent large errors in the measurement of the three-dimensional shape of the object M even if differences occur in the changes in the characteristics of the light sources 31A, 31B, 31C, and 31D due to changes in the usage environment (e.g., temperature changes during sequential measurement of multiple objects M).
[0031] The above describes a three-dimensional shape measuring device according to an embodiment of the present invention. However, the present invention is not limited to the embodiment described, and various design modifications are possible within the scope of the matters described in the claims. [Explanation of symbols]
[0032] 1. 3D shape measurement device 1a Housing 2 Projection control unit 3 Projection section 31A, 31B, 31C, 31D light source 31Aa, 31Ba, 31Ca, 31Da current inflow terminal 31Ab, 31Bb, 31Cb, 31Db Current drain terminal 310 Light emitting element 311 Resistance 32 Stripe pattern forming optical element 32a Transparent part 32b Shield part 32c Cylindrical Lens 33 Projection unit case 4. Photography Department 5. 3D shape measurement processing section 5a CPU 5b Program Memory 5ba Image processing program 5bb detection tuning program 5c Working Memory 5d Input / Output Interface 51 Illuminance sensor EX Signal indicating exposure timing I A , I B , I C , I D Current flowing through the light source M Goods M' unit P1, P2, P3, P4 stripe patterns p1, p2, p3, p4 Part of a photograph showing a striped pattern SY Synchronous signal Ta projection period Tb PWM period Tc A , Tc B , Tc C , Tc D PWM Pulse Width Td Exposure period
Claims
[Claim 1] A projection control unit; a projection unit having a plurality of light sources arranged in a row, each of which is controlled by the projection control unit in terms of its lighting and light radiation intensity, and a stripe pattern forming optical element that passes the light from the light sources in a stripe pattern, and which projects a stripe pattern onto an article, the phase of which is shifted by a predetermined angle by sequentially lighting each of the plurality of light sources; an imaging unit that captures an image of the object onto which each of the stripe patterns is projected to obtain a set of captured images; a three-dimensional shape measurement processing unit that performs image processing on the set of captured images, and has an illuminance sensor attached to the light source side in a peripheral portion of the stripe pattern forming optical element, and detects a change in the radiant intensity of light from each of the plurality of light sources from the illuminance detected by the illuminance sensor during sequential measurement of the multiple objects, and adjusts the radiant intensity of light from each of the plurality of light sources so that it falls within a reference range; a three-dimensional measuring device for measuring a three-dimensional shape of the object, comprising:
Citation Information
Patent Citations
Three-dimensional shape input device and projector
JP2003050112A
Shape measurement method and shape measuring device using a number of reference planes
JP2008281491A
Shape inspection device and shape inspection method
JP2010256217A
Shape measuring instrument and shape measuring method
JP2011242178A
Three-dimensional shape measurement device, three-dimensional shape measurement method, structure manufacturing method, and structure manufacturing system
JP2012093235A
