Inspection system, inspection method, method of manufacture using the inspection method, and inspection program

The inspection system improves anomaly detection in AM products by using leading and trailing images to assess brightness changes, addressing the limitations of existing non-destructive testing methods and ensuring reliable quality assurance in PBF processes.

JP2025159478APending Publication Date: 2025-10-21MITSUBISHI HEAVY IND LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024062065
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-04-08
Publication Date
2025-10-21

AI Technical Summary

Technical Problem

Non-destructive testing methods for Additive Manufacturing (AM) products, such as X-ray inspections, are expensive and do not adequately guarantee the quality of the created objects, particularly in Powder Bed Fusion (PBF) processes where laser irradiation generates metal vapor and fumes that can affect inspection reliability.

Method used

An inspection system and method that acquires leading and trailing images of stacked layers, calculates brightness parameters, and determines the printing environment's normality by comparing brightness change parameters with a threshold, thereby improving anomaly detection reliability.

Benefits of technology

Enhances the reliability of anomaly detection in AM products by accurately assessing the printing environment and reducing the need for costly non-destructive testing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025159478000001_ABST
    Figure 2025159478000001_ABST
Patent Text Reader

Abstract

To provide an inspection system, an inspection method, a method of manufacture using the inspection method, and an inspection program that allow for improving the reliability of a result of abnormality detection.SOLUTION: A system 60 for inspecting a formed object formed by layering a material on a base plate comprises: an acquiring section 61 that acquires a preceding image as an image of a preceding layer consisting of at least one layer formed precedently among a plurality of layers laid one over another and a succeeding image as an image of a succeeding layer consisting of at least one layer formed later than the preceding layer; a calculating section 62 that calculates a preceding brightness parameter related to the brightness of the preceding image and a succeeding brightness parameter related to the brightness of the succeeding image, respectively, and calculates a brightness-change parameter related to a change in brightness using the preceding and succeeding brightness parameters; and a determining section 63 that determines whether or not the environment for forming the formed object is normal by comparing the brightness-change parameter with a predetermined threshold.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to an inspection system, an inspection method, a manufacturing method using the inspection method, and an inspection program. [Background technology]

[0002] AM (Additive Manufacturing) products are manufactured by layering materials, and non-destructive testing such as X-ray inspections may be used to ensure the quality of AM products.

[0003] In particular, in PBF (Powder Bed Fusion), inspections are sometimes performed during fabrication by checking the state of powder placement (see, for example, Patent Document 1). Layer fabrication is performed by laying powdered metal material on a bed such as a base plate, irradiating the metal material with a laser, and repeating melting and solidification. During this process, heat generated by the laser irradiation generates metal vapor (fumes), which is part of the metal material laid on the bed. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2022-179347 Summary of the Invention [Problem to be solved by the invention]

[0005] Non-destructive testing, such as X-ray testing, used to ensure the quality of AM products is expensive. Therefore, alternative, low-cost quality assurance methods are needed. While there is a quality assurance method for AM product creation that checks for powder application defects using images that record the state of the applied powder and the laser irradiation state (see Patent Document 1), this method does not adequately guarantee the quality of the created object.

[0006] The present disclosure has been made in consideration of the above circumstances, and aims to provide an inspection system, an inspection method, a manufacturing method using the inspection method, and an inspection program that can improve the reliability of the detection results of abnormality detection. [Means for solving the problem]

[0007] An inspection system according to one aspect of some embodiments of the present disclosure is an inspection system for an object formed by stacking materials on a substrate, and includes an acquisition unit that acquires a leading image, which is an image of a leading layer consisting of at least one layer formed earlier among the multiple stacked layers, and a trailing image, which is an image of a trailing layer consisting of at least one layer formed later than the leading layer; a calculation unit that calculates a leading brightness parameter related to the brightness of the leading image and a trailing brightness parameter related to the brightness of the trailing image, and calculates a brightness change parameter related to brightness change using the leading brightness parameter and the trailing brightness parameter; and a determination unit that determines whether the environment in which the object is formed is normal by comparing the brightness change parameter with a predetermined threshold.

[0008] An inspection method according to one aspect of some embodiments of the present disclosure is a method for inspecting a molded object formed by stacking materials on a substrate, and includes an acquisition step of acquiring a leading image, which is an image of a leading layer consisting of at least one layer formed earlier among a plurality of stacked layers, and a trailing image, which is an image of a trailing layer consisting of at least one layer formed later than the leading layer; a calculation step of calculating a leading brightness parameter, which is a parameter related to the brightness of the leading image, and a trailing brightness parameter, which is a parameter related to the brightness of the trailing image, and calculating a brightness change parameter using the leading brightness parameter and the trailing brightness parameter; and a determination step of determining whether the environment in which the molded object is molded is normal by comparing the brightness change parameter with a predetermined threshold.

[0009] A manufacturing method according to one aspect of some embodiments of the present disclosure includes a powder layer formation process in which a powder of the material is laid in the molding area of ​​the object to form a powder layer, a molding layer formation process in which a laser is irradiated onto the powder layer to melt and solidify the material to form a molding layer, and an inspection process in which the molding layer is inspected using the above-described inspection method.

[0010] An inspection program according to one aspect of some embodiments of the present disclosure is an inspection program for an object formed by stacking materials on a substrate, and causes a computer to execute an acquisition process for acquiring a leading image, which is an image of a leading layer consisting of at least one layer formed earlier among the multiple stacked layers, and a trailing image, which is an image of a trailing layer consisting of at least one layer formed later than the leading layer; a calculation process for calculating a leading brightness parameter, which is a parameter related to the brightness of the leading image, and a trailing brightness parameter, which is a parameter related to the brightness of the trailing image, and calculating a brightness change parameter using the leading brightness parameter and the trailing brightness parameter; and a determination process for determining whether the environment in which the object is formed is normal by comparing the brightness change parameter with a predetermined threshold. [Effects of the Invention]

[0011] According to the present disclosure, it is possible to achieve an effect of improving the reliability of the detection result of anomaly detection. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating a schematic configuration of a molding apparatus according to an embodiment of the present disclosure. [Figure 2] FIG. 10 is a diagram illustrating an example of a modeling unit during formation of a modeling layer according to an embodiment of the present disclosure. [Figure 3] FIG. 1 is a diagram illustrating an example of a hardware configuration of an inspection system according to an embodiment of the present disclosure. [Figure 4] FIG. 2 is a functional block diagram illustrating functions of an inspection system according to an embodiment of the present disclosure. [Figure 5]10A to 10C are diagrams illustrating examples of images of each layer acquired by an acquisition unit according to an embodiment of the present disclosure. [Figure 6] FIG. 10 is a diagram illustrating an example of image processing according to an embodiment of the present disclosure. [Figure 7] 10A and 10B are diagrams illustrating images of an example of an abnormality that becomes a defective portion according to an embodiment of the present disclosure. [Figure 8] 10 is a flowchart illustrating an example of a procedure for an abnormality determination process for a printing environment according to an embodiment of the present disclosure. [Figure 9] 10 is a flowchart illustrating an example of a procedure for a defect determination process including an abnormality determination process according to an embodiment of the present disclosure. [Figure 10] 10 is a flowchart illustrating an example of a procedure for a defect determination process including an abnormality determination process according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, an embodiment of an inspection system, an inspection method, a manufacturing method using the inspection method, and an inspection program according to the present disclosure will be described with reference to the drawings.

[0014] FIG. 1 is a diagram illustrating a schematic configuration of a molding apparatus 10 according to an embodiment of the present disclosure. The surface plate 22 and the pillars 26 are fixed to the base 21. The base 21 is installed so that its upper surface is horizontal. The upper surface of the surface plate 22 is also horizontal. The upper surface of this surface plate 22 serves as a stage, on which powder material is spread to form a modeling layer. A flange-like convex portion 22a is formed around the entire periphery of the upper surface of the surface plate 22. The outer peripheral surface of the convex portion 22a is in contact with the inner surface of the modeling tank 23, and the powder can be held in the space surrounded by the upper surface of the surface plate 22 and the inner surface of the modeling tank 23. The powder material is, for example, a metal material or a ceramic material. In other words, the modeling apparatus 10 forms a model by Powder Bed Fusion (PBF).

[0015] Powder is laid on the forming section 35 of the forming tank 23 to form a powder layer. Then, the powder layer is irradiated with a laser 32 to melt and solidify the powder, thereby forming a forming layer. In this embodiment, the laser 32 is described as the heat source that solidifies the powder. The forming tank 23 is movable in the vertical direction (stacking direction), and is raised a certain amount to form and stack the forming layers. Specifically, the support section 24 supports the lower surface of the flange section 23a of the forming tank 23 so that the upper surface of the flange section 23a is horizontal. The support section 24 is connected to the drive section 25 and moves the forming tank 23 in the vertical direction. The drive section 25 is fixed to a pillar 26 and includes, for example, a motor.

[0016] The laser scanner 28 irradiates the powder layer formed in the modeling unit 35 with a laser 32. The laser scanner 28 is supported by a support unit 27 and can scan the laser 32 on a horizontal surface. In other words, it is possible to selectively heat and solidify the powder at any location on the horizontal surface. The laser 32 is generated by a laser oscillator and introduced into the laser scanner 28 via an optical fiber.

[0017] In the modeling unit 35, powder is supplied from the forming unit 41. For example, pipes 51 and 48 are connected to the supply unit 46 via a branch 47, and a pressure reducer 49 reduces the pressure in the supply unit 46 via the pipe 48, and powder is supplied from the storage unit 50 via the pipe 51 to the supply unit 46. The powder is then supplied from the supply unit 46 via the pipe 45 to the distributor 44. The distributor 44 measures the powder and supplies a predetermined amount of powder to the gap 42 in the modeling unit 41. The forming unit 41 then moves horizontally (a direction perpendicular to the vertical direction) to form a powder layer in the modeling unit 35.

[0018] Specifically, when forming the object 37, the drive unit 25 moves the modeling tank 23 upward, which creates a step between the already formed modeling surface and the upper surface of the flange portion 23a of the modeling tank 23. Then, the forming unit 41 moves horizontally, forming a new powder layer on top of the previously formed, solidified modeling layer. At this time, the height of the uppermost powder layer becomes equal to the height of the upper surface of the flange portion 23a. Then, the laser 32 is irradiated to a predetermined area of ​​the powder layer, selectively heating and solidifying it. In this way, modeling layers are formed. By moving the modeling tank 23 upward and repeating the same operation, each modeling layer is stacked.

[0019] The modeling apparatus 10 is further provided with a camera 55. The camera 55 is supported by, for example, the laser scanner 28 or the support unit 27, and is provided near the laser scanner 28. The camera 55 captures an image of the modeling unit 35 to generate an image of the formed modeling surface. The modeling surface is the surface of the layer to be modeled. The captured image is used in the inspection system 60, which will be described later. The specifications of the camera 55 are set based on the desired detection resolution for the defect D. The captured image is, for example, a black and white image. That is, for each pixel of the image, a value ranging from 0 to an upper limit is set as a brightness value. The upper limit is 255 in 8 bits (256 gradations). The closer the brightness value is to 0, the darker the image is displayed, and the closer the brightness value is to the upper limit, the whiter the image is displayed. The defect D may appear white or black.

[0020] 2 is a diagram illustrating an example of the modeling unit 35 during formation of a modeling layer according to an embodiment of the present disclosure. As shown in FIG. 2, when a laser 32 is irradiated onto a predetermined region of a powder layer to form a modeled object 37, heat generated by the laser irradiation vaporizes part of the material, generating fumes F. As shown in FIG. 2, the generated fumes F flow both horizontally and upward, and the fumes F flowing horizontally are exhausted from the modeling unit 35 through an exhaust port 57. On the other hand, the fumes F flowing upward adhere as smut S to a protective layer provided on the output surface of the laser 32 of the laser scanner 28 located above the modeling unit 35 and to the lens of the camera 55.

[0021] If smut S adheres to the protective layer of the laser scanner 28, the output of the laser 32 is suppressed, increasing the possibility of a defect D occurring. Furthermore, if smut S adheres to the lens of the camera 55, the brightness of the image of the printing surface captured by the camera 55 will be lower than when smut S is not attached to the lens. In such cases, the image of the printed object 37 captured by the inspection system 60 may be inappropriate for use in inspection due to the influence of fumes F, reducing the reliability of the inspection by the inspection system 60. For this reason, the inventors have diligently studied an inspection method that solves the above-mentioned problems. The inspection system proposed by the inventors will be described below.

[0022] FIG. 3 is a diagram showing an example of the hardware configuration of the inspection system 60 according to this embodiment. 3, the inspection system 60 is a computer system including, for example, a CPU 110, a ROM (Read Only Memory) 120 for storing programs and the like executed by the CPU 110, a RAM (Random Access Memory) 130 that functions as a work area when each program is executed, a hard disk drive (HDD) 140 as a large-capacity storage device, and a communication unit 150 for connecting to a network or the like. Note that a solid-state drive (SSD) may also be used as the large-capacity storage device. These units are connected via a bus 180.

[0023] The inspection system 60 may also include an input unit consisting of a keyboard, a mouse, etc., and a display unit consisting of a liquid crystal display device or the like for displaying data.

[0024] The storage medium for storing the programs executed by the CPU 110 is not limited to the ROM 120. For example, it may be other auxiliary storage devices such as a magnetic disk, a magneto-optical disk, or a semiconductor memory.

[0025] A series of processing steps for realizing the various functions described below are recorded in the form of a program on the hard disk drive 140 or the like, and the CPU 110 reads this program into the RAM 130 or the like and executes information processing and arithmetic operations to realize the various functions described below. The program may be pre-installed in the ROM 120 or other storage medium, provided in a state stored in a computer-readable storage medium, or distributed via wired or wireless communication means. Examples of computer-readable storage media include magnetic disks, magneto-optical disks, CD-ROMs, DVD-ROMs, and semiconductor memories.

[0026] Fig. 4 is a functional block diagram showing the functions of the inspection system 60. As shown in Fig. 4, the inspection system 60 includes an acquisition unit 61, a calculation unit 62, a determination unit 63, a processing unit 64, and an identification unit 65. Using each component included in the inspection system 60, the inspection system 60 performs anomaly determination, which determines whether an image of the surface of a modeling layer during modeling can be used for defect determination (described below), and defect determination, which inspects the modeling layers that make up the model for defects.

[0027] The acquisition unit 61 acquires a leading image, which is an image of a leading layer consisting of at least one layer formed earlier among the multiple stacked layers, and a following image, which is an image of a following layer consisting of at least one layer formed later than the leading layer. The leading layer is specifically a powder layer laid in the formation of a modeling layer at a predetermined stage that is relatively early in the entire additive manufacturing process. The leading image is an image corresponding to the leading layer. The following layer is specifically a powder layer laid in the formation of a modeling layer at a predetermined stage that is relatively late, from the middle stage to the late stage in the entire additive manufacturing process. The following image is an image corresponding to the following layer. For example, the acquisition unit 61 acquires images of the surface of the powder bed during the formation of each layer. In other words, the powder bed that will form the object is inspected. In particular, the images record the state of the powder application. It is preferable to capture images after the powder has been laid but before it has solidified (i.e., before the beam irradiation). This is because, while defects in concave portions can be identified both before and after solidification, defects in convex portions can be identified before solidification but may be difficult to identify after solidification because they are smoothed (to a uniform height) by the beam irradiation. In other words, whether the defect is a concave or convex portion, capturing an image before solidification (before the beam irradiation) allows for effective defect identification. However, as long as the state of the powder application is known, the image may be taken either before or after the powder is solidified by the beam irradiation. The acquisition unit 61 may also acquire an image of the surface of the formation layer (the formation surface) in addition to the image of the powder bed surface. The acquisition unit 61 may also be, for example, an imaging device such as a camera that captures an image of the surface of the powder layer.

[0028] The preceding layer and the following layer are defined, for example, as follows: The preceding layer is a layer located closer to the base than the intermediate layer among all layers forming the shaped object. The following layer is a layer located closer to the surface of the shaped object than the intermediate layer in the stacking direction. The preceding layer may consist of any one layer or multiple layers among all layers forming the shaped object that are located closer to the base than the intermediate layer. Similarly, the following layer is a layer after the intermediate layer among all layers forming the shaped object, and may consist of any one layer or multiple layers.

[0029] FIG. 5 shows examples of images of each layer acquired by the acquisition unit 61. FIG. 5(a) is an example of an image of the first layer (initial layer). In the image of the first layer, the base 21 is not completely covered with the scattered powder. For this reason, as shown in FIG. 5(a), the shape of the base 21 is reflected in the image of the first layer. 5(b) is an example of the second layer image. In the second layer image, the powder is spread to the extent that the shape of the base 21 cannot be recognized, but the amount of powder spread is not yet uniform. Therefore, as shown in FIG. 5(b), the second layer image appears partially distorted due to the shape of the base 21 and the uneven thickness of the powder layer. As shown in Figures 5(a) and 5(b), the brightness of the images of the layers near the first layer is not stable depending on the position in the image due to factors such as adjusting the parallelism of the base 21 during modeling and tilting during setting for modeling.

[0030] Fig. 5(c) is an example of an image of the fifth layer. In the image of the fifth layer, the base 21 is completely covered with powder. Therefore, as shown in Fig. 5(c), the image of the fifth layer is an image of the layer surface without any installation abnormalities. Figure 5(d) is an example of an image of the final layer. The image of the final layer is an image of the layer surface with reduced brightness from the state illustrated in Figure 5(c). This is because, at the time the image of the final layer is acquired, fumes generated during modeling become smut S and adhere to the lens of camera 55. Therefore, the image of the final layer is an image with reduced brightness compared to the image of the fifth layer, depending on the amount of residual images of the fumes.

[0031] As illustrated in FIG. 5, there is a possibility that the base 21 may not be completely covered by powder in the first few images (e.g., the first to fourth layers) formed. Images in which the base 21 is reflected have high image brightness, and are therefore not suitable for use in determining abnormalities. For this reason, the preceding layer must be a layer in which the base 21 is completely covered. In the above example, the preceding layer is the fifth layer, but is not limited to this and may be changed as appropriate depending on the conditions of the inspection performed by the inspection system 60. Similarly, the following layer is not limited to the final layer and may be changed as appropriate depending on the conditions of the inspection performed by the inspection system 60.

[0032] Furthermore, as described above, the metal substrate is reflected in the image of the first layer, causing the image brightness to be higher than expected. If the above-mentioned determination is performed using an image with a brightness higher than expected, the reliability of the abnormality determination cannot be guaranteed. For this reason, it is preferable that the preceding layer is a layer corresponding to an image in which the brightness parameter, which is a parameter related to the brightness of the image, is equal to or lower than a predetermined upper limit. Note that the predetermined upper limit is set, for example, based on a reference image in a normal environment for forming the object 37.

[0033] Furthermore, the environment in which the object is to be formed changes depending on the amount of powder material dispersed, resulting in changes in the surroundings of the forming area. Therefore, if an image of the entire forming environment of the object is acquired and brightness parameters are calculated, noise corresponding to the surroundings of the forming area will be included in each brightness parameter. Therefore, it is preferable that the image used to calculate the brightness parameters is the forming area where the material is laid on the surface of the layer. In this way, by limiting the range of the image used to calculate the brightness parameters to the forming area on the surface of the layer, the calculation unit can accurately calculate the average brightness.

[0034] Furthermore, the leading layer and the following layer are not limited to one layer each, and may each consist of multiple layers. For example, the leading layer is a layer in the range from the 5th layer to the 100th layer. The following layer may be a layer in the range from the 10th layer before the final layer to the final layer. Furthermore, a layer in the range from the 5th layer to the layer at the midpoint of all layers may be defined as the leading layer, and a layer in the range from the midpoint of all layers to the final layer may be defined as the following layer.

[0035] The calculation unit 62 calculates a leading brightness parameter, which is a parameter related to the brightness of the leading image, and a trailing brightness parameter, which is a parameter related to the brightness of the trailing image, and calculates a brightness change parameter related to brightness change using the leading brightness parameter and the trailing brightness parameter. The leading brightness parameter is, for example, a leading average brightness, which is the average brightness of the leading image. The trailing brightness parameter is, for example, a trailing average brightness, which is the average brightness of the trailing image. By using the average brightness as the brightness parameter in this way, it is possible to suppress the influence of brightness variations that differ from position to position in the layer image (i.e., to improve the accuracy of abnormality determination). Note that the brightness parameter is not limited to the average brightness. The brightness parameter may be a median value or another value obtained by statistically processing brightness values. Note that the brightness change parameter is, for example, a rate of change in average brightness calculated using the leading average brightness and the trailing average brightness. Note that the brightness change parameter may be an amount of change or another value related to the change in brightness of the image.

[0036] Furthermore, when the acquisition unit 61 acquires an image of each layer, the calculation unit 62 may calculate a luminance parameter for each image and calculate a luminance change parameter using the calculated luminance parameter for each image. For example, the calculation unit 62 may calculate an average luminance using the image of each layer acquired by the acquisition unit 61, and calculate a change rate of the average luminance from the fifth layer to the final layer for every two consecutive layers or for every plurality of consecutive layers.

[0037] The determination unit 63 determines whether the environment in which the object 37 is to be formed is normal by comparing the brightness change parameter with a predetermined threshold. The predetermined threshold is, for example, a value set based on a reference image, which is an image of the forming surface captured when the environment in which the object 37 is to be formed is normal. More specifically, the predetermined threshold is a rate of change in average brightness calculated in advance based on the reference image captured when the environment in which the object 37 is to be formed is normal. The determination unit 63 determines that there is an abnormality in the environment in which the object 37 is to be formed, when the rate of change in average brightness calculated by the calculation unit 62 is equal to or greater than the rate of change in average brightness calculated using the reference image. The predetermined threshold value may be stored in advance in the ROM 120, or may be recorded in a cloud server or the like that is external to the inspection system 60.

[0038] Furthermore, the determination unit 63 determines the tendency of the amount of fumes generated in the printing environment based on the brightness change parameter. Specifically, if the rate of change in average brightness calculated by the calculation unit 62 is equal to or greater than the rate of change in average brightness calculated using the reference image, the determination unit 63 determines that the amount of fumes generated in the current environment in which the object 37 is being printed is greater than expected. If the amount of fumes generated is greater than expected, a large amount of smut S will adhere to the lens of the camera 55, reducing the brightness of the subsequent image. As a result, it is possible to determine whether the amount of fumes generated is greater than in a normal environment, using the rate of change in average brightness in the current environment in which the object 37 is being printed.

[0039] The processing unit 64 performs image processing on the acquired image. Specifically, the processing unit 64 performs image processing (feature portion extraction) on the acquired image to emphasize the defect portion D. The image processing is at least one of trapezoidal correction, trimming, contrast adjustment, binarization, first differentiation, second differentiation, contour extraction, and noise removal. Other image processing may also be used as long as it emphasizes the defect portion D (makes the defect portion D easier to determine).

[0040] Furthermore, the inspection system 60 is not limited to the above configuration, and may include, for example, an imaging unit that captures images of the stacked layers.

[0041] FIG. 6 is a diagram showing an example of image processing. In FIG. 6, image processing proceeds in the direction of the arrow. First, the input image is a captured image. When capturing an image of the printing surface with camera 55, the shooting direction of camera 55 may be tilted relative to the vertical direction. In such cases, the printing surface that appears in the image becomes a trapezoid as shown in FIG. 6. For this reason, trimming and keystone correction are performed as process P1. Trimming is a process that removes parts other than the printing surface from the image. Keystone correction corrects the printing surface that appears as a trapezoid to a square (as if it were captured from directly in front).

[0042] Next, contrast adjustment is performed in process P2, and binarization (which may be first or second derivative) is performed in process P3. This makes the defect D stand out, and then contour extraction is performed in process P4. Since noise is also contained in the image in this state, noise removal is performed in process P5. In noise removal, defect D that is smaller than a set size (for example, area) may also be removed. In this way, defect D is emphasized.

[0043] Fig. 7 shows an image of an example of an abnormality that becomes a defect D. As shown in Fig. 7, each abnormality such as recoater interference, powder falling, powder short circuit, and powder depression appears as a defect D in the image.

[0044] The identifying unit 65 identifies defects D and the positions of the defects D on the surface of the layer based on the image (image that has been image processed). If defects D exist on the building surface whose image has been acquired by the acquiring unit 61, the defects D will appear in the image. Therefore, the identifying unit 65 identifies each defect D and the coordinates on the building surface that are the positions of each defect D based on the image. Since defects D have a range, it is preferable to identify coordinates that fall within this range.

[0045] In this embodiment, image processing is performed on the captured image, but if the defect D and its position can be identified without image processing, it is not necessary to perform image processing.

[0046] (Regarding abnormality detection) Next, an example of the abnormality determination process for the printing environment by the inspection system 60 will be described with reference to FIG. 8. FIG. 8 is a flowchart showing an example of the procedure for the abnormality determination process for the printing environment according to this embodiment. The flow shown in FIG. 8 may be performed after printing, for example, by storing images corresponding to each printing layer.

[0047] In the abnormality determination process, first, an image is captured (S101). Next, the captured image is trimmed to the printing range (S102). The trimmed image may be subjected to various correction processes such as keystone correction.

[0048] Next, a leading average luminance is calculated, which is the average luminance of the leading image, which is the image of the leading layer near the first layer, and a trailing average luminance is calculated, which is the average luminance of the trailing image, which is the image of the trailing layer near the final layer (S103).In addition, at this time, the average luminance may be calculated using an image in which the contrast of each layer has been adjusted. Next, the rate of change of the average brightness is calculated using the preceding average brightness and the following average brightness (S104).

[0049] Next, the change rate of the average brightness is compared with a predetermined threshold, and whether or not there is an abnormality in the printing environment is determined based on whether or not the change rate of the average brightness is equal to or greater than the predetermined threshold (S105). If it is determined that the change rate of the average brightness is not equal to or greater than the predetermined threshold (NO in S105), it is determined that there is no abnormality and that the printing environment is normal (S106). If it is determined that the change rate of the average brightness is equal to or greater than the predetermined threshold (YES in S105), it is determined that there is an abnormality (S107).

[0050] In this way, by comparing the rate of change in the average brightness of the image of the printing surface with a predetermined threshold to determine whether there is an abnormality in the printing environment, it is possible to determine whether the current printing environment is an environment worthy of inspecting the object. For example, if the rate of change in average brightness calculated using the preceding average brightness and the following average brightness is equal to or greater than the rate of change in average brightness calculated using the reference image, it can be inferred that the amount of fume generated in the current printing environment is greater than the amount of fume generated in a normal printing environment. Then, it can be determined that it is not desirable to perform defect detection on the object using the image acquired in the current printing environment.

[0051] Furthermore, this processing makes it possible to determine whether or not there is an abnormality due to a change in the manufacturing environment over time, thereby improving the reliability of the detection results of the abnormality detection performed by the inspection system 60. Furthermore, by determining whether or not there is an abnormality due to a change in the manufacturing environment over time, the frequency of non-destructive inspection can be reduced.

[0052] In the above-described anomaly determination process, the presence or absence of an anomaly is determined using the rate of change of the average luminance, but this is not limiting, and the presence or absence of an anomaly may be determined using the amount of change of the average luminance. Furthermore, the preceding layer and the following layer may each be a single layer at a predetermined position, or multiple layers located in a predetermined range. Furthermore, when inspection is performed during modeling, multiple following layers may be defined at different positions. In this case, multiple determinations are performed during modeling.

[0053] Furthermore, when inspection is performed during fabrication, the first layer of two consecutive layers may be designated as the leading layer and the next layer as the trailing layer, and abnormalities may be repeatedly determined based on the rate of change in the brightness parameters of those two layers. In addition, when performing inspection during modeling, the layer at a predetermined initial position may be designated as the leading layer, and the layer spaced a predetermined distance from the leading layer as the trailing layer, and while maintaining the predetermined distance, the leading layer and trailing layer may be changed according to the progress of the modeling process, and abnormality determination processing may be performed.

[0054] (About defect determination) Next, an example of a defect determination process by the inspection system 60 described above will be described with reference to FIGS. 9 and 10. FIGS. 9 and 10 are flowcharts showing an example of the procedure of the defect determination process including the abnormality determination process according to this embodiment. The flow shown in FIGS. 9 and 10 is performed, for example, every time a modeling layer is formed and an image is acquired. Instead of every time an image is acquired, images corresponding to each modeling layer may be accumulated and the process may be performed after modeling, for example. The defect determination process according to this embodiment is characterized by including an abnormality determination process in which the average brightness of the image of each layer is calculated as a brightness parameter, and if each brightness parameter is greater than a predetermined upper limit value or less than a predetermined lower limit value, it is determined that there is an abnormality in the image corresponding to the brightness parameter.

[0055] The defect determination process begins with capturing an image (S201), followed by trimming and keystone correction (S202), and then calculating the average brightness of the image for each layer (S203). Next, it is determined whether the average brightness of all images falls within a threshold range. Specifically, if there is an average brightness that is greater than a predetermined upper limit value or smaller than a predetermined lower limit value, it is determined that there is an abnormality in the image corresponding to this average brightness (S204). The predetermined upper limit value and the predetermined lower limit value are values ​​that are set based on a reference image, which is an image of the printing surface when the environment in which the object 37 is printed is normal, for example.

[0056] If the average brightness of any of the images is not within the threshold range (NO in S204), it is determined that defect determination cannot be performed due to some process abnormality (S205). Process abnormalities may include, for example, the amount of fumes generated in the printing environment being greater than expected, or the camera 55 not being calibrated properly. If the average brightness of all images falls within the threshold range (YES in S204), contrast adjustment is performed (S206).

[0057] Next, the average brightness of the image of each layer after contrast adjustment is calculated (S207). Next, it is determined whether the average brightness of all images after contrast adjustment falls within a threshold range. Specifically, if there is an average brightness that is greater than a predetermined upper limit value or less than a predetermined lower limit value, it is determined that there is an abnormality in the image corresponding to this average brightness (S208).

[0058] If the average brightness of any image is not within the threshold range (NO in S208), it is determined that some process abnormality has occurred and defect determination cannot be performed (S209).If the average brightness of all images is within the threshold range (YES in S208), the process proceeds to predetermined image processing (e.g., binarization, first derivative, second derivative, etc.) (S210).

[0059] Next, binarization (first or second differentiation may be performed) is performed (S210), and noise removal is performed (S211). That is, steps S202 to S211 constitute image processing.

[0060] Next, it is determined whether or not a defect D has been detected (S212). For example, if the area of ​​a region in the image that is assumed to be a defect D is equal to or larger than a threshold, this region is determined to be a defect D. Note that the determination method is not limited as long as the defect D can be determined based on the image.

[0061] If no defect D is detected (NO in S212), the image is determined to be normal (S213). If a defect D is detected (YES in S212), the coordinates of the defect D are recorded (S214).

[0062] Next, it is determined whether or not a defect D has occurred at the same coordinates for a predetermined number of consecutive layers (S215). In S215, the determination is made by referring to the record of the coordinates of the defect D for the lower modeling layer for which the determination has been made (processing of S214).

[0063] If no defect D occurs at the same coordinates for a predetermined number of consecutive layers (NO in S215), the determination of an abnormality is withheld (S216).

[0064] If a defect D occurs at the same coordinates for a predetermined number of consecutive layers (YES in S215), it is determined to be abnormal (S217).

[0065] By performing such processing, an abnormality determination process can be performed before the defect determination process, and it can be determined whether there are any abnormalities in the image used for defect determination, thereby ensuring the reliability of the determination results of the defect determination process.

[0066] In the above flow, only images determined as NO in S204 or S208 may be excluded from the inspection target, and the subsequent processing may be continued. In this case, if the determination in S204 or S208 is NO, the defect determination process is interrupted, and the administrator of the inspection system 60 is notified that a process abnormality has been confirmed.

[0067] Furthermore, the predetermined thresholds in S204 and S208, specifically, the predetermined upper limit value and the predetermined lower limit value, may be values ​​that are set based on a reference image, which is an image of the printing surface captured when the environment in which the object is printed is normal. Furthermore, the processes from S207 to S209 may be omitted as appropriate depending on the printing conditions and inspection conditions of the object to be printed.

[0068] In the above description, the abnormality determination process and the defect determination process are performed separately, but this is not limiting. For example, the abnormality determination process and the defect determination process may be performed in parallel while performing modeling. Furthermore, the abnormality determination process and the defect determination process may be combined into one process, and the defect determination process may be performed after the abnormality determination process is completed, and each process may be repeatedly performed alternately.

[0069] The present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the invention. It is also possible to combine the various embodiments.

[0070] (Additional notes) The inspection system, inspection method, manufacturing method using the inspection method, and inspection program described in each of the above-described embodiments can be understood, for example, as follows. An inspection system (60) according to a first aspect of the present disclosure is an inspection system for an object (37) formed by stacking materials on a substrate (21), and includes an acquisition unit (61) that acquires a leading image, which is an image of a leading layer consisting of at least one layer formed earlier among the multiple stacked layers, and a trailing image, which is an image of a trailing layer consisting of at least one layer formed later than the leading layer; a calculation unit (62) that calculates a leading brightness parameter related to the brightness of the leading image and a trailing brightness parameter related to the brightness of the trailing image, and calculates a brightness change parameter related to brightness change using the leading brightness parameter and the trailing brightness parameter; and a determination unit (63) that determines whether the environment in which the object is formed is normal by comparing the brightness change parameter with a predetermined threshold.

[0071] According to the present disclosure, an inspection system for a model formed by stacking materials on a substrate includes an acquisition unit that acquires a leading image, which is an image of a leading layer consisting of at least one layer formed earlier among the multiple stacked layers, and a trailing image, which is an image of a trailing layer consisting of at least one layer formed later than the leading layer; a calculation unit that calculates a leading brightness parameter relating to the brightness of the leading image and a trailing brightness parameter relating to the brightness of the trailing image, respectively, and calculates a brightness change parameter relating to brightness change using the leading brightness parameter and the trailing brightness parameter; and a determination unit that determines whether the environment in which the model is to be formed is normal by comparing the brightness change parameter with a predetermined threshold. In this way, by acquiring images of layers at different stacking positions and using multiple brightness parameters calculated from the images of each layer to determine whether the printing environment is normal or not, it is possible to determine whether there is an abnormality due to changes in the printing environment over time. This improves the reliability of the detection results of anomaly detection performed by the inspection system. Furthermore, by determining whether there is an abnormality due to changes in the printing environment over time, the frequency of non-destructive testing can be reduced.

[0072] In the inspection system according to the second aspect of the present disclosure, in the first aspect, the preceding layer may be a layer located closer to the base than an intermediate layer among all layers forming the object, and the following layer may be a layer located closer to the surface of the object than the intermediate layer.

[0073] According to the inspection system of the present disclosure, the preceding layer is a layer that is located closer to the base than a layer at an intermediate position in the formation of all layers that form the object, and the following layer is a layer that is located closer to the surface of the object than a layer at an intermediate position in the stacking direction. This makes it possible to grasp trends in the rate of change of average brightness over a wider range by using images of layers formed in the first half of the formation of the object and images of layers formed in the second half of the formation of the object, and to grasp trends in changes in the environment in which the object is formed over a wider range.

[0074] In the inspection system according to the third aspect of the present disclosure, in the second aspect, the preceding layer may be a layer corresponding to an image in which the preceding luminance parameter is equal to or less than a predetermined upper limit value.

[0075] According to the inspection system of the present disclosure, the preceding layer is a layer corresponding to an image in which the preceding brightness parameter is equal to or less than a predetermined upper brightness limit. For example, if the preceding layer is the first layer, a metal substrate may be reflected in the preceding image, increasing the brightness of the preceding image. Therefore, by determining the layer in which the preceding brightness parameter is equal to or less than a predetermined upper brightness limit as the preceding layer, it is possible to more accurately determine whether the environment in which the object is to be formed is normal.

[0076] In the inspection system according to the fourth aspect of the present disclosure, in any one of the first to third aspects, the determination unit may determine the trend in the amount of fume (F) generated in the environment based on the brightness change parameter.

[0077] According to the inspection system of the present disclosure, the determination unit determines the tendency of the amount of fumes generated in the environment in which the object is to be formed, based on the luminance change parameter obtained by using the preceding luminance parameter and the following luminance parameter, thereby making it possible to determine whether the amount of fumes generated in the environment in which the object is to be formed is within a normal range.

[0078] An inspection system according to a fifth aspect of the present disclosure, in any one of the first to fourth aspects, may be configured such that the leading brightness parameter is an average brightness of the leading image, the following brightness parameter is an average brightness of the following image, and the brightness change parameter is a rate of change between the average brightness of the leading image and the average brightness of the following image.

[0079] According to the inspection system of the present disclosure, the leading luminance parameter is the average luminance of the leading image, the trailing luminance parameter is the average luminance of the trailing image, and the luminance change parameter is the rate of change between the average luminance of the leading image and the average luminance of the trailing image. That is, the inspection system calculates the rate of change of the average luminance using the average luminance of each layer formed at a different position in the stacking direction, and compares the average rate of change of luminance with a predetermined threshold to determine whether the environment in which the object is to be formed is normal. This makes it possible to grasp the brightness of the environment in which the object is to be formed over time, and to determine whether images acquired in the current forming environment can be used to detect an abnormality in the object.

[0080] In the inspection system according to a sixth aspect of the present disclosure, in any one of the first to fifth aspects, the predetermined threshold value may be a value set based on a reference image, which is an image of a printing surface when the environment in which the object is printed is normal.

[0081] According to the inspection system of the present disclosure, the predetermined threshold is a value that is set based on a reference image obtained when the environment in which the object is to be formed is normal. By setting the predetermined threshold based on the reference image in this manner, it is possible to more accurately determine whether the environment in which the object is to be formed is normal.

[0082] In the inspection system according to a seventh aspect of the present disclosure, in any one of the first to sixth aspects, the image may be an image of a build area where the material is laid on the surface of a layer.

[0083] According to the inspection system of the present disclosure, the image is an image of a build area where material is laid on the surface of the layer. The environment in which the object is built changes depending on the amount of powder material dispersed, resulting in changes in the surroundings of the build area. Therefore, if an image of the entire build environment for the object is acquired and each brightness parameter is calculated, noise corresponding to the surroundings of the build area may be included in each brightness parameter. Therefore, by limiting the image range to the build area on the surface of the layer, the average brightness can be accurately calculated.

[0084] In an inspection system according to an eighth aspect of the present disclosure, in any one of the first to seventh aspects, the calculation unit calculates a brightness parameter related to the brightness of the image of each layer, and the determination unit determines that there is an abnormality in the image corresponding to the brightness parameter if any of the brightness parameters is greater than a predetermined upper limit value or smaller than a predetermined lower limit value.

[0085] In the inspection system according to the present disclosure, the calculation unit calculates a brightness parameter relating to the brightness of the image of each layer, and the determination unit determines that an abnormality exists in the image corresponding to the brightness parameter if the brightness parameter is greater than a predetermined upper limit or less than a predetermined lower limit. For example, if the brightness parameter of each image is not within the predetermined upper or lower limit range, it is possible that the amount of fume generated in the printing environment is greater than expected, or that the camera calibration has not been performed correctly. Therefore, by determining whether the brightness parameter of each image is within the predetermined upper or lower limit range, it is possible to improve the reliability of the laying abnormality inspection, which inspects for the presence or absence of laying abnormalities in the laying of materials during layer formation.

[0086] In the inspection system according to the ninth aspect of the present disclosure, in the eighth aspect, the upper limit value and the lower limit value are values ​​that are set based on a reference image, which is an image of the printing surface when the environment in which the object is printed is normal.

[0087] According to the inspection system of the present disclosure, the upper and lower limits are set based on a reference image, which is an image of the printing surface captured when the environment in which the object is printed is normal. In this way, the reference values ​​for determining an abnormality in the image inspection are set based on the reference image captured when the environment in which the object is printed is normal, thereby making it possible to more accurately determine whether the environment in which the object is printed is normal.

[0088] An inspection method according to a tenth aspect of the present disclosure is a method for inspecting a molded object (37) formed by stacking materials on a substrate (21), and includes an acquisition step of acquiring a leading image, which is an image of a leading layer consisting of at least one layer formed earlier among the multiple stacked layers, and a trailing image, which is an image of a trailing layer consisting of at least one layer formed later than the leading layer; a calculation step of calculating a leading brightness parameter, which is a parameter related to the brightness of the leading image, and a trailing brightness parameter, which is a parameter related to the brightness of the trailing image, and calculating a brightness change parameter using the leading brightness parameter and the trailing brightness parameter; and a determination step of determining whether the environment in which the molded object is formed is normal by comparing the brightness change parameter with a predetermined threshold.

[0089] The manufacturing method according to the eleventh aspect of the present disclosure includes a powder layer formation process in which a powder of the material is laid in the molding area of ​​the molded object to form a powder layer, a molding layer formation process in which a laser (32) is irradiated onto the powder layer to melt and solidify the material to form a molding layer, and an inspection process in which the molding layer is inspected using the inspection method of the tenth aspect.

[0090] An inspection program according to a twelfth aspect of the present disclosure is an inspection program for an object (37) formed by stacking materials on a substrate (21), and causes a computer to execute an acquisition process for acquiring a leading image, which is an image of a leading layer consisting of at least one layer formed earlier among the multiple stacked layers, and a trailing image, which is an image of a trailing layer consisting of at least one layer formed later than the leading layer; a calculation process for calculating a leading brightness parameter, which is a parameter related to the brightness of the leading image, and a trailing brightness parameter, which is a parameter related to the brightness of the trailing image, and calculating a brightness change parameter using the leading brightness parameter and the trailing brightness parameter; and a determination process for determining whether the environment in which the object is to be formed is normal by comparing the brightness change parameter with a predetermined threshold value. [Explanation of symbols]

[0091] 10: Molding device 21: Bass 22: Surface plate 22a: Convex part 23: Modeling tank 23a: Flange part 24: Support part 25: Drive unit 26: Pillar 27: Support part 28: Laser scanner 32: Laser (heat source) 35: Modeling Department 37: Modeled object 41:Formation part 42 :Void 44:Distributor 45: Piping 46: Supply section 47: Branch 48: Piping 49: Pressure reducer 50: Storage section 51: Piping 55: Camera 57: Exhaust port 60: Inspection system 61: Acquisition part 62: Calculation section 63: Judgment section 64: Processing section 65: Specific part 110:CPU 120:ROM 130:RAM 140: Hard disk drive 150: Communications Department 180: Bus D: Defective part F: Fume (metal vapor) S: Smut

Claims

1. An inspection system for a shaped object formed by stacking materials on a base, comprising: an acquisition unit that acquires a preceding image, which is an image of a preceding layer consisting of at least one layer formed in advance among the plurality of stacked layers, and a following image, which is an image of a following layer consisting of at least one layer formed after the preceding layer; a calculation unit that calculates a preceding luminance parameter related to the luminance of the preceding image and a following luminance parameter related to the luminance of the following image, and calculates a luminance change parameter related to a luminance change using the preceding luminance parameter and the following luminance parameter; a determination unit that determines whether or not an environment in which the object is formed is normal by comparing the brightness change parameter with a predetermined threshold value; An inspection system comprising:

2. the preceding layer is a layer located closer to the base than a layer at an intermediate position among all layers forming the object, The inspection system according to claim 1 , wherein the following layer is a layer located closer to the surface of the object than the layer at the intermediate position.

3. The inspection system of claim 2 , wherein the preceding layer is a layer corresponding to an image in which the preceding brightness parameter is equal to or less than a predetermined upper limit.

4. The inspection system according to claim 1 , wherein the determining unit determines a tendency of the amount of fume generated in the environment based on the brightness change parameter.

5. the previous luminance parameter is the average luminance of the previous image; the following luminance parameter is the average luminance of the following image, 2. The inspection system of claim 1, wherein the brightness change parameter is a rate of change between an average brightness of the preceding image and an average brightness of the following image.

6. The inspection system according to claim 1 , wherein the predetermined threshold value is a value that is set based on a reference image that is an image of a surface to be molded when the environment in which the object is molded is normal.

7. The inspection system of claim 1 , wherein the image is an image of a build area where the material is laid down at a surface of a layer.

8. the calculation unit calculates a brightness parameter related to the brightness of the image of each of the layers; The inspection system according to claim 1 , wherein the determining unit determines that an abnormality exists in the image corresponding to the brightness parameter when the brightness parameter is greater than a predetermined upper limit value or less than a predetermined lower limit value.

9. The inspection system according to claim 8 , wherein the upper limit value and the lower limit value are values ​​that are set based on a reference image that is an image of a surface to be molded when the environment in which the object is molded is normal.

10. 1. A method for inspecting a shaped object formed by stacking materials on a base, comprising: an acquisition step of acquiring a preceding image, which is an image of a preceding layer consisting of at least one layer formed in advance among the plurality of stacked layers, and a following image, which is an image of a following layer consisting of at least one layer formed after the preceding layer; a calculation step of calculating a preceding luminance parameter which is a parameter related to the luminance of the preceding image and a following luminance parameter which is a parameter related to the luminance of the following image, and calculating a luminance change parameter using the preceding luminance parameter and the following luminance parameter; a determining step of determining whether or not an environment for forming the object is normal by comparing the brightness change parameter with a predetermined threshold value; An inspection method having the following.

11. a powder layer forming step of forming a powder layer by spreading the powder material in a modeling area of ​​the modeled object; a modeling layer forming step of irradiating the powder layer with a laser to melt and solidify the material to form a modeling layer; an inspection step of inspecting the modeling layer using the inspection method according to claim 10; A method for manufacturing a shaped object having the above structure.

12. An inspection program for a model formed by stacking materials on a base, an acquisition process for acquiring a preceding image, which is an image of a preceding layer consisting of at least one layer formed in advance among the plurality of stacked layers, and a following image, which is an image of a following layer consisting of at least one layer formed after the preceding layer; a calculation process of calculating a preceding brightness parameter which is a parameter related to the brightness of the preceding image and a following brightness parameter which is a parameter related to the brightness of the following image, and calculating a brightness change parameter using the preceding brightness parameter and the following brightness parameter; a determination process of determining whether or not an environment for forming the object is normal by comparing the brightness change parameter with a predetermined threshold value; An inspection program that causes a computer to execute the above.

Citation Information

Patent Citations

  • Inspection system and its method and program

    JP2022179347A