IMAGE INFORMATION GENERATION DEVICE AND IMAGE INFORMATION GENERATION METHOD, IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHOD, DEFECT PREDICTION DEVICE AND DEFECT PREDICTION METHOD, AND PROGRAM

Abstract

To allow a user to easily visually grasp information of irregularity distribution, excess or deficiency of lamination height or the like even for a molded object that has a complicated shape and is hardly grasped.SOLUTION: An image information generation device 220 generates image information expressing the shape of a molded object in which layers of a plurality of weld beads are laminated. The image information generation device 220 comprises: a coordinate information acquisition unit 31 which approximates the design shape for each layer of a molded object by using a model simulating the shape of a weld bead and acquires coordinate information of a plurality of points of the approximated model; a profile extraction unit 33 which obtains a profile expressing the surface shape of the designated layer from the coordinate information; and an image information conversion unit 35 which converts the irregularity shape of the surface of the designated layer into the image information by using the profile.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an image information generating apparatus and an image information generating method, an image processing apparatus and an image processing method, a defect prediction apparatus and a defect prediction method, and a program. [Background technology]

[0002] In arc welding, there is known a technique for detecting defects that occur in a welded structure and judging whether the welding has been performed properly. For example, Patent Document 1 discloses a technique for judging the quality of the welding by acquiring multiple pieces of information related to the behavior of the welder, the shape of the molten pool, the wire extension length, etc. during semi-automatic welding (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2008-110388 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above-mentioned additive manufacturing, in which weld beads are stacked by arc welding to obtain a shaped object, narrow spaces may occur between the beads if the welding conditions or bead formation pass are inappropriate. If manufacturing is continued with narrow spaces in place, there is a risk of a welding defect occurring at the location of the narrow space due to insufficient melting (non-welding). Therefore, it is important to predict in advance the possibility of irregularities and defects in the stacked shapes, and then select welding conditions or bead formation passes that will not cause welding defects. However, in additive manufacturing, the number of passes and the pass length tend to increase compared to normal welding, making it difficult to predict the shape of the object before manufacturing and optimize the welding conditions, etc. Furthermore, the more complex the shape of the object becomes, the more complicated the prediction and optimization processes become.

[0005] Therefore, an object of the present invention is to provide an image information generating device and an image information generating method, an image processing device and an image processing method, a defect prediction device and a defect prediction method, and a program that make it easy to visually grasp information such as the distribution of unevenness and whether the stacking height is excessive or insufficient, even for objects with complex shapes that are difficult to grasp. [Means for solving the problem]

[0006] The present invention comprises the following configurations. (1) An image information generating device that generates image information representing a shape of a structure formed by laminating layers each made of a plurality of weld beads, comprising: a coordinate information acquisition unit that approximates a design shape of each layer of the object using a model that imitates a shape of the weld bead, and acquires coordinate information of a plurality of points of the approximated model; a profile extraction unit that obtains a profile representing a surface shape of the specified layer from the coordinate information; an image information conversion unit that converts the uneven shape of the surface of the specified layer into image information using the profile; An image information generating device comprising: (2) a narrow portion extraction unit that performs image processing to extract a concave narrow portion formed by the weld bead from the image information generated by the image information generating device according to (1); a feature amount calculation unit that calculates a feature amount including either a position or a size of the extracted narrow portion; An image processing device comprising: (3) An image information generating device according to (1), a narrow portion extraction unit that extracts a concave narrow portion formed by the weld bead from the image information generated by the image information generating device through image processing; a feature amount calculation unit that calculates a feature amount including either a position or a size of the extracted narrow portion; a lamination condition acquisition unit that acquires lamination conditions of the weld bead that forms the narrow portion; a defect determination unit that predicts the presence or absence of a defect that will occur in the narrow portion in the object or a size of the defect, based on the feature amount of the narrow portion and the lamination condition of the narrow portion; A defect prediction apparatus comprising: (4) An image information generating method for generating image information representing a shape of a structure formed by laminating layers each made of a plurality of weld beads, comprising the steps of: approximating a design shape of each layer of the object using a model that imitates a shape of the weld bead, and acquiring coordinate information of a plurality of points of the approximated model; A profile representing a surface shape of the specified layer is obtained from the coordinate information; converting the uneven shape of the surface of the specified layer into image information using the profile; A method for generating image information. (5) Extracting a concave narrow portion formed by the weld bead from the image information generated by the image information generating method according to (4) by image processing; Calculating a feature amount including either the position or the size of the extracted narrow portion; Image processing methods. (6) Extracting a concave narrow portion formed by the weld bead from the image information generated by the image information generating method according to (4) by image processing; Calculating a feature amount including either the position or the size of the extracted narrow portion; Acquire lamination conditions for the weld beads that form the narrow portion; predicting the presence or absence of a defect occurring in the narrow portion in the object or a size of the defect according to the feature amount of the narrow portion and the lamination condition of the narrow portion; Defect prediction methods. (7) A program for executing a procedure for generating image information representing a shape of a structure formed by stacking layers each made of a plurality of weld beads, the program comprising: On the computer, approximating a design shape of each layer of the object using a model that imitates a shape of the weld bead, and acquiring coordinate information of a plurality of points of the approximated model; determining a profile representing a surface shape of the specified layer from the coordinate information; a step of converting the uneven shape of the surface of the specified layer into image information using the profile; A program for executing. Effect of the Invention

[0007] According to the present invention, even for objects with complex shapes that are difficult to grasp, image information that makes it easy to visually grasp information such as the distribution of projections and recesses, excess or deficiency of stacking height, etc. can be obtained. This makes it possible to accurately predict defect sizes and contribute to suppressing the occurrence of defects. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is an overall configuration diagram of a welding system. [Diagram 2] FIG. 2 is a block diagram of the defect prediction device. [Diagram 3] FIG. 3 is a flowchart showing the procedure of a defect prediction method performed by the defect prediction device. [Figure 4] FIG. 4 is an explanatory diagram showing a state in which the shape of a model is reproduced using a plurality of unit models. [Diagram 5] FIG. 5 is an explanatory diagram showing a group of vertices of a unit model. [Figure 6] FIG. 6 is an explanatory diagram showing a unit model for one row extending in the depth direction. [Figure 7] FIG. 7 is an explanatory diagram showing a state in which the shape of a shaped object is reproduced by an elliptical unit model. [Figure 8A] FIG. 8A is an explanatory diagram showing how profiles are extracted from a plurality of unit models that are similar to the shape of a model. [Figure 8B] FIG. 8B is an explanatory diagram showing how profiles are extracted from a plurality of unit models that are approximate to the shape of a model. [Figure 9A] FIG. 9A is a schematic diagram of an image based on image information expressed in a contour shape. [Figure 9B] FIG. 9B is a graph showing pixel values ​​on line IX-IX in FIG. 9A. [Figure 10] FIG. 10 is an explanatory diagram showing a case where a model is formed on an inclined base. [Figure 11]FIG. 11 is an explanatory diagram showing an example of the feature amount of a narrow portion. [Figure 12] FIG. 12 is a functional block diagram of a defect determination unit included in the defect prediction device. [Figure 13] FIG. 13 is a model diagram showing the contents of a lamination plan for a model formed by a plurality of weld beads. [Figure 14] FIG. 14 is a graph showing the height distribution of the model in a cross section taken along line XIV-XIV in FIG. [Figure 15] FIG. 15 is an image showing the result of visualizing the point cloud information extracted from the model diagram of FIG. [Figure 16] FIG. 16 is an image showing the result of processing the image shown in FIG. 15 to emphasize the narrow portion. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, a configuration example of the present invention will be described in detail with reference to the drawings. Here, an example of an additive manufacturing device that manufactures a shaped object by stacking weld beads by arc welding will be described, but the manufacturing method of the shaped object and the device configuration for additive manufacturing are not limited to this.

[0010] <Configuration of additive manufacturing device> 1 is an overall configuration diagram of an additive manufacturing apparatus. The additive manufacturing apparatus 100 includes a modeling unit 11 and a control device 13. The modeling unit 11 includes a manipulator 15, a manipulator control unit 17, a filler material supply unit 19, and a heat source control unit 21.

[0011] The manipulator control unit 17 controls the manipulator 15 and the heat source control unit 21. A controller (not shown) is connected to the manipulator control unit 17, and an operator can instruct the manipulator control unit 17 to perform any operation via the controller.

[0012] The manipulator 15 is, for example, an articulated robot, and a filler material M is supported by a welding torch 23 attached to a tip shaft so that the filler material M can be continuously supplied. The welding torch 23 holds the filler material (also called welding wire) M protruding from the tip. The position and posture of the welding torch 23 can be set arbitrarily in three dimensions within the range of the degrees of freedom of the robot arm constituting the manipulator 15. The manipulator 15 is preferably one having six or more degrees of freedom, and is preferably one that can arbitrarily change the axial direction of the heat source at the tip. The manipulator 15 may be in various forms, such as a four- or more-axis articulated robot as shown in FIG. 1, or a robot equipped with angle adjustment mechanisms for two or more orthogonal axes.

[0013] The welding torch 23 has a shield nozzle (not shown), and a shielding gas is supplied from the shielding nozzle. The shielding gas blocks the atmosphere and prevents oxidation, nitridation, etc. of the molten metal during welding, thereby suppressing poor welding. The arc welding method used in this configuration may be either a consumable electrode type such as a shielded metal arc welding or a carbon dioxide gas arc welding, or a non-consumable electrode type such as a TIG (Tungsten Inert Gas) welding or a plasma arc welding, and is appropriately selected depending on the object to be molded. Here, gas metal arc welding is taken as an example for explanation. In the case of the consumable electrode type, a contact tip is disposed inside the shield nozzle, and a filler material M to which a current is supplied is held by the contact tip. The welding torch 23 generates an arc from the tip of the filler material M in a shielding gas atmosphere while holding the filler material M.

[0014] The filler metal supply unit 19 supplies the filler metal M toward the welding torch 23. The filler metal supply unit 19 includes a reel 19a on which the filler metal M is wound, and a pay-out mechanism 19b that pays out the filler metal M from the reel 19a. The filler metal M is fed to the welding torch 23 while being sent in the forward or reverse direction by the pay-out mechanism 19b as necessary. The pay-out mechanism 19b is not limited to a push type that is disposed on the filler metal supply unit 19 side and pushes out the filler metal M, but may be a pull type or a push-pull type that is disposed on a robot arm or the like.

[0015] The heat source control unit 21 is a welding power source that supplies power required for welding by the manipulator 15. The heat source control unit 21 adjusts the welding current and welding voltage supplied when forming a bead by melting and solidifying the filler metal M. In addition, the filler metal supply speed of the filler metal supply unit 19 is adjusted in conjunction with the welding conditions set by the heat source control unit 21, such as the welding current and welding voltage.

[0016] The heat source for melting the filler material M is not limited to the above-mentioned arc. For example, a heating method using both an arc and a laser, a heating method using plasma, a heating method using an electron beam or a laser, or other methods of heating may be used. When heating with an electron beam or a laser, the amount of heat can be controlled more precisely, and the state of the bead to be formed can be more appropriately maintained, which contributes to further improving the quality of the laminated structure. The material of the filler material M is not particularly limited, and the type of filler material M used may be different depending on the characteristics of the molded object Wk, such as mild steel, high-tensile steel, aluminum, aluminum alloy, nickel, nickel-based alloy, etc.

[0017] The control device 13 controls the above-mentioned components in an integrated manner. The control device 13 is configured with hardware using an information processing device such as a PC (Personal Computer).

[0018] The additive manufacturing apparatus 100 having the above-mentioned configuration operates according to a modeling program created based on a lamination plan for the object Wk. The modeling program is composed of a large number of command codes, and is created based on an appropriate algorithm according to various conditions such as the shape, material, and heat input of the object Wk. When the supplied filler material M is melted and solidified while moving the welding torch 23 according to this modeling program, a linear weld bead B, which is a molten solidified body of the filler material M, is formed on the base 25. That is, the manipulator control unit 17 drives the manipulator 15 and the heat source control unit 21 based on a predetermined modeling program provided by the control device 13. The manipulator 15 moves the welding torch 23 while melting the filler material M with an arc, according to a command from the manipulator control unit 17, to form the weld bead B. In this way, the weld beads B are formed and stacked sequentially, thereby obtaining a model Wk having a desired shape.

[0019] Next, a lamination plan for a model to be manufactured by the layered manufacturing apparatus 100 will be described. The lamination plan is determined based on a predetermined algorithm in accordance with conditions such as the shape of the object to be modeled and the specifications of each part constituting the additive manufacturing apparatus 100. Specifically, the lamination plan includes information on the trajectory (path) along which the welding torch 23 is moved, information on the welding conditions for forming a weld bead, and the like. The specific procedure for determining the lamination plan is publicly known, and therefore a description thereof will be omitted here.

[0020] The more complex the shape of the molded object becomes, the more difficult it becomes to grasp the contents of the lamination plan. Therefore, it is preferable to express the lamination plan as image information and make the image information displayable on a display unit such as a monitor. In this case, an operator can visually easily check the contents of the lamination plan and extract and evaluate characteristic parts. In other words, if the lamination plan can be visualized, it becomes easier to extract factors that cause various defects such as non-welding defects, and defects can be predicted from the extracted defect factor information. For example, a narrow portion formed by a weld bead is an example of a defect factor. It is known that non-welding of a weld bead is likely to occur in a narrow portion. Here, the presence or absence of a defect or the size of the defect is predicted from the information on the narrow portion. In the following description, the narrow portion is described as a defect factor, but this is not limiting, and other factors may be extracted to predict defects.

[0021] Next, a defect prediction method and a defect prediction device for predicting defect information contained in a narrow portion in a molded object from a lamination plan will be described in detail below. FIG. 2 is a block diagram of a defect prediction device 200. As shown in FIG. The defect prediction device 200 includes a lamination condition acquisition unit 210 that acquires lamination conditions from a prepared lamination plan, an image information generation unit 220, an image processing unit 230, and a defect determination unit 250.

[0022] The image information generating device 220 expresses the design shape of each layer of the object based on the lamination plan with a model imitating the bead shape of a weld bead, and generates image information representing the surface shape of a specified layer from the coordinate information of multiple points of the model. The user of the defect prediction device can arbitrarily specify the layer. The image information generating device 220 includes a coordinate information acquiring unit 31, a profile extracting unit 33, and an image information converting unit 35, the details of which will be described later. The coordinate information acquiring unit 31 approximates the design shape of each layer of the object using a model imitating the shape of a weld bead, and acquires coordinate information of multiple points of the approximated model. The profile extracting unit 33 obtains a profile representing the surface shape of the specified layer from the acquired coordinate information. The image information converting unit 35 converts the uneven shape of the surface of the specified layer into image information using the obtained profile.

[0023] The image processing device 230 also includes a narrow portion extraction unit 37 that processes the image information generated by the image information generating device 220 and extracts the concave narrow portion formed by the weld bead, and a feature calculation unit 39 that calculates a feature including either the position or the size of the extracted narrow portion from the image information.

[0024] The defect prediction device 200 may include a display unit 240 that displays the image information output from the image information generating device 220 and the feature amount information output from the image processing device 230. By displaying the respective pieces of output information on the display unit 240, the set lamination conditions can be visually grasped more easily.

[0025] Furthermore, the defect prediction device 200 is equipped with a defect determination unit 250 that predicts the presence or absence of defects such as unwelded defects in the narrow portion of the object, or the size of the defects, based on the features of the narrow portion calculated by the feature calculation unit 39 and the lamination conditions of the narrow portion.

[0026] The defect prediction device 200 is configured by hardware using an information processing device such as a PC (Personal Computer) like the control device 13. The control function of the defect prediction device 200 is realized by a control device (not shown) reading a program having a specific function stored in a storage device and executing the program. Examples of the control device include a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processor Unit), or a dedicated circuit. Examples of the storage device include a memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory), and a storage such as a HDD (Hard Disk Drive) or an SSD (Solid State Drive). The defect prediction device 200 may be configured to include each component such as the image information generating device 220 and the image processing device 230 described above, or may be configured to have each component connected remotely via a network or the like. The image processing device 230 may be configured to include a GPU (Graphics Processing Unit) in the processor, suitable for high-speed processing.

[0027] 3 is a flowchart showing the procedure of a defect prediction method by the defect prediction device 200. The procedure of predicting defects by the defect prediction device 200 will be described below. First, the lamination condition acquisition unit 210 acquires information on the lamination plan, which is control information related to lamination of weld beads when laminating a model (S1). For example, various lamination conditions required for prediction are extracted from the prepared lamination plan of the model. The necessary lamination conditions include information on the rod operation trajectory of the welding torch, information on the torch posture during rod operation, etc. The information on the rod operation trajectory includes, for example, the three-dimensional coordinates (x, y, z) of a specific point P located on the trajectory (modeling path). Furthermore, the information on the torch posture includes, for example, angles (α, β, γ) around each coordinate axis. Note that the coordinate information and the torch posture information are not limited to the above example, and may be, for example, information on a cylindrical coordinate system (r, θ, z) represented using polar coordinates, and the torch posture may be determined from the angles and joint positions of each joint of the manipulator holding the torch. In addition, the information may include the welding current, the welding voltage, the welding wire feed speed, the pattern of the rod operation trajectory (whether or not weaving is performed), the inter-pass time from the end of a specific shaping pass to the start of the next pass, etc. The above-mentioned coordinate information is extracted by the coordinate information acquisition unit 31 of the image information generating device 220 from the input lamination conditions.

[0028] Next, the shape of the object is predicted from the acquired lamination conditions (S2). Here, a profile is obtained that represents the lamination shape when multiple weld beads are laminated, using a model that mimics the bead shape of the weld beads. FIG. 4 is an explanatory diagram showing a state where the shape of a molded object is reproduced by a plurality of unit models BM. It is preferable that the profile Prf of the laminated shape is predicted using a unit model BM having a shape simulating a bead shape. By using the unit model BM, the shape can be simplified and the calculation of coordinate values, etc. can be reduced. Specifically, the unit models BM representing the bead shape are arranged in multiple rows and multiple layers along the molding path to approximate the shape of the molded object to be molded. The shape of this unit model BM itself is assumed to change depending on the welding conditions (welding current, welding voltage, welding wire feed speed, welding speed, etc.). Furthermore, it is preferable that each unit model BM reflects the overlap between adjacent beads, bead sagging, etc. in the model shape depending on the arrangement state. The shape of the unit model BM may be various shapes such as a trapezoid or a shape close to a trapezoid, a polygonal shape, an elliptical shape, etc., and is not particularly limited.

[0029] The multiple unit models BM arranged in this manner reproduce the layered shape of the model by applying information such as welding conditions and target positions for bead formation. From the layered shape reproduced by multiple unit models BM, the shape of the model outer surface formed by overlapping unit models BM can be understood. This shape is expressed as a profile Prf that connects the outermost edges of the unit models BM, as shown in FIG. 4. The profile extraction unit 33 shown in FIG. 2 performs the extraction process of this profile Prf. The profile Prf of the model outer surface may be extracted for each modeling pass or for each layer. In other words, if a profile Prf that represents the layered shape at any timing and at any layer during modeling is extracted, the layered shape at that timing and at that layer can be freely predicted.

[0030] Next, three-dimensional point cloud information is generated from the profile Prf information that represents the shape of the model outer surface of the specified layer (S3). If the original outer surface is formed of bent straight lines as shown in Figure 4, multiple points P that are corners of each straight line may be used as the point cloud. Also, each vertex in the shape of each unit model BM may be used as the point cloud.

[0031] Fig. 5 is an explanatory diagram showing a point cloud of vertices of a unit model. As shown in Fig. 5, points P of each vertex of a trapezoid or a unit model BM with a triangle added to the base of a trapezoid are set as point cloud information. For example, each vertex of a first-layer unit model BM can be defined as a point cloud of the first layer. In addition, in the case of a second-layer unit model BM, each vertex exposed outside the second-layer unit model and each vertex of the first-layer unit model exposed outside from the second-layer unit model can be defined as a point cloud of the second layer.

[0032] Furthermore, the point cloud information is extracted not only from the point cloud on the cross section shown in FIG. 5, but also from a plurality of unit models arranged extending in the depth direction (bead formation direction) of FIG. 6 is an explanatory diagram showing one row of unit models extending in the depth direction. The above unit model BM has been described as having a cross-sectional shape in the zx plane, but the actual unit model BM is a hexahedron having a total of eight vertices when the cross-sectional shape is a trapezoid, for example. In this way, multiple points of the three-dimensional unit model BM are extracted as point cloud information.

[0033] The above-mentioned group of points may be points other than the vertices of the unit model BM. FIG. 7 is an explanatory diagram showing a state in which the shape of a shaped object is reproduced by an elliptical unit model. When the unit model reproduces a layered shape using a smooth curve such as an ellipse, a collection of points P sampled at a fixed interval (pitch Pt) on the outer surface shape of the unit model may be defined as the point cloud described above. The information contained in the point cloud is not limited to the Cartesian coordinate system (x, y, z), and may be converted to a preferred coordinate system such as (r, θ, z) including a polar coordinate system. In this case, as described above, points P sampled at a fixed interval in the depth direction are also obtained, and these points P are defined as the point cloud.

[0034] 8A and 8B are explanatory diagrams showing how a profile Prf is extracted from a plurality of unit models that approximate the shape of a model. The model shown here has a frame-shaped wall portion and a filling portion that fills the area surrounded by the wall portion. Figs. 8A and 8B show a cross section of a part of the model.

[0035] 8A shows a four-layer unit model BMw that constitutes the wall portion, and two-layer unit models BM1 and BM2 that constitute the filling portion on the sides of the unit model BMw, with the bead width and bead height set larger than those of the wall portion. The unit model BM1 is the first layer, and the unit model BM2 is the second layer. Each of the unit models BMw, BM1, and BM2 has a trapezoidal shape, and it is assumed that beads are formed in the filling portion starting from the side closest to the unit model BMw that becomes the wall portion.

[0036] The layered shape of the object shown in Fig. 8A can be set as a profile Prf of the outer surface of the unit model of the outermost layer shown in Fig. 8B. As shown in Fig. 6, the profile Prf is a three-dimensional profile that is also connected in the depth direction of Fig. 8B, and represents the height distribution on the xy plane.

[0037] Next, the point cloud information obtained as described above is converted into a contour diagram that represents the shape of the object (S4). Specifically, image information (contour diagram) that expresses the unevenness of the surface of the object in a contour form with respect to a plane in a specific direction is generated. The process of generating three-dimensional point cloud information from the information of the profile Prf described above and converting it into a contour diagram is performed by the image information conversion unit 35 shown in FIG. 2.

[0038] Fig. 9A is a schematic diagram of an image based on image information expressed in a contour shape. Fig. 9B is a graph showing pixel values ​​on line IX-IX in Fig. 9A. Image 51 shows height information as pixel values ​​(shading) on ​​a two-dimensional plane, and the pixel values, which are the height information in Fig. 9B, represent the height distribution of profile Prf shown in Fig. 8B.

[0039] By observing this image 51 on a display unit 240 such as a monitor shown in Fig. 2, the worker can visually easily grasp the unevenness of the point cloud information, which is difficult to intuitively understand. In addition, by converting the point cloud information into image information, the amount of information to be stored can be reduced. Furthermore, by applying image processing techniques such as binarization, the desired feature information can be easily extracted.

[0040] The pixel value of the image information to be displayed in the contour may be the stack height z, or may be the difference between the planned height z0 according to the stacking plan and the stack height z obtained by modeling, or may be the height difference in a specific minute unit section. In other words, in addition to the absolute value of the height formed by the unevenness of the surface shape, it may be a value that represents the degree of inclination due to the unevenness. When the pixel value of the image information is set to the difference between the planned height z0 and the stack height z, it becomes suitable information for identifying an excessive or insufficient welding area of ​​the weld bead. Furthermore, the inclination angle of the unevenness with respect to a specific axial direction may be set as the value to be displayed in the contour. For example, as in the profile Prf in FIG. 8B, if the above-mentioned inclination angle is defined as an inclination from the vertical direction (z-axis direction), the inclined part is highlighted. Therefore, it becomes easier to evaluate the flatness of the molded surface, and if a large recess 53 exists, it becomes easier to find it.

[0041] In addition, in FIG. 9A, the height in the z-axis direction relative to the xy plane is displayed in contour form, but this is not limited thereto. For example, other values ​​may be displayed, such as the value in the x-direction relative to the yz plane being displayed in contour form.

[0042] 10 is an explanatory diagram showing a case where a model is formed on an inclined base 25. When additive manufacturing a model, the base 25 may be inclined from the horizontal plane (xy plane) and a weld bead B may be formed and layered on this inclined base surface. In this case, it is preferable that the object to be displayed in the contour form described above is not the height z in the coordinate system (x, y, z) but the value of the zL axis in the local coordinate system (xL, yL, zL) in which the inclined base surface is the xL-yL plane and the normal direction of the base surface is the zL direction. This makes it easier to grasp the change in shape of the model due to the layering height of the weld bead.

[0043] Next, narrow portions of the weld beads are extracted from the obtained contour diagram (S5). Narrow portion extraction unit 37 of image information generating device 220 shown in Fig. 2 extracts narrow portions occurring between weld beads formed based on the lamination plan (between unit models BM or between rows of unit models) from the image information converted by image information conversion unit 35. Narrow portion extraction unit 37 outputs information on the position, size, etc. of the extracted narrow portion to feature amount calculation unit 39. Feature amount calculation unit 39 calculates the feature amount of the narrow portion from the inputted narrow portion information based on the coordinate information of the narrow portion and the periphery of the narrow portion.

[0044] The narrow portion extraction unit 37 extracts the narrow portion by applying appropriate image processing to the input image information. For example, a narrow portion with a sharp recess may be extracted by binarization processing or the like. Specifically, the image of the image information is subjected to binarization processing with a specific pixel value as a threshold value, and the recessed area extracted is regarded as the narrow portion. The feature amount calculation unit 39 calculates various feature amounts such as the size and center position of the narrow portion extracted by the narrow portion extraction unit 37. In addition, the outer surface shape in the vicinity of the narrow portion may be calculated as the feature amount of the narrow portion.

[0045] FIG. 11 is an explanatory diagram showing an example of the feature amount of a narrow portion. As shown in FIG. 11, a pair of adjacent weld beads are formed on a base surface FL representing the surface of a base 25 or an existing weld bead (not shown) of a lower layer, and a narrow portion is formed between the pair of weld beads. In this case, in the direction perpendicular to the bead formation direction (the left-right direction in FIG. 11), the distance between the model lower ends Pb1, Pb2 at the bottom of the valley formed by a pair of models BMa, BMb representing the weld beads is defined as a bottom distance U, and the distance between the top Pt1 of one model BMa and the top Pt2 of the other model BMb is defined as a bead distance W. The bottom distance U may be the distance in the longitudinal direction of the pair of models BMa, BMb (the distance in the direction from the start end to the end end of the bead formation). In addition, the average value of the height from the base surface FL to the top Pt1 of the model BMa and the height from the base surface FL to the top Pt2 of the model BMb is defined as an average height H. The average height H corresponds to the valley depth of the valley formed by the pair of models BMa and BMb in the lamination direction. The bottom interval U, the bead interval W, and the average height H may be used as the feature quantities of the narrow portion.

[0046] The calculation of U, W, and H described above may be performed by preparing a model function that simulates the shape of the narrow portion in advance and fitting this model function to the shape of the narrow portion. For example, a specific reference profile function that can approximate the shape of the narrow portion of the profile Prf may be selected using the above-mentioned profile Prf, and the selected reference profile function may be fitted to set a feature amount according to a parameter value of the function. The reference profile function may be, for example, a quadratic curve, a hyperbola, a Gaussian curve, an arc with a specific radius of curvature, a V-shaped line with a specific angle, or the like.

[0047] Next, based on the feature amount of the narrow portion calculated as described above and information on the lamination conditions of the weld bead forming the narrow portion, the occurrence of a defect or the size of the defect is predicted (S6). The lamination condition acquisition unit 210 shown in Fig. 2 obtains the lamination conditions of the weld bead forming the narrow portion extracted by the narrow portion extraction unit 37 by referring to the lamination plan. The obtained information on the lamination conditions and the feature amount information of the narrow portion output from the feature amount calculation unit 39 are input to the defect determination unit 250.

[0048] 12 is a functional block diagram of the defect determination unit 250 included in the defect prediction device 200. The defect determination unit 250 determines whether a defect will occur in a narrow portion based on the input stacking conditions and feature amount information of the narrow portion. If a defect will occur, the defect determination unit 250 may predict the size of the defect.

[0049] Here, the defect size means a size including a cross-sectional area or length in a cross section perpendicular to the longitudinal direction of the weld bead. Specific examples of the defect size include the diameter (equivalent circle diameter) when the shape of the defect is approximated by a perfect circle, the cross-sectional area of ​​the approximated circle, the area of ​​the observed defect, and the major axis length and minor axis length of an ellipse when the shape of the defect is approximated by an ellipse.

[0050] The defect determination unit 250 may predict defects by using a prediction model that is generated by performing machine learning in advance on the relationship between the lamination conditions and information on the narrow portion and the presence or absence of defects or the defect size. In this case, the defect determination unit 250 includes a data acquisition unit 55 and a learning unit 57, and the learning unit 57 repeatedly learns various learning data acquired from the data acquisition unit 55 to generate a prediction model 59. Examples of means by which the learning unit 67 generates the prediction model 59 include known means such as a decision tree, linear regression, random forest, support vector machine, Gaussian process regression, and neural network. When the lamination conditions and feature amount information of the narrow portion described above are input, the generated prediction model 59 outputs information on the presence or absence of defects or the defect size.

[0051] In addition to machine learning, the defect determination unit 250 may simply compare the penetration depth corresponding to the lamination conditions with the depth of the narrow portion and determine that a defect will occur if the difference is greater than a predetermined threshold. In this way, various methods can be used as a method for predicting defects.

[0052] Next, a description will be given of the results of a verification in which a plurality of rows of weld beads are formed, a narrow portion is formed in a part of the weld beads, and defects in the narrow portion are predicted. 13 is a model diagram showing the lamination plan for a structure made of multiple weld beads. This structure is formed by adjacently placing multiple parallel weld beads along one direction (x direction) on the xy plane. Some of the multiple weld beads have gaps 61 and 63 with widths Wa and Wb as defects within the total length Wt.

[0053] Fig. 14 is a graph showing the height distribution of the model in a cross section taken along line XIV-XIV in Fig. 13. The profile Prf shown here represents height information of the point cloud extracted from the model shown in Fig. 13. It can be seen that the profile Prf has a narrow portion 65 corresponding to the void portion 61.

[0054] Figure 15 is an image showing the result of visualizing the point cloud information extracted from the model diagram of Figure 13. In this image, the voids 61 and 63 shown in Figure 13 appear clearly, and it can be seen from the pixel values ​​that they affect the height of the surrounding models.

[0055] Fig. 16 is an image showing the result of emphasizing the narrow parts by image processing the image shown in Fig. 15. This image is produced by performing image processing such as binarization and differentiation on the image shown in Fig. 15, emphasizing the narrow parts having particularly steep slopes. From the image in Fig. 16, it can be seen that gap 61 has a larger pixel value and a wider range than gap 63.

[0056] Then, feature quantities of the narrow portions were extracted from the image in Fig. 16, and defects were predicted using the trained prediction model. As a result, the defect sizes were predicted to be 1.73 mm for void 61 and 0.73 mm for void 63. The actual measured dimensions of the defects (voids) were 1.77 mm for void 61 and 0.55 mm for void 63. Therefore, it was verified that this method can predict the presence or absence of defects and their sizes with sufficient accuracy.

[0057] As described above, even if the object has a complicated three-dimensional shape and is difficult to grasp, the shape can be modeled and converted into point cloud information to obtain image information that can be easily grasped for each layer to be laminated. Then, by applying appropriate image processing to the image information, information such as unevenness distribution and excess or deficiency of the laminate height can be visually grasped easily. This makes it easier to evaluate the flatness of the laminated surface, and makes it easier to identify the defective positions and states of defects such as underfill areas and excessive welding areas in the laminated manufacturing. Therefore, the laminated plan can be easily corrected to an appropriate plan by feeding back the information so as not to cause defects.

[0058] In addition, since the defect information is extracted by image processing, the defect information can be obtained easily and with high accuracy compared to the case where the defect is directly identified by, for example, applying the model shape of the narrow part from the actual measurement value of the shape or the point cloud information obtained from the model. By using a prediction model that determines the relationship between the feature amount and lamination conditions of the narrow part and the defect, the occurrence of the defect and the size of the defect that occurs can be predicted at the planning stage before modeling, and the lamination plan can be easily reviewed. In other words, it is possible to simulate the occurrence of the defect, and the quality of the lamination plan can be analytically determined without actually modeling. In addition, by obtaining the prediction model by machine learning, it is possible to reliably predict the defect even if the details of the mechanism of the defect occurrence cannot be understood.

[0059] The present invention is not limited to the above-described embodiments, and the present invention also contemplates the mutual combination of the various components of the embodiments, as well as modifications and applications by those skilled in the art based on the description in the specification and well-known techniques, and these are included in the scope of protection sought.

[0060] As described above, the present specification discloses the following: (1) An image information generating device that generates image information representing a shape of a structure formed by laminating layers each made of a plurality of weld beads, comprising: a coordinate information acquisition unit that approximates a design shape of each layer of the object using a model that imitates a shape of the weld bead, and acquires coordinate information of a plurality of points of the approximated model; a profile extraction unit that obtains a profile representing a surface shape of the specified layer from the coordinate information; an image information conversion unit that converts the uneven shape of the surface of the specified layer into image information using the profile; An image information generating device comprising: According to this image information generating device, the design shape of the object is approximated by a model that mimics the bead shape, a profile that represents the surface shape of the model is obtained, and the uneven shape of the surface of the object is converted into image information using this profile. As a result, even if the object has a complex three-dimensional shape, the surface shape of each layer can be confirmed using image information, making it easier to visually grasp the distribution of unevenness, excess or deficiency of stacking height, etc.

[0061] (2) The image information generating device according to (1), wherein the image information includes difference information between the stack height of the specified layer and the planned height of the layer. This image information generating device makes it easier to identify locations where underfill occurs during additive manufacturing, locations where there is an excess or deficiency of weld beads, etc.

[0062] (3) The image information generating device according to (1), wherein the image information includes information indicating a gradient distribution formed by the unevenness of the surface shape. This image information generating device makes it easier to evaluate the flatness of the surface shape of a model.

[0063] (4) a narrow portion extraction unit that performs image processing to extract a concave narrow portion formed by the weld bead from the image information generated by the image information generating device according to any one of (1) to (3); a feature amount calculation unit that calculates a feature amount including either a position or a size of the extracted narrow portion; An image processing device comprising: According to this image processing device, narrow portions are extracted by image processing and feature amounts are calculated, so that processing can be performed more simply and with higher accuracy than, for example, a method of specifying the narrow portion by fitting a model shape of the narrow portion.

[0064] (5) An image information generating device according to any one of (1) to (3), a narrow portion extraction unit that extracts a concave narrow portion formed by the weld bead from the image information generated by the image information generating device through image processing; a feature amount calculation unit that calculates a feature amount including either a position or a size of the extracted narrow portion; a lamination condition acquisition unit that acquires lamination conditions of the weld bead that forms the narrow portion; a defect determination unit that predicts the presence or absence of a defect that will occur in the narrow portion in the object or a size of the defect, based on the feature amount of the narrow portion and the lamination condition of the narrow portion; A defect prediction apparatus comprising: This defect prediction device extracts narrow areas through image processing and calculates feature values, so feature values ​​can be obtained easily and with high accuracy. In addition, by predicting defects based on feature values ​​and lamination conditions, defects can be predicted at the design stage before modeling, and lamination plans can be revised.

[0065] (6) The defect prediction device described in (5), wherein the defect judgment unit predicts the presence or absence of the defect or the size of the defect based on the feature of the narrow portion calculated by the feature calculation unit and the lamination conditions acquired by the lamination condition acquisition unit from a prediction model obtained by machine learning of the relationship between the feature and the lamination conditions of the narrow portion and the presence or absence of the defect or the size of the defect. This defect prediction device uses a machine-learned prediction model, making it possible to predict defects even if the details of the mechanism by which the defects occur cannot be understood.

[0066] (7) An image information generating method for generating image information representing a shape of a structure formed by laminating layers each made of a plurality of weld beads, comprising the steps of: approximating a design shape of each layer of the object using a model that imitates a shape of the weld bead, and acquiring coordinate information of a plurality of points of the approximated model; A profile representing a surface shape of the specified layer is obtained from the coordinate information; converting the uneven shape of the surface of the specified layer into image information using the profile; A method for generating image information.

[0067] (8) Extracting a concave narrow portion formed by the weld bead from the image information generated by the image information generating method according to (7) by image processing; Calculating a feature amount including either the position or the size of the extracted narrow portion; Image processing methods.

[0068] (9) Extracting a concave narrow portion formed by the weld bead from the image information generated by the image information generating method according to (7) by image processing; Calculating a feature amount including either the position or the size of the extracted narrow portion; Acquire lamination conditions for the weld beads that form the narrow portion; predicting the presence or absence of a defect occurring in the narrow portion in the object or a size of the defect according to the feature amount of the narrow portion and the lamination condition of the narrow portion; Defect prediction methods.

[0069] (10) A program for executing a procedure for generating image information representing a shape of a structure formed by stacking layers each made of a plurality of weld beads, the program comprising: On the computer, approximating a design shape of each layer of the object using a model that imitates a shape of the weld bead, and acquiring coordinate information of a plurality of points of the approximated model; determining a profile representing a surface shape of the specified layer from the coordinate information; a step of converting the uneven shape of the surface of the specified layer into image information using the profile; A program for executing.

[0070] (11) To a computer: extracting a concave narrow portion formed by the weld bead from the image information generated by the program according to (10) by image processing; A step of calculating a feature amount including either a position or a size of the extracted narrow portion; A program for executing.

[0071] (12) To a computer: extracting a concave narrow portion formed by the weld bead from the image information generated by the program according to (10) by image processing; A step of calculating a feature amount including either a position or a size of the extracted narrow portion; A step of acquiring a lamination condition of the weld bead forming the narrow portion; a step of predicting the presence or absence of a defect occurring in the narrow portion in the object or a size of the defect, based on the feature amount of the narrow portion and the lamination condition of the narrow portion; A program for executing. [Explanation of symbols]

[0072] 11 Modeling Department 13 Control device 15 Manipulator 17 Manipulator control section 19 Filler metal supply section 19a Reel 19b Payout mechanism 21 Heat source control unit 23 Welding Torch 25 Base 31 Coordinate information acquisition unit 33 Profile Extraction Unit 35 Image information conversion section 37 Narrow area extraction part 39 Feature Calculation Unit 51 images 53 Recess 55 Data Acquisition Section 57 Learning Department 59 Predictive Models 61,63 Cavity 65 Narrow area 100 Additive manufacturing equipment 200 Defect Prediction Device 210 Lamination condition acquisition unit 220 Image information generating device 230 Image Processing Device 240 Display section 250 Defect Judgment Section B Weld bead BM, BM1, BM2 unit model BMa, BMb model FL Base surface H Average height M filler metal P point Prf Profile Pb1, Pb2 model bottom end Pt Pitch Pt1,Pt2 top U bottom spacing W Bead Spacing Wa, Wb Width Wk Sculpture Wt total length

Claims

1. An image information generating device that generates image information representing a shape of a shaped object in which layers each made of a plurality of weld beads are laminated, comprising: a coordinate information acquisition unit that approximates a design shape of each layer of the object using a model that imitates a shape of the weld bead, and acquires coordinate information of a plurality of points of the approximated model; a profile extraction unit that obtains a profile representing a surface shape of the specified layer from the coordinate information; an image information conversion unit that converts the uneven shape of the surface of the specified layer into image information using the profile; An image information generating device comprising:

2. The image information includes difference information between the stack height of the specified layer and the planned height of the layer.

2. The image information generating device according to claim 1.

3. the image information includes information indicating a gradient distribution formed by the unevenness of the surface shape, 2. The image information generating device according to claim 1.

4. a narrow portion extraction unit that performs image processing to extract a concave narrow portion formed by the weld bead from the image information generated by the image information generating device according to any one of claims 1 to 3; a feature amount calculation unit that calculates a feature amount including either a position or a size of the extracted narrow portion; An image processing device comprising:

5. An image information generating device according to any one of claims 1 to 3; a narrow portion extraction unit that extracts a concave narrow portion formed by the weld bead from the image information generated by the image information generating device through image processing; a feature amount calculation unit that calculates a feature amount including either a position or a size of the extracted narrow portion; a lamination condition acquisition unit that acquires lamination conditions of the weld bead that forms the narrow portion; a defect determination unit that predicts the presence or absence of a defect that will occur in the narrow portion in the object or a size of the defect, based on the feature amount of the narrow portion and the lamination condition of the narrow portion; A defect prediction apparatus comprising:

6. the defect determination unit predicts the presence or absence of the defect or the size of the defect based on the feature amount of the narrow portion calculated by the feature amount calculation unit and the lamination condition acquired by the lamination condition acquisition unit, from a prediction model obtained by machine learning of a relationship between the feature amount and the lamination condition of the narrow portion, and the presence or absence of the defect or the size of the defect. The defect prediction apparatus according to claim 5 .

7. 1. An image information generating method for generating image information representing a shape of a structure in which layers each made of a plurality of weld beads are laminated, comprising the steps of: approximating a design shape of each layer of the object using a model that imitates a shape of the weld bead, and acquiring coordinate information of a plurality of points of the approximated model; A profile representing a surface shape of the specified layer is obtained from the coordinate information; converting the uneven shape of the surface of the specified layer into image information using the profile; Image information generation method.

8. extracting a concave narrow portion formed by the weld bead from the image information generated by the image information generating method according to claim 7 by image processing; Calculating a feature amount including either the position or the size of the extracted narrow portion; Image processing methods.

9. extracting a concave narrow portion formed by the weld bead from the image information generated by the image information generating method according to claim 7 by image processing; Calculating a feature amount including either the position or the size of the extracted narrow portion; Acquire lamination conditions for the weld beads that form the narrow portion; predicting the presence or absence of a defect occurring in the narrow portion in the object or a size of the defect according to the feature amount of the narrow portion and the lamination condition of the narrow portion; Defect prediction methods.

10. A program for executing a procedure for generating image information representing a shape of a structure formed by laminating layers each made of a plurality of weld beads, the program comprising: On the computer, approximating a design shape of each layer of the object using a model that imitates a shape of the weld bead, and acquiring coordinate information of a plurality of points of the approximated model; determining a profile representing a surface shape of the specified layer from the coordinate information; a step of converting the uneven shape of the surface of the specified layer into image information using the profile; A program for executing the above.

11. On the computer, extracting a concave narrow portion formed by the weld bead from the image information generated by the program according to claim 10 through image processing; A step of calculating a feature amount including either a position or a size of the extracted narrow portion; A program for executing the above.

12. On the computer, extracting a concave narrow portion formed by the weld bead from the image information generated by the program according to claim 10 through image processing; A step of calculating a feature amount including either a position or a size of the extracted narrow portion; A step of acquiring a lamination condition of the weld bead forming the narrow portion; a step of predicting the presence or absence of a defect occurring in the narrow portion in the object or a size of the defect, based on the feature amount of the narrow portion and the lamination condition of the narrow portion; A program for executing the above.

Images