Defective-product image generation device, defective-product image generation method, and program

Abstract

Provided is a defective-product image generation device for generating a defective-product image having a defect region, the defective-product image generation device comprising: a non-defective-product image acquisition unit for acquiring a non-defective-product image including an edge portion; an edge designation unit for designating a defect region generation edge for the generation of the defect region from among the edge portions; a relative position designation unit for designating the relative position of the defect region to be generated with respect to the edge portion; and a defective-product image generation unit for generating a defective-product image having the defect region in a region including the defect region generation edge on the basis of the defect region generation edge and the relative position.

Description

Defective product image generating device, defective product image generating method, and program

[0001] The present invention relates to a defective product image generating device, a defective product image generating method, and a program.

[0002] A component inspection device that uses a machine learning model to generate images of defective components and then inspects the components is known (see, for example, Patent Document 1). [Prior Art Literature] [Patent Document] Patent Document 1: JP 2022-108855 A Problem to be solved

[0003] A defective product image generating device is provided for generating a defective product image in which a defective portion is generated at a desired position. General disclosure

[0004] In a first aspect of the present invention, there is provided a defective product image generation device for generating a defective product image having a defective part, the defective product image generation device comprising: a good product image acquisition unit that acquires a good product image including an edge part; an edge designation unit that designates a defective part generation edge among the edge parts that will generate the defective part; a relative position designation unit that designates a relative position of the defective part to be generated with respect to the edge part; and a defective product image generation unit that generates a defective product image having the defective part in an area that includes the defective part generation edge based on the defective part generation edge and the relative position.

[0005] In the defective product image generating device, the non-defective product image may include a first region and a second region bounded by the edge portion, and the relative position designation unit may designate at least one of the first region side and the second region side as the relative position.

[0006] In any of the above-described defective product image generating devices, the relative position specifying unit may specify a segment area including the edge portion, and the edge specifying unit may specify the defect portion generation edge from the edge portion of the segment area.

[0007] In any of the above-described defective product image generating devices, the edge specifying unit may specify the defect portion generation edge from the edge portion of the non-defective product image, and the relative position specifying unit may specify a segment area including the defect portion generation edge.

[0008] In any of the above-described defective product image generating devices, the edge specifying section may set a predetermined virtual line and specify an intersection between the virtual line and the edge section as the defect portion generating edge.

[0009] In any of the above-described defective product image generating devices, the edge designation unit may set an angle of a virtual line extending from a predetermined reference point, and designate an intersection of the virtual line and the edge portion as the defect portion generation edge.

[0010] Any of the above-described defective product image generating devices may include a property designation unit that designates properties of the defective portion.

[0011] In any of the above-described defective product image generating devices, the property designation unit may designate the material of the defective portion to be generated in the defective product image, the form of the defective portion to be generated in the defective product image, the defect mode of the defective portion to be generated in the defective product image, or the number of the defective portions to be generated in the defective product image.

[0012] In any of the above-described defective product image generation devices, the edge designation unit may set a virtual line extending from a predetermined reference point and designate an intersection of the virtual line and the edge portion as the defect portion generation edge, and the property designation unit may designate the property of the defect portion according to at least one of a distance from the reference point to the intersection point and an angle of the virtual line extending from the reference point.

[0013] In any of the above-described defective product image generating devices, the property designation unit may display a setting screen for setting a method for designating the property according to at least one of the distance and the angle.

[0014] In any of the above-described defective product image generation devices, the defective product image generation unit may input the defect portion generation edge and the relative position to a pre-trained image generation model, and generate a defective product image having the defect portion in an area including the defect portion generation edge.

[0015] In any of the above-described defective product image generating devices, the defective portion may have a protruding portion that protrudes from one side of the edge portion to the other side, with the edge portion as a boundary.

[0016] In any of the above-described defective product image generation devices, the property designation section may designate the size of the protruding portion.

[0017] In a second aspect of the present invention, there is provided a defective product image generation method for generating a defective product image having a defective part, the method comprising the steps of: a computer acquiring a non-defective product image including an edge portion; a computer specifying, from the edge portion, a defect part generation edge that generates the defective part; a computer specifying a relative position of the defect part to be generated with respect to the edge portion; and a computer generating a defective product image having the defective part in an area including the defect part generation edge, based on the defect part generation edge and the relative position.

[0018] In a third aspect of the present invention, there is provided a program for realizing a defective product image generation method for generating a defective product image having a defective part, which, when executed by a computer, causes the computer to acquire a good product image including an edge portion, specify a defective part generation edge from the edge portion that will generate the defective part, specify a relative position of the defective part to be generated with respect to the edge portion, and generate a defective product image having the defective part in an area that includes the defective part generation edge, based on the defective part generation edge and the relative position.

[0019] The above summary of the invention does not list all of the features of the present invention, and subcombinations of these features may also be inventions.

[0020] 1 shows an example of the configuration of the defective product image generating device 100. 1 shows an example of an operational flowchart of a defective product image generating method. 1 shows an example of an object 200. 1 shows an example of a method of specifying a defective portion generation edge Eb. 1 shows an example of a method of specifying a relative position Pr. 1 shows an example of a defective portion Rd. 1 shows an example of a method of generating a defective product image Ib. 1 shows a modified example of a method of generating a defective product image Ib. 1 shows a modified example of a method of generating a defective product image Ib. 1 shows a modified example of a method of generating a defective product image Ib. 1 shows a modified example of a method of generating a defective product image Ib. 1 shows a modified example of a method of generating a defective product image Ib. 1 shows a modified example of a method of generating a defective product image Ib. 1 shows a modified example of a method of generating a defective product image Ib. 1 shows a modified example of a method of generating a defective product image Ib. 1 shows a modified example of a property specification screen for specifying a property Pd. 1 shows a modified example of a method of generating a defective product image Ib. 1 shows a modified example of a method of generating a defective product image Ib. 1 shows an example of a property specification screen for specifying a property Pd ...

[0021] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention as claimed. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0022] 1A shows an example of the configuration of a defective product image generation device 100. The defective product image generation device 100 includes a non-defective product image acquisition unit 10, an edge designation unit 20, a relative position designation unit 30, and a defective product image generation unit 40. The defective product image generation device 100 may also include a property designation unit 50, a storage unit 60, and an image generation model 70.

[0023] The defective product image generation device 100 generates a defective product image Ib including a defective portion Rd. The defective portion Rd may be a defect such as a flaw, scratch, dent, distortion, noise, crack, or attachment. The defective product image generation device 100 may generate a defective product image Ib in which the defective portion Rd is formed along an edge portion Pe of the non-defective product image Ig.

[0024] The good-quality image acquisition unit 10 acquires a good-quality image Ig. The good-quality image Ig is an image of the object 200, which will be described later, and includes an edge portion Pe of the object 200. The good-quality image acquisition unit 10 may acquire the good-quality image Ig from a user. The good-quality image acquisition unit 10 may acquire a good-quality data set including a plurality of good-quality images Ig. The good-quality image acquisition unit 10 may store the acquired good-quality image Ig in the storage unit 60. The good-quality image acquisition unit 10 may acquire the good-quality image Ig stored in the storage unit 60. The good-quality image acquisition unit 10 may input the good-quality image Ig to the defective image generation unit 40.

[0025] The edge portion Pe may be an edge that indicates the outline of the end of the object 200, or an edge that indicates a step in the object 200. The edge portion Pe is not limited to the outline of the object 200, but may also be an edge that indicates a specific pattern or design of the object 200. The edge portion Pe may also be a character attached to the object 200.

[0026] The edge designation unit 20 designates a defect portion generation edge Eb from the edge portion Pe that generates a defect portion Rd. The edge designation unit 20 may allow a user to designate the defect portion generation edge Eb using an input device such as a mouse. The defect portion generation edge Eb may be designated by the user tracing the edge portion Pe. The defect portion generation edge Eb may also be designated by designating a segment area including the edge portion Pe. The edge designation unit 20 may designate one defect portion generation edge Eb from the edge portion Pe, or may designate multiple defect portion generation edges Eb from the edge portion Pe. The edge designation unit 20 may input information about the designated defect portion generation edge Eb to the defective product image generation unit 40. The edge designation unit 20 may acquire position data about the edge portion Pe to identify the position of the edge portion Pe, or may identify the edge portion Pe from the non-defective product image Ig. In one example, the edge designation unit 20 designates the edge portion Pe of the object 200 from segment information of the object 200 that includes information about the edge portion Pe. The edge designation unit 20 may directly identify the edge portion Pe from the image data of the non-defective image Ig.

[0027] The relative position designation unit 30 designates the relative position Pr of the defective portion Rd with respect to the edge portion Pe. The relative position Pr may be any value that can designate the relative position, direction, angle, or distance of the defective portion Rd with respect to the edge portion Pe. The method for designating the relative position Pr is not particularly limited. The relative position designation unit 30 may allow a user to designate the relative position Pr using an input device such as a mouse. The relative position designation unit 30 may designate the relative position Pr based on relative position designation information Ir, which will be described later. The relative position designation unit 30 may designate the relative position Pr by drawing on the non-defective image Ig, by painting, by marking the relative position Pr, by using a grid, or by using coordinate data. The relative position designation unit 30 may input information regarding the designated relative position Pr to the defective image generation unit 40.

[0028] The relative position Pr may be information specifying one of two regions divided by the edge portion Pe. For example, when an edge portion Pe extending vertically divides a region into left and right, the relative position Pr specifies the region on the left or right side of the edge portion Pe. In this way, the relative position Pr may specify the direction of the position where the defect portion Rd is to be formed relative to the edge portion Pe. The relative position Pr may also specify the distance from the edge portion Pe to the position where the defect portion Rd is to be formed. For example, the relative position Pr specifies the distance from the edge portion Pe to the center of the defect portion Rd.

[0029] The defective product image generating unit 40 generates a defective product image Ib having a defective part Rd based on the defect part generating edge Eb and the relative position Pr. The defective product image generating unit 40 forms the defective part Rd in a region including the defect part generating edge Eb. The defective part Rd may be formed in contact with the defect part generating edge Eb or may be formed so as to overlap with the defect part generating edge Eb. The defective part Rd may be formed so that at least a portion of the defective part Rd overlaps with the defect part generating edge Eb. The defective part Rd may be formed beyond the defect part generating edge Eb from one region sandwiching the defect part generating edge Eb to the other region.

[0030] The defective product image generation unit 40 may output the generated defective product image Ib. The defective product image generation unit 40 may display the defective product image Ib on a display unit such as a monitor, or may transmit the defective product image Ib to the storage unit 60 and store it in the storage unit 60. The defective product image generation unit 40 may transmit the defective product image Ib to an external unit outside the defective product image generation device 100. The defective product image generation unit 40 may have an evaluation unit that evaluates the quality of the generated defective product image Ib. The defective product image generation unit 40 may cause the image generation model 70 to learn the generated defective product image Ib.

[0031] The property specification unit 50 specifies a property Pd of the defect location Rd. The property Pd specifies the conditions for forming the defect location Rd. The property specification unit 50 may display a specification screen for the property Pd to allow the user to select the property Pd. The property specification unit 50 may display an input field for specifying the property Pd to allow the user to input the property Pd, or may display a slider bar or the like to allow the user to select.

[0032] The property Pd may be the material of the defective portion Rd to be generated in the defective product image Ib, the shape of the defective portion Rd to be generated in the defective product image Ib, the defect mode of the defective portion Rd to be generated in the defective product image Ib, or the number of the defective portions Rd to be generated in the defective product image Ib. The property specifying unit 50 may specify at least one of these properties Pd.

[0033] The form of the defect portion Rd may include at least one of the area, major axis, angle, degree of distortion, shape, scratch depth, color, brightness, hue, saturation, and texture of the defect portion Rd. The form of the defect portion Rd may also include the magnification of the defect portion Rd when applying the defect portion Rd to the non-defective image Ig, the number of area pixels, or the number of major axis pixels.

[0034] The failure mode of the defective portion Rd may include at least one of a defect, a scratch, a dent, a distortion, noise, a crack, or an attachment of the defective portion Rd. The property specifying unit 50 may specify a plurality of failure modes of the defective portion Rd. In this case, the defective image generating unit 40 may generate a plurality of defective portions Rd in one defective image Ib, or may generate a plurality of defective portions Rd of different failure modes in each of the plurality of defective images Ib.

[0035] The number of defective points Rd may be one or more. The number of defective points Rd may be the number of defective points Rd generated in one defective product image Ib. In other words, when there are multiple defective points Rd, multiple defective points Rd may be generated in one defective product image Ib, and multiple defective points Rd may be generated in one target object 200.

[0036] The storage unit 60 may store the defective product image Ib generated by the defective product image generation unit 40. The storage unit 60 may store the defect portion generation edge Eb specified by the edge specification unit 20, and may store the relative position Pr specified by the relative position specification unit 30. The storage unit 60 may store the defect portion generation edge Eb and the relative position Pr in association with the defective product image Ib.

[0037] The image generation model 70 may include at least one of a generative model, a machine learning model including a multimodal model, or a simulation that generates data. The image generation model 70 may be provided outside the defect image generation device 100. The image generation model 70 may be a pre-trained image generator such as a generative adversarial network (GAN) or a diffusion model.

[0038] The defective product image generating unit 40 may input the defect portion generating edge Eb and the relative position Pr to a pre-trained image generation model 70, and generate a defective product image Ib having a defect portion Rd in an area including the defect portion generating edge Eb. The defective product image generating device 100 may input the good product image Ig, the defect portion generating edge Eb, the relative position Pr, and the defective product image Ib to the image generation model 70 for training.

[0039] The defective product image generation device 100 of this example can generate a defective portion Rd at a desired position along the edge portion Pe of the non-defective product image Ig. This allows the defective product image generation device 100 to generate a defective product image Ib having a natural defective portion Rd along the edge portion Pe. The defective product image generation device 100 can prevent the defective portion Rd from unintentionally extending beyond the edge portion Pe.

[0040] 1B shows an example of an operational flowchart of the defective product image generating method. In step S100, a non-defective product image Ig including an edge portion Pe is acquired. In step S102, a defect portion generation edge Eb that generates a defect portion Rd within the edge portion Pe is specified. In step S104, a relative position Pr of the defect portion Rd with respect to the edge portion Pe is specified. In step S106, a defective product image Ib having a defect portion Rd in an area including the defect portion generation edge Eb is generated based on the defect portion generation edge Eb and the relative position Pr.

[0041] Step S102 may be executed before or after step S104. That is, the relative position Pr may be specified after specifying the defect-point generating edge Eb, or the relative position Pr may be specified before specifying the defect-point generating edge Eb.

[0042] When specifying the property Pd, the property Pd may be specified before specifying the defect-location generating edge Eb, or before specifying the relative position Pr. The property Pd may be specified after specifying the defect-location generating edge Eb, or after specifying the relative position Pr. The property Pd may be specified after specifying both the defect-location generating edge Eb and the relative position Pr.

[0043] FIG. 2 shows an example of an object 200. The object 200 may be an industrial product such as a screw, food, or a household item. However, the type of object 200 is not limited to these. In one example, the object 200 is a metal product, an automobile part, or a ceramic product. In this example, the edge portion Pe indicates the outline of the industrial product. The defective product image generation device 100 may obtain information about the edge portion Pe by taking a segment of the entire object 200.

[0044] The non-defective product image Ig may be a black and white image, a grayscale image, or a color image. The non-defective product image Ig may be an image of the entire object 200 or an image of a part of the object 200.

[0045] 3A shows an example of a method for specifying the defect-region generating edge Eb. In this example, the defect-region generating edge Eb is specified using an enlarged view of the area A in FIG. 2, but the defect-region generating edge Eb may also be specified using an overall view of the non-defective image Ig.

[0046] The defect portion generation edge Eb may be specified by the user by drawing it on the object 200 displayed on the screen. The defect portion generation edge Eb specifies the position on the edge portion Pe where the defect portion Rd is to be generated. The defect portion generation edge Eb may be input by the user by drawing a line along the edge portion Pe, by the user filling in an area along the edge portion Pe, or by the user roughly filling in the vicinity of the edge portion Pe. The defect portion generation edge Eb may be automatically specified based on past history or the like, or may be semi-automatically specified such that the computer automatically specifies the defect portion Eb after the user specifies a rough position using text information. In this example, the defect portion generation edge Eb is specified on a two-dimensional image, but the defect portion generation edge Eb may also be specified using three-dimensional data.

[0047] 3B shows an example of a method for specifying the relative position Pr. In this example, the relative position Pr is specified by the relative position specification information Ir. In this example, the relative position Pr is specified using an enlarged view of the area A in FIG. 2, but the relative position Pr may also be specified using an overall view of the non-defective product image Ig.

[0048] The relative position designation information Ir designates the relative position Pr of the defect location Rd with respect to the edge portion Pe. The relative position designation information Ir may be information input on the screen, coordinate data, text information, or information selected using a predetermined selection button. The relative position designation information Ir in this example is input by the user drawing it on the object 200 displayed on the screen. The relative position designation information Ir in this example is drawn so as to include the edge portion Pe. The relative position Pr may be automatically designated based on past history or the like, or may be semi-automatically designated by a computer after the user designates a rough relative position using text information.

[0049] 3C shows an example of a defect point Rd. In this example, the defect point Rd is generated at a position specified by the defect point generation edge Eb and the relative position specification information Ir. The defective product image Ib in this example includes one defect point Rd, but may also include multiple defect points Rd.

[0050] The defective product image production device 100 of this example can generate a defective part Rd by specifying a defect part generation edge Eb and a relative position Pr with respect to the edge part Pe. That is, the defective product image production device 100 of this example can generate a defective part Rd at a desired position without setting a closed area as the area where the defective part Rd is to be generated. The defective product image production device 100 of this example can form a natural-looking defect part Rd at a desired position.

[0051] 4A shows an example of a method for generating a defective product image Ib. In this example, the defect portion generating edge Eb and the relative position designation information Ir are designated on the same screen. In this example, the relative position designation information Ir is designated before the defect portion generating edge Eb, but the defect portion generating edge Eb may be designated before the relative position designation information Ir.

[0052] The relative position designation information Ir may be a line drawn by the user. The relative position designation information Ir may be input by the user in one stroke on the object 200. By designating the relative position designation information Ir, the relative position Pr of the defect point Rd with respect to the edge portion Pe is determined. In this example, the relative position designation information Ir is designated inside the object 200 with respect to the edge portion Pe, so the relative position Pr is inside the edge portion Pe. The defect point generation edge Eb is drawn so as to designate at least a part of the edge portion Pe.

[0053] The defect point Rd is generated so as to include at least the defect point generation edge Eb. The region where the defect point Rd is generated is a region that includes the defect point generation edge Eb and satisfies the relative position Pr from the edge part Pe. In this way, by specifying the defect point generation edge Eb and the relative position designation information Ir, the defect point Rd can be generated at a desired position. In this example, the defect point Rd is generated inside the region designated by the relative position designation information Ir, but it may also be generated so as to extend outside the region designated by the relative position designation information Ir.

[0054] 4B shows a modified example of the method for generating the defective product image Ib. The difference from the example in FIG. 4A is that the defective portion Rd in this example is also generated outside the area specified by the relative position specification information Ir.

[0055] The defect point Rd is generated in an area including the defect point generation edge Eb and specified by the relative position Pr with respect to the edge part Pe. Whether or not the defect point Rd is generated outside the relative position designation information Ir may be determined by inputting a property Pd indicating the size of the defect point Rd, or by displaying a button for the user to select so that the user can make the decision. Furthermore, whether or not the defect point Rd is generated outside the relative position designation information Ir may be determined depending on the mode used when inputting the relative position designation information Ir. For example, when the input mode for the relative position designation information Ir is a line drawing mode or a point input mode, the defect point Rd is allowed to be generated outside the relative position designation information Ir. On the other hand, when the input mode for the relative position designation information Ir is a segment area designation mode, the defect point Rd may be generated inside the relative position designation information Ir.

[0056] 4C shows a modified example of the method for generating the defective product image Ib. This example differs from the method for generating the defective product image Ib in FIG. 4A in that the relative position designation information Ir is designated by a segment area.

[0057] The relative position designation unit 30 designates a segment area including the edge portion Pe. The relative position designation information Ir, which is the segment area, may be designated by the user, or may be automatically designated by acquiring segment information from an image of the object 200. The segment area may be designated by drawing its periphery, or may be designated by copying and pasting a segment area of ​​a predetermined shape. The relative position designation information Ir in this example is a segment area designated by drawing its periphery. The periphery of the segment area in this example coincides with the edge portion Pe of the object 200, but may be different from the edge portion Pe.

[0058] The edge designation unit 20 designates a defect-point generation edge Eb from the edge portion Pe of the segment area designated by the relative position designation unit 30. That is, the edge designation unit 20 designates the edge portion Pe that overlaps with the segment area as the defect-point generation edge Eb. In this example, the user designates the defect-point generation edge Eb by tracing at least a part of the edge portion Pe in the area inside the previously designated relative position designation information Ir. However, the edge designation unit 20 may designate the defect-point generation edge Eb so as to include the area outside the relative position designation information Ir as well.

[0059] The defective product image generating device 100 of this example generates a plurality of defective parts Rd in an area specified by the defect part generation edge Eb and the relative position Pr. The number of defective parts Rd may be specified by the user, or may be appropriately selected from values ​​that can be taken from past defective product images Ib.

[0060] 4D shows a modified example of the method for generating the defective product image Ib. This example differs from the method for generating the defective product image Ib in FIG. 4C in that the defect portion generation edge Eb is specified before the relative position specification information Ir.

[0061] The edge designation unit 20 designates a defect-part generation edge Eb from an edge part Pe of the non-defective image Ig. In this example, the user designates the defect-part generation edge Eb by tracing at least a part of the edge part Pe. In this example, only one defect-part generation edge Eb is designated, but multiple defect-part generation edges Eb may be designated.

[0062] The relative position designation unit 30 designates an area including the defect portion generating edge Eb. The relative position designation information Ir in this example is designated so as to overlap with the previously designated defect portion generating edge Eb. That is, the relative position designation information Ir does not need to overlap with an edge portion Pe that is not designated as the defect portion generating edge Eb. However, the relative position designation unit 30 may designate the relative position designation information Ir so as to include an edge portion Pe that is not designated as the defect portion generating edge Eb. The relative position designation unit 30 may designate multiple relative positions Pr. For example, the relative position designation unit 30 may designate a relative position Pr for each of multiple defect portions Rd. The relative position designation unit 30 may designate the inside of the object 200 as the relative position Pr for the first defect portion Rd, and designate the outside of the object 200 as the relative position Pr for the second defect portion Rd.

[0063] The defective product image generating unit 40 generates a plurality of defect points Rd in an area specified by the defect point generation edge Eb and the relative position Pr. The defective product image generating device 100 of this example first specifies the defect point generation edge Eb, and can then specify the relative position designation information Ir from within the edge part Pe specified by the defect point generation edge Eb. For example, if the defect point generation edge Eb is predetermined, the defect point generation edge Eb is first specified, and then the position for inputting the relative position designation information Ir is narrowed down, making it easier to specify the relative position Pr.

[0064] 4E shows a modified example of the method for generating the defective product image Ib. This example differs from the method for generating the defective product image Ib in FIG. 4A in that the relative position designation information Ir is designated by a point.

[0065] The relative position designation unit 30 designates the relative position designation information Ir using points. In this example, by inputting points in an inner area of ​​the object 200, an area inside the edge portion Pe is designated as the relative position Pr. Note that in this example, the defect point Rd is generated in an area different from the area designated by the points, but the defect point Rd may be generated so as to overlap with the area designated by the points. The defective product image generation device 100 may also generate the defect point Rd so that the center of the points and the center of the defect point Rd coincide with each other.

[0066] 4F shows a modified example of the method for generating the defective product image Ib. In this example, the first region 201 or the second region 202 is specified as the relative position Pr. The non-defective product image Ig includes the first region 201 and the second region 202, which are bounded by the edge portion Pe.

[0067] The first region 201 is one of the regions bounded by the edge portion Pe. The second region 202 is the region on the opposite side of the first region 201 across the edge portion Pe. When the edge portion Pe is an end portion of the object 200, the first region 201 may be the region outside the object 200, and the second region 202 may be the region inside the object 200. The ranges of the first region 201 and the second region 202 may be specified in advance as arbitrary regions.

[0068] The relative position designation unit 30 designates at least one of the first region 201 side and the second region 202 side as the relative position Pr. That is, the relative position designation unit 30 designates on which side of the first region 201 or the second region 202 the defect point Rd will be generated. The relative position designation unit 30 may designate at least one of the first region 201 and the second region 202 in accordance with a user's input. The user may select at least one of the first region 201 and the second region 202 from the non-defective product image Ig. The relative position designation unit 30 may display an arbitrary selection button to allow the user to select the relative position Pr. For example, a button for selecting the inside or outside of the object 200 may be displayed to allow the user to select the relative position Pr of the defect point Rd.

[0069] Furthermore, the relative position designation unit 30 may use the relative position designation information Ir to designate either the first region 201 or the second region 202. The relative position designation unit 30 may determine the relative position designation information Ir using any of the methods shown in Figures 4A to 4E and designate the first region 201 or the second region 202 as the relative position Pr. When both the first region 201 and the second region 202 are selected, the defective product image creation device 100 may create a defective portion Rd that straddles the edge portion Pe from the inside to the outside.

[0070] The relative position designation unit 30 may designate at least one of the first region 201 and the second region 202 depending on the type of the defective portion Rd. For example, when the failure mode of the defective portion Rd is "chipped", the relative position designation unit 30 may designate the second region 202, which is an inner region of the object 200. When the failure mode of the defective portion Rd is "adhesion", the relative position designation unit 30 may designate the first region 201, which is an outer region of the object 200.

[0071] The defective product image generation device 100 of this example generates a defective portion Rd by selecting at least one of the first region 201 and the second region 202 as the relative position Pr. The method of specifying the relative position Pr is not limited to this example as long as it is possible to select at least one of the first region 201 and the second region 202.

[0072] 5A shows a modified example of the method for generating a defective product image Ib. The defective product image generation device 100 of this example uses a virtual line Lv to specify the position where the defective portion Rd is to be generated.

[0073] The edge designation unit 20 sets a predetermined virtual line Lv and designates an intersection C between the virtual line Lv and the edge portion Pe as a defect portion generation edge Eb. The virtual line Lv may be used in combination with a method of designating a defect portion generation edge Eb in another embodiment. That is, after the defect portion generation edge Eb is designated by tracing the edge portion Pe, an edge that generates a defect portion Rd from the designated defect portion generation edge Eb may be further designated in detail by the virtual line Lv.

[0074] The defective product image generation device 100 of this example specifies the generation position of the defective portion Rd using the relative position specification information Ir and the virtual line Lv. By using the virtual line Lv, the defective product image generation device 100 can easily form the defective portion Rd at the desired position.

[0075] 5B shows a modified example of the method for generating the defective product image Ib. The defective product image generation device 100 of this example specifies the position where the defective portion Rd is to be generated by specifying the virtual line Lv and its angle θ.

[0076] The edge designation unit 20 sets an angle θ of a virtual line Lv extending from a predetermined reference point P, and designates an intersection C between the virtual line Lv and the edge portion Pe as a defect portion generation edge Eb. The virtual line Lv may be used in combination with a method of designating a defect portion generation edge Eb in another embodiment. That is, after designating the defect portion generation edge Eb by tracing the edge portion Pe, an edge that generates a defect portion Rd from the designated defect portion generation edge Eb may be further designated in detail by the virtual line Lv. In one example, when the edge portion Pe has a shape close to a circle or an ellipse, the edge designation unit 20 designates the defect portion generation edge Eb using the angle θ.

[0077] The reference point P may be set at any position. In this example, the reference point P is a corner of the area A, but is not limited to this. The reference point P may also be the center of the object 200. The angle θ is the angle from any position of the virtual line Lv that passes through the reference point P. The reference point P and the angle θ may be specified by the user.

[0078] The defective product image generation device 100 of this example can adjust the spacing between the defect points Rd when generating multiple defect points Rd by specifying the angle θ. The defective product image generation device 100 may generate multiple defect points Rd at equal intervals by changing the angle θ at predetermined intervals, or may generate one or multiple defect points Rd randomly. When the object 200 is a regular polygon, the defective product image generation device 100 may generate the defect points Rd by specifying the angle θ so that each vertex of the object 200 is designated as the defect point generation edge Eb, with the center of the object 200 as the reference point P, or may generate the defect points Rd by specifying the angle θ so that each side is designated as the defect point generation edge Eb.

[0079] 5C shows a modified example of the method for generating a defective product image Ib. In this example, the defective product image generation device 100 specifies the position where the defective portion Rd is to be generated by specifying the virtual line Lv and its angle θ. The target object 200 in this example is a screw, but is not limited to this. This figure shows an image of the screw as seen from the screw head side.

[0080] The edge designation unit 20 sets a virtual line Lv extending from a predetermined reference point P, and designates an intersection C between the virtual line Lv and the edge portion Pe as a defect portion generation edge Eb. The edge designation unit 20 of this example sets an angle θ of the virtual line Lv extending from the reference point P, and designates an intersection C between the virtual line Lv and the edge portion Pe as a defect portion generation edge Eb, but as described in FIG. 5A , it is not necessary to set the reference point P and the angle θ. The reference point P of this example is the center point of the screw as seen from the screw head side, but is not limited to this.

[0081] The property specification unit 50 specifies the property Pd of the defect point Rd according to at least one of the distance D from the reference point P to the intersection point C and the angle θ of the virtual line Lv extending from the reference point P. The property specification unit 50 may automatically specify the property Pd according to at least one of the distance D and the angle θ, or may allow the user to manually specify the property Pd. The property specification unit 50 may specify the size of the major axis of the defect point Rd as the distance D, or may specify the size as the square of the distance D. That is, the property specification unit 50 may set a relational expression between at least one of the distance D or the angle θ and the property Pd of the defect point Rd, and specify the property Pd of the defect point Rd based on the relational expression. In this example, the property specification unit 50 specifies the size of the major axis of the defect point Rd to be 20% of the distance D. Furthermore, the property specification unit 50 may specify the angle generated by the defect point Rd according to the angle θ. The property specification unit 50 in this example specifies the angle of the defect point Rd so that the major axis of the defect point Rd is perpendicular to the virtual line Lv. The property specification unit 50 may also specify the angle of the defect point Rd so that the major axis of the defect point Rd coincides with the virtual line Lv.

[0082] The property specification unit 50 of the present example specifies the size or angle of the defect point Rd as the property Pd, but may specify other properties Pd such as the material of the defect point Rd, the shape of the defect point Rd, the defect mode of the defect point Rd, or the number of defect points Rd, depending on at least one of the distance D and the angle θ. The property specification unit 50 of the present example specifies the size of the major axis of the defect point Rd depending on at least one of the distance D and the angle θ, but the size of the defect point Rd may be specified by other specification methods, such as the area of ​​the defect point Rd.

[0083] The property specification unit 50 may display a setting screen for setting a method for specifying the property Pd according to at least one of the distance D and the angle θ. The property specification unit 50 may specify the property Pd based on the specification method input by the user on the setting screen. This allows the user to specify the position, shape, etc. of the defect point Rd based on desired conditions.

[0084] 6 shows an example of a property specification screen for specifying a property Pd. The defective product image production device 100 of this example displays a property specification screen for specifying a defect location Rd. The defective product image production device 100 of this example displays a display screen 110, a display screen 112, a display screen 114, and a display screen 116. The defective product image production device 100 may display the display screen 110, the display screen 112, the display screen 114, and the display screen 116 simultaneously or on separate screens.

[0085] The display screen 110 is a screen for selecting a failure mode. When there are multiple failure modes, the display screen 110 may allow the user to select all of the failure modes, or may allow the user to select one or more arbitrary failure modes. The display screen 110 may display the types of failure modes in text or as images. The display screen 110 in this example displays the types of failure modes in a pull-down format. In this example, "chipped" is specified as the failure mode. By selecting the failure mode of the failure location Rd, it is possible to preferentially generate a failure location Rd of a desired failure mode and avoid generating a failure location Rd of an unnecessary failure mode.

[0086] The display screen 112 displays a screen for specifying the size of the defect location Rd. The display screen 112 may display a method for specifying the size of the defect location Rd, or may display a range of sizes of the defect location Rd. The display screen 112 of this example displays a screen for selecting one of the following methods for specifying the size of the defect location Rd: specifying by magnification, specifying by major axis (number of pixels), or specifying by area (number of pixels). The display screen 112 of this example displays a slider bar for specifying the size of the defect location Rd. The defective product image generation device 100 may allow the user to select the maximum and minimum values ​​of the size of the defect location Rd. The defective product image generation device 100 may generate the defect location Rd by randomly specifying the size of the defect location Rd within a range of sizes of the defect location Rd. The defective product image generation device 100 may display images of the defect location Rd with its original size, the defect location Rd with its maximum size, and the defect location Rd with its minimum size.

[0087] The display screen 114 displays a screen for specifying the angle θ of the defect point Rd. The angle θ of the defect point Rd may be the angle θ of the virtual line Lv for determining the defect point generation edge Eb. The display screen 114 in this example displays a slider bar for specifying the angle θ of the defect point Rd. The defective product image generation device 100 may allow the user to select the maximum and minimum values ​​of the angle θ of the defect point Rd. The defective product image generation device 100 may generate the defect point Rd by randomly specifying the angle θ of the defect point Rd from within a range of the angle θ. The defective product image generation device 100 may display images of the defect point Rd with the original angle θ, the defect point Rd with the maximum angle θ, and the defect point Rd with the minimum angle θ.

[0088] The display screen 116 displays a screen for specifying the degree of distortion of the defective part Rd. The degree of distortion of the defective part Rd may be selected in the range of 0 to 100. The display screen 116 in this example displays a slider bar for specifying the degree of distortion of the defective part Rd. The defective product image creation device 100 may allow the user to select the maximum and minimum values ​​of the degree of distortion of the defective part Rd. The defective product image creation device 100 may generate the defective part Rd by randomly specifying the degree of distortion of the defective part Rd from within the range of the degree of distortion. The defective product image creation device 100 may display images of the defective part Rd with the original degree of distortion, the defective part Rd with the maximum degree of distortion, and the defective part Rd with the minimum degree of distortion.

[0089] Note that the display screen for specifying the property Pd in ​​this example is merely an example and is not limited to this example. The defective product image generation device 100 may display a specification screen for another property Pd, or may allow the user to specify the range of the property Pd using a method other than a slider bar. The defective product image generation device 100 of this example can generate diverse and comprehensive defect locations Rd, thereby improving the efficiency of generating defective product images Ib.

[0090] 7 shows a modified example of the method for generating a defective product image Ib. The defective product image generating device 100 of this example generates a defective portion Rd having a protruding portion 255.

[0091] The protruding portion 255 is a region of the defect portion Rd that protrudes from one side of the edge portion Pe to the other side, with the edge portion Pe as the boundary. The protruding portion 255 may be formed in a region that includes the defect portion generation edge Eb. This allows the protruding portion 255 to be formed at a desired position, similar to the position of the defect portion Rd.

[0092] The property specification unit 50 may specify the size of the protruding portion 255. Specifying the size of the protruding portion 255 may include specifying the area of ​​the protruding portion 255, and may include specifying the length L of the protruding portion 255. The length L of the protruding portion 255 may be the maximum length of the protruding portion 255, or may be the length of the major axis of the protruding portion 255. The length L in this example indicates the maximum length of the protruding portion 255. The property specification unit 50 may store the specified size of the protruding portion 255 in the storage unit 60.

[0093] The defective product image generation device 100 of this example can easily generate a wider variety of defective parts Rd in accordance with the user's intention by specifying the size of the protruding portion 255 .

[0094] 8 illustrates an example of a computer 2200 in which aspects of the present invention may be embodied, in whole or in part. Programs installed on the computer 2200 may cause the computer 2200 to function as or perform operations associated with an apparatus or one or more sections of the apparatus according to embodiments of the present invention, and / or to perform a process or steps of a process according to embodiments of the present invention. Such programs may be executed by the CPU 2212 to cause the computer 2200 to perform specific operations associated with some or all of the blocks of the flowcharts and block diagrams described herein.

[0095] A computer 2200 according to this embodiment includes a CPU 2212, a RAM 2214, a graphics controller 2216, and a display device 2218, which are interconnected by a host controller 2210. The computer 2200 also includes input / output units such as a communication interface 2222, a hard disk drive 2224, a DVD-ROM drive 2226, and an IC card drive, which are connected to the host controller 2210 via an input / output controller 2220. The computer also includes legacy input / output units such as a ROM 2230 and a keyboard 2242, which are connected to the input / output controller 2220 via an input / output chip 2240.

[0096] The CPU 2212 operates according to programs stored in the ROM 2230 and RAM 2214, thereby controlling each unit. The graphics controller 2216 acquires image data generated by the CPU 2212 into a frame buffer or the like provided in the RAM 2214 or into the graphics controller 2216 itself, and causes the image data to be displayed on the display device 2218.

[0097] The communication interface 2222 communicates with other electronic devices via a network. The hard disk drive 2224 stores programs and data used by the CPU 2212 in the computer 2200. The DVD-ROM drive 2226 reads programs or data from the DVD-ROM 2201 and provides the programs or data to the hard disk drive 2224 via the RAM 2214. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0098] ROM 2230 stores therein a boot program or the like that is executed by computer 2200 upon activation, and / or programs that depend on the hardware of computer 2200. I / O chip 2240 may also connect various I / O units to I / O controller 2220 via a parallel port, a serial port, a keyboard port, a mouse port, etc.

[0099] The programs are provided by a computer-readable medium such as a DVD-ROM 2201 or an IC card. The programs are read from the computer-readable medium, installed in the hard disk drive 2224, RAM 2214, or ROM 2230, which are also examples of computer-readable media, and executed by the CPU 2212. Information processing described in these programs is read by the computer 2200, and brings about cooperation between the programs and the various types of hardware resources described above. An apparatus or method may be configured by realizing information manipulation or processing in accordance with the use of the computer 2200.

[0100] For example, when communication is performed between computer 2200 and an external device, CPU 2212 may execute a communication program loaded into RAM 2214 and instruct communication interface 2222 to perform communication processing based on the processing described in the communication program. Under the control of CPU 2212, communication interface 2222 reads transmission data stored in a transmission buffer processing area provided in RAM 2214, hard disk drive 2224, DVD-ROM 2201, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes received data received from the network to a reception buffer processing area or the like provided on the recording medium.

[0101] Furthermore, the CPU 2212 may cause all or a necessary portion of a file or database stored on an external recording medium such as the hard disk drive 2224, the DVD-ROM drive 2226 (DVD-ROM 2201), an IC card, etc. to be read into the RAM 2214, and may perform various types of processing on the data on the RAM 2214. The CPU 2212 then writes back the processed data to the external recording medium.

[0102] Various types of information, such as various types of programs, data, tables, and databases, may be stored on the recording medium and may undergo information processing. The CPU 2212 may perform various types of processing on data read from the RAM 2214, including various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information search / replacement, etc., as described throughout this disclosure and specified by the instruction sequences of the programs, and write the results back to the RAM 2214. The CPU 2212 may also search for information in a file, database, etc. on the recording medium. For example, if multiple entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored on the recording medium, the CPU 2212 may search for an entry that matches a condition specified by the attribute value of the first attribute from among the multiple entries, read the attribute value of the second attribute stored in the entry, and thereby obtain the attribute value of the second attribute associated with the first attribute that satisfies a predetermined condition.

[0103] The above-described programs or software modules may be stored in a computer-readable medium on or near the computer 2200. A recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can also be used as a computer-readable medium, thereby providing the programs to the computer 2200 via the network.

[0104] Although the present invention has been described above using embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various modifications and improvements can be made to the above embodiments. It is clear from the claims that such modifications and improvements can also be included within the technical scope of the present invention.

[0105] It should be noted that the order of execution of each process, such as operations, procedures, steps, and stages, in the devices, systems, programs, and methods shown in the claims, specifications, and drawings is not specifically stated as "before," "prior to," etc., and that the processes can be performed in any order unless the output of a previous process is used in a subsequent process. Even if the operational flow in the claims, specifications, and drawings is described using "first," "next," etc. for convenience, this does not mean that the processes must be performed in this order.

[0106] 10...good product image acquisition unit, 20...edge designation unit, 30...relative position designation unit, 40...defective product image generation unit, 50...property designation unit, 60...storage unit, 70...image generation model, 100...defective product image generation device, 110...display screen, 112...display screen, 114...display screen, 116...display screen, 200...object, 201...first area, 202...second area, 255...protruding portion, 2200...computer 2201...DVD-ROM, 2210...host controller, 2212...CPU, 2214...RAM, 2216...graphics controller, 2218...display device, 2220...input / output controller, 2222...communication interface, 2224...hard disk drive, 2226...DVD-ROM drive, 2230...ROM, 2240...input / output chip, 2242...keyboard

Claims

1. A defective product image generation device for generating a defective product image having a defective portion, comprising: a non-defective product image acquisition unit that acquires a non-defective product image including an edge portion; an edge designation unit that designates a defective portion generation edge that generates the defective portion among the edge portions; a relative position designation unit that designates a relative position of the defective portion to be generated with respect to the edge portion; and a defective product image generation unit that generates a defective product image having the defective portion in a region including the defective portion generation edge based on the defective portion generation edge and the relative position. A defective product image generation device comprising the above components.

2. The non-defective product image includes a first region and a second region bounded by the edge portion, and the relative position designation unit designates at least one of the first region side or the second region side as the relative position. The defective product image generation device according to claim 1.

3. The relative position designation unit designates a segment region including the edge portion, and the edge designation unit designates the defective portion generation edge from the edge portion of the segment region. The defective product image generation device according to claim 1.

4. The edge designation unit designates the defective portion generation edge from the edge portion of the non-defective product image, and the relative position designation unit designates a segment region including the defective portion generation edge. The defective product image generation device according to claim 1.

5. The edge designation unit sets a predetermined virtual line and designates the intersection of the virtual line and the edge portion as the defective portion generation edge. The defective product image generation device according to claim 1.

6. The edge designation unit sets an angle of a virtual line extending from a predetermined reference point and designates the intersection of the virtual line and the edge portion as the defective portion generation edge. The defective product image generation device according to claim 1.

7. The defective product image generation device according to any one of claims 1 to 6, further comprising a property designation unit that designates a property of the defective portion.

8. The property designation unit designates a material of the defective portion to be generated in the defective product image, a form of the defective portion to be generated in the defective product image, a defective mode of the defective portion to be generated in the defective product image, or a number of the defective portions to be generated in the defective product image. The defective product image generation device according to claim 7.

9. The edge specifying unit sets a virtual line extending from a predetermined reference point, and designates the intersection point of the virtual line and the edge portion as the defective portion generation edge. The property specifying unit designates the property of the defective portion according to at least one of the distance from the reference point to the intersection point or the angle of the virtual line extending from the reference point. The defective product image generation device according to claim 7.

10. The property specifying unit displays a setting screen for setting a property specifying method according to at least one of the distance or the angle. The defective product image generation device according to claim 9.

11. The defective product image generation unit inputs the defective portion generation edge and the relative position into a pre-trained image generation model, and generates a defective product image having the defective portion in a region including the defective portion generation edge. The defective product image generation device according to any one of claims 1 to 6.

12. The defective portion has an overhanging portion that protrudes from one side of the edge portion to the other side with the edge portion as a boundary. The defective product image generation device according to claim 7.

13. The property specifying unit designates the size of the overhanging portion. The defective product image generation device according to claim 12.

14. A defective product image generation method for generating a defective product image having a defective portion, comprising: a step in which a computer acquires a non-defective product image including an edge portion; a step in which the computer designates a defective portion generation edge that generates the defective portion among the edge portions; a step in which the computer designates a relative position of the defective portion to be generated with respect to the edge portion; and a step in which the computer generates a defective product image having the defective portion in a region including the defective portion generation edge based on the defective portion generation edge and the relative position. The defective product image generation method comprising the steps.

15. A program for realizing a defective product image generation method for generating a defective product image having a defective portion, which, when executed by a computer, causes the computer to acquire a non-defective product image including an edge portion, specify a defective portion generation edge that generates the defective portion among the edge portions, specify a relative position of the defective portion to be generated with respect to the edge portion of the defective portion, and generate a defective product image having the defective portion in a region including the defective portion generation edge based on the defective portion generation edge and the relative position. Program.

Images