Control device, control method, and control program

Abstract

A control device is provided with at least one processor that displays, on a display device, an inspection object image obtained by capturing an image of an inspection object to be subjected to non-destructive inspection, and if the displayed inspection object image includes two or more flaws of the inspection object, performs non-destructive inspection on the inspection object image. A frame for inspecting a flaw is displayed in a size corresponding to a preset size in a state of being superimposed on the image to be inspected in such a manner that the frame can be moved and / or rotated relative to the image to be inspected, and the frame is displayed in such a manner as to be able to move and / or rotate relative to the image to be inspected.

Description

Technical Field

[0001] This invention relates to a control device, control method, and control program. Background Technology

[0002] Traditionally, non-destructive inspection is performed using images of the object being inspected. In the technology described in International Publication WO2022 / 014019, the location and size of defects in the welded parts of the object being inspected are detected based on image data representing the distribution of radiation transmission intensity. Summary of the Invention

[0003] -The technical problem that the invention aims to solve-

[0004] However, as a non-destructive inspection method, there is a known method for evaluating defects in an inspected object based on flaws existing within a specified gauge. For example, in inspections based on standards such as JIS (Japanese Industrial Standards) and ISO (International Organization for Standardization), an image of the inspected object obtained by photographing it is aligned with a gauge defining the test range, and defects within the gauge are evaluated. In such evaluations, adjusting the gauge position is a meticulous task, which increases the burden on the user performing the evaluation and reduces inspection efficiency.

[0005] The present invention was made in consideration of the above circumstances, and its purpose is to provide a control device, control method and control program that can assist in the evaluation of defects in an inspection object.

[0006] -Means used to solve technical problems-

[0007] The control device of the first aspect of the present invention includes at least one processor, which displays an image of an inspection object obtained by capturing an inspection object for non-destructive inspection on a display device. When the displayed inspection object image includes defects of two or more inspection objects, a frame for inspecting the defects is superimposed on the inspection object image in a manner that allows the frame to be moved or rotated relative to the inspection object image at least one of the two, and is displayed at a size corresponding to a preset size.

[0008] The control device of the second aspect of the present invention is the same as the control device of the first aspect, and the frame is a graphic corresponding to the gauge.

[0009] The control device of the third aspect of the present invention is the control device of the first aspect, wherein the frame is a graphic based on a gauge defined in the JIS or ISO specifications related to non-destructive testing.

[0010] The control device of the fourth aspect of the present invention is in the control device of the first aspect, wherein the processor moves the frame relative to each other, such that the first auxiliary line set according to the position of the defect and the second auxiliary line set according to the position of the frame are in a state of a predetermined positional relationship.

[0011] The control device of the fifth aspect of the present invention is the control device of the fourth aspect, wherein the first auxiliary line is a line segment connecting the centers of gravity of two defects.

[0012] The control device of the sixth aspect of the present invention is the control device of the fourth aspect, wherein the first auxiliary line is a line segment connecting points in two defective areas, and in the case of multiple line segments, the longest line segment among the multiple line segments is set as the first auxiliary line.

[0013] The control device of the seventh aspect of the present invention is, in the control device of the fourth aspect, wherein when the shape of the frame is rectangular, the second auxiliary line is at least one of the diagonals of the rectangular frame, and when the shape of the frame is circular, the second auxiliary line is at least one line corresponding to the diameter of the circular frame.

[0014] In the control device of the eighth aspect of the present invention, in the control device of the first aspect, the processor prompts information indicating the intention when at least a portion of the defect exists within the frame, in the case of an area overlapping with the frame.

[0015] The control device of the ninth aspect of the present invention is, in the control device of the eighth aspect, in which the processor, as a prompt for information, highlights the portion of the frame that overlaps with the defect in the frame, which is not present in all parts, compared with the other parts.

[0016] The control device of the tenth aspect of the present invention is in the control device of the first aspect, wherein when there are three or more defects, the processor extracts two defects as a pair, displays a straight line connecting the two defects of the extracted pair, accepts user input corresponding to the straight line, and performs a display corresponding to the accepted input in association with the straight line.

[0017] The control device of the eleventh aspect of the present invention is in the control device of the first aspect, wherein the processor displays an image of the object to be inspected that captures most of the shooting range of the object to be inspected and an enlarged image of the object to be inspected that enlarges a portion of the image of the object to be inspected as the object to be inspected image. When one of the frames displayed in a state of overlapping the image of the object to be inspected that captures most of the object to be inspected and the frames displayed in a state of overlapping the enlarged image of the object to be inspected move or rotate relative to the object to be inspected image, the other frame also moves or rotates in conjunction with it.

[0018] The control device of the twelfth aspect of the present invention is a control device described in the first aspect in which at least one of the categories, sizes and lengths of defects are pre-set with a correspondence between the defect and the score. The processor derives the score for at least a portion of the defects that exist in the frame based on the correspondence. If there are multiple defects that exist in the frame, the processor further derives the total score.

[0019] The control device of the thirteenth aspect of the present invention is, in the control device of the twelfth aspect, wherein the processor records the state of the frame and the area of ​​the inspection object image, which includes at least a portion of the defects present in the frame, in association with the total score displayed on the display device.

[0020] Furthermore, in order to achieve the above-mentioned objective, in the control method of the fourteenth aspect of the present invention, the processor included in the control device displays an image of the inspection object obtained by capturing an inspection object for non-destructive inspection on a display device. When the displayed inspection object image includes defects of two or more inspection objects, a frame for inspecting the defects is superimposed on the inspection object image in a state such that at least one of relative movement or rotation of the frame relative to the inspection object image is possible, and it is displayed at a size corresponding to a preset size.

[0021] In addition, in order to achieve the above-mentioned objective, the control program of the fifteenth aspect of the present invention is used to cause the processor of the control device to perform the following processing: displaying an image of an inspection object obtained by capturing an inspection object for non-destructive inspection on a display device; when the displayed inspection object image includes defects of two or more inspection objects; displaying a frame for inspecting defects in a state of overlapping the inspection object image; displaying the frame in a manner that allows at least one of relative movement or rotation relative to the inspection object image; and displaying the frame at a size corresponding to a preset size.

[0022] -Invention Effects-

[0023] According to the present invention, it is possible to assist in the evaluation of defects in the inspected object. Attached Figure Description

[0024] Figure 1This is a diagram used to illustrate the inspection object and an image of the inspection object in the implementation method.

[0025] Figure 2 This is a block diagram illustrating an example of the hardware structure of the control device in an implementation method.

[0026] Figure 3 This is a functional block diagram illustrating an example of the functional structure of the control device in an implementation method.

[0027] Figure 4 This is an example diagram used to illustrate the display status of the image and frame of the object being inspected.

[0028] Figure 5 This is a diagram of the boxes displayed by the control unit for illustrating the implementation method.

[0029] Figure 6 This is a diagram of auxiliary lines displayed by the auxiliary line display control unit for explaining the implementation method.

[0030] Figure 7 This is a flowchart illustrating an example of the control processing flow executed in the control device of the embodiment.

[0031] Figure 8 This is a diagram illustrating an example of a display method used to clarify a confirmed pair of defects.

[0032] Figure 9 This is a diagram used to illustrate other ways of using a box.

[0033] Figure 10 This is a diagram illustrating other methods for deriving the explanation box and total score. Detailed Implementation

[0034] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Furthermore, these embodiments do not limit the scope of the present invention.

[0035] like Figure 1 As shown, in this embodiment, as an example, the following situation will be described: the inspection object 10 is a cylindrical object formed by welding two pipes, such as a natural gas pipeline, and defects related to the welded portion 10B of the inspection object 10 will be evaluated. In this invention, "discontinuity" refers to defects including possible defects.

[0036] The radiographic imaging apparatus 16 captures a radiographic image covering a region that includes at least the welded portion 10B of the object under inspection 10. In this embodiment, the radiographic image of the object under inspection captured by the radiographic imaging apparatus 16 is referred to as the object under inspection image. Therefore, the object under inspection image includes images of the pipe portion 10A and the welded portion 10B of the object under inspection 10.

[0037] The radiographic imaging apparatus 16 of this embodiment captures an image of the inspection object by dividing the weld portion 10B into multiple parts as the imaging range 15 in a single imaging session. That is, in this embodiment, multiple images of the inspection object 10 are obtained, and by connecting these multiple images in a series, a radiographic image is formed that includes the area surrounding the weld portion 10B. Alternatively, unlike the radiographic imaging apparatus 16 of this embodiment, a radiographic imaging apparatus 16 capable of capturing a single radiographic image of the area surrounding the weld portion 10B can be used, and a single image of the inspection object can be used for defect evaluation.

[0038] The image of the object to be inspected obtained by the radiographic imaging device 16 is output to the control device 18. The control device 18 is a device for assisting in the evaluation of defects in the object to be inspected 10, which uses the image of the object to be inspected obtained by taking pictures of the object to be inspected 10 for non-destructive inspection.

[0039] exist Figure 2 The diagram shows an example of the hardware structure of the control device 18 in this embodiment. Figure 2 As shown, the control device 18 includes a CPU (Central Processing Unit) 20, a memory 21 as a temporary storage area, a non-volatile memory unit 22, a display 26 such as a liquid crystal display, an input unit 27, and a network I / F (Interface) 28. The CPU 20, memory 21, memory unit 22, display 26, input unit 27, and network I / F 28 are connected via a bus 29 such as a system bus or control bus, so that they can send and receive various kinds of information.

[0040] CPU 20 controls the entire control device 18. Furthermore, CPU 20 reads the control processing program 23 from storage unit 22, expands it into memory 21, and executes the expanded control processing program 23. The CPU 20 in this embodiment is an example of the processor of the present invention, and the control processing program 23 is an example of the control program of the present invention.

[0041] The storage unit 22 stores the control processing program 23 executed in the CPU 20 and the image 50 of the object to be examined obtained by the radiographic imaging device 16. Additionally, the storage unit 22 stores frame information 25A and score information 25B, which will be described in detail later. Specific examples of the storage unit 22 include storage media such as HDDs (Hard Disk Drives), SSDs (Solid State Drives), and flash memory.

[0042] The input unit 27 is used to accept user operations, such as a touch panel, buttons, a mouse, and a keyboard. Alternatively, a touch panel display integrating the display 26 and the input unit 27 can be used. The network I / F 28 communicates with the radiographic imaging apparatus 16 via a network, either wired or wirelessly. Furthermore, the display 26 in this embodiment is an example of the display device of the present invention.

[0043] In addition, Figure 3 The diagram shows an example of the functional structure of the control device 18. (Example:) Figure 3 As shown, the control device 18 of this embodiment includes an inspection object image acquisition unit 30, a display control unit 32, a defect detection unit 34, a score export unit 36, and a report generation unit 38. In the control device 18, the CPU 20 executes the control processing program 23, and the CPU 20 functions as the inspection object image acquisition unit 30, the display control unit 32, the defect detection unit 34, the score export unit 36, and the report generation unit 38.

[0044] The inspection object image acquisition unit 30 has the function of acquiring inspection object images 50. As described above, when there are multiple inspection object images 50 for one inspection object 10, the inspection object image acquisition unit 30 of this embodiment acquires the series of inspection object images 50 one by one in sequence.

[0045] As an example, the inspection object image acquisition unit 30 of this embodiment acquires the inspection object image 50 stored in the storage unit 22, but it can also acquire the inspection object image 50 from the radiographic imaging device 16. The inspection object image acquisition unit 30 outputs the acquired inspection object image 50 to the display control unit 32 and the defect detection unit 34.

[0046] The defect detection unit 34 has the function of detecting defects of the inspection object 10 from the inspection object image 50. Specifically, it detects images corresponding to defects of the inspection object 10. There are no particular limitations on the method by which the defect detection unit 34 detects defects from the inspection object image 50. For example, the defect detection unit 34 may also use a machine learning model to detect defects from the inspection object image 50, the machine learning model learning to detect defects from inspection object images including various defects. Alternatively, for example, the defect detection unit 34 may also use a known image analysis method that detects areas different from surrounding areas as defects from the inspection object image 50.

[0047] Furthermore, in this embodiment, the defect detection unit 34 assigns a value indicating whether a pixel in the inspected object image 50 is a defect as the detection result. For example, for a certain pixel, if it is a defect, it is assigned "1", and if it is not a defect, it is assigned "0". The defect detection unit 34 outputs the detection result to the display control unit 32 and the score export unit 36.

[0048] The display control unit 32 includes an inspection object image display control unit 32A, a frame display control unit 32B, and an auxiliary line display control unit 32C. (See reference...) Figures 4-6 The functions of the inspection object image display control unit 32A, the frame display control unit 32B, and the auxiliary line display control unit 32C will be explained.

[0049] The inspection object image display control unit 32A has the function of displaying an image of the inspection object on the display 26. For example... Figure 4 As shown, the inspection object image display control unit 32A displays the inspection object image 50 and the magnified inspection object image 50e on the display 26. Furthermore, the statement that the inspection object image display control unit 32A "displays" the inspection object image 50 and the magnified inspection object image 50e on the display 26 also includes the following state: in order to display on the display 26, the inspection object image display control unit 32A maintains the inspection object image 50 and the magnified inspection object image 50e.

[0050] In this embodiment, the object image 50 displayed on the display 26 is equivalent to an object image 50 captured by the radiographic imaging device 16. On the other hand, the magnified object image 50e is an enlarged version of the object image 50, where a portion of the object image 50 is magnified. Figure 4 The inspection object image 50 and the magnified inspection object image 50e shown include the pipe portion 50A as an image of the pipe portion 10A and the weld portion 50B as an image of the weld portion 10B, respectively.

[0051] like Figure 4As shown, the inspection object image display control unit 32A of this embodiment displays a magnification range frame 59 on the inspection object image 50, which represents the range of magnified inspection object image 50e in the inspection object image 50. Furthermore, the magnification range and magnification rate in the inspection object image 50 can be preset, or the user can specify them via the input unit 27.

[0052] On the other hand, the frame display control unit 32B has the following functions: it displays a frame 60, which is of a preset size and is used for defect inspection, superimposed on the inspection object image 50 and the magnified inspection object image 50e, respectively, and displays the frame 60 in a manner that allows it to be moved and rotated relative to the inspection object image 50 and the magnified inspection object image 50e, respectively. Furthermore, the term "display" of the frame 60 by the frame display control unit 32B also includes the following state: for display purposes, the frame display control unit 32B holds the frame 60.

[0053] Frame 60 is a graphic corresponding to a gauge. As a specific example, frame 60 in this embodiment is a graphic based on gauges specified in JIS specifications related to non-destructive testing. Examples of such JIS specifications include JIS Z 3104-1995 "Radiation Transmission Test Method for Steel Welded Joints", JIS Z 3105-2003 "Radiation Transmission Test Method for Aluminum Welded Joints", and JIS G 0581-1999 "Radiation Transmission Test Method for Cast Steel Parts". Alternatively, frame 60 may be a graphic based on gauges specified in ISO specifications corresponding to these JIS specifications. In the control device 18 of this embodiment, information related to the size and shape of gauges used in these specifications is stored as frame information 25A in the storage unit 22. As an example, the frame information 25A in this embodiment includes information related to the size and shape of various gauges.

[0054] The frame display control unit 32B, referring to frame information 25A, determines the size and shape of the frames 60 to be displayed in the inspection object image 50 and the magnified inspection object image 50e, respectively, based on the size and shape of the gauge used, the size of the inspection object 10 and its correspondence, and the magnification ratio of the magnified inspection object image 50e. Then, the frames 60 of the determined size and shape are superimposed on the inspection object image 50 and the magnified inspection object image 50e, respectively.

[0055] When the inspection object image 50 includes defects in two or more inspection objects 10, the frame display control unit 32B displays the frame 60. Furthermore, in this embodiment, as an example, when the magnified inspection object image 50e includes defects in two or more inspection objects 10, the frame 60 is displayed overlappingly on the inspection object image 50 and the magnified inspection object image 50e, respectively.

[0056] In the control device 18 of this embodiment, the user can move and rotate the displayed frame 60. For example, by using the input unit 27, when the displayed frame 60 is clicked, an operation to move or rotate it is performed, thereby moving or rotating the displayed frame 60 according to the operation. Furthermore, if one of the frame 60 displayed in a state of overlapping the inspection object image 50 and the frame 60 displayed in a state of overlapping the magnified inspection object image 50e is moved or rotated, the other frame 60 is also moved or rotated in conjunction.

[0057] Furthermore, based on the detection results of the defect detection unit 34, the frame display control unit 32B displays information indicating the intention regarding defects 52 that are at least partially present within the frame 60, especially when there is an area overlapping with the frame 60. Figure 5 In the example shown, at least a portion of defects 52-1 and 52-2 in the magnified inspection of object image 50e, including defects 52-1, 52-2, and 52-3, exists within frame 60. Figure 5 In the example shown, since not all parts of defects 52-1 and 52-2 exist within frame 60, the frame display control unit 32B displays the portion 60A of frame 60 that overlaps with defects 52-1 and 52-2 more prominently than other portions. There are no limitations on the method by which the frame display control unit 32B makes portion 60A of frame 60 prominent. For example, the frame display control unit 32B can display portion 60A with a color that is more prominent than other portions, or it can make portion 60A blink. Furthermore, the situation where defects 52 (52-1, 52-2) have areas overlapping with frame 60 also includes the state where the outer edge of defect 52 overlaps with frame 60. That is, there may also be cases where defects 52 do not exist outside frame 60. Additionally, here, "overlap" may include cases of coordinate overlap in the original data and cases of pixel overlap on the screen of display 26.

[0058] Therefore, users can easily identify defect 52 (in Figure 5 Does all parts of defects 52-1 and 52-2 exist within frame 60?

[0059] On the other hand, such as Figure 6As shown, the auxiliary line display control unit 32C displays a first auxiliary line 64 set according to the position of the defect 52 and a second auxiliary line 66 set according to the position of the frame 60 on the magnified inspection object image 50e. Figure 6 In the example shown, the auxiliary line display control unit 32C displays a line segment connecting the centroids of at least a portion of the defects 52-1 and 52-2 existing within the frame 60 as a first auxiliary line 64 in the magnified inspection object image 50e. Furthermore, the first auxiliary line 64 displayed by the auxiliary line display control unit 32C is not limited to the above-described manner; the first auxiliary line 64 can be any line segment connecting points within the regions of the two defects 52. For example, if multiple line segments exist, the longest line segment among them can be designated as the first auxiliary line 64. Additionally, the two defects 52 connected by the first auxiliary line 64 can be, for example, two defects 52 existing in close proximity. Here, "close proximity" can be set to within a predetermined distance, etc. Furthermore, from the viewpoint of adequately including both defects within the frame 60, the distance between the two defects 52 is preferably close to the length of the diagonal of the frame 60, for example, preferably within ±10% of the length of the diagonal of the frame 60, etc. Therefore, for example, it can be set to two defects 52 that are within a preset distance and closest to the frame 60. Furthermore, for example, it can be set to two defects 52 specified by the user, or it can be set to allow selection of which two defects 52 to connect with the first auxiliary line 64. Additionally, if there are three or more defects 52 within a close range, it can be set as follows: starting with a pair of defects 52 whose distance is close to the length of the diagonal of the frame 60, suggestions are provided sequentially, allowing the user to select the most preferred pair of defects 62, and the first auxiliary line 64 is set for the selected pair.

[0060] Furthermore, the auxiliary line display control unit 32C displays one of the two diagonals of frame 60 as a second auxiliary line 66 in the magnified inspection object image 50e. Moreover, the second auxiliary line 66 displayed by the auxiliary line display control unit 32C is not limited to the above-described manner; for example, the second auxiliary line 66 could also be either of the two diagonals. That is, the second auxiliary line 66 displayed by the auxiliary line display control unit 32C is not limited to one, but could be multiple lines.

[0061] Thus, when the first auxiliary line 64 and the second auxiliary line 66 are set, the frame display control unit 32B moves the frame 60 relative to each other, so that the first auxiliary line 64 and the second auxiliary line 66 are in a preset positional relationship. Furthermore, the movement of the frame 60 can also be performed according to the instructions of the user using the input unit 27, or it can be performed automatically.

[0062] The pre-defined positional relationship between the first auxiliary line 64 and the second auxiliary line 66 refers to the configuration relationship between the defect 52 and the frame 60, set in order to place the defect 52 in an appropriate state within the frame 60 when evaluating the defect 52. Figure 6 In the example shown, the frame display control unit 32B moves the frame 60 so that the first auxiliary line 64 and the second auxiliary line 66 are in a pre-set positional relationship as follows: the first auxiliary line 64 and the second auxiliary line 66 overlap; more specifically, the first auxiliary line 64 and the second auxiliary line 66 are on the same line. Therefore, in Figure 6 In the example shown, defects 52-1 and 52-2 become defect 52 of the evaluation object. Furthermore, it can also be related to... Figure 6 The method shown is different. The box display control unit 32B moves the box 60 so that the first auxiliary line 64 and the second auxiliary line 66 are in an orthogonal positional relationship.

[0063] like Figure 4 As shown, the display control unit 32 further displays an auxiliary line display indicator button 70, an image change indicator button 71, and a report output indicator button 72 on the display 26. The auxiliary line display indicator button 70 is operated by the user via the input unit 27 when the auxiliary line display control unit 32C displays the first auxiliary line 64 and the second auxiliary line 66 as described above. In this embodiment, by switching the auxiliary line display indicator button 70 on / off, the display of the first auxiliary line 64 and the second auxiliary line 66 can be switched.

[0064] On the other hand, the image change indicator button 71 is operated by the user via the input unit 27 when switching the inspection object image 50 displayed on the display 26. As described above, when there are multiple series of inspection object images 50 for one inspection object 10, by operating the image change indicator button 71, the inspection object image 50 displayed on the display 26 is switched sequentially among the multiple series of inspection object images 50. In addition, the report output indicator button 72 is operated by the user via the input unit 27 when outputting a report related to the inspection of the inspection object image 50, i.e., the inspection object 10.

[0065] The score derivation unit 36 ​​derives scores for at least a portion of the defects 52 present within the frame 60 based on the score information 25B stored in the storage unit 22. The score information 25B is information representing the correspondence between at least one of the defect type, size, and length of the defect 52 and a score; this correspondence is preset. In this embodiment, the score information 25B uses a correspondence based on standards such as JIS and ISO as described above. For example, such a correspondence can utilize the defect type and score derivation method used in JIS Z 3104-1995, specifically in the classification method for defects based on transmission photographs. Furthermore, when there are multiple defects 52 present at least a portion within the frame 60, the score derivation unit 36 ​​further derives a total score.

[0066] Furthermore, the score derivation unit 36 ​​is not limited to this embodiment. For example, it can also derive scores for all defects 52 present in the inspection object image 50 or the magnified inspection object image 50e based on the score information 25B.

[0067] Report generation department 38 for box 60 and at least includes defects 52 that exist in at least part of box 60 (in Figure 6 The area of ​​the magnified inspection object image 50e (defects 52-1, 52-2) is recorded in relation to the state displayed on the display 26 and the total score exported by the score export unit 36. Specifically, the report generation unit 38 captures the screen of the display 26 showing the state of the magnified inspection object image 50e and records it in relation to the total score. Hereinafter, the recorded information will be referred to as "evaluation information". In addition, when the report output instruction button 72 is activated, the report generation unit 38 uses the recorded evaluation information to generate a report based on a preset format.

[0068] Next, the operation of the control device 18 in this embodiment will be described with reference to the accompanying drawings. Figure 7 The diagram shows a flowchart illustrating an example of the control processing flow executed in the control device 18. Furthermore, Figure 7 The control processing shown is executed by CPU 20 executing control processing program 23.

[0069] exist Figure 7 In step S100, as described above, the object image acquisition unit 30 acquires an object image 50. If there are multiple series of object images 50 for one object 10, one object image 50 is acquired sequentially.

[0070] In the next step S102, the frame display control unit 32B accepts the user's specification of the gauge for evaluation. As described above, in this embodiment, since the frame information 25A includes information on multiple gauges, the user selects the gauge for evaluation from the multiple gauges that include the information included in the frame information 25A.

[0071] In the next step S104, as described above, the defect detection unit 34 detects the defect 52 from the inspection object image 50, and assigns a value indicating whether it is a defect as the detection result for each pixel of the inspection object image 50.

[0072] In the next step S106, as described above, the inspection object image display control unit 32A starts to display the inspection object image 50 and magnify the inspection object image 50e on the display 26.

[0073] In the next step S108, the frame display control unit 32B determines whether to display the frame 60. In this embodiment, as described above, if the magnified inspection object image 50e includes two or more defects 52, the frame 60 is displayed. Therefore, the frame display control unit 32B determines whether the magnified inspection object image 50e includes two or more defects 52 based on the detection result of step S104. If the magnified inspection object image 50e does not include two or more defects 52, in other words, if the magnified inspection object image 50e does not include defects 52 or includes one defect 52, the determination in step S108 becomes a negative determination, and the process proceeds to step S128. On the other hand, if the magnified inspection object image 50e includes two or more defects 52, the determination in step S108 becomes a positive determination, and the process proceeds to step S110.

[0074] In step S110, the frame display control unit 32B starts to display the frame 60 corresponding to the gauge specified in the frame information 25A in step S102 above, in a state where it is superimposed on the inspection object image 50 and the magnified inspection object image 50e respectively, and in a way that allows it to be moved and rotated.

[0075] In the next step S112, as described above, the frame display control unit 32B determines whether there is an area overlapping with the frame 60 among the defects 52 that are present in at least a portion of the frame 60. If there is no area overlapping with the frame 60, the determination in step S112 becomes a negative determination, and the process proceeds to step S116. On the other hand, if there is an area overlapping with the frame 60, the determination in step S112 becomes a positive determination, and the process proceeds to step S114.

[0076] Reference Figure 5 As described above, in step S114, the frame display control unit 32B highlights the portion 60A of the frame 60 that overlaps with the defect 52.

[0077] In the next step S116, the auxiliary line display control unit 32C determines whether to display the first auxiliary line 64 and the second auxiliary line 66. As described above, the auxiliary line display control unit 32C switches the display / hide of the first auxiliary line 64 and the second auxiliary line 66 by the user operating the auxiliary line display indicator button 70 displayed on the display 26. Therefore, the auxiliary line display control unit 32C detects the operation state of the auxiliary line display indicator button 70 and determines whether to display the first auxiliary line 64 and the second auxiliary line 66. If the first auxiliary line 64 and the second auxiliary line 66 are not displayed, the determination in step S116 becomes a negative determination, and the process proceeds to step S122. On the other hand, if the first auxiliary line 64 and the second auxiliary line 66 are displayed, the determination in step S116 becomes a positive determination, and the process proceeds to step S118.

[0078] Reference Figure 6 As described above, in step S118, the auxiliary line display control unit 32C displays the first auxiliary line 64 and the second auxiliary line 66.

[0079] Reference Figure 6 As described above, in the next step S120, the frame display control unit 32B moves the frame 60 so that the first auxiliary line 64 and the second auxiliary line 66 overlap.

[0080] In the next step S122, as described above, the score exporting unit 36 ​​exports scores for at least a portion of the defects 52 present within the frame 60 based on the score information 25B, and further exports their total scores. The score exporting unit 36 ​​outputs the exported scores for each defect 52 and the total score to the display control unit 32.

[0081] In the next step S124, the display control unit 32 displays the score and total score of each defect 52 derived in the above step S122 near each defect 52 and the frame 60.

[0082] In the next step S126, the frame display control unit 32B determines whether the user has moved or rotated the frame 60. If the user has not moved or rotated the frame 60, the determination in step S126 becomes a negative determination, and the process proceeds to step S128.

[0083] In step S128, the report generation unit 38 determines whether to output the aforementioned report. As described above, if the user's operation of the report output instruction button 72 is not accepted, the determination in step S128 becomes a negative determination, and the process proceeds to step S130.

[0084] In step S130, the object image acquisition unit 30 determines whether it has received an instruction to change the displayed object image 50. As described above, if the user's image change instruction button 71 is received, the determination in step S130 becomes an affirmative determination, and the process returns to step S100. When the object image acquisition unit 30 acquires the next object image 50, the process after step S102 is repeated. On the other hand, if the user's image change instruction button 71 is not received, the determination in step S130 becomes a negative determination, and the process returns to step S126, repeating the processes of steps S126 and S128.

[0085] On the other hand, in step S128, if the user operates the report output instruction button 72, a positive determination is made, and the process proceeds to step S132. In step S132, as described above, the report generation unit 38 records the status displayed on the display 26 and the total score exported by the score export unit 36 ​​in association with the area of ​​the frame 60 and the magnified inspection object image 50e, which includes at least a portion of the defects 52 present within the frame 60, as evaluation information. Furthermore, the report generation unit 38 uses the evaluation information to create a report and outputs the created report. Moreover, the report output path is not limited; for example, it can be output to the storage unit 22 and the report can be saved in the storage unit 22, or it can be output to an external device via the network I / F 28. Alternatively, the report can be displayed on the display 26 via the display control unit 32.

[0086] In the next step S134, the inspection object image display control unit 32A ends the display of the inspection object image 50 and the magnified inspection object image 50e, and the frame display control unit 32B ends the display of the frame 60. When the processing of step S134 is completed, Figure 7 The control process shown has ended.

[0087] As described above, according to the control device 18 of the aforementioned methods, the inspection object image display control unit 32A displays the inspection object image 50 obtained by capturing the inspection object 10 for non-destructive inspection on the display 26. Furthermore, when the displayed inspection object image 50 includes defects in two or more inspection objects 10, the frame display control unit 32B displays the frame 60 used for defect inspection in a state where it overlaps the inspection object image 50 and the magnified inspection object image 50e, allowing the frame 60 to move and rotate relative to the inspection object image 50 and the magnified inspection object image 50e, and displays it at a size corresponding to a preset size.

[0088] Thus, according to the control device 18 of this embodiment, the positional relationship between the frame 60 for inspecting defects and the defect 52 included in the inspection object image 50 (enlarged inspection object image 50e) can be easily set to an appropriate state, thereby assisting in the evaluation of defects in the inspection object 10.

[0089] Furthermore, the above description addresses the case where the shape of frame 60 is rectangular, but the shape of frame 60 is not limited to a rectangle. For example, it can also be as follows: Figure 9 The box 60-1 shown is circular. In this case, the second auxiliary line 66-1 becomes a line segment corresponding to the diameter of the circle. Furthermore, the box 60 may not cover the entire interior area; it can also be arranged as follows: Figure 9 As shown in box 60-2, box 60 is formed by a portion of interrupted line segments. Figure 9 In the case of box 60-2 shown, it is also the same as box 60 mentioned above (refer to...). Figure 6 The second auxiliary line 66 is the same as that of the second auxiliary line 66-2, which is the diagonal of the rectangle defined by the box 60-2.

[0090] Alternatively, it can be configured as follows: when there are three or more defects 52, the display control unit 32 displays information on the display 26 indicating whether a visual judgment based on the user has been made and the score has been confirmed for each pair of defects 52. For example, it can also be configured as follows: when there are three or more defects 52, the display control unit 32 extracts two defects 52 as a pair, displays a straight line connecting the two defects 52 of the extracted pair, accepts user input corresponding to the straight line, and performs a display corresponding to the accepted input in association with the straight line. Figure 8 The image shows an example of how this will be displayed in this situation. Figure 8 In the example shown, for the pair of defects 52-1 and 52-2, a line 80-1 and a corresponding checkbox 82-1 are displayed. Similarly, for the pair of defects 52-2 and 52-3, a line 80-2 and a corresponding checkbox 82-2 are displayed. Figure 8 In the example shown, the following status is displayed: the pair of defects 52-1 and 52-2 has been confirmed, but the pair of defects 52-2 and 52-3 has not yet been confirmed. When the user confirms the pair of defects 52-1 and 52-2, they check the checkbox 82-1 through the input section 27. By clearly defining the pair of defects 52 that have been confirmed in this way, a comprehensive evaluation of the defects can be performed.

[0091] Furthermore, in the above method, the following approach was described: When the first auxiliary line 64 and the second auxiliary line 66 are displayed, the auxiliary line display control unit 32C automatically moves the frame 60 so that the first auxiliary line 64 and the second auxiliary line 66 overlap. However, the component that moves the frame 60 is not limited to the auxiliary line display control unit 32C. For example, the user can also manually move the frame 60 using the input unit 27 so that the first auxiliary line 64 and the second auxiliary line 66 overlap. Alternatively, the movement of the frame 60 can be configured as a combination of automatic movement based on the auxiliary line display control unit 32C and manual movement based on the user.

[0092] Furthermore, while the method of displaying the first auxiliary line 64 and the second auxiliary line 66 on the display 26 has been described, when the frame display control unit 32B automatically moves the frame 60 based on the first auxiliary line 64 and the second auxiliary line 66, the first auxiliary line 64 and the second auxiliary line 66 may not be displayed on the display 26.

[0093] Alternatively, it could be that it is capable of controlling the processing (see reference). Figure 7 The mid-course modification used for evaluation box 60. For example, it could also be, as from Figure 5 The box 60 shown is changed to Figure 10 As shown in box 60-3, it can be changed to boxes of different sizes. Furthermore, when using... Figure 10 In the case of box 60-3 shown, the fraction derivation unit 36 ​​can be configured to derive a total score by adding up the scores of defects 52-1, 52-2, and 52-3 included in box 60-3, or it can convert the sum of the scores of defects 52-1, 52-2, and 52-3 into the value of the size of box 60 and derive the total score. In the latter case, for example, if the area of ​​the rectangle defined by box 60-3 is twice the area of ​​the rectangle defined by box 60, the fraction derivation unit 36 ​​derives half of the sum of the scores of defects 52-1, 52-2, and 52-3 as the total score.

[0094] Alternatively, the display control unit 32 can be configured to display the scores or total scores of each defect 52 exported by the score export unit 36 ​​on the display 26.

[0095] Furthermore, in the above method, the defect detection unit 34 is configured to automatically detect defects 52 from the inspection object image 50. However, it can also be configured as follows: the user confirms the inspection object image 50 or the magnified inspection object image 50e displayed on the display 26, and uses the input unit 27 to specify the area of ​​defect 52 on the displayed inspection object image 50 or the magnified inspection object image 50e. The defect detection unit 34 will then detect the area specified by the user as defect 52.

[0096] Furthermore, in the above description, the inspection object image display control unit 32A and the frame display control unit 32B use the display 26 provided by the control device 18 as the display device for displaying the inspection object image 50 and the frame 60. However, the display device is not limited to the display 26. For example, the display device for displaying the inspection object image 50 and the frame 60 may also be a display device provided outside the control device 18.

[0097] In the above embodiments, for example, the hardware structure of the processing unit that performs various processes, such as the image acquisition unit 30, display control unit 32, defect detection unit 34, score output unit 36, and report generation unit 38, can use various processors as shown below. Among the various processors described above, in addition to the general-purpose processor, i.e., CPU, which executes software (program) and functions as various processing units, there are also processors such as FPGA (Field Programmable Gate Array), which can have their circuit structure changed after manufacturing, i.e., programmable logic devices (PLDs), and processors such as ASIC (Application Specific Integrated Circuit), which have circuit structures specifically designed for performing specific processes, i.e., dedicated circuits.

[0098] A processing unit can consist of one of these various processors, or it can consist of a combination of two or more processors of the same or different types (e.g., a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, multiple processing units can be composed of a single processor.

[0099] As examples of a single processor comprising multiple processing units, firstly, one could exemplify this: in client and server computers, a combination of one or more CPUs and software is used to construct a single processor, which functions as multiple processing units. Secondly, one could exemplify this: in system-on-a-chip (SoC) devices, a processor is used to implement the overall system functionality, including multiple processing units, using a single integrated circuit (IC) chip. In this way, various processing units are constructed using one or more of the aforementioned processors as their hardware architecture.

[0100] Moreover, as the hardware structure of these various processors, more specifically, circuits composed of circuit elements such as semiconductor elements can be used.

[0101] Furthermore, in the above embodiments, the method of pre-storing (installing) the control processing program 23 in the storage unit 22 of the control device 18 has been described, but it is not limited to this. The control processing program 23 may also be provided in a recording medium such as a CD-ROM (Compact Disc Read Only Memory), DVD-ROM (Digital Versatile Disc Read Only Memory), or USB (Universal Serial Bus) memory. In addition, the control processing program 23 may also be configured to be downloaded from an external device via a network.

[0102] Furthermore, the present invention can also be applied to programs and program products. Specifically, the control processing program 23 of the above embodiments can also be provided as a program product. Program products include products for providing programs in all ways. For example, program products include programs provided via networks such as the Internet, and non-transitory computer-readable recording media such as CD-ROMs and DVDs that store programs.

[0103] Furthermore, the structure and operation of the radiographic imaging apparatus 16 and control device 18 described in the above embodiments are merely examples, and modifications can be made according to the circumstances without departing from the spirit of the present invention. Additionally, it goes without saying that the above embodiments can be appropriately combined.

[0104] Regarding the above-described embodiments, the following notes are further disclosed.

[0105] (Note 1)

[0106] A control device, wherein,

[0107] Equipped with at least one processor

[0108] The processor

[0109] The image of the object being inspected, obtained through non-destructive inspection, is displayed on the display device.

[0110] When the displayed inspection object image includes defects in two or more of the inspection objects, the frame used to inspect the defects is overlapped on the inspection object image in a manner that allows the frame to be moved or rotated relative to the inspection object image in at least one of the following ways, and is displayed at a size corresponding to a preset size.

[0111] (Note 2)

[0112] According to the control device described in Appendix 1, wherein,

[0113] The frame is a graphic corresponding to a gauge.

[0114] (Note 3)

[0115] According to the control device described in Appendix 1, wherein,

[0116] The frame is a graphic based on gauges defined in JIS or ISO specifications related to non-destructive testing.

[0117] (Note 4)

[0118] The control device according to any one of Appendices 1 to 3, wherein,

[0119] The processor

[0120] The frame is moved relative to each other, such that the first auxiliary line set according to the position of the defect and the second auxiliary line set according to the position of the frame are in a pre-defined positional relationship.

[0121] (Note 5)

[0122] According to the control device described in Appendix 4, wherein...

[0123] The first auxiliary line is a line segment connecting the centroids of the two defects.

[0124] (Note 6)

[0125] According to the control device described in Appendix 4, wherein...

[0126] The first auxiliary line is a line segment connecting points within two areas of the defect.

[0127] In the case of multiple line segments, the longest line segment among the multiple line segments is designated as the first auxiliary line.

[0128] (Note 7)

[0129] According to the control device described in Appendix 4, wherein...

[0130] When the shape of the frame is rectangular, the second auxiliary line is at least one of the diagonals of the rectangular frame.

[0131] When the shape of the frame is circular, the second auxiliary line is at least one line corresponding to the diameter of the circular frame.

[0132] (Note 8)

[0133] The control device according to any one of Appendices 1 to 7, wherein,

[0134] The processor

[0135] For defects that are at least partially present within the frame, in the case of an area overlapping the frame, information indicating the intent is provided.

[0136] (Note 9)

[0137] According to the control device described in Appendix 8, wherein...

[0138] The processor

[0139] As a hint of the information, the portion of the box that overlaps with the defect, which is not entirely present within the box, will be highlighted compared to the other portions.

[0140] (Postscript 10)

[0141] The control device according to any one of Appendices 1 to 9, wherein...

[0142] The processor

[0143] If three or more of the aforementioned defects are present, two defects will be extracted as a pair.

[0144] Display the straight line connecting the two defects of the extracted pair.

[0145] Accept input from the user corresponding to the line.

[0146] The input received is displayed in association with the line.

[0147] (Postscript 11)

[0148] The control device according to any one of Appendices 1 to 10, wherein,

[0149] The processor

[0150] The image displayed includes an image of the object being inspected that captures most of the area of ​​the object being inspected, and an enlarged image of the object being inspected that magnifies a portion of the image.

[0151] When one of the frames, which is displayed superimposed on the image of the object being inspected and which is displayed superimposed on the magnified image of the object being inspected, moves or rotates relative to the image of the object being inspected, the other frame also moves or rotates in conjunction with it.

[0152] (Postscript 12)

[0153] The control device according to any one of Appendices 1 to 11, wherein,

[0154] A pre-defined correspondence between at least one of the defects' category, size, and length and a score is established.

[0155] The processor derives scores for at least a portion of the defects that exist within the frame based on the correspondence.

[0156] If there are multiple defects, at least some of which exist within the frame, a total score is further derived.

[0157] (Postscript 13)

[0158] According to the control device described in Appendix 12, wherein,

[0159] The processor

[0160] The state of the image of the object to be inspected, including the frame and at least a portion of the defect present within the frame, is recorded in association with the total score and displayed on the display device.

[0161] (Postscript 14)

[0162] A control method, wherein,

[0163] The processor of the control device

[0164] The image of the object being inspected, obtained through non-destructive inspection, is displayed on the display device.

[0165] When the displayed inspection object image includes defects in two or more of the inspection objects, the frame used to inspect the defects is overlapped on the inspection object image in a manner that allows the frame to be moved or rotated relative to the inspection object image in at least one of the following ways, and is displayed at a size corresponding to a preset size.

[0166] (Postscript 15)

[0167] A control program for causing a processor in a control device to perform the following processing:

[0168] The image of the object being inspected, obtained through non-destructive inspection, is displayed on the display device.

[0169] When the displayed inspection object image includes defects in two or more of the inspection objects, the frame used to inspect the defects is overlapped on the inspection object image in a manner that allows the frame to be moved or rotated relative to the inspection object image in at least one of the following ways, and is displayed at a size corresponding to a preset size.

[0170] The invention described in Japanese Patent Application No. 2023-119447, filed on July 21, 2023, is incorporated herein by reference in its entirety. All documents, patent applications, and technical specifications described herein, and those specifically and separately described herein, are incorporated herein by reference to the same extent.

Claims

1. A control device, wherein at least one processor is provided, the processor displaying, on a display device, an inspection target image obtained by photographing an inspection target of a non-destructive inspection, in a case where a flaw of two or more of the inspection targets is included in the displayed inspection target image, displaying a frame for inspecting the flaw in a state of being superimposed on the inspection target image, in a manner in which at least one of relative movement or rotation of the frame with respect to the inspection target image is possible, and in a size corresponding to a size set in advance.

2. The control device according to claim 1, wherein the frame is a figure corresponding to a gauge.

3. The control device according to claim 1, wherein the frame is a figure based on a gauge determined in a specification of JIS or ISO related to the non-destructive inspection.

4. The control device according to claim 1, wherein the processor causes the frame to be relatively moved so that a first auxiliary line set in accordance with a position of the flaw and a second auxiliary line set in accordance with a position of the frame are in a position relationship set in advance.

5. The control device according to claim 4, wherein the first auxiliary line is a line segment connecting centers of gravity of two of the flaws.

6. The control device according to claim 4, wherein the first auxiliary line is a line segment connecting points within areas of two of the flaws, in a case where a plurality of the line segments exist, the longest line segment among the plurality of the line segments is set as the first auxiliary line.

7. The control device according to claim 4, wherein in a case where a shape of the frame is a rectangle, the second auxiliary line is at least one of diagonal lines of the rectangular frame, in a case where a shape of the frame is a circle, the second auxiliary line is at least one line corresponding to a diameter of the circular frame.

8. The control device according to claim 1, wherein the processor for at least a part of the flaw existing within the frame, in a case where an area overlapping with the frame exists, prompting information indicating that.

9. The control device according to claim 8, wherein the processor as the prompting of the information, highlighting a part of the frame overlapping with the flaw of which not all parts exist within the frame, compared to other parts.

10. The control device according to claim 1, wherein the processor in a case where three or more of the flaws exist, extracting two flaws as a pair, displaying a straight line connecting the two flaws of the extracted pair, accepting an input of a user corresponding to the straight line, performing display corresponding to the accepted input in association with the straight line.

11. The control device according to claim 1, wherein the processor displaying, as the inspection target image, an inspection target image photographing a majority of a photographing range of the inspection target and an enlarged inspection target image in which a part of the inspection target image is enlarged, In a case where one of the frame displayed in a state of being superimposed on the inspection object image on which a majority of the inspection object is captured and the frame displayed in a state of being superimposed on the enlarged inspection object image is relatively moved or rotated with respect to the inspection object image, the other frame is also moved or rotated in linkage.

12. The control device according to claim 1, wherein a correspondence relationship of at least one of a category, a size, and a length of the defect and a score is set in advance, the processor derives a score based on the correspondence relationship for at least a portion of the defects existing in the frame, in a case where a plurality of the defects exist in at least a portion of the frame, a total score is further derived.

13. The control device according to claim 12, wherein the processor for the frame and a region of the inspection object image including at least the portion of the defects existing in the frame, a state displayed on the display device is recorded in association with the total score.

14. A control method, wherein a processor included in a control device an inspection object image obtained by capturing an inspection object subjected to non-destructive inspection is displayed on a display device, in a case where defects of two or more of the inspection objects are included in the displayed inspection object image, a frame for inspecting defects is displayed in a state of being superimposed on the inspection object image in a manner in which at least one of relative movement or rotation of the frame with respect to the inspection object image is possible, and in a size corresponding to a size set in advance.

15. A control program for causing a processor included in a control device to execute processing of: an inspection object image obtained by capturing an inspection object subjected to non-destructive inspection is displayed on a display device, in a case where defects of two or more of the inspection objects are included in the displayed inspection object image, a frame for inspecting defects is displayed in a state of being superimposed on the inspection object image in a manner in which at least one of relative movement or rotation of the frame with respect to the inspection object image is possible, and in a size corresponding to a size set in advance.

Images