Display control device, display control method, and display control program

Abstract

When performing display control based on a plurality of inspection images captured by irradiating an inspection target object with radiation from a plurality of different imaging directions, and structural information representing a three-dimensional structure of the inspection target object, a display control device of the present invention performs the display control on the basis of association information in which a viewpoint direction when performing the display control based on the structural information and the imaging directions of each of the plurality of inspection images are associated with one another.

Description

Display control device, display control method, and display control program

[0001] The present disclosure relates to a display control device, a display control method, and a display control program.

[0002] Japanese Patent Laid-Open Publication No. 2021-135153 discloses a technique for creating three-dimensional data of an object to be inspected using information from multiple X-ray images obtained by photographing the object. This technique uses the three-dimensional data of the object to create and display a user confirmation image that shows the shape of the inspection target portion of the object to be inspected as a two-dimensional shape of the desired observation surface.

[0003] In non-destructive testing, it is preferable to be able to associate information about a flaw in a two-dimensional test image taken by irradiating a test object with the position of the flaw in the three-dimensional structure of the test object, because the efficiency of testing can be improved by referring to the shape and texture information of the flaw in the two-dimensional test image together with the position of the flaw in the three-dimensional structure of the test object.

[0004] The present disclosure has been made in consideration of the above circumstances, and aims to provide a display control device, a display control method, and a display control program that can improve the inspection efficiency of non-destructive inspection.

[0005] A first aspect of the display control device is a display control device that has at least one processor and performs display control based on a plurality of inspection images captured by irradiating an inspection object with radiation from a plurality of different shooting directions and structural information representing the three-dimensional structure of the inspection object, and the processor performs display control based on correspondence information that corresponds the viewpoint direction when performing display control based on the structural information with the shooting direction of each of the plurality of inspection images.

[0006] A second aspect of the display control device is the display control device of the first aspect, wherein the processor controls the display of at least one inspection image and a virtual inspection object based on structural information, based on the association information.

[0007] A third aspect of the display control device is the display control device of the second aspect, wherein the processor changes the display mode of at least a plurality of inspection images based on the association information.

[0008] A fourth aspect of the display control device is the display control device of the third aspect, wherein the processor changes the display mode of the inspection image based on the viewpoint direction.

[0009] A fifth aspect of the display control device is the display control device of the fourth aspect, in which the processor selects one inspection image from a plurality of inspection images based on the angle between the viewing direction and the shooting direction, and changes the display mode of the selected inspection image.

[0010] A sixth aspect of the display control device is the display control device of the fourth aspect, in which the processor selects one inspection image from a plurality of inspection images based on the similarity between the inspection image and a two-dimensional image obtained by projecting structural information along the viewpoint direction, and changes the display mode of the selected inspection image.

[0011] A seventh aspect of the display control device is the display control device of the fifth or sixth aspect, wherein the processor performs control to highlight the selected test image.

[0012] The display control device of an eighth aspect is the display control device of the fifth or sixth aspect, wherein the processor changes the display position of the selected inspection image.

[0013] A ninth aspect of the display control device is the display control device of the fifth or sixth aspect, wherein the processor controls to display only a selected inspection image from among a plurality of inspection images.

[0014] A tenth aspect of the display control device is the display control device of the fourth aspect, in which, when controlling the display of multiple inspection images, the processor positions each inspection image at a position corresponding to the angle between the viewing direction and the shooting direction of each inspection image.

[0015] In an eleventh aspect of the display control device, in the fourth aspect, the processor, when controlling the display of a plurality of test images, arranges each test image in an order according to the attribute information of each test image.

[0016] A twelfth aspect of the display control device is the display control device of the fourth aspect, in which, when the processor controls the display of multiple test images, the processor arranges each test image in an order according to the angle between the viewing direction and the shooting direction of each test image, or in an order according to the similarity between each test image and a two-dimensional image obtained by projecting structural information along the viewing direction.

[0017] A thirteenth aspect of the display control device is a display control device of any one of the second to twelfth aspects, in which the processor changes the display mode of a virtual inspection object based on the shooting direction corresponding to a selected position within the display area of ​​a plurality of inspection images.

[0018] A fourteenth aspect of the display control device is the display control device of the thirteenth aspect, wherein the processor changes the viewpoint direction to a direction equal to the photographing direction of the selected inspection image.

[0019] A display control device of a fifteenth aspect is a display control device of the thirteenth aspect, in which the processor changes the viewpoint direction in the same direction as or opposite to the operation of moving the selected inspection image, in accordance with the operation of moving the selected inspection image.

[0020] A 16th aspect of the display control device is the 13th aspect of the display control device, wherein when the selected position is a position between a plurality of test images, the processor changes the viewpoint direction so that the relative positional relationship between the selected position and the test images arranged around the selected position approaches the relative positional relationship between the viewpoint direction and the test images arranged around the selected position.

[0021] A seventeenth aspect of the display control device is a display control device of any one of the second to sixteenth aspects, in which the processor controls the display of information representing the correspondence between structural information and multiple inspection images, based on the correspondence information, by compositing the information onto at least one of the virtual inspection object and the inspection images.

[0022] The display control device of the 18th aspect is the display control device of the 17th aspect, in which the processor controls the display of an object indicating the presence of an inspection image around the virtual inspection object and in a direction corresponding to the shooting direction of each inspection image.

[0023] A nineteenth aspect of the display control device is the display control device of the eighteenth aspect, wherein the processor performs control to highlight an object indicating the presence of a selected test image.

[0024] A twentieth aspect of the display control device is the display control device of the seventeenth aspect, in which the processor controls the display of a selected inspection image by synthesizing grid-like auxiliary lines, and controls the display of a virtual inspection object by synthesizing grid-like auxiliary lines spaced at the same intervals as the auxiliary lines on a surface perpendicular to the direction corresponding to the shooting direction of the selected inspection image.

[0025] A display control device of a 21st aspect is the display control device of the 17th aspect, in which the processor controls the display of corresponding feature points between a selected inspection image and a virtual inspection object by combining the inspection image and the virtual inspection object.

[0026] A 22nd aspect of the display control device is the 17th aspect of the display control device, in which the processor controls the display of an object representing a defect synthesized at a position on a virtual inspection object corresponding to the position of the defect on a selected inspection image.

[0027] A display control device of the 23rd aspect is a display control device of any one of the 2nd to 22nd aspects, in which position information of a flaw shown in an inspection image is associated with position information of the flaw in the structural information, and a processor changes at least one of the display mode of the virtual inspection object and the display mode of the inspection image based on the position information of the flaw selected in the inspection image or the structural information.

[0028] A 24th aspect of the display control device is the 23rd aspect of the display control device, in which the processor changes the display mode of the inspection image based on the distance between the position of a selected flaw among multiple flaws and the positions of flaws other than the selected flaw.

[0029] A 25th aspect of the display control device is the 23rd aspect of the display control device, in which the processor changes the display mode of the inspection image based on the ratio between the average pixel value of the selected flaw area and the average pixel value of the surrounding area of ​​the flaw area.

[0030] A twenty-sixth aspect of the display control device is the twenty-third aspect of the display control device, wherein the processor changes the display mode of the inspection image based on the smoothness of pixel values ​​in the peripheral area of ​​the selected flaw.

[0031] A display control device according to a twenty-seventh aspect is the display control device according to the twenty-third aspect, wherein the processor changes the viewpoint direction so that the selected flaw is positioned at the center of the screen and in the foreground.

[0032] A twenty-eighth aspect of the display control device is the twenty-third aspect of the display control device, in which the processor changes the viewpoint direction so that the thickness of the object to be inspected along the viewpoint direction is the thinnest at the position of the selected flaw.

[0033] The display control method of the 29th aspect is a display control method executed by the processor of a display control device that has at least one processor and performs display control based on a plurality of inspection images taken by irradiating the object to be inspected from a plurality of different shooting directions and structural information representing the three-dimensional structure of the object to be inspected, and performs display control based on correspondence information that corresponds the viewpoint direction when performing display control based on the structural information with the shooting direction of each of the plurality of inspection images.

[0034] The display control program of the 30th aspect is a display control program to be executed by a processor of a display control device that has at least one processor and performs display control based on multiple inspection images taken by irradiating the object to be inspected from multiple different shooting directions and structural information representing the three-dimensional structure of the object to be inspected, and performs display control based on correspondence information that corresponds the viewpoint direction when performing display control based on the structural information with the shooting direction of each of the multiple inspection images.

[0035] According to the present disclosure, the inspection efficiency of non-destructive inspection can be improved.

[0036] 1 is a block diagram showing a schematic configuration of a radiographic image capturing device. FIG. 2 is a block diagram showing an example of the hardware configuration of a display control device. FIG. 3 is a diagram for explaining structural information. FIG. 4 is a diagram showing an example of inspection image information. FIG. 5 is a diagram showing an example of flaw position information. FIG. 6 is a block diagram showing an example of the functional configuration of a display control device. FIG. 7 is a diagram showing an example of a display screen. FIG. 8 is a diagram showing an example of a display screen. FIG. 9 is a diagram showing an example of a display screen. FIG. 10 is a diagram showing an example of a display screen. FIG. 11 is a diagram showing an example of a display screen. FIG. 12 is a diagram showing an example of a display screen. FIG. 13 is a diagram showing an example of a display screen.

[0037] Hereinafter, examples of embodiments for carrying out the technology of the present disclosure will be described in detail with reference to the drawings.

[0038] First, the configuration of a radiographic image capturing apparatus 1 according to this embodiment will be described with reference to Fig. 1. The radiographic image capturing apparatus 1 is used for non-destructive testing of an object to be inspected. As shown in Fig. 1, the radiographic image capturing apparatus 1 includes a display control device 10, a radiation source 12, and a radiation detector 14. The display control device 10, the radiation source 12, and the radiation detector 14 are connected to each other so as to be able to communicate with each other. The display control device 10 is, for example, a computer such as a personal computer or a server computer.

[0039] The radiation source 12 irradiates the inspection object O with radiation R, such as X-rays. The radiation source 12 according to this embodiment irradiates cone beam radiation R. The direction from the radiation source 12 to a point on the radiation detector 14 at which the radiation R, which has passed through the inspection object O, reaches is referred to as the "imaging direction D." In this embodiment, an example will be described in which the imaging direction D is the direction from the radiation source 12 to a point on the radiation detector 14 at which the radiation R, which has passed through the center of the inspection object O, reaches.

[0040] The radiation detector 14 includes a scintillator as an example of a light-emitting layer that emits light when irradiated with radiation R, and a TFT (Thin Film Transistor) substrate. The scintillator and TFT substrate are layered along the irradiation direction of radiation R, i.e., the imaging direction D. The TFT substrate includes a plurality of pixels arranged two-dimensionally, and each pixel includes a sensor unit and a field-effect thin-film transistor as an example of a conversion element that generates an increasing amount of charge as the amount of radiation irradiated increases. The sensor unit absorbs light emitted by the scintillator to generate and accumulate charge. The field-effect thin-film transistor converts the accumulated charge in the sensor unit into an electrical signal for output. With the above configuration, the radiation detector 14 generates a two-dimensional radiographic image corresponding to the amount of radiation R irradiated from the radiation source 12 onto the inspection object O and transmitted through the inspection object O, and outputs the generated radiographic image to the display control device 10.

[0041] In this way, in the radiographic imaging device 1, a radiographic image captured by irradiating the inspection object O with radiation R from the radiation source 12 is stored in the display control device 10. Hereinafter, a radiographic image captured by irradiating the inspection object O with radiation R will be referred to as an "inspection image."

[0042] Next, the hardware configuration of the display control device 10 according to this embodiment will be described with reference to Fig. 2. As shown in Fig. 2, the display control device 10 includes a CPU (Central Processing Unit) 20, a memory 21 serving as a temporary storage area, and a non-volatile storage unit 22. The display control device 10 also includes a display 23 such as a liquid crystal display, an input device 24 such as a keyboard and a mouse, and a network I / F (Interface) 25 connected to a network. The display control device 10 also includes an external I / F 26 to which the radiation source 12 and the radiation detector 14 are connected. The CPU 20, the memory 21, the storage unit 22, the display 23, the input device 24, the network I / F 25, and the external I / F 26 are connected to a bus 27. The CPU 20 is an example of a processor according to the disclosed technology.

[0043] The storage unit 22 is realized by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, or the like. The storage unit 22 serves as a storage medium and stores a display control program 30. The CPU 20 reads the display control program 30 from the storage unit 22, loads it into the memory 21, and executes the loaded display control program 30.

[0044] The memory unit 22 also stores structural information 32, inspection image information 34, and flaw position information 36. The structural information 32 includes information representing the three-dimensional structure of the inspection object O. As shown in FIG. 3 as an example, the structural information 32 according to this embodiment is information used when a virtual inspection object O is displayed on the display 23, and is information that represents the three-dimensional structure of the inspection object O using coordinates in an orthogonal coordinate system consisting of three axes: the X-axis, the Y-axis, and the Z-axis. The structural information 32 also includes the material of each component that constitutes the inspection object O. The transmittance of the radiation R of the component is determined depending on the component's material. An example of the structural information 32 is design information such as CAD data.

[0045] As an example, as shown in Fig. 4 , the inspection image information 34 includes a plurality of inspection images captured by irradiating the inspection object O with radiation R from a plurality of different imaging directions D. Fig. 4 shows an example in which there are four imaging directions D, i.e., four inspection images. The number of imaging directions D and the directions to be used for the imaging directions D are set by the user depending on the shape, material, etc. of the inspection object O.

[0046] 4, the inspection image information 34 includes an ID for identifying each inspection image associated with the inspection image, the shooting direction D when each inspection image was captured, and information about defects on the inspection object O detected from each inspection image. The shooting direction D included in the inspection image information 34 is converted into coordinates in the Cartesian coordinate system of the structure information 32. The direction passing through the origin (0,0,0) from the coordinates of the shooting direction D included in the inspection image information 34 is the shooting direction D when the inspection image was captured.

[0047] The information about flaws contained in the inspection image information 34 includes IDs for identifying flaws detected in the inspection image and positional information about the flaws in the inspection image. The example in FIG. 4 shows that three flaws have been detected, with their respective IDs being "A," "B," and "C." In this embodiment, the positional information about flaws in the inspection image is expressed in coordinates of a Cartesian coordinate system that has a specific point (e.g., the point in the upper left corner) of the two-dimensional inspection image as its origin and is composed of two axes, the X axis and the Y axis. The term "flaw" in this specification is defined as a non-destructive inspection term and refers to discontinuities such as bubbles, foreign objects, and cracks.

[0048] 5 as an example, the flaw position information 36 includes an ID for identifying the flaw and flaw position information. The ID included in the flaw position information 36 is the same as the ID included in the information about the flaw in the inspection image information 34. The flaw position information included in the flaw position information 36 is the flaw position information in the inspection image included in the inspection image information 34 converted into coordinates in the Cartesian coordinate system of the structure information 32. In other words, the flaw position information included in the inspection image information 34, which is the position information of the flaw shown in the inspection image, and the flaw position information in the structure information 32 are associated with each other by the ID for identifying the flaw.

[0049] Next, the functional configuration of the display control device 10 according to this embodiment will be described with reference to Fig. 6. As shown in Fig. 6, the display control device 10 includes a reception unit 40, a selection unit 42, and a display control unit 44. The CPU 20 executes the display control program 30 to function as the reception unit 40, the selection unit 42, and the display control unit 44.

[0050] The reception unit 40 receives user operations on the screen displayed on the display 23 under the control of the display control unit 44, which will be described later. For example, the user performs operations such as selecting one of the multiple inspection images displayed on the display 23, rotating the virtual inspection object O displayed on the display 23, and selecting a flaw displayed on the display 23.

[0051] The selection unit 42 selects one inspection image from the plurality of inspection images based on the angle formed between the viewing direction when the display control unit 44 performs display control based on the structural information 32 and the shooting direction D of each inspection image. The viewing direction is the direction of the display screen of the virtual inspection object O as seen from the virtual inspection object O. The viewing direction is expressed, for example, by coordinates in the Cartesian coordinate system of the structural information 32. In other words, the viewing direction and the shooting direction D included in the inspection image information 34 correspond to each other by coordinates in the same Cartesian coordinate system.

[0052] Furthermore, when looking in the direction from the coordinates representing the viewpoint direction to the origin, the virtual inspection object O faces the display screen. That is, for example, when the user performs an operation to rotate the inspection object O displayed on the display 23, the viewpoint direction is changed. Furthermore, when the viewpoint direction is changed, the posture of the virtual inspection object O is changed so that the surface facing the viewpoint direction faces the display screen.

[0053] Specifically, the selection unit 42 calculates the angle between the viewpoint direction and the photographing direction D of each inspection image based on the inspection image information 34, and selects the inspection image with the smallest calculated angle.

[0054] The selection unit 42 may calculate the similarity between each inspection image and a two-dimensional image obtained by projecting the structural information 32 along the viewpoint direction. In this case, the selection unit 42 selects one inspection image from the plurality of inspection images based on the calculated similarity. Specifically, the selection unit 42 selects the inspection image with the highest calculated similarity.

[0055] As shown in Fig. 7 , the display control unit 44 controls the display of a virtual inspection object O and multiple inspection images on the display 23 based on the structural information 32 and the inspection image information 34. As shown in Fig. 7 , the screen displayed under the display control by the display control unit 44 includes a first display area A1 in which the virtual inspection object O is displayed and a second display area A2 in which the multiple inspection images are displayed. In the example of Fig. 7 , the multiple inspection images are displayed in a tiled arrangement, but the multiple inspection images may also be displayed in a line aligned vertically or horizontally on the screen.

[0056] 7, the display control unit 44 further controls the display of objects representing flaws on the virtual inspection object O based on the flaw position information 36. In the example of FIG. 7, flaws are represented by black circles. The objects representing flaws are not particularly limited and may be, for example, predetermined marks or icons. Furthermore, for example, the objects representing flaws may be images of the flaw area in the inspection image. Furthermore, for example, the color of the objects representing flaws may be different for each flaw.

[0057] When the accepting unit 40 accepts an operation to rotate the virtual inspection object O, the display control unit 44 rotates the virtual inspection object O by changing the viewpoint direction according to the rotation amount of the operation. In this case, the display control unit 44 changes the display mode of the inspection image based on the changed viewpoint direction. Specifically, the display control unit 44 changes the display mode of the inspection image selected by the selecting unit 42 based on the changed viewpoint direction.

[0058] 8 , the display control unit 44 controls the display of the inspection image selected by the selection unit 42 to be highlighted by drawing the outline of the inspection image selected by the selection unit 42 in a preset color such as red. FIG. 8 shows an example in which the inspection image located in the upper left corner is selected by the selection unit 42.

[0059] As shown in Figure 9, the display control unit 44 may control the display of the inspection image selected by the selection unit 42 in a larger size than the other inspection images, thereby highlighting the inspection image selected by the selection unit 42.

[0060] 10, the display control unit 44 may change the display position of the examination image selected by the selection unit 42. The example of Fig. 10 shows a state in which a plurality of examination images are arranged vertically in the display area A2, and the display position of the examination image selected by the selection unit 42 is changed to the top.

[0061] 11 , the display control unit 44 may perform control to display only the inspection image selected by the selection unit 42 from among the multiple inspection images. In this case, the display control unit 44 switches one inspection image to be displayed in the display area A2 in response to a user operation such as a scroll operation to switch the inspection image to be displayed.

[0062] 12 , when controlling the display of a plurality of examination images, the display control unit 44 may arrange each examination image at a position corresponding to the angle formed between the viewing direction and the imaging direction D of each examination image. In this case, the user can easily grasp the imaging direction D when each examination image was taken. In the example of FIG. 12 , each examination image is arranged on a sphere to make it easier for the user to grasp the imaging direction D when each examination image was taken.

[0063] 13 , when arranging each inspection image at a position according to the angle formed between the viewing direction and the shooting direction D of each inspection image, the display control unit 44 may arrange the inspection image with the smallest angle formed between the viewing direction and the shooting direction D in the center of the display area A2. In this case, the display control unit 44 arranges inspection images other than the inspection image arranged in the center of the display area A2 according to the angle formed between the shooting direction D of that inspection image and the shooting direction D of the inspection image arranged in the center of the display area A2. In the example of FIG. 13 , the display control unit 44 controls the display so that the inspection image arranged in the center of the display area A2 is displayed larger than the other inspection images.

[0064] Furthermore, when controlling the display of a plurality of examination images, the display control unit 44 may arrange each examination image in an order according to the attribute information of each examination image. For example, in the display area A2 of the display screen shown in Fig. 10, the display control unit 44 arranges the examination images from top to bottom in order of the photographing date and time closest to the time of display. Furthermore, the attribute information in this case is not limited to the photographing date and time, and may also be the photographer, the examiner, etc.

[0065] Furthermore, when controlling the display of a plurality of examination images, the display control unit 44 may arrange the examination images in an order according to the angle between the viewing direction and the imaging direction D of each examination image. For example, in the display area A2 of the display screen shown in Fig. 10, the display control unit 44 arranges the examination images from the top in descending order of the angle between the viewing direction and the imaging direction D of each examination image.

[0066] Furthermore, when controlling the display of a plurality of inspection images, the display control unit 44 may arrange the inspection images in an order according to the degree of similarity between each inspection image and a two-dimensional image obtained by projecting the structural information 32 along the viewing direction. For example, in the display area A2 of the display screen shown in Fig. 10, the inspection images are arranged from top to bottom in descending order of the degree of similarity between each inspection image and a two-dimensional image obtained by projecting the structural information 32 along the viewing direction.

[0067] When the accepting unit 40 accepts an operation to select a position within the display area A2 of a plurality of images, the display control unit 44 changes the display mode of the virtual inspection object O based on the shooting direction D corresponding to the selected position within the display area A2. Examples of the operation in this case include an operation to select the inspection image itself, an operation to select a position between the inspection images, etc.

[0068] Specifically, the display control unit 44 changes the viewpoint direction to a direction equal to the imaging direction D of the selected inspection image. In this case, the virtual inspection object O is displayed in the display area A1 with the surface of the virtual inspection object O viewed from the imaging direction D facing the display screen.

[0069] 12 or 13, the display control unit 44 may change the viewpoint direction in accordance with an operation to move the selected inspection image, in the same direction as the operation or in the opposite direction to the operation. In this case, the virtual inspection object O rotates in accordance with the operation to move the inspection image. In addition, at this time, the display control unit 44 may synchronize the speed at which the inspection image is moved with the speed at which the viewpoint direction is moved.

[0070] 12 or 13 , when the selected position is between a plurality of inspection images, the display control unit 44 may change the viewpoint direction so that the relative positional relationship between the selected position and the inspection images arranged around the selected position approaches the relative positional relationship between the viewpoint direction and the inspection images arranged around the selected position. In this case, the virtual inspection object O is displayed in the display area A1 with the surface of the virtual inspection object O corresponding to the selected position facing the display screen.

[0071] Next, the operation of the display control device 10 according to this embodiment will be described with reference to Fig. 14. The CPU 20 executes the display control program 30, thereby executing the display control process shown in Fig. 14. The display control process shown in Fig. 14 is executed, for example, when a command to start execution is input by the user.

[0072] 14, the display control unit 44 controls the display of the virtual inspection object O and multiple inspection images on the display 23 based on the structure information 32 and the inspection image information 34. Furthermore, the display control unit 44 controls the display of an object representing a flaw on the virtual inspection object O based on the flaw position information 36. The viewpoint direction when the virtual inspection object O is displayed on the initial display screen in this step S10 may be the viewpoint direction of the initial setting value, or may inherit the viewpoint direction when the virtual inspection object O was displayed the previous time. Furthermore, the display state of the multiple inspection images may also follow the initial setting value, or may inherit the display state when the multiple inspection images were displayed the previous time.

[0073] In step S12, the reception unit 40 waits until it receives a user operation on the screen displayed by the control in the immediately preceding step S10, step S20, or step S22. When the reception unit 40 receives a user operation, the determination in step S12 becomes positive, and the process proceeds to step S14.

[0074] In step S14, the receiving unit 40 determines whether the operation received in step S12 is an operation to rotate the virtual inspection object O. If this determination is positive, the process proceeds to step S16.

[0075] In step S16, the display control unit 44 rotates the virtual inspection object O by changing the viewpoint direction in accordance with the rotation amount of the operation accepted in step S12. In step S18, the selection unit 42 selects one inspection image from the plurality of inspection images based on the angle between the viewpoint direction changed by the processing of step S16 and the shooting direction D of each inspection image, as described above. In step S20, the display control unit 44 performs control to highlight the inspection image selected in step S18, as described above. When the processing of step S20 is completed, the process returns to step S12.

[0076] On the other hand, if the operation accepted in step S12 is an operation for selecting a position within the display area A2 of a plurality of images, the determination in step S14 is negative, and the process proceeds to step S22. In step S22, the display control unit 44 changes the viewpoint direction to a direction equal to the imaging direction D of the inspection image selected by the operation accepted in step S12, as described above. When the process of step S22 ends, the process returns to step S12. When the user inputs an instruction to end the display on the screen, the display control process ends.

[0077] As described above, according to this embodiment, flaw information in a two-dimensional inspection image is associated with the position of the flaw in the three-dimensional structure of the inspection object O, and the display of the two-dimensional inspection image is linked with the display of a three-dimensional virtual inspection object O. This makes it possible to improve the inspection efficiency of non-destructive inspection.

[0078] In the above embodiment, the display control unit 44 may control the display of information representing the correspondence between the structural information 32 and multiple inspection images, based on the structural information 32 and the inspection image information 34, by synthesizing the information with at least one of the virtual inspection object O and the inspection image.

[0079] Specifically, as shown in FIG. 15 as an example, the display control unit 44 may perform control to synthesize an object indicating the presence of an inspection image around the virtual inspection object O and in a direction corresponding to the shooting direction D of each inspection image, and display the synthesized object on the display 23. FIG. 15 shows an example in which a thumbnail image of the inspection image is used as the object indicating the presence of the inspection image. In this case, as shown in FIG. 16 , an arrow indicating the shooting direction D of the inspection image may be used as the object indicating the presence of the inspection image. In addition, in this case, a mark or icon representing the inspection image may be used as the object indicating the presence of the inspection image. In addition, in this case, when an inspection image is selected by the user in the display area A2, the display control unit 44 may perform control to highlight the object indicating the presence of the inspection image.

[0080] Furthermore, as shown in FIG. 17, the display control unit 44 may perform control to synthesize and display a grid-like auxiliary line for the selected inspection image, and may also perform control to synthesize and display a grid-like auxiliary line at the same intervals as the auxiliary line on a plane perpendicular to the direction corresponding to the shooting direction D of the selected inspection image for the virtual inspection object O.

[0081] 18 , the display control unit 44 may perform control to display corresponding feature points between the selected inspection image and the virtual inspection object O by combining them with the inspection image and the virtual inspection object O. In FIG. 18 , corresponding feature points between the inspection image and the virtual inspection object O are represented by circle, triangle, and square marks, respectively.

[0082] The display control unit 44 may also perform control to synthesize and display an object representing a flaw at a position on the virtual inspection object O that corresponds to the position of the flaw on the selected inspection image.

[0083] In addition, in the above embodiment, when the reception unit 40 receives an operation to select an object representing a flaw in the inspection image or a flaw in the virtual inspection object O, the display control unit 44 may change at least one of the display mode of the virtual inspection object O and the display mode of the inspection image based on the positional information of the selected flaw.

[0084] Specifically, the selection unit 42 first selects one inspection image from the multiple inspection images based on the distance between the position of a flaw selected by the user from the multiple flaws and the positions of flaws other than the selected flaw. More specifically, the selection unit 42 selects the inspection image with the longest distance. The display control unit 44 controls the display of the inspection image selected by the selection unit 42 to be highlighted. This makes it easier for the user to refer to inspection images in which flaws are relatively far apart, i.e., inspection images in which the conditions of the flaws are relatively easy to see.

[0085] In this case, the selection unit 42 may select one inspection image from the plurality of inspection images based on the ratio between the average pixel value of the flaw area selected by the user and the average pixel value of the area surrounding the flaw area. Specifically, the selection unit 42 selects the inspection image with the largest ratio. The display control unit 44 controls the display of the inspection image selected by the selection unit 42 to be highlighted. This makes it easier for the user to refer to an inspection image in which the flaw area is relatively easy to see.

[0086] In this case, the selection unit 42 may select one inspection image from the plurality of inspection images based on the smoothness of pixel values ​​in the area surrounding the flaw selected by the user. Specifically, the selection unit 42 selects the inspection image with the highest smoothness. The display control unit 44 controls the display of the inspection image selected by the selection unit 42 to be highlighted. This makes it easier for the user to refer to the inspection image in which the flaw area is relatively easy to see.

[0087] Furthermore, as shown in FIG. 19, the display control unit 44 may change the viewpoint direction so that the flaw selected by the user is positioned at the center and in the foreground of the screen.

[0088] Furthermore, as shown in FIG. 20, the viewpoint direction may be changed so that the thickness of the inspection object O along the viewpoint direction becomes the thinnest at the position of the flaw selected by the user.

[0089] Furthermore, in the above embodiment, the display control unit 44 does not need to control the display of an object representing a flaw on the virtual inspection object O based on the flaw position information 36. In this case, the display control device 10 does not need to store the flaw position information 36.

[0090] In the above embodiment, the following various processors can be used as the hardware structure of the processing units that execute various processes, such as the reception unit 40, the selection unit 42, and the display control unit 44. As described above, the various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as various processing units, as well as dedicated electrical circuits that are processors having a circuit configuration specifically designed to execute specific processes, such as a programmable logic device (PLD) that is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field Programmable Gate Array), and an ASIC (Application Specific Integrated Circuit).

[0091] A single processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with a single processor.

[0092] Examples of configuring multiple processing units with a single processor include: first, a form in which one processor is configured with a combination of one or more CPUs and software, as typified by computers such as client and server computers, and this processor functions as multiple processing units; second, a form in which a processor is used to realize the functions of an entire system including multiple processing units with a single IC (Integrated Circuit) chip, as typified by systems on chips (SoCs); in this way, various processing units are configured using one or more of the above-mentioned various processors as a hardware structure.

[0093] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements.

[0094] In the above embodiment, the display control program 30 is pre-stored (installed) in the storage unit 22, but this is not limiting. The display control program 30 may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory. The display control program 30 may also be downloaded from an external device via a network.

[0095] The disclosure of Japanese Patent Application No. 2022-101831, filed on June 24, 2022, is incorporated herein by reference in its entirety. In addition, all documents, patent applications, and technical standards described herein are incorporated herein by reference to the same extent as if each individual document, patent application, and technical standard was specifically and individually indicated to be incorporated by reference.

Claims

1. A display control device comprising at least one processor, and performing display control based on a plurality of inspection images captured by irradiating an inspection object with radiation from a plurality of different imaging directions and structural information representing a three-dimensional structure of the inspection object, The processor, The display control is performed based on association information in which a viewpoint direction when performing the display control based on the structural information is associated with the photographing direction of each of the plurality of inspection images. Display control device.

2. The processor, Based on the association information, control is performed to display at least one of the inspection images and a virtual inspection object based on the structural information. The display control device according to claim 1 .

3. The processor, A display mode of at least the plurality of inspection images is changed based on the association information. The display control device according to claim 2 .

4. The processor, The display mode of the inspection image is changed based on the viewing direction. The display control device according to claim 3 .

5. The processor, selecting one inspection image from the plurality of inspection images based on an angle between the viewing direction and the photographing direction; Change the display mode of the selected inspection image The display control device according to claim 4.

6. The processor, selecting one inspection image from the plurality of inspection images based on a similarity between a two-dimensional image obtained by projecting the structural information along the viewpoint direction and the inspection image; Change the display mode of the selected inspection image The display control device according to claim 4.

7. The processor, Controls highlighting of selected inspection images The display control device according to claim 5 or 6.

8. The processor, Change the display position of the selected inspection image The display control device according to claim 5 or 6.

9. The processor, Control is performed to display only a selected inspection image from among the plurality of inspection images. The display control device according to claim 5 or 6.

10. The processor, When controlling the display of the plurality of inspection images, each inspection image is arranged at a position corresponding to an angle between the viewing direction and the photographing direction of each inspection image. The display control device according to claim 4.

11. The processor, When controlling the display of the plurality of inspection images, the inspection images are arranged in an order according to attribute information of each inspection image. The display control device according to claim 4.

12. The processor, When controlling display of the plurality of inspection images, the inspection images are arranged in an order according to an angle between the viewing direction and the photographing direction of each inspection image, or in an order according to a similarity between each inspection image and a two-dimensional image obtained by projecting the structural information along the viewing direction. The display control device according to claim 4.

13. The processor, changing a display mode of the virtual inspection object based on the shooting direction corresponding to a selected position within a display area of ​​the plurality of inspection images; The display control device according to any one of claims 2 to 6.

14. The processor, The viewpoint direction is changed to a direction equal to the photographing direction of the selected inspection image. The display control device according to claim 13.

15. The processor, In response to an operation of moving the selected inspection image, the viewpoint direction is changed in the same direction as the operation of moving the inspection image or in a direction opposite to the operation of moving the inspection image. The display control device according to claim 13.

16. The processor, When the selected position is a position between the plurality of inspection images, the viewpoint direction is changed so that the relative positional relationship between the selected position and the inspection images arranged around the selected position approaches the relative positional relationship between the viewpoint direction and the inspection images arranged around the selected position. The display control device according to claim 13.

17. The processor, Based on the correspondence information, control is performed to synthesize information representing the correspondence relationship between the structural information and the plurality of inspection images onto at least one of the virtual inspection object and the inspection images and to display the information. The display control device according to any one of claims 2 to 6.

18. The processor, and performing control to display an object representing the presence of the inspection image around the virtual inspection object and in a direction corresponding to the photographing direction of each inspection image. The display control device according to claim 17.

19. The processor, Controlling to highlight the object representing the presence of the selected inspection image The display control device according to claim 18.

20. The processor, For the selected inspection image, a control is performed to synthesize and display lattice-like auxiliary lines, and for the virtual inspection object, a control is performed to synthesize and display lattice-like auxiliary lines having the same intervals as the auxiliary lines on a surface orthogonal to a direction corresponding to the photographing direction of the selected inspection image. The display control device according to claim 17.

21. The processor, and performing control to display the selected corresponding feature points of the inspection image and the virtual inspection object by combining the selected feature points with the inspection image and the virtual inspection object. The display control device according to claim 17.

22. The processor, Control is performed to synthesize and display an object representing a flaw at a position on a virtual inspection object corresponding to the position of the flaw on the selected inspection image. The display control device according to claim 17.

23. position information of a flaw captured in the inspection image is associated with position information of a flaw in the structural information; The processor, At least one of a display mode of the virtual inspection object and a display mode of the inspection image is changed based on position information of the flaw selected in the inspection image or the structure information. The display control device according to any one of claims 2 to 6.

24. The processor, The display mode of the inspection image is changed based on a distance between a position of a selected flaw among the plurality of flaws and a position of a flaw other than the selected flaw. The display control device according to claim 23.

25. The processor, The display mode of the inspection image is changed based on the ratio between the average pixel value of the selected flaw region and the average pixel value of the surrounding region of the flaw region. The display control device according to claim 23.

26. The processor, The display mode of the inspection image is changed based on the smoothness of pixel values ​​in the peripheral area of ​​the selected flaw. The display control device according to claim 23.

27. The processor, The viewing direction is changed so that the selected flaw is positioned at the center and in front of the screen. The display control device according to claim 23.

28. The processor, The viewpoint direction is changed so that the thickness of the inspection object along the viewpoint direction becomes the thinnest at the position of the selected flaw. The display control device according to claim 23.

29. A display control method executed by at least one processor of a display control device that performs display control based on a plurality of inspection images captured by irradiating an inspection object with radiation from a plurality of different imaging directions and structural information representing a three-dimensional structure of the inspection object, the method comprising: The display control is performed based on association information in which a viewpoint direction when performing the display control based on the structural information is associated with the photographing direction of each of the plurality of inspection images. Display control method.

30. A display control program for causing a processor of a display control device to execute display control based on a plurality of inspection images captured by irradiating an inspection object with radiation from a plurality of different imaging directions and structural information representing a three-dimensional structure of the inspection object, the display control program comprising: The display control is performed based on association information in which a viewpoint direction when performing the display control based on the structural information is associated with the photographing direction of each of the plurality of inspection images. Display control program.