Display control device, display control method, and display control program
By generating and displaying composite images from the same set of individual images, the problem of low efficiency in image inspection of large devices is resolved, enabling a quick and comprehensive understanding of the overall structure and damage information of the object.
Patent Information
- Application Number
- CN202380094172.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-02-28
- Filing Date
- 2023-11-13
- Publication Date
- 2025-09-26
AI Technical Summary
When taking multiple images of a large device during image inspection, users need to confirm each segmented image one by one, which reduces efficiency and prevents a comprehensive understanding of the object's overall structure.
Through the display control device and method, a composite image of the same individual image group is generated, and the processor is used to perform image selection, synthesis and display control. Combined with attribute information and damage detection, a composite image capable of identifying damage is generated.
The efficiency of image confirmation is improved, allowing users to more quickly understand the overall structure and damage information of the object, reducing the trouble of multiple comparisons.
Smart Images

Figure CN120712470A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a display control device, a display control method and a display control program. Background Art
[0002] Japanese Patent Application Laid-Open No. 2010-203808 discloses a non-destructive inspection system that combines partial images of an inspection object captured by a radiation detector to create a composite image of the entire inspection object. This non-destructive inspection system creates a composite image of the entire inspection object by overlapping adjacent partial images of the inspection object without overlapping areas. This process of combining multiple images to create a single large image is known as mosaicking. Summary of the Invention
[0003] Technical issues to be solved by the invention
[0004] In the manufacturing process of industrial products, inspection using images of objects (hereinafter referred to as "image inspection") is sometimes performed. For example, non-destructive inspection using radiographic images is performed to determine whether a product has internal defects.
[0005] During image inspection, when inspecting large devices, for example, the object may be split into multiple images, capturing an object that cannot fit in a single image. In these cases, each of these images captures a different part of the object. In this case, the user can only partially identify the object using a single image. This results in the inconvenience of accessing each of the multiple images one by one to verify the object.
[0006] In addition, in this case, the user cannot obtain information about the surrounding areas such as the surrounding parts of the part or the structure of the entire object based on only a part of the object projected on an image. Therefore, in order to confirm the entire object, it is necessary to compare multiple images for comprehensive judgment, which reduces the efficiency of the user in confirming the image.
[0007] The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a display control device, a display control method, and a display control program that can suppress a decrease in efficiency when a user confirms an image.
[0008] Means for solving technical problems
[0009] A first aspect provides a display control device, wherein the device comprises at least one processor, which receives a selection of at least one image from a plurality of images stored in a storage device, and, when a same individual image group including the at least one selected image exists in the storage device, controls the display of a composite image based on the same individual image group, wherein the same individual image group is obtained by photographing a plurality of non-overlapping parts of at least one portion of the same individual.
[0010] According to a second aspect of the display control device, in addition to the display control device of the first aspect, the processor performs control to display both the selected at least one image and the synthesized image.
[0011] According to the display control device of the third aspect, in addition to the display control device of the first aspect or the second aspect, the composite image is an image in which the same individual image group is arranged based on the relative positional relationship of parts of the same individual captured in each image of the same individual image group.
[0012] According to the display control device of the fourth aspect, on the basis of the display control device of any one of the first aspect to the third aspect, the same individual is the object of non-destructive inspection, the processor obtains the results of damage detection processing performed on each image of the same individual image group, and when controlling the display of a composite image, controls the results of damage detection processing of each image of the same individual image group constituting the composite image in a manner that can be distinguished.
[0013] According to the display control device of the fifth aspect, based on the display control device of the fourth aspect, the processor performs the following control: information indicating whether there is a defect and at least one of the number, density and severity of damage are displayed in a discernible manner as a result of damage detection processing.
[0014] According to the display control device of the sixth aspect, on the basis of the display control device of any one of the first aspect to the fifth aspect, the same individual image group includes images obtained by repeatedly shooting a part of an area of adjacent parts, and the processor extracts the characteristics of the shape of the part from each image of the same individual image group, and generates a composite image by performing image processing to overlap the characteristic shapes of two images obtained by shooting adjacent parts, that is, two images whose feature similarity is greater than a fixed value.
[0015] According to the display control device of the seventh aspect, on the basis of the display control device of any one of the first to sixth aspects, the same individual is an object of non-destructive inspection, the same individual image group includes images obtained by repeatedly shooting a part of an area of adjacent parts, the processor obtains the results of damage detection processing performed on each image of the same individual image group, and generates a composite image by performing image processing on the damage of two images obtained by shooting adjacent parts, that is, two images of the same damage, which overlap.
[0016] According to the display control device of the eighth aspect, based on the display control device of the fourth aspect or the seventh aspect, the processor performs damage detection processing on each image of the same individual image group.
[0017] According to the display control device of the ninth aspect, on the basis of the display control device of any one of the first to eighth aspects, each image of the same individual image group is an image obtained by photographing a marker in a state where the marker is photographed, and the processor generates a composite image by performing image processing to overlap the markers of two images obtained by photographing adjacent parts.
[0018] According to the tenth aspect, in addition to the display control device of any one of the first to ninth aspects, a link for individually accessing each image of the same individual image group constituting the composite image is set.
[0019] According to the display control device of aspect eleven, on the basis of the display control device of any one of aspects one to ten, each image of the same individual image group is assigned attribute information, and the processor determines whether the same individual image group including at least one selected image exists in the storage device based on the attribute information.
[0020] According to the display control device of aspect 12, based on the display control device of any one of aspects 1 to eleven, when the process of generating a composite image by synthesizing the same individual image group fails, the processor controls the display of information indicating that the process of generating a composite image has failed, and accepts the user's correction of the composite image or the re-synthesis instruction issued by the user.
[0021] According to the display control device of the thirteenth aspect, based on the display control device of any one of the first to twelfth aspects, the processor performs at least one of grayscale correction processing, distortion correction processing and enlargement and reduction processing on at least one image constituting the composite image.
[0022] According to the fourteenth aspect, a display control method is provided, wherein a processor possessed by a display control device performs the following processing: accepting a selection of at least one image from a plurality of images stored in a storage device, and when the same individual image group including the selected at least one image exists in the storage device, controlling the display of a composite image based on the same individual image group, wherein the same individual image group is obtained by photographing a plurality of non-overlapping parts of at least a portion of the same individual.
[0023] The fifteenth aspect provides a display control program, which enables a processor of a display control device to perform the following processing: accepting a selection of at least one image from a plurality of images stored in a storage device, and when the same individual image group including the selected at least one image exists in the storage device, controlling the display of a composite image based on the same individual image group, wherein the same individual image group is obtained by photographing multiple non-overlapping parts of at least a portion of the same individual.
[0024] Effects of the Invention
[0025] According to the present invention, it is possible to suppress a decrease in efficiency when a user confirms an image. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] Figure 1 This is a block diagram showing a schematic configuration of a radiation imaging device.
[0027] Figure 2 This is a block diagram showing an example of the hardware configuration of a display control device.
[0028] Figure 3 A diagram for explaining attribute information.
[0029] Figure 4 This is a diagram for explaining the learned model.
[0030] Figure 5 This is a block diagram showing an example of the functional configuration of a display control device.
[0031] Figure 6 This is a diagram for explaining image synthesis processing.
[0032] Figure 7 It is a diagram for explaining image synthesis processing according to a modification example.
[0033] Figure 8 It is a diagram for explaining image synthesis processing according to a modification example.
[0034] Figure 9 It is a diagram showing an example of a display screen.
[0035] Figure 10 This is a diagram showing an example of a synthesized image.
[0036] Figure 11 This is a diagram showing an example of a synthesized image.
[0037] Figure 12 It is a diagram showing an example of a display screen according to a modification.
[0038] Figure 13 This is a flowchart showing an example of display control processing.
[0039] Figure 14 This is a diagram for explaining image synthesis processing using markers.
[0040] Figure 15 This is a diagram showing an example of notation of a modified example. DETAILED DESCRIPTION
[0041] Hereinafter, examples of modes for implementing the technology of the present invention will be described in detail with reference to the drawings.
[0042] First, refer to Figure 1 The structure of the radiation imaging device 1 of this embodiment will be described. The radiation imaging device 1 is used for non-destructive inspection of an inspection object. Figure 1 As shown, the radiographic imaging apparatus 1 includes a display control device 10, a radiation source 12, and a radiation detector 14. The display control device 10, the radiation source 12, and the radiation detector 14 are connected so as to be able to communicate with each other. Examples of the display control device 10 include a personal computer and a server computer.
[0043] The radiation source 12 irradiates radiation R such as X-rays, for example, to the non-destructive inspection object 0. The radiation source 12 of the present embodiment irradiates the radiation R in a cone beam shape.
[0044] The radiation detector 14 includes a scintillator, which is an example of a light-emitting layer that emits light due to being irradiated with radiation R, and a TFT (Thin Film Transistor) substrate. The scintillator and the TFT substrate are stacked. The TFT substrate has a plurality of pixels arranged in a two-dimensional shape, and each pixel has a sensor portion, which is an example of a conversion element that increases the charge generated as the amount of irradiated radiation increases, and an electric field effect thin film transistor. The sensor portion absorbs the light emitted by the scintillator to generate charge and accumulates the generated charge. The electric field effect thin film transistor converts the charge accumulated in the sensor portion into an electrical signal and outputs it. According to the above structure, the radiation detector 14 generates a two-dimensional radiation image corresponding to the radiation R irradiated from the radiation source 12 to the object 0, and outputs the generated radiation image to the display control device 10.
[0045] Thus, in the radiation imaging apparatus 1, a radiation image captured by irradiating the object 0 with radiation R from the radiation source 12 is stored in the display control device 10. Hereinafter, a radiation image captured by irradiating the object 0 with radiation R is referred to as an "inspection image."
[0046] Next, refer to Figure 2 The hardware structure of the display control device 10 of this embodiment is described below. Figure 2 As shown, the display control device 10 includes a CPU (Central Processing Unit) 20, a memory 21 serving as a temporary storage area, and a nonvolatile storage device 22. Furthermore, the display control device 10 includes a display 23 such as a liquid crystal display, an input device 24 such as a keyboard and a mouse, and a network interface 25 connected to a network. Furthermore, the display control device 10 includes an external interface 26 connected to the radiation source 12 and the radiation detector 14. The CPU 20, memory 21, storage device 22, display 23, input device 24, network interface 25, and external interface 26 are connected to a bus 27. The CPU 20 is an example of a processor related to the technology of the present invention.
[0047] The storage device 22 is implemented by an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like. The storage device 22, serving as a storage medium, stores a display control program 30. The CPU 20 reads the display control program 30 from the storage device 22, expands it in the memory 21, and executes the expanded display control program 30.
[0048] In addition, the storage device 22 stores a plurality of inspection images 32, a plurality of attribute information 34, and a learned model 36. The plurality of inspection images 32 include an inspection image 32 showing the entire object 0 in a single image, for example, when the object 0 is a relatively small device. Figure 1 In the example of , since the object 0 is smaller than the radiation detector 14 , the entire object 0 is reflected in one inspection image 32 .
[0049] In addition, the multiple inspection images 32 also include inspection image groups 32, which are obtained by photographing the object 0 that cannot be accommodated in one image in multiple times when the object O is a large device, etc. In this case, the inspection image group 32 is an image group obtained by photographing multiple parts of the same individual that are at least partially non-repeated (hereinafter referred to as the "same individual image group"). The same individual mentioned here means, for example, that the object 0 is the same product and the manufacturing number is also the same. That is, in this embodiment, even if the object 0 is the same product, if the manufacturing numbers are different, they are regarded as different individuals. In addition, in this embodiment, each image of the same individual image group is an image obtained by repeatedly photographing a part of the adjacent parts.
[0050] like Figure 3 As shown, each inspection image 32 is assigned attribute information 34, which is metadata containing a variety of information related to the inspection image 32. The attribute information 34 can be attached as an external data file to the inspection image 32, or it can be integrated with the inspection image 32 as an attribute of the inspection image 32. The attribute information 34 includes, as attribute items, the date and time of imaging, product ID (identification), manufacturing number, and imaging sequence.
[0051] The photographing date and time is information indicating the date and time when the inspection image 32 was captured. The product ID is information used to identify the product. The manufacturing number is information used to identify individual products. In other words, the combination of the product ID and the manufacturing number can be used to determine whether the product belongs to the same individual. The photographing order is information indicating the order in which the inspection images 32 within a group of images of the same individual were captured. In this embodiment, adjacent parts are photographed in a continuous order.
[0052] like Figure 4 As shown, the learned model 36 is a learned model that takes the inspection image 32 as input and takes the information related to the damage of the object 0 in the input inspection image 32 as output. The learned model 36 is obtained in advance by machine learning using multiple sets of inspection images 32 and the information related to the damage of the object 0 in the inspection image 32 as supervisory data. Examples of information related to damage include the position of the damage in the inspection image 32, the size of the damage, and the shape of the damage. In the present embodiment, the position of the damage in the inspection image 32 is represented by the coordinates of an orthogonal coordinate system, which has a specific point (for example, the point in the upper left corner) of the two-dimensional inspection image as the origin and is composed of two axes, the X-axis and the Y-axis. In addition, "damage" in this specification is defined as a term for non-destructive inspection, and means discontinuous parts such as bubbles, foreign matter, and cracks.
[0053] Next, refer to Figure 5The functional structure of the display control device 10 of this embodiment will be described. Figure 5 As shown, the display control device 10 includes a receiving unit 40, a determination unit 42, a detection unit 44, a synthesis unit 46, and a display control unit 48. The CPU 20 executes the display control program 30 to function as the receiving unit 40, the determination unit 42, the detection unit 44, the synthesis unit 46, and the display control unit 48.
[0054] The user selects one inspection image 32 from the plurality of inspection images 32 stored in the storage device 22. For example, the user selects one inspection image 32 using file management software such as a file manager. The receiving unit 40 receives the user's selection of one inspection image 32.
[0055] The determination unit 42 determines whether the same individual image group including the selected inspection image 32 exists in the storage device 22 based on the attribute information 34. Specifically, the determination unit 42 determines whether the same individual image group exists in the storage device 22 by determining whether there are two or more inspection images 32 in the storage device 22 that have the same combination of product ID and manufacturing number as the selected inspection image 32.
[0056] Furthermore, the determination unit 42 may further use the imaging date and time when determining whether the same individual image group exists in the storage device 22. In this case, the determination unit 42 determines whether there are two or more inspection images 32 in the storage device 22 that have the same product ID and manufacturing number group as the selected inspection image 32 and whose imaging date and time differ by a predetermined time (e.g., within 30 minutes). The predetermined time in this case is pre-set based on the time required to capture the inspection image 32.
[0057] If the determination unit 42 determines that the same individual image group including the selected inspection image 32 does not exist in the storage device 22, the detection unit 44 inputs the inspection image 32 into the learned model 36. The learned model 36 outputs information related to damage on the object O in the input inspection image 32 as the result of the damage detection process. In this way, the detection unit 44 performs damage detection processing on the inspection image 32.
[0058] Furthermore, when the determination unit 42 determines that the same individual image group including the selected inspection image 32 exists in the storage device 22, the detection unit 44 inputs each image of the same individual image group into the learned model 36. Information related to damage to the object O in each input inspection image 32 is output from the learned model 36 as a result of damage detection processing. Thus, the detection unit 44 performs damage detection processing on each image of the same individual image group.
[0059] Alternatively, the detection unit 44 may detect damage to the object O in the inspection image 32 using a known detection algorithm. Alternatively, the damage to the object O in the inspection image 32 may be specified by the user via the input device 24. In this case, the detection unit 44 detects the damage specified by the user. Furthermore, the damage detection process may be performed by a device separate from the display control device 10. In this case, the detection unit 44 obtains the damage detection results from the separate device.
[0060] When the determination unit 42 determines that the same individual image group including the selected inspection image 32 exists in the storage device 22 , the synthesis unit 46 generates one image (hereinafter referred to as a “synthesized image”) by synthesizing the images of the same individual image group.
[0061] Specifically, the synthesis unit 46 extracts the shape features of the parts reflected in the images from each image in the same individual image group. A well-known shape detection algorithm can be applied to this extraction process.
[0062] Moreover, as an example, Figure 6 As shown, the synthesis unit 46 generates a synthesized image by performing image processing to overlap the characteristic shapes of two inspection images 32 obtained by photographing adjacent parts, that is, the two inspection images 32 whose similarity of extracted features is greater than a fixed value. Figure 6 In the example of , the portion surrounded by the dotted circle represents a shape portion where the similarity of the feature is greater than or equal to a fixed value. In the generation process of this composite image, parallel translation and rotation of the inspection image 32 are performed.
[0063] As described above, since adjacent parts are imaged in a continuous sequence, the synthesis unit 46 can identify two inspection images 32 obtained by imaging adjacent parts by referring to the imaging order items in the attribute information 34. Furthermore, when the same individual image group includes three or more inspection images 32, the synthesis unit 46 repeatedly performs the above synthesis of the two inspection images, while changing the two groups, to generate a single synthesized image. In other words, the synthesized image is an image in which the same individual image group is arranged based on the relative positional relationships of the parts of the same individual that appear in each image of the same individual image group.
[0064] In addition, if Figure 7 As shown in FIG. 1 , when the object 0 is an object having a shape such as a repeated shape, it is sometimes difficult to synthesize the two inspection images 32 in the above-mentioned processing. Therefore, as an example, Figure 8 As shown, the synthesis unit 46 may generate a synthesized image by performing image processing to overlap two images obtained by imaging adjacent parts, that is, two images showing the same lesion detected by the detection unit 44 .
[0065] When the determination unit 42 determines that the same individual image group including the selected inspection image 32 exists in the storage device 22, the display control unit 48 controls the display 23 to display the synthesized image generated by the synthesizing unit 46. Figure 9 As shown in FIG. 1 , in this embodiment, the display control unit 48 performs control to display both the selected inspection image 32 and the synthesized image generated by the synthesizing unit 46 on the display 23. Figure 9 In the example shown, "Image #2" is selected. In addition, the display control unit 48 may be configured to distinguish the selected inspection image 32 in the composite image by highlighting a frame line corresponding to the selected inspection image 32 in the composite image.
[0066] In addition, if Figure 10 As shown in FIG. 1 , the composite image may be a composite image of a plurality of inspection images 32 obtained by photographing the side surface of a cylindrical tube. Figure 11 As shown in FIG, it may be an image synthesized by a plurality of inspection images 32 obtained by imaging the object 0 while rotating it in the direction of the detection surface of the radiation detector 14 while keeping the center fixed. Figure 11 , an example of a composite image is shown in which four inspection images 32 obtained by imaging four times while rotating the object O by 90 degrees each are composited.
[0067] In addition, if Figure 12 As shown, when the display control unit 48 controls the display of the composite image, it may also control the display of the results of the damage detection processing of each image of the same individual image group constituting the composite image in a discriminable manner. Figure 12 In the example shown, the display control unit 48 displays "OK" or "NG", which is an example of information indicating whether there is a defect, as the result of the damage detection process. Whether the damage is a defect is determined by, for example, whether the size of the damage is greater than a threshold value.
[0068] In addition, the display control unit 48 may also control the display of at least one of the number of lesions, the density of lesions, and the severity of lesions as the result of the lesion detection process. The density of lesions is calculated, for example, based on the ratio of the area of the lesions to the area of the part shown in the inspection image 32. In addition, the severity of lesions is set to, for example, increase in value as the size of the lesions increases. In this case, the display control unit 48 may also control the display of the number of lesions, the density of lesions, and the severity of lesions in a discriminable manner, such as by increasing the color of the image frame or the color of the text "NG" as the number of lesions, the density of lesions, and the severity of lesions increases.
[0069] Next, refer to Figure 13 The function of the display control device 10 of this embodiment will be described. The CPU 20 executes the display control program 30, Figure 13 Display control processing shown. Figure 13 The display control process shown is executed when, for example, one inspection image 32 is selected by the user.
[0070] exist Figure 13 In step S10 of the present invention, the accepting unit 40 accepts the user's selection of a single inspection image 32. In step S12, as described above, the determining unit 42 determines, based on the attribute information 34, whether the same individual image group including the single inspection image 32 selected in step S10 exists in the storage device 22. If this determination is affirmative, the process proceeds to step S14.
[0071] In step S14, as described above, the detector 44 performs damage detection processing on each image in the same individual image group including the one inspection image 32 selected in step S10. In step S16, as described above, the synthesizer 46 generates a synthesized image by synthesizing each image in the same individual image group.
[0072] In step S18, the display control unit 48 controls the display 23 to display both the single inspection image 32 selected in step S10 and the composite image generated in step S16. When the process of step S18 is completed, the display control process ends.
[0073] On the other hand, if the determination in step S12 is negative, the process proceeds to step S20. In step S20, as described above, the detection unit 44 performs damage detection processing on the single inspection image 32 selected in step S10. In step S22, the display control unit 48 controls the display 23 to display the single inspection image 32 selected in step S10. When the process in step S22 is completed, the display control process ends.
[0074] As described above, according to this embodiment, control is performed to display a composite image when a user selects a single inspection image 32 and the same individual image group including the inspection image 32 exists in the storage device 22. Therefore, the user can check the image while understanding information about the surrounding area of the single inspection image 32, thereby reducing the efficiency of the user's image checking.
[0075] Furthermore, in the above embodiment, a case where the user selects one inspection image 32 from a plurality of inspection images 32 stored in the storage device 22 is described. However, the inventive technique is not limited to this embodiment. For example, a method may be employed in which the user selects two or more inspection images 32 from a plurality of inspection images 32 stored in the storage device 22. In this case, the display control process described in the above embodiment is performed on each selected inspection image 32.
[0076] Furthermore, in the above embodiment, the composite image is described as a single image generated by combining images from the same individual image group. However, the inventive technology is not limited to this embodiment. For example, the composite image may be a plurality of inspection images 32 from the same individual image group arranged based on the relative positional relationships of parts of the same individual that appear in the images from the same individual image group. In this case, the images from the same individual image group may be images obtained by imaging adjacent parts of the same part without duplication.
[0077] In addition, in the above embodiment, the synthesis unit 46 generates a synthesized image by performing image processing to overlap the characteristic shapes of two inspection images 32 obtained by photographing adjacent parts, that is, two inspection images 32 whose similarity of extracted features is greater than a fixed value, but the technology of the invention is not limited to this method. For example, Figure 14 As shown, when each inspection image 32 of the same individual image group is an image obtained by photographing a state in which a mark M is reflected, the synthesis unit 46 may generate a synthesized image by performing image processing to overlap the marks M of two inspection images 32 obtained by photographing adjacent parts. Figure 14 , the mark M is an example of a number indicating the order of imaging. In this embodiment, the mark M is formed of a material that does not transmit radiation R, such as lead.
[0078] In addition, the mark M is not limited to numbers, but can also be text. Figure 15As shown, the mark M may be a mark such as an arrow indicating the range left in the synthesized image. Furthermore, the mark M need not be a mark dedicated to the synthesis process. Non-destructive inspection standards (e.g., JIS Z 2036:2015) stipulate that images should be captured with a penetrometer (IQI: Image Quality Indicator) reflected in the image. Furthermore, the shape of the penetrometer is determined by the standard. Therefore, the synthesis unit 46 may use a penetrometer as the mark M.
[0079] Furthermore, in the above-described embodiment, the synthesizing unit 46 may set a link for individually accessing each image in the same group of individual images constituting the synthesized image. In this case, the display control unit 48 controls the display 23 so that, when the user designates each image constituting the synthesized image to be displayed on the display 23, the image is displayed.
[0080] Furthermore, in the above-described embodiment, the display control unit 48 may also control the display 23 to display a message indicating the failure of the composite image generation process when the process of synthesizing the same set of individual images fails. In this case, the receiving unit 40 may also accept user corrections to the composite image or user-initiated resynthesis instructions. User corrections in this case may include, for example, modifying the positions of the images comprising the composite image. Furthermore, when issuing a resynthesis instruction, the user may rotate a portion of the image, change the magnification, add an image to the composite image, or remove a portion of the image from the composite image.
[0081] Furthermore, in the above embodiment, the CPU 20 may perform at least one of grayscale correction, distortion correction, and scaling on at least one of the images constituting the composite image. For example, if the magnification ratios of the images constituting the composite image differ, the CPU 20 may perform scaling to unify the magnification ratios.
[0082] Furthermore, in the above-described embodiment, for example, various processors described below may be used as the hardware configuration of a processing unit that executes various processes, such as the various functional units of the display control device 10. These various processors include, in addition to general-purpose processors (CPUs) that execute software (programs) to function as various processing units, as described above, processors whose circuit configuration can be modified after manufacture, such as FPGAs (Field Programmable Gate Arrays), programmable logic devices (PLDs), and application-specific integrated circuits (ASICs), processors with circuit configurations specifically designed to execute specific processes, such as dedicated circuits.
[0083] A processing unit may be composed of one of these various processors, or a combination of two or more processors of the same or different types (e.g., a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, multiple processing units may be composed of one processor.
[0084] As examples of multiple processing units composed of a single processor, there is a first approach, typified by computers such as clients and servers, where a single processor is composed of a combination of one or more CPUs and software, with this processor functioning as multiple processing units. A second approach, typified by systems on chips (SoCs), uses a processor that implements the overall functionality of a system including multiple processing units on a single IC (Integrated Circuit) chip. In this way, various processing units are constructed using one or more of the aforementioned processors as a hardware structure.
[0085] Furthermore, as the hardware structure of these various processors, more specifically, a circuit (circuitry) formed by combining circuit elements such as semiconductor elements can be used.
[0086] In the above embodiment, the display control program 30 is pre-stored (installed) in the storage device 22, but the present invention is not limited thereto. The display control program 30 may also be provided by recording it on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), or a USB (Universal Serial Bus) memory device. Furthermore, the display control program 30 may be downloaded from an external device via a network.
[0087] The disclosure of Japanese Patent Application No. 2023-030565, filed on February 28, 2023, is incorporated herein by reference in its entirety. Furthermore, all documents, patent applications, and technical specifications described in this specification are incorporated herein by reference to the same extent as if each individual document, patent application, or technical specification were specifically and individually indicated to be incorporated by reference.
Claims
1. A display control device comprising at least one processor, wherein: The processor accepting a selection of at least one image from a plurality of images stored in a storage device, When the same individual image group including the selected at least one image exists in the storage device, control is performed to display a composite image based on the same individual image group, wherein the same individual image group is obtained by photographing multiple parts of the same individual that do not overlap in at least part.
2. The display control device according to claim 1, wherein: The processor Control is performed to display both the selected at least one image and the synthesized image.
3. The display control device according to claim 1 or 2, wherein: The composite image is an image in which the same individual image group is arranged based on the relative positional relationship between parts of the same individual captured in the respective images of the same individual image group.
4. The display control device according to claim 1 or 2, wherein: The same individual is the object of non-destructive inspection, The processor obtaining the results of damage detection processing performed on each image of the same individual image group, When performing control for displaying the composite image, control is performed to display the results of the damage detection processing of each image of the same individual image group constituting the composite image in a discriminable manner.
5. The display control device according to claim 4, wherein: The processor performs the following control: Information indicating whether a defect exists and at least one of the number, density, and severity of damage are displayed in a discriminable manner as a result of the damage detection process.
6. The display control device according to claim 1 or 2, wherein: The same individual image group includes images obtained by repeatedly photographing a portion of adjacent areas. The processor extracting features of the shape of the part from each image of the same individual image group, The composite image is generated by performing image processing to overlap shapes having the feature in two images obtained by imaging adjacent areas, that is, two images having a similarity of the feature of at least a predetermined value.
7. The display control device according to claim 1 or 2, wherein: The same individual is the object of non-destructive inspection, The same individual image group includes images obtained by repeatedly photographing a portion of adjacent areas. The processor obtaining the results of damage detection processing performed on each image of the same individual image group, The composite image is generated by performing image processing to overlap two images obtained by imaging adjacent parts, that is, two images of the same lesion.
8. The display control device according to claim 4, wherein: The processor Damage detection processing is performed on each image in the same individual image group.
9. The display control device according to claim 1 or 2, wherein: Each image in the same individual image group is an image captured with the marker captured. The processor The composite image is generated by performing image processing to overlap the markers of two images obtained by imaging adjacent parts.
10. The display control device according to claim 1 or 2, wherein: A link for individually accessing each image of the same individual image group constituting the composite image is set.
11. The display control device according to claim 1 or 2, wherein: Each image in the same individual image group is assigned attribute information. The processor Based on the attribute information, it is determined whether the same individual image group including the selected at least one image exists in the storage device.
12. The display control device according to claim 1 or 2, wherein: The processor When the process of generating the composite image by synthesizing the same individual image group fails, control is performed to display a message indicating that the process of generating the composite image has failed. Accepting the user's correction of the synthesized image or the re-synthesis instruction issued by the user.
13. The display control device according to claim 1 or 2, wherein: The processor At least one of grayscale correction processing, distortion correction processing, and enlargement and reduction processing is performed on at least one image constituting the composite image.
14. A display control method, wherein: The processor included in the display control device performs the following processing: accepting a selection of at least one image from a plurality of images stored in a storage device, When the same individual image group including the selected at least one image exists in the storage device, control is performed to display a composite image based on the same individual image group, wherein the same individual image group is obtained by photographing multiple parts of the same individual that do not overlap in at least part.
15. A display control program, wherein: It is used to enable the processor of the display control device to perform the following processing: accepting a selection of at least one image from a plurality of images stored in a storage device, When the same individual image group including the selected at least one image exists in the storage device, control is performed to display a composite image based on the same individual image group, wherein the same individual image group is obtained by photographing multiple parts of the same individual that do not overlap in at least part.
Citation Information
Patent Citations
Non-destructive inspection method and non-destructive inspection system
JP2010203808A
Semiconductor device
JP2023030565A