Information processing device, information processing method, program, information display device, and information display method
By using a processor in the information processing device, selecting and accessing matching images based on the attribute information of the image, the complexity and access difficulty of image inspection result management in the industrial product manufacturing process are solved, and convenient access to the desired image is achieved.
Patent Information
- Application Number
- CN202380060845.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-09-12
- Filing Date
- 2023-08-04
- Publication Date
- 2025-04-04
AI Technical Summary
In the manufacturing process of industrial products, image inspection requires multiple implementations of each component and product, resulting in a huge number of inspection images acquired and accessing these images becomes difficult.
By using the processor in the information processing device, those images that match the specified attribute information are selected and accessed. These attribute information may include the image acquisition inspection process, individual information of the component or product, photography direction and date, etc. Based on these attribute information, the processor selects the appropriate image and prompts the accessing mechanism to enable the user to easily access the required image.
Easily accessed to the desired image is achieved, reducing image management complexity and access difficulty in case of multiple image checks.
Smart Images

Figure CN119768787A_ABST
Abstract
Description
Technical Field
[0001] The disclosed technology relates to an information processing device, an information processing method, a program, an information display device, and an information display method. Background Art
[0002] As a technology related to the management system of image data, the following technology is known. For example, in the Japanese Patent Gazette No. 2021-26330, there is described an inspection result management server, which has: a management mechanism, which manages the specified identification information that can be provided by the information provider and the past image data of the structure bound to the information provider in association; a receiving mechanism, which receives the identification information sent by the communication terminal that obtains the identification information from the information provider via the communication network; and a creation mechanism, which creates a screen that displays the past image data of the structure corresponding to the identification information received by the receiving mechanism on the communication terminal via the communication network.
[0003] Japanese Patent Gazette No. 7-113762 describes an inspection and measuring device comprising: a photographing mechanism that photographs an object to be inspected; a recording mechanism that records an inspection image obtained by the photographing mechanism and inspection information related to the inspection image; a display mechanism that displays the inspection image recorded in the recording mechanism; and an inspection image retrieval mechanism that retrieves an inspection image corresponding to the inspection information by specifying a part of the inspection information recorded in the recording mechanism and displays it on the display mechanism.
[0004] Japanese Patent Gazette No. 2002-269109 describes a thin film device manufacturing process management system comprising: a database that stores the product name of the thin film device, the manufacturing process name, the wafer number, the foreign matter / defect distribution detected by the inspection device, keywords representing the characteristics of the foreign matter / defect distribution, the foreign matter / defect image captured based on the inspection data, keywords representing the characteristics of the foreign matter / defect image, and the content of foreign matter / defect countermeasures in a related manner; a mechanism that accepts the input of keywords of the foreign matter / defect distribution and the foreign matter / defect image by the operator, and the input of a search logic based on multiple keywords; a mechanism that searches the contents of the database according to the input search conditions and searches whether there are any past cases that match the conditions; and a mechanism that displays the search results. Summary of the invention
[0005] Technical issues to be solved by the invention
[0006] In the manufacturing process of industrial products, sometimes an inspection using an image obtained by photographing an object (hereinafter referred to as image inspection) is performed. For example, a non-destructive inspection is performed to determine the presence or absence of internal defects of a product using a radiographic image. Image inspection is performed multiple times until the product is completed. Sometimes different parts of an individual are photographed, or the photographing direction is changed for photographing. In addition, when a product is composed of multiple components, image inspection is performed on each of the multiple components, and in addition, image inspection is performed on the state of a finished product composed of multiple components. In this way, when image inspection is performed multiple times on each component and each product, the number of images (hereinafter referred to as inspection images) obtained in each inspection process becomes huge, and access to the desired inspection image becomes difficult. For example, in the case where you want to compare inspection images of different parts of the same individual photographed in a certain inspection process and in the case where you want to compare inspection images obtained in each of multiple inspection processes implemented on the same individual, it is desired to be able to easily access the inspection image of the object.
[0007] The disclosed technology has been accomplished in view of the above-mentioned points, and aims to facilitate access to desired images.
[0008] Means for solving technical problems
[0009] The information processing device according to the disclosed technology includes at least one processor, which selects an image assigned with the same attribute information as designated attribute information from among a plurality of images assigned with attribute information as an access target image, and prompts an access mechanism for accessing the access target image.
[0010] The processor may also receive attribute information assigned to the image being displayed on the display as designated attribute information. The processor may also receive designated input of the attribute information as designated attribute information.
[0011] The plurality of images may also be inspection images acquired in an inspection process performed on an object contained in the image. The attribute information may also include information identifying the inspection process in which the image was acquired. The attribute information may also include information identifying an individual component or product of the object, information identifying an individual product manufactured using the component of the object, information identifying each individual of the plurality of components constituting the product of the object, information identifying a manufacturing batch of the component or product of the object, information identifying a part of the object, information identifying a shooting direction of the image, and at least one of the shooting date of the image.
[0012] The processor may also select, based on the attribute information, a plurality of inspection images including different parts acquired from the same individual in the same inspection process as the access object images. The processor may also arrange and present a plurality of access mechanisms corresponding to the plurality of access object images in the order corresponding to the parts of the object contained in the access object images.
[0013] The processor may select, based on the attribute information, a plurality of inspection images acquired for the same individual in the same inspection process and having different imaging directions as the access target images. The processor may also prompt an access mechanism for accessing the plurality of access target images in an order corresponding to the imaging directions.
[0014] The processor may also select, based on the attribute information, a plurality of inspection images acquired on the same individual in each of a plurality of inspection processes performed at different timings as the access target images. The processor may also select, based on the attribute information, a plurality of inspection images acquired on the same individual in inspection processes performed before and after a specific process as the access target images.
[0015] The processor may also select, based on the attribute information, the inspection image acquired for the individual of the first component specified by the specified attribute information, the inspection image acquired for the individual of the second component used in combination with the individual of the first component, and the inspection image acquired for the individual of the product manufactured using the first component and the second component as the access object image. The processor may also select, based on the attribute information, the inspection image acquired for the individual of the product specified by the specified attribute information and the inspection image acquired for each individual of the multiple components constituting the individual of the product as the access object image. The processor may also classify and prompt multiple access agencies corresponding to the multiple access object images for each component and each inspection process. The processor may also arrange and prompt multiple access agencies corresponding to the multiple access object images in the chronological order of the inspection process.
[0016] The processor may select the access target image based on the priority set for the attribute information. The processor may make the presentation method of the plurality of access institutions corresponding to the plurality of access target images different according to the priority set for the attribute information.
[0017] The information processing method involved in the disclosed technology is a method as follows: among multiple images each of which is assigned attribute information, an image assigned attribute information identical to designated attribute information, i.e., designated attribute information, is selected as an access target image, and an access mechanism for accessing the access target image is prompted.
[0018] The program involved in the disclosed technology is a program for causing at least one processor of an information processing device to perform the following processing: selecting an image that is assigned attribute information identical to specified attribute information, i.e., specified attribute information, from a plurality of images that are respectively assigned attribute information as an access object image; and prompting an access mechanism for accessing the access object image.
[0019] The information display device according to the disclosed technology is a device that displays, on a display, an access mechanism for accessing an image to which attribute information identical to designated attribute information, ie, designated attribute information, is assigned, among a plurality of images to which attribute information is assigned.
[0020] The information processing method involved in the disclosed technology is a method of displaying on a display an access mechanism for accessing an image to which attribute information identical to designated attribute information, ie, designated attribute information, is assigned, among a plurality of images to which attribute information is assigned.
[0021] Effects of the Invention
[0022] According to the inventive technique, it is possible to easily access a desired image. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] Figure 1 This is a diagram showing an example of the configuration of an image management system according to an embodiment of the disclosed technology.
[0024] Figure 2 This is a diagram showing an example of the structure of a data file of an inspection image handled by the image management system according to the embodiment of the disclosed technology.
[0025] Figure 3 This is a diagram showing an example of the hardware configuration of an image browsing device according to an embodiment of the disclosed technology.
[0026] Figure 4 This is a functional block diagram showing an example of the functional configuration of an image browsing device according to an embodiment of the disclosed technology.
[0027] Figure 5 This is a diagram showing an example of a presentation method of an access mechanism according to an embodiment of the disclosed technology.
[0028] Figure 6 This is a flowchart showing an example of the flow of processing performed by executing the access support program according to the embodiment of the disclosed technology.
[0029] Fig. 7A This is a diagram showing an example of a method of photographing a radiographic image acquired in non-destructive inspection of a metal product.
[0030] Figure 7B This is a diagram showing an example of a presentation method of an access mechanism when receiving a first limited access request according to an embodiment of the disclosed technology.
[0031] Fig. 8A This is a diagram showing an example of a method of photographing a radiographic image acquired in non-destructive inspection of a metal product.
[0032] Figure 8B This is a diagram showing an example of a presentation method of an access mechanism when receiving a second limited access request according to an embodiment of the disclosed technology.
[0033] Figure 8C This is a diagram showing an example of a presentation method of an access mechanism when receiving a second limited access request according to an embodiment of the disclosed technology.
[0034] Fig. 9 This is a diagram showing an example of the inspection process flow performed on the same individual component or product.
[0035] Fig.10 This is a diagram showing an example of a manufacturing process flow including an inspection process performed on the same individual component or product.
[0036] Fig.11 This is a diagram showing an example of a presentation method of an access mechanism when receiving a fifth limited access request according to an embodiment of the disclosed technology.
[0037] Fig. 12A This is a diagram showing an example of a presentation method of an access mechanism according to an embodiment of the disclosed technology.
[0038] Fig. 12B This is a diagram showing an example of a presentation method of an access mechanism according to an embodiment of the disclosed technology. DETAILED DESCRIPTION
[0039] Hereinafter, an example of an embodiment of the disclosed technology will be described with reference to the drawings. In addition, in each of the drawings, the same reference numerals are given to the same or equivalent components and parts, and repeated descriptions are omitted.
[0040] [First embodiment]
[0041] Figure 11 is a diagram showing an example of the structure of an image management system 1 involved in an embodiment of the disclosed technology. The image management system 1 is composed of an image viewing device 10 and an image server 20. The image server 20 is a server computer having a storage medium for storing inspection images acquired in an inspection process of an industrial product. The inspection process may be, for example, a non-destructive inspection process for determining the presence or absence of defects inside a product using a radiographic image. That is, the inspection image may also be a radiographic image.
[0042] The image browsing device 10 is a computer having a function of browsing inspection images stored in the image server 20. The image browsing device 10 is connected to the image server 20 via the network 30 so as to be communicable. The image browsing device 10 can download the desired inspection image from the image server 20 and display it on the display 105. The image browsing device 10 can be, for example, a device in the form of a desktop, notebook or tablet computer, or a device in the form of a smart phone. The image browsing device 10 is an example of an "information processing device" in the disclosed technology. In addition, the image management system 1 composed of the image browsing device 10 and the image server 20 can also be interpreted as the "information processing device" in the disclosed technology.
[0043] Figure 24 is a diagram showing an example of the structure of a data file 40 of an inspection image processed by the image management system 1. The data file 40 of the inspection image is composed of attribute information 41 and image data 42. The image data 42 is pixel data of the inspection image. The attribute information 41 is metadata including a plurality of information related to the image data 42. The attribute information 41 includes, as attribute items, a photographing date and time, a component ID (identification), a product ID, an inspection process ID, a photographing part ID, a photographing direction ID, and a batch ID. The photographing date and time is information indicating the year, month, and day of photographing of the inspection image. The component ID is information for identifying the individual component as an object contained in the inspection image. The product ID is information for identifying the individual product as an object contained in the inspection image. The inspection process ID is information for identifying the inspection process in which the inspection image is acquired (photographed). The photographing part ID is information for identifying the part of the object contained in the inspection image. The photographing part ID may also be information for identifying the relative positional relationship of the object. The photographing direction ID is information for identifying the photographing direction of the inspection image. The imaging direction ID may be information for identifying the front, back, top, right, and left sides, or information for identifying an angle based on a predetermined direction. The batch ID is information for identifying a manufacturing batch of the object included in the inspection image. The inspection image data file 40 may have a format based on DICOM (Digital Imaging and Communications in Medicine), which is known as a format for medical image data.
[0044] Figure 3 1 is a diagram showing an example of the hardware configuration of the image browsing device 10. The image browsing device 10 includes a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a nonvolatile memory 103, an input device 104, a display 105, and a network interface 106. These hardware components are connected to a bus 107.
[0045] The display 105 is, for example, a liquid crystal display or an LED (Light Emitting Diode) display. The input device 104 includes, for example, a keyboard and a mouse, and may also include a proximity input device such as a touch panel display, and a voice input device such as a microphone. The network interface 106 is an interface for connecting the image browsing device 10 to a network.
[0046] The nonvolatile memory 103 is a nonvolatile storage medium such as a hard disk and a flash memory. An access support program 110 is stored in the nonvolatile memory 103. The RAM 102 is a working memory for the CPU 101 to execute processing. The CPU 101 downloads the access support program 110 stored in the nonvolatile memory 103 to the RAM 102, and executes processing according to the access support program 110. The CPU 101 is an example of a "processor" in the disclosed technology.
[0047] Figure 4 1 is a functional block diagram showing an example of the functional configuration of the image browsing device 10. The image browsing device 10 functions as a designated attribute information accepting unit 11, an access target image selecting unit 12, and an access mechanism presenting unit 13 by the CPU 101 executing the access support program 110.
[0048] The designated attribute information receiving unit 11 receives designated attribute information, which is attribute information designated in attribute information (photographing date and time, component ID, product ID, inspection process ID, photographing part ID, photographing direction ID, batch ID) assigned to the inspection image. In the present embodiment, the designated attribute information receiving unit 11 receives attribute information assigned to the inspection image displayed on the display 105 as designated attribute information. The designated attribute information receiving unit 11 may receive, as designated attribute information, only attribute information having a part of attribute items selected, for example, according to a preset priority order, from a plurality of attribute items constituting the attribute information assigned to the inspection image displayed on the display 105 (photographing date and time, component ID, product ID, inspection process ID, photographing part ID, photographing direction ID, batch ID).
[0049] The access target image selection unit 12 selects, as the access target image, an inspection image to which attribute information identical to the designated attribute information received by the designated attribute information receiving unit 11 is assigned from among the inspection images stored in the image server 20. That is, the access target image selection unit 12 selects, as the access target image, an inspection image to which attribute information identical to at least one of the plurality of attribute items (photographing date and time, component ID, product ID, inspection process ID, photographing part ID, photographing direction ID, batch ID) constituting the designated attribute information is assigned. The access target image selection unit 12 may select, as the access target image, an inspection image to which attribute information identical to a portion of the attribute items selected in accordance with a preset priority order from among the plurality of attribute items constituting the designated attribute information is assigned. For example, the access target image selection unit 12 may select the access target image by referring to an attribute information list that lists attribute information for all inspection images stored in the image server 20. The attribute information list is automatically generated by the image server 20. The attribute information list is updated every time a new inspection image is stored in the image server 20 and is sent to the image browsing device 10. Furthermore, the access target image selection unit 12 may delegate the process of selecting an access target image to the image server 20. In this case, the access target image selection unit 12 transmits designated attribute information to the image server 20, and receives a selection result from the image server 20.
[0050] The access mechanism prompting unit 13 prompts the access mechanism for accessing the access target image selected by the access target image selecting unit 12. The access mechanism may be, for example, a hyperlink for accessing the access target image. For example, the access mechanism prompting unit 13 may display a character string representing the file name or URL (Uniform Resource Locator) of the access target image, or a content in which a hyperlink is embedded in the thumbnail of the access target image, as the access mechanism on the display 105. The access mechanism prompting unit 13 may, for example, generate the access mechanism by referring to a URL list that lists URLs for all inspection images stored in the image server 20. The URL list is automatically generated by the image server 20. Whenever a new inspection image is stored in the image server 20, the URL list is updated and sent to the image browsing device 10. In addition, the access mechanism prompting unit 13 may also entrust the generation of the access mechanism to the image server 20.
[0051] Figure 5 FIG. 1 is a diagram showing an example of a method of prompting a visit to an organization. Figure 5In the example shown, the inspection image 50 (file name: AA000.dcm) displayed on the display 105 is an image downloaded by the user from the image server 20. The designated attribute information receiving unit 11 receives the attribute information assigned to the inspection image 50 displayed on the display 105 as designated attribute information. The access target image selecting unit 12 selects an inspection image assigned with the same attribute information as the designated attribute information assigned to the inspection image 50 displayed on the display 105 as the access target image. Figure 5 In the example, the case where the inspection images with the file names "AA001.dcm", "AB002.dcm", and "AB004.dcm" are selected as the access target images is shown. The access mechanism prompting unit 13 displays the hyperlinks 60 for accessing the selected access target images as the access mechanisms on the display 105. Figure 5 In the example shown, the hyperlink 60 is embedded in a character string representing the file name of each access target image. When the user clicks any hyperlink 60 using the mouse pointer 70, the corresponding access target image is downloaded from the image server 20 and displayed on the display 105.
[0052] Figure 6 The flowchart shows an example of the flow of processing performed by the CPU 101 executing the access support program 110. The access support program 110 is executed when the user operates the input device 104 to instruct to start processing, for example, while the inspection image that is the starting point for generating the access mechanism is displayed on the display 105.
[0053] In step S1 , the designated attribute information accepting unit 11 accepts attribute information given to the inspection image being displayed on the display 105 as designated attribute information.
[0054] In step S2, the access target image selection unit 12 selects, as the access target image, an inspection image to which attribute information identical to the designated attribute information received in step S1 is assigned from among the inspection images stored in the image server 20. That is, the access target image selection unit 12 selects, as the access target image, an inspection image to which attribute information including at least one attribute item identical in value to the plurality of attribute items (photographing date and time, component ID, product ID, inspection process ID, photographing site ID, and batch ID) constituting the designated attribute information is assigned.
[0055] In step S3, the access organization prompting unit 13 prompts the access organization for accessing the access target image selected in step S3. For example, the access organization prompting unit 13 may display a character string indicating the file name or URL of the access target image on the display 105, or may embed a hyperlink for accessing the access target image in the thumbnail of the access target image.
[0056] As described above, the image browsing device 10 according to the embodiment of the disclosed technology selects an image to which attribute information is assigned that is the same as the designated attribute information, i.e., the designated attribute information, from among a plurality of images to which attribute information is assigned as an access target image, and prompts an access mechanism for accessing the access target image. The image browsing device 10 receives the attribute information assigned to the image being displayed on the display 105 as the designated attribute information.
[0057] At least a part of the attribute information of the access target image is the same as the image currently displayed on the display 105, and is related to the image currently displayed on the display 105. Therefore, it is highly likely that the access target image is the next image that the user desires to access after the image currently displayed on the display 105. By providing the access mechanism for accessing such an image, the user can easily access the desired image.
[0058] [Second Embodiment]
[0059] Fig. 7A This is a diagram showing an example of a radiographic image acquisition method for non-destructive inspection of metal products. In non-destructive inspection, when the size of the object is large, inspection images are acquired multiple times while changing the imaging position so as to cover a predetermined inspection range. Fig. 7A , a case where a plurality of inspection images (file names: AA000.dcm, AA001.dcm, AA002.dcm, AA003.dcm) are acquired along welding line 80. In this way, it is assumed that the user wishes to view a plurality of inspection images acquired by photographing a plurality of different parts of the same individual simultaneously or sequentially.
[0060] The access object image selection unit 12 involved in the second embodiment selects a plurality of inspection images including different parts obtained from the same individual in the same inspection process as the access object images based on the attribute information. Specifically, when receiving an access request (hereinafter referred to as a first limited access request) for a plurality of inspection images including different parts obtained from the same individual in the same inspection process, the access object image selection unit 12 selects a plurality of inspection images to which attribute information including attribute items constituting the specified attribute information is assigned, in which the values of the component ID (or product ID) and the inspection process ID are the same, and the values of the photographed part ID are different, as the access object images. In addition, the first limited access request can be made, for example, by the user operating the input device 104.
[0061] When receiving the first limited access request, the access institution presenting unit 13 arranges and presents a plurality of access institutions corresponding to the selected plurality of access target images, respectively, in the order corresponding to the parts of the objects included in the access target images. Figure 7B is a diagram showing an example of the way in which the access mechanism presents the first limited access request. Fig. 7A Corresponding. Figure 7B In the example, the inspection image 50 (file name: AA000.dcm) displayed on the display 105 is along Fig. 7A The top image of a series of inspection images captured along the welding line 80 shown in FIG. 1 is a top image. The access target image selection unit 12 selects a series of inspection images (file names: AA001.dcm, AA002.dcm, AA003.dcm) captured along the welding line 80 as the access target images. The access mechanism presentation unit 13 arranges and displays hyperlinks 60 for accessing the selected access target images (file names: AA001.dcm, AA002.dcm, AA003.dcm) on the display 105 in the order corresponding to the parts of the objects included in the images. That is, when the part of the object included in the access target image is relatively located at the top, the access mechanism presentation unit 13 arranges the hyperlinks 60 corresponding to the image relatively at the top.
[0062] As described above, based on the attribute information, multiple inspection images including different parts obtained for the same individual in the same inspection process are selected as access object images, and multiple access mechanisms corresponding to the multiple access object images are arranged and prompted in an order corresponding to the parts of the object contained in the access object images, thereby making it easy to access the desired image.
[0063] [Third Embodiment]
[0064] Fig. 8AThis is a diagram showing an example of a radiographic image acquisition method for non-destructive inspection of metal products. In non-destructive inspection, when the structure of the object is complex, inspection images are acquired multiple times while changing the imaging direction so as to cover a predetermined inspection range. Fig. 8A , the case where inspection images are acquired from four directions (D1, D2, D3, and D4) for the object 90 is shown. Assume that the user wishes to view a plurality of inspection images acquired from different imaging directions for the same individual simultaneously or sequentially.
[0065] The access object image selection unit 12 involved in the third embodiment selects a plurality of inspection images obtained from the same individual in the same inspection process with different photographing directions as the access object images based on the attribute information. Specifically, when receiving an access request for a plurality of inspection images obtained from the same individual in the same inspection process with different photographing directions (hereinafter referred to as a second limited access request), the access object image selection unit 12 selects a plurality of inspection images to which attribute information including attribute items constituting the specified attribute information, in which the values of the component ID (or product ID) and the inspection process ID are the same, and the values of the photographing direction ID are different, as the access object images. In addition, the second limited access request can be made by the user operating the input device 104.
[0066] When receiving the second limited access request, the access mechanism presenting unit 13 presents access mechanisms for accessing the selected plurality of access target images in the order corresponding to the imaging direction. Figure 8B and Figure 8C FIG. 2 is a diagram showing an example of the way in which the access mechanism presents the second limited access request. Figure 8B In the example, the inspection image 50A (file name: AC001.dcm) shot from the direction D1 is displayed on the display 105. The access target image selection unit 12 selects a series of inspection images shot from a plurality of shooting directions as the access target images. The access mechanism prompting unit 13 displays access buttons 71R and 71L for respectively accessing the selected access target images on the display 105 as access mechanisms. When the access button 71R is clicked once with the mouse pointer 70 while the inspection image 50A (file name: AC001.dcm) shot from the direction D1 is displayed on the display 105, the inspection image shot from the direction D2 is displayed on the display 105. When the access button 71R is clicked again, as shown in FIG. Figure 8CAs shown, the inspection image 50B (file name: AC0003.dcm) taken from the direction D3 is displayed on the display 105. On the other hand, when the access button 71L is clicked once with the mouse pointer 70 while the inspection image 50A taken from the direction D1 is displayed on the display 105, the inspection image taken from the direction D4 is displayed on the display 105.
[0067] As described above, based on the attribute information, multiple inspection images with different photographic directions obtained for the same individual in the same inspection process are selected as access object images, and an access mechanism for accessing the multiple access object images in an order corresponding to the photographic directions is prompted, thereby making it easy to access the desired image.
[0068] [Fourth Embodiment]
[0069] Fig. 9 This is a diagram showing an example of the inspection process flow performed on the same individual component or product. Fig. 9 The following example is shown: a first inspection process P1 is performed on the same individual part or product at a predetermined timing, a second inspection process P2 is performed after the first inspection process P1, and a third inspection process P3 is performed after the second inspection process P2. In each inspection process, an inspection image is acquired. In this way, it is assumed that the user wishes to view multiple inspection images acquired for the same individual in each of the multiple inspection processes performed at different timings simultaneously or sequentially.
[0070] The access target image selection unit 12 involved in the fourth embodiment selects multiple inspection images acquired for the same individual in each of multiple inspection processes implemented at different timings as access target images based on attribute information. Specifically, when receiving an access request for multiple inspection images acquired for the same individual in each of multiple inspection processes implemented at different timings (hereinafter referred to as a third limited access request), the access target image selection unit 12 selects multiple inspection images to which attribute information including attribute items constituting the specified attribute information, in which the values of the component ID (or product ID) are the same and the values of the inspection process ID are different, as access target images. In addition, the third limited access request can be made, for example, by the user operating the input device 104.
[0071] When receiving the third limited access request, the visiting institution presenting unit 13 arranges and displays the visiting institutions corresponding to the selected visiting target images on the display 105 in the order corresponding to the execution order of the inspection processes for which the visiting target images were acquired.
[0072] In this way, multiple inspection images obtained for the same individual in each of multiple inspection processes implemented at different timings are selected as access object images, and multiple access mechanisms corresponding to the selected multiple access object images are arranged and presented in an order corresponding to the implementation order of the inspection processes in which the access object images are obtained. Thus, access to the desired images can be easily performed.
[0073] [Fifth Embodiment]
[0074] Fig.10 This is a diagram showing an example of a manufacturing process flow including an inspection process performed on the same individual component or product. Fig.10 The following example is shown: a first inspection process P1 is performed on the same individual part or product at a predetermined timing, and after the first inspection process P1, a reprocessing process R1 is performed to repair the defects found in the first inspection process P1, and after the reprocessing process R1, a second inspection process P2 is performed to determine the suitability of the defect repair based on the reprocessing. Inspection images are acquired in each inspection process. In this way, it is assumed that the user wishes to view multiple inspection images acquired for the same individual in each inspection process performed before and after the reprocessing process simultaneously or sequentially.
[0075] The access target image selection unit 12 involved in the fifth embodiment selects multiple inspection images obtained from the same individual in the inspection process implemented before and after a specific process (for example, a reprocessing process) as the access target images based on the attribute information. Specifically, when receiving an access request (hereinafter referred to as a fourth limited access request) for multiple inspection images obtained from the same individual in the inspection process implemented before and after a specific process, the access target image selection unit 12 selects multiple inspection images assigned with attribute information including multiple attribute items constituting the specified attribute information, the values of the component ID or product ID are the same, and the value of the inspection process ID corresponds to the attribute item of the inspection process performed before and after the specific process (for example, the reprocessing process) as the access target images. In addition, the fourth limited access request can be made, for example, by the user operating the input device 104.
[0076] When receiving the fourth limited access request, the visiting institution presenting unit 13 arranges and displays the visiting institutions corresponding to the selected visiting target images on the display 105 in the order corresponding to the execution order of the inspection processes for which the visiting target images were acquired.
[0077] In this way, multiple inspection images obtained on the same individual in the inspection processes performed before and after a specific process (for example, a reprocessing process) are selected as access object images, and multiple access mechanisms corresponding to the selected multiple access object images are arranged and prompted in an order corresponding to the implementation order of the inspection processes in which the access object images were obtained, thereby making it easy to access the desired images.
[0078] [Sixth Embodiment]
[0079] Generally speaking, image inspection is performed multiple times until the product is completed. Sometimes, different parts of an individual are photographed, or the photographing direction is changed. In addition, when a product is composed of multiple parts, the multiple parts are image inspected separately, and the image inspection is performed on the state of the finished product composed of the multiple parts. In this way, when multiple image inspections are performed on each part or each product, the number of inspection images obtained in each inspection process becomes huge, and it becomes difficult to access the desired inspection image.
[0080] The access target image selection unit 12 according to the sixth embodiment selects, based on the attribute information, an inspection image acquired for an individual first component specified by the designated attribute information (hereinafter referred to as a first component inspection image), an inspection image acquired for an individual second component used in combination with the individual first component (hereinafter referred to as a second component inspection image), and an inspection image acquired for an individual product manufactured using the first component and the second component (hereinafter referred to as a product inspection image) as access target images. In addition, it is assumed here that the inspection image displayed on the display 105 is the first component inspection image.
[0081] When receiving an access request for a plurality of inspection images including a component inspection image and a product inspection image (hereinafter referred to as a fifth limited access request), the access object image selection unit 12 specifies the individual product ID of a product manufactured using the individual first component based on the component ID of the individual first component contained in the specified attribute information, and further selects the individual component ID of the second component used in combination with the individual first component based on the product ID. For example, by referring to the product ID and component ID assigned to the product inspection image, the individual component IDs of all components constituting the product can be specified. The access object image selection unit 12 selects an inspection image to which attribute information including attribute items having the same value as the individual component ID of the first component contained in the specified attribute information, the individual component ID of the specified second component, and the individual product ID of the product is assigned as the access object image. In addition, the fifth limited access request can be made, for example, by the user operating the input device 104.
[0082] When receiving the fifth limited access request, the access institution prompting unit 13 prompts the access institutions corresponding to the selected multiple access target images by category, by product, or by inspection process. In addition, the access institution prompting unit 13 arranges and prompts the access institutions corresponding to the multiple access target images in the chronological order of the inspection process.
[0083] Fig.11 FIG. 2 is a diagram showing an example of the way in which the access mechanism presents the access request when the fifth limited access request is received. Fig.11 In the figure, for "component X" as the first component, hyperlinks 60A and 60B as access mechanisms corresponding to the inspection images (file names: AA001.dcm, AA002.dcm) obtained in the intermediate inspection process and the inspection images (file names: AB001.dcm, AB002.dcm) obtained in the inspection process after reprocessing are shown. In addition, for "component Y" as the second component used in combination with the first component, hyperlinks 60C as access mechanisms corresponding to the inspection images (file names: CA001.dcm, CA002.dcm) obtained in the intermediate inspection process are shown. In addition, for the "product Z" manufactured using the first component and the second component, hyperlinks 60D and 60E as access means corresponding to the inspection images (file names: DD001.dcm, DD002.dcm, DD003.dcm) acquired in the intermediate inspection process after assembly and the inspection images (file names: DE001.dcm, DE002.dcm, DE003.dcm) acquired in the final inspection process are shown. As access means corresponding to the above-mentioned inspection images, the hyperlinks 60A to 60E are classified for each component, each product, and each inspection process, and are displayed on the display 105 in a state arranged in chronological order according to each inspection process.
[0084] In this way, the inspection image obtained for the individual first component specified by the designated attribute information, the inspection image obtained for the individual second component used in combination with the individual first component, and the inspection image obtained for the individual product manufactured using the first component and the second component are respectively specified as access object images, and the multiple access mechanisms corresponding to the multiple access object images are classified according to each component and each inspection process. In addition, they are arranged and prompted in the chronological order of the inspection process, thereby making it easy to access the desired image.
[0085] In the above description, the case where the inspection image displayed on the display 105 is the first component inspection image is exemplified, but when the inspection image displayed on the display 105 is the product inspection image, processing is performed as follows. That is, the access target image selection unit 12 selects, based on the attribute information, the inspection image acquired for the individual product specified by the designated attribute information and the inspection image acquired for each of the multiple components constituting the individual product as the access target image.
[0086] [Seventh Embodiment]
[0087] In the second to sixth embodiments described above, examples are given of cases where the inspection image specified as the access object image is limited by the user making a limited access request. In contrast, in the present embodiment, the inspection image specified as the access object image is limited according to the priority set for the attribute information. That is, the priority is set for the multiple attribute items constituting the attribute information. The priority can be set by the user. The access object image selection unit 12 selects the access object image based on the priority set for the attribute information. The priority can also be a priority sort.
[0088] The access object image selection unit 12 extracts a portion of attribute items with relatively high priority from among the multiple attribute items (photographing date and time, component ID, product ID, inspection process ID, photographing part ID, photographing direction ID, batch ID) constituting the designated attribute information. The attribute items with relatively high priority may also be attribute items with a priority above a threshold. The access object image selection unit 12 selects, as the access object image, an inspection image to which at least one of the extracted attribute items and attribute information including the attribute items are assigned. Attribute items with relatively low priority from among the multiple attribute items constituting the designated attribute information are not considered in the selection of the access object image. According to the image browsing device 10 involved in this embodiment, it is possible to suppress the access object image from becoming large, and therefore, it is possible to easily access the desired image.
[0089] [Eighth Embodiment]
[0090] In the seventh embodiment described above, the access target image is selected based on the priority set in the attribute information. However, the presentation methods of the plurality of access institutions corresponding to the plurality of access target images may be made different according to the priority.
[0091] As an example, based on the attribute information assigned to the inspection image [#1] displayed on the display 105, consider the case where three inspection images [#2], [#3], and [#4] are specified as access target images. Inspection image [#1] is an inspection image of individual A1 of component A photographed from direction D1 in the first inspection process. The attribute information of inspection image [#1] includes <component ID: A1>, <inspection process ID: P1>, and <photographic direction ID: D1>. Inspection image [#2] is an inspection image of individual A1 of component A photographed from direction D2 in the first inspection process. The attribute information of inspection image [#2] includes <component ID: A1>, <inspection process ID: P1>, and <photographic direction ID: D2>. Inspection image [#3] is an inspection image of individual A1 of component A photographed from direction D1 in the second inspection process. The attribute information of inspection image [#3] includes <component ID: A1>, <inspection process ID: P2>, and <photographic direction ID: D1>. Inspection image [#4] is an inspection image of individual A1 of component A captured from direction D2 in the second inspection process. The attribute information of inspection image [#4] includes <component ID: A1>, <inspection process ID: P2>, and <photographic direction ID: D2>.
[0092] Fig. 12A and Fig. 12B This is a diagram showing an example of the way of presenting the access mechanism when a relatively high priority is set for "inspection process ID" among the plurality of attribute items constituting the attribute information in the above-mentioned case. The access mechanism presenting unit 13 presents the access mechanism corresponding to the inspection image [#2] (file name: AA001.dcm) as the access target image, which is assigned attribute information including the same value as the value "P1" of the inspection process ID, which is an attribute item with a relatively high priority among the attribute information assigned to the inspection image [#1] 50A (file name: AA000.dcm) displayed on the display 105, and the access mechanism corresponding to the other inspection images [#3] (file name: AB001.dcm) and [#4] (file name: AB002.dcm) as the access target images, is different from the access mechanisms corresponding to the other inspection images [#3] (file name: AB001.dcm) and [#4] (file name: AB002.dcm).
[0093] like Fig. 12AAs shown in the example, the access mechanism display unit 13 displays the hyperlink 60A corresponding to the inspection image [#2] (file name: AA001.dcm) as the access mechanism on the display 105 together with the inspection image [#1] 50A (file name: AA000.dcm). The access mechanism display unit 13 sets the access mechanisms corresponding to the inspection images [#3] and [#4] to be hidden, and displays an icon 72 for displaying the access mechanisms set to be hidden on the display 105. When the user clicks the icon 72 with the mouse pointer 70, as shown in FIG. Fig. 12B As shown, hyperlinks 60B and 60C as access mechanisms corresponding to the inspection images [#3] and [#4], respectively, are displayed.
[0094] In this way, according to the priority set for the attribute information, the multiple access mechanisms corresponding to the multiple access target images are prompted differently, thereby enabling guidance to prioritize access to specific access target images. According to the above example, it is possible to guide priority access to the inspection image [#2], which was acquired in the same inspection process as the inspection image [#1] displayed on the display 105 and has a different photographing direction from the inspection image [#1].
[0095] In addition, in each of the above-mentioned embodiments, the case where the designated attribute information receiving unit 11 receives the attribute information assigned to the inspection image displayed on the display 105 as the designated attribute information is exemplified, but the disclosed technology is not limited to this method. The designated attribute information receiving unit 11 may also receive designated input of the attribute information to be processed as the designated attribute information. The designated input may be performed by the user operating the input device 104. According to this method, even in a state where the inspection image is not displayed on the display 105, the access target image can be selected.
[0096] In the above-mentioned embodiments, the image browsing device 10 and the image server 20 are constituted by different computers connected in a communicable manner, but the image browsing device 10 may also have the function of the image server 20. In the above-mentioned embodiments, the image management system 1 processes inspection images, but it may process all images other than inspection images.
[0097] In each of the above-mentioned embodiments, for example, as a hardware structure of a processing unit (processing unit) that performs various processes such as the designated attribute information receiving unit 11, the access object image selection unit 12, and the access organization prompting unit 13, various processors (processors) as shown below can be used. Among the above-mentioned various processors, as described above, in addition to general-purpose processors that execute software (programs) and function as various processing units, namely CPUs and GPUs, there are also processors such as FPGAs that can change the circuit structure after manufacturing, namely programmable logic devices (PLDs), and processors with circuit structures specially designed to perform specific processes such as ASICs (Application Specific Integrated Circuits, dedicated circuits), etc.
[0098] A processing unit may be composed of one of these various processors, or a combination of two or more processors of the same or different types (e.g., a combination of multiple FPGAs, or a combination of a CPU and an FPGA). In addition, multiple processing units may be composed of one processor.
[0099] As an example of a plurality of processing units being constituted by one processor, first, there is a method represented by computers such as clients and servers, where one processor is constituted by a combination of one or more CPUs and software, and the processor functions as a plurality of processing units. Second, there is a method represented by a system on chip (SoC), etc., where a processor is used to realize the functions of the entire system including a plurality of processing units by a single IC (Integrated Circuit) chip. In this way, various processing units are constituted as hardware structures using one or more of the above-mentioned various processors.
[0100] Furthermore, as the hardware configuration of these various processors, more specifically, a circuit (circuitry) formed by combining circuit elements such as semiconductor elements can be used.
[0101] In addition, in the above-mentioned embodiment, the access support program 110 is described as being pre-stored (installed) in the non-volatile memory 103, but the present invention is not limited thereto. The access support program 110 may also be provided in a manner recorded on a recording medium such as a CD-ROM (Compact Disc Read Only Memory), a DVD-ROM (Digital Versatile Disc Read Only Memory), and a USB (Universal Serial Bus) memory. In addition, the access support program 110 may also be provided in a manner of being downloaded from an external device via a network. That is, the program (i.e., program product) described in this embodiment may be provided by a recording medium or may be transmitted from an external computer.
[0102] Regarding the above-mentioned first to eighth embodiments, the following supplementary notes are further disclosed.
[0103] (Note 1)
[0104] An information processing device having at least one processor, wherein:
[0105] The processor
[0106] An image to which attribute information is assigned that is the same as the designated attribute information, ie, the designated attribute information, is selected as an access target image from among a plurality of images to which attribute information is assigned,
[0107] An access mechanism for accessing the access target image is prompted.
[0108] (Note 2)
[0109] The information processing device according to Supplement 1, wherein:
[0110] The processor receives attribute information assigned to an image being displayed on a display as the designated attribute information.
[0111] (Note 3)
[0112] The information processing device according to Supplement 1, wherein:
[0113] The processor accepts a designation input of attribute information as the designation attribute information.
[0114] (Note 4)
[0115] An information processing device according to any one of Supplementary Notes 1 to 3, wherein:
[0116] The plurality of images are inspection images acquired during an inspection process performed on an object included in the image.
[0117] The attribute information includes information for identifying the inspection process in which the image was acquired.
[0118] (Note 5)
[0119] The information processing device according to Supplement 4, wherein:
[0120] The attribute information also includes information identifying an individual component or product of the object, information identifying an individual product manufactured using the component of the object, information identifying each individual of the multiple components constituting the product of the object, information identifying a manufacturing batch of the component or product of the object, information identifying a location of the object, information identifying a photographing direction of the image, and at least one of the photographing date of the image.
[0121] (Note 6)
[0122] The information processing device according to Supplement 5, wherein:
[0123] The processor selects, based on the attribute information, a plurality of inspection images including different parts acquired on the same individual in the same inspection process as the access target images.
[0124] (Note 7)
[0125] The information processing device according to Supplement 6, wherein:
[0126] The processor arranges and presents the plurality of access mechanisms corresponding to the plurality of access target images, respectively, in an order corresponding to the parts of the objects included in the access target images.
[0127] (Note 8)
[0128] An information processing device according to any one of Supplement 5 to Supplement 7, wherein:
[0129] The processor selects, based on the attribute information, a plurality of inspection images acquired on the same individual in the same inspection process and having different imaging directions as the access target images.
[0130] (Note 9)
[0131] The information processing device according to Supplementary Note 8, wherein:
[0132] The processor presents the access mechanism for accessing the plurality of access target images in an order corresponding to a photographing direction.
[0133] (Note 10)
[0134] An information processing device according to any one of Notes 5 to 9, wherein:
[0135] The processor selects, based on the attribute information, a plurality of inspection images acquired for the same individual in each of a plurality of inspection steps performed at different timings as the access target image.
[0136] (Note 11)
[0137] An information processing device according to any one of Supplement 5 to Supplement 10, wherein:
[0138] The processor selects, based on the attribute information, a plurality of inspection images acquired on the same individual in inspection steps performed before and after a specific step as the access target images.
[0139] (Note 12)
[0140] An information processing device according to any one of Supplement 5 to Supplement 11, wherein:
[0141] Based on the attribute information, the processor selects as the access object image an inspection image obtained for an individual of a first component specified by the specified attribute information, an inspection image obtained for an individual of a second component used in combination with an individual of the first component, and an inspection image obtained for an individual of a product manufactured using the first component and the second component.
[0142] (Note 13)
[0143] An information processing device according to any one of Supplement 5 to Supplement 12, wherein:
[0144] The processor selects, based on the attribute information, an inspection image acquired for an individual product specified by the specified attribute information and an inspection image acquired for each of a plurality of components constituting the individual product as the access target images.
[0145] (Note 14)
[0146] The information processing device according to Supplement 12 or Supplement 13, wherein:
[0147] The processor classifies and presents the plurality of access mechanisms corresponding to the plurality of access target images for each component and each inspection process.
[0148] (Note 15)
[0149] The information processing device according to Supplement 14, wherein:
[0150] The processor arranges and presents the plurality of access mechanisms corresponding to the plurality of access target images, respectively, in chronological order of the inspection process.
[0151] (Note 16)
[0152] An information processing device according to any one of Supplement 1 to Supplement 15, wherein:
[0153] The processor selects the access target image based on the priority set for the attribute information.
[0154] (Note 17)
[0155] An information processing device according to any one of Supplement 1 to Supplement 15, wherein:
[0156] The processor makes the presentation methods of the plurality of visit institutions corresponding to the plurality of visit target images different according to the priority set for the attribute information.
[0157] (Note 18)
[0158] An information processing method, wherein at least one processor of an information processing device performs the following processing:
[0159] selecting, from among a plurality of images to which attribute information is respectively assigned, an image to which attribute information identical to the designated attribute information, ie, designated attribute information, is assigned as an access target image; and
[0160] An access mechanism for accessing the access target image is prompted.
[0161] (Note 19)
[0162] A program for causing at least one processor of an information processing device to execute the following processing:
[0163] selecting, from among a plurality of images to which attribute information is respectively assigned, an image to which attribute information identical to the designated attribute information, ie, designated attribute information, is assigned as an access target image; and
[0164] An access mechanism for accessing the access target image is prompted.
[0165] (Note 20)
[0166] An information display device, wherein:
[0167] An access mechanism for accessing an image to which attribute information identical to designated attribute information, ie, designated attribute information, is assigned is displayed on the display.
[0168] (Note 21)
[0169] A method for displaying information, wherein:
[0170] An access mechanism for accessing an image to which attribute information identical to designated attribute information, ie, designated attribute information, is assigned is displayed on the display.
[0171] In addition, the disclosure of Japanese Patent Application No. 2022-144437 filed on September 12, 2022 is incorporated herein by reference in its entirety. In addition, with respect to all documents, patent applications, and technical specifications described in this specification, each document, patent application, and technical specification is incorporated herein by reference to the same extent as if it were specifically and individually described.
Claims
1. An information processing device having at least one processor, wherein: The processor selecting, from among a plurality of images to which attribute information is respectively assigned, an image to which attribute information identical to at least a portion of the designated attribute information, that is, the designated attribute information, as an access target image; An access mechanism for accessing the access target image is prompted.
2. The information processing device according to claim 1, wherein: The processor receives at least a part of the attribute information given to the image being displayed on the display as the designated attribute information.
3. The information processing device according to claim 1, wherein: The processor accepts a designation input of attribute information as the designation attribute information.
4. The information processing device according to claim 1, wherein: The plurality of images are inspection images acquired during an inspection process performed on an object included in the image. The attribute information includes information for identifying the inspection process in which the image was acquired.
5. The information processing device according to claim 4, wherein: The attribute information also includes information identifying an individual component or product of the object, information identifying an individual product manufactured using the component of the object, information identifying each individual of the multiple components constituting the product of the object, information identifying a manufacturing batch of the component or product of the object, information identifying a location of the object, information identifying a photographing direction of the image, and at least one of the photographing date of the image.
6. The information processing device according to claim 5, wherein: The processor selects, based on the attribute information, a plurality of inspection images including different parts acquired on the same individual in the same inspection process as the access target images.
7. The information processing device according to claim 6, wherein: The processor arranges and presents the plurality of access mechanisms corresponding to the plurality of access target images, respectively, in an order corresponding to the parts of the objects included in the access target images.
8. The information processing device according to claim 5, wherein: The processor selects, based on the attribute information, a plurality of inspection images acquired on the same individual in the same inspection process and having different imaging directions as the access target images.
9. The information processing device according to claim 8, wherein: The processor presents the access mechanism for accessing the plurality of access target images in an order corresponding to a photographing direction.
10. The information processing device according to claim 5, wherein: The processor selects, based on the attribute information, a plurality of inspection images acquired for the same individual in each of a plurality of inspection steps performed at different timings as the access target image.
11. The information processing device according to claim 5, wherein: The processor selects, based on the attribute information, a plurality of inspection images acquired on the same individual in inspection steps performed before and after a specific step as the access target images.
12. The information processing device according to claim 5, wherein: Based on the attribute information, the processor selects as the access object image an inspection image obtained for an individual of a first component specified by the specified attribute information, an inspection image obtained for an individual of a second component used in combination with an individual of the first component, and an inspection image obtained for an individual of a product manufactured using the first component and the second component.
13. The information processing device according to claim 5, wherein: The processor selects, based on the attribute information, an inspection image acquired for an individual product specified by the specified attribute information and an inspection image acquired for each of a plurality of components constituting the individual product as the access target images.
14. The information processing device according to claim 12 or 13, wherein: The processor classifies and presents the plurality of access mechanisms corresponding to the plurality of access target images for each component and each inspection process.
15. The information processing device according to claim 14, wherein: The processor arranges and presents the plurality of access mechanisms respectively corresponding to the plurality of access target images in a chronological order of the inspection process.
16. The information processing device according to any one of claims 1 to 5, wherein: The processor selects the access target image based on the priority set for the attribute information.
17. The information processing device according to any one of claims 1 to 5, wherein: The processor makes the presentation methods of the plurality of access institutions corresponding to the plurality of access target images different according to the priority set for the attribute information.
18. An information processing method, wherein: At least one processor of the information processing device performs the following processing: selecting, from among a plurality of images to which attribute information is respectively assigned, an image to which attribute information identical to the designated attribute information, ie, designated attribute information, is assigned as an access target image; as well as An access mechanism for accessing the access target image is prompted.
19. A program for causing at least one processor of an information processing device to execute the following processing: selecting, from among a plurality of images to which attribute information is respectively assigned, an image to which attribute information identical to the designated attribute information, ie, designated attribute information, is assigned as an access target image; and An access mechanism for accessing the access target image is prompted.
20. An information display device, wherein: An access mechanism for accessing an image to which attribute information identical to designated attribute information, ie, designated attribute information, is assigned is displayed on the display.
21. A method for displaying information, wherein: An access mechanism for accessing an image to which attribute information identical to designated attribute information, ie, designated attribute information, is assigned is displayed on the display.
Citation Information
Patent Citations
Inspection-measurement device
JP1995113762A
System and method for managing thin film device manufacturing process
JP2002269109A
Examination result management server, communication system, communication method and program
JP2021026330A
Fe-BASED ALLOY AND METAL POWDER
JP2022144437A