Information processing device, assistance system, assistance method, and assistance program

By automatically detecting the association between the tray and the inspection object through image processing and location information, the problem of heavy manual operation burden for inspectors is solved, and a more efficient inspection process is achieved.

CN119032477APending Publication Date: 2024-11-26MITSUBISHI ELECTRIC CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202280092840.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2022-03-08
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

In existing technologies, inspectors need to manually associate the inventory with the items being inspected, resulting in an excessive workload.

Method used

An information processing device is provided that automatically detects and associates disks and inspection objects through image processing and location information, reducing manual operation.

Benefits of technology

It reduced the workload of inspectors and improved inspection efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119032477A_ABST
    Figure CN119032477A_ABST
Patent Text Reader

Abstract

An information processing device (100) is provided with: an acquisition unit (120) that acquires an image indicating a disk (300) including a disk name and inspection objects (301-309), and a position table (111) that is information indicating a correspondence relationship among the disk name, the position of the inspection object, and the name of the inspection object; a detection unit (130) that detects the disk name from within the image region representing the disk (300) on the basis of the image detection disk (300), and that detects the positions of the detection objects (301-309) on the basis of the image region representing the disk (300); and an association unit (140) that associates the disk (300) and the spot inspection objects (301-309) on the basis of the name of the disk (300), the positions of the spot inspection objects (301-309), and the position table (111).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an information processing device, an assisting system, an assisting method and an assisting program. Background Art

[0002] Control panels, switchboards, distribution panels, etc. are installed in facilities such as power plants. These panels are inspected daily or regularly. These panels include instruments, etc. Instruments, etc. are inspection objects. Here, a technology for extracting the display content of the instrument is proposed (see Patent Document 1).

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2018-181232 Summary of the invention

[0006] Problems to be solved by the invention

[0007] In the above technology, the content of the inspection object is extracted. However, this technology does not know which disk contains the content of the inspection object. Therefore, the inspector needs to associate the inspection object with the disk containing the inspection object through manual work. For example, the inspector uses a computer to perform the association work. The inspector's work increases the inspector's burden.

[0008] The object of the present invention is to reduce this burden.

[0009] Means for solving problems

[0010] An information processing device according to one embodiment of the present invention is provided. The information processing device comprises: an acquisition unit that acquires an image representing a disk including a name of the disk and an inspection object, and position information that represents the correspondence between the name of the disk, the position of the inspection object, and the name of the inspection object; a detection unit that detects the disk based on the image, detects the name of the disk from an image region representing the disk, and detects the position of the inspection object based on the image region representing the disk; and an association unit that associates the disk with the inspection object based on the name of the disk, the position of the inspection object, and the position information.

[0011] Effects of the Invention

[0012] According to the present invention, the burden can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 This is a diagram showing the support system according to the first embodiment.

[0014] Figure 2 This is a diagram showing hardware included in the information processing device according to the first embodiment.

[0015] Figure 3 This is a block diagram showing the functions of the information processing device according to the first embodiment.

[0016] Figure 4 This is a diagram showing an example of a position table according to Embodiment 1.

[0017] Figure 5 This is a diagram showing an example of disk detection in the first embodiment.

[0018] Figure 6 This is a diagram showing an example of associated images according to the first embodiment.

[0019] Figure 7 This is a flowchart showing an example of processing executed by the information processing device according to Embodiment 1.

[0020] Figure 8 This is a diagram showing a support system according to the second embodiment.

[0021] Fig. 9 This is a block diagram showing the functions of the information processing device according to the second embodiment.

[0022] Fig.10 This is a block diagram showing the functions of the information processing device according to the third embodiment.

[0023] Fig.11 This is a diagram showing an example of displaying inspection results according to the fourth embodiment.

[0024] Fig.12 This is a block diagram showing the functions of a mobile terminal according to the fifth embodiment. DETAILED DESCRIPTION

[0025] Hereinafter, embodiments will be described with reference to the drawings. The following embodiments are merely examples, and various modifications can be made within the scope of the present invention.

[0026] Implementation Method 1

[0027] Figure 1 1 is a diagram showing a support system according to Embodiment 1. The support system includes an information processing device 100 and a mobile terminal 200. The information processing device 100 and the mobile terminal 200 are connected via a network.

[0028] The information processing device 100 is a device that executes the support method. The mobile terminal 200 is a device used by an inspector. For example, the mobile terminal 200 is a smartphone, a tablet terminal, or an HMD (Head Mounted Display). The mobile terminal 200 has a camera unit.

[0029] Figure 1A panel 300 is shown. For example, the panel 300 is a control panel, a switchboard, a distribution panel, etc. The panel 300 includes a sign 301, switches 302-304, lamps 305-307, and meters 308,309.

[0030] The name of the panel 300 is written on the nameplate 301. Switches 302 to 304, lamps 305 to 307, and meters 308 and 309 are inspection targets.

[0031] The inspector uses the mobile terminal 200 to take a picture of the disk 300. Then, the mobile terminal 200 sends the image representing the disk 300 to the information processing device 100. The information processing device 100 automatically associates the disk 300 with the inspection object based on the image. Thus, the inspector does not need to manually associate the inspection object with the disk containing the inspection object. Thus, the information processing device 100 can reduce the burden on the inspector.

[0032] Next, the information processing device 100 will be described in detail.

[0033] Next, the hardware included in the information processing device 100 will be described.

[0034] Figure 2 1 is a diagram showing hardware included in the information processing device according to Embodiment 1. The information processing device 100 includes a processor 101 , a volatile storage device 102 , and a nonvolatile storage device 103 .

[0035] The processor 101 controls the entire information processing device 100. For example, the processor 101 is a CPU (Central Processing Unit), an FPGA (Field Programmable Gate Array), etc. The processor 101 may also be a multiprocessor. In addition, the information processing device 100 may also have a processing circuit.

[0036] The volatile storage device 102 is a main storage device of the information processing device 100. For example, the volatile storage device 102 is a RAM (Random Access Memory). The nonvolatile storage device 103 is an auxiliary storage device of the information processing device 100. For example, the nonvolatile storage device 103 is a HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0037] Next, the functions of the information processing device 100 will be described.

[0038] Figure 31 is a block diagram showing the functions of the information processing device according to Embodiment 1. The information processing device 100 includes a storage unit 110, an acquisition unit 120, a detection unit 130, an association unit 140, a state detection unit 150, and an output unit 160. The state detection unit 150 may also be referred to as an inspection unit.

[0039] The storage unit 110 may be realized as a storage area reserved in the volatile storage device 102 or the nonvolatile storage device 103 .

[0040] Part or all of the acquisition unit 120, the detection unit 130, the association unit 140, the state detection unit 150, and the output unit 160 may also be implemented by a processing circuit. In addition, part or all of the acquisition unit 120, the detection unit 130, the association unit 140, the state detection unit 150, and the output unit 160 may also be implemented as a module of a program executed by the processor 101. For example, the program executed by the processor 101 is also called an auxiliary program. For example, the auxiliary program is recorded in a recording medium.

[0041] The storage unit 110 may store a position table. Here, a position table is shown.

[0042] Figure 4 1 is a diagram showing an example of a position table of Implementation 1. For example, a position table 111 is stored in a storage unit 110. The position table 111 is also called position information. The position table 111 is information indicating the correspondence between the name of a disk, the position of an inspection object, and the name of the inspection object. The position table 111 is described in detail. The position table 111 has items of "Disk Name", "No.", "Type", "Position", and "Name". For example, the name of the disk is registered in the item of "Disk Name". The position of the inspection object is registered in the item of "Position". The name of the inspection object is registered in the item of "Name".

[0043] "No. 1" of the disk name "△△ Machine" indicates the position of the switch 302. For example, the position of the switch 302 is indicated by the distance from the origin (ie, X, Y). In addition, the width of the switch 302 is indicated by W and H. In addition, the origin is the corner of the disk 300.

[0044] The origin may also be the position of the sign 301. The position of the inspection object may also be represented by the coordinates of the center point of the inspection object. Figure 4The position table 111 may be used to represent the position of the inspection object in a manner other than the position. For example, the position of the inspection object may be represented by a ratio relative to the width of the disk. In addition, for example, the position of the inspection object may be represented by the coordinates of the four corners of the inspection object. For example, the position of the inspection object may be represented by a circle based on the coordinates of the center point and the radius. The position of the inspection object may be represented by the area of ​​the inspection object. In addition, the unit of position may be a physical length such as cm or m.

[0045] The acquisition unit 120 acquires an image generated by the mobile terminal 200 .

[0046] The acquisition unit 120 acquires the position table 111. For example, the acquisition unit 120 acquires the position table 111 from the storage unit 110. Also, for example, the acquisition unit 120 acquires the position table 111 from an external device. In addition, the external device is omitted in the figure.

[0047] The detection unit 130 detects the disk 300 based on the image. For example, the detection unit 130 detects the disk 300 using the image and the learned model. Also, for example, the detection unit 130 detects the disk 300 using the image and information indicating the shape of the disk 300. In addition, the learned model and the information indicating the shape of the disk 300 may also be stored in the storage unit 110 or an external device. Detection of the disk 300 is illustrated.

[0048] Figure 5 4 is a diagram showing an example of disk detection in Embodiment 1. Image 400 is an image generated by mobile terminal 200. Figure 5 As shown in FIG. 1 , the detection unit 130 detects the disk 300 . Specifically, the detection unit 130 detects the shape of the disk 300 . That is, the detection unit 130 detects a rectangle. In addition, the detection unit 130 may detect four points indicating the four corners of the disk 300 .

[0049] The detection unit 130 detects the name of the disk 300 from the image area representing the disk 300. Specifically, the detection unit 130 performs character recognition on the image area of ​​the disk 300. When the detection unit 130 performs character recognition, the detection unit 130 may use OCR (Optical Character Recognition). Thus, the detection unit 130 detects the name of the disk 300 shown on the label 301, "△△ Machine".

[0050] The detection unit 130 detects the position of the inspection object based on the image area representing the disk 300. In detail, the detection unit 130 detects the inspection object using object recognition technology, thereby being able to detect the position of the inspection object. Thus, the detection unit 130 detects the position of the switch 302 and the like. Figure 4 As shown, the position of the detection result can also be expressed by the angle and width of the inspection object.

[0051] The associating unit 140 associates the disk 300 with the inspection object based on the name of the disk 300, the location of the inspection object, and the location table 111. Specifically, the associating unit 140 determines the name of the disk 300, "△△ machine", from the "disk name" of the location table 111. The associating unit 140 determines the name of the inspection object based on the record of "location" of "△△ machine" in the location table 111 and the location of the inspection object. The associating unit 140 associates the name of the disk 300, "△△ machine", with the name of the inspection object. An associated image is shown.

[0052] Figure 6 FIG. 1 is a diagram showing an example of an associated image according to Embodiment 1. Figure 6 As shown, the disk 300 and the inspection object are associated with each other.

[0053] The state detection unit 150 detects the state of the inspection object in the image. In detail, the state detection unit 150 detects the state of the inspection object using image analysis technology or a learned model. Specifically, the state detection unit 150 detects whether the switch is in an on state or an off state. In addition, the state detection unit 150 detects whether the light is flashing. Furthermore, the state detection unit 150 detects the value shown by the meter.

[0054] The output unit 160 outputs the inspection result as the detection result to the mobile terminal 200. Thus, the inspector can confirm the state of the inspection object via the mobile terminal 200. In addition, for example, the inspection result is information that associates the name of the tray 300 "△△ machine", the name of the inspection object "○○ switch", and the state of the inspection object "on".

[0055] Next, the processing executed by the information processing device 100 will be described using a flowchart.

[0056] Figure 7 This is a flowchart showing an example of processing executed by the information processing device according to Embodiment 1.

[0057] (Step S11 ) The acquisition unit 120 acquires an image generated by the mobile terminal 200 .

[0058] (Step S12) The detection unit 130 detects the disk 300 based on the image.

[0059] (Step S13) The detection unit 130 detects the name of the disk 300 based on the image.

[0060] (Step S14) The detection unit 130 detects the position of the inspection object based on the image.

[0061] (Step S15 ) The associating unit 140 associates the disk 300 with the inspection target based on the name of the disk 300 , the position of the inspection target, and the position table 111 .

[0062] (Step S16 ) The state detection unit 150 detects the state of the inspection object in the image.

[0063] (Step S17 ) The output unit 160 outputs the inspection result to the mobile terminal 200 .

[0064] According to Embodiment 1, the information processing device 100 associates the disk 300 with the inspection target. Therefore, the inspector does not need to manually associate the inspection target with the disk including the inspection target. Thus, the information processing device 100 can reduce the burden on the inspector.

[0065] Implementation Method 2

[0066] Next, Embodiment 2 will be described. In Embodiment 2, matters different from Embodiment 1 will be mainly described. In Embodiment 2, description of matters common to Embodiment 1 will be omitted.

[0067] Figure 8 2 is a diagram showing a support system according to Embodiment 2. The support system may include an information processing device 100 , a mobile terminal 200 , and a drawing reading device 500 .

[0068] The drawing reading device 500 reads the design drawing (ie, paper medium) of the disk 300. The drawing reading device 500 may also transmit a drawing showing the disk 300 obtained by reading the design drawing to the information processing device 100. The drawing reading device 500 may also be included in the mobile terminal 200.

[0069] Fig. 9 Detailed description of the invention Figure 2 is a block diagram showing the functions of the information processing device according to the second embodiment. Figure 3 The same structure as shown Fig. 9 Structural annotation and Figure 3 The information processing device 100 further includes a generator 170. A part or all of the generator 170 may be implemented by a processing circuit. In addition, a part or all of the generator 170 may be implemented as a module of a program executed by the processor 101.

[0070] The acquisition unit 120 may acquire the diagram showing the disk 300 from the diagram reading device 500. Here, the information processing device 100 may have a diagram reading function. When the information processing device 100 has the diagram reading function, the acquisition unit 120 acquires the diagram showing the disk 300 read by the information processing device 100.

[0071] Furthermore, the acquisition unit 120 may acquire a CAD (Computer-Aided Design) drawing which is a design drawing of the disk 300 . The CAD drawing is a drawing showing the disk 300 . For example, the acquisition unit 120 acquires the CAD drawing from the storage unit 110 .

[0072] The generating unit 170 generates the position table 111 based on the map showing the disk 300. The output unit 160 outputs the position table 111 to the storage unit 110 or an external device.

[0073] According to Embodiment 2, the position table 111 is automatically generated. Therefore, for example, an inspector does not need to create the position table 111. Thus, the information processing device 100 can reduce the burden on the inspector.

[0074] Implementation 3

[0075] Next, Embodiment 3 will be described. In Embodiment 3, matters different from Embodiment 1 will be mainly described. In Embodiment 3, description of matters common to Embodiment 1 will be omitted.

[0076] In Embodiment 1, the case where the inspection result is output is described. After the inspection result is output to mobile terminal 200, the inspection result disappears in information processing device 100. Therefore, the fact that the inspection was performed is lost. Therefore, in Embodiment 3, the case where the inspection result is stored in information processing device 100 is described.

[0077] Fig.10 Detailed description of the invention Figure 1 is a block diagram showing the functions of an information processing device according to Embodiment 3. Figure 3 The same structure as shown Fig.10 Structural annotation and Figure 3 The information processing device 100 further includes a storage control unit 180. A part or all of the storage control unit 180 may also be implemented by a processing circuit. In addition, a part or all of the storage control unit 180 may also be implemented as a module of a program executed by the processor 101.

[0078] The storage control unit 180 stores the inspection result including the inspection date and time in the storage unit 110 .

[0079] According to Embodiment 3, information processing device 100 stores the inspection result. Thus, information processing device 100 can retain the fact that the inspection was performed.

[0080] Implementation 4

[0081] Next, Embodiment 4 will be described. In Embodiment 4, matters different from Embodiment 3 will be mainly described. In Embodiment 4, description of matters common to Embodiment 3 will be omitted.

[0082] In the third embodiment, the case where the inspection result is stored in the information processing device 100 is described. Here, the inspection result is based on the inspection result of the machine. The inspector also needs to use his own eyes to inspect. That is, the inspector also needs to use his own eyes to check whether the inspection result is correct. Therefore, in the fourth embodiment, the case of double checking is described.

[0083] In Embodiment 4, mobile terminal 200 is an HMD. Information processing device 100 transmits the inspection result to HMD. As a result, HMD displays the inspection result. FIG.

[0084] Fig.11 FIG. 4 is a diagram showing an example of displaying the inspection results according to the fourth embodiment. Fig.11 As shown, the inspection result is displayed on the display (also referred to as a display unit) of the HMD. For example, the state in which the switch 302 is turned on is displayed on the display.

[0085] The HMD is worn by the inspector. In addition, the inspector is also referred to as a user. The inspector can recognize the inspection result by visually recognizing the display. Here, the HMD has a camera unit. The camera unit can also be considered as a camera. In addition, the HMD has a detection unit. The detection unit detects via the camera unit that the inspector has seen the inspection result. In detail, the detection unit detects via the camera unit that the destination of the inspector's line of sight is the part where the inspection result is displayed. In addition, for example, the detection unit can also determine that the inspector has seen the inspection result when the inspector sees the inspection result for 0.5 seconds.

[0086] In addition, the HMD has an acquisition unit. The acquisition unit acquires positional relationship information indicating the positional relationship between the camera unit and the display. In addition, for example, the positional relationship information is stored in the storage unit of the HMD. In addition, the acquisition unit acquires line of sight information indicating the line of sight of the inspector. In addition, for example, the line of sight information is calculated based on information obtained from the camera unit. The detection unit detects the inspection object seen by the inspector based on the positional relationship information, the line of sight information, and the image obtained by the camera unit photographing the direction of the line of sight. For example, the detection unit detects that the inspector has seen the switch 302.

[0087] The HMD transmits information indicating that the inspector has seen the inspection result and information indicating the inspection object seen by the inspector to the information processing device 100 .

[0088] The acquisition unit 120 acquires information indicating that the inspector has viewed the inspection result and information indicating the inspection object viewed by the inspector.

[0089] Based on the information indicating that the inspector has seen the inspection result and the information indicating the inspection object seen by the inspector, the storage control unit 180 stores information indicating that a double check has been performed in the storage unit 110 when the object of the inspection result seen by the inspector (i.e., the inspection result displayed on the display) and the inspection object seen by the inspector (i.e., the inspection object detected by the detection unit) are consistent. For example, when the object "switch 302" of the inspection result displayed on the display and the inspection object "switch 302" seen by the inspector are consistent, the storage control unit 180 stores information indicating that a double check has been performed in the storage unit 110.

[0090] According to the fourth embodiment, the information processing device 100 can store the fact that the double check has been performed.

[0091] Implementation method 5

[0092] Next, Embodiment 5 will be described. In Embodiment 5, matters different from Embodiments 1 to 4 will be mainly described. In Embodiment 5, description of matters common to Embodiments 1 to 4 will be omitted.

[0093] In Embodiments 1 to 4, the case where information processing device 100 executes the main processing is described. In Embodiment 5, the case where a mobile terminal has the same function as information processing device 100 is described.

[0094] Fig.12 600 is a block diagram showing the functions of a mobile terminal according to Embodiment 5. For example, the mobile terminal 600 is a smartphone, a tablet terminal, or an HMD. The mobile terminal 600 is also called an information processing device.

[0095] The mobile terminal 600 includes a storage unit 610 , an acquisition unit 620 , a detection unit 630 , an association unit 640 , a state detection unit 650 , an output unit 660 , a generation unit 670 , a storage control unit 680 , an imaging unit 690 , and a display unit 691 .

[0096] The storage unit 610 may be realized as a storage area reserved in a volatile storage device or a nonvolatile storage device included in the mobile terminal 600 .

[0097] Part or all of the acquisition unit 620, the detection unit 630, the association unit 640, the state detection unit 650, the output unit 660, the generation unit 670, and the storage control unit 680 may be implemented by a processing circuit of the mobile terminal 600. In addition, part or all of the acquisition unit 620, the detection unit 630, the association unit 640, the state detection unit 650, the output unit 660, the generation unit 670, and the storage control unit 680 may be implemented as a module of a program executed by a processor of the mobile terminal 600.

[0098] For example, the camera unit 690 is implemented by a camera of the mobile terminal 600. For example, the display unit 691 is implemented by a display of the mobile terminal 600.

[0099] First, the function of the imaging unit 690 will be described. The imaging unit 690 captures an image of the disk 300 .

[0100] The functions of the acquisition unit 620, the detection unit 630, the association unit 640, the state detection unit 650, the generation unit 670, and the storage control unit 680 are the same as those of the acquisition unit 120, the detection unit 130, the association unit 140, the state detection unit 150, the generation unit 170, and the storage control unit 180. For example, the acquisition unit 620 acquires an image obtained by photographing the disk 300. In this way, the functions of the acquisition unit 620, the detection unit 630, the association unit 640, the state detection unit 650, the generation unit 670, and the storage control unit 680 are the same as those of the acquisition unit 120, the detection unit 130, the association unit 140, the state detection unit 150, the generation unit 170, and the storage control unit 180. Therefore, the description of the functions of the acquisition unit 620, the detection unit 630, the association unit 640, the state detection unit 650, the generation unit 670, and the storage control unit 680 is omitted.

[0101] The output unit 660 outputs the inspection result to the display unit 691. Thus, the display unit 691 displays the inspection result.

[0102] The mobile terminal 600 can implement the contents of the fourth embodiment. First, the display unit 691 displays the inspection result as the detection result. The detection unit 630 detects, via the camera unit 690, that the inspector has seen the inspection result. The acquisition unit 620 acquires positional relationship information indicating the positional relationship between the camera unit 690 and the display unit 691. In addition, the acquisition unit 620 acquires line of sight information indicating the line of sight of the inspector. The detection unit 630 detects the inspection object seen by the inspector based on the positional relationship information, the line of sight information, and the image obtained by photographing the direction of the line of sight by the camera unit 690. The acquisition unit 620 acquires information indicating that the inspector has seen the inspection result and information indicating the inspection object seen by the inspector. Based on the information indicating that the inspector has seen the inspection result and the information indicating the inspection object seen by the inspector, the storage control unit 680 stores the information indicating that the double check has been performed in the storage unit 610 when the object of the inspection result seen by the inspector (i.e., the inspection result displayed on the display unit 691) and the inspection object seen by the inspector (i.e., the inspection object detected by the detection unit 630) are consistent. In this way, the mobile terminal 600 can implement the content of the fourth embodiment.

[0103] According to the fifth embodiment, the mobile terminal 600 can achieve the same effects as those of the first to fourth embodiments.

[0104] The features in the above-described embodiments can be combined with each other as appropriate.

[0105] Description of symbols

[0106] 100: information processing device; 101: processor; 102: volatile storage device; 103: non-volatile storage device; 110: storage unit; 111: position table; 120: acquisition unit; 130: detection unit; 140: association unit; 150: state detection unit; 160: output unit; 170: generation unit; 180: storage control unit; 200: mobile terminal; 300: disk; 301: sign; 302-304: switch; 305-307: lamp; 308, 309: instrument; 400: image; 500: illustration reading device; 600: mobile terminal; 610: storage unit; 620: acquisition unit; 630: detection unit; 640: association unit; 650: state detection unit; 660: output unit; 670: generation unit; 680: storage control unit; 690: camera unit; 691: display unit.

Claims

1. An information processing device, comprising: An acquisition unit that acquires an image representing the disk including the name of the disk and the inspection object, and position information representing a correspondence relationship between the name of the disk, the position of the inspection object, and the name of the inspection object; A detection unit that detects the disk based on the image, detects the name of the disk from an image area representing the disk, and detects the position of the inspection object based on the image area representing the disk; as well as The associating unit associates the disk with the inspection object based on the name of the disk, the location of the inspection object, and the location information.

2. The information processing device according to claim 1, wherein: The information processing device further comprises: a state detection unit configured to detect a state of the inspection object in the image; and An output unit outputs a spot inspection result as a detection result.

3. The information processing device according to claim 2, wherein: The information processing device further comprises: an imaging unit that captures an image of the disk; and A display unit displays the inspection result.

4. The information processing device according to claim 2 or 3, wherein: The information processing device further comprises: a storage unit; and A storage control unit stores the inspection result in the storage unit.

5. The information processing device according to any one of claims 2 to 4, wherein: The information processing device further comprises: a storage unit; and Storage Control Unit, The acquisition unit acquires information indicating that the user has viewed the inspection result and information indicating the inspection object viewed by the user. The storage control unit stores information indicating that a double check was performed in the storage unit based on information indicating that the user has seen the inspection result and information indicating the inspection object seen by the user, if the object of the inspection result seen by the user is consistent with the inspection object seen by the user.

6. The information processing device according to any one of claims 1 to 5, wherein: The information processing device further includes a generating unit. The acquisition unit acquires a map representing the disk, The generating unit generates the position information based on a map representing the disk.

7. An auxiliary system, comprising: a mobile terminal having an imaging unit for imaging the disk including the name of the disk and the disk to be inspected; and information processing device, The information processing device comprises: an acquisition unit that acquires the image representing the disk generated by the mobile terminal, and acquires position information that is information indicating a correspondence between the name of the disk, the location of the inspection object, and the name of the inspection object; A detection unit that detects the disk based on the image, detects the name of the disk from within an image region representing the disk, and detects the position of the inspection object based on the image region representing the disk; and The associating unit associates the disk with the inspection object based on the name of the disk, the location of the inspection object, and the location information.

8. An auxiliary method, wherein: The information processing device obtains an image representing the disk including the name of the disk and the inspection object, and position information representing the correspondence between the name of the disk, the position of the inspection object, and the name of the inspection object, that is, position information, detects the disk based on the image, detects the name of the disk from an area of ​​the image representing the disk, and detects the position of the inspection object based on the area of ​​the image representing the disk. The information processing device associates the disk and the inspection object based on the name of the disk, the position of the inspection object, and the position information.

9. An auxiliary program causing an information processing device to execute the following processing: obtaining an image of the disk including the name of the disk and the inspection object and information indicating the correspondence between the name of the disk, the position of the inspection object and the name of the inspection object, i.e., position information; detecting the disk based on the image; detecting the name of the disk from an area of ​​the image representing the disk; and detecting the position of the inspection object based on the area of ​​the image representing the disk. The disk and the inspection object are associated with each other according to the name of the disk, the location of the inspection object and the location information.