INFORMATION PROCESSING FACILITY, SUPPORT SYSTEM, SUPPORT METHOD AND SUPPORT PROGRAM

Abstract

Information processing device (100), comprising: an acquisition unit (120) that acquires an image indicating an operation panel (300) having a name of the operation panel (300), and an inspection target and position information (111) as information indicating a correspondence relationship between the name of the operation panel, a position of the inspection target, and a name of the inspection target; a detection unit (130) that detects the operation panel (300) based on the image, detects the name of the operation panel (300) in an image area indicating the operation panel (300), and detects the position of the inspection target based on the image area indicating the operation panel (300); a linking unit (140) that links the operation panel (300) and the inspection target based on the name of the operation panel (300), the position of the inspection target, and the position information (111); a state detection unit (150) that detects a state of the inspection target in the image; an output unit (160) that outputs an inspection result as a detection result; a storage unit (110); and a memory control unit (180), wherein the acquisition unit (120) acquires information indicating that a user has viewed the inspection result and information indicating an inspection target viewed by the user, and when a target of the inspection result viewed by the user matches the inspection target viewed by the user based on the information indicating that the user has viewed the inspection result and the information indicating the inspection target viewed by the user, the storage control unit (180) stores information indicating that a double check has been performed in the storage unit (110).

Description

TECHNICAL FIELD

[0001] The present disclosure relates to an information processing device, a support system, a support method and a support program. STATE OF THE ART

[0002] In a facility such as a power plant, a control board or control panel, a power board or control panel, a distribution board or control panel, etc. are installed. These control panels are inspected routinely or at regular intervals. These control panels contain meters or similar devices. The meters or similar devices are inspection targets. A technology for extracting the display content of a meter was proposed here (see patent reference 1).

[0003] Patent Reference 2 discloses a portable information terminal comprising an imaging unit for accommodating a measuring device and an identification mark attached to a power supply device, a measuring unit for reading out a display value of the measuring device captured by the imaging unit, an identification mark reading unit for reading out identification information of the identification mark captured by the imaging unit, a document creating unit for creating a document in which the display value and the identification information are associated with each other, a storage unit for storing the document, and a display unit for displaying the document.

[0004] Patent Reference 3 discloses a monitoring device. This device comprises an image unit for capturing an image of a power device to be monitored, and a display unit on which the captured image is displayed. A recognition unit reads the name or status of a panel from the captured image. Detailed information about the panel, associated with its name and status, is stored in advance in a memory area. A display control unit retrieves the corresponding detailed information from the memory and displays it on the display unit.

[0005] Patent Reference 4 discloses a monitoring system. It reads a measuring device using a camera to monitor changes in the measuring device's measured values, which are detected by image processing. An image processor extracts an image of the measuring device as the monitoring object from the image information captured by the camera and detects the measured value displayed on the measuring device's display. A management unit collects the measured values ​​detected by the image processor via a network and generates time series information to monitor changes in the measuring device's measured values. REFERENCES TO THE STATE OF THE ART PATENT REFERENCES Patent Reference 1: Publication of Japanese Patent Application No. 2018-181232 Patent Reference 2: JP 2018 -45 655 A Patent Reference 3: JP 2019 - 57 041 A Patent reference 4: JP 2011 - 81 715 A SUMMARY OF THE INVENTION TASK TO BE SOLVED BY THE INVENTION

[0006] With the aforementioned technology, the content of an inspection target is extracted. However, the technology is unable to identify which control panel contains the inspection target whose content is being extracted. Therefore, an inspector must manually establish a link between each inspection target and the control panel containing the inspection target. The inspector performs the work of establishing the link using a computer, for example. The work performed by the inspector increases the inspector's workload.

[0007] An object of the present disclosure is to reduce the burden. MEANS TO SOLVED THE TASK

[0008] An information processing device according to one aspect of the present disclosure is provided. The information processing device includes an acquisition unit that acquires an image indicating an operation panel having a name of the operation panel, an inspection target, and position information as information indicating a correspondence relationship between the name of the operation panel, a position of the inspection target, and a name of the inspection target; an acquisition unit that acquires the operation panel based on the image, acquires the name of the operation panel in an image area indicating the operation panel, and acquires the position of the inspection target based on the image area indicating the operation panel; and a linking unit that links the operation panel and the inspection target based on the name of the operation panel, the position of the inspection target, and the position information. EFFECT OF THE INVENTION

[0009] According to the present disclosure, the load can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a diagram showing a support system in a first embodiment. Fig. 2 is a diagram showing the hardware included in an information processing device of the first embodiment. Fig. 3 is a block diagram showing functions of the information processing device in the first embodiment. Fig. 4 is a diagram showing an example of a position table in the first embodiment. Fig. 5 is a diagram showing an example of detecting an operation panel in the first embodiment. Fig. 6 is a diagram showing an example of an image of a link in the first embodiment. Fig. 7 is a flowchart showing an example of a process executed by the information processing device in the first embodiment. Fig. 8 is a diagram showing a support system in a second embodiment. Fig. 9 is a block diagram showing functions of an information processing device in the second embodiment. Fig. 10 is a block diagram showing functions of an information processing device in a third embodiment. Fig. 11 is a diagram showing an example of a case where an inspection result is displayed in a fourth embodiment. Fig. 12 is a block diagram showing functions of a mobile terminal in a fifth embodiment. MODE FOR CARRYING OUT THE INVENTION

[0010] Embodiments will be described below with reference to the drawings. The following embodiments are merely examples, and various modifications are possible within the scope of the present disclosure. First embodiment

[0011] Fig. Figure 1 is a diagram showing a support system in a first embodiment. The support system includes an information processing device 100 and a mobile terminal 200. The information processing device 100 and the mobile terminal 200 are connected to each other via a network.

[0012] Information processing device 100 is a device that executes a support process. Mobile terminal 200 is a device used by an inspector. Mobile terminal 200 is, for example, a smartphone, a tablet device, or a head-mounted display (HMD). Mobile terminal 200 includes an image capture unit.

[0013] In Fig. 1 shows an operating panel 300. The operating panel 300 is, for example, a control board, a power board, a distribution board, or the like. The operating panel 300 includes a label plate 301, switches 302 to 304, lamps 305 to 307, and counters 308 and 309.

[0014] The nameplate 301 contains the name of the control panel 300. Switches 302 to 304, lamps 305 to 307, and counters 308 and 309 are inspection targets.

[0015] The inspector photographs the operation panel 300 using the mobile terminal 200. The mobile terminal 200 then transmits an image indicating the operation panel 300 to the information processing device 100. The information processing device 100 automatically links the operation panel 300 and the inspection targets based on the image. This eliminates the need for the inspector to manually link each inspection target to the operation panel containing the inspection target. Accordingly, the information processing device 100 is able to reduce the inspector's workload.

[0016] The information processing device 100 is described in detail below.

[0017] First, hardware included in the information processing device 100 will be described below.

[0018] Fig. Figure 2 is a diagram showing the hardware included in the information processing device in the first embodiment. The information processing device 100 includes a processor 101, a volatile memory device 102, and a non-volatile memory device 103.

[0019] The processor 101 controls the information processing device 100 as a whole. The processor 101 is, for example, a central processing unit (CPU), a field-programmable gate array (FPGA), or the like. The processor 101 may also be a multiprocessor. The information processing device 100 may further include processing circuitry.

[0020] The volatile storage device 102 is a main memory of the information processing device 100. The volatile storage device 102 is, for example, a random access memory (RAM). The non-volatile storage device 103 is an auxiliary memory of the information processing device 100. The non-volatile storage device 103 is, for example, a hard disk drive (HDD) or a solid-state drive (SSD).

[0021] Next, functions included in the information processing device 100 are described below.

[0022] Fig. Figure 3 is a diagram showing the functions of the information processing device in the first embodiment. The information processing device 100 includes a storage unit 110, an acquisition unit 120, an acquisition unit 130, a linking unit 140, a state acquisition unit 150, and an output unit 160. Incidentally, the state acquisition unit 150 may also be referred to as an inspection unit.

[0023] The storage unit 110 may be implemented as a memory area reserved in the volatile memory device 102 or in the non-volatile memory device 103.

[0024] Part or all of the acquisition unit 120, the acquisition unit 130, the linking unit 140, the state acquisition unit 150, and the output unit 160 may be implemented by a processing circuit. Furthermore, part or all of the acquisition unit 120, the acquisition unit 130, the linking unit 140, the state acquisition unit 150, and the output unit 160 may be implemented as modules of a program executed by the processor 101. The program executed by the processor 101 is also referred to, for example, as a support program. The support program is recorded, for example, on a recording medium.

[0025] A position table can be stored in the storage unit 110. The position table is shown below.

[0026] Fig. 4 is a diagram showing an example of the position table of the first embodiment. For example, the position table 111 has been stored in the storage unit 110. The position table 111 is also referred to as position information. The position table 111 includes information indicating a correspondence relationship between the name of the operation panel, a position of an inspection target, and a name of the inspection target. The position table 111 will be explained in detail below. The position table 111 includes the items "operation panel name," "No.," "Type," "Position," and "Name." For example, the name of the operation panel is entered under the "operation panel name" item. The position of each inspection target is entered under the "Position" item. The name of each inspection target is entered under the "Name" item.

[0027] "No. 1" of the control panel name "ΔΔ Machine" indicates the position of the switch 302. For example, the position of the switch 302 is represented by a distance (i.e., X, Y) from an origin. In addition, the widths of the switch 302 are represented by W and H. Incidentally, the origin is a corner of the control panel 300.

[0028] The origin can also be the position of the label 301. The position of the inspection target can also be represented by coordinates of a central point of the inspection target. In short, the representation of the position of the inspection target can also be a different representation than the position in the position table 111 in Fig. 4. The position of the inspection target can also be represented, for example, by a ratio relative to the width of the control panel. Furthermore, the position of the inspection target can also be represented, for example, by the coordinates of four corners of the inspection target. The position of the inspection target can also be represented, for example, by a circle composed of the coordinates of the center point and a radius. The position of the inspection target can also be represented by an area of ​​the inspection target. Furthermore, the unit of the position can be a physical length such as cm or m.

[0029] The acquisition unit 120 acquires the image generated by the mobile terminal 200.

[0030] Procurement unit 120 acquires position table 111. Procurement unit 120 acquires position table 111, for example, from storage unit 110. Alternatively, procurement unit 120 acquires position table 111, for example, from an external facility. The representation of the external facility is omitted.

[0031] The detection unit 130 detects the operation panel 300 based on the image. For example, the detection unit 130 detects the operation panel 300 based on the image and a learned model. Alternatively, the detection unit 130 detects the operation panel 300 based on, for example, the image and the information indicating the shape of the operation panel 300. Incidentally, the learned model and the information indicating the shape of the operation panel 300 can be stored in the storage unit 110 or an external device. An example of detecting the operation panel 300 is described below.

[0032] Fig. Fig. 5 is a diagram showing an example of detecting the control panel in the first embodiment. Image 400 is the image generated by the mobile terminal 200. As shown in Fig. As shown in Figure 5, the detection unit 130 detects the control panel 300. Specifically, the detection unit 130 detects the shape of the control panel 300. That is, the detection unit 130 detects a rectangle. Alternatively, the detection unit 130 can also detect four points representing the four corners of the control panel 300.

[0033] The acquisition unit 130 acquires the name of the control panel 300 in an image area indicating the control panel 300. Specifically, the acquisition unit 130 performs character recognition in the image area of ​​the control panel 300. When performing character recognition, the acquisition unit 130 may use optical character recognition (OCR). As a result, the acquisition unit 130 acquires the name "ΔΔ Machine" of the control panel 300 indicated on the name plate 301.

[0034] The detection unit 130 detects the position of each inspection target based on the image area indicating the control panel 300. Specifically, the detection unit 130 is capable of detecting the position of the inspection target by detecting the inspection target using object recognition technology. Thus, the detection unit 130 detects the positions of the switch 302 and the like. Furthermore, the position can be represented as the detection result by a corner and width of the inspection target, as shown in Fig. 4 shown.

[0035] The linking unit 140 links the operation panel 300 and each inspection target based on the name of the operation panel 300, the position of each inspection target, and the position table 111. Specifically, the linking unit 140 identifies the name "ΔΔ Machine" of the operation panel 300 from the "Operation Panel Name" field in the position table 111. The linking unit 140 identifies the name of each inspection target based on the records of the "Position" in the "ΔΔ Machine" in the position table 111 and the position of the inspection target. The linking unit 140 links the name "ΔΔ Machine" of the operation panel 300 and the name of the inspection target. An image of the linkage is shown below.

[0036] Fig. Fig. 6 is a diagram showing an example of the link image in the first embodiment. As shown in Fig. As shown in Figure 6, the control panel 300 and the inspection targets are linked.

[0037] The state detection unit 150 detects the state of each inspection target in the image. Specifically, the state detection unit 150 detects the state of each inspection target using image analysis technology or a learned model. Specifically, the state detection unit 150 detects whether a switch is in an ON or OFF state. The state detection unit 150 also detects whether a lamp is flashing or not. Furthermore, the state detection unit 150 detects a value indicated by a counter.

[0038] The output unit 160 outputs an inspection result as a detection result to the mobile terminal 200. Accordingly, the inspector can check the state of each inspection target via the mobile terminal 200. Incidentally, the inspection result is information in which, for example, the name "ΔΔ machine" of the operation panel 300, the name "OO switch" of an inspection target, and the state "ON" of the inspection target are linked together.

[0039] A process executed by the information processing device 100 will be described below using a flowchart.

[0040] Fig. 7 is a flowchart showing an example of the process executed by the information processing device in the first embodiment. (Step S11) The acquisition unit 120 acquires the image generated by the mobile terminal 200. (Step S12) The detection unit 130 detects the operation panel 300 based on the image. (Step S13) The acquisition unit 130 acquires the name of the operation panel 300 from the image. (Step S14) The detection unit 130 detects the position of an inspection target from the image. (Step S15) The linking unit 140 links the operation panel 300 and the inspection target based on the name of the operation panel 300, the position of the inspection target, and the position table 111. (Step S16) The state detecting unit 150 detects the state of the inspection target on the image. (Step S17) The output unit 160 outputs the inspection result to the mobile terminal 200.

[0041] According to the first embodiment, the information processing device 100 links the operation panel 300 and the inspection targets. Thus, the inspector no longer needs to manually establish the link between each inspection target and the operation panel containing the inspection target. Accordingly, the information processing device 100 is able to reduce the inspector's workload. Second embodiment

[0042] A second embodiment is described below. In the second embodiment, the features that differ from those of the first embodiment are primarily described. In the second embodiment, the description of features that are the same as those of the first embodiment is omitted.

[0043] Fig. Figure 8 is a diagram showing a support system in the second embodiment. The support system may include an information processing device 100, a mobile terminal 200, and a drawing reader 500.

[0044] The drawing reading device 500 reads a design drawing of the control panel 300 (ie, a paper medium). The drawing reading device 500 can transmit a drawing of the control panel 300 obtained by reading the design drawing to the information processing device 100. Furthermore, the drawing reading device 500 can be integrated into the mobile terminal 200.

[0045] Fig. Fig. 9 is a block diagram showing functions of the information processing device in the second embodiment. Each component in Fig. 9, which is in Fig. 3, the same reference symbol is used as in Fig. 3. The information processing device 100 also includes a generating unit 170. Part or all of the generating unit 170 can be realized by processing circuits. Furthermore, part or all of the generating unit 170 can be implemented as a module of a program executed by the processor 101.

[0046] The acquisition unit 120 may acquire the drawing indicating the operation panel 300 from the drawing reading device 500. Here, the information processing device 100 may have a drawing reading function. If the information processing device 100 has the drawing reading function, the acquisition unit 120 acquires a drawing indicating the operation panel 300 read by the information processing device 100.

[0047] Furthermore, the procurement unit 120 can obtain a CAD (computer-aided design) drawing as a design drawing of the control panel 300. The CAD drawing is the drawing that specifies the control panel 300. The procurement unit 120 obtains the CAD drawing, for example, from the storage unit 110.

[0048] The generation unit 170 generates the position table 111 based on the drawing indicating the operation panel 300. The output unit 160 outputs the position table 111 to the storage unit 110 or an external device.

[0049] In the second embodiment, the position table 111 is generated automatically. This relieves the inspector from performing, for example, the work of generating the position table 111. Accordingly, the information processing device 100 is able to reduce the inspector's workload. Third embodiment

[0050] Next, a third embodiment will be described below. In the third embodiment, description will be given mainly of features different from those in the first embodiment. In the third embodiment, description of features common to the first embodiment will be omitted.

[0051] In the first embodiment, the case where the inspection result is output was described. After the inspection result is output to the mobile terminal 200, the inspection result disappears from the information processing device 100. As a result, the fact that the inspection was performed is lost. Therefore, in the third embodiment, a case where the inspection result is stored in the information processing device 100 will be described.

[0052] Fig. Figure 10 is a block diagram showing functions of the information processing device in the third embodiment. Each component in Fig. 10, which have a Fig. 3, the same reference symbol is used as in Fig. 3. The information processing device 100 also includes a memory control unit 180. Part or all of the memory control unit 180 may be implemented by processing circuits. Furthermore, part or all of the memory control unit 180 may be implemented as a module of a program executed by the processor 101.

[0053] The storage control unit 180 stores an inspection result including inspection date and time in the storage unit 110.

[0054] According to the third embodiment, the information processing device 100 stores the inspection result. Therefore, the information processing device 100 is capable of storing the fact that the inspection was performed. Fourth embodiment

[0055] A fourth embodiment will be described below. In the fourth embodiment, the features that are different from those of the third embodiment will be described primarily. In the fourth embodiment, the description of features that are the same as those of the third embodiment will be omitted.

[0056] In the third embodiment, a case was described where the inspection result is stored in the information processing device 100. The inspection result here is the result of a machine inspection. The inspector must also perform the inspection using their own eyes. In short, the inspector must also verify with their own eyes whether the inspection result is correct or not. Therefore, in the fourth embodiment, a case where a double check is performed will be described.

[0057] In the fourth embodiment, the mobile terminal 200 is an HMD. The information processing device 100 transmits the inspection result to the HMD. Accordingly, the HMD displays the inspection result. A case where the HMD displays the inspection result is shown below.

[0058] Fig. Fig. 11 is a diagram showing an example of the case where the inspection result is displayed in the fourth embodiment. As shown in Fig. As shown in Figure 11, the inspection result is displayed on a display (e.g., also referred to as a display unit) of the HMD. The display indicates, for example, that switch 302 is in the ON state.

[0059] The HMD was attached to the inspector. The inspector is also referred to as the user. The inspector is able to recognize the inspection result by viewing the display. Here, the HMD includes the image acquisition unit. The image acquisition unit can be regarded as a camera. In addition, the HMD includes a detection unit. The detection unit detects through the image acquisition unit that the inspector has viewed the inspection result. Specifically, the detection unit detects through the image acquisition unit that the end of the inspector's line of sight is a position where the inspection result is currently displayed. Furthermore, the detection unit can judge that the inspector has viewed the inspection result if the inspector has viewed the inspection result for, for example, 0.5 seconds.

[0060] The HMD also includes an acquisition unit. The acquisition unit acquires positional relationship information indicating a positional relationship between the image acquisition unit and the display. Incidentally, the positional relationship information is stored, for example, in a storage unit of the HMD. Furthermore, the acquisition unit acquires line-of-sight information indicating the inspector's line of sight. Incidentally, the line-of-sight information is calculated based on information acquired, for example, by the image acquisition unit. The acquisition unit acquires an inspection target viewed by the inspector based on the positional relationship information, the line-of-sight information, and an image obtained by the image acquisition unit by photographing the process in the direction of the line of sight. For example, the acquisition unit acquires that the inspector viewed the switch 302.

[0061] The HMD transmits to the information processing device 100 information indicating that the inspector has viewed the inspection result and information indicating which inspection target the inspector has viewed.

[0062] The acquisition unit 120 acquires the information indicating that the inspector has viewed the inspection result and the information indicating the inspection target that the inspector has viewed.

[0063] When the target of the inspection result viewed by the inspector (i.e., the inspection result displayed by the display unit) matches the inspection target viewed by the inspector (i.e., the inspection target acquired by the acquisition unit) based on the information indicating that the inspector viewed the inspection result and the information indicating the inspection target viewed by the inspector, the storage control unit 180 stores information indicating that the double check was performed in the storage unit 110. For example, the storage control unit 180 stores the information indicating that the double check was performed in the storage unit 110 when the target "switch 302" of the inspection result displayed on the display matches the inspection target "switch 302" viewed by the inspector.

[0064] According to the fourth embodiment, the information processing device 100 is capable of storing the fact that the double check has been performed. Fifth embodiment

[0065] Next, a fifth embodiment will be described. In the fifth embodiment, features different from those of the first to fourth embodiments will be mainly described. In the fifth embodiment, descriptions of features common to the first to fourth embodiments will be omitted.

[0066] In the first to fourth embodiments, cases where the information processing device 100 performs main processing were described. In the fifth embodiment, a case where the mobile terminal has the same functions as the information processing device 100 is described.

[0067] Fig.Figure 12 is a block diagram showing functions of the mobile terminal in the fifth embodiment. Mobile terminal 600 is, for example, a smartphone, a tablet terminal, or an HMD. Mobile terminal 600 is also referred to as an information processing device.

[0068] The mobile terminal 600 includes a storage unit 610, an acquisition unit 620, a detection unit 630, a linking unit 640, a state detection unit 650, an output unit 660, a generation unit 670, a storage control unit 680, an image acquisition unit 690, and a display unit 691.

[0069] The storage unit 610 may be implemented as a storage area provided in a volatile storage device or a non-volatile storage device included in the mobile terminal 600.

[0070] Part or all of the acquisition unit 620, the acquisition unit 630, the linking unit 640, the state acquisition unit 650, the output unit 660, the generation unit 670, and the storage control unit 680 may be implemented by a processing circuit included in the mobile terminal 600. Furthermore, part or all of the acquisition unit 620, the acquisition unit 630, the linking unit 640, the state acquisition unit 650, the output unit 660, the generation unit 670, and the storage control unit 680 may be implemented as modules of a program executed by a processor included in the mobile terminal 600.

[0071] The image capture unit 690 is implemented, for example, by a camera of the mobile terminal 600. The display unit 691 is implemented, for example, by a display device of the mobile terminal 600.

[0072] First, the function of the image capture unit 690 is described. The image capture unit 690 captures an image of the control panel 300.

[0073] The functions of the acquisition unit 620, the detection unit 630, the linking unit 640, the state detection unit 650, the generation unit 670, and the storage control unit 680 correspond to the functions of the acquisition unit 120, the detection unit 130, the linking unit 140, the state detection unit 150, the generation unit 170, and the storage control unit 180. The acquisition unit 620 acquires, for example, an image obtained by photographing the operation panel 300. As described above, the functions of the acquisition unit 620, the acquisition unit 630, the linking unit 640, the state acquisition unit 650, the generation unit 670, and the storage control unit 680 correspond to the functions of the acquisition unit 120, the acquisition unit 130, the linking unit 140, the state acquisition unit 150, the generation unit 170, and the storage control unit 180.Thus, the description of the functions of the procurement unit 620, the acquisition unit 630, the linking unit 640, the status acquisition unit 650, the generation unit 670 and the storage control unit 680 is omitted.

[0074] The output unit 660 outputs the inspection result to the display unit 691. Accordingly, the display unit 691 displays the inspection result.

[0075] The mobile terminal 600 is capable of implementing the contents of the fourth embodiment. First, it is assumed that the display unit 691 displays the inspection result as the detection result. The detection unit 630 detects, via the image acquisition unit 690, that the inspector has viewed the inspection result. The acquisition unit 620 acquires the positional relationship information indicating the positional relationship between the image acquisition unit 690 and the display unit 691. Furthermore, the acquisition unit 620 acquires the line-of-sight information indicating the inspector's line of sight. The detection unit 630 detects an inspection target viewed by the inspector based on the positional relationship information, the line-of-sight information, and an image obtained by the image acquisition unit 690 by photographing the process in the direction of the line of sight.The acquisition unit 620 acquires the information indicating that the inspector has viewed the inspection result and the information indicating the inspection target that the inspector viewed. When the target of the inspection result viewed by the inspector (i.e., the inspection result displayed by the display unit 691) matches the inspection target viewed by the inspector (i.e., the inspection target acquired by the acquisition unit 630) based on the information indicating that the inspector has viewed the inspection result and the information indicating the inspection target viewed by the inspector, the storage control unit 680 stores the information indicating that the double check has been performed in the storage unit 610. As described above, the mobile terminal 600 is capable of implementing the contents of the fourth embodiment.

[0076] According to the fifth embodiment, the mobile terminal 600 achieves the same effects as the first to fourth embodiments.

[0077] Features in the embodiments described above can be combined with each other in a suitable manner. DESCRIPTION OF REFERENCE SYMBOLS

[0078] 100: Information processing device, 101: Processor, 102: Volatile storage device, 103: Non-volatile storage device, 110: Storage unit, 111: Position table, 120: Acquisition unit, 130: Detection unit, 140: Linking unit, 150: State detection unit, 160: Output unit, 170: Generation unit, 180: Storage control unit, 200: Mobile terminal, 300: Control panel, 301: Name plate, 302 - 304: Switch, 305 - 307: Lamp, 308, 309: Counter, 400: Image, 500: Drawing reader, 600: Mobile terminal, 610: Storage unit, 620: Acquisition unit, 630: Detection unit, 640: Linking unit, 650: State acquisition unit, 660: Output unit, 670: Generation unit, 680: Memory control unit, 690: Image acquisition unit, 691: Display unit

Claims

[1] Information processing device (100), comprising: an acquisition unit (120) that acquires an image indicating an operation panel (300) having a name of the operation panel (300), and an inspection target and position information (111) as information indicating a correspondence relationship between the name of the operation panel, a position of the inspection target, and a name of the inspection target; a detection unit (130) that detects the operation panel (300) based on the image, detects the name of the operation panel (300) in an image area indicating the operation panel (300), and detects the position of the inspection target based on the image area indicating the operation panel (300); a linking unit (140) that links the operation panel (300) and the inspection target based on the name of the operation panel (300), the position of the inspection target, and the position information (111); a state detection unit (150) that detects a state of the inspection target in the image; an output unit (160) that outputs an inspection result as a detection result; a storage unit (110); and a memory control unit (180), wherein the acquisition unit (120) acquires information indicating that a user has viewed the inspection result and information indicating an inspection target viewed by the user, and when a target of the inspection result viewed by the user matches the inspection target viewed by the user based on the information indicating that the user has viewed the inspection result and the information indicating the inspection target viewed by the user, the storage control unit (180) stores information indicating that a double check has been performed in the storage unit (110). [2] Information processing device (600) according to claim 1, further comprising: an image capture unit (690) that captures an image of the control panel (300); and a display unit (691) that displays the inspection result. [3] The information processing device according to claim 1 or 2, wherein the storage control unit (180) stores the inspection result in the storage unit (110). [4] Information processing device according to one of claims 1 to 3, further comprising a generating unit (170), wherein the procurement unit (120) procures a drawing indicating the control panel (300), and the generating unit (170) generates the position information (111) based on the drawing indicating the operation panel (300). [5] Support system, including: a mobile terminal (200) comprising an image capturing unit that captures an image of an operation panel (300) including a name of the operation panel (300) and an inspection target; and an information processing device (100), wherein the information processing device (100) comprises: an acquisition unit (120) that acquires an image generated by the mobile terminal (300) and indicating the operation panel (300), and acquires position information (111) as information indicating a correspondence relationship between the name of the operation panel, a position of the inspection target, and a name of the inspection target; a detection unit (130) that detects the operation panel (300) based on the image, detects the name of the operation panel (300) in an image area indicating the operation panel (300), and detects the position of the inspection target based on the image area indicating the operation panel (300); a linking unit (140) that links the operation panel (300) and the inspection target based on the name of the operation panel (300), the position of the inspection target, and the position information (111); a state detection unit (150) that detects a state of the inspection target in the image; an output unit (160) that outputs an inspection result as a detection result; a storage unit (110); and a memory control unit (180), where the acquisition unit (120) acquires information indicating that a user has viewed the inspection result and information indicating an inspection target viewed by the user, and when a target of the inspection result viewed by the user matches the inspection target viewed by the user based on the information indicating that the user has viewed the inspection result and the information indicating the inspection target viewed by the user, the storage control unit (180) stores information indicating that a double check has been performed in the storage unit (110). [6] A support method performed by an information processing device (100) having a storage unit (110), the support method comprising: Acquiring an image indicating an operation panel (300) having a name of the operation panel (300) and an inspection target and position information (111) as information indicating a correspondence relationship between the name of the operation panel (300), a position of the inspection target, and a name of the inspection target, detecting the operation panel (300) based on the image, detecting the name of the operation panel (300) in an image area indicating the operation panel, detecting the position of the inspection target based on the image area indicating the operation panel (300); Linking the operation panel (300) and the inspection target based on the name of the operation panel (300), the position of the inspection target and the position information (111); capturing a state of the inspection target in the image; Outputting an inspection result as a recording result; Obtaining information indicating that a user has viewed the inspection result and information indicating an inspection target viewed by the user; and when a target of the inspection result viewed by the user matches the inspection target viewed by the user based on the information indicating that the user has viewed the inspection result and the information indicating the inspection target viewed by the user, storing information indicating that a double check has been performed in the storage unit (110). [7] A support program that causes an information processing device (100) having a storage unit (110) to perform an operation, comprising: Acquiring an image indicating an operation panel (300) having a name of the operation panel (300), and an inspection target and position information (111) as information indicating a correspondence relationship between the name of the operation panel (300), a position of the inspection target, and a name of the inspection target, detecting the operation panel (300) based on the image, detecting the name of the operation panel (300) in an image area indicating the operation panel (300), detecting the position of the inspection target based on the image area indicating the operation panel (300), Linking the control panel (300) and the inspection target based on the name of the control panel (300), the position of the inspection target and the position information (111), Capturing a state of the inspection target in the image, Output of an inspection result as a recording result, Obtaining information indicating that a user has viewed the inspection result and information indicating an inspection target viewed by the user, and when a target of the inspection result viewed by the user matches the inspection target viewed by the user based on the information indicating that the user has viewed the inspection result and the information indicating the inspection target viewed by the user, storing information indicating that a double check has been performed in the storage unit (110).

Images