Apparatus, method, and recording medium

Abstract

An apparatus, a method, and a recording medium. The present invention provides an apparatus having: a storage section that stores, at each position on a tour route, an inspection target instrument in a plant that a tourer should visually check; a position acquisition section that acquires the position of the tourer on the tour route; a first detection section that detects a visual target instrument that the tourer visually sees; and an alarm section that outputs an alarm signal for the visual target instrument in accordance with a case where the inspection target instrument corresponding to the position of the tourer on the tour route is not detected as the visual target instrument.

Description

Technical Field

[0001] This invention relates to an apparatus, a method, and a recording medium. Background Technology

[0002] Patent document 1 describes "detecting the user's line of sight and controlling information communication with other communication instruments".

[0003] Patent Document 1: Japanese Patent Application Publication No. 2016-177565 Summary of the Invention

[0004] In a first aspect of the present invention, an apparatus is provided. The apparatus may include a storage unit that stores, at each location along a patrol route, the instruments within the workshop that should be visually inspected by the inspector. The apparatus may include a location acquisition unit that acquires the location of the inspector along the patrol route. The apparatus may include a first detection unit that detects the visually inspectable instruments seen by the inspector. The apparatus may include an alarm unit that outputs an alarm signal for the visually inspectable instrument if no visually inspectable instrument corresponding to the inspector's location on the patrol route is detected.

[0005] The alarm unit may include a notification unit that informs the patrol personnel of the alarm signal when it is output. The alarm unit may also include an output control unit that stops the output of the alarm signal if the patrol personnel who received the notification cancel the output of the alarm signal.

[0006] The device may also include a second detection unit that detects the brainwaves of the patroller. The storage unit may also store the baseline brainwaves of the patroller at each location along the patrol route. The alarm unit may output an alarm signal if no visual target instrument corresponding to the patroller's location on the patrol route is detected, and if the difference between the patroller's brainwaves and the baseline brainwaves exceeds an acceptable value.

[0007] The device may also include a third detection unit that detects whether the inspector has performed a perceptual inspection based on at least one of the senses, including hearing, smell, and touch. The device may also include a fourth detection unit that detects instruments among a plurality of instruments in the workshop that have undergone sensory inspection using perceptual perception. The storage unit may also store inspection locations along the inspection route where the inspector should perform sensory inspections using perceptual perception. The alarm unit may also output an alarm signal for the instruments detected by the fourth detection unit based on whether the inspector has performed a perceptual inspection at a location different from the inspection location.

[0008] The device may include a camera unit that captures images of the inspector's field of vision. The device may also include an image analysis unit that detects the inspector's hands and various instruments within the workshop within the images captured by the camera unit. A third detection unit can detect tactile perception based on whether the inspector's hand overlaps with an instrument. A fourth detection unit can detect instruments that overlap with the inspector's hand.

[0009] The first inspection unit can be worn by the inspector.

[0010] The alarm unit can be worn by the inspector and send the alarm signal to the workshop management center.

[0011] The alarm unit can be configured at the workshop management center to output alarm signals.

[0012] In a second aspect of the invention, a method is provided. The method may include a storage phase in which the inspector stores the instruments within the workshop that should be visually inspected at each location along the inspection route. The method may include a location acquisition phase in which the location of the inspector along the inspection route is acquired. The method may include a first detection phase in which the visually inspected instruments seen by the inspector are detected. The method may include an alarm phase in which an alarm signal is output for the visually inspected instruments if no inspected instrument corresponding to the inspector's location on the inspection route is detected as a visually inspected instrument.

[0013] In a third aspect of the present invention, a recording medium for recording a program is provided.

[0014] The program can enable the computer to function as a storage unit, which stores the instruments in the workshop that the inspector should visually inspect at each location along the inspection route.

[0015] The program can function as a location acquisition unit, which acquires the location of the inspector along the inspection route. The program can also function as a first detection unit, which detects visually observable instruments within the inspector's field of vision. Finally, the program can function as an alarm unit, which outputs an alarm signal for the visually observable instrument if no such instrument is detected that corresponds to the inspector's location along the inspection route.

[0016] Furthermore, the above description of the invention does not list all the essential features of the invention. Additionally, combinations of the above-described feature sets can also constitute an invention. Attached Figure Description

[0017] Figure 1This refers to the security management system 1 involved in this embodiment.

[0018] Figure 2 Terminal 2 indicates the inspection terminal.

[0019] Figure 3 This describes the appearance of the inspection terminal 2.

[0020] Figure 4 This indicates actions related to the visual object instrument 11(M).

[0021] Figure 5 This refers to actions related to the perceived object instrument 11(T).

[0022] Figure 6 Examples of computer 2200 that can embody all or part of the various aspects of the present invention are shown. Detailed Implementation

[0023] The present invention will now be described through embodiments thereof, which do not limit the invention as defined in the claims. Furthermore, not all combinations of the features described in the embodiments are essential to the inventive solution.

[0024] [1. Structure of Security Management System 1]

[0025] Figure 1 This refers to the security management system 1 involved in this embodiment. The security management system 1 performs security management in the workshop and has multiple instruments 11, security terminals 12, patrol terminals 2, operation control devices 15, interface devices 16, and resource management devices 17.

[0026] Here, as a workshop, in addition to industrial workshops such as chemical workshops, there are also workshops for managing and controlling wellheads and their surroundings in gas fields and oil fields, workshops for managing and controlling power generation from hydropower, thermal power, and nuclear power, workshops for managing and controlling environmental resource power generation from solar energy and wind power, and workshops for managing and controlling water supply and drainage, dams, etc. Various instruments 11, security terminals 12, and inspection terminals 2 can be configured at the site of the execution process within the workshop. For example, there are piping for the flow of the fluid being measured and flow meters installed on the piping to measure the flow rate of the fluid. Operation control devices 15, interface devices 16, and resource management devices 17 can be configured in the workshop's management center 10.

[0027] [1-1. Instrument 11]

[0028] The multiple instruments 11 are appliances, machines, or devices. For example, they can be sensors that measure physical quantities such as pressure, temperature, pH, speed, and flow rate in a workshop process; actuators such as valves, flow control valves, on / off valves, pumps, fans, motors, heating devices, and cooling devices that control any physical quantity; audio instruments such as microphones and speakers that collect abnormal noises in the workshop or emit alarm sounds; position detection instruments that output position information from each instrument; piping for fluid flow; or other instruments. The types of the multiple instruments 11 can be different, and at least some of the two or more types of instruments 11 can be the same.

[0029] Each instrument 11 can be connected to the operation control device 15 via the control network 100 in a wired or wireless manner. Communication within the control network 100 can be digital communication or a hybrid communication that superimposes digital signals and analog signals (such as 4-20mA signals), with speeds ranging from approximately 1000bps to 10000bps (e.g., 1200bps, 2400bps). Communication within the control network 100 can be based on wireless communication protocols of the ISA (International Society of Automation), such as ISA100, HART (Highway Addressable Remote Transducer), BRAIN, FOUNDATION Fieldbus, PROFIBUS, etc.

[0030] Each instrument 11 may have inherent identification information (also known as instrument-specific information). Instrument-specific information is information used to uniquely identify the instrument. In this embodiment, as an example, it may be at least one of the following: a serial number assigned to the instrument 11 based on a communication protocol (HART as an example), a serial number set by the manufacturer of the instrument 11, and an instrument ID.

[0031] [1-2. Security Terminal 12]

[0032] The security terminal 12 accesses the setting parameters of the instrument 11 to reference, set, and change the setting parameter values. The security terminal 12 can be a handheld terminal (HHT) carried by the field operator (for example, a smartphone or tablet PC), or a desktop PC. When the security terminal 12 is a handheld terminal, it can be connected to the instrument 11 in a detachable manner.

[0033] [1-3. Inspection Terminal 2]

[0034] Inspection terminal 2 is an example of a device used for inspections within the workshop. Inspection terminal 2 can wirelessly communicate with at least one of the following: the operation control device 15, the interface device 16, or the resource management device 17 of the management center 10. Furthermore, inspection terminal 2 will be described in detail below.

[0035] [1-4. Operation control device 15]

[0036] The operation control device 15 communicates with each instrument 11 to control the process. For example, the operation control device 15 acquires process values ​​as measurement data from the instrument 11, which acts as a sensor, and drives the instrument 11, which acts as an actuator. Furthermore, the operation control device 15 can supply the process values ​​to the interface device 16 and receive target values ​​of the process values ​​from the interface device 16. In this embodiment, as an example, a single operation control device 15 is described to control all instruments 11 in the security management system 1; however, multiple operation control devices 15 can be used to separately control a portion of the instruments 11. As an example, the operation control device 15 can be an FCS (Field Control Station).

[0037] [1-5. Interface Device 16]

[0038] Interface device 16 facilitates communication between the manager and the workshop. Interface device 16 can control the workshop processes via operation control device 15 based on the manager's operations. For example, interface device 16 can receive process values ​​from operation control device 15 and supply target values ​​of the process values ​​to operation control device 15. Furthermore, interface device 16 can change the set parameter values ​​of instrument 11 via operation control device 15. Additionally, interface device 16 can store the set parameter values ​​of at least some instruments 11 in association with them. As an example, interface device 16 can be a Human Interface Station (HIS) or a PC, etc.

[0039] [1-6. Resource Management Device 17]

[0040] Resource management device 17 performs online monitoring and centralized management of the workshop. For example, resource management device 17 can manage information from instrument 11 acquired by operation control device 15 (such as set parameter values ​​and process values). As an example, resource management device 17 can be composed of a PC or the like.

[0041] [2. Inspection Terminal 2]

[0042] Figure 2This refers to inspection terminal 2. Inspection terminal 2 is used by inspectors who patrol the workshop along a predetermined inspection route. The inspection route can be set so that the inspector can visually identify each instrument 11 (also called the inspection target instrument 11(K)) among the multiple instruments 11 in the workshop that should be visually inspected.

[0043] The patrol terminal 2 includes a communication unit 20, an input unit 21, a storage unit 22, a camera unit 23, an image analysis unit 24, a perception detection unit 25, a location acquisition unit 26, an instrument detection unit 27, a brainwave detection unit 28, and an alarm unit 29. Furthermore, in the structure of the patrol terminal 2, at least the camera unit 23, image analysis unit 24, perception detection unit 25, location acquisition unit 26, instrument detection unit 27, and brainwave detection unit 28 can be worn by the patrol personnel. In this embodiment, as an example, each component of the patrol terminal 2 is worn by the patrol personnel.

[0044] [2-1. Communications Department 20]

[0045] The communication unit 20 communicates wirelessly with at least one of the operation control device 15, interface device 16, or resource management device 17 of the management center 10.

[0046] [2-2. Input Section 21]

[0047] Input unit 21 receives input from the inspector. For example, the results of inspections conducted during the inspection can be input to input unit 21. Input unit 21 can supply the input content to storage unit 22, etc. Input unit 21 can receive input based on physical keys or other keys, and can also receive input based on voice input.

[0048] [2-3. Storage Section 22]

[0049] Storage Department 22: Inspections to be performed by storage inspectors.

[0050] For example, the storage unit 22 can store the instruments 11(K) to be visually inspected at each location along the inspection route. The storage unit 22 can store the instrument-specific information of the instrument 11(K) to be visually inspected at each location in a manner associated with the location information representing each location along the inspection route. The correspondence between locations along the inspection route and the instruments 11(K) to be inspected can be set by a skilled inspector; for example, it can be set based on the instruments 11 visually inspected by the skilled inspector during the inspection and the inspector's position during the visual inspection. In this embodiment, as an example, the location information represents latitude and longitude obtained from GPS satellites; however, other information can also be represented as long as the location within the workshop is uniquely determined.

[0051] In addition, the storage unit 22 can also store the inspection locations along the inspection route where sensory inspections using at least one of the senses, including hearing, smell, and touch, should be performed. The storage unit 22 can also store the types of sensory perceptions that should be performed at each location and the instruments 11 that are the objects of sensory inspections, in a manner associated with location information representing each location on the inspection route.

[0052] In addition to the content to be checked, the storage unit 22 can also store other information.

[0053] For example, the storage unit 22 can also store the reference brainwave of the inspector at each location on the inspection route. In this embodiment, as an example, the storage unit 22 can store the reference brainwave at each location in a manner associated with location information representing each location on the inspection route. When the inspector inspects the inspection route while all instruments 11 in the workshop are functioning normally, the reference brainwave can represent the brainwaves measured at each location on the inspection route. The reference brainwave can represent patterns of basic rhythms (also known as background brainwaves) such as alpha waves and beta waves. The reference brainwave can be different for each inspector using the inspection terminal 2.

[0054] In addition, the storage unit 22 can also store location information indicating the installation location of each instrument 11 in the workshop, as well as identification data for visually identifying the instrument 11. The identification data can be image data of the instrument 11's appearance, data representing appearance features (such as color, button configuration, etc.), or data representing the product name, model number, and inherent instrument information set on the exterior of the instrument 11. The product name, model number, and inherent instrument information can be the product name, model number, and inherent instrument information themselves, or codes such as barcodes or QR codes (such as registered trademarks), and can be affixed to the instrument 11 by at least one of the following methods: pasting, printing, or engraving.

[0055] In addition, the storage unit 22 can also store the results of inspections performed by the inspector (in this embodiment, visual inspection and sensory inspection are examples of such inspections). For example, the storage unit 22 can store the inspection results input from the input unit 21. As an example, the storage unit 22 can store the inspection results of visual inspections in association with the instrument 11 to which the inspection is performed. In addition, the storage unit 22 can store the inspection results of sensory inspections in association with the location where the inspection was performed and the instrument 11 to which the inspection is performed.

[0056] [2-4. Filming Section 23]

[0057] The imaging unit 23 captures images of the inspector's field of vision. The imaging unit 23 can then supply the captured images (also called captured images) to the image analysis unit 24.

[0058] [2-5. Image Analysis Unit 24]

[0059] The image analysis unit 24 analyzes the images captured by the imaging unit 23.

[0060] The image analysis unit 24 can detect each instrument 11 in the workshop within the captured image. Furthermore, the image analysis unit 24 can detect the inspector's hand within the captured image. For example, the image analysis unit 24 can perform image processing such as edge extraction on the captured image to detect the instruments 11 and the inspector's hand.

[0061] The image analysis unit 24 can generate data for identifying each detected instrument 11 (also called instrument identification data). The instrument identification data can be the same type of data as the identification data stored in the storage unit 22, or it can be image data of the appearance of the instrument 11, data representing appearance features, or data such as product name, model number, or instrument-specific information set on the outside of the instrument 11.

[0062] The image analysis unit 24 can supply instrument determination data and position information within the captured image to the instrument detection unit 27 for each instrument 11 detected within the captured image. The position information within the captured image can represent the position information within the inspector's field of view. If the inspector's hand is detected within the captured image, the image analysis unit 24 can supply the position information of each instrument 11 and the hand within the captured image to the instrument detection unit 27 and the perception detection unit 25.

[0063] [2-6. Perception Detection Department 25]

[0064] The perception detection unit 25 is an example of the third detection unit, which detects when the inspector has engaged in perceptual perception using at least one of the senses, including hearing, smell, and touch. In this embodiment, as an example, the perception detection unit 25 can detect when the inspector has engaged in tactile perception. The perception detection unit 25 can detect tactile perception based on whether the inspector's hand overlaps with the instrument 11. The perception detection unit 25 can also detect overlap between the hand and the instrument 11 based on the positional information of the hand and the instrument 11 within the captured image provided by the image analysis unit 24.

[0065] If the sensory detection unit 25 detects that the inspector has made a sensory perception, it can supply a signal indicating the main point to the alarm unit 29 and the instrument detection unit 27.

[0066] [2-7. Location Acquisition Section 26]

[0067] The location acquisition unit 26 acquires the location of the patrol personnel along the patrol route. The location acquisition unit 26 can supply the acquired location information to the instrument detection unit 27 and the alarm unit 29.

[0068] [2-8. Instrument Testing Department 27]

[0069] The instrument inspection unit 27 inspects instruments 11 that may be detected as abnormal by the inspector. The instrument inspection unit 27 includes a visual instrument inspection unit 271 and a sensory instrument inspection unit 272.

[0070] [2-8(1). Visual Instrument Inspection Department 271]

[0071] The visual instrument inspection unit 271 inspects the visual object instrument 11(M) that the inspector sees.

[0072] The visual instrument detection unit 271 can detect instruments 11 detected in the central region of the captured image by the image analysis unit 24 as visual object instruments 11 (M). The visual instrument detection unit 271 can detect visual object instruments 11 (M) based on the position information of each instrument 11 in the captured image supplied by the image analysis unit 24.

[0073] The visual instrument detection unit 271 can refer to the storage unit 22 to detect the instrument-specific information of the visual object instrument 11(M) based on the instrument determination data supplied from the image analysis unit 24 for the visual object instrument 11(M) and the location information of the inspector supplied from the location acquisition unit 26. The visual instrument detection unit 271 can supply the instrument-specific information of the visual object instrument 11(M) to the alarm unit 29.

[0074] [2-8(2). Perceptual Instrument Detection Department 272]

[0075] Perceptual instrument testing unit 272 is an example of the fourth testing unit, which tests the instrument 11 (also called perceptual object instrument 11(T)) among the multiple instruments 11 in the testing workshop that performs sensory examinations using perceptual perception.

[0076] The perceptual instrument detection unit 272 can detect the instrument 11 detected by the image analysis unit 24 in the captured image that overlaps with the inspector's hand as the perceptual object instrument 11(T). The perceptual instrument detection unit 272 can detect the perceptual object instrument 11(T) based on the position information of the hand and each instrument 11 in the captured image supplied by the image analysis unit 24.

[0077] The perception instrument detection unit 272 can refer to the storage unit 22 to detect the instrument-specific information of the perception object instrument 11(T) based on the instrument determination data supplied from the image analysis unit 24 for the perception object instrument 11(T) and the location information of the patroller supplied from the location acquisition unit 26. The perception instrument detection unit 272 can supply the instrument-specific information of the perception object instrument 11(T) to the alarm unit 29.

[0078] [2-9. Brainwave Detection Department 28]

[0079] The brainwave detection unit 28, an example of the second detection unit, detects the brainwaves of the patroller. The brainwave detection unit 28 may have multiple electrodes configured to contact the patroller's head, and brainwaves can be detected via these electrodes. In this embodiment, as an example, the brainwave detection unit 28 can detect basic rhythmic patterns of brainwaves such as alpha waves and beta waves. The brainwave detection unit 28 can supply the detected brainwaves to the alarm unit 29.

[0080] [2-10. Alarm Department 29]

[0081] The alarm unit 29 outputs an alarm signal to the instrument 11 in the workshop based on the actions of the inspector. The alarm unit 29 may include an inspection content detection unit 291, a judgment unit 292, a notification unit 293, and an output control unit 294.

[0082] [2-10(1). Inspection Content Detection Department 291]

[0083] The inspection content detection unit 291 detects the inspection content that the inspector should perform. For example, the inspection content detection unit 291 can detect the inspection object instrument 11(K) corresponding to the inspector's position. In addition, the inspection content detection unit 291 can detect the inspection positions on the inspection route that should be subject to sensory inspection.

[0084] The inspection content detection unit 291 can inspect the inspection content by referring to the storage unit 22. The inspection content detection unit 291 can supply the inspection results to the judgment unit 292.

[0085] [2-10(2). Judgment Section 292]

[0086] The determination unit 292 makes a determination related to whether an alarm signal needs to be output.

[0087] For example, the determination unit 292 can determine whether the visual object instrument 11(M) has detected the inspection object instrument 11(K) corresponding to the position of the inspector on the inspection route. The determination unit 292 can make a determination by comparing the instrument-specific information of the inspection object instrument 11(K) detected by the inspection content detection unit 291 with the instrument-specific information of the visual object instrument 11(M) detected by the visual instrument detection unit 271. If the visual object instrument 11(M) does not detect the inspection object instrument 11(K), the visual object instrument 11(M) is seen by the inspector first compared to the inspection object instrument 11(K), so the possibility of an anomaly occurring for the visual object instrument 11(M) is higher. Therefore, the determination result that the visual object instrument 11(M) does not detect the inspection object instrument 11(K) can indicate that an alarm signal should be output.

[0088] The determination unit 292 can determine whether the visual target instrument 11(M) has failed to detect the inspection target instrument 11(K) corresponding to the position of the inspector on the inspection route, and whether the difference between the inspector's brainwave and the reference brainwave exceeds the allowable value. The determination unit 292 can make a determination by comparing the reference brainwave read from the storage unit 22 with the brainwave detected by the brainwave detection unit 28. When the reference brainwave of each inspector is stored in the storage unit 22, the reference brainwave of the inspector using the inspection terminal 2 can be used for determination.

[0089] Here, a difference in brainwave amplitude exceeding the permissible value can refer to a difference in parameters representing the basic rhythmic pattern of the brainwaves exceeding the permissible value. For example, if the test subject is tense, the amplitude of the alpha wave decreases. The determination unit 292 can determine whether the difference between the amplitude of the inspector's alpha wave and the amplitude of the reference brainwave exceeds the permissible value. If the visual target instrument 11(M) does not detect the examination target instrument 11(K), and the difference in brainwave amplitude is large, the visual target instrument 11(M) is prioritized by the inspector compared to the examination target instrument 11(K), and the inspector is in a tense state, thus the possibility of an abnormality occurring with the visual target instrument 11(M) is higher. Therefore, the determination result based on the premise that the visual target instrument 11(M) does not detect the examination target instrument 11(K), and the difference in brainwave amplitude exceeds the permissible value, can indicate that an alarm signal should be output.

[0090] Furthermore, the determination unit 292 can determine whether the inspector has performed sensory perception based on any one of the senses at a location different from the inspection location where a sensory inspection should be performed. The determination unit 292 can make a determination by comparing the inspection location where a sensory inspection should be performed, as detected by the inspection content detection unit, with the inspector's position acquired by the position acquisition unit 26 when sensory perception is detected by the perception detection unit 25. If sensory perception has occurred at a location different from the inspection location, the inspector has performed sensory perception that is not originally necessary, and therefore the possibility of an abnormality occurring in the instrument 11, which is the object of the sensory perception, is higher. Therefore, a determination result based on the premise that sensory perception has occurred at a location different from the inspection location can indicate that an alarm signal should be output.

[0091] The judgment unit 292 can provide the judgment result to the notification unit 293.

[0092] [2-10(3). Bulletin Department 293]

[0093] When an alarm signal is output (in this embodiment, as an example, a determination is made that an alarm signal should be output), the notification unit 293 notifies the inspector of this decision. For example, unless a cancellation operation is performed, the notification unit 293 can convey the message that an alarm signal should be output to the inspector.

[0094] Furthermore, the notification unit 293 can inform the inspectors of the inspection content that should be performed based on their location along the inspection route. For example, the notification unit 293 can inform the inspectors of the instrument 11 to be inspected and the types of sensory perception that should be conducted through sensory examination based on the detection results of the inspection content detection unit 291, and urge them to conduct the inspection.

[0095] [2-10(4). Output Control Unit 294]

[0096] The output control unit 294 controls the output of the alarm signal. The output control unit 294 can stop the output of the alarm signal if the patroller cancels the output of the alarm signal upon receiving a notification from the notification unit 293. The output control unit 294 can also stop the output of the alarm signal if it is canceled upon instruction from the input unit 21.

[0097] The output control unit 294 can output an alarm signal depending on whether an alarm signal has been indicated. The output control unit 294 can also output an alarm signal if it has not been indicated to be canceled with a reference time (for example, 2 seconds).

[0098] The output control unit 294 can output an alarm signal to the management center 10 via the communication unit 20. In this embodiment, as an example, the output control unit 294 can output an alarm signal to at least one of the operation control device 15, the interface device 16, or the resource management device 17. The alarm signal may not contain instrument-specific information of the instrument 11 being monitored. The alarm signal may also contain at least one of the location of the inspector or an image captured by the imaging unit 23.

[0099] [2-11. Effects obtained from inspection terminal 2]

[0100] According to the above-mentioned inspection terminal 2, if the visual object instrument 11(M) does not detect the inspection object instrument 11(K) corresponding to the position of the inspector on the inspection route, an alarm signal will be output for the visual object instrument 11(M). Therefore, the inspector can output an alarm signal to report the abnormality for the instrument 11 that is perceived as abnormal and is seen first compared with the inspection object instrument 11(K).

[0101] In addition, if the visual object instrument 11(M) fails to detect the inspection object instrument 11(K) corresponding to the position of the inspector on the inspection route, and the difference between the inspector's brainwave and the reference brainwave exceeds the allowable value, an alarm signal is output. Therefore, an alarm signal can be output to report the abnormality for the instrument 11 that is reliably sensed by the inspector.

[0102] Furthermore, based on the situation where the inspector performs sensory-based perceptual detection at a location different from the inspection location where a sensory check should be performed, an alarm signal is output for the sensory object instrument 11(T) among the multiple instruments 11 in the workshop that has performed a sensory check using sensory perception. Therefore, an alarm signal can be output to report an abnormality for the sensory object instrument 11(T) that has performed sensory-based detection by the inspector sensing an abnormality.

[0103] In addition, based on the overlap of the inspector's hand with the instrument 11, the inspector is detected to have performed tactile perception. An alarm signal is output to the instrument 11 that overlaps with the inspector's hand. Therefore, the instrument 11 can reliably output an alarm signal to report the abnormality when the inspector senses the abnormality and performs tactile detection.

[0104] Furthermore, when an alarm signal is output, the inspector is notified, and the output of the alarm signal is stopped depending on whether the alarm signal output is cancelled. Therefore, it is possible to prevent the output of an alarm signal for instrument 11 that is determined by the inspector to be free of abnormalities.

[0105] In addition, the location acquisition unit 26, imaging unit 23, and instrument detection unit 27 of the inspection terminal 2 are worn by the inspector, so compared with the case where the inspector does not wear them, the instruments that the inspector sees can be accurately and quickly detected.

[0106] In addition, the alarm unit 29 of the inspection terminal 2 is worn by the inspector and sends the alarm signal to the workshop management center 10, so that the status of the instrument 11 that the inspector feels is abnormal can be confirmed in the management center 10.

[0107] [3. Appearance of the inspection terminal 2]

[0108] Figure 3 This describes the appearance of the inspection terminal 2.

[0109] The patrol terminal 2 can be a wearable computer worn by a user. In this embodiment, as an example, it can be a head-mounted display. The patrol terminal 2 may include a helmet 200 worn on the user's head, goggles 201 covering the user's eyes, and a camera unit 23.

[0110] The helmet 200 protects the user's head. The goggles 201 are located on the front of the patrol terminal 2 and cover the user's eyes. The goggles 201 are an example of the notification unit 293, but could also be an optical transmission type display. The goggles 201 can overlay notification content onto the user's field of vision.

[0111] The camera unit 23 is located on the front part of the patrol terminal 2. In this embodiment, as an example, the camera unit 23 is located on the helmet 200, but it can also be located on the goggles 201.

[0112] [4. Operation of Terminal 2 for Inspection]

[0113] [4-1. Actions related to the visual object instrument 11(M)]

[0114] Figure 4 This indicates an action related to the visual object instrument 11 (M). The inspection terminal 2 outputs an alarm signal to the visual object instrument 11 (M) by executing steps S11 to S29. Furthermore, regarding this action, and actions related to the perceived object instrument 11 (T) described later, the storage unit 22 can pre-store content other than inspection results (for example, the inspected object instruments 11 (K) at each location on the inspection route). Additionally, during the operation, the imaging unit 23 can sequentially capture images of the inspector's field of view, and the image analysis unit 24 can generate instrument identification data for the instruments 11 detected within the captured images.

[0115] In step S11, the location acquisition unit 26 acquires the location of the patrolman along the patrol route. The location acquisition unit 26 can acquire the location of the patrol terminal 2 as the location of the patrolman. The location acquisition unit 26 can receive wireless signals transmitted from GPS satellites to detect the current location coordinates of the patrol terminal 2.

[0116] However, the location acquisition unit 26 can acquire the location of the inspection terminal 2 using other methods. For example, the location acquisition unit 26 can acquire the location of the inspection terminal 2 based on the received radio signal strength (RSSI) from multiple base stations configured within the workshop. Furthermore, the location acquisition unit 26 can calculate the location of the inspection terminal 2 by comparing the position and size of each subject in pre-captured images at various locations along the inspection route with the position and size of each subject in newly captured images by the imaging unit 23 during the inspection.

[0117] In step S13, the inspection content detection unit 291 of the alarm unit 29 detects the inspection target instrument 11(K) corresponding to the patroller's position. The inspection content detection unit 291 can refer to the storage unit 22 to detect the instrument-specific information of the inspection target instrument 11(K) stored at each location along the patrol route that corresponds to the patroller's current position. When there are multiple inspection target instruments 11(K) corresponding to the patroller's current position, the inspection content detection unit 291 can acquire the instrument-specific information of each inspection target instrument 11(K).

[0118] Furthermore, in step S13, the notification unit 293 of the alarm unit 29 can notify the inspector that each detected inspection target instrument 11(K) is a visual inspection target. As an example, the notification unit 293 can display a mark indicating that it is a visual inspection target in the portion of the display area of ​​the goggles 201 that overlaps with each inspection target instrument 11(K). Additionally, if there is no inspection target instrument 11(K) corresponding to the inspector's position in step S13, the process can proceed to step S19.

[0119] In step S15, the visual instrument detection unit 271 of the instrument detection unit 27 detects the visual target instruments 11(M) seen by the inspector. The visual instrument detection unit 271 can detect the instruments 11 detected by the image analysis unit 24 in the central area of ​​the captured image as visual target instruments 11(M). In this embodiment, as an example, the visual instrument detection unit 271 can detect the instruments 11 continuously detected in the central area of ​​the captured image for a first reference time (3 seconds for example) as visual target instruments 11(M). In addition, the visual instrument detection unit 271 can detect each instrument 11 detected in the central area of ​​the captured image for a second reference time after the inspection target instruments 11(K) are detected through the processing in step S13 as visual target instruments 11(M). The second reference time can be a length corresponding to the number of inspection target instruments 11(K) detected through the processing in step S13, or it can be a fixed length such as 10 seconds.

[0120] The visual instrument detection unit 271 can detect the instrument-specific information of the visual object instrument 11 (M) based on the instrument determination data supplied from the image analysis unit 24 for the visual object instrument 11 (M) and the location information of the inspector supplied from the location acquisition unit 26. In this embodiment, as an example, the visual instrument detection unit 271 can compare the inspector's location information with the location information of the installation positions of each instrument 11 stored in the storage unit 22, and detect each instrument 11 within a reference range (for example, a radius of 10m) from the location indicated by the inspector's location information. Furthermore, the visual instrument detection unit 271 can compare the identification data stored in the storage unit 22 for each detected instrument 11 with the instrument determination data generated for the visual object instrument 11 (M), and detect the identification data that matches the instrument determination data. The visual instrument detection unit 271 can set the instrument-specific information associated with the identification data that matches the instrument determination data in the storage unit 22 as the instrument-specific information of the visual object instrument 11 (M).

[0121] In step S17, the determination unit 292 of the alarm unit 29 determines whether the inspection target instrument 11(K) corresponding to the inspector's position is detected as a visual target instrument 11(M). If there are multiple inspection target instruments 11(K) corresponding to the inspector's position, the determination unit 292 can determine whether each of the multiple inspection target instruments 11(K) is detected as a visual target instrument 11(M), that is, whether all inspection target instruments 11(K) are detected as visual target instruments 11(M).

[0122] If it is determined that each instrument 11(K) to be inspected is a visual inspection instrument 11(M) (step S17; Y), that is, if the inspector performs a normal visual inspection of each instrument 11(K), the process proceeds to step S19. In this case, the input unit 21 can store the inspection results input by the inspector in the storage unit 22.

[0123] If it is determined that no inspection target instrument 11(K) was detected as a visual target instrument 11(M) (step S17; N), that is, if the inspector sensed an anomaly and prioritized visually inspecting the visual target instrument 11(M) over the inspection target instrument 11(K), the process proceeds to step S21. Furthermore, the determination unit 292 can determine that no inspection target instrument 11(K) was detected as a visual target instrument 11(M) within the aforementioned second reference time (for example, 10 seconds) after the inspection target instrument 11(K) was detected in step S13.

[0124] In step S19, the position acquisition unit 26 detects the movement of the inspector. The position acquisition unit 26 can detect movement if the re-acquired position differs from the position acquired in step S11. If movement is detected, the process can proceed to step S11. In this case, the position acquisition unit 26 can set the position acquired in step S19 as the inspector's position without re-acquiring the inspector's position.

[0125] In step S21, the brainwave detection unit 28 detects the brainwaves of the inspector.

[0126] In step S23, the determination unit 292 of the alarm unit 29 determines whether the difference between the inspector's brainwave and the reference brainwave exceeds the allowable value. If the difference is determined to be less than the allowable value (step S23; N), for example, if the inspector's level of tension is not high, the process proceeds to step S15. If the difference is determined to be greater than the allowable value (step S23; Y), for example, if the inspector's level of tension is high, the process proceeds to step S25.

[0127] In step S25, the notification unit 293 of the alarm unit 29 informs the inspector that an alarm signal will be output. As an example, unless a cancellation operation is performed, the notification unit 293 can display a message indicating the predetermined purpose of outputting the alarm signal on the goggles 201. Furthermore, the notification unit 293 can inform the inspector which instrument 11 is being output to; in other words, it can inform the inspector of the visual target instrument 11 (M) that is the target of the alarm signal output. For example, the notification unit 293 can display a mark indicating the target of the alarm signal in the portion of the display area of ​​the goggles 201 that overlaps with the visual target instrument 11 (M) that is the target of the alarm signal output. In this case, the inspector can determine whether to cancel the alarm signal output based on confirming that the instrument 11 is the target of the alarm signal.

[0128] Furthermore, the visual object instrument 11(M) to which the alarm signal is output can be an instrument 11 that is different from any inspection object instrument 11(K) detected in step S13 among the visual object instruments 11(M) detected in step S15. When there are multiple such visual object instruments 11(M), the visual object instrument 11(M) to which the alarm signal is output can be the visual object instrument 11(M) continuously detected in the central region of the captured image for the longest period, or it can be the visual object instrument 11(M) last detected in the central region of the captured image.

[0129] In step S27, the output control unit 294 determines whether the alarm signal output has been cancelled by the inspector. If it is determined that the alarm signal has been cancelled (step S27; Y), the process proceeds to step S15. Thus, the output of the alarm signal is stopped depending on whether the alarm signal output has been cancelled. If it is determined in step S27 that the alarm signal output has not been cancelled (step S27; N), the process proceeds to step S29.

[0130] In step S29, the output control unit 294 outputs an alarm signal to the visual object instrument 11(M) to which the alarm signal is output. The output control unit 294 can make the alarm signal include the instrument-specific information of the visual object instrument 11(M) detected by the visual instrument detection unit 271.

[0131] [4-2. Actions related to the perceived object instrument 11(T)]

[0132] Figure 5 This indicates an action related to the object perception instrument 11(T). The inspection terminal 2 outputs an alarm signal to the object perception instrument 11(T) by executing the processing in steps S31 to S47. In addition, actions related to the aforementioned visual object instrument 11(M) can be executed in parallel with this action.

[0133] In step S31, the inspection content detection unit 291 detects the inspection positions on the inspection route where sensory inspections should be performed. The inspection content detection unit 291 can detect the position information of each inspection position on the inspection route by referring to the storage unit 22. The inspection content detection unit 291 can also detect the type of perceptual perception that should be performed at each inspection position and the instrument 11 that is the object of sensory inspection by referring to the storage unit 22.

[0134] In step S33, the location acquisition unit 26 acquires the location of the patrolman on the patrol route. The location acquisition unit 26 can acquire the patrolman's location in the same way as in step S11 described above.

[0135] In step S35, the determination unit 292 determines whether the inspector's position is an inspection position for sensory inspection. If the inspector's position is determined not to be an inspection position (step S35; N), the process can proceed to step S37. If the inspector's position is determined to be an inspection position (step S35; Y), the process can proceed to step S39.

[0136] Furthermore, if the inspector's location is determined to be an inspection location, the notification unit 293 of the alarm unit 29 can notify the inspector that the current location is an inspection location for sensory examination. As an example, the notification unit 293 can display the types of perceptual sensations that should be performed through sensory examination on the display area of ​​the goggles 201. In addition, the input unit 21 can store the inspection results input by the inspector in the storage unit 22.

[0137] In step S39, the position acquisition unit 26 detects the movement of the inspector. The position acquisition unit 26 can detect movement if the re-acquired position differs from the position acquired in step S33. If movement is detected, the process can proceed to step S33. In this case, the position acquisition unit 26 may not re-acquire the inspector's position, but instead set the position acquired in step S39 as the inspector's position.

[0138] In step S37, the determination unit 292 determines whether a perceptual perception based on at least one of the senses, including hearing, smell, and touch (touch as an example in this embodiment), has occurred. In this embodiment, as an example, the determination unit 292 may determine whether a perceptual perception has been detected by the perception detection unit 25. If it is determined that no perceptual perception has occurred (step S37; N), the process proceeds to step S39. If it is determined that a perceptual perception has occurred (step S37; Y), the process proceeds to step S41.

[0139] In step S41, the perceptual instrument detection unit 272 of the instrument detection unit 27 detects the perceptual object instrument 11(T) that has undergone sensory examination using perceptual perception. The perceptual instrument detection unit 272 can detect the instrument 11 detected by the image analysis unit 24 in the captured image as the perceptual object instrument 11(T) that overlaps with the inspector's hand. In this embodiment, as an example, the perceptual instrument detection unit 272 can detect the instrument 11 that overlaps with the hand in the captured image for a third reference time (3 seconds as an example) and continuously detect it as the perceptual object instrument 11(T).

[0140] The perception instrument detection unit 272 can detect the instrument-specific information of the perception object instrument 11(T) based on the instrument determination data supplied from the image analysis unit 24 for the perception object instrument 11(T) and the location information of the inspector supplied from the location acquisition unit 26. In this embodiment, as an example, the perception instrument detection unit 272 can compare the inspector's location information with the location information of each instrument 11's installation location stored in the storage unit 22, and detect each instrument 11 within a reference range (for example, a radius of 10m) from the location indicated by the inspector's location information. Furthermore, the perception instrument detection unit 272 can compare the instrument determination data supplied for the perception object instrument 11(T) with the recognition data stored in the storage unit 22 for each detected instrument 11, and detect recognition data that matches the instrument determination data. Moreover, the perception instrument detection unit 272 can set the instrument-specific information associated with the detected recognition data in the storage unit 22 as the instrument-specific information of the perception object instrument 11(T).

[0141] In step S43, the notification unit 293 of the alarm unit 29 notifies the inspector that an alarm signal will be output. As an example, unless a cancellation operation is performed, the notification unit 293 can display a message indicating the predetermined purpose of outputting the alarm signal on the goggles 201. Furthermore, the notification unit 293 can notify the inspector whether an alarm signal is output for any instrument 11; in other words, it can notify the inspector of the perceived object instrument 11(T) that is the target of the alarm signal output. For example, the notification unit 293 can display a mark indicating the object of the alarm signal in the portion of the display area of ​​the goggles 201 that overlaps with the perceived object instrument 11(T) that is the target of the alarm signal output. In this case, the inspector can determine whether to cancel the alarm signal output based on confirmation of the instrument 11 that is the target of the alarm signal. Moreover, the perceived object instrument 11(T) that is the target of the alarm signal output can be the perceived object instrument 11(T) detected in the process of step S41.

[0142] In step S45, the output control unit 294 determines whether the alarm signal output has been cancelled by the inspector. If it is determined that the alarm signal has been cancelled (step S45; Y), the process proceeds to step S37. Thus, the output of the alarm signal is stopped based on whether the alarm signal output has been cancelled. In step S45, if it is determined that the alarm signal output has not been cancelled (step S45; N), the process proceeds to step S47.

[0143] In step S47, the output control unit 294 outputs an alarm signal for the sensing object instrument 11(T). The output control unit 294 can make the alarm signal include the instrument-specific information of the sensing object instrument 11(T) detected by the sensing instrument detection unit 272.

[0144] [5. A modified example of the structure for inspecting the visual object instrument 11(M)]

[0145] In the above embodiment, it is described that the instrument-specific information of the visual object instrument 11(M) is detected using instrument determination data supplied from the image analysis unit 24, but it is also possible to detect the information without using instrument determination data.

[0146] For example, the inspection terminal 2 may have a sensor array (not shown) that detects the inspector's line of sight or the inspector's gaze point (also called gaze position). The inspector's line of sight can be a straight line connecting the midpoint of the eyes and the inspector's gaze point, or it can be a straight line passing through the midpoint of the eyes and pointing towards the front of the head. The sensor array may include a 6-axis sensor, a magnetic sensor, a distance sensor, an eye potential sensor, etc. The 6-axis sensor may be a motion sensor (also called an inertial sensor) with a 3-axis accelerometer and a 3-axis gyroscope (angular velocity) sensor, which can detect the inspector's head movements and thus the orientation of the inspection terminal 2. The magnetic sensor may be, for example, a 3-axis geomagnetic sensor. The distance sensor can measure the distance from the inspection terminal 2 to an object in front of it (instrument 11 as an example). The eye potential sensor can detect the orientation of the eyeballs by detecting the potential difference around the eyes.

[0147] In this case, the visual instrument detection unit 271 can detect the inherent instrument information of the visual target instrument 11(M) based on the inspector's line of sight or the position of their gaze. As an example, the visual instrument detection unit 271 can detect the inspector's line of sight and gaze position, starting from the inspector's position, based on the measurement results of the sensor group and the position information acquired by the position acquisition unit 26. Furthermore, the visual instrument detection unit 271 can refer to the installation positions of each instrument 11 stored in the storage unit 22 to detect the instrument 11 located in the line of sight or at the gaze position as the visual target instrument 11(M).

[0148] Furthermore, the inspection terminal 2 may have a camera unit that captures images of the inspector's eyes. In this case, the visual instrument detection unit 271 can detect the line of sight by analyzing the image of the eye. Additionally, the visual instrument detection unit 271 can detect the distance from the inspection terminal 2 to the inspector's gaze point and the gaze position using the convergence angle calculated based on the orientation of the inspector's left and right eyes.

[0149] [6. A modified example of the structure for detecting the perceived object instrument 11(T)]

[0150] In the above embodiment, it is described that the perception detection unit 25 detects whether the inspector has performed a tactile perception, but it can also detect whether a perception based on at least one sense, such as hearing or smell, has been performed.

[0151] In cases where auditory perception is detected, the perception detection unit 25 can detect the inspector's listening motion. For example, the perception detection unit 25 can use a 6-axis sensor to detect the inspector's head movements and perform auditory perception based on whether the head stops moving beyond a reference time. Additionally, the perception detection unit 25 can perform auditory perception based on whether the inspector's eyes are closed for more than a reference time (e.g., 2 seconds) in an image captured from the camera focusing on the inspector's eyes. Furthermore, the perception detection unit 25 can perform auditory perception based on whether the inspector's hand is touching behind their ear in an image captured from the camera focusing on the inspector's ear. Finally, the perception detection unit 25 can perform auditory perception based on whether a sound pressure exceeding a reference sound pressure (e.g., 60 dB) is measured by a sensor measuring the sound pressure around the inspection terminal 2. When the perception detection unit 25 detects auditory perception, the perception instrument detection unit 272 can detect one or more instruments 11 as perception objects (T) within the reference range of the inspector (for example, within a radius of 10m).

[0152] Furthermore, in the case of detecting olfactory perception, the perception detection unit 25 can perform olfactory perception based on the observation of air being inhaled from the nose of the inspector at a frequency exceeding a reference frequency (for example, twice per second) in an image from a camera capturing the inspector's nasal cavity. When the perception detection unit 25 detects olfactory perception, the perception instrument detection unit 272 detects one or more instruments 11 (for example, the instrument closest to the inspector) within a reference range relative to the inspector (for example, a radius of 5m) as perception target instruments 11 (T), and one or more instruments 11 on the upwind side of the inspector. When an instrument 11 on the upwind side of the inspector is detected, the perception instrument detection unit 272 can compare the instruments 11 positioned more upwind of the inspector based on the measurement results of a wind direction sensor that measures the wind direction around the inspector and the position information obtained from the position acquisition unit 26.

[0153] Furthermore, when the perception detection unit 25 detects perceptual perception based on two or more of the senses of touch, hearing, or smell, the perception instrument detection unit 272 can detect the instrument 11 that has undergone a sensory check based on all senses as the perceptual object instrument 11(T). For example, when the perception detection unit 25 detects both perceptual perception based on a first sense and perceptual perception based on a second sense, the perception instrument detection unit 272 can perform a sensory check based on the first sense and detect the instrument 11 that has undergone a sensory check based on the second sense as the perceptual object instrument 11(T).

[0154] Instead, the perception instrument detection unit 272 can detect the instrument 11 that performs a sensory check based on each sensation detected by the perception detection unit 25. For example, if the perception detection unit 25 detects a perception based on a first sensation and a perception based on a second sensation, the perception instrument detection unit 272 can detect the instrument 11 that performs a sensory check based on the first sensation and the instrument 11 that performs a sensory check based on the second sensation as perception object instruments 11 (T).

[0155] [7. Other variations]

[0156] In the above embodiments, the patrol terminal 2 is described as having a communication unit 20, an input unit 21, an image capturing unit 23, an image analysis unit 24, a perception detection unit 25, a location acquisition unit 26, an instrument detection unit 27, a perception instrument detection unit 272, and a brainwave detection unit 28. However, it may also lack any of the above components. When the patrol terminal 2 does not have a communication unit 20, the alarm unit 29 of the patrol terminal 2 can output alarm signals to the surrounding area.

[0157] Furthermore, while the description explains the scenario where each part of the inspection terminal 2 is worn by the inspector, the alarm unit 29 may not be worn by the inspector but instead be located in the workshop management center 10. For example, the inspection terminal 2 may have a main body worn by the inspector, including a camera unit 23, an image analysis unit 24, a perception detection unit 25, a location acquisition unit 26, an instrument detection unit 27, a brainwave detection unit 28, a storage unit 22, and an input unit 21, as well as an alarm unit 29 located in the management center 10. In this case, the structure worn by the inspector can be reduced, thus lightening the main body of the terminal.

[0158] Furthermore, it was explained that the alarm unit 29 may have a notification unit 293 or it may not have a notification unit 293. In this case, the alarm unit 29 can output an alarm signal for the visual object instrument 11(M) if no inspection object instrument 11(K) corresponding to the position of the inspector on the inspection route is detected as a visual object instrument 11(M).

[0159] Furthermore, various embodiments of the present invention can be described with reference to flowchart diagrams and block diagrams, where a module can represent (1) a stage of the process of performing an operation, or (2) a part of a device that performs the operation. Specific stages and parts can be installed using dedicated circuits, programmable circuits supplied together with computer-readable instructions stored on a computer-readable medium, and / or processors supplied together with computer-readable instructions stored on a computer-readable medium. Dedicated circuits can include digital and / or analog hardware circuits, and can also include integrated circuits (ICs) and / or discrete circuits. Programmable circuits can include reconfigurable hardware circuits such as logic AND, logic OR, logic XOR, logic NAND, logic NOR, and other logic operations, trigger circuits, registers, field-programmable gate arrays (FPGAs), programmable logic arrays (PLAs), etc., and memory elements.

[0160] A computer-readable medium can include any tangible device capable of storing instructions executable by a suitable device, resulting in a product having executable instructions containing means for performing operations specified in a flowchart or block diagram. Examples of computer-readable media include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable media include floppy disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), electrically erasable programmable read-only memory (EEPROM), static random access memory (SRAM), optical disc read-only memory (CD-ROM), digital versatile optical disc (DVD), Blu-ray (RTM) discs, memory sticks, integrated circuit cards, etc.

[0161] Computer-readable instructions may include any of the following: assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code described in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, JAVA (registered trademark), C++, and procedural programming languages ​​such as "C" or similar programming languages.

[0162] Computer-readable instructions can be provided to the processor or programmable circuitry of a general-purpose computer, a special-purpose computer, or other programmable data processing device, depending on a local area network (LAN), wide area network (WAN), or the Internet, and executed to create means for performing the operations specified in a flowchart or block diagram. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0163] Figure 6 Examples of computer 2200 embodying all or part of various embodiments of the present invention are shown. Programs installed in computer 2200 enable computer 2200 to function as an operation associated with or one or more parts of a device according to embodiments of the present invention, or to perform such operation or such parts, and / or to execute processes or stages of processes according to embodiments of the present invention. Such programs may be executed by CPU 2212 to enable computer 2200 to perform specific operations associated with several or all of the modules in the flowcharts and block diagrams described in this specification.

[0164] The computer 2200 according to this embodiment includes a CPU 2212, RAM 2214, a graphics controller 2216, and a display device 2218, which are interconnected via a main controller 2210. Additionally, the computer 2200 includes input / output units such as a communication interface 2222, a hard disk drive 2224, a DVD-ROM drive 2226, and an IC card driver, which are connected to the main controller 2210 via an input / output controller 2220. Furthermore, the computer includes conventional input / output units such as a ROM 2230 and a keyboard 2242, which are connected to the input / output controller 2220 via an input / output chip 2240.

[0165] CPU 2212 executes actions according to the programs stored in ROM 2230 and RAM 2214, thereby controlling each unit. Graphics controller 2216 acquires image data generated by CPU 2212 in frame buffer or other storage provided to RAM 2214, and displays the image data on display device 2218.

[0166] Communication interface 2222 communicates with other electronic devices via a network. Hard disk drive 2224 stores programs and data used by CPU 2212 within computer 2200. DVD-ROM drive 2226 reads programs or data from DVD-ROM 2201 and provides programs or data to hard disk drive 2224 via RAM 2214. IC card drive reads programs and data from IC card and / or writes programs and data to IC card.

[0167] ROM 2230 stores startup programs and / or programs that depend on the hardware of computer 2200, which are executed by computer 2200 upon activation. Additionally, input / output chip 2240 connects various input / output units to input / output controller 2220 via parallel ports, serial ports, keyboard ports, mouse ports, etc.

[0168] The program is provided by a computer-readable medium such as a DVD-ROM 2201 or an IC card. The program is read from the computer-readable medium and installed on a hard disk drive 2224, RAM 2214, or ROM 2230, which are also examples of computer-readable media, and executed by the CPU 2212. The information processing described in the program is read by the computer 2200, enabling cooperation between the program and the aforementioned hardware resources of various types. An apparatus or method can be constituted by using the computer 2200 to perform information manipulation or processing.

[0169] For example, when communication is performed between computer 2200 and external devices, CPU 2212 can execute a communication program loaded in RAM 2214 and issue communication processing instructions to communication interface 2222 based on the processing described in the communication program. Under the control of CPU 2212, communication interface 2222 reads transmission data stored in the transmission buffer processing area provided in recording media such as RAM 2214, hard disk drive 2224, DVD-ROM 2201, or IC card, and sends the read transmission data to the network, or writes received data received from the network to the receive buffer processing area provided on the recording medium, etc.

[0170] In addition, CPU 2212 can read all or a portion of files or databases stored on external recording media such as hard disk drive 2224, DVD-ROM drive 2226 (DVD-ROM 2201), IC card, etc., into RAM 2214, and perform various types of processing on the data in RAM 2214. CPU 2212 then writes the processed data back to the external recording media.

[0171] Various types of information, such as programs, data, tables, and databases, can be stored in recording media and processed. CPU 2212 can perform various types of processing, including operations, information processing, conditional judgments, conditional branches, unconditional branches, and information retrieval / replacement, as specified by a sequence of instructions described at any location in this disclosure, on data read from RAM 2214, and write back the results to RAM 2214. Furthermore, CPU 2212 can retrieve information from files, databases, etc., within the recording medium. For example, if multiple entries, each having an attribute value of a first attribute associated with an attribute value of a second attribute, are stored in the recording medium, CPU 2212 can retrieve from these multiple records an entry that specifies the attribute value of the first attribute and matches the condition, read the attribute value of the second attribute stored within that entry, and obtain the attribute value of the second attribute associated with the first attribute that satisfies the pre-defined condition.

[0172] The programs or software modules described above can be stored on or near computer-readable media on computer 2200. Alternatively, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable medium, thereby providing the program to computer 2200 via the network.

[0173] The present invention has been described above using embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. Those skilled in the art will understand that various modifications or improvements can be made to the above embodiments. As clearly understood from the claims, such modifications or improvements can also be included within the technical scope of the present invention.

[0174] The execution order of actions, sequences, steps, and stages in the apparatus, system, program, and method shown in the claims, specification, and drawings is not specifically indicated as "earlier" or "earlier." Furthermore, it should be noted that any order is permissible as long as the output of a previous process is not used in a subsequent process. Even if terms such as "firstly," "nextly," etc., are used for convenience in describing the flow of actions in the claims, specification, and drawings, it does not imply that the actions must be performed in that order.

[0175] Explanation of the label

[0176] 1. Security Management System

[0177] 2. Terminals used for patrol

[0178] 10 Management Center

[0179] 11 Instruments

[0180] 12 Security Terminals

[0181] 15. Operation control device

[0182] 16 Interface Devices

[0183] 17 Resource Management Device

[0184] 20 Ministry of Communications

[0185] 21 Input Section

[0186] 22 Storage Department

[0187] 23 Filming Department

[0188] 24 Image Analysis Unit

[0189] 25. Perception Detection Department

[0190] 26 Location Acquisition Department

[0191] 27. Instrument Testing Department

[0192] 28. Brainwave Detection Department

[0193] 29 Alarm Department

[0194] 200 helmets

[0195] 201 goggles

[0196] 271 Visual Instrument Inspection Department

[0197] 272 Perceptual Instrument Testing Department

[0198] 291 Inspection Content Testing Department

[0199] 292 Judgment Department

[0200] 293 Notification Department

[0201] 294 Output Control Unit

Claims

1. A device worn by an inspector of instruments in a workshop, wherein, The device has: The storage unit is associated with multiple locations set along the inspection route, whereby the inspectors store the instruments in the workshop that they are to visually inspect. The location acquisition unit acquires the location of the patrolman along the patrol route; The first inspection unit inspects the visually visible instruments located at the inspector's position. as well as The alarm unit outputs an alarm signal for the visual object instrument if, in the case that the instrument being inspected is not detected as the visual object instrument, it is stored in association with the location corresponding to the location of the inspector on the inspection route among the multiple preset locations.

2. The apparatus according to claim 1, wherein, The alarm unit has: The notification department, upon issuing an alarm signal, informs the patrol personnel of the purpose of issuing the alarm signal; and The output control unit stops the output of the alarm signal if the alarm signal output is canceled by the inspector who received the notification.

3. The apparatus according to claim 1 or 2, wherein, The device also includes a second detection unit that detects the brainwaves of the inspector. The storage unit also stores the baseline brainwaves of the patroller at each location along the patrol route. The alarm unit outputs an alarm signal when the inspection target instrument corresponding to the position of the patrolman on the patrol route is not detected as the visual target instrument and the difference between the patrolman's brainwave and the reference brainwave exceeds the allowable value.

4. The apparatus according to claim 1 or 2, wherein, The device also has: The third inspection department detects whether the inspectors have conducted perceptual perception based on at least one of the senses, including hearing, smell and touch. as well as The fourth inspection department inspects instruments among the various instruments in the workshop that have undergone sensory examinations using the aforementioned perceptual senses. The storage unit also stores the inspection locations along the inspection route that the inspector should conduct using the sensory perception described therein. The alarm unit also outputs an alarm signal for the instrument detected by the fourth detection unit based on whether the inspector has made the perceptual perception at a location different from the inspection location.

5. The apparatus according to claim 4, wherein, The device has: The camera unit, which films the inspectors' field of vision; and The image analysis unit detects the inspector's hand and various instruments in the workshop within the image captured by the imaging unit. The third detection unit detects that the inspector has engaged in tactile perception based on the overlap between the inspector's hand and the instrument. The fourth detection unit detects the instrument when it overlaps with the inspector's hand.

6. The apparatus according to claim 1 or 2, wherein, The first inspection unit is worn by the inspector.

7. The apparatus according to claim 6, wherein, The alarm device is worn by the inspector and sends the alarm signal to the workshop's management center.

8. The apparatus according to claim 6, wherein, The alarm unit is located in the management center of the workshop and outputs the alarm signal.

9. The apparatus according to claim 1, wherein, The alarm unit includes a determination unit that determines whether to prioritize detecting instruments other than the target inspection instrument as visual target instruments compared to the target inspection instrument, based on the instruments stored in association with the location corresponding to the location of the patroller on the patrol route among the multiple preset locations. If the determination unit determines that the instrument other than the instrument to be inspected should be detected as the visual target instrument first, the alarm unit outputs an alarm signal for the visual target instrument.

10. A method, wherein, The method has the following stages: During the storage phase, the instruments to be inspected in the workshop that the inspector should visually inspect are stored at each of the multiple locations set along the inspection route. During the location acquisition phase, the location of the patrolman on the patrol route is acquired; In the first detection phase, the visual objects of the instruments that are visually visible to the inspector at the inspector's location are detected. as well as During the alarm phase, if no instrument that is stored as the visual target instrument is detected as being associated with the location of the inspector on the patrol route from among the multiple predefined locations, an alarm signal is output for the visual target instrument.

11. A recording medium having a program recorded thereon, This program enables the computer to function as the following components: The storage unit is associated with multiple locations set along the inspection route, whereby the inspectors store the instruments in the workshop that should be visually inspected by the inspectors. The location acquisition unit acquires the location of the patrolman along the patrol route; The first inspection unit inspects the visually visible instruments located at the inspector's position. as well as The alarm unit outputs an alarm signal for the visual object instrument if, in the case that the instrument being inspected is not detected as the visual object instrument, it is stored in association with the location corresponding to the location of the inspector on the inspection route among the multiple preset locations.

Images