Determination device, determination method and recording medium

Abstract

The present invention provides an apparatus, a method and a recording medium, wherein the apparatus comprises: a storage unit, for storing, for each of a plurality of operations that the operator should perform, an area that the operator should view when performing the operation; a detection unit, for detecting the areas that the operator should view respectively; and a determination unit, for determining whether the detection unit has detected each area stored in the storage unit.

Description

Technical Field

[0001] The present invention relates to an apparatus, a method and a recording medium. Background Art

[0002] Patent Document 1 states that “the electronic device may include a sight line detection unit that detects a user's sight line, and the control unit may obtain an area in a web page that the user is paying attention to based on the user's sight line information obtained from the sight line detection unit.”

[0003] Patent Document 1: Japanese Patent Publication No. 2015-191551 Summary of the invention

[0004] In a first aspect of the present invention, a device is provided. The device may include a storage unit that stores, for each of a plurality of operations that the operator should perform, a region that the operator should watch when performing the operation. The device may include a detection unit that detects the regions that the operator watches, respectively. The device may include a determination unit that determines whether the detection unit detects each region that the operator should watch stored in the storage unit.

[0005] The determination unit may determine, for each job, whether the detection unit has detected the area corresponding to the job.

[0006] The device may include an input unit for receiving an input operation of completion of each of the plurality of tasks from an operator. The device may include an input control unit for accepting input of the input unit in response to the determination unit determining that an area corresponding to the task is detected for each of the plurality of tasks.

[0007] The storage unit may further store the order in which each of the plurality of jobs should be performed. The input control unit may approve the input of the input unit based on the completion of other jobs that should be completed before the job and the detection of the area corresponding to the job by the determination unit.

[0008] The device may include an extracting unit that extracts an area not detected by the detecting unit from among the plurality of areas stored by the storing unit. The device may include a notifying unit that notifies the operator that the work corresponding to the area extracted by the extracting unit is not being performed.

[0009] The area that the operator should watch may be a setting area of ​​the equipment.

[0010] In a second aspect of the present invention, a method is provided. The method may include a storage stage, in which, for each of a plurality of operations that the operator should perform, a region to be observed by the operator when performing the operation is stored. The method may include a detection stage in which the regions to be observed by the operator are detected respectively. The method may include a determination stage in which the determination stage determines whether each region to be observed stored in the storage stage is detected in the detection stage.

[0011] In a third aspect of the present invention, a recording medium having a program recorded thereon is provided. The computer can function as a storage unit by executing the program, and the storage unit stores, for each of a plurality of operations that the operator should perform, an area that the operator should watch when performing the operation. The computer can function as a detection unit by executing the program that detects the areas that the operator watches, respectively. The computer can function as a determination unit by executing the program that determines whether the detection unit has detected each area that needs attention stored in the storage unit.

[0012] In addition, the above summary of the invention does not list all the essential features of the present invention. In addition, sub-combinations of these feature groups may also constitute inventions. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 A maintenance management system 1 according to this embodiment is shown.

[0014] Figure 2 The display determination device 17 is shown.

[0015] Figure 3 The operation of the determination device 17 is shown.

[0016] Figure 4 Indicates the display screen.

[0017] Figure 5 An example of a computer 2200 is shown in which various aspects of the present invention may be implemented in whole or in part.

[0018] Description of Reference Numerals

[0019] 1 Maintenance management system, 11 Equipment, 12 Maintenance terminal, 15 Operation control device, 16 Interface device, 17 Determination device, 18 Resource management device, 100 Control network, 171 Input unit, 172 Storage unit, 173 Determination unit, 174 Camera unit, 175 Detection unit, 176 Determination unit, 177 Extraction unit, 178 Notification unit, 179 Input control unit, 180 Display screen, 2200 Computer, 2201 DVD-ROM, 2210 Main controller, 2212 CPU, 2214 RAM, 2216 Graphics controller, 2218 Display device, 2220 Input / output controller, 2222 Communication interface, 2224 Hard disk drive, 2226 DVD-ROM drive, 2230 ROM, 2240 Input / output chip, 2242 Keyboard. DETAILED DESCRIPTION

[0020] The present invention will be described below by way of the embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all combinations of features described in the embodiments are essential to the solution means of the invention.

[0021] Figure 1 The maintenance management system 1 of this embodiment is shown. The maintenance management system 1 performs maintenance management of a factory and includes a plurality of devices 11 , a maintenance terminal 12 , an operation control device 15 , an interface device 16 , a determination device 17 , and a resource management device 18 .

[0022] Here, as factories, in addition to chemical and other industrial factories, there are factories that manage and control wellheads and their surroundings such as gas fields or oil fields, factories that manage and control power generation such as hydropower, thermal power, and nuclear power, factories that manage and control environmental power generation such as solar power or wind power, and factories that manage and control water supply and drainage or dams, etc. Some of the multiple devices 11 and the maintenance terminal 12 can be configured at the site where the process is executed in the factory. For example, there are pipelines that allow the measured fluid to flow, and flow meters that are installed in the pipeline and measure the flow rate of the fluid, etc. at the site. The operation control device 15, other parts of the multiple devices 11, the interface device 16, the determination device 17, and the resource management device 18 can be configured at the management center of the factory.

[0023] The plurality of devices 11 are tools, machines or devices, for example, sensors that measure physical quantities such as pressure, temperature, pH, speed, flow rate, etc. in a factory process, actuators such as valves, flow control valves, on-off valves, pumps, fans, motors, heating devices, cooling devices, etc. that control any physical quantity, sound equipment such as microphones and speakers that collect abnormal sounds in the factory or issue alarms, position detection equipment that outputs position information of each device 11, pipes that allow fluid to flow, switches, cameras, PCs (Personal Computers), etc. that are arranged in a room such as a management center, or other equipment. Each device 11 in the plurality of devices 11 may be of a different type, or at least two or more devices 11 may be of the same type.

[0024] At least some of the plurality of devices 11 can be connected to the operation control device 15 via the control network 100 in a wired or wireless manner. The communication within the control network 100 can be digital communication or a mixed communication in which a digital signal is superimposed on an analog signal (4-20 mA signal, etc.), and can be at a speed of about 1000 bps to 10000 bps (1200 bps, 2400 bps as an example). The communication within the control network 100 can be performed, for example, by a wireless communication protocol of ISA (International Society of Automation), and can be performed, for example, by ISA100, HART (Highway Addressable Remote Transducer) (registered trademark), BRAIN (registered trademark), FOUNDATION Fieldbus, PROFIBUS, etc.

[0025] Each device 11 may have inherent identification information (also referred to as device inherent information). The device inherent information is information used to uniquely identify the device 11. In this embodiment, as an example, it may be at least one of a serial number assigned to the device 11 through a communication protocol (as an example, HART), a serial number set by the manufacturer of the device 11, and a device ID assigned by a user.

[0026] The maintenance terminal 12 accesses the setting parameters of some of the multiple devices 11 to refer to, set, and change the setting parameter values. The maintenance terminal 12 may be a handheld terminal (HHT) carried by a field operator (for example, a smartphone or a tablet PC), or may be a fixed PC. When the maintenance terminal 12 is a handheld terminal, the maintenance terminal 12 may be detachably connected to the device 11.

[0027] The operation control device 15 communicates with some of the multiple devices 11 to control the process. For example, the operation control device 15 obtains a process value as measurement data from the device 11 as a sensor and drives the device 11 as an actuator. In addition, the operation control device 15 can supply the process value to the interface device 16 and receive the target value of the process value from the interface device 16. In addition, in this embodiment, as an example, it is explained that the maintenance management system 1 is equipped with one operation control device 15 to control multiple devices 11, but it is also possible to have multiple operation control devices 15, each of which performs distributed control on a part of the devices 11. The operation control device 15 can be an FCS (Field Control Station) as an example.

[0028] The interface device 16 displays various data in the factory on the display screen and provides an interface between the operator and the factory. The interface device 16 can control the process of the factory through the operation control device 15 according to the operation of the operator. For example, the interface device 16 can receive the process value from the operation control device 15 and supply the target value of the process value to the operation control device 15. In addition, the interface device 16 can change the setting parameter value of the device 11 through the operation control device 15. In addition, the interface device 16 can store at least a part of the device 11 in association with the setting parameter value of the device 11. As an example, the interface device 16 can be an HIS (Human Interface Station) and can be composed of a PC or the like.

[0029] The determination device 17 is an example of a device that performs various determinations regarding operations in the factory. For example, the determination device 17 can detect the area viewed by the operator and determine whether the operator in the factory has performed a predetermined operation. As an example, the determination device 17 can be composed of a wearable device with a line of sight detection function such as an eye tracker, a PC, a camera, etc. In this embodiment, the determination device 17 is communicatively connected to the factory's equipment 11, resource management device 18, interface device 16, operation control device 15, and maintenance terminal 12 (hereinafter also referred to as external devices), but it may not be connected to the external device.

[0030] The resource management device 18 performs online monitoring and centralized management of the factory. For example, the resource management device 18 can manage data (for example, setting parameter values ​​or process values) of the equipment 11 acquired by the operation control device 15. The resource management device 18 can be composed of a PC or the like.

[0031] Figure 2 The determination device 17 is shown. The determination device 17 includes an input unit 171 , a storage unit 172 , a determination unit 173 , an imaging unit 174 , a detection unit 175 , a determination unit 176 , an extraction unit 177 , a notification unit 178 , and an input control unit 179 .

[0032] The input unit 171 receives input related to the operation from the operator or an external device. The input unit 171 can receive input operations of completion of the operation from the operator for each of the plurality of operations. The input unit 171 can receive input indicating a prescribed status related to the operation or the factory from the operator. The input unit 171 can receive various data from an external device existing in the factory in a wired or wireless manner. The input unit 171 can include at least one of a keyboard, a touch panel, a communication terminal, and a button. The input unit 171 can supply the input content to the determination unit 173.

[0033] Here, the status may include at least one of the entry and exit of an operator in a predetermined space (for example, a building or room such as a management center), arrival at a predetermined time, and detection of an abnormality in a process value of a plant device 11.

[0034] The operation may be an action that the operator should perform under various conditions. As an example, the operation may include turning off or on the power of the device 11, opening or closing a window, exiting from a predetermined area, entering a predetermined area, various operations of the device 11, checking an area of ​​at least a portion of the display screen of the device 11, and confirming whether at least one of these actions has been performed.

[0035] The storage unit 172 stores one or more areas (also referred to as areas requiring attention) that the operator should watch when performing a plurality of operations that the operator should perform. The storage unit 172 can store data that is input in advance by the operator or the like via the input unit 171. The data includes status data that respectively indicate the status of the operations that should be performed, operation data that respectively indicate the operations, and area data that respectively indicate areas requiring attention. The storage unit 172 can also store the order in which the operations should be performed for a plurality of operations. The storage unit 172 can store the status, the operations, the order of the operations, and the areas requiring attention for each operation in association. The storage unit 172 can have a table for the association.

[0036] Here, the area requiring attention may be an area where the equipment 11 in the factory is installed, an area surrounded by a coordinate range in a room of a management center, or an area surrounded by a coordinate range on a display screen of an external device or a determination device. The area data of the area requiring attention may be at least one of the coordinate range and the device-specific information of the equipment 11. In addition, the area requiring attention may also be any one of a plurality of windows in the display screen. In this case, the area data of the area requiring attention may represent a coordinate range in the display screen or any one of the windows.

[0037] The determination unit 173 determines the area that the operator should watch when performing each of the multiple operations that the operator should perform. The determination unit 173 can determine the multiple operations based on the status input from the input unit 171. The determination unit 173 can obtain operation data representing the multiple operations and area data representing the area that needs attention from the storage unit 172. The determination unit 173 can supply the area data to the determination unit 176, and supply the operation data and area data to the extraction unit 177. The determination unit 173 can supply various data to the extraction unit 177 together with the input content of the input unit 171.

[0038] The camera unit 174 photographs the operator. The camera unit 174 may photograph a part of the operator (eyeball, head, etc.). The camera unit 174 may be a glasses-type wearable device, a camera provided on the periphery of the display screen of the determination device 17 or an external device, or a surveillance camera provided on the ceiling or wall of a management center, etc. The camera unit 174 supplies the photographed data to the detection unit 175.

[0039] The detection unit 175 detects the area viewed by the operator (also referred to as the visual recognition area). The detection unit 175 can detect the area viewed by the operator by detecting the line of sight of the operator. The detection unit 175 can detect the line of sight by analyzing the image supplied from the camera unit 174. The detection unit 175 can detect the gaze position of both eyes based on the image of the eyeball, and detect the straight line connecting the middle point of both eyes and the gaze position of the operator as the line of sight of the operator. The detection unit 175 can detect the orientation of the operator's head based on the position of the operator's eyes, nose, mouth, etc., and detect the straight line of the detected orientation as the line of sight of the operator. The detection unit 175 can use the area on the detected line of sight as the visual recognition area. The detection unit 175 can further detect the position of the operator based on GPS or an image, and detect the visual recognition area based on the position.

[0040] The detection unit 175 may further detect the area in the display screen of the device 11 that the operator is viewing. The detection unit 175 may detect the intersection of the operator's line of sight and the display screen as the position in the display screen that the operator is viewing, and detect the area including the position as the visual recognition area. The detection unit 175 may supply area data representing the visual recognition area to the determination unit 176. The area data supplied by the detection unit 175 may be in the same format as the area data of the area requiring attention stored in the storage unit 172.

[0041] Here, the visual recognition area may be an area surrounded by a coordinate range. In addition, when multiple windows are displayed in the display screen of the external device or the determination device, the visual recognition area may also be any one of the windows. In this case, the area data of the visual recognition area may represent the coordinate range in the display screen, or may represent any one of the windows. The visual recognition area may be an area narrower than the area to be concerned, an area of ​​the same width as the area to be concerned, or an area wider than the area to be concerned.

[0042] The determination unit 176 determines whether the detection unit 175 has detected each area requiring attention stored in the storage unit 172. The determination unit 176 may determine, for each operation, whether the detection unit 175 has detected the area requiring attention corresponding to the operation. When at least a portion of the visual recognition area supplied from the detection unit 175 coincides with at least a portion of the area requiring attention, the determination unit 176 may determine that the detection unit 175 has detected the area requiring attention. The determination unit 176 may supply the determination result indicating the area requiring attention detected by the detection unit 175 (also referred to as the detected area requiring attention) to the extraction unit 177. For example, the determination unit 176 may supply the area data of the detected area requiring attention to the extraction unit 177.

[0043] The extraction unit 177 extracts an area not detected by the detection unit 175 (also referred to as an undetected area requiring attention) from among the plurality of areas requiring attention stored in the storage unit 172. The extraction unit 177 may supply at least one of the area data of the undetected area requiring attention and the operation data of the operation corresponding to the undetected area requiring attention to the notification unit 178. After supplying the data of the undetected area requiring attention to the notification unit 178, when the area data of the undetected area requiring attention is received from the determination unit 176 (i.e., when the determination unit 176 determines that the operator has viewed the undetected area requiring attention), the extraction unit 177 may supply a signal indicating that the operation corresponding to the undetected area requiring attention has been performed to the notification unit 178. The extraction unit 177 may supply a signal indicating that all areas requiring attention have been detected to the input control unit 179 for each operation or each situation.

[0044] The notification unit 178 notifies the operator that the operation corresponding to the area extracted by the extraction unit 177 is not performed. The notification unit 178 can notify the operator of the operation corresponding to the undetected area requiring attention received from the extraction unit 177. The notification unit 178 can notify the operator through at least one of sound, display, vibration, etc. For example, the notification unit 178 can have a display screen, and the undetected area requiring attention or the operation corresponding to the undetected area requiring attention can be displayed on the display screen.

[0045] The input control unit 179 controls the input unit 171 based on the determination result of the determination unit 176. The input control unit 179 recognizes the input of completion of the job through the input unit 171 for each of the plurality of jobs, based on the determination by the determination unit 176 that the area corresponding to the job is detected. The input control unit 179 may recognize the input through the input unit 171 for each of the plurality of jobs, based on the completion of other jobs that should be completed before the job and the determination by the determination unit 176 that the area corresponding to the job is detected. The input control unit 179 may recognize the input through the input unit 171 when all the areas requiring attention are detected for each situation or each job. As an example, if it is determined that all or part of the areas requiring attention for a plurality of jobs in one situation have been detected, the input control unit 179 may send a recognition signal to the input unit 171 and recognize the next input.

[0046] Figure 3 The operation of the determination device 17 is shown. The determination device 17 supports the maintenance management of the factory by performing the processing of steps S11 to S21. In addition, this operation can be started when the factory is started.

[0047] In step S11, the determination device 17 determines whether the condition for starting the determination is satisfied. If the operator inputs a specified condition via the input unit 171, the determination device 17 can start the determination action. In addition, if a signal indicating the start of the determination is received from an external device present in the factory via the input unit 171, the determination device 17 can start the determination action. In addition, the determination device 17 can start the determination action when a predetermined time is reached or when the power of the determination device 17 is turned on. When the condition for starting the determination is satisfied (step S11; yes), the process can be transferred to step S13. When the condition for starting the determination is not satisfied (step S11; no), it is possible to wait until the condition is satisfied.

[0048] In step S13, the determination unit 173 determines the area requiring attention. As an example, if data indicating the status of exiting from "Room a" in "Building B" of the factory is received from the input unit 171, the determination unit 173 accesses the storage unit 172 to obtain one or more operation data and area data corresponding to the exit. In this case, as an example, the operation may be to disconnect the power of the equipment 11 (lighting, PC, etc.) in Room a, the operator closes the door of Room a, and the operator views a specific area of ​​the display screen of the equipment 11 in Room a. The area requiring attention corresponding to the operation may be the setting area of ​​the equipment 11 that is disconnected from the power supply, the door of Room a, and a specific window in the display screen.

[0049] In step S15 , the detection unit 175 detects the line of sight of the operator based on the data supplied from the imaging unit 174 to detect the visual recognition area.

[0050] In step S17, the determination unit 176 determines whether the operator is viewing the region requiring attention. In the present embodiment, as an example, the determination unit 176 may determine whether the region requiring attention is consistent with the visual recognition region. When a region requiring attention is consistent with multiple visual recognition regions, the determination unit 176 may indicate to the extraction unit 177 that the region requiring attention is detected each time they are consistent.

[0051] In this embodiment, as an example, viewing the region requiring attention may mean viewing the region requiring attention at least once within a first reference time width (as an example, 1 minute) until the current moment. Viewing the region requiring attention once may mean that the line of sight is located in the region requiring attention for a second reference time width (as an example, 0.5 seconds). This second reference width may be a period in which each of the multiple regions requiring attention is different. In this case, the storage unit 172 may store the first reference width corresponding to the region requiring attention.

[0052] When there are a plurality of attention-demanding regions, the determination unit 176 may determine whether the plurality of attention-demanding regions are viewed respectively. Viewing the plurality of attention-demanding regions respectively may mean that each attention-demanding region is viewed at least once within the first reference time width up to the current time.

[0053] In step S19, the extracting unit 177 extracts the work corresponding to the undetected attention region. The extracting unit 177 may compare the region data of the plurality of attention regions received from the determining unit 173 with the detected attention regions received from the determining unit 176 to extract the attention regions not detected by the detecting unit 175.

[0054] As an example, the extraction unit 177 may extract an undetected area requiring attention from among a plurality of areas requiring attention corresponding to the condition during a period from the input of the condition (start of the determination operation) to the third reference width (10 minutes as an example). The extraction unit 177 may supply the area data of the undetected area requiring attention (or the operation data corresponding to the area data) to the notification unit 178 after the period of the third reference width has passed since the input of one condition. After supplying the area data of the undetected area requiring attention to the notification unit 178, the extraction unit 177 may supply a signal indicating that the undetected area requiring attention has been detected to the notification unit 178 when receiving a signal (area data) indicating that the undetected area requiring attention has been detected (seen by the operator) from the determination unit 176. Here, the third reference width may be the same as or different from the first reference width. The third reference width may be a period that is different for each condition, in which case the storage unit 172 may store the third reference width corresponding to each condition.

[0055] In addition, the extraction unit 177 can determine for each operation or each situation whether multiple operations are performed in the order in which they should be performed. The extraction unit 177 can determine whether the area requiring attention corresponding to the operation is detected in the order in which the multiple operations should be performed. The extraction unit 177 can determine that the area requiring attention detected in a different order is not detected. As an example, in the case where three operations should be performed in the order of A, B, and C, if it is determined in the determination unit that the area requiring attention a corresponding to operation A, the area requiring attention c corresponding to operation C, and the area requiring attention b corresponding to operation B are detected in the order, the extraction unit 177 can determine that the area requiring attention c is not detected.

[0056] Furthermore, if a plurality of conditions are input to the input unit 171, the extraction unit 177 may determine whether one or more operations have been performed in the order in which the conditions are input or in a predetermined order for the conditions. For example, if two conditions I and II are sequentially input to the input unit 171, the extraction unit 177 may extract the undetected areas requiring attention for condition II for the areas requiring attention detected after all the operations corresponding to the initial condition I are completed (i.e., the areas requiring attention corresponding to all the operations are detected or the input of the completion of the operations is performed for all the operations).

[0057] If the extraction unit 177 determines that all attention-required regions corresponding to the input situation are detected (step S19; Yes), the process may proceed to step S11. If it determines that at least a portion of the attention-required region is not detected (step S19; No), the process may proceed to step S21.

[0058] In step S21, the notification unit 178 may display at least one of the undetected area requiring attention extracted by the extraction unit 177, the range of the undetected area requiring attention, and the operation corresponding to the undetected area requiring attention on the display screen of the determination device 17 or an external device of the factory.

[0059] When the undetected area requiring attention is a specific area of ​​the display screen of the determination device 17 or the display screen of the external device, as an example, the notification unit 178 may change at least one of the display position, display color, brightness, display size, character decoration, display color or display size of each area of ​​the display screen, and text in each area, to indicate the undetected area requiring attention. When the display mode of the area requiring attention is changed, the notification unit 178 may return the display mode of the area requiring attention to the state before the change, according to the consistency between the area requiring attention and the visual recognition area.

[0060] The notification unit 178 may end the notification operation in response to receiving a signal indicating that an undetected attention-required region has been detected from the extraction unit 177 , or in response to the operator inputting a completion of the work on the input unit 171 .

[0061] In step S21, if a signal indicating that all the areas requiring attention are detected for each condition or each operation is received from the extraction unit 177, the input control unit 179 recognizes the input of the operation completion performed by the operator. The input control unit 179 can disable the input from the input unit 171 until the signal is received. As an example, if the signal is received, the input control unit 179 can recognize the input by switching the operation completion button in the input unit 171 from non-display to display or by highlighting the operation completion button.

[0062] The determination device 17 may return to step S15 and detect the visually recognizable area after the notification by the notification unit 178 or while the notification continues.

[0063] According to the above operation, it is possible to determine whether the operator has performed the work determined according to the situation by using the line of sight, and the operator can be made to perform the work reliably.

[0064] Figure 4 The display screen 180 is shown as an example of a region requiring attention. The display screen 180 may be a display screen of the determination device 17 or a display screen of an external device in the factory. In this case, the camera unit 174 may be provided at the end of the display screen 180 to capture the eyes of the operator viewing the display screen 180 in order to detect the line of sight.

[0065] The process values ​​of a part of the devices 11 selected by the operator among the devices 11 in the factory can be displayed on the display screen 180. For example, a selection area 1641 for selecting the installation area of ​​the device 11 in the factory and a data display area 1642 for displaying the process values ​​of the devices 11 belonging to the selected installation area can be provided on the display screen 180. When an abnormality occurs in the process value of any device 11 and the determination device 17 determines that the operator is not viewing the area to be viewed, the notification unit 178 can change the display method of the data display area 1642 of the process value.

[0066] In this figure, as an example, the building and room in the factory are displayed as the option of the installation area of ​​the device 11 in the selection area 1641, and "Room a" of "Building B" is selected, and the history of the process values ​​of "Device (1)" to "Device (4)" installed in the installation area is displayed in the data display area 1642 (1) to 1642 (4). In addition, when the process value of "Device (1)" is abnormal and the data display area 1642 (1) becomes the area requiring attention, since the operator's visual recognition area 1643 is located in the data display area 1642 (2), the background color of the data display area 1642 (1) is changed under the control of the notification unit 178.

[0067] In addition, the camera unit 174 may be mounted on the operator (e.g., head, shoulder, etc.) to capture the direction the operator is facing. For example, the camera unit 174 may capture a code (e.g., a barcode, a QR code (registered trademark)) mounted on the device 11, and the detection unit 175 may identify the device 11 through the code, and the determination unit 176 may determine that the detection unit 175 has detected the area requiring attention corresponding to the device 11.

[0068] In addition, the determination device 17 may not have the camera unit 174. In this case, the detection unit 175 may receive data for detecting the operator's line of sight from an external device (such as a wearable device, a camera, etc.).

[0069] Furthermore, the determination device 17 may be a part of the plant equipment 11 , the resource management device 18 , the interface device 16 , the operation control device 15 , or the maintenance terminal 12 .

[0070] In addition, various embodiments of the present invention may be described with reference to flow charts and block diagrams, where a module may represent (1) a stage of a process for performing an operation or (2) a portion of a device having the function of performing an operation. Specific stages and portions may be implemented by dedicated circuits, programmable circuits supplied together with computer-readable instructions stored on a computer-readable medium, and / or processors supplied together with computer-readable instructions stored on a computer-readable medium. Dedicated circuits may include digital and / or analog hardware circuits, and may also include integrated circuits (ICs) and / or discrete circuits. Programmable circuits may include reconfigurable hardware circuits, which include logical AND, logical OR, logical XOR, logical NAND, logical NOR and other logical operations, flip-flops, registers, field programmable gate arrays (FPGAs), programmable logic arrays (PLAs) and other memory elements, etc.

[0071] Computer-readable media may include any tangible device capable of storing instructions executed by an appropriate device, and as a result, a computer-readable medium having instructions stored therein includes a product containing instructions that can be executed in order to make a means for performing the operations specified by the flowchart or block diagram. Examples of computer-readable media may include: electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, etc. More specific examples of computer-readable media may include: floppy (registered trademark) disks, magnetic disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), electrically erasable programmable read-only memories (EEPROM), static random access memories (SRAM), compact disk read-only memories (CD-ROM), digital versatile disks (DVD), Blu-ray (RTM) disks, memory sticks, integrated circuit cards, etc.

[0072] Computer readable instructions include any of source code and object code described by any combination of one or more programming languages ​​including assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or object-oriented programming languages ​​such as Smalltalk (registered trademark), JAVA (registered trademark), C++, and existing procedural programming languages ​​such as the "C" programming language or similar programming languages.

[0073] The computer readable instructions may be provided to a processor or programmable circuit of a general-purpose computer, a special-purpose computer or other programmable data processing device via a local or local area network (LAN), a wide area network (WAN) such as the Internet, and the computer readable instructions are executed to produce a means for performing the operations specified by the flowchart or block diagram. Examples of processors include: computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, etc.

[0074] Figure 5 The computer 2200 is an example of a computer that can implement various modes of the present invention in whole or in part. The computer 2200 can perform operations associated with the device of the embodiment of the present invention or functions of one or more parts of the device, or perform the operations or the one or more parts, and / or the computer 2200 can perform processes of the embodiment of the present invention or stages of the processes, through the program installed in the computer 2200. In order to make the computer 2200 perform specific operations associated with some or all of the modules in the flowcharts and block diagrams described in this specification, the CPU 2212 can execute such a program.

[0075] The computer 2200 of this embodiment includes a CPU 2212, a RAM 2214, a graphic controller 2216, and a display device 2218, which are connected to each other through a main controller 2210. The computer 2200 also includes an input / output unit such as a communication interface 2222, a hard disk drive 2224, a DVD-ROM drive 2226, and an IC card drive, which are connected to the main controller 2210 via an input / output controller 2220. The computer also includes a conventional input / output unit such as a ROM 2230 and a keyboard 2242, which are connected to the input / output controller 2220 via an input / output chip 2240.

[0076] The CPU 2212 controls each unit by operating according to the program stored in the ROM 2230 and the RAM 2214. The graphic controller 2216 acquires image data generated by the CPU 2212 in a frame buffer or the like provided in the RAM 2214 or in itself, and displays the image data on the display device 2218.

[0077] The communication interface 2222 can communicate with other electronic devices via a network. The hard disk drive 2224 stores programs and data used by the CPU 2212 in the computer 2200. The DVD-ROM drive 2226 reads programs or data from the DVD-ROM 2201 and provides the programs or data to the hard disk drive 2224 via the RAM 2214. The IC card drive reads programs and data from an IC card and / or writes programs and data to an IC card.

[0078] The ROM 2230 stores therein a boot program or the like executed by the computer 2200 upon activation and / or a program that depends on the hardware of the computer 2200. The input / output chip 2240 may also connect various input / output units to the input / output controller 2220 via a parallel port, a serial port, a keyboard port, a mouse port, and the like.

[0079] The program is provided by a computer-readable medium such as DVD-ROM 2201 or an IC card. The program is read from the computer-readable medium and installed in the hard disk drive 2224, RAM 2214 or ROM 2230, which is also an example of a computer-readable medium, and is executed by the CPU 2212. The information processing described in these programs is read to the computer 2200, thereby bringing about cooperation between the program and the various types of hardware resources described above. The device or method can be constituted by realizing the operation or processing of information with the use of the computer 2200.

[0080] For example, when communication is performed between the computer 2200 and an external device, the CPU 2212 can execute a communication program loaded in the RAM 2214, and instruct the communication interface 2222 to perform communication processing based on the processing described in the communication program. Under the control of the CPU 2212, the communication interface 2222 reads the transmission data stored in the transmission buffer processing area provided in the RAM 2214, the hard disk drive 2224, the DVD-ROM 2201, or a recording medium such as an IC card, and transmits the read transmission data to the network, or writes the reception data received from the network to the reception buffer processing area provided on the recording medium, etc.

[0081] Furthermore, the CPU 2212 can read all or a necessary part of a file or database stored in an external recording medium such as the hard disk drive 2224, the DVD-ROM drive 2226 (DVD-ROM 2201), or an IC card into the RAM 2214, and perform various types of processing on the data on the RAM 2214. Then, the CPU 2212 writes the processed data back to the external recording medium.

[0082] Various types of information such as various types of programs, data, tables, and databases can be stored in the recording medium and receive information processing. CPU2212 performs various types of processing described in various places of this disclosure on the data read from RAM2214 and writes the results back to RAM2214. The various types of processing include various types of operations specified by the instruction sequence of the program, information processing, conditional judgment, conditional branching, unconditional branching, information retrieval / replacement, etc. In addition, CPU2212 can retrieve information in files, databases, etc. in the recording medium. For example, in the case where multiple entries having attribute values ​​of the first attribute associated with the attribute values ​​of the second attribute are stored in the recording medium, CPU2212 can retrieve an entry consistent with the condition specifying the attribute value of the first attribute from the multiple entries, and read the attribute value of the second attribute stored in the entry, thereby obtaining the attribute value of the second attribute associated with the first attribute that meets the predetermined condition.

[0083] The program or software module described above may be stored in a computer-readable medium on or near the computer 2200. In addition, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable medium, thereby providing the program to the computer 2200 via the network.

[0084] The present invention has been described above using the embodiments, but the technical scope of the present invention is not limited to the scope described in the above embodiments. It is obvious to those skilled in the art that various changes or improvements can be made to the above embodiments. According to the description of the claims, the method of making such changes or improvements can also be included in the technical scope of the present invention.

[0085] The execution order of each process such as actions, processes, steps and stages in the apparatus, system, program and method shown in the claims, specifications and drawings is not specifically indicated as "earlier", "before", etc. In addition, it should be noted that as long as the output of the previous process is not used in the subsequent process, it can be implemented in any order. Even if the action flow in the claims, specifications and drawings is described using "first," "next," etc. for the sake of convenience, it does not mean that it must be implemented in this order.

Claims

1. A determination device, Features include: A storage unit that stores, in association with each of a plurality of tasks that the operator should perform, a region that requires attention that the operator should watch when performing the task; A detection unit, for respectively detecting the area viewed by the operator; a determination unit, configured to determine whether the detection unit has detected each area requiring attention stored in the storage unit; an extracting unit that extracts an area not detected by the detecting unit from among the plurality of areas stored by the storing unit; as well as a notification unit that notifies the operator that a work corresponding to the area extracted by the extraction unit has not been performed, When the determination unit determines that the attention-requiring region is viewed by the operator, the extraction unit supplies a signal indicating that a work corresponding to the attention-requiring region has been performed to the notification unit.

2. The determination device according to claim 1, It is characterized in that The determination unit determines, for each job, whether the detection unit has detected a region corresponding to the job.

3. The determination device according to claim 1 or 2, Features Also includes: An input unit that receives an input operation of completion of each of the plurality of tasks from the operator; as well as The input control unit approves the input of the input unit for each of the plurality of jobs, based on the determination by the determination unit that the area corresponding to the job is detected.

4. The determination device according to claim 3, It is characterized in that The storage unit further stores, for each of the plurality of tasks, an order in which the task should be performed. The input control unit approves the input of the input unit for each of the plurality of jobs, based on the completion of another job that should be completed before the job and the determination unit determining that the area corresponding to the job is detected.

5. The determination device according to claim 1 or 2, It is characterized in that The area requiring attention that the operator should watch is the setting area of ​​the equipment.

6. The determination device according to claim 1 or 2, It is characterized in that The area of ​​interest that the operator should view is an area within the room surrounded by a coordinate range, or an area on the display screen surrounded by a coordinate range.

7. A determination method, Features include: In a storage stage, a region requiring attention that the operator should watch when performing each of a plurality of tasks that the operator should perform is stored in association with the region requiring attention that the operator should watch when performing the task; In the detection stage, the areas viewed by the operator are detected respectively; A determination stage, determining whether each area requiring attention stored in the storage stage is detected in the detection stage; An extraction stage, extracting an area not detected in the detection stage from among the plurality of areas stored in the storage stage; as well as a notification stage of notifying the operator that work corresponding to the area extracted in the extraction stage has not been performed, If it is determined in the determination stage that the operator has viewed the attention-requiring region, a signal indicating that an operation corresponding to the attention-requiring region has been performed is supplied in the extraction stage.

8. A recording medium having a program recorded thereon, It is characterized in that The computer executes the program to function as a storage unit, a detection unit, a determination unit, an extraction unit, and a notification unit. The storage unit stores, in association with each of a plurality of tasks to be performed by the operator, a region requiring attention that the operator should watch when performing the task. The detection unit detects the area viewed by the operator respectively. The determination unit determines whether the detection unit has detected each of the attention-requiring regions stored in the storage unit. The extracting unit extracts an area not detected by the detecting unit from among the plurality of areas stored in the storing unit, the notifying unit notifies the operator that work corresponding to the area extracted by the extracting unit is not being performed, When the determination unit determines that the attention-requiring region is viewed by the operator, the extraction unit supplies a signal indicating that a work corresponding to the attention-requiring region has been performed to the notification unit.

Images