Programmable display, apparatus management system, apparatus management method, and program

Abstract

A programmable display (10) comprises a display unit (120) that displays video that has been captured of a space, a setting unit (102) that sets a stay area within the video, and a restriction unit (104) that restricts the operations of a target apparatus when it has been detected that an operator is not within the stay area.

Description

Programmable display, device management system, device management method, and program ,

[0009]

[0001] The present disclosure relates to a programmable display, a device management system, a device management method, and a program.

[0002] Techniques for restricting the operation of a device when a user is away from the device are known. For example, Patent Document 1 discloses a technique for restricting the operation of a multifunction device by executing a temporary logout process on the multifunction device when the user is away from the multifunction device.

[0003] Japanese Patent Application Laid-Open No. 2015-045916

[0004] Even in a production site, there is a need for a technique for restricting the operation of target devices related to an operator's work when the operator is absent. For example, it is conceivable to apply the technique described in Patent Document 1 to devices in a production site. <00000in09>

[0005] However, in the technique of Patent Document 1, since the temporary logout process is executed only based on the distance from the user to the multifunction device, there is a possibility that the temporary logout process may be executed against the user's intention, which is inconvenient.

[0006] An object of the present disclosure is to provide a programmable display, a device management method, and a program capable of restricting the operation of a target device when an operator is absent without impairing the convenience of the operator in view of the above circumstances.

[0007] To achieve the above object, a programmable display according to the present disclosure includes: display means for displaying an image obtained by imaging a space; setting means for setting a stay area within the image; and restriction means for restricting the operation of a target device when it is detected that an operator is absent within the stay area.

[0008] According to the present disclosure, it is possible to restrict the operation of a target device when an operator is absent without impairing the convenience of the operator.

[0009] A diagram showing the overall configuration of the equipment management system according to Embodiment 1 of this disclosure. A diagram schematically showing an example of a dwelling area setting screen displayed by the programmable display according to Embodiment 1 of this disclosure. A block diagram explaining the functional configuration of the programmable display according to Embodiment 1 of this disclosure. A diagram showing an example of the hardware configuration of the programmable display according to Embodiment 1 of this disclosure. A flowchart showing an example of dwelling area setting processing by the programmable display according to Embodiment 1 of this disclosure. A flowchart showing an example of operation restriction processing by the programmable display according to Embodiment 1 of this disclosure. A diagram showing the overall configuration of the equipment management system according to Embodiment 2 of this disclosure. A diagram schematically showing an example of a dwelling area setting screen displayed by the programmable display according to Embodiment 2 of this disclosure. A diagram schematically showing an example of a dwelling area setting screen displayed by the programmable display according to Modification 3 of this disclosure. A block diagram explaining the functional configuration of the programmable display according to Modification 4 of this disclosure.

[0010] Hereinafter, a programmable display according to an embodiment of the present disclosure will be described with reference to the drawings. In each drawing, the same or equivalent parts are denoted by the same reference numerals.

[0011] (Embodiment 1) The equipment management system 1 according to Embodiment 1 will be described with reference to Figure 1. The equipment management system 1 comprises a programmable display 10, a camera 20, and a PLC (Programmable Logic Controller) 30. The programmable display 10, camera 20, and PLC 30 are installed in the production site space R within the factory. The programmable display 10 is communicatively connected to the camera 20 and the PLC 30. The camera 20 captures images of the production site space R. The worker W using the programmable display 10 enters and exits the production site space R and moves within the production site space R. As will be described later, the production site space R is also equipped with equipment, furniture, etc. other than the programmable display 10, camera 20, and PLC 30, but these are omitted from Figure 1. The PLC 30 is connected to field equipment (not shown) installed in the production site and manages said field equipment. The equipment management system 1 is an example of an equipment management system according to the present disclosure.

[0012] The programmable display 10 manages the PLC 30 and the field devices under the control of the PLC 30. The worker W remains in front of the screen of the programmable display 10 during work. The worker W can manage the PLC 30 and field devices by checking the display screen of the programmable display 10 and operating it as needed. The programmable display 10, camera 20, and PLC 30 are connected via, for example, a factory network. However, these devices are not limited to this; they may also be connected via direct communication lines or via wireless communication. The programmable display 10 is an example of a programmable display and target device according to this disclosure.

[0013] The programmable display 10 displays information about the equipment to be managed and a management screen that accepts operations for equipment management only when the operator W performs a login operation to the programmable display 10. Until the operator W performs a login operation, the programmable display 10 displays a login screen that only accepts login operations and does not display any information about the equipment to be managed.

[0014] As described later, when the programmable display 10 detects that worker W is not in the designated waiting area, it restricts its own operation. The restriction of operation is, for example, by executing an automatic logout process that forcibly logs out worker W who is logged into the programmable display 10, thereby ending the display of the management screen and switching to the login screen. As a result, the management screen is not displayed and operations for equipment management are not accepted, thus restricting the operation of the programmable display 10. Alternatively, instead of the automatic logout process, the operation of the programmable display 10 may be restricted by executing a lock process that switches to a lock screen that only accepts unlock operations. Or, if worker W's absence could become a serious incident, the programmable display 10 may restrict its operation by executing a shutdown process that ends its own operation. Restricting the operation of the programmable display 10 also limits the functions that the programmable display 10 can perform. In the following description, unless otherwise specified, the restriction of the programmable display 10's operation is assumed to be the execution of the automatic logout process.

[0015] Camera 20 is installed to image the production site space R such that the programmable display 10 is included in the imaging range. Camera 20 images the production site space R at regular intervals and transmits the image data showing the captured image to the programmable display 10. Regular intervals are short periods of time, such as 1 / 30th of a second or 1 / 60th of a second. Camera 20 continuously transmits the image data to the programmable display 10 at these short intervals, and the programmable display 10 processes the continuously transmitted image data as video obtained by imaging the production site space R. Production site space R is an example of the space according to this disclosure. Camera 20 is an example of the imaging means according to this disclosure.

[0016] The PLC 30 manages field equipment (not shown) installed in the production area. The PLC 30 is, for example, communicatively connected to sensors and drive devices, and controls the drive devices according to the sensor output. The PLC 30 communicates with the programmable display 10 and receives control in accordance with the operation of the programmable display 10 by the worker W. Note that the PLC 30 may be installed in a different space from the space where the programmable display 10 and camera 20 are installed.

[0017] Referring to Figure 2, the setting of the dwelling area A using the programmable display 10 will be explained in general terms. Figure 2 schematically shows an example of the dwelling area setting screen V displayed by the programmable display 10. The dwelling area setting screen V displays the image of the production site space R captured by the camera 20 and is a screen for setting the dwelling area A on the screen. In Figure 2, equipment, fixtures, etc. other than the programmable display 10 are indicated by diagonal lines.

[0018] Operator W can set a dwelling area A in the video, as shown in Figure 2, by, for example, specifying the vertices of the area to be set as dwelling area A on the programmable display 10 using touch operations. Although Figure 2 shows a rectangular area, the number of vertices to be specified can be any number of three or more, and a polygonal area corresponding to the number of vertices can be set as dwelling area A. In addition to specifying vertices, a rectangular area can also be specified by, for example, drag-and-drop operations on the screen.

[0019] The dwelling area setting screen V displays video of the production site space R. However, displaying video from the time of setting would include worker W in the video, which could be inconvenient when setting dwelling area A. Therefore, by making it possible to display past video on the dwelling area setting screen V, dwelling area A can be set within video where worker W is not visible, as shown in Figure 2. Conversely, if it is more convenient for worker W to be visible in the video, then the current video or past video in which worker W is visible should be displayed.

[0020] The programmable display 10 continuously analyzes the video and, when it detects that worker W is not present in dwelling area A within the video, it performs an automatic logout to restrict the operation of the programmable display 10.

[0021] As described above, the programmable display 10 allows the worker W to freely set the dwelling area A within the video. When the worker W is not in the dwelling area A, the programmable display 10 performs an automatic logout process to restrict the operation of the programmable display 10 itself. For example, as shown in Figure 2, the worker W can set the area including the programmable display 10 as the dwelling area A, thereby automatically restricting the operation of the programmable display 10 when the worker W leaves the programmable display 10. Since the dwelling area A can be set according to the worker W's will, automatic logout processing against the worker's intentions can be prevented, and convenience is not compromised.

[0022] The functional configuration of the programmable display 10 will be explained with reference to Figure 3. The programmable display 10 comprises a control unit 100, a communication unit 110, a display unit 120, an input unit 130, and a storage unit 140.

[0023] The control unit 100 provides overall control of the programmable display unit 10. The control unit 100 comprises a display control unit 101, a setting unit 102, a video processing unit 103, and a limiting unit 104. Each of these functional units will be described later.

[0024] The communication unit 110 communicates with the camera 20 and the PLC 30. In particular, the communication unit 110 receives captured image data from the camera 20 and outputs it to the control unit 100.

[0025] The display unit 120 displays a display screen based on the control of the display control unit 101. In particular, the display unit 120 displays a dwelling area setting screen V for setting a dwelling area A as shown in Figure 2. In addition, the display unit 120 also displays the login screen, lock screen, etc. The display unit 120 is, for example, a touchscreen including a liquid crystal display. The display unit 120 is an example of a display means according to this disclosure.

[0026] The input unit 130 receives input operations from the operator W and outputs a signal corresponding to the operation to the control unit 100. The input unit 130 includes, for example, an input device such as a touchscreen integrated with the display unit 120 or operation buttons.

[0027] The storage unit 140 stores the captured image data that the camera 20 continuously transmits. The storage unit 140 also stores setting data that indicates the settings set by the setting unit 102. In particular, the setting data includes data indicating the dwelling area A and authentication data necessary for the worker W to log in to the programmable display 10.

[0028] The display control unit 101 controls the display unit 120 to display a display screen on the display unit 120. In particular, the display control unit 101 displays a dwelling area setting screen V on the display unit 120, which includes images obtained by imaging the production site space R based on the image data continuously transmitted by the camera 20. When displaying past images, the display control unit 101 displays past images by referring to the image data stored in the storage unit 140. In addition, the display control unit 101 also displays the login screen, lock screen, etc., on the display unit 120.

[0029] The setting unit 102 performs settings related to the programmable display 10 and stores setting data indicating the settings in the storage unit 140. In particular, when the worker W sets a dwelling area A on the dwelling area setting screen V, the setting unit 102 sets the dwelling area A in the video by storing setting data including data indicating the dwelling area A in the storage unit 140. The setting unit 102 is an example of a setting means according to this disclosure.

[0030] The video processing unit 103 analyzes the current video based on the captured image data continuously transmitted by the camera 20 and detects whether or not a worker W is present in the dwelling area A based on video processing. For example, the video processing unit 103 detects worker W that is visible in the current video using image recognition, image difference, etc., and detects that worker W is present in the dwelling area A if the detected position of worker W is within the dwelling area A. If worker W is detected in the current video but the detected position of worker W is not within the dwelling area A, or if worker W cannot be detected in the current video, the video processing unit 103 detects that worker W is absent from the dwelling area A.

[0031] The limiting unit 104 restricts the operation of the programmable display unit 10 itself by executing the above-mentioned automatic logout process or lock process when the video processing unit 103 detects that the worker W is not present in the dwelling area A. The limiting unit 104 is an example of a limiting means according to the present disclosure.

[0032] An example of the hardware configuration of the programmable display 10 will be explained with reference to Figure 4. The programmable display 10 shown in Figure 4 is implemented, for example, by a microcontroller, which is a type of computer.

[0033] The programmable display unit 10 comprises a processor 1001, a memory 1002, an interface 1003, and a secondary storage device 1004, all of which are connected to each other via a bus 1000.

[0034] The processor 1001 is, for example, a CPU (Central Processing Unit). The processor 1001 reads the operation program stored in the secondary storage device 1004 into the memory 1002 and executes it, thereby realizing each function of the programmable display 10.

[0035] Memory 1002 is a main memory device, for example, composed of RAM (Random Access Memory). Memory 1002 stores the operational program read by the processor 1001 from the secondary memory device 1004. Memory 1002 also functions as working memory when the processor 1001 executes the operational program.

[0036] Interface 1003 is an I / O (Input / Output) interface such as a serial port, a USB (Universal Serial Bus) port, or a network interface.

[0037] The secondary storage device 1004 is, for example, flash memory, an HDD (Hard Disk Drive), or an SSD (Solid State Drive). The secondary storage device 1004 stores the operation program executed by the processor 1001. The functions of the storage unit 140 are realized by the secondary storage device 1004.

[0038] Referring to Figure 5, an example of the dwelling area setting process using the programmable display 10 will be explained. The process shown in Figure 5 is started, for example, when worker W performs an operation to call up the dwelling area setting screen V.

[0039] The display control unit 101 of the control unit 100 of the programmable display unit 10 controls the display unit 120 to display a dwelling area setting screen V that includes an image obtained by capturing the production site space R, as shown in Figure 2 (step S101).

[0040] The setting unit 102 of the control unit 100 awaits an input operation by the worker W to set a dwelling area via the input unit 130 (step S102). For example, the setting unit 102 awaits an input operation to specify dwelling area A on the dwelling area setting screen V shown in Figure 2.

[0041] The setting unit 102 sets the staying area A within the video based on the input operation waited for in step S102 (step S103). Specifically, the setting unit 102 sets the staying area A within the video by storing setting data including data indicating the staying area A specified by the input operation in the storage unit 140. Then, the control unit 100 ends the staying area setting process.

[0042] An example of the operation restriction process by the programmable display 10 will be described while referring to FIG. 6. The process shown in FIG. 6 is started, for example, when the worker W logs in to the programmable display 10 via the login screen or when the lock is released via the lock screen.

[0043] The video processing unit 103 of the control unit 100 analyzes the current video and detects whether the worker W is absent within the staying area A (step S111).

[0044] When the worker W is not absent within the staying area A, that is, when the worker W exists within the staying area A (step S112: No), the control unit 100 repeats the process from step S111.

[0045] When the worker W is absent within the staying area A (step S112: Yes), the restriction unit 104 of the control unit 100 restricts the operation of the programmable display 10 by executing an automatic logout process, a lock process, a shutdown process, etc. (step S113). Then, the control unit 100 ends the operation restriction process.

[0046] As described above, the programmable display 10 according to Embodiment 1 has been described. According to the programmable display 10, when the worker W is absent within the staying area A set by the worker W, the operation of the programmable display 10 is restricted. Since the staying area A can be set according to the will of the worker W himself / herself, it is possible to prevent the operation of the programmable display 10 from being restricted against the intention of the worker W. Therefore, it is possible to restrict the operation of the programmable display 10 when the worker W is absent without impairing the convenience of the worker W.

[0047] (Embodiment 2) While referring to FIG. 7, differences between the device management system 1 according to Embodiment 2 and Embodiment 1 will be described. The device management system 1 according to Embodiment 2 is different from Embodiment 1 in that it further includes a belt conveyor 40 communicably connected to the PLC 30 and controlled by the PLC 30. Also, the operator W is different from Embodiment 1 in that the operator W is a user of the belt conveyor 40. Also, the camera 20 is different from Embodiment 1 in that it is installed to image the production site space R so that the belt conveyor 40, rather than the programmable display 10, is included in the imaging range.

[0048] And the restricting unit 104 of the control unit 100 of the programmable display 10 is different from Embodiment 1 in that it restricts the operation of the belt conveyor 40 instead of the programmable display 10 itself. Specifically, the restricting unit 104 restricts the operation of the belt conveyor 40 by stopping the operation of the belt conveyor 40 via the communication unit 110 and the PLC 30. In Embodiment 2, the belt conveyor 40 is an example of the target device according to the present disclosure.

[0049] In Embodiment 2, the residence area setting screen V displayed on the programmable display 10 is, for example, as shown in FIG. 8. The residence area setting screen V shown in FIG. 8 shows the operator W performing work using the belt conveyor 40 in the video. In the example shown in FIG. 8, the operator W is setting the residence area A by displaying a past video in which the operator W is reflected on the residence area setting screen V. By setting the residence area A in this way, when the operator W leaves the belt conveyor 40, the restricting unit 104 can stop the operation of the belt conveyor 40.

[0050] That is, the programmable display 10 according to Embodiment 2 is different from Embodiment 1 in that it restricts the operation with the belt conveyor 40 as the target device instead of the programmable display 10 itself.

[0051] According to the programmable display 10 of Embodiment 2, it is possible to prevent the operation of the belt conveyor 40 from being restricted against the intentions of the worker W, and therefore, the operation of the belt conveyor 40 can be restricted when the worker W is absent without impairing the convenience of the worker W.

[0052] In Embodiment 2, the belt conveyor 40 was described as the target equipment, but other equipment, such as various field devices installed in the production site, can also be used as the target equipment.

[0053] (Modification 1) In each embodiment, if worker W is in the dwelling area A and the restriction unit 104 is not imposing any restrictions, the video processing unit 103 may detect that a third party has entered the dwelling area A, and when the restriction unit 104 detects that a third party has entered the dwelling area A, it may restrict the operation of the target device. For example, if the target device is a programmable display 10, if its operation is not restricted, it may be possible for a third party to peek at it, and there is a risk of confidential information being leaked. By performing an automatic logout process, a lock process, etc., when a third party enters the dwelling area A and restricting its operation, it is possible to prevent a third party from peeking at it.

[0054] Methods for distinguishing worker W from a third party include performing person recognition using image recognition, or attaching a two-dimensional code to the work clothes worn by worker W and recognizing the two-dimensional code.

[0055] (Modification 2) There may be multiple workers W engaged in work in the production site space R. However, if there are an unnecessarily large number of workers W other than the main worker W, the risk to equipment management increases. Therefore, in each embodiment, a limit may be placed on the number of people that can stay in the waiting area A. Specifically, the setting unit 102 sets the number of people that can stay, the video processing unit 103 counts the number of workers W present in the waiting area A and detects if it exceeds the number that can stay, and when it detects that it exceeds the number that can stay, the restriction unit 104 restricts the operation of the target equipment. This reduces the risk when there are an unnecessarily large number of workers W.

[0056] (Modification 3) In Modification 2, the operation of the target equipment may be further restricted when a worker W stays in a specific area within the dwelling area A for a certain period of time or longer. Specifically, as shown in Figure 9, the setting unit 102 sets the restricted area B within the dwelling area A on the dwelling area setting screen V, and sets the maximum dwelling time that can be spent in the restricted area B. The video processing unit 103 detects when the time spent by the worker W in the restricted area B exceeds the maximum dwelling time. When the restriction unit 104 detects that the maximum dwelling time has been exceeded, it restricts the operation of the target equipment. The restricted area B is set, for example, around equipment that is particularly confidential. This further reduces the risk when there are an unnecessarily large number of workers W.

[0057] (Modification 4) In each embodiment, when the operation of the target equipment is restricted, that is, when worker W is not in the dwelling area A, the video processing unit 103 detects that a third party has entered the dwelling area A, and when it detects that a third party has entered the dwelling area A, the programmable display 10 may notify an external device that is communicably connected to the programmable display 10 that a third party has entered. Specifically, as shown in Figure 10, the control unit 100 of the programmable display 10 further includes a notification unit 105, and when it detects that a third party has entered the dwelling area A, the notification unit 105 notifies the external device 50 that a third party has entered. The external device 50 that receives the notification performs processing such as displaying an alert or stopping operation. The notification unit 105 is an example of a notification means according to this disclosure.

[0058] (Other variations) In Embodiment 1, one programmable display 10 used the image captured by one camera 20. However, when multiple programmable displays 10 are installed in the production site space R, and the camera 20 is capturing images of the production site space R with the multiple programmable displays 10 included in its imaging range, the multiple programmable displays 10 may use the image captured by one camera 20.

[0059] In the hardware configuration shown in Figure 4, the programmable display 10 is equipped with a secondary storage device 1004. However, the configuration is not limited to this; the secondary storage device 1004 may be located outside the programmable display 10, and the programmable display 10 and the secondary storage device 1004 may be connected via an interface 1003. In this configuration, removable media such as USB flash drives and memory cards can also be used as the secondary storage device 1004.

[0060] Alternatively, instead of the hardware configuration shown in Figure 4, the programmable display 10 may be configured using a dedicated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array). Furthermore, in the hardware configuration shown in Figure 4, some of the functions of the programmable display 10 may be implemented, for example, by a dedicated circuit connected to interface 1003.

[0061] The program used in the programmable display 10 can be stored and distributed on computer-readable recording media such as CD-ROM (Compact Disc Read Only Memory), DVD (Digital Versatile Disc), USB flash drive, memory card, and HDD. By installing this program on a specific or general-purpose computer, the computer can be made to function as the programmable display 10.

[0062] Alternatively, the aforementioned program may be stored in a storage device owned by another server on the Internet, and the program may be downloaded from that server.

[0063] This disclosure allows for various embodiments and modifications without departing from the broad spirit and scope of this disclosure. Furthermore, the embodiments described above are for illustrative purposes only and do not limit the scope of this disclosure. In other words, the scope of this disclosure is indicated by the claims, not by the embodiments. Various modifications made within the scope of the claims and the equivalent significance of the disclosure are considered to be within the scope of this disclosure.

[0064] 1 Equipment management system, 10 Programmable display, 20 Camera, 30 PLC, 40 Belt conveyor, 50 External equipment, 100 Control unit, 101 Display control unit, 102 Setting unit, 103 Video processing unit, 104 Restriction unit, 105 Notification unit, 110 Communication unit, 120 Display unit, 130 Input unit, 140 Storage unit, 1000 Bus, 1001 Processor, 1002 Memory, 1003 Interface, 1004 Secondary storage device, A Waiting area, B Restriction area, R Production site space, V Waiting area setting screen, W Worker.

Claims

1. A programmable display comprising: display means for displaying an image obtained by imaging a space; setting means for setting a dwelling area within the image; and limiting means for restricting the operation of a target device when it is detected that a worker is not present in the dwelling area.

2. The programmable display according to claim 1, wherein the restricting means further restricts the operation of the target device when it detects that the worker is staying in the dwelling area and that a third party has entered the dwelling area.

3. The programmable display according to claim 1 or 2, wherein the setting means further sets the number of people who can stay in the waiting area, and the limiting means further restricts the operation of the target device when it detects that the number of workers present in the waiting area exceeds the number of people who can stay.

4. The programmable display according to claim 3, wherein the setting means further sets a restricted area and a permitted stay time within the dwelling area, and the restricting means further restricts the operation of the target equipment when it detects that the time the worker has been dwelling in the restricted area exceeds the permitted stay time.

5. The programmable display according to claim 1, further comprising a notification means for notifying an external device of an intrusion when it is detected that a third party has entered the dwelling area while the operation of the target device is restricted by the restriction means.

6. The programmable display according to any one of claims 1 to 5, wherein the space is a space in which the programmable display is installed, the video shows the programmable display, the target device is the programmable display, and the setting means sets the dwelling area to include the programmable display shown in the video.

7. A device management system comprising: a programmable display according to any one of claims 1 to 6; and an imaging means for imaging the space.

8. A device management method comprising: a computer displays images obtained by imaging a space on a display means; a dwelling area is set within the image; and when it detects that no worker is present in the dwelling area, the operation of the target device is restricted.

9. A program that causes a computer to display images obtained by imaging a space on a display means, to set a dwelling area within the image, and to restrict the operation of a target device when it detects that no worker is present in the dwelling area.

Images