A monitoring system, a device for providing image data, a device for controlling computer members in a network, a program for providing image data, and a program for controlling client data are the basic inventions.
Patent Information
- Application Number
- LAP680
- Authority / Receiving Office
- LA · LA
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2017-03-28
- Filing Date
- 2018-03-28
- Publication Date
- 2022-09-09
AI Technical Summary
Conventional monitoring systems for infrastructure equipment face challenges in easily adapting to changes in the monitoring target range, requiring significant changes to system diagrams and display setups when jurisdictional scopes are altered.
A monitoring system comprising a monitoring control device, an HMI server, and client control devices that generate and display partial images of infrastructure equipment status, allowing dynamic adjustment of the monitoring area and display format based on real-time sensor data and user input, enabling flexible response to changes in the monitoring scope.
Enables efficient and adaptive monitoring by allowing real-time adjustment of displayed images to reflect changes in the monitoring area, improving operational efficiency and ease of use in managing infrastructure equipment across varying jurisdictions.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Surveillance system, image information providing device, client control device, image information providing program, and client control program
[0001] An embodiment of the present invention relates to a monitoring system, an image information providing device, a client control device, an image information providing program, and a client control program.
[0002] Conventionally, in monitoring systems for monitoring infrastructure facilities, information from the monitored infrastructure facilities is displayed in a way that is easy for the monitor to recognize, and the monitored infrastructure facilities are managed in a unified manner. For example, in a power supply dispatching center or a substation control center, a mosaic display device or a large projector device is installed on the wall of the monitoring room, and a system diagram of the infrastructure facilities under the control range is displayed. By displaying the system diagram, the status of the system can be monitored in a centralized manner.
[0003] In such a monitoring system, if the monitoring range is changed, for example, if the jurisdictional range is abolished or consolidated, it becomes necessary to change the system diagram that has been displayed up until now. When trying to change the system diagram, it may be necessary to recreate the mosaic display device or reinstall a projector device that can display the changed monitoring range at a size that is easy for monitors and others to recognize.
[0004] Japanese Patent Application Laid-Open No. 2000-134736
[0005] The problem that the present invention aims to solve is to provide a monitoring system, an image information providing device, a client control device, an image information providing program, and a client control program that can easily respond to changes in the monitoring range.
[0006] A monitoring system according to an embodiment includes a monitoring control device, an image information providing device, and a client control device. The monitoring control device monitors infrastructure facilities and transmits the status of the infrastructure facilities, obtained based on information input from sensors, to the image information providing device. The image information providing device generates original image information based on the status of the infrastructure facilities received from the monitoring control device. The client control device is connected to a display device and an operation device, receives information from the operation device specifying a partial area of an entire image that can be generated from the original image information, transmits the information to the image information providing device, and causes the display device to display an image based on the information received from the image signal output device. The image information providing device outputs information to the client control device for displaying a partial area of the entire image, the partial area being determined based on the area specification information received from the client control device.
[0007] 1 is a system configuration diagram showing the configuration of a monitoring system according to an embodiment. FIG. 1 is a diagram showing an example of a current state table 23 used in an HMI server according to an embodiment. FIG. 2 is a diagram showing an example of a monitoring area displayed on a client device according to an embodiment. FIG. 3 is a sequence diagram showing an operation of displaying a monitoring area on a monitoring system according to an embodiment. FIG. 4 is a diagram showing an example of a reduced-size monitoring area displayed on a client device according to an embodiment. FIG. 5 is a sequence diagram showing an operation of displaying a monitoring area on a monitoring system according to an embodiment. FIG. 6 is a diagram showing an example of a state change area displayed on a client device according to an embodiment. FIG. 7 is a diagram showing an example of a reduced-size display of state change areas on a client device according to an embodiment. FIG. 8 is a sequence diagram showing an operation of displaying state changes on multiple locations on a monitoring system according to an embodiment. FIG. 9 is a diagram showing an example of locking the display of state changes on a client device according to an embodiment. FIG. 10 is a sequence diagram showing an operation of locking the display of state changes on a monitoring system according to an embodiment. FIG. 11 is a sequence diagram showing an operation of displaying state changes on multiple locations after locking the display of state changes on a monitoring system according to an embodiment.
[0008] Hereinafter, a monitoring system according to an embodiment will be described with reference to the drawings.
[0009] First Embodiment First, a first embodiment will be described. FIG. 1 is a system configuration diagram showing the configuration of a monitoring system according to the embodiment. As shown in FIG. 1, the monitoring system 1 includes, for example, a monitoring control device 10, an HMI (Human Machine Interface) server (image information providing device) 20, and a client control device 30. The monitoring control device 10, the HMI server 20, and the client control device 30 communicate with each other via a network 100. The network 100 may include, for example, a wide area network (WAN), a local area network (LAN), the Internet, a provider device, a wireless base station, a dedicated line, or some or all of these. The client control device 30 and the like connected to the network 100 can also function as an access point. In this case, the client control device 30 communicates wirelessly or wired with an operation device 40 and a display device 50, and transmits information received from the operation device 40 to the HMI server 20 and transmits image information received from the HMI server 20 to the operation device 40 and the display device 50.
[0010] The monitoring control device 10, the HMI server 20, and the client control device 30 are computers each including a processor such as a CPU (Central Processing Unit) and a program memory for storing programs executed by the processor. The status change detection unit 11 in the monitoring control device 10, the area image transmission unit 21 in the HMI server 20, and the request transmission unit 31 and setting reception unit 32 in the client control device 30 are realized by a processor such as a CPU (Central Processing Unit) executing programs stored in the program memory. Some or all of these functional units may be realized by hardware such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable Gate Array).
[0011] Sensors 12 are connected to the monitoring and control device 10. The monitoring and control device 10 transmits status information indicating the status of infrastructure facilities 13 obtained based on information received from the sensors 12 to the HMI server 20. The infrastructure facilities 13 are facilities necessary for establishing social infrastructure, such as power generation facilities, power distribution facilities, water treatment facilities, or gas distribution facilities. The infrastructure facilities 13 may also be operational infrastructure such as the power status of factories and large buildings, distribution facilities in logistics centers, or research facilities in schools and research institutes. As such, the infrastructure facilities 13 are facilities that are too widespread to be monitored at a glance, and therefore are facilities for which centralized monitoring in one location is desirable.
[0012] The monitoring and control device 10 includes, for example, a status change detection unit 11. The status change detection unit 11 detects a change in the status of the infrastructure equipment 13 based on information from the sensor 12. In the case of monitoring a power supply control center, a change in the status of the infrastructure equipment 13 may be, for example, a power outage occurring from a normal state. To detect the status change, the status change detection unit 11 stores information received from the sensor 12 in a storage area (not shown). When the status change detection unit 11 receives new information from the sensor 12, it compares the newly received information with the information stored in the storage area and determines that a status change has been detected if the two pieces of information are different. Alternatively, the status change detection unit 11 may compare the information from the sensor 12 with a predetermined threshold and determine that a status change has been detected if the information from the sensor 12 is equal to or lower than the threshold. The status change detection unit 11 transmits the detected status change to the HMI server 20 as status change information. In Figure 1, the sensor 12 is shown as outputting information to the monitoring control device 10 without going through the network 100, but the sensor 12 may also transmit information to the monitoring control device 10 via the network 100.
[0013] The HMI server 20 generates original image information based on the status information received from the monitoring control device 10. Here, the original image information is information that can be used to generate, for example, an image of a system diagram showing the status of monitored points throughout the entire area under its jurisdiction (hereinafter referred to as an overall image).
[0014] The information from which an image can be generated is, for example, a reference such as a uniform resource locator (URL) for specifying the location of the image on a web server (not shown) on the network 100, or compressed image data, bitmap data, vector data, etc. that make up the image itself. Furthermore, if the client control device 30 holds the framework of an image such as a system diagram, the information from which an image can be generated may be, for example, element data that indicates the numerical values, colors, etc. of each element (monitoring point, etc.) within the framework of the image.
[0015] The HMI server 20 has, for example, an area image transmission unit 21 and a storage unit 22. The area image transmission unit 21 determines image information (hereinafter referred to as area image information) for displaying a partial area of an entire image that can be generated from original image information, based on area designation information received from the client control device 30. The area image transmission unit 21 transmits the determined area image information to the client control device 30. Furthermore, if the status information received from the monitoring control device 10 includes information indicating a change in status (hereinafter referred to as status change information), the area image transmission unit 21 updates a current status table 23 that stores the status change.
[0016] The storage unit 22 is realized by, for example, a hard disk drive (HDD), flash memory, an electrically erasable programmable read-only memory (EEPROM), or a random access memory (RAM). The storage unit 22 stores a current status table 23. The current status table 23 is a data table for managing the current monitoring status and the display status on the client control device based on status information received from the monitoring control device 10 and information received from the client control device 30.
[0017] 2 shows an example of the contents of the current status table 23. As shown in FIG. 2, the current status table 23 has items for status number, status change information, and confirmation information. The status number item stores a number indicating the order in which a status change was received. The status change information item stores the content of the status change information received from the monitoring control device 10. The confirmation information item stores the content of information (hereinafter referred to as response information) indicating a response from the client control device 30 to image information transmitted from the HMI server when a status change occurs.
[0018] The status change information further has items for type, occurrence area, display area, and display format. The type item stores the manner of the status change, such as a power outage or recovery from power outage. The occurrence area item stores information about the area where the status change occurred. The display area item stores the area displayed by the image information transmitted from the area image transmission unit 21 to the client control device 30. The display format item stores the type of display image, such as whether the image transmitted from the area image transmission unit 21 to the client control device 30 and displayed by the image information is a system diagram.
[0019] The response information item further includes items "confirmed" and "display lock." The "confirmed" item stores information indicating whether a response (hereinafter referred to as "confirmation response information") has been received from the client control device 30 indicating that the display of the area where a status change has occurred has been confirmed. The "display lock" item stores information indicating whether a response (hereinafter referred to as "lock response information") has been received from the client control device 30 requesting that the display of the area where a status change has occurred be fixed (locked).
[0020] The area image sending unit 21 determines area image information for displaying an area where a state change has occurred based on the state change information received from the monitoring control device 10. The area image sending unit 21 transmits the determined area image information to the client control device 30. Furthermore, when the area image sending unit 21 receives information from the client control device 30 specifying that the display of the area where a state change has occurred be fixed (locked) (hereinafter referred to as lock specification information), the area image sending unit 21 updates the current state table 23.
[0021] Returning to FIG. 1 , the client control device 30 will be described. The client control device 30 is connected to the operation device 40 and the display device 50. The client control device 30 receives area designation information from the operation device 40, which designates a partial area of an entire image that can be generated from original image information. The client control device 30 also transmits the area designation information received from the operation device 40 to the HMI server 20. The client control device 30 includes a request sending unit 31 and a setting receiving unit 32. The request sending unit 31 transmits the area designation information to the HMI server 20. The setting receiving unit 32 receives operation information such as the area designation information from the operation device 40.
[0022] The operation device 40 operates the image to be displayed on the display device 50. The operation device 40 includes an operation input unit for operating the image to be displayed on the display device 50 and a communication unit for communicating with the client control device 30 area designation information based on the operation information input by the operation input unit. The operation device 40 is, for example, a tablet terminal having a touch panel as the operation input unit. In this case, the operation device 40 can perform operations such as changing, enlarging, or reducing the screen displayed on the display device 50 by operating the touch panel that displays the same image as the screen displayed on the display device 50. The operation device 40 may also be a smartphone, a laptop, or a desktop personal computer.
[0023] The display device 50 receives image information from the client control device 30 and displays an image corresponding to the received image information. The display device 50 has a display unit for displaying the image and a communication unit for communicating with the client control device 30. The display device 50 is, for example, a large monitor (for example, about 70 inches).
[0024] Communication between the client control device 30 and the operation device 40 is performed, for example, via a wireless communication method via a Wi-Fi network. Communication between the client control device 30 and the operation device 40 may also be performed via a wireless communication network such as a cellular network, a short-range wireless communication network such as infrared or Bluetooth (registered trademark), or a wired communication network such as a local area network (LAN). Communication between the client control device 30 and the display device 50 is performed, for example, via an HDMI (High Definition Multimedia Interface; registered trademark) cable or a USB (Universal Serial Bus) cable. When the client control device 30 and the display device 50 are connected via an HDMI cable, the display device 50 displays an image based on pixel information received from the HDMI cable. In other words, when the client control device 30 and the display device 50 are connected via an HDMI cable, the display device 50 does not have an image generation function, and an image is generated by the client control device 30, or image information received by the client control device 30 is image information expressed as bitmap data or the like. Furthermore, the communication between the client control device 30 and the display device 50 may be performed using a communication method similar to the communication method between the client control device 30 and the operation device 40, such as the above-described Wi-Fi network.
[0025] An example of a monitoring area displayed by the display device 50 will be described using Fig. 3. Fig. 3 is a diagram showing a state in which a monitoring area is displayed on the display device 50 of the embodiment. Fig. 3(a) shows an image of an entire image that can be generated from the original image information generated by the HMI server 20. Fig. 3(b) shows an example of a region image displayed by the display device 50. Fig. 3(c) shows an example of a region image displayed by the operation device 40.
[0026] The overall image 200 shown in Fig. 3(a) is, for example, a system diagram that would be displayed on an entire wall of a monitoring room in the prior art. The area image 200a shown in Fig. 3(a) is a partial area of the overall image 200 that is determined based on area designation information received from the client control device 30.
[0027] 3(b), the display device 50 displays an area image 200a corresponding to the image information received from the HMI server 20 based on the area designation information. In this way, by displaying the monitoring area indicated by the area image 200a on the display device 50, the monitor can monitor the area indicated by the area image 200a.
[0028] As shown in FIG. 3C , the operation device 40 displays the same image as the image displayed by the display device 50. By displaying the same image as the image displayed by the display device 50 on the operation device 40, an observer or the like can touch the image while visually checking the image displayed on the operation device 40, and operate the image displayed on the display device 50. For example, an observer or the like can move (scroll) the position of the area image 200 a in the entire image 200 by touching the display screen of the operation device 40 and performing a sliding operation to the left or right. When an observer or the like operates the operation device 40, operation information is transmitted to the HMI server 20 via the client control device 30, and image information based on the operation information is transmitted from the HMI server 20 to the client control device 30. The client control device 30 reflects the image displayed on the display device 50. This mechanism allows the image displayed on the display device 50 to be operated.
[0029] The operation shown in FIG. 3 will be described using FIG. 4. FIG. 4 is a sequence diagram showing the operation of displaying a monitoring area in the monitoring system 1 of this embodiment. The monitoring control device 10 receives sensor information from the sensor 12 (step S101). The monitoring control device 10 generates status information based on the received sensor information (step S102). The monitoring control device 10 transmits the status information to the HMI server 20 (step S103). The HMI server 20 receives the status information from the monitoring control device 10 (step S104). The HMI server 20 generates original image information from the received status information (step S105). Meanwhile, the client control device 30 receives operation information such as a scrolling operation from the operation device 40 (step S106). The client control device 30 generates area designation information based on the received operation information and transmits it to the HMI server (step S107).
[0030] The HMI server 20 receives area designation information from the client control device 30 (step S108). The HMI server 20 determines image information based on the received area designation information (step S109). Here, the image information determined by the HMI server 20 is image information corresponding to all or part of the area of the original image information. The HMI server 20 transmits the determined image information to the client control device 30 (step S110). The client control device 30 receives the image information from the HMI server 20 (step S111). The client control device 30 transmits the received image information to the operation device 40 and the display device 50 (step S112).
[0031] Here, an example in which an image showing a monitoring area displayed by the display device 50 is displayed as an image different from that shown in FIG. 3 will be described using FIG. 5 . FIG. 5 is a diagram showing an example in which a monitoring area is displayed in a reduced size on the display device 50 of the embodiment. FIG. 5( a) is a diagram similar to FIG. 3( a), but in FIG. 5( a), an area image 200b shows an area wider than the area image 200a in FIG. 3( a). FIG. 5( b) is a diagram similar to FIG. 3( b), but a system overview diagram is displayed instead of the system diagram. Here, the system overview diagram refers to a diagram that shows the system diagram at a more macroscopic level. FIG. 5( c) is a diagram similar to FIG. 3( c). The system overview diagram is an example of an "overall image."
[0032] A macro view is, for example, a view that displays fewer components enlarged in the same area. Here, a macro view is an example of an "image generated from a macro perspective." When a large number of components are all displayed in an area, the details become too detailed to grasp, and in such cases, displaying a macro view can make it easier to grasp the overall picture.
[0033] 3(c), the operation device 40 can operate the area displayed on the display device 50 by scrolling the same image as the image displayed by the display device 50. In this case, the monitor or the like can reduce the position of the area image 200a by touching the display screen of the operation device 40 with two fingers and bringing the two fingers that touched the screen closer together (pinch in). In addition, the monitor or the like can enlarge the position of the area image 200a by spreading the two fingers that touched the screen apart (pinch out).
[0034] As shown in Fig. 5(a), when the display area displayed in the area image 200b determined based on the area designation information received from the client control device 30 is relatively wide, i.e., when the display magnification when displayed on the display device 50 is relatively small, the HMI server 20 transmits image information of the system overview diagram in the area image 200b to the client control device 30. When the image information of the system overview diagram is transmitted from the HMI server 20, the display device 50 displays the system overview diagram in the area image 200b, as shown in Fig. 5(b). Furthermore, as shown in Fig. 5(c), the operation device 40 displays the same image as the image displayed by the display device 50, as in Fig. 3(c).
[0035] If the display range of the system diagram corresponding to the area image 200b is too wide, as in Fig. 3(b), even if the system diagram of the corresponding area is displayed on the display device 50, the display of the system diagram will be too small and the monitor, etc. will not be able to grasp the status of each system included in the system diagram. In such a case, the HMI server 20 can cause the client control device 30 to display a system overview diagram as shown in Fig. 5(b), thereby enabling the monitor, etc. to grasp the status of the system.
[0036] The operation shown in Fig. 5 will be described below with reference to Fig. 6. Fig. 6 is a sequence diagram showing the operation of displaying a monitoring area in the monitoring system 1 of the embodiment. The processing shown in steps S151 to S155 of the sequence chart shown in Fig. 6 is similar to the processing shown in steps S101 to S105 of the sequence chart shown in Fig. 4, and therefore description thereof will be omitted. The client control device 30 receives operation information associated with a pinch-out or pinch-in operation from the operation device 40 (step S156). Based on the received operation information, the client control device 30 generates designation information including area designation information and display magnification designation information and transmits the designation information to the HMI server (step S157).
[0037] The HMI server 20 receives designation information from the client control device 30 (step S158). Based on the display magnification designation information included in the received designation information, the HMI server 20 determines the type of image (system diagram or system overview diagram) to be sent to the client control device (step S159). Based on the area designation information included in the received designation information, the HMI server 20 also determines image information (step S160). The HMI server 20 sends the determined image information to the client control device 30 (step S161).
[0038] The client control device 30 receives the image information from the HMI server 20 (step S162) and transmits the received image information to the operation device 40 and the display device 50 (step S163).
[0039] An example of displaying an area where a status change has occurred on the display device 50 will be described using FIG. 7 . FIG. 7 is a diagram showing an example of displaying a monitoring area on the display device 50 of the embodiment. FIG. 7( a) is a diagram similar to FIG. 3( a), except that a status change mark J1 indicating a status change has occurred is marked in an area image 200x that is different from the area image 200a in the overall image 200. FIG. 7( b) is a diagram similar to FIG. 3( b). FIG. 7( c) shows an example of a display in which the image shown in FIG. 7( b) is switched to a system diagram of the area where the status change has occurred due to a status change. As shown in FIG. 7( a), when a status change occurs in the location shown in the area image 200x, the HMI server 20 transmits image information of the system diagram of the area image 200x to the client control device 30, regardless of the image currently displayed on the display device 50. In this way, as shown in FIG. 7B , even if the display device 50 is displaying the area image 200a, if a change in state occurs in the area image 200x, the display on the display device 50 automatically switches from the area image 200a to the area image 200x as shown in FIG. 7C . When a change in state occurs in the location indicated by the area image 200x, the monitoring system 1 of this embodiment can notify a monitor or other person that a change in state has occurred in the monitored area by switching the display on the display device 50 to the area image 200x where the change in state has occurred. Furthermore, the monitoring system 1 of this embodiment highlights the location where the change in state has occurred by, for example, flashing (flickering) the area image F1 indicating the location in the area image 200x where the change in state has occurred. In this case, the monitoring system 1 may further highlight the area image F1 by displaying it in a different background color from the background color of other areas where no change in state has occurred. The monitoring system 1 may also notify the occurrence of a change in status by using a siren sound, an audio announcement, or the like, via an audio output device (not shown) in the client control device 30 .
[0040] Here, the operation shown in Fig. 7 will be described using Fig. 8. Fig. 8 is a sequence diagram showing the operation of displaying an area in which a state change has occurred in the monitoring system 1 of this embodiment. The monitoring control device 10 receives sensor information from the sensor 12 (step S201). If the monitoring control device 10 determines that a state change has occurred based on the received sensor information, it generates state change information (step S202). The monitoring control device 10 transmits the state change information to the HMI server 20 (step S203).
[0041] Here, an example of the actual state of the infrastructure facility 13 when a state change occurs will be described. The sensor 12 is configured, for example, with a circuit breaker installed on the power supply path to be monitored, an electromagnetic relay corresponding to the circuit breaker, and a relay control unit that controls the operation of the electromagnetic relay. The electromagnetic relay controlled by the relay control unit switches the circuit breaker to a disconnected state or a connected state. When a short circuit or the like occurs in the power supply path, the circuit breaker installed on the power supply path where the short circuit occurs is switched to a disconnected state. Furthermore, switching the circuit breaker to a disconnected state changes the state of the electromagnetic relay. Generally, when a short circuit or the like occurs in the power supply path, the state of the electromagnetic relay changes slightly after the state of the circuit breaker changes.
[0042] When a short circuit or the like occurs in the power supply path, the sensor 12 transmits a change in the state of the circuit breaker to the monitoring control device 10. The monitoring control device 10 transmits the received change in state to the state change detection unit 11.
[0043] If a short circuit or the like occurs in the power supply path, the state change detection unit 11 receives a change in the state of the electromagnetic relay slightly later than the change in the state of the circuit breaker. Even in such a case, the state change detection unit 11 needs to treat the change in the state of the circuit breaker and the change in the state of the electromagnetic relay as a single state change caused by the occurrence of a short circuit or the like. Therefore, when the state change detection unit 11 receives a state change, the state change detection unit 11 treats state changes received within a certain time (e.g., 3 seconds) from the time the state change is received as a single state change. In this way, by receiving state changes until the certain time has passed, the state change detection unit 11 can prevent related state changes from being mistakenly recognized as being caused by separate events or from missing related state changes.
[0044] The HMI server 20 receives state change information from the monitoring control device 10 (step S204). Based on the received state change information, the HMI server 20 stores the type of state change, the area where the state change occurred, etc. in the current state table 23 and updates the current state table 23 (step S205). Based on the received state change information, the HMI server 20 determines image information (step S206). Here, the image information determined by the HMI server 20 is image information for displaying the area where the state change indicated by the state change information occurred.
[0045] The HMI server 20 transmits the determined image information to the client control device 30 (step S207). The client control device 30 receives the image information from the HMI server 20 (step S208). The client control device 30 transmits the received image information to the operation device 40 and the display device 50 (step S209). In this way, a system diagram of the area where the state change has occurred is displayed on the display device 50, and the monitor or the like can visually confirm this image.
[0046] When an observer or the like recognizes an area where a change in status has occurred and is displayed on the display device 50, the observer or the like operates an operation device (not shown) different from the operation device 40 (hereinafter referred to as an operation console) or the operation device 40, and transmits response information indicating that the display of the area where the change in status has occurred has been confirmed. The client control device 30 receives the response information from the operation console or the operation device 40 (step S210). The client control device 30 transmits the received response information to the HMI server 20 (step S211).
[0047] The HMI server 20 receives response information from the client control device 30 (step S212). The HMI server 20 updates the current state table 23 based on the received response information (step S213). If the received response information indicates that the area in which a state change has occurred has been confirmed, the HMI server 20 transmits to the client control device 30 information for displaying the area determined based on the area designation information from the client control device 30.
[0048] In this case, the HMI server 20 may transmit to the client control device 30 an image for stopping the flickering display of the area image F1 and returning the area image F1 to the same display as other areas where no change in state has occurred, instead of transmitting information for displaying the area determined based on the area designation information from the client control device 30. Furthermore, if the background color of the area image F1 has been displayed in a color different from the background color of other areas where no change in state has occurred, the HMI server 20 may transmit to the client control device 30 information for returning the background color of the area image F1 to the same color as the background color of other areas where no change in state has occurred.
[0049] Using FIG. 9 , a display example in which multiple areas where a status change has occurred will be described. FIG. 9 is a diagram showing an example of a monitoring area displayed on the display device 50 of the embodiment. FIG. 9( a) is a diagram similar to FIG. 7( a), except that a status change mark J2 indicating a status change has occurred is displayed in a location indicated by an area image 200y different from the area image 200x. FIG. 9( b) is a diagram similar to FIG. 7( c). FIG. 9( c) shows an example of a display in which the image shown in FIG. 9( b) is switched to a system diagram including all areas where status changes have occurred due to status changes occurring in multiple locations. Here, a system diagram including all areas where status changes have occurred is an example of "multiple areas." As shown in FIG. 9( a), if a status change occurs in the location indicated by the area image 200x and also in the location indicated by the area image 200y, the HMI server 20 transmits image information of the system diagram of the area image 200xy, which includes the area image 200x and the area image 200y, to the client control device 30. In this way, even if the display device 50 is displaying the area image 200x and flickering the area image F1 as shown in FIG. 9(b), if a change in state occurs in the area image 200y, the display on the display device 50 will automatically switch from the area image 200x to the area image 200xy as shown in FIG. 9(c).
[0050] In the monitoring system 1 of this embodiment, if a change in status occurs in a location indicated in area image 200x in addition to the location indicated in area image 200x, the display on the display device 50 can be switched to area image 200xy, which includes area image 200x and area image 200y, thereby notifying a monitor or the like of all locations in the monitored area where a change in status has occurred.
[0051] Using FIG. 10 , a display example will be described in which the area where a status change has occurred displayed on the display device 50 is wider than the display area shown in FIG. 9( c). FIG. 10 is a diagram showing an example of a monitoring area displayed on the display device 50 of the embodiment. FIG. 10( a) is a diagram similar to FIG. 9( a), but includes a status change mark J3 indicating that a status change has occurred in the location indicated by area image 200z, which is different from area images 200x and 200y. FIG. 10( b) is a diagram similar to FIG. 9( c). FIG. 10( c) shows an example of a display in which the image shown in FIG. 10( b) is switched to a system overview diagram of the area including all areas where status changes have occurred due to status changes occurring in multiple locations. 10A, when a change in state occurs at the location shown in area image 200x, a change in state occurs at the location shown in area image 200y, and a further change in state occurs at the location shown in area image 200z, the HMI server 20 performs processing to transmit image information of area image 200xyz including area image 200x, area image 200y, and area image 200z. However, in this case, since the area of the location shown in area image 200xyz is wide, the HMI server 20 transmits image information of the system overview diagram of area image 200xyz to the client control device 30 instead of the system diagram of area image 200xyz. In this way, as shown in FIG. 10( b), if a change in state occurs in area image 200z while displaying the system diagram of area image 200xy and flickering area images F1 and F2, the display on display device 50 automatically switches from the system diagram of area image 200xy to the system overview diagram of area image 200xyz, as shown in FIG. 10( c). In this way, when attempting to switch from area image 200xy to area image 200xyz, if the system diagram of the area indicated by area image 200xyz is displayed on display device 50, the HMI server 20 displays the system overview diagram if the display of the system diagram of the area indicated by area image 200xyz becomes too small for the monitor to grasp the status of each system included in the system diagram. Displaying the system overview diagram enables the monitor to grasp the status of the system.
[0052] 9 and 10 will be described below with reference to FIG. 11. FIG. 11 is a sequence diagram showing the operation of displaying an area in which a state change has occurred in the monitoring system 1 of the embodiment. The processing shown in steps S301 to S309 in the sequence chart shown in FIG. 11 is similar to the processing shown in steps S201 to S209 in the sequence chart shown in FIG. 8, and therefore a description thereof will be omitted. Furthermore, the processing shown in steps S310 to S312 in the sequence chart shown in FIG. 11 is similar to the processing shown in steps S201 to S203 in the sequence chart shown in FIG. 8, and therefore a description thereof will be omitted.
[0053] The HMI server 20 receives the state change information from the monitoring control device 10 (step S313). Based on the received state change information, the HMI server 20 stores the type of state change, the area where the state change occurred, etc. in the current state table 23 and updates the current state table 23 (step S314). Based on the received state change information, the HMI server 20 determines image information (step S315). Here, the image information determined by the HMI server 20 is image information for displaying all of the areas where the state change indicated by the state change information has occurred.
[0054] To determine the image information, the HMI server 20 refers to, for example, the updated current status table 23. When multiple pieces of state change information are stored in the current status table 23, the HMI server 20 refers to the response information for each of the multiple pieces of state change information stored. The HMI server 20 determines an area that includes all areas where state changes indicated in the multiple pieces of state change information for which no response information has been received have occurred. If the determined area is within a predetermined range, the image information of the system diagram corresponding to the determined area is determined; if it exceeds the predetermined range, the image information of the system overview diagram corresponding to the determined area is determined.
[0055] The HMI server 20 transmits the determined image information to the client control device 30 (step S316). The client control device 30 receives the image information from the HMI server 20 (step S317). The client control device 30 transmits the received image information to the operation device 40 and the display device 50 (step S318).
[0056] Using Fig. 12, a display example different from Fig. 9 will be described in which there are multiple regions where a change in state has occurred in the display device 50. Fig. 12 is a diagram showing an example of a monitoring region displayed on the display device 50 of the embodiment. Fig. 12(a) is a diagram similar to Fig. 9(a). Fig. 12(b) is a diagram similar to Fig. 9(b). Fig. 12(c) is a diagram similar to Fig. 9(b). Fig. 12(d) is a diagram showing an image displayed by the operation device 40 similar to the image displayed by the display device 50 in Fig. 12(c), except that an arrow icon image 200c is shown in the lower right corner of the screen. Here, the icon image 200c is an example of a "shortcut icon."
[0057] As shown in FIG. 12( a), when a change in state occurs in the location indicated by area image 200x and a further change in state occurs in the location indicated by area image 200y, the HMI server 20 performs processing to transmit image information of area image 200xy, which includes area image 200x and area image 200y. However, if the HMI server 20 has received a lock request from the client control device 30, the HMI server 20 does not transmit image information of the system diagram of area image 200xy. Instead, the HMI server 20 transmits image information of the system diagram of area image 200x and image information of icon image 200c (e.g., an icon image indicating a shortcut) to the client control device 30. By doing so, even if a change in state occurs in area image 200y while the display device 50 is displaying area image 200x and flickering area image F1, as shown in FIG. 12( b), the display device 50 displays an image showing the same area as in FIG. 12( b), as shown in FIG. 12( c). That is, the display of the display device 50 is fixed (locked) as the area image 200x. Then, as shown in Fig. 12(d), an icon image 200c indicating that a change in state has occurred in an area (here, area image 200y) different from the locked image (here, area image 200x) is displayed in the lower right of the display screen of the operation device 40.
[0058] In the monitoring system 1 of this embodiment, if information indicating whether the display is locked is stored in the display lock item of the response display in the current status table 23, even if status changes occur in multiple locations, only the location where the status change first occurred continues to be displayed on the display device 50. Images indicating the status changes in multiple locations are then displayed on the operation device 40. The information indicating whether the display is locked is written and stored in the current status table 23 in advance. The HMI server 20 may leave the information indicating whether the display is locked as it is stored in advance. Alternatively, the HMI server 20 may update the current status table 23 to change the information indicating whether the display is locked, for example, when receiving a request signal requesting display lock from the client control device 30. By displaying the area image 200x without switching the display image on the display device 50 to the area image 200xy, it is possible to prevent the display image from being changed unexpectedly before the monitor recognizes the status change.
[0059] Furthermore, in this case, the monitoring system 1 of the present embodiment displays an icon image 200c indicating a shortcut for switching to and displaying area image 200xy without switching to area image 200xy, for example, at the bottom right of the screen of the operation device 40. By displaying the icon image 200c on the display screen of the operation device 40, even if the display of the location where the status change indicated by area image 200x occurred is locked, the monitor can be notified that the status change has occurred in another location. Furthermore, even if the display is locked, the monitor can easily display the other location where the status change has occurred by performing a tap operation with a finger on the screen of the operation device 40 where the icon image 200c is displayed.
[0060] 12 , when icon image 200c is tapped or the like on operation device 40, the image displayed on display device 50 may be area image 200xy or area image 200y. When icon image 200c is tapped or the like and area image 200y is to be displayed on display device 50, operation device 40 may be caused to display an icon image for returning to the display of area image 200x.
[0061] Here, the operation shown in Fig. 11 will be described using Fig. 13. Fig. 13 is a sequence diagram showing the operation of displaying an area in which a state change has occurred in the monitoring system 1 of the embodiment. As already explained, the HMI server 20 may not change the information indicating whether or not the display is locked. However, here, a case will be described in which the HMI server 20 updates the current state table 23 to change the information indicating whether or not the display is locked, for example, when it receives a request signal requesting that the display be locked from the client control device 30. The processing shown in steps S401 to S409 in the sequence chart shown in Fig. 13 is the same as the processing shown in steps S201 to S209 in the sequence chart shown in Fig. 8, and therefore description thereof will be omitted.
[0062] The client control device 30 receives a lock designation from the operation device 40 (step S410). The client control device 30 transmits the received lock designation to the HMI server 20 (step S411). The HMI server 20 receives the lock designation from the client control device 30 (step S412). Based on the received lock designation, the HMI server 20 stores in the current status table 23 the fact that there is information designating a display lock in the display lock item corresponding to the state change information indicated in the lock designation, and updates the current status table 23 (step S413).
[0063] The processing shown in steps S420 to S422 in the sequence chart shown in FIG. 13 is similar to the processing shown in steps S201 to S203 in the sequence chart shown in FIG. 8, and therefore description thereof will be omitted.
[0064] The HMI server 20 receives the state change information from the monitoring control device 10 (step S423). Based on the received state change information, the HMI server 20 stores the type of state change, the area where the state change occurred, etc. in the current state table 23 and updates the current state table 23 (step S424). Based on the received state change information, the HMI server 20 determines image information (step S425).
[0065] The HMI server 20 refers to the updated current status table 23 to determine the image information. When multiple pieces of state change information are stored in the current status table 23, the HMI server 20 refers to the response information for each of the multiple pieces of state change information stored. When there is state change information among the multiple pieces of state change information that specifies a display lock request as response information, the HMI server 20 selects image information of the system diagram corresponding to the area where the state change indicated in the state change information that specified the display lock occurred. Then, the HMI server 20 determines image information by adding the image of the icon to be displayed on the operation device 40 to the image indicated by the selected image information.
[0066] The HMI server 20 transmits the determined image information to the client control device 30 (step S426). The client control device 30 receives the image information from the HMI server 20 (step S427). The client control device 30 transmits the received image information to the operation device 40 and the display device 50 (step S428). At this time, the operation device 40 displays an image in which an icon image 200c (FIG. 12(d)) has been added to the bottom right or other part of the screen showing the area image 200x. Furthermore, the display device 50 displays the area image 200x (FIG. 12(c)).
[0067] In the monitoring system 1, when the HMI server 20 receives a request to lock the display, the display may be unlocked when the HMI server 20 receives response information indicating that the display of the area where a state change has occurred has been confirmed in step S211. Alternatively, in the monitoring system 1, the display may be unlocked when the HMI server 20 receives specification information indicating that the display of the area where a state change has occurred is to be unlocked. Furthermore, in the monitoring system 1, the display may be unlocked when the icon image 200c is clicked and the HMI server 20 receives specification information indicating that all areas where a state change has occurred are to be displayed.
[0068] When the specification information received from the client control device 30 indicates information to unlock the display, the HMI server 20 stores the display unlock information in the specification information of the state number indicated by the received specification information in the current state table 23, and updates the current state table 23.
[0069] 14, a process will be described in which, in step S428 of FIG. 13, icon image 200c (FIG. 12(d)) is displayed on the operation device 40 at the bottom right or the like of the screen showing area image 200x, and the operation device 40 is operated to click on icon image 200c. FIG. 14 is a sequence diagram showing the operation in the monitoring system 1 of the embodiment when icon image 200c indicating a shortcut is clicked on an image based on the display lock.
[0070] First, it is assumed that the processes shown in steps S401 to S428 in FIG. 13 have been performed (step S450). The client control device 30 receives operation information from the operation device 40 indicating that the icon image 200c has been clicked (step S451). Based on the received operation information indicating that the icon image 200c has been clicked, the client control device 30 transmits to the HMI server 20 designation information indicating a request to display some or all of the areas where multiple state changes have occurred (step S452). The HMI server 20 receives from the client control device 30 designation information indicating a request to display some or all of the areas where state changes have occurred (step S453). Based on the received designation information, the HMI server 20 stores in the current state table 23 a request to release the display lock in the display lock item corresponding to the state change information indicated in the lock designation, and updates the current state table 23 (step S454).
[0071] The HMI server 20 determines image information based on the state change information received from the monitoring control device 10 (step S455). The image information determined here is image information for displaying part of the area where multiple state changes have occurred. The HMI server 20 transmits the determined image information to the client control device 30 (step S456). The client control device 30 receives the image information from the HMI server 20 (step S457). The client control device 30 transmits the received image information to the display device 50, and causes the display device 50 to display the image (step S458).
[0072] According to the first embodiment described above, there is provided a monitoring control device 10 that monitors infrastructure facilities, an HMI server 20, and a client control device 30 that is connected to a display device 50 and an operation device 40, in which the monitoring control device 10 transmits the status of the infrastructure facilities obtained based on information input from the sensors 12 to the HMI server 20, the HMI server 20 generates original image information based on the status of the infrastructure facilities received from the monitoring control device 10, the client control device 30 receives information from the operation device 40 that specifies a partial area of an entire image that can be generated from the original image information and transmits it to the HMI server 20, and causes the display device 50 to display an image based on the information received from the HMI server 20. Furthermore, by outputting information to the client control device 30 for displaying a partial area of the entire image determined based on the area specification information received from the client control device 30, it is possible to display any area of a system diagram of the monitored object, and it is possible to easily respond to changes in the range of the monitored object.
[0073] Second Embodiment Next, a second embodiment will be described. In the first embodiment, as shown in Fig. 1, the monitoring system 1 includes one each of a monitoring control device 10, an HMI server 20, and a client control device 30. However, in the second embodiment, the monitoring system 1 includes one monitoring control device 10, one HMI server 20, and a plurality of client control devices 30. The monitoring system 1 of the second embodiment includes a plurality of client control devices 30, and can display the entire image 200 by, for example, displaying, on each of the plurality of client control devices 30, images obtained by dividing the entire image 200 of Fig. 3(a) in correspondence with each of the plurality of client control devices 30.
[0074] The monitoring system 1 of the second embodiment also has a standalone mode and a shared mode. In the standalone mode, an operation device 40 connected to each of the multiple client control devices 30 operates images to be displayed on the corresponding display devices 50. In the shared mode, one operation device 40 (hereinafter referred to as the master operation device 40) of the operation devices 40 connected to each of the multiple client control devices 30 operates images to be displayed on all of the display devices 50 connected to each of the multiple client control devices 30.
[0075] When the monitoring system 1 of the second embodiment is set to the shared mode, the same screen is displayed on all of the display devices 50 connected to the multiple client control devices 30 by operating the master operation device 40. By displaying the same screen on all of the display devices 50, information on an area where a change in status has occurred can be shared among multiple monitors.
[0076] In the shared mode, for example, the client control device 30 transmits area designation information from the master operation device 40 to the HMI server 20. The HMI server 20 realizes this by transmitting image information determined based on the received area designation information to all client control devices provided in the monitoring system 1.
[0077] The client control devices 30 may be further divided into multiple groups, and a sub-sharing mode may be provided in which information is shared by each group. In this case, the client control device 30 that receives area designation information from the master operation device 40 for each group assigns the group identification number to the received area designation information and transmits it to the HMI server 20. The HMI server 20 transmits image information determined based on the received area designation information to the multiple client control devices 30 that correspond to the received group identification numbers.
[0078] According to the second embodiment described above, there is a monitoring control device 10 that monitors infrastructure equipment, an HMI server 20, and a plurality of client control devices 30, and in addition to achieving the same effects as the first embodiment, it is possible to display the same area image showing any area of the system diagram of the monitored object on the display devices 50 connected to each of the plurality of client control devices 30, and it is possible to share information with a plurality of monitors, etc. who monitor each of the plurality of client control devices 30.
[0079] According to at least one embodiment described above, the monitoring control device 10 monitors infrastructure facilities and transmits the status of the infrastructure facilities obtained based on information input from the sensor 12 to the HMI server 20; the HMI server 20 generates original image information based on the status of the infrastructure facilities received from the monitoring control device 10; and the client control device 30 is connected to the display device 50 and the operation device 40, receives information specifying a partial area of an overall image that can be generated from the original image information from the operation device 40 and transmits it to the HMI server 20, and causes the display device 50 to display an image based on the information received from the HMI server 20. The HMI server 20 can easily respond to changes in the monitoring range by outputting to the client control device 30 information for displaying a partial area of the overall image, which is determined based on the area specification information received from the client control device 30.
[0080] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention described in the claims and their equivalents.
[0081] 1... monitoring system, 10... monitoring control device, 11... status change detection unit, 12... sensor, 20... HMI server, 21... area image transmission unit, 22... storage unit, 23... current status table, 30... client control device, 31... request transmission unit, 32... setting reception unit, 40... operation device, 50... display device
Claims
1. A monitoring system comprising: a monitoring control device that monitors infrastructure equipment, the monitoring control device transmitting the status of the infrastructure equipment obtained based on information input from a sensor to an image information providing device; the image information providing device generating original image information based on the status of the infrastructure equipment received from the monitoring control device; and a client control device connected to a display device and an operation device, receiving information from the operation device that specifies a partial area of an overall image that can be generated from the original image information and transmitting the information to the image information providing device, and displaying an image based on the information received from the image information providing device on the display device, wherein the image information providing device transmits information to the client control device for displaying the partial area of the overall image, which is determined based on the area specification information received from the client control device.
2. The monitoring system described in claim 1, wherein the client control device transmits display magnification designation information to the image information providing device based on information received from the operation device, and the image information providing device transmits information to the client control device for enlarging or reducing a portion of the entire image and displaying it at a magnification determined based on the display magnification designation information received from the client control device.
3. The monitoring system of claim 1, wherein the image information providing device transmits to the client control device information for displaying all or part of an image generated from a macro viewpoint, which is an image that can be generated from the original image information, when the magnification determined based on the display magnification designation information received from the client control device is equal to or less than a predetermined threshold value.
4. The monitoring system described in claim 1, wherein, when it is determined that a change in status has occurred based on the status of the infrastructure equipment received from the monitoring control device, the image information providing device transmits to the client control device information for displaying the area in which the change in status has occurred, instead of information for displaying a partial area of the overall image determined based on the area designation information received from the client control device.
5. The monitoring system according to claim 4, wherein the image information providing device transmits to the client control device information for highlighting and displaying the area in which the change in state has occurred.
6. The monitoring system of claim 4, wherein when the image information providing device receives response information from the client control device indicating that the display of the area where the change in status has occurred has been confirmed, the image information providing device transmits to the client control device information for displaying a partial area of the entire image determined based on the area designation information received from the client control device, instead of information for displaying the area where the change in status has occurred.
7. The monitoring system of claim 1, wherein, when the image information providing device determines that there are multiple areas where a change in status has occurred based on the status of the infrastructure equipment received from the monitoring control device, it transmits information to the client control device to display multiple areas that include all of the multiple areas where the change in status has occurred.
8. The monitoring system of claim 7, wherein the image information providing device transmits to the client control device information for displaying the multiple regions in an overall image that is different from the overall image and can be generated from the original image information, when the display magnification for displaying the multiple regions is equal to or less than a predetermined threshold value.
9. The monitoring system described in claim 4, wherein the image information providing device, when receiving from the client control device specification information to fix the display of one area where the status change has occurred, and when it is determined that there are multiple areas where the status change has occurred based on the status of the infrastructure equipment received from the monitoring control device, transmits to the client control device information to display one area where the status change has occurred and information to display a shortcut icon, instead of information to display multiple areas that are areas including all of the multiple areas where the status changes have occurred; and when the client control device receives from the operation device operation information to the effect that the shortcut icon has been operated, it transmits to the image information providing device specification information to specify the transmission of information to display an area that includes some or all of the multiple areas where the status changes have occurred.
10. The monitoring system of claim 1, wherein there are a plurality of client control devices, and the image information providing device transmits to all of the plurality of client control devices information for displaying a partial area of the entire image determined based on area designation information received from the operation device connected to one of the plurality of client control devices.
11. An image information providing device that generates original image information based on the state of infrastructure facilities, and outputs information for displaying a partial area of the entire image that is determined based on area designation information that designates a partial area of an entire image that can be generated using the original image information.
12. A client control device connected to a display device and an operation device, receiving area designation information from the operation device that designates a partial area of an entire image that can be generated from original image information generated based on the state of infrastructure equipment, transmitting the received area designation information to an image information providing device, and receiving information for displaying a partial area of the entire image that is determined based on the area designation information.
13. An image information providing program that causes an image information providing device to generate original image information based on the state of infrastructure facilities, and to transmit information for displaying a partial area of the entire image that is determined based on area designation information that designates a partial area of the entire image that can be generated using the original image information.
14. A client control program that causes a client control device connected to a display device and an operation device to receive from the operation device area designation information that designates a partial area of an entire image that can be generated from original image information generated based on the state of infrastructure equipment, transmit the received area designation information to an image information providing device, and receive from the image information providing device information for displaying a partial area of the entire image that is determined based on the area designation information.
