Monitoring panel operation device and monitoring panel operation system

Abstract

To suppress an operation mistake of a monitoring panel by a monitoring person.SOLUTION: A prompt operation executing unit configured to specify a control content for the elevator system based on a command inputted to the monitoring panel while referring to a processing result by the AI processing unit, and an operation information generating unit configured to generate operation information defining an operation content to be performed on the monitoring panel and a simulation image for displaying an image corresponding to the operation content on the display apparatus while the monitoring panel is operated according to the operation information in order to execute the specified control content while referring to the processing result by the AI processing unit, and output the operation information and the simulation image to the monitoring panel. The AI processing unit includes: SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] An embodiment of the present invention relates to a monitoring panel operation device and a monitoring panel operation system. [Background technology]

[0002] In recent years, elevator systems have been monitored and controlled by monitoring panels such as PC (Personal Computer) monitoring panels. The monitors on the monitoring panels display various information about the elevators and various operation buttons for controlling the elevators. Controlling elevator operation, stopping elevators, and preventing elevators from stopping at specific floors can have a significant impact if an operator makes a mistake, so the monitoring panels must be operated with the utmost care.

[0003] For example, Patent Document 1 discloses a technology that uses machine learning to predict driving conditions during a newly occurring disaster and displays the driving conditions on a monitor using colors or symbols. This makes it possible to prevent drivers from overlooking important information during an emergency. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2023-006806 Summary of the Invention [Problem to be solved by the invention]

[0005] However, with the technology of Patent Document 1, the monitor still has to select the appropriate button from a variety of operation buttons and operate the monitoring panel. Therefore, although highlighting important information has the effect of reducing operational errors by the monitor to a certain extent, the effect of reducing operational errors is not sufficient.

[0006] The problem to be solved by this embodiment is to provide a monitoring panel operation device and a monitoring panel operation system that can reduce operational errors of a monitoring staff member on the monitoring panel. [Means for solving the problem]

[0007] The monitoring panel operating device of the embodiment includes an AI processing unit that acquires input information input to a monitoring panel that monitors an elevator system from an input device attached to the monitoring panel, acquires image information output from the monitoring panel to a display device attached to the monitoring panel, and performs processing using artificial intelligence; a prompt operation execution unit that identifies control content for the elevator system based on commands input to the monitoring panel while referring to the processing results by the AI ​​processing unit; and an operation information generation unit that generates, while referring to the processing results by the AI ​​processing unit, operation information that specifies the operation content to be performed on the monitoring panel in order to execute the identified control content, and a simulated image for displaying an image corresponding to the operation content on the display device while the monitoring panel is operated in accordance with the operation information, and outputs the generated information to the monitoring panel. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a monitoring panel operation system according to an embodiment. [Figure 2] FIG. 2 is a schematic diagram illustrating an example of an operation when the monitoring panel according to the embodiment performs non-stop floor setting control. [Figure 3] FIG. 3 is a schematic diagram illustrating an example of an operation when the monitoring panel according to the embodiment performs non-stop floor setting control. [Figure 4] FIG. 4 is a schematic diagram illustrating an example of an operation when the monitoring panel according to the embodiment performs non-stop floor setting control. [Figure 5] FIG. 5 is a schematic diagram illustrating an example of an operation when the monitoring panel according to the embodiment performs non-stop floor setting control. [Figure 6] FIG. 6 is a schematic diagram illustrating an example of an operation when the monitoring panel according to the embodiment performs non-stop floor setting control. [Figure 7] FIG. 7 is a schematic diagram showing an example of an operation when the monitoring panel operating system according to the embodiment performs non-stop floor setting control. [Figure 8] FIG. 8 is a schematic diagram showing an example of an operation when the monitoring panel operating system according to the embodiment performs non-stop floor setting control. [Figure 9] FIG. 9 is a flowchart illustrating an example of a procedure for operating a monitoring panel by a monitoring panel operating device according to an embodiment. [Figure 10] FIG. 10 is a flowchart illustrating an example of a procedure of a process according to a modified example performed by the monitoring panel operating device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] (Example of a monitoring panel operation system configuration) FIG. 1 is a diagram illustrating an example of the configuration of a monitoring panel operation system 100 according to an embodiment.

[0010] As shown in FIG. 1, a monitoring panel operation system 100 of the embodiment includes a monitoring panel 10, an elevator system 20, a building management system 30, an input device 41, an output device 42, and a monitoring panel operation device 50.

[0011] Elevator system 20 is configured to include, for example, a car installed in a facility such as a predetermined building, various drive mechanisms for driving the car, such as a hoist, rope, and counterweight, and call devices (none of which are shown) installed in the car and at landings within the facility. Note that elevator system 20 may include multiple cars, in which case multiple drive mechanisms are provided corresponding to the individual cars.

[0012] The monitoring panel 10 is configured as a PC equipped with, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory), and monitors the elevator system 20 and controls each part of the elevator system 20 to thereby control the elevator system 20. The monitoring panel 10 may be configured to monitor and control multiple elevator systems 20 installed in the same facility.

[0013] Furthermore, a monitor 11 and various USB (Universal Serial Bus) devices 12 are connected to the monitoring panel 10.

[0014] The monitor 11 is a liquid crystal display (LCD) or the like connected to the monitoring panel 10 via a high-definition multimedia interface (HDMI (registered trademark)) cable or the like.

[0015] The monitor 11 is configured to display information indicating the entire facility in which the elevator system 20 is installed, as well as various information about the elevator system 20 installed in the facility, and various operation buttons 110 (110a, 110b, etc.) for controlling the elevator system 20.

[0016] The USB device 12 is connected to various input tools such as a mouse 120a and a keyboard 120b that are connected to the monitoring panel 10 via a USB port that the monitoring panel 10 has.

[0017] The supervisor of the elevator system 20 reads various information about the elevator system 20 from the monitor 11, selects an operation button 110 from the various operation buttons 110 to perform the desired operation, and operates the monitoring panel 10 using a mouse 120a, a keyboard 120b, etc., to perform various controls on the elevator system 20.

[0018] The monitor 11, and the mouse 120a and keyboard 120b included in the USB device 12 are examples of a display device attached to the monitoring panel 10 and an input device attached to the monitoring panel 10, respectively.

[0019] The input device 41 acquires various types of input information from the mouse 120a, keyboard 120b, etc., which is transmitted to the monitoring panel 10 via a USB port. The input device 41 also acquires various types of image information which is transmitted from the monitoring panel 10 via an HDMI cable and displayed on the monitor 11. The input information and image information acquired by the input device 41 from the monitoring panel 10 is transferred to the monitoring panel operating device 50.

[0020] The output device 42 transfers the operation information 53a and the simulated image 53b generated by the monitoring panel operation device 50 to the monitoring panel 10. The operation information 53a and the simulated image 53b will be described in detail below.

[0021] The monitoring panel operation device 50 is configured, for example, as a cloud server placed on the cloud, and exchanges various information with the monitoring panel 10 via an input device 41 and an output device 42 using a network line such as the Internet.

[0022] The monitoring panel operating device 50 includes an AI processing unit 51, a prompt operation execution unit 52, an operation information generation unit 53, and a building information DB (Data Base) 54. Each of these units may be placed on the cloud, for example, and may be configured from one or more computers equipped with a CPU, ROM, RAM, etc.

[0023] The AI ​​processing unit 51 is equipped with an image recognition unit 511 and a machine learning unit 512, and analyzes the above-mentioned input information and image information transferred from the monitoring panel 10 via the input device 41, and learns various operations on the monitoring panel 10 for controlling the elevator system 20.

[0024] The image recognition unit 511 analyzes various image information using, for example, image recognition technology, and identifies UI (User Interface) elements such as operation buttons 110 on various images actually displayed on the monitor 11, display windows that display information and status of the elevator system 20, and icons that indicate elevators and escalators.

[0025] The machine learning unit 512 analyzes input information regarding various operations performed on the monitoring panel 10 using the mouse 120a, keyboard 120b, etc., and, together with the image analysis results by the image recognition unit 511, learns the monitor's past operation patterns using artificial intelligence (AI) technology and machine learning.

[0026] The prompt operation execution unit 52 accepts commands input by a monitor to the monitoring panel 10. The monitor uses a keyboard 120b or the like connected to the monitoring panel 10 to input commands for performing desired control on the elevator system 20. The prompt operation execution unit 52 analyzes the monitor's commands input in plain text, for example, and identifies the operation content for the monitoring panel 10 to perform the control desired by the monitor.

[0027] The operation information generating unit 53 generates operation information 53a and a simulation image 53b based on the analysis result of the prompt operation executing unit 52, and outputs them to the monitoring panel 10 via the output device .

[0028] The operation information 53a simulates signals transmitted from the mouse 120a, keyboard 120b, etc. to the monitoring panel 10 when a monitor actually performs input operations on the mouse 120a, keyboard 120b, etc. to perform desired control on the elevator system 20. The output device 42 transmits the operation information 53a via the USB port, and the monitoring panel 10 performs the control on the elevator system 20 as desired by the monitor.

[0029] The simulated image 53b simulates signals etc. transmitted from the monitoring panel 10 to the monitor 11 when an observer actually performs input operations on the mouse 120a, keyboard 120b etc., in order to display an image corresponding to these input operations on the monitor 11. The output device 42 described above transmits the simulated image 53b via an HDMI cable, so that an image corresponding to the operation on the monitoring panel 10 is displayed on the monitor 11 of the monitoring panel 10.

[0030] The operation information 53a and the simulated image 53b are generated using the learning results of the AI ​​processing unit 51. This allows the monitoring panel 10 to be automatically operated by the monitoring panel operating device 50, making it possible to control the elevator system 20 under various conditions.

[0031] The building information DB 54 stores various information related to the facility in which the elevator system 20 is installed, such as tenant information 541 and entrance / exit information 542. Information such as the tenant information 541 and entrance / exit information 542 is acquired from the building management system 30, which will be described in detail below. The information stored in the building information DB 54 is referenced by the AI ​​processing unit 51 during machine learning by the AI ​​processing unit 51 and when the prompt operation execution unit 52 and the operation information generation unit 53 generate operation information 53a and simulated image 53b.

[0032] The building management system 30 manages facilities such as buildings in which the elevator system 20 is installed. Facility management includes, for example, facility entry / exit management, notification of various information within the facility, facility security management, etc. To perform such facility management, the building management system 30 holds various types of information related to the facility, such as tenant information 31 and entrance / exit information 32.

[0033] The tenant information 31 includes, for example, the store name and business hours on each floor of the facility, the office name and arrival and departure times on each floor, the content and time of notifications to be sent within the facility, etc. The entrance and exit information 32 includes information such as the closing time of the entrance and exit system within the facility, the current number of people in the facility, etc.

[0034] The monitoring panel 10 described above acquires various information from the building management system 30, and manages and controls the elevator system 20 in cooperation with the building management system 30. The monitoring panel operating device 50 described above also learns how to operate the monitoring panel 10 and determines the operation content of the monitoring panel 10 while referring to tenant information 541 and entrance / exit information 542, etc., acquired from the building management system 30 and stored in the building information DB 54.

[0035] (Monitoring panel operation example) Next, an example of the operation of the monitoring panel 10 of the embodiment will be mainly described with reference to Figures 2 to 6. In the latter half, the machine learning operation of the monitoring panel operating device 50 of the embodiment will also be mentioned.

[0036] 2 to 6 are schematic diagrams showing an example of an operation when the monitoring panel 10 according to the embodiment performs non-stop floor setting control. The non-stop floor setting control is a control for preventing a predetermined car from stopping at a specific floor among a plurality of cars provided in the elevator system 20.

[0037] 2 is an example of the overall planar screen 11a displayed on the monitor 11 of the monitoring panel 10. The overall planar screen 11a is a planar screen that shows the entire facility such as a building and the location of the elevator system 20 installed in the facility, and functions as the main screen or home screen of the monitoring panel 10.

[0038] As shown in FIG. 2, a plurality of operation tabs 111a and 111b for transitioning between display screens on the monitor 11 are displayed in the upper area of ​​the entire planar screen 11a.

[0039] The multiple operation tabs 111a include various tabs that transition the display screen among a menu screen, a plan view screen, a cross-sectional screen, an operation screen, an escalator screen that displays the status of the escalator, a schedule screen, a legend screen that displays various legends, an abnormality information screen that displays abnormality information, and a print screen when printing a screen.

[0040] The multiple operation tabs 111b include an overall area screen on which the overall planar screen 11a is displayed, and various tabs for transitioning the display screen between an office screen, a residential screen, and a low-rise commercial facility / school screen, each of which displays a planar screen of an office area, an area such as a residential facility, and an area such as a low-rise commercial facility / school.

[0041] Additionally, outside these operation tabs 111a and 111b, in the upper right area or the like of the entire planar screen 11a, a command window button 115 is displayed for displaying a command input window in which commands can be input to the monitoring panel operation device 50. Details of command input to the monitoring panel operation device 50 will be described later.

[0042] The whole planar screen 11a is displayed by selecting the tab for the planar screen and the tab for the whole area screen from the above-mentioned operation tabs 111a and 111b.

[0043] On the overall planar screen 11a, icons 113a and 113b indicating elevators, escalators, etc., a display window 112a showing various information, various operation buttons 110a, etc. are displayed superimposed on an overall floor plan 114a of the facility, such as a building, in which the elevator system 20 is installed. However, in Fig. 2, in consideration of ease of viewing the drawing, only some of these displayed contents are denoted by symbols such as 110a, 112a, 113a, 113b.

[0044] Icon 113a indicates the location of elevators installed within the facility. Icon 113a allows the monitor to know the installation location of the elevators and the location of each elevator car (car number). In addition, the monitor can also grasp the general operating status of each car by the display color indicating the elevator car number.

[0045] Icons 113b indicate the locations of escalators installed within the facility. Icons 113b allow supervisors to know the locations of elevators, etc. Furthermore, supervisors can also grasp the general operating status of each escalator from the display color of icons 113b, etc.

[0046] The display window 112 divides the elevator installation positions (banks) and escalator installation positions within the facility into areas, and displays information about the banks and areas, such as the bank names and area names.

[0047] The operation buttons 110a on the entire planar screen 11a have the function of transitioning the display screen to, for example, an operation screen or a cross-sectional screen, etc. On the entire planar screen 11a, these operation buttons 110a are displayed in, for example, individual display windows 112a, and by pressing the operation button 110a in a specific display window 112a, it is possible to transition to an operation screen for controlling the elevators in that bank or the elevators in that area, or the like.

[0048] Fig. 3 is an example of an individual flat screen 11b displayed on the monitor 11 of the monitoring panel 10. The individual flat screen 11b displays an enlarged flat screen for each area. The individual flat screen 11b shown in Fig. 3 is an enlarged flat screen of the office area, and is displayed by selecting the flat screen tab and the office screen tab from the operation tabs 111a and 111b in the upper region of the monitor 11.

[0049] As shown in FIG. 3, the individual planar screen 11b showing the office area also displays a plurality of operation tabs 111a, 111b in the upper region, and command window buttons 115 are displayed on the margins of these operation tabs 111a, 111b. In addition, icons 113a, 113b showing elevators, escalators, etc., a display window 112b showing various information, and various operation buttons 110b, etc. are displayed superimposed on a floor plan 114b showing the entire office area in which the elevator system 20 is installed.

[0050] On the individual flat screen 11b, an icon 113a indicating the elevator position includes an elevator number display section 113c indicating each elevator in the bank. The elevator number display section 113c shows more detailed information such as the elevator name, operating status, and current floor of each elevator in the bank.

[0051] In addition, on the individual flat screen 11b, each display window 112b can display various operation buttons 110b, the bank name mentioned above, as well as indicator lights that indicate a state different from the normal state, such as maintenance inspection or controlled operation.

[0052] Fig. 4 is an example of an operation screen 11c displayed on the monitor 11 of the monitoring panel 10. The operation screen 11c is configured to enable various controls of the elevator system 20 to be performed for each individual area. The operation screen 11c shown in Fig. 4 is a screen for controlling the elevator system 20 installed in an office area, and is displayed by selecting an operation screen tab from among the multiple operation tabs 111a on the individual planar screen 11b shown in Fig. 4, for example, which shows the office area.

[0053] 4, an operation screen 11c of an elevator system 20 installed in an office area also displays a plurality of operation tabs 111a in an upper region. Below these operation tabs 111a, operation tabs 111c for emergency, office 1, office 2, residential, etc., low-rise commercial / school, etc. are displayed. On the operation screen 11c, of these operation tabs 111c for office 1, office 2, residential, etc., low-rise commercial / school, etc., the operation tab 111c for office 1, for example, is selected.

[0054] By appropriately selecting the operation tab 111c for office 2, residential area, low-rise commercial / school area, etc. instead of the operation tab 111c for office 1, it is possible to display the operation screen 11c of the elevator system 20 for an office area, residential area, low-rise commercial / school area, etc. different from office 1. On the operation screen 11c, the emergency operation tab 111c for operating the emergency elevator is always displayed.

[0055] Also on the operation screen 11c, a command window button 115 is displayed outside the operation tabs 111a and 111c.

[0056] In the operation tab 111c of the office 1, for each bank such as office local 1 to 3 and office service, a machine number display section 112c relating to each machine installed in each bank is displayed.

[0057] Each unit display section 112c includes displays relating to the unit name, operating status, monitoring information, operation commands, and the like.

[0058] The operating status includes the display of the current status of the car, such as waiting, ascending, descending, door open, door closed, etc., and also displays the current position of the car by floor number. The monitoring information includes the display of operating information such as operating or suspended, information detected by various sensors such as elevator malfunction, shaking due to earthquakes, etc., over-temperature in the machine room, and fire outbreak, and controlled operation information indicating that controlled operation is being carried out due to the occurrence of earthquakes, fires, power outages, etc.

[0059] The operation commands include the display of various operation buttons 110c for issuing operation switching commands such as operating or halting, setting or canceling non-stop floors, starting or canceling controlled operation, etc. By pressing these operation buttons 110, the monitor can change the operating status, etc. of individual units in the office area.

[0060] The following describes the operations performed on the operation screen 11c, taking the example of setting a non-stop floor for a specific elevator. In the following explanation, the operation of setting the 16th floor as a non-stop floor for elevator No. 5 in the bank partitioned as the office local 1 will be described.

[0061] As shown in Fig. 5, the cursor CSR is moved to and pressed on the non-stop floor setting button among the multiple operation buttons 110c provided for each later stage in the bank of the office local 1. This causes a display window 112d for setting non-stop floors to be displayed in a pop-up format on the operation screen 11c.

[0062] The display window 112d includes displays such as the target group name such as office local 1, the setting range, icons indicating each floor, an OK button, and a cancel button.

[0063] As shown in Figure 6(a), an individual call is selected from a common call or an individual call for a platform or car. An individual call is selected when making a predetermined setting for a specific car among multiple cars included in a bank, such as an office local 1. When a common call is selected, a predetermined setting can be made collectively for all cars included in the bank.

[0064] As shown in Fig. 6(b), when an individual call (landing or car) is selected, check boxes for selecting the setting target from among the landing and car No. 1 to car No. 8 are displayed in the display window 112d. Here, the check box for car No. 5 is checked.

[0065] As shown in Figure 6(c), in this example, the icons for each floor indicate that, of the floors B3 to 16, floors B3, B1, 1, 3, 4, and 7 to 16 are currently the floors where Unit 5 stops. Here, the icon for the 16th floor is clicked. This selects the 16th floor as a new non-stop floor.

[0066] As shown in FIG. 6(d), the OK button on the display window 112d is pressed.

[0067] As shown in FIG. 6(e), pressing the OK button causes a display window 112e to be displayed in a pop-up format. The display window 112e displays a message such as "No-stop floor setting will be performed. Are you sure?" along with a Yes button and a No button. Pressing the Yes button on the display window 112e sets the 16th floor as a no-stop floor for Unit 5.

[0068] The monitoring panel operation device 50 analyzes and learns the above-mentioned various operations performed on the monitoring panel 10 by the monitor.

[0069] That is, the AI ​​processing unit 51 analyzes various operation signals acquired via the USB port of the monitoring panel 10 and various image signals acquired via the HDMI cable of the monitoring panel 10.

[0070] From various image signals, it is possible to estimate the display contents of the overall planar screen 11a, individual planar screen 11b, operation screen 11c, etc. displayed on the monitor 11 under each situation, as well as the display positions of US elements such as operation buttons 110.

[0071] From various operation signals, it is possible to estimate the coordinates of the cursor CSR on the screen of the monitor 11, the coordinates where a click operation or the like is performed with the mouse 120a or the like, and the like.

[0072] Based on these analysis results, the AI ​​processing unit 51 estimates the display contents of the entire planar screen 11a, the individual planar screen 11b, the operation screen 11c, etc., that are displayed on the monitor 11 under each situation. Furthermore, the AI ​​processing unit 51 estimates and learns various operation contents from the coordinates of the cursor CSR, the coordinates where a click operation or the like is performed with the mouse 120a, etc.

[0073] Machine learning by the AI ​​processing unit 51 may be performed not only on the setting operation of non-stop floors for the specified elevator as described above, but also on a variety of general operations, such as pausing a specified elevator, setting controlled operation, and canceling these settings.

[0074] In addition, in machine learning by the AI ​​processing unit 51, by acquiring command signals etc. that directly represent the internal operation of the monitoring panel 10, it is thought that it is possible to grasp and learn the operations performed by the monitor on the monitoring panel 10 more simply and easily than by performing image recognition processing on the display screen on the monitor 11 and analyzing the input contents from the mouse 120a and keyboard 120b etc. via the USB port.

[0075] However, it is not desirable from the viewpoint of security of the facility where the elevator system 20 is installed to exchange such information, which can be easily understood by a third party, with the external monitoring panel operating device 50. According to the above method, machine learning by the AI ​​processing unit 51 can be performed while taking into consideration the security of the facility.

[0076] (Example of operation of the monitoring panel operation system) Next, an example of operation of the monitoring panel operation system 100 according to the embodiment will be mainly described with reference to Fig. 7 and Fig. 8. Fig. 7 and Fig. 8 are schematic diagrams showing an example of operation when the monitoring panel operation system 100 according to the embodiment performs non-stop floor setting control.

[0077] 7, like the above-described Fig. 2, is an overall planar screen 11a showing the entire facility in which the elevator system 20 is installed. As described above, the command window button 115 is displayed in the upper right region or the like of the overall planar screen 11a.

[0078] As machine learning by the AI ​​processing unit 51 progresses and the monitoring panel operation device 50 becomes capable of performing various operations on the monitoring panel 10, the command window button 115 on each display screen, such as the overall flat screen 11a, as well as the individual flat screen 11b and operation screen 11c, will be displayed in a pressable state.

[0079] 7, by pressing the command window button 115, a command input window 112p can be displayed in a pop-up format on a display screen such as the entire planar screen 11a. The command input window 112p is configured to allow commands to be input to the monitoring panel operation device 50. The monitoring panel operation device 50 analyzes the input command and automatically operates the monitoring panel 10 in place of the monitor.

[0080] The following describes the operation of the monitoring panel 10 performed by the monitoring panel operating device 50, taking as an example the operation of setting a non-stop floor for a specific elevator. In the following explanation, as with the above-mentioned FIG. 5 and subsequent figures, the operation of setting the 16th floor as a non-stop floor for elevator No. 5 in the bank partitioned as the office local 1 will be described.

[0081] 8(a), in the command input window 112p, the supervisor can input desired control details for the elevator system 20. Here, it is assumed that the supervisor inputs, for example, using the keyboard 120b, "I want to make the 16th floor a non-stop floor for elevator No. 5."

[0082] The prompt operation execution unit 52 of the monitoring panel operation device 50 analyzes the input command and identifies what kind of control should be performed on the elevator system 20. In this example, it is identified that the user wants to set the 16th floor as a non-stop floor for elevator No. 5. When the prompt operation execution unit 52 analyzes the command, the AI ​​processing unit 51 analyzes the input information from the mouse 120a and keyboard 120b of the monitoring panel 10 and identifies the text of the input command, etc.

[0083] Furthermore, the AI ​​processing unit 51 identifies the screen currently displayed on the monitor 11 from image information at least immediately before the command input in the command input window 112p, and also grasps the current state of the elevator system 20. The image information at this time is also acquired from the monitoring panel 10 via the input device 41. The current state of the elevator system 20 may include, for example, that the No. 5 elevator is operating normally, that no existing settings have been made for the No. 5 elevator, and so on.

[0084] In addition, the AI ​​processing unit 51 refers to various information about the facility, such as tenant information 541 and entry / exit information 542, obtained from the building management system 30 and stored in the building information DB 54, and extracts facility information that should be taken into consideration when controlling the elevator system 20 identified by the prompt operation execution unit 52.

[0085] The operation information generation unit 53 identifies the operation to be performed on the monitoring panel 10 that is required to set the non-stop floors, based on the analysis result of the prompt operation execution unit 52. At this time, the operation information generation unit 53 uses the learning result of the AI ​​processing unit 51, and also refers to the current display screen analyzed by the AI ​​processing unit 51, the current state of the elevator system 20, and additional information extracted by the AI ​​processing unit 51 when performing the above control.

[0086] Furthermore, the operation information generating unit 53 generates operation information 53a for performing the identified operation on the monitoring panel 10. In this example, the operation information 53a includes operation signals to the monitoring panel 10 that correspond to, among the plurality of operation tabs 111a to 111c shown in the above-described FIGS. 2 to 4 and the like, a click operation on the operation tabs 111a to 111c required for displaying the operation screen 11c, a click operation on the operation button 110 for displaying the display window 112d for setting non-stop floors on the operation screen 11c shown in the above-described FIG. 5, a click operation on various operation buttons 110 for setting non-stop floors on the display window 112d shown in FIG. 6, and the like.

[0087] Operations equivalent to various click operations can be performed by specifying the coordinates of the cursor CSR on the monitor 11, etc.

[0088] Furthermore, the operation information generating unit 53 generates a simulated image 53b to be displayed on the monitor 11 in accordance with the above-mentioned operations on the monitoring panel 10. The simulated image 53b includes simulated images such as the overall planar screen 11a, the individual planar screen 11b, and the operation screen 11c shown in Figures 2 to 4 described above, the display window 112d that pops up on the operation screen 11c shown in Figure 5, and the display window 112d shown in Figure 6, the state of which changes in accordance with various operations.

[0089] The operation information generation unit 53 transmits the operation information 53a and simulated image 53b generated as described above to the monitoring panel 10 via the output device 42. As a result, the monitoring panel 10 is automatically operated in accordance with the operation information 53a, and various simulated images in accordance with the simulated image 53b are displayed on the monitor 11 in accordance with the operation of the monitoring panel 10.

[0090] As shown in Fig. 8(b), when the display of the simulated image starts, it is preferable to display a display window 112m to notify the monitor 11 of the start of the simulated image display and to obtain the monitor's approval. This allows the monitor to more reliably recognize that the image displayed on the monitor 11 from this point on is a simulated image.

[0091] As shown in Fig. 8(c), the simulated image displayed on the monitor 11 may be, for example, a simulated image corresponding to the display window 112d shown in Fig. 6(a) to Fig. 6(d) after passing through simulated images corresponding to the overall planar screen 11a, the individual planar screen 11b, and the operation screen 11c shown in Fig. 2 to Fig. 4. However, the screen transitions among the overall planar screen 11a, the individual planar screen 11b, and the operation screen 11c may vary depending on the display screen when the command input window 112p is displayed.

[0092] Furthermore, when the various simulation screens are displayed, it is preferable to appropriately display a display window 112m that explains the operations to be performed and allows the supervisor to confirm that the operations are correct, thereby allowing the supervisor to proceed with the operation of the monitoring panel 10.

[0093] 8(d), if the AI ​​processing unit 51 has extracted facility information, etc. that should be taken into consideration when controlling the elevator system 20, a display window 112m may be further displayed to present the extracted facility information, etc. Here, information on the tenants occupying the fifth floor, information on the time when the entrance / exit system will be completely closed, etc., is displayed.

[0094] Furthermore, the display window 112m may display suggested content to assist with operation based on the extracted facility information, etc. Here, when setting non-stop floors, a suggestion is made as to whether or not to set only the time period that coincides with the complete closing time of the entrance / exit system.

[0095] As shown in Fig. 8(e), when the non-stop floor setting is completed, a mock screen of a display window 112e corresponding to the above-mentioned Fig. 6(e) is displayed on the monitor 11. If the monitor adopts the above-mentioned proposal, additional settings etc. adopted by the monitor may be displayed in the display window 112e.

[0096] After the automatic operation by the monitoring panel operating device 50 is completed, the AI ​​processing unit 51 again acquires image information and the like from the monitoring panel 10 via the input device 41, and checks whether the operation results on the monitoring panel 10 are correctly reflected and whether the elevator system 20 is set to the state desired by the monitor. At this time, the monitoring panel operating device 50 may display on the monitor 11 that the operation has been completed successfully.

[0097] As described above, the automatic operation of the monitoring panel 10 by the monitoring panel operating device 50 may be capable of being performed for a variety of general operations, not limited to the setting of non-stop floors for the specified locomotive as described above, but also including pausing the specified locomotive, setting control operation, and canceling these settings.

[0098] Furthermore, even when the monitoring panel 10 is automatically operated by the monitoring panel operating device 50, rather than outputting command signals or the like that cause the monitoring panel 10 to perform specified internal operations, the above processing can be performed indirectly by operating the monitoring panel 10 using operation information 53a via a USB port and simulated images 53b via an HDMI cable, etc., while taking security in the facility into consideration.

[0099] (Example of processing for monitoring panel operation device) Next, an example of operation processing of the monitoring panel 10 by the monitoring panel operating device 50 of the embodiment will be described with reference to Fig. 9. Fig. 9 is a flow chart showing an example of the procedure of operation processing of the monitoring panel 10 by the monitoring panel operating device 50 according to the embodiment.

[0100] 9, the monitoring panel operation device 50 monitors whether or not the command window button 115 is pressed on any display screen on the monitor 11 (step S101). While the command window button 115 is not pressed (step S101: No), the monitoring panel operation device 50 continues monitoring.

[0101] When the command window button 115 is pressed on any display screen (step S101: Yes), a command input window 112p is displayed on that display screen (step S102). The prompt operation execution unit 52 monitors whether a command has been input in the command input window 112p (step S103). While no command has been input (step S103: No), the prompt operation execution unit 52 continues monitoring.

[0102] When a command is entered on the command input window 112p (S103: Yes), the prompt operation execution unit 52 identifies the control content for the elevator system 20 from the entered command, and the AI ​​processing unit 51 identifies the current status of the elevator system 20, the display screen, facility information, etc. (step S104).

[0103] The current state and display screen of the elevator system 20 are identified by image information at that time acquired from the monitoring panel 10, and facility information is identified from various information stored in the building information DB .

[0104] The operation information generating unit 53 generates operation information 53a and a simulated image 53b based on the control content, the state of the elevator system 20, the current display screen, etc., respectively specified by the prompt operation executing unit 52 and the AI ​​processing unit 51 (step S105). In addition, the operation information generating unit 53 determines whether or not there is additional information extracted by the AI ​​processing unit 51 from facility information, etc. (step S106).

[0105] If there is incidental information about the facility or the like (step S106: Yes), the incidental information and, if necessary, information for presenting suggestions or the like based on the incidental information are added to the generated operation information 53a and simulated image 53b (step S107). If there is no incidental information about the facility or the like (step S106: No), the processing of step S107 is skipped. The operation information generation unit 53 outputs the generated operation information 53a and simulated image 53b to the monitoring panel 10 (step S108).

[0106] The processing in the loop L101 to L102 (steps S109, S110) is repeated a required number of times.

[0107] That is, automatic operations of the monitoring panel 10 are executed sequentially in accordance with the operation information 53a and simulated image 53b output to the monitoring panel 10 (step S109), and further operations are carried out (step S109) while obtaining approval from the monitor in accordance with these automatic operations (step S110).

[0108] By repeating the processing of steps S109 and S110 the required number of times, control according to the command input by the supervisor is performed on the elevator system 20. However, if the supervisor denies the specified operation content before the automatic operation of the monitoring panel 10 is completed (step S110: No), the automatic operation of the monitoring panel 10 ends with an error (step S112).

[0109] When the automatic operation of the monitoring panel 10 is completed, the AI ​​processing unit 51 determines whether or not control in accordance with the input command has been performed on the elevator system 20 (step S111). The above determination by the AI ​​processing unit 51 is made based on image information newly acquired from the monitoring panel 10, etc.

[0110] If the settings made by the automatic operation of the monitoring panel 10 are correctly reflected (step S111: Yes), the process ends normally. If the settings made by the automatic operation of the monitoring panel 10 are not correctly reflected (step S111: No), the process ends with an error (step S112).

[0111] This completes the operation process of the monitoring panel 10 by the monitoring panel operation device 50 of the embodiment.

[0112] (Overview) When operating a monitoring panel that monitors and controls an elevator system, a monitor must read various information about the elevator system from the monitor, select an operation button from among the various operation buttons to perform the desired operation, and control the elevator system.

[0113] However, there is a possibility that an operation error on the monitoring panel may occur due to an accidental mouse click or a mistake on the part of the monitor. In elevator system control, there are many operations that can be greatly affected by an operation error, such as setting a specific elevator to be idle or setting a non-stop floor, so it is desirable to prevent such operation errors.

[0114] According to the embodiment of the monitoring panel operating device 50, the AI ​​processing unit 51 acquires input information input to the monitoring panel 10 from the mouse 120a, keyboard 120b, etc. attached to the monitoring panel 10 that monitors the elevator system 20, acquires image information output from the monitoring panel 10 to the monitor 11 attached to the monitoring panel 10, and performs processing using AI.

[0115] This allows the operator to grasp the operation details on the monitoring panel 10 and the display details on the monitor 11 while maintaining the security of the facility in which the elevator system 20 is installed.

[0116] According to the monitoring panel operating device 50 of the embodiment, the prompt operation executing unit 52 identifies the control content for the elevator system 20 based on the command input to the monitoring panel 10 while referring to the processing result by the AI ​​processing unit 51.

[0117] This allows the supervisor to instruct the monitoring panel operation device 50 on the desired control content for the elevator system 20 simply by inputting commands in plain text, for example.

[0118] According to the embodiment of the monitoring panel operation device 50, the operation information generation unit 53 generates operation information 53a that specifies the operation content to be performed on the monitoring panel 10 in order to execute the identified control content, while referring to the processing results by the AI ​​processing unit 51, and outputs the information to the monitoring panel 10.

[0119] This allows the monitoring panel 10 to be automatically operated based on commands input by the supervisor while maintaining the security of the facility, allowing the desired control of the elevator system 20. This reduces operational errors of the supervisor in the monitoring panel 10. Furthermore, the operational efficiency of the monitoring panel 10 can be improved.

[0120] According to the embodiment of the monitoring panel operation device 50, in order to execute the specified control content, the operation information generation unit 53 generates a simulated image 53b for displaying an image corresponding to the operation content on the monitor 11 while the monitoring panel 10 is operated in accordance with the operation information 53a, while referring to the processing results by the AI ​​processing unit 51, and outputs the generated simulated image 53b to the monitoring panel 10.

[0121] This allows the monitor to proceed with the operation while appropriately checking the operation details of the monitoring panel 10 using the monitoring panel operating device 50. Since information is output to the monitoring panel 10 in a format that cannot be easily analyzed by third parties, the security of the facility is also maintained.

[0122] According to the monitoring panel operation device 50 of the embodiment, the AI ​​processing unit 51 analyzes the acquired image information and identifies the state of the elevator system 20 and the image displayed on the monitor 11 at the time of inputting the command.

[0123] As a result, the operation information generation unit 53 can generate operation information 53a and simulated image 53b based on the current state of the elevator system 20, and also, if necessary, including an operation to transition from the current display image on the monitor 11 to the operation screen 11c.

[0124] According to the monitoring panel operating device 50 of the embodiment, the AI ​​processing unit 51 uses machine learning to learn the operation of the monitoring panel 10 by the monitor who monitors the elevator system 20, based on the analysis results of the acquired image information and input information. This makes it possible to learn a method for automatically operating the monitoring panel 10 in place of the monitor, while maintaining the security of the facility.

[0125] According to the monitoring panel operating device 50 of the embodiment, the operation information generating unit 53 includes in the operation information 53a an operation to present supplementary information related to the control of the elevator system 20, which the AI ​​processing unit 51 has extracted by referring to the building information DB 54. This allows the monitor to examine the control content of the elevator system 20 from more diverse angles and cause the monitoring panel operating device 50 to perform a more appropriate operation.

[0126] According to the monitoring panel operating device 50 of the embodiment, the operation information generating unit 53 includes, in the operation information 53a, an operation to present a proposal based on the supplementary information, which can help the monitor to more appropriately control the elevator system 20.

[0127] In the above embodiment, commands to the monitoring panel operation device 50 are given using, for example, the keyboard 120b, etc. However, the monitor may also give commands to the monitoring panel operation device 50 by voice, etc.

[0128] (Variation) Next, a modified example of the processing by the monitoring panel operating device 50 of the embodiment will be described with reference to Fig. 10. In the processing of the modified example, the monitoring panel operating device 50 does not operate the monitoring panel 10, but only displays a simulated image on the monitor 11, which is different from the processing of the embodiment described above. The processing of the modified example can be performed when simulating the occurrence of a disaster such as an earthquake, fire, or power outage.

[0129] FIG. 10 is a flowchart showing an example of a procedure of a process of the modified example by the monitoring panel operating device 50 according to the embodiment.

[0130] As shown in FIG. 10, when the command window button 115 is pressed on any display screen on the monitor 11 (step S201: Yes), the monitoring panel operation device 50 displays the command input window 112p (step S202), and the prompt operation execution unit 52 analyzes the command entered on the command input window 112p (S203: Yes) and determines whether the content of the command instructs the execution of a simulation (step S204).

[0131] A command to run a simulation is identified by the inclusion of input content such as, for example, "I would like to run a simulation of an earthquake." At this time, the supervisor may be further prompted to input additional information that specifies the scale of the simulation, such as the area within the facility to be simulated and the number of elevator banks.

[0132] If the command is not an instruction to execute a simulation but indicates a predetermined control content for the elevator system 20 (step S204: No), the monitoring panel operating device 50 proceeds to the processing from step S104 onwards shown in Figure 9 of the above-mentioned embodiment.

[0133] If the command is an instruction to execute a simulation (step S204: Yes), the AI ​​processing unit 51 identifies the current state of the elevator system 20 and facility that are the subject of the simulation, the current display screen, etc. (step S205).

[0134] As described above, the current status and display screen of the elevator system 20 are determined by the image information at that time obtained from the monitoring panel 10, and the current status of the facility is determined from various information stored in the building information DB 54.

[0135] The operation information generation unit 53 generates operation information 53a and a simulated image 53b based on the control content, the state of the elevator system 20, the current display screen, etc., respectively identified by the prompt operation execution unit 52 and the AI ​​processing unit 51 (step S206).

[0136] In the processing of the modified example, the operation information 53a and the simulated image 53b are generated according to a simulation scenario. The simulation scenario is generated by the AI ​​processing unit 51, and includes settings for situations that change over time from the occurrence of an earthquake, such as the time of occurrence of a large-scale earthquake, the state of each unit five minutes after the occurrence of a large-scale earthquake, switching all units to earthquake control operation six minutes after the occurrence of a large-scale earthquake, starting automatic recovery of all units seven minutes after the occurrence of a large-scale earthquake, and starting recovery operation of all units ten minutes after the occurrence of a large-scale earthquake.

[0137] The AI ​​processing unit 51, for example, refers to the building information DB 54, applies records of past earthquakes and learning results from machine learning to the facility being simulated, predicts the expected impact on the facility and elevator system 20 in the event of a large-scale earthquake, and generates the above-mentioned scenario.

[0138] Therefore, in the above example, the operation information 53a includes an operation to detect the occurrence of a large-scale earthquake, an operation to check the status of each unit after the occurrence of an earthquake, an operation to switch to earthquake control operation, an operation to start recovery operation, and the like.

[0139] Furthermore, the simulated images 53b include simulated images 53b for presenting simulation results in addition to simulated images 53b corresponding to the operations indicated by the operation information 53a. The simulation results include, for example, the evacuation rate from the facility, the evacuation completion time, the evacuation route usage status, the evacuation shelter arrival rate, the remaining capacity of the evacuation shelter, the evacuation status of people requiring special consideration, and the like.

[0140] The evacuation rate and evacuation completion time from the facility are calculated, for example, based on the number of people present in the facility obtained by the building management system 30 from the facility's entrance / exit system, i.e., the number of people present in the facility when a large-scale earthquake occurred. More specifically, the evacuation rate is the number of people present who have completed evacuation by the time the evacuation began or the simulation ended, and is expressed, for example, as a percentage, as the ratio of those who have completed evacuation to the total number of people present. The evacuation completion time is the predicted time from the start of evacuation until everyone has completed evacuation.

[0141] The evacuation route usage status is calculated based on the information on the number of people in the building as well as information on the evacuation routes obtained from the building management system 30. More specifically, the evacuation route usage status is a breakdown of the number of people who evacuated via each evacuation route. This makes it possible to grasp the congestion status of the evacuation routes.

[0142] The number of people arriving at the evacuation shelter is calculated based on the information on the number of people present in the building, as well as information on evacuation shelters around the facility obtained from the building management system 30. More specifically, the number of people arriving at the evacuation shelter is the number of people who have arrived at each evacuation shelter, with a breakdown for each evacuation shelter shown. This also makes it possible to calculate the remaining capacity of the evacuation shelter. In other words, the remaining capacity of the evacuation shelter is calculated from the maximum capacity and current capacity of each evacuation shelter. If any evacuation shelter is approaching full capacity, an additional warning message is displayed.

[0143] The evacuation status of people requiring special consideration is calculated based on the information on the number of people present at the facility as described above, as well as information on facility users acquired from the building management system 30. The AI ​​processing unit 51 identifies trends in the attributes of facility users from the information on facility users, and calculates the ratio of people requiring special consideration, such as the elderly, disabled, and children, to the total number of people present at the facility. The AI ​​processing unit 51 also predicts the support status of people requiring special consideration from information on supplies stockpiled at the facility and surrounding evacuation shelters, as well as information on medical institutions and other facilities near the facility.

[0144] The operation information generation unit 53 outputs only the simulated image 53b out of the operation information 53a and simulated image 53b generated as described above to the monitoring panel 10 (step S207). As a result, the simulated images 53b are sequentially displayed on the monitor 11 of the monitoring panel 10 (step S208). The display of the simulated images 53b starts with a notice that the simulated image 53b will be displayed, then goes through the simulated image 53b corresponding to the operation information 53a generated according to the simulation scenario, and ends with the simulated image 53b presenting the simulation result at the end of the simulation.

[0145] Since this is a simulation, as described above, the operation information 53a is not output to the monitoring panel 10, and no operation is performed on the monitoring panel 10.

[0146] This completes the processing of the modified example by the monitoring panel operation device 50 of the embodiment.

[0147] The processing of the above-described modified example is performed as a simulation of a disaster occurrence, but the processing of the modified example may also be used when actually conducting disaster prevention training or evacuation training.

[0148] In an actual disaster prevention drill, not only the simulated image 53b but also the operation information 53a generated according to the scenario may be output to the monitoring panel 10, and the monitoring panel 10 may be actually operated. In an actual evacuation drill, in addition to operating the monitoring panel 10, facility staff and facility users may be introduced and training may be conducted to evacuate these people according to the assumptions made in the scenario. In this case, instead of the simulation results, the evacuation rate from the facility, the evacuation completion time, etc. in the actual evacuation drill may be presented as the training results.

[0149] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims. [Explanation of symbols]

[0150] 10...monitoring panel, 11...monitor, 12...USB device, 20...elevator system, 30...building management system, 41...input device, 42...output device, 50...monitoring panel operation device, 51...AI processing unit, 52...prompt operation execution unit, 53...operation information generation unit, 53a...operation information, 53b...simulated image, 54...building information DB, 100...monitoring panel operation system

Claims

1. an AI processing unit that acquires input information input to a monitoring panel that monitors the elevator system from an input device attached to the monitoring panel, acquires image information output from the monitoring panel to a display device attached to the monitoring panel, and performs processing using artificial intelligence; a prompt operation execution unit that identifies control content for the elevator system based on a command input to the monitoring panel while referring to a processing result by the AI ​​processing unit; and an operation information generation unit that generates operation information specifying the operation content to be performed on the monitoring panel in order to execute the specified control content, and a simulated image for displaying an image corresponding to the operation content on the display device while the monitoring panel is being operated in accordance with the operation information, while referring to the processing result by the AI ​​processing unit, and outputs the generated image to the monitoring panel. Monitoring panel operating device.

2. The AI ​​processing unit analyzing the acquired image information to identify the state of the elevator system and the image displayed on the display device at the time of inputting the command; The monitoring panel operation device according to claim 1.

3. The AI ​​processing unit learning, by machine learning, the operation of the monitoring panel by a monitor who monitors the elevator system from the analysis results of the acquired image information and the input information; The prompt operation execution unit Identifying control content for the elevator system based on the learning result by the AI ​​processing unit; The operation information generation unit Based on the learning result by the AI ​​processing unit, an operation content for the monitoring panel for controlling the elevator system is identified, and the operation information and the simulated image are generated. The monitoring panel operation device according to claim 1.

4. a database that acquires and stores information about the facility from a management system that manages the facility in which the elevator system is installed; The AI ​​processing unit extracting supplementary information related to control of the elevator system by referring to the database; The operation information generation unit an operation for presenting the supplementary information is included in the operation information; The monitoring panel operation device according to claim 1.

5. The operation information generation unit an operation for presenting a proposal based on the supplementary information is included in the operation information; The monitoring panel operation device according to claim 4.

6. An elevator system; a monitoring panel for monitoring the elevator system; A monitoring panel operation device for operating the monitoring panel, The monitoring panel operation device is An AI processing unit that acquires input information input to the monitoring panel from an input device attached to the monitoring panel, acquires image information output from the monitoring panel to a display device attached to the monitoring panel, and performs processing using artificial intelligence; a prompt operation execution unit that identifies control content for the elevator system based on a command input to the monitoring panel while referring to a processing result by the AI ​​processing unit; and an operation information generation unit that generates operation information specifying the operation content to be performed on the monitoring panel in order to execute the specified control content, and a simulated image for displaying an image corresponding to the operation content on the display device while the monitoring panel is being operated in accordance with the operation information, while referring to the processing result by the AI ​​processing unit, and outputs the generated simulated image to the monitoring panel. Monitoring panel operation system.

Images