Elevator Failure Monitoring System and Elevator Failure Monitoring Method
The elevator failure monitoring system addresses the lack of coordination between robots and elevator controls by integrating audio and video information to detect abnormalities and ensure smooth operation, enhancing passenger safety and enabling automatic rescue operations.
Patent Information
- Application Number
- JP2022090603
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-06-03
- Publication Date
- 2025-06-19
- Estimated Expiration
- 2042-06-03
AI Technical Summary
Existing elevator systems lack coordination between autonomous mobile robots and elevator controls, leading to situations where robots may block passenger paths, preventing immediate egress.
An elevator failure monitoring system that integrates audio and video information from elevator cars, detects abnormalities, and coordinates with a failure monitoring center to ensure smooth robot operation and passenger safety by providing a communication route for remote operation.
The system enables seamless operation of robots within buildings by ensuring that passenger safety is maintained, allowing for automatic notification and rescue operations when abnormalities occur, and providing a communication route for remote robot operation.
Smart Images

Figure 0007695917000001 
Figure 0007695917000002 
Figure 0007695917000003
Abstract
Description
Technical Field
[0001] The present invention relates to an elevator failure monitoring system and an elevator failure monitoring method considering an autonomous mobile body.
Background Art
[0002] In recent years, the practical application of autonomous mobile bodies (hereinafter referred to as robots) that perform tasks such as cleaning inside buildings, transporting luggage, and guiding people in buildings has been promoted. In a building with multiple floors such as a building, it is essential to use an elevator for the robot to perform the above tasks.
[0003] However, when using an elevator for a robot, it is necessary to assume that the robot may become immobile (stacked). If the robot cannot move inside the elevator car, the elevator operation will stop.
[0004] Therefore, for example, in Patent Document 1, when the robot becomes immobile, the upper management device releases the autonomous movement mode of the robot, checks the surrounding camera images that can capture the robot, and enables the robot to be remotely operated. A control system for an autonomous mobile device has been proposed.
Prior Art Documents
Patent Documents
[0005]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0006] According to Patent Document 1, if the robot itself can detect an immobile state, it is possible to control the robot using a control system for an autonomous mobile device that remotely operates the robot.
[0007] However, when the robot gets on the elevator, if it cannot determine that there are passengers remaining in the car and gets into the car, it is assumed that the robot will block the path of the passengers getting off the elevator, and the passengers will not be able to get off immediately.
[0008] The assumed case regarding the robot's use of the elevator is due to the fact that the robot is controlled by its control device but is not coordinated with the elevator control side.
[0009] Therefore, in the present invention, an object is to provide an elevator failure monitoring system and an elevator failure monitoring method for smoothly moving the robot within the building by incorporating the robot into the management target.
Means for Solving the Problems
[0010] From the above, in the present invention, "an elevator failure monitoring system when a robot uses an elevator car in a building, which manages the calls of the elevator car to control the operation of the elevator car, obtains the audio and video information from the audio and video acquisition means installed in the elevator car, and detects abnormalities in the elevator car; an elevator-robot cooperation unit that controls the robot moving within the building and stores the notification destination in case of an abnormality; and a failure monitoring center that obtains the abnormality detection information, audio, and video information in the elevator car from the elevator control device, obtains the notification destination in case of an abnormality when the robot is involved in the abnormality, presents the abnormality detection information, audio, and video information in the elevator car to the corresponding person on the robot side, and secures and provides a communication route enabling the operation of the robot via the elevator-robot cooperation unit", is provided.
[0011] In the present invention, there is provided an elevator failure monitoring method when a robot uses an elevator car in a building, which manages calls for the elevator car to control the operation of the elevator car, obtains voice and video information from voice and video acquisition means installed in the elevator car, detects abnormalities in the elevator car, controls the robot moving in the building, stores the notification destination in case of an abnormality, obtains the detection information of the abnormality in the elevator car and the voice and video information, when the robot is involved in the abnormality, obtains the notification destination in case of an abnormality, presents the detection information of the abnormality in the elevator car and the voice and video information to the corresponding person on the robot side, and secures and provides a communication route enabling the operation of the robot.
Advantages of the Invention
[0012] According to the present invention, it is possible to provide an elevator failure monitoring system for smoothly moving a robot in a building.
[0013] Specifically, according to an embodiment of the present invention, when a robot attempts to board an elevator car, if a passenger in the elevator is blocked by the robot and cannot get off, in order to request rescue by using the intercom in the car, the rescue signal is automatically transferred to the robot's failure response destination (notification destination), so that rescue operations can be carried out smoothly.
[0014] In addition, by making the camera and the microphone / speaker of the intercom in the car accessible from the robot's failure response destination, it is possible to check the situation of the passengers in the car even if the robot itself fails.
Brief Description of the Drawings
[0015]
Figure 1
Figure 2
Figure 3
Embodiment for Carrying Out the Invention
[0016] Hereinafter, embodiments of the present invention will be described with reference to the drawings.
Embodiment
[0017] FIG. 1 is a diagram showing a configuration example of an elevator failure monitoring system according to Embodiment 1 of the present invention.
[0018] The elevator failure monitoring system 10 includes an elevator car 5, an elevator control panel 4, and a failure monitoring center 3 as mechanisms on the elevator side, and also includes a robot 1 and an elevator-robot cooperation unit 2 as mechanisms on the robot side. By the cooperation between the elevator side and the robot side, it is possible to notify, request, and execute responses to troubles from the elevator side to the robot side together with necessary information.
[0019] The following description will be sequentially made from the mechanisms on the elevator side. First, the elevator car 5 includes an intercom 51 having an intercom button 511, a microphone 512, and a speaker 513, and a camera 52 for photographing the inside of the car.
[0020] On the other hand, as its main function, the elevator control panel 4 performs processing of causing the elevator car 5 to travel up and down and opening and closing the doors in response to elevator calls in normal operation by an operation control unit 42.
[0021] The elevator control panel 4 also includes a signal input unit 44 for detecting a pressing signal of the intercom button 511 in the elevator car 5, a voice input unit 45 for inputting the microphone voice 512 of the intercom, a video input unit 46 for inputting the video of the camera 52 in the elevator car 5, and a voice output unit 47 for outputting voice to the speaker 513 of the intercom.
[0022] As a result, problems such as a situation where a robot blocks the path of passengers getting off the elevator car 5, preventing the passengers from getting off immediately, are recognized on the elevator control panel 4 based on notifications from the passengers. Also, when the situation is grasped by the elevator control panel 4, it will be possible to notify the passengers.
[0023] Upon receiving such a notification, the elevator control panel 4 functions as follows. First, the abnormality detection unit 43 monitors door opening and closing commands from the operation control unit 42, detects a specific state of the elevator, and determines that entrapment has occurred. The abnormality notification unit 48 creates abnormality notification content using the pressing signal of the intercom button 511 and the entrapment state detected by the abnormality detection unit 43, and notifies the failure monitoring center 3 from the communication unit 41 that an abnormality has occurred. The abnormality notification content at this time includes voice input and video input detected inside the elevator car 5.
[0024] Here, before explaining the failure monitoring center 3, the mechanism on the robot side will be explained. First, the robot 1 includes a communication unit 11 that communicates with the elevator-robot cooperation unit 2, and a control unit 12 that controls the operation of the robot 1. It operates according to instructions from the operation control unit 23 in the elevator-robot cooperation unit 2 as appropriate, or operates autonomously based on self-judgment, and transmits an elevator call to the elevator-robot cooperation unit 2 as necessary information, for example, when using the elevator.
[0025] The elevator-robot cooperation unit 2 includes a robot communication unit 21 that communicates with the robot 1, a storage unit 22 that stores a robot notification destination 221 for notifying a responder when the robot 1 fails, an operation control unit 23 that controls an elevator call registration command from the robot, and an elevator communication unit 24 that requests the elevator control panel 4 to create a call.
[0026] In this way, the mechanisms on the elevator side (elevator car 5, elevator control panel 4) and the mechanisms on the robot side (robot 1, elevator-robot cooperation unit 2) function independently during normal operation, and they cooperate only in relation to the registration and management of elevator calls from the robot side.
[0027] On the other hand, when the elevator control panel 4 detects an abnormality notification, generally, the failure monitoring center 3 configured as a server gets involved and contributes to handling the situation. The failure monitoring center 3 includes an elevator communication unit 31, a notification control unit 32, a relay app issuing unit 33, a public Web display unit 34, a monitoring center Web display unit 36, and a call control unit 35.
[0028] The present invention is characterized by the following responses when a robot is riding in the elevator car 5. As a premise in this case, the elevator-robot cooperation unit 2 and the failure monitoring center 3 may be manned or unmanned, but there is a responder M in a standby state that is required to respond by being notified of the detection of an abnormality in the elevator car 5 by the failure monitoring center 3 and ensuring a communication route.
[0029] When the elevator control panel 4 detects an abnormality notification, the failure monitoring center 3 receives the abnormality notification content from the elevator control panel 4 through the elevator communication unit 31 and transmits it to the notification control unit 32. After receiving the abnormality notification content (elevator direct talk or confinement failure signal), the notification control unit 32 confirms with the elevator-robot cooperation unit 2 that the robot 1 has currently created a call and is riding in the elevator car 5.
[0030] When a robot is riding in the elevator car 5, the reporting control unit 32 in the failure monitoring center 3 further acquires information on the robot reporting destination 221 that manages the robot 1 in which a trouble has occurred from the storage unit 22 of the elevator-robot cooperation unit 2. The information on the robot reporting destination 221 includes the responder MR on the elevator-robot cooperation unit 2 side, and relays the app to the reporting destination of the robot (for example, the mobile information terminal 6 owned by the responder MR on the elevator-robot cooperation unit 2 side) via the relay app issuing unit 33.
[0031] The relay app includes an access method for accessing the public Web display unit 34 in the failure monitoring center 3, whereby the responder MR is permitted to access the public Web display unit 34 using the mobile information terminal 6.
[0032] When the responder MR who has accessed the public Web display unit 34 sees a screen as shown in FIG. 2 on the mobile information terminal 6 he / she possesses, he / she can receive the microphone and speaker of the client (responder MR) accessing from the relay app, and obtain the video of the elevator's direct talk microphone, speaker, and camera by display and broadcast. A similar environment is also prepared in the monitoring center Web display unit 36 in the failure monitoring center 3, and similar information is presented to the responder ME on the failure monitoring center 3 side.
[0033] Next, the screen of the Web app transferred to the robot reporting destination in the present invention will be described with reference to FIG. 2. When the trouble responder MR of the robot 1 accesses the public Web display unit 34 using the Web app to be sent to the robot reporting destination 211, he / she can confirm the screen of the mobile information terminal 6 shown in FIG. 2.
[0034] The screen includes, for example, a video display unit 61 that displays the video detected by the in-car camera 52, a microphone mute button 62 that can select to transmit / not transmit (mute) the voice of the microphone connected to the portable information terminal 6 of the trouble responder MR to the speaker 513 of the intercom in the elevator car 5, a remote button 63 that can remotely control the robot 1 via the elevator-robot cooperation unit 2, a response completion button 64 for the trouble responder MR of the robot to notify the trouble monitoring center 3 that the response is completed, and a response interruption button 65 for the trouble responder MR of the robot to request the responder ME of the trouble monitoring center 3 to respond without taking any action, etc.
[0035] Next, according to FIG. 3, the processing flowchart of the elevator monitoring system according to Embodiment 1 of the present patent will be described.
[0036] In step S101 of FIG. 3, the elevator communication unit 31 of the trouble monitoring center 3 receives the abnormality notification signal transmitted from the abnormality notification unit 48 of the elevator control panel 4 via the communication unit 41. Here, the abnormality notification signal is an input signal 44 of the intercom button 511 or a signal transmitted when the abnormality detection unit 43 determines that the operation state of the operation control unit 42 is in a locked state. Further, the abnormality notification signal includes the current floor of the elevator and the opening / closing state of the door acquired from the operation control unit 42.
[0037] In step S102, the elevator communication unit 31 transmits the abnormality notification signal to the notification control unit 32. The notification control unit 32 checks the presence or absence of an elevator call from the current robot 1 and the floor on which the elevator call was created by the robot 1 with the operation control unit 23 of the elevator-robot cooperation unit 2. When the floor on which the elevator call was created by the robot 1 matches the current floor of the elevator included in the abnormality notification signal, the notification control unit 32 determines that the abnormality notification signal is an abnormality related to the boarding / alighting of the robot 1 and proceeds to step S103. If they do not match, it proceeds to step S110.
[0038] In step S103, the notification control unit 32 accesses the operation control unit 23 of the elevator-robot cooperation unit 2. The operation control unit 23 acquires the robot notification destination 221 stored in the storage unit 22 and transmits it to the notification control unit 32. Although multiple robot notification destinations can be stored, this embodiment will explain the flowchart when there is one robot notification destination.
[0039] Next, in step S104, the notification control unit 32 transmits the robot notification destination 221 received from the operation control unit 23, an identifier for specifying the abnormality notification signal (for example, the abnormality notification sequence number), and an identifier for specifying the elevator that transmitted the abnormality notification signal (for example, the elevator manufacturing number) to the relay app issuing unit 33 to request the issuance of a relay app. The relay app issuing unit 33 transmits a primary identifier that can access the public web display unit 34 to the robot notification destination 221 according to the request for issuing the relay app. The primary identifier includes a URL (Uniform Resource Locator) for accessing the public web display unit 34, an identifier for specifying the abnormality notification signal, and an identifier for specifying the elevator that transmitted the abnormality notification signal.
[0040] In addition, the relay app issuing unit 33 transmits to the public web display unit 34 the fact that it has transmitted the primary identifier that can access the relay app to the robot notification destination 221 and the transmission time. The public web display unit 34 permits access from the identifier for specifying the abnormality notification signal. As a result, the responder MR on the robot side can access the public web display unit 34 and utilize the information display and operation environment shown in FIG. 2.
[0041] Next, in step S105, the public web display unit 34 detects whether there is an access within a certain time from the transmission time of the primary identifier received from the relay app issuing unit 33. If there is an access within the certain time, it is determined that there is an access from the responder MR of the robot notification destination 221 and the response is in progress, and the process proceeds to step S106. If there is no access within the certain time, it is determined that the responder MR of the robot notification destination 221 is absent, and the process proceeds to step S110.
[0042] In step S106, when accessing from the operator MR of the robot reporting destination 221, an identifier for specifying the abnormality reporting signal and an identifier for specifying the elevator that transmitted the abnormality reporting signal are transmitted to the public web display unit 34. The public web display unit 34 uses the identifier for specifying the elevator that transmitted the abnormality reporting signal to request the call control unit 35 to connect the web app 6 to the terminal of the operator of the robot reporting destination and to various devices inside the elevator car. The call control unit 35 connects to the communication unit 41 of the elevator control panel 4 via the elevator communication unit 31 and makes a connection to various devices.
[0043] Specifically, it is possible to output the voice of the intercom microphone 512 to the speaker of the operator's terminal via the web app 6, display the video of the car camera 52 on the camera display unit 61 of the web app, and output the microphone voice of the operator's terminal to the intercom speaker 513.
[0044] Also, the operator can control whether to output or not (mute) the microphone voice of the operator's terminal to the intercom speaker 513 by clicking the microphone mute button 62 of the web app 6.
[0045] Also, when the remote button 63 of the web app 6 is pressed, the public web display unit 34 issues a request to remotely control the robot to the operation control unit 23 of the elevator-robot cooperation unit 2 via the reporting control unit 32. The operation control unit 23 releases the autonomous movement mode of the robot 1 via the robot communication unit 21 and performs remote control from the public web display unit. As an example of the remote control, as shown in the remote button 63, remote control of forward, backward, left turn, and right turn is possible.
[0046] Next, in step S107, while the public web display unit 34 is connected to various devices in the elevator car 5, the web app 6 constantly detects whether the response interruption button 65 has been pressed. If the response interruption button 65 is pressed, the responder at the robot reporting destination regards the abnormality notification signal as not related to the robot, hands over the response to the controller ME at the failure control center 3, and proceeds to step S110. If the response interruption button 65 is not pressed, the response continues and the process proceeds to step S108.
[0047] In step S108, while the public web display unit 34 is connected to various devices in the elevator car, the web app 6 constantly detects whether the response completion button 64 has been pressed. If the response completion button 63 is pressed, the responder at the robot reporting destination regards the current abnormality notification as response completed and proceeds to step S109. If the response completion button is not pressed, the response continues and the process proceeds to step S107.
[0048] In step S109, the public web display unit 34 requests the call control unit 35 to interrupt the connection between the terminal of the responder at the robot reporting destination and various devices in the elevator car, and rejects access from the identifier that identifies the abnormality notification signal.
[0049] As a result, the situation of various devices in the elevator car cannot be accessed from the terminal 6 of the responder MR at the robot reporting destination 221, and the privacy of elevator users can be protected.
[0050] Finally, in step S110, the public web display unit 34 requests the call control unit 35 to respond to the abnormality notification signal to the controller ME at the failure monitoring center 3. The call control unit 35 displays the abnormality notification signal on the monitoring center web display unit 36, enabling the controller ME to confirm the situation in the elevator car and perform rescue operations.
[0051] Also, at that time, since the response from the robot reporting destination is no longer required, the process proceeds to step S109 to reject access from the robot reporting destination.
[0052] From the above, when the elevator failure monitoring system detects an abnormal notification signal related to the robot, it can smoothly resolve passenger troubles caused by the robot by transmitting a primary identifier that can access the elevator car to the robot notification destination.
[0053] In addition, when setting up a web-based communication route using a relay app, it is advisable to consider the following points. First, transmit a primary identifier that can access the failure monitoring center to the robot notification destination, and the primary identifier should preferably include a URL (Uniform Resource Locator) for access, an identifier for specifying abnormal information, and an identifier for specifying the elevator that sent the abnormal information.
[0054] Also, detect whether there is access within a certain period from the transmission time of the primary identifier. If there is no access within the certain period, it is advisable to determine that the person in charge at the robot notification destination is absent and display the abnormal information at the failure monitoring center.
[0055] Moreover, when the response interruption button is pressed, it is advisable to display the abnormal information at the failure monitoring center.
[0056] Also, after displaying the abnormal information at the failure monitoring center, it is advisable for the relay app to reject access from the identifier for specifying the abnormal information.
[0057] Furthermore, it is advisable to set it so that the relay app rejects access from the identifier for specifying the abnormal information after displaying the abnormal information at the failure monitoring center.
[0058] In summary, the present invention is an elevator failure monitoring system 10 when robot 1 uses elevator car 5 in a building, which manages calls of elevator car 5 to control the operation of the elevator car, obtains audio and video information from audio and video acquisition means 51, 52 installed in elevator car 5, and includes an elevator control device 4 for detecting abnormalities in elevator car 5, an elevator-robot cooperation unit 2 for controlling robot 1 moving in the building and storing a notification destination 221 in case of an abnormality, and a failure monitoring center 3 that obtains information on detected abnormalities, audio, and video in elevator car 5 from elevator control device 4, obtains the notification destination 221 in case of an abnormality when robot 1 is involved in the abnormality, presents information on detected abnormalities, audio, and video in elevator car 5 to the responder MR on the robot side, and secures and provides a communication route enabling operation of robot 1 via elevator-robot cooperation unit 2, which is an "elevator failure monitoring system".
[0059] In the embodiments shown in FIGS. 1 to 3 above, although the use of the web has been described as a communication means for notifying the robot-side responder MR and providing a response method, this may be by other communication methods such as dedicated lines. Also, although an example using a mobile information terminal has been shown, it is not limited thereto.
Explanation of Reference Numerals
[0060] 1: Robot, 11: Communication unit, 12: Control unit, 2: Elevator - robot cooperation unit, 21: Robot communication unit, 22: Memory unit, 221: Robot notification destination, 23: Operation control unit, 24: Elevator communication unit, 3: Fault monitoring center, 31: Elevator communication unit, 32: Notification control unit, 33: Relay application issuing unit, 34: Public Web display unit, 35: Call control unit, 36: Monitoring center Web display unit, 4: Elevator control panel, 41: Communication unit, 42: Operation control unit, 43: Abnormality detection unit, 44: Signal input unit, 45: Voice input unit, 46: Video input unit, 47: Voice output unit, 48: Abnormality notification unit, 5: Elevator car, 51: Intercom, 511: Intercom button, 512: Intercom microphone, 513: Intercom speaker, 52: Camera
Claims
1. An elevator failure monitoring system when a robot uses an elevator car in a building, An elevator control device that manages calls for the elevator car to control the operation of the elevator car, obtains voice and video information from voice and video acquisition means installed in the elevator car, and detects abnormalities in the elevator car; An elevator-robot cooperation unit that controls the robot moving in the building and stores a reporting destination in case of an abnormality; A failure monitoring center that obtains information on the detection of an abnormality in the elevator car and the voice and video information from the elevator control device, obtains the reporting destination in case of an abnormality when the robot is involved in the abnormality, presents the information on the detection of the abnormality in the elevator car and the voice and video information to the responder on the robot side, and secures and provides a communication route that enables the operation of the robot via the elevator-robot cooperation unit. The elevator failure monitoring system is characterized by being composed of this.
2. The elevator failure monitoring system according to claim 1, The responder on the robot side has a portable information terminal, and the failure monitoring center issues a relay application to the responder to secure and provide a communication route via the web. The elevator failure monitoring system is characterized by this.
3. The elevator failure monitoring system according to claim 1, The failure monitoring center presents information on the detection of an abnormality in the elevator car and the voice and video information to the responder on the elevator side, and secures and provides a communication route that enables the operation of the robot via the elevator-robot cooperation unit. The elevator failure monitoring system is characterized by this.
4. The elevator failure monitoring system according to claim 3, An elevator failure monitoring system in which the responder on the robot side can transfer the authority to resolve abnormal situations to the responder on the elevator side.
5. The elevator failure monitoring system according to claim 2, On the display screen of the portable information terminal held by the responder on the robot side, when the communication route is opened, there are a video display unit of the elevator car camera, a microphone mute button that can select to send / not send (mute) the voice of the microphone connected to the portable information terminal of the responder on the robot side to the intercom speaker, a remote button that can remotely control the robot, a response completion button for the responder on the robot side to notify the failure monitoring center that the response is completed, and a response interruption button for the robot failure responder not to respond and request the responder of the failure monitoring center to respond. An elevator failure monitoring system characterized by comprising.
6. The elevator failure monitoring system according to claim 2, In establishing a web-based communication route using a relay application, a primary identifier that can access the failure monitoring center is transmitted to the robot reporting destination, and the primary identifier includes a URL (Uniform Resource Locator) for access, an identifier for specifying abnormal information, and an identifier for specifying the elevator that transmitted the abnormal information. An elevator failure monitoring system characterized by that.
7. The elevator failure monitoring system according to claim 6, It is detected whether there is access within a certain time from the transmission time of the primary identifier. If there is no access within a certain time, it is determined that the responder at the robot reporting destination is absent, and the abnormal information is displayed on the failure monitoring center. An elevator failure monitoring system characterized by that.
8. The elevator failure monitoring system according to claim 5, When the response interruption button is pressed, an elevator failure monitoring system characterized by displaying abnormal information on the failure monitoring center.
9. An elevator failure monitoring system according to claim 8, after displaying the abnormal information on a failure monitoring center, the relay app rejects access from an identifier that identifies the abnormal information, characterized by the elevator failure monitoring system.
10. An elevator failure monitoring system according to claim 8, after displaying the abnormal information on a failure monitoring center, the relay app rejects access from an identifier that identifies the abnormal information, an elevator failure monitoring system.
11. An elevator failure monitoring method when a robot uses an elevator car in a building, managing calls of the elevator car to control the operation of the elevator car, obtaining voice and video information from voice and video acquisition means installed in the elevator car, detecting an abnormality in the elevator car, controlling the robot moving in the building and storing a notification destination in case of an abnormality, obtaining detection information of an abnormality in the elevator car and the voice and video information, when the robot is involved in the abnormality, obtaining the notification destination in case of the abnormality, presenting the detection information of the abnormality in the elevator car and the voice and video information to a responder on the robot side, and securing and providing a communication route enabling operation of the robot, characterized by the elevator failure monitoring method.
Citation Information
Patent Citations
Robot control method, robot and control system
CN112720507A
JP179921A
Elevator control device and elevator system
JP2021195257A
Control system for autonomous mobile robot, control method for the same, control program for the same, and autonomous mobile robot control unit
JP2022038295A
Apparatus, system, and method for mobile robot relocalization
US20200278687A1