Elevator inspection support method and inspection support device

Abstract

This invention provides an elevator inspection support method and inspection support device that improves worker safety and work efficiency by displaying items that are normally invisible as augmented reality (AR) images. [Solution] An elevator inspection support method using AR technology, wherein 3D model information of each elevator component and elevator information including at least unit number information and floor information are registered, and during elevator inspection, the location information of the elevator car on the floor where the worker is working is acquired, and based on the elevator information, the location information of the elevator car and the 3D model information of each elevator component, a 3D AR image of the elevator car on the floor where the worker is boarding is displayed on the display unit of a terminal device held by the worker.

Description

Technical Field

[0001] Embodiments of the present invention relate to a method and an apparatus for assisting elevator inspection work.

Background Art

[0002] In elevator inspection work, workers often board on top of the car. When performing the work, first, the car is moved to a predetermined floor in inspection operation using an elevator control panel. After that, the landing door is opened, and the worker boards on top of the car to perform the work.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the position of the car cannot be confirmed until the landing door is opened, and problems such as the car being absent or stopping at a high position when the landing door is opened, making it impossible to board, may occur. Also, when opening the landing door, it is necessary to unlock the landing door using a dedicated tool, but since the unlocking position cannot be visually recognized, it takes time to unlock, and there is a problem that work efficiency decreases.

[0005]

[0006] In view of the above circumstances, the present invention aims to provide an elevator inspection support method and inspection support device that improve the safety and work efficiency of workers by displaying items that are normally invisible as AR images. [Means for solving the problem]

[0007] In the future, elevator inspection methods are envisioned to involve workers using wearable devices (devices that can be worn like glasses) to perform inspections by following instructions displayed on the device's voice or screen, including work content, procedures, and automatic identification of abnormal areas of the inspection target. This proposal suggests an efficient and safe inspection method for elevators by displaying items that are normally invisible as AR images on the screen.

[0008] An embodiment for achieving the above objective is an elevator inspection support method using AR technology, in which 3D model information of each elevator component and elevator information including at least unit number information and floor information are registered, and during elevator inspection, the position information of the elevator car on the floor where the worker is working is acquired, and based on the elevator information, the position information of the elevator car and the 3D model information of each elevator component, a 3D AR image of the elevator car on the floor where the worker is boarding is displayed on the display unit of a terminal device held by the worker. [Brief explanation of the drawing]

[0009] [Figure 1] A schematic diagram illustrating the operational state of the elevator system according to this embodiment. [Figure 2] A block diagram showing the control system of the elevator system according to the first embodiment. [Figure 3] An explanatory diagram showing an example of a wearable device worn by workers. [Figure 4] A flowchart showing the processing procedure of the first embodiment. [Figure 5] A schematic diagram showing the elevator system according to the embodiment in its pre-operation state. [Figure 6] An explanatory diagram showing an AR image of the elevator car position in the first embodiment. [Figure 7] An explanatory diagram showing an AR image of the locking mechanism position in the embodiment. [Figure 8] A block diagram showing the control system of the elevator system according to the second embodiment. [Figure 9] An explanatory diagram showing an AR image of the elevator car position in the second embodiment. [Figure 10A] A flowchart showing the processing procedure of the second embodiment. [Figure 10B] A flowchart showing the processing procedure of the second embodiment. [Modes for carrying out the invention]

[0010] <First Embodiment> Configuration of the First Embodiment Figure 1 schematically shows the configuration of an elevator system. In elevator 1 in Figure 1, a rope 5 is stretched across a hoisting machine 4 located in the machine room 3 above the hoistway 2. An elevator car 6 is suspended from one end of the rope 5, and a counterweight 7 is suspended from the other end of the rope 5, both in a well-belt configuration. In addition to the hoisting machine 4, an elevator control panel 8 is located in the machine room 3, which is connected to the elevator car 6 via a tail cord (not shown).

[0011] On the other hand, each floor has landing doors 10a, 10b, ..., 10n for each landing 9a, 9b, ..., 9n. During inspection work, worker 11 operates the elevator control panel 8 to move the elevator car 6 to a desired position during inspection operation, and enters the hoistway 2 by unlocking the landing doors 10a, 10b, ..., 10n from the landings 9a, 9b, ..., 9n, and performs inspection work on the elevator car 6.

[0012] Figure 2 is a block diagram showing the system configuration of the first embodiment. Figure 3 is an explanatory diagram showing an example of a wearable device worn by a worker. Figure 4 is a flowchart showing the control flow of the elevator system according to the first embodiment.

[0013] As shown in FIG. 2, the elevator control panel 8 includes a control panel side communication unit 81 and an elevator information storage unit 82. The elevator information storage unit 82 stores the unit number information 821 and the 3D model information 822 of the component supplies of each elevator model.

[0014] The terminal device 20 includes a terminal device side communication unit 21, an AR control unit 22, a wearable device 23, a position information unit 24, and an abnormality determination unit 25.

[0015] The AR control unit 22 includes an image processing unit 221, a positioning unit 222, and an output unit 223.

[0016] The wearable device 23 includes a video display unit 231. This wearable device 23 is a glasses-shaped device worn by the worker 11, and a 3D model image can be displayed on the video display unit 231. The AR marker information reading unit 232 in the figure will be described in the second embodiment.

[0017] 《Processing Procedure of the First Embodiment》 In the flowchart of FIG. 4, during the inspection work, the elevator control panel 8 is operated to move the car 6 to an arbitrary position during the inspection operation (S1).

[0018] Elevator information for each unit is recorded in the elevator information storage unit 82 of the elevator control panel 8, and the unit number information 821 and a plurality of 3D model information 822 used in the embodiment are registered. The unit number information 821 includes the floor height position information of the car 6 when the elevator control panel 8 is operated during the inspection work to move the car 6 to an arbitrary position during the inspection operation. The terminal device side communication unit 21 and the control panel side communication unit 81 communicate, and the elevator information recorded in the elevator information storage unit 82 is input to the AR control unit 22 of the terminal device 20.

[0019] The position determination unit 222 of the AR control unit 22 determines the position to display the 3D image based on the input unit information 821 and the position information of the terminal device 20's position information unit 24 (S2). The image processing unit 221 processes the 3D model information 822 to display as a 3D image. The output unit 223 outputs the 3D model information 822 to be displayed to the video display unit 231 when the worker 11 operates the terminal device 20. As a result, a 3D image of the desired product is displayed on the screen of the terminal device 20 (S3).

[0020] Furthermore, when a 3D image is output to the video display unit 231 of the terminal device 20, if the equipment displaying the 3D image is the elevator car 6, the abnormality determination unit 25, based on the input elevator information 15, determines that there is a difference in level (for example, 100-200 mm) between the floor height position information of the elevator car 6 and the position information unit 24 of the terminal device 20 and the position of the landings 9a, 9b, ..., 9n where the worker 11 is located. If this difference exceeds a certain threshold, the terminal device 20 has a function to warn the video display unit 231 and prompt the user to correct the floor height position of the elevator car 6 (S4-S6).

[0021] Figure 5 shows the elevator control panel 8, with the elevator car 6 moved to the boarding position, before the worker 11 boards the elevator car 6. The terminal device 20 is a device such as a smartphone or wearable device 23 that the worker 11 always carries, and is used to display inspection procedures and submit inspection completion reports.

[0022] Figure 6 shows, with dashed lines, the 3D image display of the elevator car 6 shown on the video display unit 231 of the terminal device 20, as viewed from the position of worker 11 shown in Figure 5 in the direction of arrow X. As can be seen from Figure 6, worker 11 can visually confirm the position of the elevator car 6 by checking the 3D image displayed on a smartphone or wearable device 23.

[0023] Figure 7 shows, with dashed lines, the three-dimensional image display of the lock section video 31 of the landing doors 10a, 10b, ..., 10n, as displayed on the video display unit 231 of the terminal device 20, when viewed from the position of worker 11 shown in Figure 5 in the direction of arrow X.

[0024] During elevator inspection work, the locking mechanism 26 of the landing doors 10a, 10b, ..., 10n can be unlocked by inserting the unlock key 32 between the landing doors 10a, 10b, ..., 10n and the three-sided frame 30 from the landings 9a, 9b, ..., 9n, and lifting the locking mechanism (shown in the locking mechanism image 31). However, the locking mechanism is not visible from the landings 9a, 9b, ..., 9n, and it is necessary to locate it with the unlock key 32 while unlocking. As can be seen from Figure 7, in this embodiment, the locking mechanism image 31 showing the locking mechanism that locks the landing doors 10a, 10b, ..., 10n can be visible from the landings 9a, 9b, ..., 9n, making it easy to determine the location of the locking mechanism.

[0025] Thus, according to the first embodiment, it is possible to identify the work object based on location information and display the work procedure. Therefore, by displaying items that are normally not visible using AR images, the safety and work efficiency of elevator inspection work can be improved.

[0026] 《Configuration of the Second Embodiment》 Figure 8 is a block diagram showing the system configuration of the second embodiment.

[0027] Augmented Reality (AR) technology, which overlays various content onto the real world visible through a display device to add information, requires accurate recognition of the display position and size in order to display AR content seamlessly in the real world. AR markers are a necessary tool for this purpose.

[0028] The configuration of the second embodiment is as follows: As shown in Figure 3, the wearable device 23 worn by the worker 11 is equipped with an image display unit 231 and an AR marker information reading unit 232 that reads information from AR markers.

[0029] As shown in Figure 9, the AR marker 40 is installed near the landing button. The AR marker 50 is installed above the landing door 108. The AR marker 40 records floor information 41 and elevator number information 42, which are used to display an AR image containing elevator number and floor information. Similarly, the AR marker 50 also records floor information and elevator number information. The AR control unit 22 of the terminal device 20 processes the AR information from the read elevator information and the recognized AR marker position to determine the content and display position of the AR image.

[0030] Processing procedure of the second embodiment During inspection, information is read from the elevator to a terminal device, and the elevator information is then read by a wearable device 23.

[0031] When the wearable device 23 recognizes the AR marker 40 installed at each floor landing, it analyzes the current floor from the AR marker 40 at the landing and displays the car position within the elevator shaft 2 as an AR image from the floor from which the AR marker 40 was read via the wearable device 23, based on the car position information (pulse value) indicating the current car position. If the car position in the AR image is not the normal boarding position, a warning is displayed on the video display unit 231. After confirming that the car position is normal in the AR image, for example, by reading the AR marker 50 installed above the landing door, the AR image displays the positions at which the landing doors 10a, 10b, ..., 10n can be unlocked, and the landing doors 10a, 10b, ..., 10n can be easily unlocked with the unlock key 32.

[0032] To elaborate on the specific process, as shown in Figure 10, during inspection operation, first, the elevator car is moved to the boarding position on the floor where the worker will board (S11). At this time, the terminal device 20 reads the car position information from the elevator control panel 8 (S12). Based on the read car position information, the AR marker information reading unit 232 recognizes the AR marker 40 (S13, S14).

[0033] When the AR marker 40 is recognized, the floor on which the AR marker 40 is installed is analyzed (S15). If it is the 1st floor, the AR image of the elevator car's position from the 1st floor landing is displayed on the video display unit 231 (S16, S17). If it is the 2nd floor, the AR image of the elevator car's position from the 2nd floor landing is displayed on the video display unit 231 (S24, S25). If it is the Nth floor, the AR image of the elevator car's position from the Nth floor landing is displayed on the video display unit 231 (S26, S27).

[0034] Next, the displayed AR image of the elevator car's location is determined to be either a valid boarding location or not (S18). If it is valid, the process ends.

[0035] If the car position is not normal, a warning is displayed to correct the car position (S19). After correcting the position, the terminal device 20 reads the car position information from the elevator control panel 8 (S20, S21). Based on the read car position information, the display position of the AR image of the elevator car 6 is updated (S22, S23).

[0036] Meanwhile, the AR marker information reading unit 232 recognizes the AR marker 50 installed on the landing door 108 and analyzes the floor level on which the AR marker 50 is installed. Then, as shown by the dashed line in Figure 7, the video display unit 231 displays a three-dimensional image of the lock part video 31 of the displayed landing doors 10a, 10b, ..., 10n.

[0037] As described above, according to the second embodiment, components that are not normally visible can be displayed as AR images on the video display unit 231. For example, the elevator car 6 inside the elevator shaft 2 can be visualized from the landings 9a, 9b, ..., 9n, and the location of the elevator car 6 can be seen before opening the landing doors 10a, 10b, ..., 10n, so a warning can be displayed on the video display unit 231 if the boarding position is incorrect. In addition, the location of the unlock key 32 for the landing doors 10a, 10b, ..., 10n can be displayed as an AR image, making it easy to unlock and improving work efficiency.

[0038] Furthermore, if the elevator information includes pre-existing component data and building information for each property, it will be possible to display AR images of the elevator car shape, unlock mechanism shape, replacement parts, and fault locations in conjunction with remote inspections.

[0039] Although several embodiments of the present invention have been described above, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents. [Explanation of Symbols]

[0040] 1...Elevator, 2...Hoistway, 3...Machine room, 4...Hoisting machine, 5...Rope, 6...Elevator car, 7...Counterweight, 8...Elevator control panel, 81...Control panel side communication unit, 82...Elevator information storage unit, 821...Unit information, 822...3D model information, 9a,9b,9n...Landing, 10a,10b,10n,108...Landing door, 11...Worker, 20...Terminal device, 21...Terminal device side communication unit, 22...AR control unit, 23...Wearable device, 24...Location information unit, 222...Location determination unit, 221...Image processing unit, 223...Output unit, 231...Video display unit, 232...AR marker information reading unit, 25...Anomaly detection unit, 30...Three-sided frame, 31...Lock unit video, 32...Unlock key, 40,50...AR marker, 61...Elevator car position video

Claims

1. A method for supporting elevator inspection work using AR technology, The 3D model information of each elevator's components, along with elevator information including at least the unit number and floor information, are registered. During elevator inspections, the terminal device carried by the worker acquires the location information of the elevator car on the floor where the worker is working. An elevator inspection work support method, which displays a 3D AR image of the elevator car on the floor where the worker boards the elevator car on the display unit of a terminal device held by the worker, based on the aforementioned elevator information, the location information of the elevator car, and 3D model information of the components of each elevator.

2. The elevator inspection work support method according to claim 1, wherein the display unit of the terminal device displays a 3D AR image of the lock portion of the landing door on the floor where the worker boards the elevator car.

3. The elevator inspection work support method according to claim 1 or 2, wherein the elevator information is recorded in the elevator control panel, and the terminal device acquires the elevator information by communicating with the elevator control panel.

4. An AR marker is installed at a designated location on the floor where elevator inspection work is to be performed, An elevator information storage unit stores floor information and 3D model information of components for each elevator model as elevator information, A wearable device worn by a worker, which reads the elevator information by reading the AR marker at the start of work, An inspection work support device comprising: a display unit provided on the wearable device, which displays a 3D AR image of the elevator car on the floor where the worker boards the elevator car at the start of work, based on the elevator information and location information.

Images