Assistance system for arrangement work on devices of elevator
Patent Information
- Application Number
- JP2024531789
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-10-02
- Publication Date
- 2024-12-23
- Estimated Expiration
- 2042-07-05
AI Technical Summary
Existing methods for arranging elevator equipment, such as those using reference wires, are limited to equipment installed in a pit and cannot be applied to equipment not installed in a pit, restricting their applicability in elevator equipment arrangement work.
A support system that includes a photographing device and a guidance system to guide the placement of elevator equipment by imaging the target arrangement and providing a guide image superimposed on the photographed image, allowing for precise alignment and placement of various elevator equipment regardless of location, using a camera to capture images and a server or portable terminal to display and notify the worker of the correct placement.
Enables accurate and efficient placement of elevator equipment by providing real-time guidance and notification, improving workability and reducing reliance on manual input, and can be applied to various types of elevator equipment and locations, including those not directly attached to a building.
Smart Images

Figure 2024009389000001 
Figure 2024009389000002 
Figure 2024009389000003
Abstract
Description
Elevator equipment placement support system
[0001] The present disclosure relates to a support system for elevator equipment placement work.
[0002] Patent Document 1 discloses an example of a method for positioning an elevator buffer base. In this method, a visible light laser device is positioned using a reference wire hung vertically in the elevator shaft as a reference. The buffer base is positioned in the pit by aligning the laser beam emitted from the visible light laser device with an index on the buffer base.
[0003] Japanese Patent Application Publication No. 2010-70268
[0004] In elevators, various devices including buffer stands are arranged. However, the method of Patent Document 1 is based on a reference wire member that is hung vertically in the elevator shaft, and therefore cannot be applied to the arrangement of devices that are not installed in the pit.
[0005] The present disclosure relates to solving such problems, and provides a support system that can be applied to the arrangement of various elevator equipment.
[0006] The assistance system according to the present disclosure includes, in an arrangement task of arranging each of one or more pieces of equipment of an elevator to a corresponding target location, an imaging device that photographs an area including the position of the target location corresponding to each of the one or more pieces of equipment, and a guidance system that guides the arrangement of each of the one or more pieces of equipment to the corresponding target location based on the image captured by the imaging device.
[0007] The assistance system according to the present disclosure can be applied to the arrangement of various elevator equipment.
[0008] 1 is a perspective view of an example of elevator equipment to which the assistance system according to embodiment 1 is applied. FIG. 2 is a top view of a hoist according to embodiment 1. FIG. 3 is a configuration diagram of the assistance system according to embodiment 1. FIG. 4 is a diagram showing an example of display by a display unit according to embodiment 1. FIG. 5 is a diagram showing an example of display by a display unit according to embodiment 1. FIG. 6 is a flowchart showing an example of operation of the assistance system according to embodiment 1. FIG. 7 is a top view of another example of elevator equipment to which the assistance system according to embodiment 1 is applied. FIG. 8 is a diagram showing another example of display by a display unit according to embodiment 1. FIG. 9 is a diagram showing an example of extraction of characteristic parts by a target placement acquisition unit according to embodiment 1. FIG. 10 is a diagram showing an example of extraction of characteristic parts by a target placement acquisition unit according to embodiment 1. FIG. 11 is a diagram showing an example of extraction of characteristic parts by a target placement acquisition unit according to embodiment 1. FIG. 12 is a diagram showing an example of extraction of characteristic parts by a target placement acquisition unit according to embodiment 1. FIG. 13 is a diagram showing an example of extraction of characteristic parts by a target placement acquisition unit according to embodiment 1. FIG. 1 is a configuration diagram of a support system according to a modified example of embodiment 1. FIG. 2 is a diagram showing an example of acquisition of a target placement by a target placement acquisition unit according to a modified example of embodiment 1. FIG. 3 is a hardware configuration diagram of a main part of the support system according to embodiment 1. FIG. 4 is a configuration diagram of a support system according to embodiment 2. FIG. 5 is a diagram showing an example of a trained model in a learning unit according to embodiment 2. FIG. 6 is a diagram showing an example of a trained model in a learning unit according to embodiment 2. FIG. 7 is a flowchart showing an example of an operation of the support system according to embodiment 2. FIG. 8 is a flowchart showing an example of an operation of the support system according to embodiment 2. FIG. 9 is a diagram showing an example of a display by a display unit according to a modified example of embodiment 2.
[0009] The present disclosure will be described with reference to the accompanying drawings, in which the same or corresponding parts are denoted by the same reference numerals, and redundant descriptions will be appropriately simplified or omitted.
[0010] First Embodiment Fig. 1 is a perspective view of an example of elevator equipment to which a support system 1 according to a first embodiment is applied.
[0011] The assistance system 1 is applied to elevator equipment installation work. Elevator equipment includes, for example, devices operating in an elevator, components constituting the elevator, and their components. The installation work is the work of installing elevator equipment in a target installation corresponding to the equipment. In the installation work, one or more pieces of equipment are installed in their corresponding target installations. The target installation of each piece of equipment is, for example, the installation of the equipment during normal elevator operation. Here, the installation of the equipment includes the position and orientation of the equipment. In the installation work, the installation order for at least some of the equipment to be installed may be preset. The installation work includes, for example, the installation of a new elevator, the renovation of an elevator, or the replacement or maintenance and inspection of elevator equipment. The maintenance and inspection work of elevator equipment may include a process of removing elevator equipment and returning the equipment to its original position after adjustment or cleaning.
[0012] An elevator is applied, for example, to a building having multiple floors. An elevator shaft (not shown) is provided in the building. The shaft is a long vertical space spanning multiple floors in the building. An elevator landing (not shown) is provided on each floor. A landing door is provided at each landing on each floor. The landing door is a door that separates the landing from the elevator shaft.
[0013] The elevator includes a car (not shown), a hoisting rope 2, and a traction machine 3. The car is a device that travels vertically in a hoistway to transport passengers and the like between multiple floors. The hoisting rope 2 is a rope that suspends the car in the hoistway. An elevator may be provided with multiple hoisting ropes 2. The traction machine 3 is an example of elevator equipment. FIG. 1 shows a perspective view of the traction machine 3. The traction machine 3 is provided, for example, in a machine room. The machine room is provided, for example, above the elevator hoistway. A traction machine base 4 is provided in the machine room. The traction machine base 4 is a base that serves as the base for the traction machine 3. The traction machine 3 includes a motor 5 and a sheave 6. The motor 5 and the sheave 6 are each an example of elevator equipment. During installation work, the traction machine 3 may be divided into the motor 5 and the sheave 6 and then installed. The motor 5 is a device that rotates and drives the sheave 6. The sheave 6 has a sheave groove 7. The sheave groove 7 is a groove in the sheave 6 around which the hoisting rope 2 is wound. The hoisting rope 2 is lowered from the sheave 6 to the hoistway through a rope duct provided in, for example, a machine room. In the elevator, the hoisting rope 2 is wound up by the sheave 6 driven to rotate by the motor 5, causing the car to travel vertically in the hoistway.
[0014] FIG. 2 is a top view of the hoisting machine 3 according to the first embodiment.
[0015] In this example, the support system 1 supports the installation work of installing elevator equipment including the hoisting machine 3. The support system 1 includes a photographing device 8.
[0016] The photographing device 8 is a device that photographs images, such as a camera. The images photographed by the photographing device 8 may be either still images or moving images. The photographing device 8 photographs an area including the target placement position of the hoist 3. The photographing device 8 is disposed vertically above the sheave 6 of the hoist 3. The photographing device 8 is disposed directly above the sheave 6. In this example, the photographing device 8 is disposed on a vertical line passing through the rotation axis of the sheave 6. The photographing device 8 may also be disposed diagonally above the area including the target placement position of equipment such as the hoist 3.
[0017] FIG. 3 is a configuration diagram of the support system 1 according to the first embodiment.
[0018] The camera device 8 is fixed to the ceiling of the machine room above the sheave 6. The camera device 8 is fixed so as not to move from the start to the end of the placement work. The camera device 8 is fixed by, for example, an anchor bolt, a magnet, a suction cup, or adhesive tape. The camera device 8 may be attached to a stand installed in, for example, a machine room. The camera device 8 may be fixed to, for example, the wall of the machine room. The camera device 8 may be fixed by, for example, a magnetic chuck. The camera device 8 may remain fixed even after the placement work is completed. Alternatively, the camera device 8 may be removed after the placement work is completed.
[0019] The assistance system 1 includes a guidance system 9. The guidance system 9 is a system including a server device installed in, for example, a building where the elevator is installed or in another building. Alternatively, the guidance system 9 may be a system including a portable information terminal such as a smartphone carried by a worker performing the installation work. Alternatively, the guidance system 9 may be a system including a device built into the imaging device 8. The guidance system 9 may be a system including a single device. Alternatively, the guidance system 9 may be a system including multiple devices. In this case, the multiple devices of the guidance system 9 may be connected to each other via a communication network such as the Internet. Some or all of the functions of the guidance system 9 may be installed on, for example, a virtual machine on a cloud service. Some or all of the functions of the guidance system 9 may be installed on, for example, an edge server in the building where the elevator is installed that connects to an external service via a communication network such as the Internet. The guidance system 9 includes a memory unit 10, an input unit 11, a target placement acquisition unit 12, a display unit 13, and a notification unit 14.
[0020] The memory unit 10 is a part that stores information. The memory unit 10 stores information such as the order in which one or more pieces of equipment in an elevator will be placed during placement work. The input unit 11 is a part that accepts input from, for example, a worker performing placement work. The input unit 11 is, for example, a touch panel, a mouse, or a keyboard. The target placement acquisition unit 12 is a part that acquires a target placement corresponding to each piece of equipment to be placed during placement work. The display unit 13 is a part that displays a guide image indicating a target placement corresponding to each piece of equipment, superimposed on an image captured by the imaging device 8. The display unit 13 is, for example, a display. The notification unit 14 is a part that notifies the worker of the relationship between the placement of each piece of equipment and the target placement. The notification unit 14 is, for example, a speaker that notifies by voice.
[0021] Next, the functions of the assistance system 1 will be described with reference to Figures 4 and 5. Figures 4 and 5 are diagrams showing examples of displays by the display unit 13 according to embodiment 1. In this example, the placement work includes a process of replacing the existing hoist 3 with a new hoist 3.
[0022] 4 shows an image of the existing hoist 3 in place. The display unit 13 displays the image of the existing hoist 3 captured by the image capture device 8.
[0023] The target position acquisition unit 12 acquires a target position of the hoist 3, which is an elevator device. The target position acquisition unit 12 acquires a target position corresponding to the hoist 3, for example, based on input from an operator. In this example, the target position corresponding to the hoist 3 is the position of the sheave groove 7 during normal elevator operation. The target position information includes information on characteristic parts. The characteristic parts are one or more points or lines that indicate the characteristics of the position or posture of the device arranged at the target position. In this example, the characteristic part is a point that indicates the position of the sheave groove 7. The characteristic part is, for example, a point that indicates the position of the end of the sheave groove 7. The target position acquired by the target position acquisition unit 12 is stored, for example, in the memory unit 10. The characteristic parts are used, for example, as a guide reference during arrangement work. The characteristic parts of the device are extracted from images captured by the imaging device 8, for example, by an image processing technique.
[0024] In the process of replacing the hoisting machine 3 , the worker removes the hoisting rope 2 from the sheave 6 of the existing hoisting machine 3 .
[0025] Thereafter, the worker inputs the target layout by tracing the sheave groove 7 of the existing hoist 3 before removal on the image captured by the photographing device 8 through the input unit 11. The target layout acquisition unit 12 acquires the target layout input through the input unit 11.
[0026] Thereafter, the worker removes the existing hoisting machine 3. Next, the worker temporarily places the new hoisting machine 3 in the machine room.
[0027] 5 shows an image of the new hoist 3 in a temporarily placed state. The display unit 13 displays the image of the new hoist 3 photographed by the photographing device 8.
[0028] The display unit 13 displays a guide image superimposed on the image captured by the imaging device 8. The guide image is an image showing the target placement acquired by the target placement acquisition unit 12. FIG. 5 shows an example of a guide image corresponding to the hoist 3. The guide image is, for example, an image showing the position or posture of a characteristic part of the equipment placed in the target placement. In this example, the guide image shows an image showing the position and posture of the sheave 6 of the hoist 3 placed in the target placement. The guide image also shows a point showing the position of the end of the sheave 6 of the hoist 3 placed in the target placement. The guide image may be vector image data such as points or lines showing the position and posture of the equipment to be placed. The points or lines showing the position and posture of the equipment are, for example, corners or edges of the outline of the equipment. Alternatively, the guide image may be raster image data such as a video of the equipment placed in the target placement.
[0029] The worker adjusts the position of the newly placed hoist 3 based on the image displayed on the display unit 13. In this example, the worker moves the hoist 3 to the right side of the drawing.
[0030] In this example, the guidance system 9 acquires the position of the new hoist 3, for example, by image recognition of the image captured by the photographing device 8. In this case, the display unit 13 may display an image such as an arrow indicating the direction in which to move the new hoist 3 as part of the guidance image.
[0031] Furthermore, for example, in the notification unit 14, a first range and a second range are set in advance for the relationship of placement, such as the distance between the newly installed hoist 3 and the target placement corresponding to the hoist 3. The first range is a range that indicates that the newly installed hoist 3 has approached the target placement when, for example, the position and attitude of the newly installed hoist 3 are in the first range. The second range is a range that indicates that the newly installed hoist 3 has been placed at the target placement within the allowable error range when, for example, the position and attitude of the newly installed hoist 3 are in the second range. The second range is included in the first range. The notification unit 14 determines whether the position and attitude of the newly installed hoist 3, acquired by, for example, image recognition, fall within the first range and the second range. When the position and attitude of the new hoist 3 fall within the first range, the notification unit 14 issues a first sound to notify the worker that the new installed hoist 3 has approached the target placement. The first sound is a predetermined sound such as an alarm sound or a voice announcement. When the position and attitude of the new hoist 3 enter the second range, the notification unit 14 emits a second sound to notify the worker that the new hoist 3 has been placed in the target location. The second sound is a sound different from the predetermined first sound such as an alarm sound or a voice announcement. The worker is guided by the display on the display unit 13 and the notification by the notification unit 14 to place the new hoist 3 in the target location.
[0032] Thereafter, the worker winds the hoisting rope 2 around the sheave 6 of the newly installed hoisting machine 3. If there is any equipment to be subsequently placed, the worker performs the work of placing that equipment. At this time, the support system 1 provides guidance for the placement of that equipment in the same manner as it provided guidance for the placement of the hoisting machine 3. On the other hand, if there is no equipment to be subsequently placed, the worker ends the placement work.
[0033] Next, an example of the operation of the assistance system 1 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an example of the operation of the assistance system 1 according to the first embodiment. Fig. 6 shows an example of the operation of the assistance system 1 that provides guidance on the location of any device in an elevator.
[0034] In step S11, the target placement acquisition unit 12 acquires the target placement of the equipment to be placed. After that, the operation of the support system 1 proceeds to step S12.
[0035] In step S12, the display unit 13 displays a guide image indicating the target placement of the target device superimposed on the image of the target device photographed by the photographing device 8. Thereafter, the operation of the support system 1 proceeds to step S13.
[0036] In step S13, the notification unit 14 determines whether the position and posture of the target device are within the first range. If the determination result is Yes, the operation of the support system 1 proceeds to step S14. On the other hand, if the determination result is No, the operation of the support system 1 proceeds to step S12.
[0037] In step S14, the notification unit 14 emits the first sound. After that, the operation of the support system 1 proceeds to step S15.
[0038] In step S15, the notification unit 14 determines whether the position and posture of the target device are within the second range. If the determination result is Yes, the operation of the support system 1 proceeds to step S16. On the other hand, if the determination result is No, the operation of the support system 1 proceeds to step S12.
[0039] In step S16, the notification unit 14 emits the second sound. Then, the operation of the support system 1 for guiding the placement of the target device ends. At this time, if there is another device to be subsequently placed in the placement work, the support system 1 starts guiding the placement of the other device.
[0040] Here, the imaging device 8 may include multiple cameras. Each camera is disposed at a position suitable for guiding the placement of any one of the devices. A position suitable for guiding the placement of a device is, for example, a position where the device is photographed from a direction suitable for guiding the placement of the device. A direction suitable for guiding the placement of a device is, for example, a direction with the largest tolerance for device placement, or a direction perpendicular to the direction with the smallest tolerance for device placement. Alternatively, each camera may be disposed so as to enable a stereoscopic view of the placement of each device. If the devices to be placed include a hoist 3, one of the cameras is disposed, for example, vertically above the sheave 6 of the hoist 3. This camera is disposed directly above the sheave 6. Furthermore, another camera is disposed vertically below the sheave 6 of the hoist 3. This camera is disposed directly below the sheave 6. The imaging device 8 may include a camera disposed either vertically above or vertically below the sheave 6 of the hoist 3.
[0041] The equipment to be placed during the placement work may be equipment other than the hoist 3. The equipment to be placed during the placement work may be, for example, a car door device. The car door device is a device that is provided on the car and opens and closes to allow elevator passengers to get on and off the car. In this case, the photographing device 8 may include a camera that is provided on the rear wall of the car's cab. Here, the cab is the part of the car where passengers board. The rear wall of the cab is, for example, the inner wall of the cab that faces the space where passengers board. The rear wall of the cab faces the car door device that is provided on the front of the car.
[0042] Fig. 7 is a top view of another example of elevator equipment to which the assistance system 1 according to embodiment 1 is applied. Fig. 7 shows a top view of a hall threshold 15, which is another example of elevator equipment.
[0043] The landing threshold 15 is a threshold that guides the opening and closing of the landing door. The characteristic portion of the target arrangement corresponding to the landing threshold 15 is, for example, a point that indicates the positions of both ends of the landing threshold 15 during normal elevator operation. In this case, the imaging device 8 includes, for example, a camera that captures an image of the landing threshold 15 from vertically above.
[0044] Fig. 8 is a top view of another example of elevator equipment to which the assistance system 1 according to embodiment 1 is applied. Fig. 8 shows a top view of a landing device 16, which is another example of elevator equipment.
[0045] The landing device 16 is a device that detects the landing of the car at each floor. The landing device 16 is provided, for example, on the car. The landing device 16 detects, for example, a landing board provided on each floor using a detection unit 17. The detection unit 17 has a groove through which the landing board passes when the car travels. The characteristic portion of the target arrangement corresponding to the landing device 16 is, for example, a point indicating the position of the end of the groove. In this case, the imaging device 8 includes, for example, a camera that captures an image of the landing device 16 from vertically above or vertically below. The camera is provided, for example, on the car. Alternatively, the camera may be provided, for example, in the elevator shaft, vertically above or vertically below the landing board of any floor.
[0046] Fig. 9 is a diagram showing another example of display by the display unit 13 according to embodiment 1. On the left side of Fig. 9, an image showing a state in which an existing hoist 3 is arranged is shown. On the right side of Fig. 9, an image showing a state in which a new hoist 3 is arranged is shown.
[0047] In this example, the size of the existing hoist 3 is different from the size of the new hoist 3. On the other hand, the size of the sheave 6 of the existing hoist 3 is the same as the size of the sheave 6 of the new hoist 3. In this case, the assistance system 1 can guide the placement of the new hoist 3 using a target placement based on an input with the sheave groove 7 of the existing hoist 3 as the reference.
[0048] As described above, the assistance system 1 according to the first embodiment includes a camera device 8 and a guidance system 9. During placement work, the camera device 8 captures an image of an area including a target placement position corresponding to each of one or more pieces of equipment in an elevator. The placement work is work of placing each piece of equipment in the corresponding target placement. The guidance system 9 provides guidance for placing each piece of equipment in the corresponding target placement based on the image captured by the camera device 8.
[0049] The assistance system 1 provides guidance for the installation work based on the images captured by the camera device 8. Therefore, the assistance system 1 can be applied to the installation work of various elevator devices, regardless of the type of device to be installed and the location where it is installed. Furthermore, since the installation work does not require marking, the assistance system 1 can also be applied to the installation work of devices that cannot be directly attached to the building, such as the sheave 6.
[0050] Furthermore, the guidance system 9 acquires a target placement corresponding to at least one of the one or more pieces of equipment based on an input from a worker performing placement work.
[0051] The target layout is input by the worker who will be performing the layout work, so that the target layout can be set according to the situation, such as the location where the equipment is to be placed and the equipment to be placed.
[0052] The guidance system 9 also includes a display unit 13. The display unit 13 displays a guidance image indicating a target location corresponding to at least one of the one or more devices by superimposing the image captured by the imaging device 8 on the image.
[0053] This allows the worker to perform the placement work while simultaneously checking the device to be placed and the guide image, so the support system 1 can more effectively provide guidance for the placement work.
[0054] Furthermore, the guide image showing the target arrangement corresponding to at least one of the one or more devices is an image of one or more characteristic parts of the device arranged in the target arrangement.
[0055] The support system 1 guides the placement work based on the characteristic features of the equipment. This clarifies the alignment criteria. Therefore, the support system 1 can more effectively guide the placement work. Furthermore, even when the placement work includes a process of replacing existing equipment with new equipment that is different in overall size or shape, the support system 1 can more effectively guide the placement work based on the common characteristic features of the existing equipment and the new equipment.
[0056] The guidance system 9 also includes a notification unit 14. In the notification unit 14, a first range is set in advance for a target location corresponding to at least one of the one or more devices. The notification unit 14 notifies the user that the device has entered the first range by a first sound.
[0057] This allows the worker to confirm the arrangement of the equipment without relying on a display on the display unit 13. Here, the first range may be, for example, a range that indicates that the equipment has approached the target arrangement when the position and orientation of the equipment to be arranged are within the first range. Alternatively, the first range may be, for example, a range that indicates that the equipment has been arranged in the target arrangement within the allowable error range when the position and orientation of the equipment to be arranged are within the first range.
[0058] Furthermore, for at least one of the one or more devices for which a first range is set, a second range is set in advance with respect to the target arrangement corresponding to the device in the notification unit 14. The second range is included in the first range. The notification unit 14 notifies the user that the device has entered the second range by a second sound.
[0059] As a result, by receiving notifications using different sounds, such as the first sound and the second sound, the worker can confirm the relationship between the equipment to be placed and the target placement corresponding to the equipment. Here, the second range is, for example, a range indicating that the equipment has been placed in the target placement within the allowable error range when the position and orientation of the equipment to be placed are within the second range. Alternatively, the second range may be a range that includes the third range. The third range is, for example, a range indicating that the equipment has been placed in the target placement within the allowable error range when the position and orientation of the equipment to be placed are within the third range.
[0060] The photographing device 8 is installed so as not to move from the start to the end of the placement work.
[0061] This allows the position of the image capturing device 8 to be used as a reference, allowing the support system 1 to provide more accurate guidance for the placement work.
[0062] Furthermore, when the one or more pieces of equipment in the arrangement work include a hoist 3, the camera device 8 is disposed vertically above or below the sheave 6 of the hoist 3. Furthermore, when the one or more pieces of equipment in the arrangement work include a car door device, the camera device 8 is disposed on the rear wall of the car room of the car in which the car door device is provided.
[0063] In this way, the imaging device 8 is placed in a position suitable for guiding the placement of the equipment, so the support system 1 can provide more accurate guidance for the placement work.
[0064] The target location acquisition unit 12 may acquire a target location for each piece of equipment based on design information such as design drawings. For example, when the installation work involves the installation of a new elevator, guidance for locating each piece of equipment in accordance with the design information becomes possible. The target location acquisition unit 12 may also acquire a target location for an equipment to be placed during the installation work based on the relative location of the equipment to its surrounding equipment. For example, when the equipment to be placed during the installation work is a hoisting machine 3, the target location for the hoisting machine 3 may be acquired based on the horizontal distance between the sheave groove 7 of the sheave 6 of the hoisting machine 3 and the edge of the rope duct in the machine room. This allows the assistance system 1 to guide the sheave 6 to a location where the hoisting rope 2 hanging from the sheave groove 7 into the hoistway is less likely to interfere with the edge of the rope duct. In this case, when the installation work involves a replacement work, the diameter of the sheave 6 or the number of sheave grooves 7 may change before and after the replacement.
[0065] Furthermore, during installation work such as elevator equipment replacement work or maintenance and inspection work, at least one piece of equipment may be installed at a position where an elevator equipment that was already installed before the installation work has been removed. In this case, the target installation acquisition unit 12 may acquire a target installation corresponding to the equipment based on the installation position of the previously installed equipment before the removal. For example, if the installation work includes a process of replacing an existing hoist 3 with a new hoist 3, the target installation acquisition unit 12 detects the installation position of the sheave groove 7 of the existing hoist 3 before removal by, for example, image recognition of an image of the existing hoist 3 captured by the photographing unit. Based on the acquired position of the sheave groove 7, the target installation acquisition unit 12 acquires a target installation position of the new hoist 3, for example, as an installation position where the position of the sheave groove 7 remains unchanged before and after replacement. In this case, the worker does not need to input the target installation position via the input unit 11. This improves the workability of the installation work. In addition, for example, in maintenance and inspection work on elevator equipment, the equipment that was already placed before the placement work and the equipment that will be placed in the position and posture of that equipment during the placement work may be the same equipment.
[0066] The memory unit 10 also stores a preset order for the placement of one or more devices in the placement work. At this time, the target placement acquisition unit 12 may acquire a target placement corresponding to at least one of the one or more devices based on the relative placement of a device that is placed before the device in the order stored in the memory unit 10. At this time, the target placement acquisition unit 12 determines whether the devices are placed according to the order stored in the memory unit 10. If the order of placement of the devices follows the order stored in the memory unit 10, the target placement acquisition unit 12 acquires a target placement based on the relative placement of the devices. For example, if the motor 5 and sheave 6 of the hoist 3 are placed separately in this order in the placement work, the target placement acquisition unit 12 acquires the target placement of the sheave 6 based on the position or attitude at which the motor 5 is placed. The memory unit 10 may store information on the relative placement of the motor 5 and sheave 6 of the hoist 3. At this time, the target placement acquisition unit 12 may acquire the target placement of the sheave 6 from the position or attitude of the placed motor 5 by, for example, referring to the relative placement of the sheave 6 from the storage unit 10. At this time, the occurrence of interference with already placed equipment is suppressed.
[0067] Next, a specific example of extraction of a characteristic part of a device will be described with reference to Fig. 10 to Fig. 12. Fig. 10 to Fig. 12 are diagrams showing examples of extraction of a characteristic part by the target placement acquisition unit 12 according to the first embodiment.
[0068] In this example, the target location acquisition unit 12 extracts the characteristic portions by an image processing technique such as template matching. The target location acquisition unit 12 extracts, as the characteristic portions of the device, corners of the outline of the device, which are examples of points that indicate the position and orientation of the device.
[0069] 10 shows a photographed image of a device photographed by the photographing device 8 and a model image of the device. The model image of the device is, for example, a similar image of the device photographed in the past, or a similar image generated based on design information of the device. The similar image based on design information is, for example, a CAD image (CAD: Computer Aided Design). Note that in the model image of the device, the characteristic parts of the device are known.
[0070] The target arrangement acquisition unit 12 detects the position of the device on the captured image by scanning the model image on the captured image captured by the imaging device 8. The target arrangement acquisition unit 12 may scan the model image while performing image transformation such as affine transformation including enlargement, reduction, and rotation of the model image, or homography transformation. While scanning the model image, the target arrangement acquisition unit 12 calculates the similarity or dissimilarity between the model image and the area on the captured image where the model image overlaps.
[0071] 11, the target placement acquisition unit 12 detects the position where the similarity is greatest or the position where the dissimilarity is least as the position of the device on the captured image. Note that when transformations such as rotation, enlargement, and reduction of the model image are performed during scanning, the target placement acquisition unit 12 may also detect transformation parameters such as the rotation angle and enlargement or reduction magnification of the model image.
[0072] 12, the target layout acquisition unit 12 determines the layout of the characteristic parts of the model image located at the positions detected by scanning as the layout of the characteristic parts of the equipment on the captured image. Because the characteristic parts in the model image are known, the target layout acquisition unit 12 can extract the layout of the characteristic parts of the equipment on the captured image using the positions of the model image detected by scanning and the transformation parameters.
[0073] Next, another specific example of extraction of a characteristic part of a device will be described with reference to Fig. 13 and Fig. 14. Fig. 13 and Fig. 14 are diagrams showing another example of extraction of a characteristic part by the target placement acquisition unit 12 according to embodiment 1.
[0074] 13, the image of the device on the captured image and the model image may not exactly match. In such cases, the target location acquisition unit 12 detects the approximate position of the device on the captured image by scanning the model image.
[0075] 14, the target layout acquisition unit 12 sets a processing area for performing detailed detection of the feature portion in an area including the layout of the feature portion of the model image located at the position detected by scanning, etc. In this example, the target layout acquisition unit 12 sets two processing areas: an upper processing area and a lower processing area.
[0076] The target layout acquisition unit 12 performs corner detection processing in each of the set processing areas. In the corner detection processing, known algorithms such as Harris corner detection or Shi-Tomasi corner detection can be applied. The target layout acquisition unit 12 extracts the corners detected in this way as feature portions.
[0077] Next, another specific example of extraction of a characteristic part of a device will be described with reference to Fig. 15. Fig. 15 is a diagram showing another example of extraction of a characteristic part by the target placement acquisition unit 12 according to the first embodiment.
[0078] The target location acquisition unit 12 calculates image features for each of the model image and the captured image. The image features calculated here are, for example, SIFT (Scale-Invariant Feature Transform), SURF (Speed Up Robust Feature), or HOG (Histogram of Oriented Gradient). The image features calculated here are rotation-invariant and scale-invariant features. FIG. 15 shows keypoints detected by features such as SIFT.
[0079] The target location acquisition unit 12 matches the key points detected in the model image with the key points detected in the captured image. This allows the target location acquisition unit 12 to detect the position of the device in the captured image. Even if the device is rotated or enlarged or reduced in the captured image, matching is possible by using rotation-invariant and scale-invariant feature amounts.
[0080] For example, the target layout acquisition unit 12 may set the layout of the characteristic parts of the model image thus matched as the layout of the characteristic parts of the device on the captured image. Alternatively, the target layout acquisition unit 12 may set a processing area for detailed detection of the characteristic parts in an area including the layout of the characteristic parts of the model image thus matched. In this case, the target layout acquisition unit 12 performs corner detection processing in each of the set processing areas, and extracts the detected corners as characteristic parts.
[0081] As shown in FIG. 16 , the target placement acquisition unit 12 may extract, as a feature of the equipment, an edge of the outline of the equipment, which is an example of a line indicating the position and orientation of the equipment. FIG. 16 is a diagram showing another example of extraction of feature parts by the target placement acquisition unit 12 according to the first embodiment. The target placement acquisition unit 12 extracts edges as feature parts using a procedure similar to that used to extract corners as feature parts. Here, in the edge detection process, a known algorithm such as Canny edge detection can be applied. In the edge detection process, processes such as noise removal and line segmentation may be performed. Because intuitively easy-to-understand edges are displayed as a guide image, the worker can more easily perform the equipment placement work.
[0082] 17, the target placement acquisition unit 12 may acquire multiple target placement candidates for a device based on an image of the device captured by the imaging device 8. FIG. 17 is a diagram showing an example of acquisition of a target placement by the target placement acquisition unit 12 according to the first embodiment. The target placement candidates for a device are, for example, candidates for characteristic parts of the device. In this example, the candidate characteristic parts are, for example, multiple corners extracted by an image processing technique.
[0083] At this time, the guidance system 9 presents a plurality of candidates for the target layout to the worker, for example, via the display unit 13. The worker selects one or more candidates from the presented plurality of candidates for the target layout, for example, via the input unit 11. The target layout acquisition unit 12 acquires the candidates selected by the worker as the target layout of the equipment. In this example, candidates not selected by the worker are excluded from the target layout of the equipment. This makes it easier for the worker to input the target layout.
[0084] Furthermore, the guide image indicating a target arrangement corresponding to at least one of one or more devices may be an image of the device arranged in the target arrangement. For example, when the arrangement work includes a process of replacing an existing hoist 3 with a new hoist 3, the display unit 13 may display an image of the existing hoist 3 before it is removed as a guide image superimposed on the image of the new hoist 3 arranged in the arrangement work. In this case, the image of the existing hoist 3 as a guide image is displayed superimposed, for example, as a semi-transparent image so that it can be compared with the position of the image of the new hoist 3. Alternatively, the image of the existing hoist 3 as a guide image may be displayed superimposed, for example, as an image of only the outline.
[0085] FIG. 18 is a configuration diagram of a support system 1 according to a modification of the first embodiment.
[0086] The guidance system 9 includes a communication unit 18. The communication unit 18 is a unit that outputs information to a device external to the guidance system 9 via a wired or wireless connection. The communication unit 18 may output information to the external device via a communication network such as the Internet. The communication unit 18 outputs, for example, information on a target placement or information on a guidance image. The communication unit 18 outputs information to, for example, a display device 19 external to the guidance system 9. The display device 19 may be, for example, a portable information terminal such as a smartphone carried by a worker. The worker may also wear the display device 19 during placement work. The display device 19 is, for example, a device such as an HMD (Head Mounted Display) that displays an input image superimposed on an image in the worker's field of view. The display device 19 displays an image using, for example, AR (Augmented Reality) technology or VR (Virtual Reality) technology. This allows the worker to check the positional relationship between the equipment and the target position while performing the placement work, thereby improving the efficiency of the placement work. Note that the information on the target position or the guide image may be information acquired as three-dimensional information based on images taken by multiple cameras of the imaging device 8.
[0087] FIG. 19 is a diagram showing an example of acquisition of a target layout by the target layout acquisition unit 12 according to another modification of the first embodiment.
[0088] 19 , the target placement acquisition unit 12 acquires the target placement based on images captured by the camera device 8 before the already-installed equipment is removed and images captured by the camera device 8 after the equipment is removed. For example, when the installation work includes a process of replacing the existing hoist 3 with a new hoist 3, the target placement acquisition unit 12 acquires images of the existing hoist 3 before it is removed. The target placement acquisition unit 12 also acquires images after the existing hoist 3 has been removed. The target placement acquisition unit 12 extracts the position or orientation of the existing hoist 3 in the images captured by the camera device 8 by taking the difference between the acquired images. The target placement acquisition unit 12 acquires a target placement corresponding to the position or orientation of the new hoist 3 based on the extracted position of the existing hoist 3.
[0089] Next, an example of the hardware configuration of the support system 1 will be described with reference to Fig. 20. Fig. 20 is a hardware configuration diagram of the main part of the support system 1 according to the first embodiment.
[0090] Each function of the assistance system 1 may be realized by a processing circuit. The processing circuit includes at least one processor 100 a and at least one memory 100 b. The processing circuit may include at least one dedicated hardware 200 in addition to or in place of the processor 100 a and the memory 100 b.
[0091] When the processing circuit includes a processor 100a and a memory 100b, each function of the assistance system 1 is realized by software, firmware, or a combination of software and firmware. At least one of the software and firmware is written as a program. The program is stored in the memory 100b. The processor 100a realizes each function of the assistance system 1 by reading and executing the program stored in the memory 100b.
[0092] The processor 100a is also called a CPU (Central Processing Unit), processing unit, arithmetic unit, microprocessor, microcomputer, or DSP. The memory 100b is composed of non-volatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, or EEPROM.
[0093] Where the processing circuitry comprises dedicated hardware 200, the processing circuitry may be implemented, for example, as a single circuit, multiple circuits, a programmed processor, parallel programmed processors, an ASIC, an FPGA, or a combination thereof.
[0094] Each function of the assistance system 1 can be realized by a processing circuit. Alternatively, each function of the assistance system 1 can be realized collectively by a processing circuit. Some of the functions of the assistance system 1 may be realized by dedicated hardware 200, and the other parts may be realized by software or firmware. In this way, the processing circuit realizes each function of the assistance system 1 by dedicated hardware 200, software, firmware, or a combination of these.
[0095] Embodiment 2. The assistance system 1 according to embodiment 1 acquires a target layout corresponding to the hoist 3 based on input from a worker. The assistance system 1 according to embodiment 2 learns, by machine learning, the relationship between the image captured by the camera device 8 and the target layout previously input by the worker on this image via the input unit 11. Furthermore, the assistance system 1 infers the target layout in the image captured by the camera device 8 using a trained model generated by training.
[0096] 21 is a configuration diagram of a guidance system 9 according to embodiment 2. The guidance system 9 according to embodiment 2 further includes a learning unit 20 and an inference unit 21.
[0097] The learning unit 20 acquires, as learning data, a set of images captured by the camera device 8 and a target layout previously input by a worker for the image via the input unit 11. Here, the learning data is data that associates the images captured by the camera device 8 with the target layout input by the worker for the image. The learning unit 20 learns the target layout for the images captured by the camera device 8 based on the acquired learning data. That is, the learning unit 20 generates a trained model for inferring the optimal target layout from the images captured by the camera device 8. Note that the images captured by the camera device 8 may be, for example, images captured vertically from above of an area where equipment is to be placed, as in the first embodiment. Here, the combination of data included in the learning data corresponds to the process of the placement work. For example, in the process of placing new equipment, the images captured by the camera device 8 are images that do not include the equipment. Therefore, the combination of the images captured by the camera device 8 and the target layout input by the worker for the images is acquired as learning data. Furthermore, in the process of replacing existing equipment with new equipment, the image captured by the imaging device 8 includes the existing equipment. Therefore, a combination of the image captured by the imaging device 8 and the target layout input by the worker for that image is acquired as learning data.
[0098] Next, an example of a trained model trained by the learning unit 20 will be described with reference to FIGS. 22 and 23 . FIGS. 22 and 23 are diagrams showing an example of a trained model in the learning unit 20 according to the second embodiment. The learning unit 20 can perform training using a known learning algorithm, such as supervised learning or reinforcement learning. As an example, a learning algorithm based on supervised learning using a neural network will be described. In this example, the learning unit 20 learns a target position for image data of the existing hoist 3 by supervised learning according to a neural network model. Here, supervised learning refers to a technique in which pairs of input and output data are provided to a learning device such as the learning unit 20, and the learning device learns features of the training data to generate a trained model. The trained model generated here is used by an inference device such as the inference unit 21 to infer an output from an input.
[0099] A neural network consists of an input layer consisting of multiple neurons, a hidden layer consisting of multiple neurons, and an output layer consisting of multiple neurons. Each neuron applies an activation function to the input value and outputs it. The activation function is a nonlinear function such as a sigmoid function or a ramp function.
[0100] For example, in a three-layer neural network as shown in FIG. 22, when multiple inputs are input to the input layer (X1, X2, X3, ...), the output values are multiplied by weights W0 (w01, w02, w03, ...) and input to the intermediate layer (Y1, Y2, ...). The output values from the intermediate layer are further multiplied by weights W1 (w11, w12, w13, ...) and input to the output layer (Z1, Z2, Z3, ...). Each neuron in the output layer outputs output data based on the input values. In this way, the output through the neural network varies depending on the values of each component of the weight vectors W0 and W1. In this example, the trained model is represented by weight vectors W0 and W1.
[0101] Alternatively, as shown in FIG. 23 , a learning algorithm using a neural network with two or more hidden layers may be applied. In such a neural network, when multiple inputs are input to the input layer (X1, X2, X3, ...), the output values are multiplied by weights W0 (w01, w02, w03, ...) and input to the first hidden layer (Y11, Y12, ...). The output values from the first hidden layer are further multiplied by weights W1 (w11, w12, w13, ...) and input to the second hidden layer. This process is repeated, and the output values from the nth hidden layer are further multiplied by weights Wn (wn1, wn2, wn3, ...), where n is a natural number greater than or equal to 2, and input to the output layer. Each neuron in the output layer outputs output data based on the input values. In this way, the output through the neural network varies depending on the values of each component of the weight vector W0, W1, ..., Wn. In this example, the trained model is represented by weight vectors W0, W1, ..., Wn. Note that the connections between adjacent layers do not have to be fully connected. For example, the neural network may include a convolutional layer or a pooling layer.
[0102] The data input to the input layer may be, for example, image features extracted from an image. The image features may include, for example, the position of an edge in the image. The data input to the input layer may include, for example, information such as a label that identifies the type of equipment to be placed in the target layout. The data output from the output layer may be, for example, the position and orientation of the equipment, which is the target layout. If the target layout can be labeled, the data output from the output layer may be a value such as the probability that each label will be assigned to the target layout.
[0103] In the second embodiment, the neural network of the learning unit 20 learns the target layout in the image data captured by the camera device 8 by so-called supervised learning in accordance with learning data created based on a combination of images captured by the camera device 8 and target layouts previously input by a worker on these images via the input unit 11. That is, the neural network learns by inputting images captured by the camera device 8 into the input layer and adjusting the weight vectors W0 and W1, etc., so that the results output from the output layer, i.e., the target layout, approach the target layout previously input by the worker via the input unit 11. The learning unit 20 can perform learning from the learning data using a known method, such as backpropagation.
[0104] The learning unit 20 generates a trained model by performing the above-described learning. The storage unit 10 stores the trained model generated by the learning unit 20.
[0105] Although the above description concerns a case where supervised learning is applied to the learning algorithm used by the learning unit 20, the present invention is not limited to this. The learning algorithm may be capable of learning the relationship between the images captured by the image capture device 8 and the target layout, and machine learning may be performed using other known methods such as genetic programming, functional logic programming, or support vector machines. Furthermore, the learning algorithm used by the learning unit 20 may be deep learning, which learns the extraction of image features. Furthermore, the learning unit 20 may learn the relationship between the images captured by the image capture device 8 and the target layout using an algorithm such as reinforcement learning. The reward in reinforcement learning may be, for example, an evaluation input by a worker after the work, or the time or man-hours required for the work.
[0106] Furthermore, the data input to the input layer may be image data itself. The image data input during learning by the learning unit 20 may include, in addition to images captured by the camera device 8, CG images (CG: Computer Graphics) generated using 3D CAD. The image data input during learning may be CG images converted to resemble actual images captured by the camera device 8. In this case, the image data input during learning is generated using technology such as GAN (Generative Adversarial Network). In this GAN, for example, a network that generates similar images for learning is used as the generation network. Furthermore, a network that identifies actual images captured by the camera device 8 and similar images generated by the generation network is used as the identification network. Increasing the number of images for learning in this way can improve the accuracy of learning in the learning unit 20. Note that the target placement data for the image data generated in this way may be manually set by an operator or automatically set based on component information in the 3D CAD data that is the basis of the CG images, etc.
[0107] The inference unit 21 infers the target arrangement in the image captured by the imaging device 8, which is obtained using the trained model. That is, by inputting the image captured by the imaging device 8 into this trained model, it is possible to output the target arrangement inferred from the image.
[0108] Next, an example of the learning process in the learning unit 20 will be described with reference to Fig. 24. Fig. 24 is a flowchart showing an example of the operation of the assistance system 1 according to embodiment 2. Fig. 24 shows an example of the learning process in the learning unit 20.
[0109] Here, the assistance system 1 according to the second embodiment uses, as learning data, an image of the existing hoist 3 obtained by the operation of the assistance system 1 shown in Fig. 6 and a target layout input by an operator. The following learning process may be performed after the process shown in Fig. 6 has been performed multiple times. Furthermore, the following learning process may be performed each time the process shown in Fig. 6 has been performed, and this may be repeated.
[0110] In step S21, the learning unit 20 acquires learning data that is created based on a combination of an image captured by the imaging device 8 and a target placement that was previously input by an operator for this image via the input unit 11. In the second embodiment, the learning unit 20 simultaneously acquires an image of the existing hoist 3 and the target placement, but it is sufficient for the learning unit 20 to input these in an associated manner, and the learning unit 20 may acquire the image of the existing hoist 3 and the data on the target placement at different times.
[0111] Then, in step S22, the learning unit 20 learns the target placement of the equipment in the image data captured by the camera device 8 through supervised learning in accordance with learning data created based on a combination of the image captured by the camera device 8 and the target placement previously input by the worker for this image via the input unit 11, and generates a learned model.
[0112] Then, in step S23, the storage unit 10 stores the trained model generated by the training unit 20.
[0113] Next, an example of inference processing in the target placement inference unit 21 for an image captured by the imaging device 8 will be described with reference to Fig. 25. Fig. 25 is a flowchart showing an example of the operation of the support system 1 according to embodiment 2. Fig. 25 shows an example of the inference processing in the inference unit 21. In embodiment 2, the operation related to the inference processing is performed in step S11 of Fig. 6, and the subsequent operations are similar to the operations shown in Fig. 6.
[0114] In step S31 , the inference unit 21 acquires an image captured by the image capturing device 8 .
[0115] Then, in step S32, the inference unit 21 inputs the image captured by the imaging device 8 into the trained model stored in the storage unit 10. The inference unit 21 obtains a target position for the image data captured by the imaging device 8 from the output of the trained model.
[0116] Then, in step S33, the inference unit 21 outputs a target layout for the image data captured by the camera device 8, obtained from the trained model. The target layout is the target layout of one of the elevator devices to be placed in the area of the image during the placement work. The target layout acquisition unit 12 acquires the target layout output by the inference unit 21 as the target layout of the device. Then, the operation of the assistance system 1 proceeds to step S12 in FIG. 6 , where the output target layout is displayed superimposed on the image captured by the camera device 8.
[0117] As described above, the assistance system 1 according to the second embodiment includes a learning unit 20. The learning unit 20 generates a trained model through machine learning using training data. The training data includes images captured by the camera device 8 and a target layout of elevator equipment to be placed in the area of the image. The trained model is used to infer the target layout from the images captured by the camera device 8. The assistance system 1 also includes an inference unit 21. The inference unit 21 infers the target layout of the equipment from the images captured by the camera device using the trained model. The guidance system 9 acquires the target layout corresponding to the equipment based on the inference by the inference unit 21. This configuration eliminates the need for the worker to input the target layout via the input unit 11, thereby reducing the burden on the worker of inputting the target layout and enabling even non-experts to identify the target layout.
[0118] In the second embodiment, the inference unit 21 has been described as outputting a target arrangement for image data captured by the photographing device 8 using a trained model generated by the learning unit 20 of the support system 1. However, the inference unit 21 may also acquire a trained model generated by an external system (not shown) of the support system 1, and output a target arrangement for image data captured by the photographing device 8 based on the trained model acquired from the external system.
[0119] Alternatively, one or both of the learning unit 20 and the inference unit 21 may be mounted on a device located outside the building in which the elevator is installed and connected via a communication network such as the Internet. For example, the learning unit 20 may be mounted on a learning device that serves as an independent device. Alternatively, the inference unit 21 may be mounted on an inference device that serves as an independent device. Alternatively, one or both of the learning unit 20 and the inference unit 21 may be mounted on a virtual machine on a cloud service.
[0120] The learning unit 20 may also perform learning using learning data created for multiple elevators. In this case, the multiple elevators may be installed in different buildings. The multiple elevators may also be elevators operating in the same area. Alternatively, the multiple elevators may also be elevators operating in multiple areas. Elevators from which the learning unit 20 acquires learning data may be added and removed during operation of the assistance system 1. The learning unit 20 of one assistance system 1 may also acquire a trained model generated by the learning unit 20 of another assistance system 1. In this case, the learning unit 20 of the assistance system 1 that has acquired the trained model may perform re-learning so as to update the acquired trained model using the training data acquired in the assistance system 1.
[0121] Next, a modified example of the second embodiment will be described with reference to Fig. 26. Fig. 26 is a diagram showing an example of a display by the display unit 13 according to the modified example of the second embodiment. In this modified example, the trained model is a model that can infer, from an image captured by the image capturing device 8, the target arrangement of a device to be placed in the area of the image, as well as characteristic parts of the device. The characteristic parts of the device inferred in the trained model are one or more characteristic parts.
[0122] The following describes an example of an arrangement work for arranging a hoist 3. In this example, an existing hoist is replaced with a new hoist 3. In the arrangement work, after the existing hoist is removed, the new hoist 3 is temporarily placed near the target location. At this time, the photographing device 8 photographs an area including both the temporarily placed new hoist 3 and the position of its target location.
[0123] The learning unit 20 acquires, as learning data, a set of the image captured by the imaging device 8, the target arrangement of the newly installed hoist 3 previously input by an operator via the input unit 11 for the image, and characteristic parts of the newly installed hoist 3 temporarily placed in the image. The characteristic parts of the newly installed hoist 3 are input by an operator via, for example, the input unit 11. The characteristic parts of the newly installed hoist 3 may be input, for example, together with the input of the target arrangement. Note that the trained model in the learning unit 20 may be a composite model that independently includes a model for acquiring the target arrangement and a model for acquiring the characteristic parts. In this case, the learning unit 20 may independently acquire learning data for the model for acquiring the target arrangement and learning data for the model for acquiring the characteristic parts.
[0124] The inference unit 21 uses the trained model by the learning unit 20 to infer a target location of the new hoist 3 from the image captured by the photographing device 8 and characteristic parts of the temporarily placed new hoist 3 in the image. The guidance system 9 provides guidance to the target location of the new hoist 3 based on the target location and characteristic parts of the new hoist 3 thus inferred. For example, as shown in FIG. 26 , the display unit 13 displays a guide image superimposed on the image captured by the photographing device 8. In this example, the guide image displays an image showing the position and attitude of the sheave 6 of the new hoist 3 placed at the target location. The image displays the positions of the characteristic parts when the new hoist 3 is placed at the target location. The guide image also displays the positions of the characteristic parts of the new hoist 3 that will be placed from the temporarily placed position to the target location. With this configuration, the characteristic parts of the current equipment and the characteristic parts of the equipment placed at the target location are displayed simultaneously, allowing the assistance system 1 to more effectively provide guidance for the placement work. This improves the workability of the placement work.
[0125] The assistance system according to the present disclosure can be applied to the installation work of elevator equipment.
[0126] DESCRIPTION OF SYMBOLS 1 Support system, 2 Hoisting rope, 3 Hoist, 4 Hoist base, 5 Motor, 6 Sheave, 7 Sheave groove, 8 Photography device, 9 Guidance system, 10 Memory unit, 11 Input unit, 12 Target position acquisition unit, 13 Display unit, 14 Notification unit, 15 Landing threshold, 16 Landing device, 17 Detection unit, 18 Communication unit, 19 Display device, 20 Learning unit, 21 Inference unit, 100a Processor, 100b Memory, 200 Dedicated hardware
Claims
1. In an arrangement operation in which one or more pieces of equipment of an elevator are arranged in a corresponding target arrangement, an imaging device is configured to image an area including a position of a target arrangement corresponding to each of the one or more pieces of equipment; a guidance system that guides the placement of each of the one or more devices to a corresponding target placement based on an image captured by the imaging device; An elevator equipment arrangement support system comprising:
2. The guidance system stores a preset order of arrangement of the one or more devices in the arrangement work, determines whether at least one of the one or more devices is arranged according to the stored order, and, if the order of arrangement is in accordance with the stored order, obtains a target arrangement corresponding to the device based on a relative arrangement of a device that is arranged before the device in the stored order.
2. The elevator equipment arrangement work support system according to claim 1.
3. When at least one of the one or more devices is to be placed at a position after removing an elevator device that was already placed before the placement work, the guidance system obtains a target placement corresponding to the device based on the placement before the already placed device was removed.
3. The elevator equipment arrangement work support system according to claim 1 or 2.
4. The guidance system acquires a target arrangement based on a difference between an image captured by the photographing device before the equipment that has already been placed is removed and an image captured by the photographing device after the equipment is removed.
3. The elevator equipment arrangement work support system according to claim 1 or 2.
5. In the guidance system, a target arrangement corresponding to at least one of the one or more devices is acquired based on an input from a worker performing the arrangement work.
3. The elevator equipment arrangement work support system according to claim 1 or 2.
6. In the guidance system, a target arrangement corresponding to at least one of the one or more devices is acquired based on a candidate selected by a worker performing the arrangement work from among a plurality of candidates presented by the guidance system to the worker.
6. The elevator equipment arrangement work support system according to claim 5.
7. The guidance system comprises: a display unit that displays, for at least one of the one or more devices, a guide image indicating a target arrangement corresponding to the device on the image captured by the imaging device; Equipped 3. The elevator equipment arrangement work support system according to claim 1 or 2.
8. The guidance system comprises: a communication unit that outputs, for at least one of the one or more pieces of equipment, a guide image showing a target arrangement corresponding to the piece of equipment to a display device that displays the input image superimposed on an image in the field of view of a worker performing the arrangement work; Equipped 3. The elevator equipment arrangement work support system according to claim 1 or 2.
9. The guide image showing a target arrangement corresponding to at least one of the one or more devices is an image of the device arranged in the target arrangement. The elevator equipment arrangement work support system according to claim 7.
10. The guide image showing a target arrangement corresponding to at least one of the one or more devices is an image of one or more characteristic parts of the device arranged in the target arrangement. The elevator equipment arrangement work support system according to claim 7.
11. The guidance system comprises: a notification unit that notifies, with a first sound, that at least one of the one or more devices has entered a first range that is preset with respect to a target arrangement corresponding to the device; Equipped 3. The elevator equipment arrangement work support system according to claim 1 or 2.
12. The notification unit notifies, with a second sound, that at least one of the devices for which the first range is set among the one or more devices has entered a second range that is set in advance for a target arrangement included in the first range and corresponding to the device. The elevator equipment arrangement work support system according to claim 11.
13. The photographing device is provided so as not to move from the start to the end of the placement work.
3. The elevator equipment arrangement work support system according to claim 1 or 2.
14. When the one or more devices in the arrangement work include a hoist, the camera is disposed vertically above or below a sheave of the hoist, The guide system guides the sheave to a target position based on a sheave groove of the sheave.
3. The elevator equipment arrangement work support system according to claim 1 or 2.
15. When the one or more devices in the placement work include a landing device having a detection unit that detects the landing of the car on each floor, the photographing device is disposed vertically above or below the landing device in the car, The guidance system guides the placement of the landing device to a target placement based on a groove of the detection unit through which a landing plate provided on each floor passes when the car travels on the landing device.
3. The elevator equipment arrangement work support system according to claim 1 or 2.
16. A learning unit that uses learning data including an image captured by the image capture device and a target arrangement of devices among the one or more devices to be arranged in an area of the image to generate a trained model by machine learning that infers a target arrangement from the image captured by the image capture device. The elevator equipment arrangement work support system according to claim 1 or 2, comprising:
17. an inference unit that infers a target arrangement of the device from the image captured by the image capture device, using a trained model for inferring a target arrangement from the image captured by the image capture device, the trained model being generated by machine learning using learning data including an image captured by the image capture device and a target arrangement of the device among the one or more devices to be arranged in the area of the image; Equipped with The guidance system acquires a target arrangement corresponding to the device based on an inference by the inference unit.
3. The elevator equipment arrangement work support system according to claim 1 or 2.
18. The trained model used by the inference unit for inference is a trained model for inferring a target arrangement of one or more devices to be arranged in a region of the image from an image captured by the imaging device, and one or more characteristic parts of the device, The inference unit infers a target arrangement and one or more characteristic parts of the device from an image captured by the imaging device, The guidance system guides the device to the target configuration inferred by the inference unit based on the target configuration inferred by the inference unit and one or more features. The elevator equipment arrangement work support system according to claim 17.
