Elevator equipment placement support system

Abstract

Provided is an assistance system that can be applied to an arrangement work on various devices of an elevator. This assistance system (1) comprises an imaging apparatus (8) and a guide system (9). The imaging apparatus (8) captures a region including the position of a target arrangement corresponding to each of one or more devices of an elevator in an arrangement work. The arrangement work is a work of arranging each device in the corresponding target arrangement. The guide system (9) guides the arrangement of each device in the corresponding target arrangement on the basis of the image captured by the imaging apparatus (8).

Description

[Technical Field]

[0001] The present disclosure relates to a support system for elevator equipment placement work. [Background technology]

[0002] Patent Document 1 discloses an example of a method for positioning an elevator buffer base. In this method, a visible light laser device is positioned based on a reference wire material lowered vertically into the elevator shaft. The buffer base is positioned in the pit by aligning the laser beam emitted from the visible light laser device with an index on the buffer base. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2010-70268 Summary of the Invention [Problem to be solved by the invention]

[0004] In elevators, various devices including buffer stands are arranged. However, the method of Patent Document 1 is based on a reference wire member lowered vertically into the elevator shaft, and therefore cannot be applied to the arrangement of devices that are not installed in the pit.

[0005] The present disclosure relates to solving such problems, and provides a support system that can be applied to the arrangement of various elevator equipment. [Means for solving the problem]

[0006] The assistance system according to the present disclosure includes, in an arrangement task of arranging one or more pieces of equipment of an elevator in a corresponding target arrangement, an image capturing device that captures an image of an area including a position of a target arrangement corresponding to each of the one or more pieces of equipment, and a guidance system that provides guidance for arranging each of the one or more pieces of equipment in the corresponding target arrangement based on an image captured by the image capturing device. The guidance system stores a preset order for arranging one or more pieces of equipment in the arrangement work, determines whether at least one of the one or more pieces of equipment is arranged in accordance with the stored order, and, if the order of arrangement is in accordance with the stored order, obtains a target arrangement corresponding to the piece of equipment based on the relative arrangement of a piece of equipment that is arranged before the piece of equipment in the stored order. . The assistance system according to the present disclosure includes, in an arrangement work for arranging each of one or more pieces of equipment of an elevator in a corresponding target arrangement, a photographing device that photographs an area including the position of the target arrangement corresponding to each of the one or more pieces of equipment, and a guidance system that guides the arrangement of each of the one or more pieces of equipment to the corresponding target arrangement based on the image photographed by the photographing device, and when at least one of the one or more pieces of equipment of the elevator that was already positioned before the arrangement work is to be placed in a position after removing the equipment, the guidance system obtains the target arrangement corresponding to the equipment based on the arrangement before the already positioned equipment was removed. The assistance system according to the present disclosure is provided for an arrangement task of arranging one or more pieces of equipment of an elevator in a corresponding target arrangement, and includes a camera that photographs an area including the position of the target arrangement corresponding to each of the one or more pieces of equipment, and a guidance system that provides guidance for arranging each of the one or more pieces of equipment in the corresponding target arrangement based on the image photographed by the camera, and the guidance system obtains the target arrangement based on the difference between an image photographed by the camera before the equipment that has already been placed is removed and an image photographed by the camera after the equipment is removed. The assistance system according to the present disclosure is provided for an arrangement task of arranging one or more pieces of equipment in an elevator to a corresponding target location, and includes: a camera that photographs an area including the position of a target location corresponding to each of the one or more pieces of equipment; and a guidance system that provides guidance for arranging each of the one or more pieces of equipment to the corresponding target location based on the image photographed by the camera, and the guidance system includes an alarm unit that, for at least one of the one or more pieces of equipment, alerts by a first sound that the equipment has entered a first range that is preset for the target location corresponding to the equipment. The support system according to the present disclosure includes, in an arrangement work in which each of one or more pieces of equipment of an elevator is arranged in a corresponding target position, a camera that photographs an area including the position of a target position corresponding to each of one or more pieces of equipment, and a guidance system that guides the arrangement of each of the one or more pieces of equipment to the corresponding target position based on the image photographed by the camera, and when the one or more pieces of equipment in the arrangement work includes a hoist, the camera is positioned vertically above or below the sheave of the hoist, and the guidance system guides the arrangement of the sheave to the target position based on the sheave groove of the sheave. The assistance system according to the present disclosure comprises, in an arrangement operation in which each of one or more pieces of equipment of an elevator is arranged in a corresponding target location, a camera that photographs an area including the position of a target location corresponding to each of one or more pieces of equipment, and a guidance system that provides guidance in the arrangement of each of the one or more pieces of equipment to the corresponding target location based on the image photographed by the camera, and when the one or more pieces of equipment in the arrangement operation include a landing device having a detection unit that detects the car's landing on each floor, the camera device is positioned on the car vertically above or below the landing device, and the guidance system provides guidance in the arrangement of the landing device to the target location based on the grooves of the detection unit through which landing plates provided on each floor pass as the car travels on the landing device. [Effects of the Invention]

[0007] The assistance system according to the present disclosure can be applied to the arrangement of various elevator equipment. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a perspective view of an example of elevator equipment to which the assistance system according to the first embodiment is applied. [Figure 2] FIG. 1 is a top view of a hoisting machine according to a first embodiment. [Figure 3] 1 is a configuration diagram of a support system according to a first embodiment. [Figure 4] 4 is a diagram showing an example of a display by a display unit according to the first embodiment. FIG. [Figure 5] 4 is a diagram showing an example of a display by a display unit according to the first embodiment. FIG. [Figure 6] 4 is a flowchart showing an example of the operation of the support system according to the first embodiment. [Figure 7] 10 is a top view of another example of elevator equipment to which the assistance system according to the first embodiment is applied. FIG. [Figure 8] 10 is a top view of another example of elevator equipment to which the assistance system according to the first embodiment is applied. FIG. [Figure 9] 10 is a diagram showing another example of a display by the display unit according to the first embodiment. FIG. [Figure 10] 5 is a diagram showing an example of extraction of a feature portion by a target placement acquisition unit according to the first embodiment. FIG. [Figure 11] 5 is a diagram showing an example of extraction of a feature portion by a target placement acquisition unit according to the first embodiment. FIG. [Figure 12] 5 is a diagram showing an example of extraction of a feature portion by a target placement acquisition unit according to the first embodiment. FIG. [Figure 13] 5 is a diagram showing an example of extraction of a feature portion by a target placement acquisition unit according to the first embodiment. FIG. [Figure 14] 5 is a diagram showing an example of extraction of a feature portion by a target placement acquisition unit according to the first embodiment. FIG. [Figure 15] 5 is a diagram showing an example of extraction of a feature portion by a target placement acquisition unit according to the first embodiment. FIG. [Figure 16] 5 is a diagram showing an example of extraction of a feature portion by a target placement acquisition unit according to the first embodiment. FIG. [Figure 17] 5 is a diagram illustrating an example of acquisition of a target arrangement by a target arrangement acquisition unit according to the first embodiment. FIG. [Figure 18] FIG. 10 is a configuration diagram of a support system according to a modified example of the first embodiment. [Figure 19] 10 is a diagram showing an example of acquisition of a target arrangement by a target arrangement acquisition unit according to a modification of the first embodiment. FIG. [Figure 20] 1 is a hardware configuration diagram of a main part of a support system according to a first embodiment. [Figure 21] FIG. 10 is a configuration diagram of a support system according to a second embodiment. [Figure 22] FIG. 10 is a diagram illustrating an example of a trained model in a training unit according to the second embodiment. [Figure 23] FIG. 10 is a diagram illustrating an example of a trained model in a training unit according to the second embodiment. [Figure 24] 10 is a flowchart showing an example of the operation of the support system according to the second embodiment. [Figure 25] 10 is a flowchart showing an example of the operation of the support system according to the second embodiment. [Figure 26]FIG. 10 is a diagram showing an example of a display by a display unit according to a modification of the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] The present disclosure will be described with reference to the accompanying drawings, in which the same or corresponding parts are denoted by the same reference numerals, and redundant descriptions will be appropriately simplified or omitted.

[0010] Embodiment 1 FIG. 1 is a perspective view of an example of an elevator device to which a support system 1 according to the first embodiment is applied.

[0011] The assistance system 1 is applied to elevator equipment installation work. Elevator equipment includes, for example, devices operating in an elevator, components constituting the elevator, and their components. The installation work is the work of installing elevator equipment in a target arrangement corresponding to the equipment. In the installation work, one or more pieces of equipment are installed in their corresponding target arrangements. The target arrangement of each piece of equipment is, for example, the arrangement of the equipment during normal elevator operation. Here, the equipment installation includes the position and orientation of the equipment. In the installation work, the installation order for at least some of the equipment to be installed may be preset. The installation work includes, for example, the installation of a new elevator, the renovation of an elevator, or the replacement or maintenance and inspection of elevator equipment. The maintenance and inspection work of elevator equipment may include a process of removing elevator equipment and returning the equipment to its original position after adjustment or cleaning.

[0012] An elevator is applied, for example, to a building having multiple floors. An elevator shaft (not shown) is provided in the building. The shaft is a long vertical space spanning multiple floors in the building. An elevator landing (not shown) is provided on each floor. A landing door is provided at each landing on each floor. The landing door is a door that separates the landing from the elevator shaft.

[0013] The elevator includes a car (not shown), a hoisting rope 2, and a traction machine 3. The car is a device that travels vertically in a hoistway to transport passengers and the like between multiple floors. The hoisting rope 2 is a rope that suspends the car in the hoistway. An elevator may be provided with multiple hoisting ropes 2. The traction machine 3 is an example of elevator equipment. FIG. 1 shows a perspective view of the traction machine 3. The traction machine 3 is provided, for example, in a machine room. The machine room is provided, for example, above the elevator hoistway. A traction machine base 4 is provided in the machine room. The traction machine base 4 is a base that serves as the base for the traction machine 3. The traction machine 3 includes a motor 5 and a sheave 6. The motor 5 and the sheave 6 are each an example of elevator equipment. During installation work, the traction machine 3 may be divided into the motor 5 and the sheave 6 and then installed. The motor 5 is a device that rotates and drives the sheave 6. The sheave 6 has a sheave groove 7. The sheave groove 7 is a groove around which the hoisting rope 2 is wound in the sheave 6. The hoisting rope 2 is lowered from the sheave 6 to the hoistway through a rope duct provided in, for example, a machine room. In the elevator, the hoisting rope 2 is wound up by the sheave 6 driven to rotate by the motor 5, causing the car to travel vertically in the hoistway.

[0014] FIG. 2 is a top view of the hoisting machine 3 according to the first embodiment.

[0015] In this example, the support system 1 supports the installation work of installing elevator equipment including the hoisting machine 3. The support system 1 includes a photographing device 8.

[0016] The photographing device 8 is a device that takes images, such as a camera. The images taken by the photographing device 8 may be either still images or moving images. The photographing device 8 takes an image of an area that includes the target placement position of the hoist 3. The photographing device 8 is placed vertically above the sheave 6 of the hoist 3. The photographing device 8 is placed directly above the sheave 6. In this example, the photographing device 8 is placed on a vertical line that passes through the rotation axis of the sheave 6. The photographing device 8 may also be placed diagonally above the area that includes the target placement position of equipment such as the hoist 3.

[0017] FIG. 3 is a configuration diagram of the support system 1 according to the first embodiment.

[0018] The camera device 8 is fixed to the ceiling of the machine room above the sheave 6. The camera device 8 is fixed so as not to move from the start to the end of the placement work. The camera device 8 is fixed by, for example, an anchor bolt, a magnet, a suction cup, or adhesive tape. The camera device 8 may be attached to a stand installed in, for example, a machine room. The camera device 8 may be fixed to, for example, the wall of the machine room. The camera device 8 may be fixed by, for example, a magnetic chuck. The camera device 8 may remain fixed even after the placement work is completed. Alternatively, the camera device 8 may be removed after the placement work is completed.

[0019] The assistance system 1 includes a guidance system 9. The guidance system 9 is a system including a server device installed in, for example, the building where the elevator is installed or in another building. Alternatively, the guidance system 9 may be a system including a portable information terminal such as a smartphone carried by a worker performing the installation work. Alternatively, the guidance system 9 may be a system including a device built into the imaging device 8. The guidance system 9 may be a system including a single device. Alternatively, the guidance system 9 may be a system including multiple devices. In this case, the multiple devices of the guidance system 9 may be connected to each other via a communication network such as the Internet. Some or all of the functions of the guidance system 9 may be installed in, for example, a virtual machine on a cloud service. Some or all of the functions of the guidance system 9 may be installed in, for example, an edge server in the building where the elevator is installed that connects to an external service via a communication network such as the Internet. The guidance system 9 includes a memory unit 10, an input unit 11, a target placement acquisition unit 12, a display unit 13, and a notification unit 14.

[0020] The memory unit 10 is a part that stores information. For example, information such as the order in which one or more pieces of equipment in an elevator will be placed in the placement work is stored in the memory unit 10. The input unit 11 is a part that accepts input from, for example, a worker performing the placement work. The input unit 11 is, for example, a touch panel, a mouse, or a keyboard. The target placement acquisition unit 12 is a part that acquires a target placement corresponding to each piece of equipment to be placed in the placement work. The display unit 13 is a part that displays a guide image indicating the target placement corresponding to each piece of equipment, superimposed on an image captured by the imaging device 8. The display unit 13 is, for example, a display. The notification unit 14 is a part that notifies the worker of the relationship of the placement of each piece of equipment to the target placement. The notification unit 14 is, for example, a speaker that notifies by voice.

[0021] Next, the functions of the assistance system 1 will be described with reference to FIGS. 4 and 5 are diagrams showing examples of displays on the display unit 13 according to the first embodiment. In this example, the installation work includes replacing the existing hoisting machine 3 with a new hoisting machine 3 .

[0022] FIG. 4 shows an image of the existing hoisting machine 3 in place. The display unit 13 displays an image of the existing hoist 3 photographed by the photographing device 8.

[0023] The target position acquisition unit 12 acquires a target position of the hoist 3, which is an elevator device. The target position acquisition unit 12 acquires a target position corresponding to the hoist 3 based on, for example, input from an operator. In this example, the target position corresponding to the hoist 3 is the position of the sheave groove 7 during normal elevator operation. The target position information includes information on characteristic parts. The characteristic parts are one or more points or lines that indicate the characteristics of the position or posture of the device arranged at the target position. In this example, the characteristic parts are points that indicate the position of the sheave groove 7. The characteristic parts are, for example, points that indicate the positions of the ends of the sheave groove 7. The target position acquired by the target position acquisition unit 12 is stored, for example, in the memory unit 10. The characteristic parts are used, for example, as a guide reference during arrangement work. The characteristic parts of the device are extracted from images captured by the imaging device 8 using, for example, an image processing technique.

[0024] In the process of replacing the hoisting machine 3, an operator removes the hoisting rope 2 from the sheave 6 of the existing hoisting machine 3.

[0025] Thereafter, the worker inputs the target layout by tracing the sheave groove 7 of the existing hoist 3 before removal on the image captured by the photographing device 8 through the input unit 11. The target layout acquisition unit 12 acquires the target layout input through the input unit 11.

[0026] Thereafter, the worker removes the existing hoisting machine 3. Next, the worker temporarily places the new hoisting machine 3 in the machine room.

[0027] FIG. 5 shows an image of a new hoisting machine 3 in a temporary position. The display unit 13 displays an image of the newly installed hoist 3 photographed by the photographing device 8.

[0028] The display unit 13 displays a guide image superimposed on the image captured by the imaging device 8. The guide image is an image showing the target placement acquired by the target placement acquisition unit 12. FIG. 5 shows an example of a guide image corresponding to the hoist 3. The guide image is, for example, an image showing the position or posture of a characteristic part of the equipment placed in the target placement. In this example, the guide image shows an image showing the position and posture of the sheave 6 of the hoist 3 placed in the target placement. The guide image also shows a point showing the position of the end of the sheave 6 of the hoist 3 placed in the target placement. The guide image may be vector image data such as points or lines showing the position and posture of the equipment to be placed. The points or lines showing the position and posture of the equipment are, for example, corners or edges of the outline of the equipment. Alternatively, the guide image may be raster image data such as a video of the equipment placed in the target placement.

[0029] The worker adjusts the position of the newly placed hoist 3 based on the image displayed on the display unit 13. In this example, the worker moves the hoist 3 to the right side of the drawing.

[0030] In this example, the guidance system 9 acquires the position of the new hoist 3, for example, by image recognition of the image captured by the photographing device 8. In this case, the display unit 13 may display an image such as an arrow indicating the direction in which to move the new hoist 3 as part of the guidance image.

[0031] Furthermore, for example, the notification unit 14 pre-sets a first range and a second range for the relationship of placement, such as the distance between the newly installed hoist 3 and the target placement corresponding to the hoist 3. The first range is a range that indicates that the newly installed hoist 3 has approached the target placement when the position and posture of the newly installed hoist 3 are within the first range. The second range is a range that indicates that the newly installed hoist 3 has been placed at the target placement within the allowable error range when the position and posture of the newly installed hoist 3 are within the second range. The second range is included in the first range. The notification unit 14 determines whether the position and posture of the newly installed hoist 3, acquired by, for example, image recognition, fall within the first range and the second range. When the position and posture of the newly installed hoist 3 fall within the first range, the notification unit 14 issues a first sound to notify the worker that the newly installed hoist 3 has approached the target placement. The first sound is a preset sound such as an alarm sound or a voice announcement. When the position and posture of the new hoist 3 enter the second range, the notification unit 14 emits a second sound to notify the worker that the new hoist 3 has been placed in the target location. The second sound is a sound different from the preset first sound such as an alarm sound or a voice announcement. The worker is guided by the display on the display unit 13 and the notification by the notification unit 14 to place the new hoist 3 in the target location.

[0032] Thereafter, the worker winds the hoisting rope 2 around the sheave 6 of the newly installed hoisting machine 3. If there is any equipment to be subsequently placed, the worker performs the work of placing that equipment. At this time, the support system 1 provides guidance for the placement of that equipment in the same manner as it provided guidance for the placement of the hoisting machine 3. On the other hand, if there is no equipment to be subsequently placed, the worker ends the placement work.

[0033] Next, an example of the operation of the support system 1 will be described with reference to FIG. FIG. 6 is a flowchart showing an example of the operation of the support system 1 according to the first embodiment. FIG. 6 shows an example of the operation of the assistance system 1 that provides guidance on the placement of any equipment in an elevator.

[0034] In step S11, the target placement acquisition unit 12 acquires the target placement of the devices to be placed. After that, the operation of the support system 1 proceeds to step S12.

[0035] In step S12, the display unit 13 displays a guide image indicating a target placement corresponding to the device, superimposed on the image of the target device photographed by the photographing device 8. Thereafter, the operation of the support system 1 proceeds to step S13.

[0036] In step S13, the notification unit 14 determines whether the position and posture of the target device are within the first range. If the determination result is Yes, the operation of the assistance system 1 proceeds to step S14. On the other hand, if the determination result is No, the operation of the assistance system 1 proceeds to step S12.

[0037] In step S14, the notification unit 14 emits the first sound. After that, the operation of the support system 1 proceeds to step S15.

[0038] In step S15, the notification unit 14 determines whether the position and posture of the target device are within the second range. If the determination result is Yes, the operation of the assistance system 1 proceeds to step S16. On the other hand, if the determination result is No, the operation of the assistance system 1 proceeds to step S12.

[0039] In step S16, the notification unit 14 emits the second sound. After that, the operation of the support system 1 for guiding the placement of the target device ends. At this time, if there is another device to be subsequently placed in the placement work, the support system 1 starts guiding the placement of the other device.

[0040] Here, the photographing device 8 may include multiple cameras. Each camera is disposed at a position suitable for guiding the placement of any one of the devices. A position suitable for guiding the placement of a device is, for example, a position where the device is photographed from a direction suitable for guiding the placement of the device. A direction suitable for guiding the placement of a device is, for example, a direction with the largest tolerance for device placement, or a direction perpendicular to the direction with the smallest tolerance for device placement. Alternatively, each camera may be disposed so as to enable a stereoscopic view of the placement of each device. If the devices to be placed include a hoist 3, one of the cameras is disposed, for example, vertically above the sheave 6 of the hoist 3. This camera is disposed directly above the sheave 6. Furthermore, another camera is disposed vertically below the sheave 6 of the hoist 3. This camera is disposed directly below the sheave 6. The photographing device 8 may include a camera disposed either vertically above or vertically below the sheave 6 of the hoist 3.

[0041] The equipment to be placed during the placement work may be other equipment of the hoist 3. The equipment to be placed during the placement work may be, for example, a car door device. The car door device is a device that is provided on the car and opens and closes to allow elevator passengers to get on and off the car. In this case, the photographing device 8 may include a camera that is provided on the rear wall of the car's cab. Here, the cab is the part of the car where passengers board. The rear wall of the cab is, for example, the inner wall of the cab that faces the space where passengers board. The rear wall of the cab faces the car door device that is provided on the front of the car.

[0042] FIG. 7 is a top view of another example of elevator equipment to which the assistance system 1 according to the first embodiment is applied. FIG. 7 shows a top view of a landing threshold 15, which is another example of elevator equipment.

[0043] The landing threshold 15 is a threshold that guides the opening and closing of the landing door. The characteristic portion of the target arrangement corresponding to the landing threshold 15 is, for example, a point that indicates the positions of both ends of the landing threshold 15 during normal elevator operation. In this case, the imaging device 8 includes, for example, a camera that captures an image of the landing threshold 15 from vertically above.

[0044] FIG. 8 is a top view of another example of elevator equipment to which the assistance system 1 according to the first embodiment is applied. FIG. 8 shows a top view of a landing device 16, which is another example of elevator equipment.

[0045] The landing device 16 is a device that detects the landing of the car at each floor. The landing device 16 is provided, for example, on the car. The landing device 16 detects, for example, a landing board provided on each floor using a detection unit 17. The detection unit 17 has a groove through which the landing board passes when the car travels. The characteristic portion of the target arrangement corresponding to the landing device 16 is, for example, a point indicating the position of the end of the groove. In this case, the photographing device 8 includes, for example, a camera that photographs the landing device 16 from vertically above or vertically below. The camera is provided, for example, on the car. Alternatively, the camera may be provided, for example, in the elevator shaft, vertically above or vertically below the landing board of any floor.

[0046] FIG. 9 is a diagram showing another example of a display by the display unit 13 according to the first embodiment. An image showing the state where the existing hoisting machine 3 is arranged is shown on the left side of Fig. 9. An image showing the state where the new hoisting machine 3 is arranged is shown on the right side of Fig. 9.

[0047] In this example, the size of the existing hoist 3 is different from the size of the new hoist 3. On the other hand, the size of the sheave 6 of the existing hoist 3 is the same as the size of the sheave 6 of the new hoist 3. In this case, the assistance system 1 can guide the placement of the new hoist 3 using a target placement based on an input with the sheave groove 7 of the existing hoist 3 as the reference.

[0048] As described above, the support system 1 according to the first embodiment includes a camera device 8 and a guidance system 9. In the placement work, the camera device 8 captures an image of an area including a target placement position corresponding to each of one or more pieces of equipment in an elevator. The placement work is a work of placing each piece of equipment in the corresponding target placement. The guidance system 9 provides guidance on placing each piece of equipment in the corresponding target placement based on the image captured by the camera device 8.

[0049] The assistance system 1 provides guidance for the installation work based on the images captured by the camera device 8. Therefore, the assistance system 1 can be applied to the installation work of various elevator devices, regardless of the type of device to be installed and the location where it is installed. Furthermore, since the installation work does not require marking, the assistance system 1 can also be applied to the installation work of devices that cannot be directly attached to the building, such as the sheave 6.

[0050] Furthermore, the guidance system 9 acquires a target arrangement corresponding to at least one of the one or more devices based on an input from a worker who performs the arrangement work.

[0051] The target layout is input by the worker who will be performing the layout work, so that the target layout can be set according to the situation, such as the location where the equipment is to be placed and the equipment to be placed.

[0052] The guidance system 9 also includes a display unit 13. The display unit 13 displays a guidance image indicating a target arrangement corresponding to at least one of the one or more devices, superimposed on the image captured by the imaging device 8.

[0053] This allows the worker to carry out the placement work while simultaneously checking the device to be placed and the guide image, which allows the support system 1 to more effectively provide guidance for the placement work.

[0054] Furthermore, the guide image showing the target arrangement corresponding to at least one of the one or more devices is an image of one or more characteristic parts of the device arranged in the target arrangement.

[0055] The support system 1 guides the placement work based on the characteristic features of the equipment. This clarifies the alignment criteria. Therefore, the support system 1 can more effectively guide the placement work. Furthermore, even when the placement work includes a process of replacing existing equipment with new equipment that is different in overall size or shape, the support system 1 can more effectively guide the placement work based on the common characteristic features of the existing equipment and the new equipment.

[0056] The guidance system 9 also includes a notification unit 14. In the notification unit 14, a first range is set in advance for a target location corresponding to at least one of one or more devices. The notification unit 14 notifies the user that the device has entered the first range by a first sound.

[0057] This allows the worker to confirm the arrangement of the equipment without relying on display by the display unit 13. Here, the first range is, for example, a range that indicates that the equipment has approached the target arrangement when the position and orientation of the equipment to be arranged are within the first range. Alternatively, the first range may be, for example, a range that indicates that the equipment has been arranged in the target arrangement within the allowable error range when the position and orientation of the equipment to be arranged are within the first range.

[0058] Furthermore, for at least one of the one or more devices for which a first range is set, a second range is set in advance with respect to the target arrangement corresponding to the device in the notification unit 14. The second range is included in the first range. The notification unit 14 notifies the user that the device has entered the second range by a second sound.

[0059] As a result, by receiving notifications using different sounds, such as the first sound and the second sound, the worker can confirm the relationship between the equipment to be placed and the target placement corresponding to the equipment. Here, the second range is, for example, a range indicating that the equipment has been placed in the target placement within the allowable error range when the position and orientation of the equipment to be placed are in the second range. Alternatively, the second range may be a range that includes the third range. The third range is, for example, a range indicating that the equipment has been placed in the target placement within the allowable error range when the position and orientation of the equipment to be placed are in the third range.

[0060] The photographing device 8 is installed so as not to move from the start to the end of the placement work.

[0061] This allows the position of the image capturing device 8 to be used as a reference, so that the support system 1 can provide more accurate guidance for the placement work.

[0062] Furthermore, when the one or more pieces of equipment in the arrangement work include a hoist 3, the camera device 8 is placed vertically above or vertically below the sheave 6 of the hoist 3. Furthermore, when one or more pieces of equipment in the installation work include a car door device, the image capturing device 8 is placed on the rear wall of the car room in which the car door device is installed.

[0063] In this way, the imaging device 8 is placed in a position suitable for guiding the placement of the equipment, so the support system 1 can provide more accurate guidance for the placement work.

[0064] The target location acquisition unit 12 may acquire a target location for each piece of equipment based on design information such as design drawings. For example, if the installation work involves installing a new elevator, guidance for locating each piece of equipment according to the design information becomes possible. The target location acquisition unit 12 may also acquire a target location for each piece of equipment to be located during the installation work based on the relative location of the equipment to its surrounding equipment. For example, if the equipment to be located during the installation work is a hoisting machine 3, the target location for the hoisting machine 3 may be acquired based on the horizontal distance between the sheave groove 7 of the sheave 6 of the hoisting machine 3 and the edge of the rope duct in the machine room. This allows the assistance system 1 to guide the sheave 6 to a location where the hoisting rope 2 hanging from the sheave groove 7 into the hoistway is less likely to interfere with the edge of the rope duct. For example, if the installation work involves a replacement work, the diameter of the sheave 6 or the number of sheave grooves 7 may change before and after the replacement.

[0065] Furthermore, in arrangement work such as elevator equipment replacement work or maintenance and inspection work, at least one piece of equipment may be arranged at a position after removing elevator equipment that was already arranged before the arrangement work. In this case, the target arrangement acquisition unit 12 may acquire a target arrangement corresponding to the equipment based on the arrangement before the already arranged equipment was removed. For example, when the arrangement work includes a step of replacing an existing hoisting machine 3 with a new hoisting machine 3, the target arrangement acquisition unit 12 may Camera 8 The position of the sheave groove 7 of the existing hoist 3 before it is removed is detected by image recognition of an image of the existing hoist 3 taken by the operator. The target position acquisition unit 12 acquires the target position of the new hoist 3 based on the acquired position of the sheave groove 7, for example, as an arrangement in which the position of the sheave groove 7 remains unchanged before and after replacement. At this time, the worker does not need to input the target position via the input unit 11. This improves the workability of the placement work. Note that, for example, in maintenance and inspection work on elevator equipment, the equipment that was already placed before the placement work and the equipment that will be placed in the position and attitude of that equipment during the placement work may be the same equipment.

[0066] The memory unit 10 also stores a preset order for the placement of one or more devices in the placement work. At this time, the target placement acquisition unit 12 may acquire a target placement corresponding to at least one of the one or more devices based on the relative placement of a device that is placed before the device in the order stored in the memory unit 10. At this time, the target placement acquisition unit 12 determines whether the devices are placed according to the order stored in the memory unit 10. If the order of placement of the devices follows the order stored in the memory unit 10, the target placement acquisition unit 12 acquires a target placement based on the relative placement of the devices. For example, if the motor 5 and sheave 6 of the hoist 3 are placed separately in this order in the placement work, the target placement acquisition unit 12 acquires the target placement of the sheave 6 based on the position or attitude at which the motor 5 is placed. The memory unit 10 may store information on the relative placement of the motor 5 and sheave 6 of the hoist 3. At this time, the target placement acquisition unit 12 may acquire the target placement of the sheave 6 from the position or attitude of the placed motor 5 by, for example, referring to the relative placement of the sheave 6 from the storage unit 10. At this time, the occurrence of interference with already placed equipment is suppressed.

[0067] Next, a specific example of extracting characteristic parts of a device will be described with reference to FIGS. 10 to 12 are diagrams showing examples of extraction of characteristic portions by the target placement acquisition unit 12 according to the first embodiment.

[0068] In this example, the target location acquisition unit 12 extracts the characteristic parts by an image processing method such as template matching. The target location acquisition unit 12 extracts, as the characteristic parts of the device, the corners of the outline of the device, which are examples of points that indicate the position and orientation of the device.

[0069] 10 shows a photographed image of a device photographed by the photographing device 8 and a model image of the device. The model image of the device is, for example, a similar image of the device photographed in the past, or a similar image generated based on design information of the device. A similar image based on design information is, for example, a CAD (Computer Aided Design) image. Note that in the model image of the device, the characteristic parts of the device are known.

[0070] The target arrangement acquisition unit 12 detects the position of the device on the captured image by scanning the model image on the captured image captured by the imaging device 8. The target arrangement acquisition unit 12 may scan the model image while performing image transformations such as affine transformation including enlargement, reduction, and rotation of the model image, or homography transformation. While scanning the model image, the target arrangement acquisition unit 12 calculates the similarity or dissimilarity between the model image and the area on the captured image where the model image overlaps.

[0071] 11, the target arrangement acquisition unit 12 detects the position where the similarity is greatest or the position where the dissimilarity is least as the position of the device on the captured image. Note that when performing transformations such as rotation, enlargement, and reduction of the model image during scanning, the target arrangement acquisition unit 12 may also detect transformation parameters such as the rotation angle and enlargement or reduction magnification of the model image.

[0072] 12, the target layout acquisition unit 12 determines the layout of the characteristic parts of the device on the captured image as the layout of the characteristic parts of the model image located at the position detected by scanning, etc. Because the characteristic parts in the model image are known, the target layout acquisition unit 12 can extract the layout of the characteristic parts of the device on the captured image using the positions of the model image detected by scanning and the transformation parameters.

[0073] Next, another specific example of extracting the characteristic parts of a device will be described with reference to FIGS. 13 and 14 are diagrams showing other examples of extraction of characteristic portions by the target placement acquisition unit 12 according to the first embodiment.

[0074] 13, the image of the device on the captured image and the model image may not exactly match. In such cases, the target location acquisition unit 12 detects the approximate position of the device on the captured image by scanning the model image.

[0075] 14, the target layout acquisition unit 12 sets a processing area for performing detailed detection of the feature portion in an area including the layout of the feature portion of the model image located at the position detected by scanning, etc. In this example, the target layout acquisition unit 12 sets two processing areas: an upper processing area and a lower processing area.

[0076] The target layout acquisition unit 12 performs corner detection processing in each of the set processing areas. In the corner detection processing, a known algorithm such as Harris corner detection or Shi-Tomasi corner detection can be applied. The target layout acquisition unit 12 extracts the corners detected in this way as feature parts.

[0077] Next, another specific example of extracting the characteristic parts of a device will be described with reference to FIG. FIG. 15 is a diagram showing another example of extraction of a characteristic portion by the target placement acquisition unit 12 according to the first embodiment.

[0078] The target location acquisition unit 12 calculates image features for each of the model image and the captured image. The image features calculated here are, for example, SIFT (Scale-Invariant Feature Transform), SURF (Speed ​​Up Robust Feature), or HOG (Histogram of Oriented Gradient). The image features calculated here are rotation-invariant and scale-invariant features. Figure 15 shows keypoints detected by features such as SIFT.

[0079] The target location acquisition unit 12 matches the key points detected in the model image with the key points detected in the captured image. This allows the target location acquisition unit 12 to detect the position of the device on the captured image. Even if the device is rotated or enlarged or reduced in the captured image, matching is possible by using rotation-invariant and scale-invariant feature amounts.

[0080] For example, the target layout acquisition unit 12 sets the layout of the characteristic parts of the model image thus matched as the layout of the characteristic parts of the device on the captured image. Alternatively, the target layout acquisition unit 12 may set a processing area for detailed detection of the characteristic parts in an area including the layout of the characteristic parts of the model image thus matched. In this case, the target layout acquisition unit 12 performs corner detection processing in each of the set processing areas, and extracts the detected corners as characteristic parts.

[0081] As shown in FIG. 16, the target placement acquisition unit 12 may extract, as a feature of the equipment, an edge of the outline of the equipment, which is an example of a line indicating the position and orientation of the equipment. FIG. 16 is a diagram showing another example of extraction of a feature by the target placement acquisition unit 12 according to the first embodiment. The target placement acquisition unit 12 extracts an edge as a feature by a procedure similar to that used to extract a corner as a feature. Here, in the edge detection process, a known algorithm such as Canny edge detection can be applied. In the edge detection process, processing such as noise removal and line segmentation may be performed. Since intuitively easy-to-understand edges are displayed as a guide image, the worker can more easily perform the equipment placement work.

[0082] 17, the target placement acquisition unit 12 may acquire multiple target placement candidates for a device based on an image of the device captured by the image capture device 8. FIG. 17 is a diagram showing an example of acquisition of a target placement by the target placement acquisition unit 12 according to the first embodiment. The candidate target placements for a device are, for example, candidates for characteristic parts of the device. In this example, the candidate characteristic parts are, for example, multiple corners extracted by an image processing technique.

[0083] At this time, the guidance system 9 presents a plurality of candidates for the target placement to the worker, for example, via the display unit 13. The worker selects one or more candidates from the presented plurality of candidates for the target placement, for example, via the input unit 11. The target placement acquisition unit 12 acquires the candidates selected by the worker as the target placement of the equipment. In this example, candidates not selected by the worker are excluded from the target placement of the equipment. This makes it easier for the worker to input the target placement.

[0084] Furthermore, the guide image indicating a target arrangement corresponding to at least one of one or more devices may be an image of the device arranged in the target arrangement. For example, when the arrangement work includes a process of replacing an existing hoist 3 with a new hoist 3, the display unit 13 may display an image of the existing hoist 3 before it is removed as a guide image superimposed on the image of the new hoist 3 arranged in the arrangement work. In this case, the image of the existing hoist 3 as a guide image is displayed superimposed, for example, as a semi-transparent image so that it can be compared with the position of the image of the new hoist 3. Alternatively, the image of the existing hoist 3 as a guide image may be displayed superimposed, for example, as an image of only the outline.

[0085] FIG. 18 is a configuration diagram of a support system 1 according to a modification of the first embodiment.

[0086] The guidance system 9 includes a communication unit 18. The communication unit 18 is a unit that outputs information to a device external to the guidance system 9 via a wired or wireless connection. The communication unit 18 may output information to the external device via a communication network such as the Internet. The communication unit 18 outputs, for example, information on a target placement or information on a guidance image. The communication unit 18 outputs information to, for example, a display device 19 external to the guidance system 9. The display device 19 may be, for example, a portable information terminal such as a smartphone carried by a worker. The worker may also wear the display device 19 during placement work. The display device 19 is, for example, a device such as an HMD (Head Mounted Display) that displays an input image superimposed on an image in the worker's field of view. The display device 19 displays images using, for example, AR (Augmented Reality) technology or VR (Virtual Reality) technology. This allows the worker to check the positional relationship between the equipment and the target placement while performing the placement work, thereby improving the work efficiency of the placement work. The information on the target location or guide image may be information acquired based on images taken by a plurality of cameras of the image taking device 8 as three-dimensional information.

[0087] FIG. 19 is a diagram showing an example of acquisition of a target layout by the target layout acquisition unit 12 according to another modification of the first embodiment.

[0088] As shown in FIG. 19 , the target arrangement acquisition unit 12 acquires the target arrangement based on an image captured by the camera device 8 before the already installed equipment is removed and an image captured by the camera device 8 after the equipment is removed. For example, when the installation work includes a process of replacing the existing hoist 3 with a new hoist 3, the target arrangement acquisition unit 12 acquires an image of the existing hoist 3 before it is removed. The target arrangement acquisition unit 12 also acquires an image after the existing hoist 3 is removed. The target arrangement acquisition unit 12 extracts the position or orientation of the existing hoist 3 in the image captured by the camera device 8 by taking the difference between the acquired images. The target arrangement acquisition unit 12 acquires a target arrangement corresponding to the position or orientation of the new hoist 3 based on the extracted position of the existing hoist 3.

[0089] Next, an example of the hardware configuration of the support system 1 will be described with reference to FIG. FIG. 20 is a hardware configuration diagram of the main part of the support system 1 according to the first embodiment.

[0090] Each function of the assistance system 1 may be realized by a processing circuit. The processing circuit includes at least one processor 100 a and at least one memory 100 b. The processing circuit may include at least one dedicated hardware 200 in addition to or in place of the processor 100 a and the memory 100 b.

[0091] When the processing circuit includes a processor 100a and a memory 100b, each function of the assistance system 1 is realized by software, firmware, or a combination of software and firmware. At least one of the software and firmware is written as a program. The program is stored in the memory 100b. The processor 100a realizes each function of the assistance system 1 by reading and executing the program stored in the memory 100b.

[0092] The processor 100a is also called a CPU (Central Processing Unit), processing device, arithmetic unit, microprocessor, microcomputer, or DSP. The memory 100b is configured by, for example, a non-volatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, or EEPROM.

[0093] Where the processing circuitry comprises dedicated hardware 200, the processing circuitry may be implemented, for example, as a single circuit, multiple circuits, a programmed processor, parallel programmed processors, an ASIC, an FPGA, or a combination thereof.

[0094] Each function of the assistance system 1 can be realized by a processing circuit. Alternatively, each function of the assistance system 1 can be realized collectively by a processing circuit. Some of the functions of the assistance system 1 may be realized by dedicated hardware 200, and the other parts may be realized by software or firmware. In this way, the processing circuit realizes each function of the assistance system 1 by dedicated hardware 200, software, firmware, or a combination of these.

[0095] Embodiment 2 The assistance system 1 according to the first embodiment acquires a target layout corresponding to the hoist 3 based on input from a worker. The assistance system 1 according to the second embodiment learns, by machine learning, the relationship between an image captured by the camera device 8 and a target layout previously input by a worker on this image via the input unit 11. Furthermore, the assistance system 1 infers the target layout in the image captured by the camera device 8 using a trained model generated by the training.

[0096] 21 is a configuration diagram of a guidance system 9 according to embodiment 2. The guidance system 9 according to embodiment 2 further includes a learning unit 20 and an inference unit .

[0097] The learning unit 20 acquires, as learning data, a set of images captured by the camera device 8 and a target layout previously input by a worker for the image via the input unit 11. Here, the learning data is data in which the images captured by the camera device 8 and the target layout input by a worker for the image are associated with each other. The learning unit 20 learns the target layout in the images captured by the camera device 8 based on the acquired learning data. That is, the learning unit 20 generates a trained model for inferring an optimal target layout from the images captured by the camera device 8. Note that the images captured by the camera device 8 may be, for example, images captured vertically from above of an area where equipment is to be placed, as in the first embodiment. Here, the combination of data included in the learning data corresponds to the process of the placement work. For example, in the process of placing new equipment, the images captured by the camera device 8 are images that do not include the equipment. Therefore, the combination of the images captured by the camera device 8 and the target layout input by a worker for the images is acquired as learning data. Furthermore, in the process of replacing existing equipment with new equipment, the image captured by the camera device 8 includes the existing equipment. Therefore, a combination of the image captured by the camera device 8 and the target layout input by the worker for that image is acquired as learning data.

[0098] Next, an example of a trained model trained by the learning unit 20 will be described with reference to FIGS. 22 and 23. FIGS. 22 and 23 are diagrams illustrating an example of a trained model in the learning unit 20 according to the second embodiment. The learning unit 20 can perform training using a known learning algorithm, such as supervised learning or reinforcement learning. As an example, a learning algorithm based on supervised learning using a neural network will be described. In this example, the learning unit 20 learns a target position for image data of the existing hoist 3 by supervised learning according to a neural network model. Here, supervised learning refers to a technique in which pairs of input and output data are provided to a learning device such as the learning unit 20, and the learning device learns features of the training data to generate a trained model. The trained model generated here is used by an inference device such as the inference unit 21 to infer an output from an input.

[0099] A neural network consists of an input layer consisting of multiple neurons, a hidden layer consisting of multiple neurons, and an output layer consisting of multiple neurons. Each neuron applies an activation function to the input value and outputs it. The activation function is a nonlinear function such as a sigmoid function or a ramp function.

[0100] For example, in a three-layer neural network as shown in Figure 22, when multiple inputs are input to the input layer (X1, X2, X3, ...), the output values ​​are multiplied by weights W0 (w01, w02, w03, ...) and input to the intermediate layer (Y1, Y2, ...). The output values ​​from the intermediate layer are further multiplied by weights W1 (w11, w12, w13, ...) and input to the output layer (Z1, Z2, Z3, ...). Each neuron in the output layer outputs output data based on the input values. In this way, the output through the neural network varies depending on the values ​​of each component of the weight vectors W0 and W1. In this example, the trained model is represented by weight vectors W0 and W1.

[0101] Alternatively, as shown in FIG. 23, a learning algorithm using a neural network with two or more hidden layers may be applied. In such a neural network, when multiple inputs are input to the input layer (X1, X2, X3, ...), the output values ​​are multiplied by weights W0 (w01, w02, w03, ...) and input to the first hidden layer (Y11, Y12, ...). The output values ​​from the first hidden layer are further multiplied by weights W1 (w11, w12, w13, ...) and input to the second hidden layer. This process is repeated in a similar manner, where n is a natural number greater than or equal to 2, and the output values ​​from the nth hidden layer are further multiplied by weights Wn (wn1, wn2, wn3, ...) and input to the output layer. Each neuron in the output layer outputs output data based on the input values. In this way, the output through the neural network varies depending on the values ​​of each component of the weight vector W0, W1, ..., Wn. In this example, the trained model is represented by weight vectors W0, W1, ..., Wn. Note that the connections between adjacent layers do not have to be fully connected. For example, the neural network may include a convolutional layer or a pooling layer.

[0102] The data input to the input layer may be, for example, image features extracted from an image. The image features may include, for example, the position of an edge in the image. The data input to the input layer may include, for example, information such as a label that identifies the type of equipment to be placed in the target layout. The data output from the output layer may be, for example, the position and orientation of the equipment, which is the target layout. If the target layout can be labeled, the data output from the output layer may be a value such as the probability that each label will be assigned to the target layout.

[0103] In the second embodiment, the neural network of the learning unit 20 learns the target layout in the image data captured by the camera device 8 by so-called supervised learning in accordance with learning data created based on a combination of images captured by the camera device 8 and target layouts previously input by a worker on these images via the input unit 11. That is, the neural network learns by inputting images captured by the camera device 8 into the input layer and adjusting the weight vectors W0 and W1, etc., so that the results output from the output layer, i.e., the target layout, approach the target layout previously input by a worker via the input unit 11. The learning unit 20 can perform learning from the learning data using a known method, for example, backpropagation.

[0104] The learning unit 20 generates a trained model by performing the above-described learning. The storage unit 10 stores the trained model generated by the learning unit 20.

[0105] Although the above description concerns a case where supervised learning is applied to the learning algorithm used by the learning unit 20, the present invention is not limited to this. The learning algorithm may be capable of learning the relationship between the images captured by the image capture device 8 and the target location, and machine learning may be performed using other known methods such as genetic programming, functional logic programming, or support vector machines. The learning algorithm used by the learning unit 20 may also be deep learning, which learns the extraction of image features. The learning unit 20 may also learn the relationship between the images captured by the image capture device 8 and the target location using an algorithm such as reinforcement learning. The reward in reinforcement learning may be, for example, an evaluation input by a worker after the work, or the time or man-hours required for the work.

[0106] Furthermore, the data input to the input layer may be image data itself. The image data input during learning by the learning unit 20 may include, in addition to images captured by the camera device 8, CG (Computer Graphics) images generated using 3D CAD. The image data input during learning may be CG images converted to resemble actual images captured by the camera device 8. In this case, the image data input during learning is generated using a technology such as a generative adversarial network (GAN). In this GAN, for example, a network that generates similar images for learning is used as the generation network. Furthermore, a network that identifies actual images captured by the camera device 8 and similar images generated by the generation network is used as the identification network. Increasing the number of images for learning in this way can improve the accuracy of learning in the learning unit 20. Note that the target placement data for the image data generated in this way may be set manually by an operator or automatically based on information about components in the 3D CAD data that is the basis of the CG images.

[0107] The inference unit 21 infers the target arrangement in the image captured by the image capture device 8, which is obtained using the trained model. That is, by inputting the image captured by the image capture device 8 into this trained model, it is possible to output the target arrangement inferred from the image.

[0108] Next, an example of the learning process in the learning unit 20 will be described with reference to Fig. 24. Fig. 24 is a flowchart showing an example of the operation of the support system 1 according to embodiment 2. Fig. 24 shows an example of the learning process in the learning unit 20.

[0109] Here, the assistance system 1 according to the second embodiment uses, as learning data, an image of the existing hoist 3 obtained by the operation of the assistance system 1 shown in Fig. 6 and a target layout input by an operator. The following learning process may be performed after the process shown in Fig. 6 has been performed multiple times. Furthermore, the following learning process may be performed each time the process shown in Fig. 6 has been performed, and this may be repeated.

[0110] In step S21, the learning unit 20 acquires learning data that is created based on a combination of an image captured by the photographing device 8 and a target placement previously input by a worker for this image via the input unit 11. In the second embodiment, the learning unit 20 simultaneously acquires an image of the existing hoist 3 and the target placement, but it is sufficient for the learning unit 20 to input these in an associated manner, and the learning unit 20 may acquire the image of the existing hoist 3 and the data on the target placement at different times.

[0111] Then, in step S22, the learning unit 20 learns the target placement of the equipment in the image data captured by the camera device 8 through supervised learning in accordance with learning data created based on a combination of the image captured by the camera device 8 and the target placement previously input by the worker for this image through the input unit 11, and generates a learned model.

[0112] Thereafter, in step S23, the storage unit 10 stores the trained model generated by the training unit 20.

[0113] Next, an example of inference processing in the target placement inference unit 21 for an image captured by the image capturing device 8 will be described with reference to Fig. 25. Fig. 25 is a flowchart showing an example of the operation of the support system 1 according to the second embodiment. Fig. 25 shows an example of the inference processing in the inference unit 21. In the second embodiment, the operation related to the inference processing is performed in step S11 of Fig. 6, and the subsequent operations are similar to the operations shown in Fig. 6.

[0114] In step S31, the inference unit 21 acquires an image captured by the image capturing device 8.

[0115] Then, in step S32, the inference unit 21 inputs the image captured by the image capturing device 8 into the trained model stored in the storage unit 10. The inference unit 21 obtains a target position for the image data captured by the image capturing device 8 from the output of the trained model.

[0116] Then, in step S33, the inference unit 21 outputs a target layout for the image data captured by the camera device 8, which is obtained from the trained model. The target layout is the target layout of one of the elevator devices to be placed in the area of ​​the image during the placement work. The target layout acquisition unit 12 acquires the target layout output by the inference unit 21 as the target layout of the device. Then, the operation of the assistance system 1 proceeds to step S12 in FIG. 6, where the output target layout is displayed superimposed on the image captured by the camera device 8.

[0117] As described above, the assistance system 1 according to the second embodiment includes a learning unit 20. The learning unit 20 generates a trained model through machine learning using training data. The training data includes images captured by the camera device 8 and a target layout of elevator equipment to be placed in the area of ​​the image. The trained model is used to infer the target layout from the images captured by the camera device 8. The assistance system 1 also includes an inference unit 21. The inference unit 21 infers the target layout of the equipment from the images captured by the camera device using the trained model. The guidance system 9 acquires the target layout corresponding to the equipment based on the inference by the inference unit 21. This configuration eliminates the need for the worker to input the target layout via the input unit 11, thereby reducing the burden on the worker of inputting the target layout and enabling even non-experts to identify the target layout.

[0118] In the second embodiment, the inference unit 21 has been described as outputting a target arrangement for image data captured by the photographing device 8 using a trained model generated by the learning unit 20 of the support system 1. However, the inference unit 21 may also acquire a trained model generated by an external system (not shown) of the support system 1, and output a target arrangement for image data captured by the photographing device 8 based on the trained model acquired from the external system.

[0119] Alternatively, one or both of the learning unit 20 and the inference unit 21 may be mounted on a device connected via a communication network such as the Internet and located outside the building in which the elevator is installed. For example, the learning unit 20 may be mounted on a learning device that serves as an independent device. Alternatively, the inference unit 21 may be mounted on an inference device that serves as an independent device. Alternatively, one or both of the learning unit 20 and the inference unit 21 may be mounted on a virtual machine on a cloud service.

[0120] The learning unit 20 may also perform learning using learning data created for multiple elevators. In this case, the multiple elevators may be installed in different buildings. The multiple elevators may also be elevators operating in the same area. Alternatively, the multiple elevators may also be elevators operating in multiple areas. Elevators from which the learning unit 20 acquires learning data may be added and removed during the operation of the assistance system 1. The learning unit 20 of one assistance system 1 may also acquire a trained model generated by the learning unit 20 of another assistance system 1. In this case, the learning unit 20 of the assistance system 1 that has acquired the trained model may perform re-learning to update the acquired trained model using learning data acquired in the assistance system 1.

[0121] Next, a modification of the second embodiment will be described with reference to FIG. 26 is a diagram showing an example of a display by the display unit 13 according to a modification of the second embodiment. In this modification, the trained model is a model that can infer, from an image captured by the image capturing device 8, the target arrangement of the device to be placed in the area of ​​the image, as well as the characteristic parts of the device. The characteristic parts of the device inferred in the trained model are one or more characteristic parts.

[0122] The following describes an example of an installation work for installing a hoisting machine 3. In this example, an existing hoisting machine is replaced with a new hoisting machine 3. In the installation work, after the existing hoisting machine is removed, the new hoisting machine 3 is temporarily placed near the target placement. At this time, the photographing device 8 photographs an area including both the temporarily placed new hoisting machine 3 and the position of its target placement.

[0123] The learning unit 20 acquires, as learning data, a set of the image captured by the photographing device 8, the target arrangement of the newly installed hoist 3 previously input by an operator via the input unit 11 for the image, and the characteristic parts of the newly installed hoist 3 temporarily placed in the image. The characteristic parts of the newly installed hoist 3 are input by an operator via the input unit 11, for example. The characteristic parts of the newly installed hoist 3 may be input, for example, together with the input of the target arrangement. Note that the trained model in the learning unit 20 may be a composite model that independently includes a model for acquiring the target arrangement and a model for acquiring the characteristic parts. In this case, the learning unit 20 may independently acquire learning data for the model for acquiring the target arrangement and learning data for the model for acquiring the characteristic parts.

[0124] The inference unit 21 uses the trained model by the learning unit 20 to infer the target placement of the new hoist 3 from the image captured by the photographing device 8, and characteristic parts of the newly installed hoist 3 temporarily placed in the image. The guidance system 9 provides guidance to the new hoist 3 to the target placement based on the target placement and characteristic parts of the new hoist 3 thus inferred. For example, as shown in FIG. 26 , the display unit 13 displays a guide image superimposed on the image captured by the photographing device 8. In this example, the guide image displays an image showing the position and attitude of the sheave 6 of the new hoist 3 placed in the target placement. The image displays the positions of the characteristic parts when the new hoist 3 is placed in the target placement. The guide image also displays the positions of the characteristic parts of the new hoist 3 to be placed from the temporarily placed position to the target placement. With this configuration, the characteristic parts of the current equipment and the characteristic parts of the equipment placed in the target placement are displayed simultaneously, allowing the assistance system 1 to more effectively provide guidance for the placement work. This improves the workability of the placement work. [Industrial Applicability]

[0125] The assistance system according to the present disclosure can be applied to the installation work of elevator equipment. [Explanation of symbols]

[0126] DESCRIPTION OF REFERENCE NUMERALS 1 Support system, 2 Hoisting rope, 3 Hoist, 4 Hoist base, 5 Motor, 6 Sheave, 7 Sheave groove, 8 Photography device, 9 Guidance system, 10 Memory unit, 11 Input unit, 12 Target position acquisition unit, 13 Display unit, 14 Notification unit, 15 Landing threshold, 16 Landing device, 17 Detection unit, 18 Communication unit, 19 Display device, 20 Learning unit, 21 Inference unit, 100a Processor, 100b Memory, 200 Dedicated hardware

Claims

1. an imaging device that images an area including a position of a target arrangement corresponding to each of one or more pieces of equipment of an elevator in an arrangement operation in which each of the one or more pieces of equipment is arranged in a corresponding target arrangement; a guidance system that guides the placement of each of the one or more devices to the corresponding target placement based on the image captured by the imaging device; Equipped with The guidance system stores a preset order of arrangement of the one or more devices in the arrangement work, determines whether at least one of the one or more devices is arranged in accordance with the stored order, and, if the order of arrangement is in accordance with the stored order, obtains a target arrangement corresponding to the device based on the relative arrangement of a device that is arranged before the device in the stored order. A support system for elevator equipment placement work.

2. an imaging device that images an area including a position of a target arrangement corresponding to each of one or more pieces of equipment of an elevator in an arrangement operation in which each of the one or more pieces of equipment is arranged in a corresponding target arrangement; a guidance system that guides the placement of each of the one or more devices to the corresponding target placement based on the image captured by the imaging device; Equipped with When at least one of the one or more pieces of equipment is to be placed at a position after removing an elevator device that was already placed before the placement work, the guidance system acquires a target placement corresponding to the equipment based on the placement before the already placed equipment was removed. A support system for elevator equipment placement work.

3. an imaging device that images an area including a position of a target arrangement corresponding to each of one or more pieces of equipment of an elevator in an arrangement operation in which each of the one or more pieces of equipment is arranged in a corresponding target arrangement; a guidance system that guides the placement of each of the one or more devices to the corresponding target placement based on the image captured by the imaging device; Equipped with The guidance system acquires a target placement based on a difference between an image captured by the imaging device before the equipment that has already been placed is removed and an image captured by the imaging device after the equipment is removed. A support system for elevator equipment placement work.

4. an imaging device that images an area including a position of a target arrangement corresponding to each of one or more pieces of equipment of an elevator in an arrangement operation in which each of the one or more pieces of equipment is arranged in a corresponding target arrangement; a guidance system that guides the placement of each of the one or more devices to the corresponding target placement based on the image captured by the imaging device; Equipped with The guidance system comprises: a notification unit that notifies, with a first sound, that at least one of the one or more devices has entered a first range that is preset with respect to a target arrangement corresponding to the device; Equipped with A support system for elevator equipment placement work.

5. The notification unit notifies, with a second sound, that at least one of the devices for which the first range is set among the one or more devices has entered a second range that is set in advance for a target arrangement that is included in the first range and corresponds to the device. The elevator equipment arrangement work support system according to claim 4.

6. an imaging device that images an area including a position of a target arrangement corresponding to each of one or more pieces of equipment of an elevator in an arrangement operation in which each of the one or more pieces of equipment is arranged in a corresponding target arrangement; a guidance system that guides the placement of each of the one or more devices to the corresponding target placement based on the image captured by the imaging device; Equipped with When the one or more pieces of equipment in the placement work include a hoist, the camera is disposed vertically above or vertically below a sheave of the hoist; The guide system guides the sheave to a target position based on the sheave groove of the sheave. A support system for elevator equipment placement work.

7. an imaging device that images an area including a position of a target arrangement corresponding to each of one or more pieces of equipment of an elevator in an arrangement operation in which each of the one or more pieces of equipment is arranged in a corresponding target arrangement; a guidance system that guides the placement of each of the one or more devices to the corresponding target placement based on the image captured by the imaging device; Equipped with When the one or more pieces of equipment in the placement work include a landing device having a detection unit that detects the landing of the car on each floor, the photographing device is arranged vertically above or vertically below the landing device in the car, The guidance system guides the placement of the landing device to a target placement based on grooves of the detection units through which landing plates provided on each floor pass when the car travels at the landing device. A support system for elevator equipment placement work.

8. In the guidance system, a target arrangement corresponding to at least one of the one or more devices is acquired based on an input from a worker performing the arrangement work. The elevator equipment arrangement work support system according to any one of claims 1 to 7.

9. In the guidance system, the target placement corresponding to at least one of the one or more pieces of equipment is acquired based on a candidate selected by the worker performing the placement work from among a plurality of candidates presented by the guidance system to the worker. The elevator equipment arrangement work support system according to claim 8.

10. The guidance system comprises: a display unit that displays, for at least one of the one or more devices, a guide image indicating a target arrangement corresponding to the device, superimposed on the image captured by the imaging device; Equipped with The elevator equipment arrangement work support system according to any one of claims 1 to 7.

11. The guidance system comprises: a communication unit that outputs, for at least one of the one or more pieces of equipment, a guide image showing a target arrangement corresponding to the equipment to a display device that displays the input image superimposed on an image in the field of view of the worker performing the arrangement work. Equipped with The elevator equipment arrangement work support system according to any one of claims 1 to 7.

12. The guide image showing the target arrangement corresponding to at least one of the one or more devices is an image of the device arranged in the target arrangement. The elevator equipment arrangement work support system according to claim 10.

13. The guide image showing the target arrangement corresponding to at least one of the one or more devices is an image of one or more characteristic parts of the device arranged in the target arrangement. The elevator equipment arrangement work support system according to claim 10.

14. The photographing device is installed so as not to move from the start to the end of the placement work. The elevator equipment arrangement work support system according to any one of claims 1 to 7.

15. a learning unit that generates, by machine learning, a trained model that infers a target arrangement from an image captured by the image capture device, using learning data including an image captured by the image capture device and a target arrangement of devices among the one or more devices that are to be arranged in an area of ​​the image; The elevator equipment arrangement work support system according to any one of claims 1 to 7, comprising:

16. an inference unit that infers a target arrangement of the device from the image captured by the image capture device using a trained model for inferring a target arrangement from the image captured by the image capture device, the trained model being generated by machine learning using training data including an image captured by the image capture device and a target arrangement of the device to be placed in an area of ​​the image among the one or more devices; Equipped with The guidance system acquires a target arrangement corresponding to the device based on the inference of the inference unit. The elevator equipment arrangement work support system according to any one of claims 1 to 7.

17. the trained model used for inference by the inference unit is a trained model for inferring, from an image captured by the imaging device, a target arrangement of a device to be arranged in an area of ​​the image among the one or more devices and one or more characteristic parts of the device, the inference unit infers a target location and one or more characteristic parts of the device from an image captured by the imaging device; The guidance system guides the device to the target location inferred by the inference unit based on the target location inferred by the inference unit and one or more characteristic portions. The elevator equipment arrangement work support system according to claim 16.

Images