Passenger conveyor confirmation system and passenger conveyor confirmation method

Abstract

Provided are a passenger conveyor confirmation system and a passenger conveyor confirmation method, which can confirm whether bolts for fixing steps to chains in a passenger conveyor are properly installed. Provided are: a detection unit, which detects a predetermined color for each bolt from an image of each bolt captured by a photographing terminal when a washer having a bent portion with one side colored in a predetermined color is installed and the bolt is tightened, and the bent portion is bent in a manner in which the one side is presented; a determination unit, which determines whether each bolt is properly installed based on the result of the detection performed by the detection unit; and an output unit, which outputs the result determined by the determination unit.

Description

Technical Field

[0001] The present invention generally relates to a technique for assisting the work of checking bolts that secure steps to chains in a passenger conveyor. Background Art

[0002] The passenger conveyor has a truss installed in a building structure and a plurality of steps connected in a ring shape and arranged in the truss to move in a circular manner. The plurality of steps are connected to a ring-shaped chain, and by rotating and driving the chain, the plurality of steps can be moved in a circular manner along a guide rail installed in the truss. Through this circular movement, the passenger conveyor transports passengers on the steps from one boarding and alighting entrance to another boarding and alighting entrance. The plurality of steps are connected to the ring-shaped chain by a plurality of bolts (hereinafter referred to as step fixing bolts). A tongue washer (hereinafter referred to as a red washer) is inserted into the step fixing bolt, and the tongue washer is painted red on only one surface and has three tongues.

[0003] In a passenger conveyor with such a structure, when performing maintenance and inspection work in the above-mentioned truss and replacing steps, the steps are removed and installed by loading and unloading the step fixing bolts. In the past, when installing the steps, the tightening state of the step fixing bolts was confirmed. After the operator tightened the step fixing bolts with a specified torque using a tightening tool, one of the three tongues of the inserted red washer was vertically bent, thereby displaying the red color painted on only one surface. The red display caused by the bending of the red washer was visually confirmed, and double confirmation was performed with the person in charge of the operation. Then, the person in charge of the operation visually confirmed the red display caused by the bending of the above-mentioned red washer in all steps while the passenger conveyor was running, and completed the confirmation work of the tightening state of the step fixing bolts by confirming the tightening state of the step fixing bolts. Whenever the person in charge of the operation performs the above-mentioned confirmation work, he enters the confirmation result into the checklist.

[0004] In recent years, a screw tightening forgetting prevention device has been disclosed for preventing forgetting to tighten a plurality of screws such as bolts tightened by a marked torque wrench (see Patent Document 1). In the screw tightening forgetting prevention device, a plurality of screw components are photographed by a photographing unit, the total area of ​​the mark obtained by binarizing the image obtained by photographing the mark attached to the head of the screw component by the photographing unit is obtained, the center of gravity position of the mark is calculated, and compared with the center of gravity of all screw components within the pre-registered photographing range, to determine whether all the screw components are tightened.

[0005] Prior art literature

[0006] Patent Document 1: Japanese Patent Application Publication No. 2004-249388 Summary of the invention

[0007] Problems to be solved by the invention

[0008] In the technology described in Patent Document 1, it is necessary to use a photographing unit to photograph the mark attached to the head of the screw member. However, due to the structure of the steps of the passenger conveyor, it is impossible to photograph the head of the step fixing bolt, so in the technology described in Patent Document 1, it is impossible to confirm the tightening state of the step fixing bolt.

[0009] The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to provide a passenger conveyor confirmation system or the like which can confirm whether bolts for fixing steps to chains in a passenger conveyor are properly installed.

[0010] Means for solving problems

[0011] In order to solve such a problem, the present invention provides a passenger conveyor confirmation system, which can confirm the tightening state of each bolt fixing each step to the chain in a passenger conveyor having a plurality of steps connected to a chain that can move in a circular motion, and is provided with: a detection unit, which detects the prescribed color for each bolt from an image obtained by photographing each bolt by a photographing terminal when a washer having a bent portion with one side colored in a prescribed color is installed and the bolt is tightened to bend the bent portion in a manner in which the one side is presented; a determination unit, which determines whether each bolt is properly installed based on the result of the detection performed by the detection unit; and an output unit, which outputs the result determined by the determination unit.

[0012] In the above structure, for example, for the bolts of the installed step, when the specified color can be detected, the result of determining that the bolts are properly installed is output, and when the specified color cannot be detected, the result of determining that the bolts are not properly installed is output. According to the above structure, for example, the person in charge of the work can accurately and easily confirm the tightening state of the bolts of the installed step.

[0013] Effects of the Invention

[0014] According to the present invention, it is possible to determine whether the bolts for fixing the steps to the chain are properly attached. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 It is a diagram showing an example of the configuration of the passenger conveyor confirmation system according to the first embodiment.

[0016] Figure 2 It is a diagram showing a schematic structure of a step according to the first embodiment.

[0017] Figure 3 This is a diagram showing an example of a connection portion of steps according to the first embodiment.

[0018] Figure 4 This is a diagram showing an example of a connection portion of steps according to the first embodiment.

[0019] Figure 5 This is a diagram showing an example of a red gasket according to the first embodiment.

[0020] Figure 6 This is a diagram showing an example of the hardware structure of the photographing terminal of the first embodiment.

[0021] Figure 7 This is a diagram showing an example of the functional structure of the imaging terminal of the first embodiment.

[0022] Figure 8 This is a diagram showing an example of the confirmation process according to the first embodiment.

[0023] Fig. 9 This is a diagram showing an example of the confirmation process according to the first embodiment.

[0024] Fig.10 This is a diagram showing an example of the guide according to the first embodiment.

[0025] Fig.11 It is a diagram showing an example of the automatic extraction method of the bolt extraction image according to the first embodiment.

[0026] Explanation of symbols

[0027] 100……passenger conveyor confirmation system, 120……photographing terminal, 303……step fixing bolt, 304……red washer. DETAILED DESCRIPTION

[0028] (I) First Embodiment

[0029] Hereinafter, an embodiment of the present invention will be described in detail, but the present invention is not limited to the embodiment.

[0030] The passenger conveyor confirmation system of this embodiment assists the confirmation operation of the tightening state of the step fixing bolts of the passenger conveyor. For example, the passenger conveyor confirmation system photographs the steps of the passenger conveyor in operation, extracts a still image of the step fixing bolts from the photographed step image, detects the red color of the bend of the red washer from the extracted still image, determines the tightening state of the step fixing bolts based on the detection result, and accumulates the still image and the determination result of the tightening state of the step fixing bolts.

[0031] According to the above configuration, the tightening state of the step fixing bolts of the passenger conveyor can be confirmed accurately and easily.

[0032] The expressions "first", "second", "third", etc. in this specification are added to identify the structural elements, and do not necessarily limit the number or order. In addition, the numbers used to identify the structural elements are used according to the context, and the numbers used in one context do not necessarily represent the same structure in other contexts. In addition, it does not prevent the structural element identified by a certain number from having the function of the structural element identified by another number.

[0033] Next, the embodiments of the present invention are described according to the accompanying drawings. The following description and drawings are examples for describing the present invention, and are appropriately omitted and simplified for the purpose of clarifying the description. The present invention can also be implemented in various other ways. Unless otherwise specified, each structural element can be single or multiple.

[0034] In the following description, the same elements are denoted by the same reference numerals in the drawings, and the description is omitted as appropriate. In addition, when describing the same elements without distinguishing them, the common part (part other than the branch number) of the reference symbol including the branch number is sometimes used, and when describing the same elements while distinguishing them, the reference symbol including the branch number is sometimes used. For example, when describing the step fixing bolts without distinguishing them in particular, they are recorded as "step fixing bolt 303", and when describing the step fixing bolts while distinguishing them, they are sometimes recorded as "step fixing bolt 303-1" and "step fixing bolt 303-2".

[0035] Figure 1 1 is a diagram showing an example of the structure of a passenger conveyor confirmation system 100. The passenger conveyor confirmation system 100 is a system that assists in the confirmation operation of the tightening state of the step fixing bolts that fix the steps of a passenger conveyor such as an escalator and a moving walkway. More specifically, the passenger conveyor confirmation system 100 is a system that automatically detects the bending of the red washer inserted together with the step fixing bolt from an image and determines whether the tightening state of the step fixing bolt is good. In the following, an escalator 101 is used as an example of a passenger conveyor for explanation.

[0036] The escalator 101 includes a truss 102 provided in a building structure (not shown), a control panel 103, a handrail 104, steps 105, a guide rail 106, a handrail 107, a drive mechanism 108, a transmission chain 109, a drive chain 110, a handrail drive device 111, a drive sprocket 112, and a driven sprocket 113. In the following description, a coordinate system is sometimes used in which the horizontal direction is the x-axis, the width direction of the step 105 is the y-axis, and the vertical direction is the z-axis.

[0037] The control panel 103, the drive mechanism 108, and the drive sprocket 112 are arranged on the upper floor side 114 of the truss 102. The driven sprocket 113 is arranged on the lower floor side 115.

[0038] The driving mechanism 108 is composed of a motor and a speed reducer. The motor is powered from the control board 103, and the operation of the motor is controlled by the control board 103. A belt member 116 is wound around the motor and the speed reducer, and the rotational force of the motor is transmitted to the speed reducer via the belt member 116.

[0039] A transmission chain 109 is wound around the speed reducer and the drive sprocket 112. The driving force of the drive mechanism 108 is transmitted to the drive sprocket 112 via the transmission chain 109, and the drive sprocket 112 rotates.

[0040] A pair of drive chains 110 are wound around the drive sprocket 112 and the driven sprocket 113. When the drive sprocket 112 rotates, the driven sprocket 113 and the drive chain 110 rotate.

[0041] Moreover, a handrail driving chain 117 is wound around the driving sprocket 112 . The handrail driving chain 117 is wound around a plurality of transmission pulleys 118 , and is also wound around the handrail driving device 111 .

[0042] A pair of guide rails 106 are arranged in the width direction of the truss 102, and the plurality of steps 105 are movably supported by the pair of guide rails 106. The plurality of steps 105 are endlessly connected via a pair of drive chains 110, and are guided by the guide rails 106 to circulate between the outgoing side and the returning side.

[0043] The handrail 104 is supported on the upper part of the truss 102 and is arranged on both sides of the width direction of the truss 102. An annular handrail 107 is installed on the handrail 104. The handrail 107 is movably supported on the handrail 104, and is cyclically moved in synchronization with the plurality of steps 105 in the same direction by the handrail driving device 111. Thus, in the escalator 101, passengers holding the handrail 107 while riding on the steps 105 can be safely transported.

[0044] In addition, the escalator 101 has a landing board 119. The landing board 119 is provided at the landing entrance from the inside of the building toward the stairs 105. The landing board 119 is a cover of the upper floor side 114 (the machine room located in the floor surface) and is a passage for passengers. Figure 1 , an example is shown in which the boarding plate 119 is removed in order to perform the removal and installation work of the steps 105.

[0045] The passenger conveyor confirmation system 100 has a photographing terminal 120. The photographing terminal 120 is set on a fixing fixture 121 during the confirmation operation, and the fixing fixture 121 is set to face the step fixing bolts of the step 105 at a certain distance. In addition, the photographing terminal 120 can also be always installed on the fixing fixture 121. That is, the photographing terminal 120 can be set to a movable type that the operator or the person in charge of the operation carries whenever the operation is confirmed, or it can be set to a permanent type fixed to the truss 102. In addition, instead of the fixing fixture 121, a mark can be set at a position that can be set to face the step fixing bolts of the step 105 at a certain distance. In addition, the installation place of the photographing terminal 120 is any place where the step fixing bolts of the step 105 can be photographed, and is not limited to the inside of the machine room. In addition, the fixing fixture 121 can also be a tripod-like stand.

[0046] Next, the structure of the step 105 will be described in detail.

[0047] Figure 2 1 is a diagram showing a schematic structure of the stair 105. The stair 105 has a frame 201 as a framework and a step 202 for passengers to stand on. The step 202 is fixed to the upper part of the frame 201. Boundary lines 203 colored in yellow or the like are provided at the front, rear, left, and right ends of the step 202. The boundary lines 203 guide passengers to stand near the center of the stair 105. The pattern of the boundary lines 203 is not limited to Figure 2 For example, the boundary line 203 behind the pedal 202 (on the kick plate side) may not be provided, and the boundary line 203 before and after the pedal 202 may not be provided.

[0048] Figure 3 and Figure 4 1 is a diagram showing an example of a connection portion of the step 105. Figure 3 and Figure 4 As shown, the step 105 is fastened to a collar 302 rotatably fitted around both ends of a front axle 301 connected to a drive chain 110 via a hole (not shown) provided in the frame 201 by a plurality of step fixing bolts 303 (e.g., a first step fixing bolt 303-1 and a second step fixing bolt 303-2). A red washer 304 is inserted between the step fixing bolt 303 and the frame 201.

[0049] Next, the red gasket 304 will be described in detail.

[0050] Figure 5: is a diagram showing an example of a red washer 304. The first pattern 510 shows the red washer 304 before the step fixing bolt 303 is tightened. In the first pattern 510, the three tongues of the red washer 304 are parallel to the x-direction and the y-direction (horizontal), and the surface is metallic. In contrast, the second pattern 520 shows the red washer 304 after the step fixing bolt 303 is tightened. The operator bends one of the three tongues of the red washer 304 in a direction parallel to the z-direction (vertical), thereby displaying the red color 521 painted on the back of the red washer 304. In addition, the bent tongue is preferably the tongue that is easiest for the operator to visually confirm.

[0051] Here, the washers inserted into the step fixing bolts 303 and the frame 201 are not limited to the red washers 304. For example, the back of the washers may be a predetermined color (for example, green, etc., a color not found in the structural components of the step 105). In addition, for example, the number of tongues (bends) of the washers is not limited to three, and may be one, or may be two or more.

[0052] The passenger conveyor confirmation system 100 detects the red color 521 of the red gasket 304 through the photographing terminal 120 to determine whether the fastening state is good. Figure 6 as well as Figure 7 The structure of the photographing terminal 120 is described.

[0053] Figure 6 1 is a diagram showing an example of the hardware configuration of the photographing terminal 120. Figure 6 As shown, the passenger conveyor confirmation system 100 includes an imaging terminal 120 and a storage device 610. The imaging terminal 120 and the storage device 610 are connected via a network 620 so as to be communicable.

[0054] The photographing terminal 120 may be a smart phone, a tablet terminal, a laptop computer, etc. having a photographing function and an information processing function, or may be implemented by combining a photographing unit such as a digital camera or a digital video camera and an information processing unit such as a processor.

[0055] For example, the photographing terminal 120 includes a processor 601 , a main storage device 602 , an auxiliary storage device 603 , an input device 604 , an output device 605 , a communication device 606 , and a camera 607 .

[0056] The processor 601 is a device that performs calculation processing and is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an AI (Artificial Intelligence) chip, or the like.

[0057] The main storage device 602 is a device for storing programs, data, etc. The main storage device 602 is, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The ROM is an SRAM (Static Random Access Memory), an NVRAM (Non Volatile RAM), a mask ROM (Mask Read Only Memory), a PROM (Programmable ROM), etc. The RAM is a DRAM (Dynamic Random Access Memory), etc.

[0058] The auxiliary storage device 603 is a HDD (Hard Disk Drive), a flash memory (Flash Memory), an SSD (Solid State Drive), an optical storage device, etc. The optical storage device is a CD (Compact Disc), a DVD (Digital Versatile Disc), etc. The program, data, etc. stored in the auxiliary storage device 603 are read into the main storage device 602 at any time.

[0059] The input device 604 is a user interface for receiving information from the user and is, for example, a keyboard, a mouse, a card reader, a touch panel, or the like.

[0060] The output device 605 is a user interface that outputs various information (display output, sound output, print output, etc.). The output device 605 is, for example, a display device that visualizes various information, a sound output device (speaker), a printing device, etc. The display device is an LCD (Liquid Crystal Display), a graphics card, etc.

[0061] The communication device 606 is a communication interface for communicating with other devices via a communication medium. The communication device 606 is, for example, a NIC (Network Interface Card), a wireless communication module, a USB (Universal Serial Interface) module, a serial communication module, etc. The communication device 606 can also function as an input device for receiving information from other devices that can be connected in a communicative manner. In addition, the communication device 606 can also function as an output device for sending information to other devices that can be connected in a communicative manner.

[0062] The imaging device 607 includes an imaging lens, an imaging element, etc., and is a device that converts an optical image formed by the imaging lens into an electrical signal through the imaging element. The imaging device 607 is composed of a CCD (Charge Coupled Device) sensor, a CMOS (Complementary Metal Oxide Semiconductor) sensor, etc.

[0063] The storage device 610 is a HDD, SSD, etc. that stores data. In addition, the storage device 610 may be included in the imaging terminal 120, may be connected to the imaging terminal 120 without passing through the network 620, or may not be provided.

[0064] Figure 7 1 is a diagram showing an example of the functional configuration of the imaging terminal 120. The imaging terminal 120 includes an imaging unit 710, a pre-processing unit 720, and a post-processing unit 730.

[0065] The imaging unit 710 performs processing related to imaging in the imaging device 607 and acquires an image 711 .

[0066] The pre-processing unit 720 includes a detection unit 721 and an area measurement unit 722. The detection unit 721 performs image processing on the image 711 to obtain a still image 723, and extracts a bolt extraction image 724 in which the step fixing bolt 303 is photographed from the still image 723. In addition, the detection unit 721 extracts (detects) the red color 521 of the red washer 304 from the extracted bolt extraction image 724. The area measurement unit 722 obtains the area of ​​the red color 521 detected by the detection unit 721 (hereinafter referred to as the red area).

[0067] The post-processing unit 730 includes a determination unit 731, an output unit 732, and a guide unit 733. The determination unit 731 determines whether the tightening state of the step fixing bolt 303 is good or not. For example, the determination unit 731 determines that the step fixing bolt 303 detected as red 521 by the detection unit 721 is properly installed (qualified), and determines that the step fixing bolt 303 not detected as red 521 by the detection unit 721 is not properly installed (unqualified). The output unit 732 outputs the result of the determination made by the determination unit 731 to the output device 605, the maintenance DB 740 of the storage device 610, etc. In addition, the output unit 732 instructs the escalator 101 (control panel 103) to cyclically move the step 105 to a position where the step fixing bolt 303 determined by the determination unit 731 as not being properly installed can be visually confirmed. The guide unit 733 guides the imaging terminal 120 at a certain distance relative to the step fixing bolt 303 , and the guide that can guide the imaging terminal 120 in a manner facing the step fixing bolt 303 is displayed on the output device 605 in an overlapping manner with the image obtained by the imaging terminal 120 .

[0068] The functions of the shooting terminal 120 (camera unit 710, pre-processing unit 720, post-processing unit 730, etc.) can be implemented, for example, by the processor 601 reading the program stored in the auxiliary storage device 603 into the main storage device 602 and executing (software), or can be implemented by hardware such as dedicated circuits, or can be implemented by combining software and hardware. In addition, one function of the shooting terminal 120 can be divided into multiple functions, and multiple functions can also be summarized into one function. In addition, part of the functions of the shooting terminal 120 can be set as other functions, or can be included in other functions. In addition, part of the functions of the shooting terminal 120 can also be implemented by other computers that can communicate with the shooting terminal 120.

[0069] The storage device 610 has a maintenance DB 740. The maintenance DB 740 stores information indicating a plan of a confirmation work (work plan information), a bolt extraction image 724 extracted by the pre-processing unit 720, a result of a quality determination by the post-processing unit 730, and the like.

[0070] Next, the confirmation process in the passenger conveyor confirmation system 100 will be described.

[0071] Figure 8 and Fig. 9 This is a diagram showing an example of confirmation processing.

[0072] In S801 , the imaging terminal 120 obtains information indicating the plan of this confirmation work (work plan information) and the red area and the result of the good / bad judgment when the confirmation work was performed last time (last performance information) from the maintenance DB 740 .

[0073] In S802, the operator is on the upper floor side 114 of the truss 102, using Fig.10 The imaging terminal 120 is fixed (installed) in a guide 1010 described later so as to be able to image the steps 105 of the escalator 101 in an operating state.

[0074] In S803, the person in charge of the work starts imaging the steps 105. At this time, the pre-processing unit 720 obtains information (the total number of steps 105, the number of the step 105 to start imaging, etc.) input by the person in charge of the work via the input device 604.

[0075] In S804, the person in charge of the work operates the escalator 101 in the maintenance mode for one cycle.

[0076] In S805, the person in charge of the work ends the imaging of the step 105. At this time, the imaging unit 710 sends the image 711 when the escalator 101 (step 105) has completed one rotation to the pre-processing unit 720.

[0077] In S806 , the pre-processing unit 720 divides the video 711 into still images 723 for each unit time.

[0078] In S807, the pre-processing unit 720 processes each of the plurality of still images 723 by using Fig.11 In the automatic extraction method described later, each bolt extraction image 724 in which the step fixing bolts 303 are photographed is extracted.

[0079] In S808, the pre-processing unit 720 detects the bending of the red washer 304. The pre-processing unit 720 extracts an image 724 from the bolt, for example, and extracts red pixels by step fixing bolt 303 using image processing techniques such as RGB detection, detects the red color 521 of the red washer 304, and calculates the red area. In addition, the pre-processing unit 720 detects the division of the step 105 using shape-based object matching, gaps (cuts) of the boundary line 203, etc., and counts the number of the step 105. The pre-processing unit 720 determines the number of the step 105, thereby being able to identify each step fixing bolt 303, and thus being able to manage the red area by step fixing bolt 303.

[0080] In addition, the pre-processing unit 720 counts the number of step fixing bolts 303 in which the bending of the red washers 304 is not detected (the number of unbent ones) based on the total number of steps 105 (i.e., the total number of step fixing bolts 303 required to fix all the steps 105) and the number of bends of the detected red washers 304, and sends the counting result to the post-processing unit 730.

[0081] In S809, the post-processing unit 730 determines whether the number of unbent pieces is "0". If the post-processing unit 730 determines that the number of unbent pieces is "0", the process proceeds to S810, and if the post-processing unit 730 determines that the number of unbent pieces is not "0", the process proceeds to S812.

[0082] In S810, the post-processing unit 730 performs additional confirmation processing. In the additional confirmation processing, the fastening states of all step fixing bolts 303 are judged to be good or bad based on the work plan information, the last implementation information, and the current implementation information, and a good or bad judgment result indicating the result of the good or bad judgment is generated.

[0083] Here, the red washer 304 rotates to a certain extent around the step fixing bolt 303 when the step fixing bolt 303 is tightened, so the bending position is not necessarily located at the same position. Therefore, the red area detected by the passenger conveyor confirmation system 100 changes. By performing additional confirmation processing based on this feature, the following two points can be achieved.

[0084] First, when there is no difference between the red area of ​​the red gasket 304 of the step 105 scheduled to be disassembled in the work plan and the red area of ​​the red gasket 304 of the step 105 stored in the maintenance DB 740, the work plan is considered not to have been implemented, and a notification to the manager, record management, etc. can be performed. In addition, record management refers to the management of the steps 105 that have been disassembled and installed, or the management of the steps 105 that were scheduled to be disassembled but not disassembled.

[0085] Second, the steps 105 that are not scheduled to be disassembled in the work plan are also compared in the same way. If there is a difference in the red area, it is considered that the step fixing bolts 303 have become loose. By issuing instructions to the person in charge of the work to tighten the bolts, it is possible to prevent the step fixing bolts 303 from falling off due to loosening. For details on the additional confirmation process, use Fig. 9 This will be described later.

[0086] In S811, the post-processing unit 730 stores the red area of ​​each step fixing bolt 303 and the good / bad determination result (this time implementation information) when the confirmation process is performed in the maintenance DB 740, and ends the confirmation process.

[0087] In S812, the post-processing unit 730 instructs the control panel 103 to operate the escalator 101 in the maintenance mode so that the step fixing bolts 303 (steps 105) that are not detected to be bent stop at a position that can be visually confirmed (for example, a photographing position). In addition, the post-processing unit 730 may be replaced by an instruction from the operation supervisor, thereby operating the escalator 101 so that the step fixing bolts 303 that are not detected to be bent stop at a position that can be visually confirmed.

[0088] In addition, in S812, when the red color 521 (bend) cannot be detected, the post-processing unit 730 may display the result that the step fixing bolt 303 is not properly installed on the output device 605. In addition, in S810, when the red color 521 can be detected, the post-processing unit 730 may display the result that the step fixing bolt 303 is properly installed on the output device 605.

[0089] In S813, the person in charge of the work confirms the tightening state of the step fixing bolt 303, and takes measures such as inserting the red washer 304 or bending the red washer 304 as needed.

[0090] In this way, the person in charge of the operation visually confirms the step fixing bolts 303 of the unqualified step 105 based on the result of the good or bad judgment of the post-processing unit 730, and performs tightening operations according to different situations, thereby avoiding forgetting to tighten the step fixing bolts 303.

[0091] This embodiment is not limited to the above-mentioned processing. For example, in S808, by outputting the result of the good or bad judgment to the checklist, the preparation of the work completion report can be made more efficient. In addition, in S808, the post-processing unit 730 can also store the bolt extraction image 724 in the maintenance DB 740. In this case, the manager can perform history management by confirming all the multiple bolt extraction images 724 stored in the maintenance DB 740 and the results of the good or bad judgment.

[0092] Fig. 9 1 is a diagram showing an example of the additional confirmation process. In the additional confirmation process, one unprocessed step 105 among all the steps 105 is selected as a processing target, and the processes of S901 to S910 are performed on each step 105 .

[0093] In S901, the post-processing unit 730 determines whether the step 105 to be processed is the step 105 of the work plan (planned object) based on the work plan information. If the step 105 to be processed is determined to be the step 105 of the planned object, the post-processing unit 730 transfers the processing to S902, and if the step 105 to be processed is determined not to be the step 105 of the planned object, the post-processing unit 730 transfers the processing to S906.

[0094] In S902 , the post-processing unit 730 uses the previous implementation information and the current implementation information to obtain the difference between the current red area and the previous red area for the red washer 304 of the step 105 to be processed.

[0095] In S903, the post-processing unit 730 determines whether the difference is "0". If the post-processing unit 730 determines that the difference is "0" (determined that the device has not been disassembled), the process moves to S904, and if the difference is not "0" (determined that the device has been disassembled), the process moves to S905.

[0096] In S904, the post-processing unit 730 generates a good or bad judgment result indicating that the work plan has not been implemented, and notifies the manager that the work plan has not been implemented for the step 105 of the processing object. In addition, the post-processing unit 730 can also display the fact that the work plan has not been implemented for the step 105 of the processing object on the output device 605 (notify the person in charge of the work).

[0097] In S905 , the post-processing unit 730 generates a good / bad result indicating that the work plan has been executed.

[0098] In S906 , the post-processing unit 730 uses the previous implementation information and the current implementation information to obtain the difference between the current red area and the previous red area for the red washer 304 of the step 105 to be processed.

[0099] In S907, the post-processing unit 730 determines whether the difference is "0". If the post-processing unit 730 determines that the difference is "0" (determined that the step fixing bolt 303 is not loose), the processing is transferred to S908, and if the difference is determined not to be "0" (determined that the step fixing bolt 303 is loose), the processing is transferred to S909.

[0100] In S908, the post-processing unit 730 generates a good / bad determination result indicating that the step fixing bolts 303 of the step 105 to be processed are not loose.

[0101] In S909, the post-processing unit 730 generates a good / bad determination result indicating that the step fixing bolts 303 of the step 105 to be processed are loose.

[0102] In S910, the post-processing unit 730 displays the need to tighten the step fixing bolts 303 of the step 105 to be processed on the output device 605 (notifies the person in charge of the work). The person in charge of the work tightens the step fixing bolts 303 of the step 105 to be processed based on the notification.

[0103] In addition, the post-processing unit 730 may also compare the bolt extraction image 724 of the step fixing bolt 303 extracted in the current confirmation process with the bolt extraction image 724 of the step fixing bolt 303 stored in the maintenance DB 740, thereby determining that the work plan has not been implemented and / or the step fixing bolt 303 is loose. In addition, the post-processing unit 730 may perform S902 to S905 without performing S901. That is, the post-processing unit 730 may also calculate the difference between the red area of ​​the current time and the red area of ​​the previous time for the red washer 304 of the step 105 to be processed without determining whether the step 105 to be processed is the step 105 to be planned, and determine whether the step 105 has been installed or removed based on the calculated difference.

[0104] Fig.10 1 is a diagram showing an example of a guide (a guide 1010) displayed on the output device 605 of the imaging terminal 120. The guide 1010 is composed of a vertical guide 1010-1 and a horizontal guide 1010-2 that cross each other.

[0105] The person in charge of the work can photograph the intersection of the vertical guide 1010-1 and the horizontal guide 1010-2 displayed on the output device 605 and the bolt image 1020 representing the step fixing bolt 303 as the object in an overlapping manner, thereby photographing the object directly facing and parallel to the object at a certain distance.

[0106] The structure of the guide member 1010 is not limited to Fig.10 The example shown may be composed of a rectangle, a circle, or a plurality of points.

[0107] In addition, as described above, inside the upper floor side 114, the fixing clamp 121 can also be fixed to the truss 102 using, for example, a clamp not shown in the figure, and each time a confirmation operation is performed, the shooting terminal 120 is fixed to the fixing clamp 121. As a result, the object is always photographed directly at a certain distance and in parallel. The fixing clamp 121 and the shooting terminal 120 can also be permanently installed.

[0108] Fig.11 1 is a diagram showing an example of an automatic extraction method of a bolt extraction image 724 in which the step fixing bolt 303 is captured. Fig.11An example of the escalator 101 being operated upward is shown. In the still images 723-1 to 723-4 arranged in time series, the step image 1110 representing the step 105 to be processed and the step image 1120 representing the step 105 before the step 105 to be processed gradually move in the opposite direction (downward) of the z direction. In addition, the rectangular area in the center of the still image 723 and longer in the y direction is set as the detection area 1130 for detecting the boundary line 203 (boundary line image 1170).

[0109] In the still images 723-1 and 723-2, a portion or all of the bolt image 1140 representing the step fixing bolt 303 provided on the step 105 to be processed and the washer image 1150 representing the red washer 304 provided on the step 105 to be processed are blocked by the step image 1120 representing the previous step 105. Therefore, the photographing terminal 120 cannot detect all of them. In the still image 723-3, the photographing terminal 120 can fully detect the bolt image 1140 and the washer image 1150, but in the still image 723-4, they are blocked again by the step image 1110, so they cannot detect all of them.

[0110] Therefore, the photographing terminal 120 needs to extract the bolt extraction image 724 that captures the step fixing bolt 303 from the still image 723-3. Here, the location where the step fixing bolt 303 is installed must be between the step 105 to be processed and the previous step 105. Therefore, in the detection area 1130, by extracting an image in which both the boundary line image 1160 representing the boundary line 203 of the step 105 to be processed and the boundary line image 1170 representing the boundary line 203 of the previous step 105 are undetectable, the bolt extraction image 724 can be automatically extracted.

[0111] The boundary line 203 can be detected using, for example, color extraction such as RGB detection or shape-based object matching.

[0112] In the automatic extraction method of the bolt extraction image 724 in which the step fixing bolts 303 are photographed, an example is shown in which the escalator 101 is operated to ascend and the left and right step fixing bolts 303 are photographed at one time, but the example is not limited thereto. The escalator 101 may be operated to descend to be photographed, or one of the left and right step fixing bolts 303 may be photographed. In addition, the escalator 101 may be photographed in two modes, namely, the ascending operation and the descending operation. In this case, the photographing terminal 120 compares the images obtained by these photographing, thereby eliminating the interference caused by lighting, etc., and further improving the determination accuracy. In addition, in order to improve the determination accuracy, a guide may be displayed in the output device 605, and the guide guides the photographing terminal 120 in a manner of photographing in parallel at a certain distance from the object when the photographing terminal 120 is photographing. In addition, similarly, for the still image 723 extracted after shooting, for example, shape correction based on techniques such as trapezoidal correction, angle correction to make it parallel, and shading correction to make the brightness in the image uniform by referring to the brightness of multiple points from the initial image may be used. In addition, in this embodiment, an example on the upper floor side 114 is shown, but it can also be implemented on the lower floor side 115.

[0113] The present invention is not limited to the above-mentioned contents, and materials, shapes, structures, etc. can be appropriately selected, combined, or changed as appropriate within the scope of the gist of the invention.

[0114] (II) Notes

[0115] The above-mentioned embodiments include, for example, the following contents.

[0116] In the above-mentioned embodiment, the case where the present invention is applied to the passenger conveyor confirmation system is described, but the present invention is not limited to this and can be widely applied to various other systems, devices, methods, and programs.

[0117] In the above embodiment, when the number of unbent parts is determined to be "0" (Yes) in S809, S810 (additional confirmation processing) is performed, but the present invention is not limited thereto. For example, S810 (additional confirmation processing) may not be performed.

[0118] In addition, in the above-mentioned embodiment, the post-processing unit 730 notifies the manager in S904 that the work plan has not been implemented for the step 105 to be processed, but the present invention is not limited to this. For example, the post-processing unit 730 may instruct the control panel 103 to operate the escalator 101 in the maintenance mode instead of or in addition to the above-mentioned notification, so that the step 105 for which the work plan has not been implemented stops at a position that can be visually confirmed (for example, a photographing position).

[0119] In addition, in the above-mentioned embodiment, the post-processing unit 730 displays the tightening of the step fixing bolt 303 of the step 105 to be processed on the output device 605 (notifies the person in charge of the operation) in S910, but the present invention is not limited to this. For example, the post-processing unit 730 may also instruct the control panel 103 to operate the escalator 101 in the maintenance mode instead of or on the basis of the above-mentioned notification, so that the step 105 that needs to be tightened stops at a position that can be visually confirmed (for example, a photographing position).

[0120] In addition, in the above-mentioned embodiment, the photographing terminal 120 may also include a lighting device, and photograph the object by irradiating light through the lighting device.

[0121] In addition, in the above-mentioned embodiment, the output of information is not limited to display on a display. The output of information can be sound output based on a speaker, output to a file, printing on a paper medium through a printing device, projection on a screen through a projector, or other methods.

[0122] In the above description, information such as programs, tables, and files that implement various functions can be placed in storage devices such as memories, hard disks, SSDs (Solid State Drives), or recording media such as IC cards, SD cards, and DVDs.

[0123] The above-described embodiment has, for example, the following characteristic structures. (1)

[0125] In a passenger conveyor (e.g., escalator 101, moving walkway, passenger conveyor) having a plurality of steps (e.g., step 105) that can be connected to a chain (e.g., drive chain 110) that moves in a circular motion, a passenger conveyor confirmation system (e.g., passenger conveyor confirmation system 100) that can confirm the tightening state of each bolt (e.g., step fixing bolt 303) that fixes each step to the above-mentioned chain includes: a detection unit (e.g., detection unit 721, imaging terminal 120, computer connected to imaging terminal 120 so as to be communicable), which is installed with a washer (e.g., red washer 304) having a bent portion (e.g., tongue) with one side (e.g., back side) colored in a predetermined color (e.g., red 521) and tightening the bolts, and in the case of the operation of bending the above-mentioned bent portion in a manner in which the above-mentioned one side is presented, the above-mentioned specified color is detected for each of the above-mentioned bolts from an image (e.g., image 711, still image 723, bolt extraction image 724) obtained by photographing the above-mentioned bolts by a photographing terminal (e.g., photographing terminal 120); a determination unit (e.g., determination unit 731, photographing terminal 120, a computer connected to photographing terminal 120 in a communicative manner), which determines whether each of the above-mentioned bolts is properly installed based on the result of the detection performed by the above-mentioned detection unit; and an output unit (e.g., output unit 732, photographing terminal 120, a computer connected to photographing terminal 120 in a communicative manner), which outputs the result determined by the above-mentioned determination unit.

[0126] In the above structure, for example, regarding the bolts of the installed step, when the specified color can be detected, the result of determining that the bolts are properly installed is output, and when the specified color cannot be detected, the result of determining that the bolts are not properly installed is output. According to the above structure, for example, the person in charge of the work can accurately and easily confirm the tightening state of the bolts of the installed step. (2)

[0128] The above-mentioned passenger conveyor confirmation system has: a guide unit (for example, a guide unit 733, a photographing terminal 120, and a computer communicatively connected to the photographing terminal 120), which guides the above-mentioned photographing terminal at a certain distance relative to the bolt, and a guide member (for example, a guide member 1010) that can guide the above-mentioned photographing terminal in a manner directly opposite to the above-mentioned bolt is displayed on a display device (for example, an output device 605) in an overlapping manner with the image obtained by the above-mentioned photographing terminal.

[0129] According to the above structure, the guide for guiding in a manner facing the bolt at a certain distance is displayed overlapping the image obtained by the imaging terminal. Therefore, for example, the person in charge of the work can easily and appropriately set the imaging terminal by making the guide consistent with the bolt image in the image. (3)

[0131] A boundary line (e.g., boundary line 203) is provided on the pedal of the step, and when the boundary line of the step is not displayed within a predetermined range in the image obtained by the photographing terminal when the steps cyclically move, the detection unit detects the next step of the step (e.g., reference step 204). Fig.11 ).

[0132] In the above configuration, the next step can be detected when the boundary line provided on the step board is interrupted, so that, for example, the bolt can be easily detected and the predetermined color can be detected. (4)

[0134] The passenger conveyor confirmation system comprises: an area measuring unit (e.g., area measuring unit 722, photographing terminal 120, a computer communicatively connected to photographing terminal 120), which calculates the area of ​​the specified color (e.g., red area) detected by the detection unit for each of the bolts, and stores the calculated area in a storage device (e.g., maintenance DB 740, storage device 610, auxiliary storage device 603), and the determination unit determines whether the bolt is loose based on the area calculated this time by the area measuring unit for the bolts of the steps that are not planned to be installed and removed, and the area calculated last time by the area measuring unit for the bolts (e.g., refer to S906 and S907).

[0135] In the above structure, the detected area of ​​the specified color is stored, and based on the current area and the previous area, it is determined whether the bolts of the steps that are not planned to be installed or removed are loose. According to the above structure, for example, the person in charge of the work can understand whether the bolts of the steps that are not planned to be installed or removed are loose. (5)

[0137] The above-mentioned passenger conveyor confirmation system has: an area measuring unit (for example, the area measuring unit 722, the imaging terminal 120, and a computer communicatively connected to the imaging terminal 120), which calculates the area of ​​the above-mentioned specified color (for example, the red area) detected by the above-mentioned detection unit for each of the above-mentioned bolts, and stores the calculated area in a storage device (for example, maintenance DB740, storage device 610, auxiliary storage device 603), and the above-mentioned determination unit determines whether the above-mentioned step has been installed and removed based on the area of ​​the bolt of the step calculated this time by the above-mentioned area measuring unit and the area of ​​the bolt calculated last time by the above-mentioned area measuring unit (for example, refer to S902 and S903).

[0138] In the above structure, the detected area of ​​the specified color is stored, and whether the planned installation and removal of the steps is installed or removed is determined based on the current area and the previous area. According to the above structure, for example, the manager can understand that the planned installation and removal of the steps has not been carried out. (6)

[0140] In the above configuration, the predetermined color is red, which is not a color in the components of the passenger conveyor. Therefore, for example, the predetermined color can be detected more accurately by the detection unit, and the accuracy of the determination by the determination unit can be improved. (7)

[0142] In a passenger conveyor (e.g., escalator 101, moving walkway, passenger conveyor) having a plurality of steps (e.g., step 105) connected to a chain (e.g., drive chain 110) that can move in a circular motion, a passenger conveyor confirmation method for confirming the tightening state of each bolt (e.g., step fixing bolt 303) that fixes each step to the above-mentioned chain comprises: installing a washer (e.g., red washer 304) having a bending portion (e.g., tongue) with one side (e.g., back side) colored in a prescribed color (e.g., red 521) and tightening the bolt, bending the above-mentioned one side in a manner that the above-mentioned one side is presented. In the operation of the bending portion, the detection unit detects the above-mentioned specified color for each of the above-mentioned bolts from the images (for example, image 711, still image 723, bolt extraction image 724) obtained by photographing the above-mentioned bolts by a photographing terminal (for example, photographing terminal 120) (for example, S808); the judgment unit determines whether each of the above-mentioned bolts is properly installed based on the result of the detection performed by the above-mentioned detection unit (for example, refer to S809); and the output unit instructs the above-mentioned passenger conveyor to move the above-mentioned multiple steps in a circular manner to a position where the bolts determined by the above-mentioned judgment unit as not properly installed can be visually confirmed (for example, refer to S812).

[0143] In the above configuration, the steps are cyclically moved so that the improperly installed bolts can be visually confirmed. Therefore, for example, a person in charge of the work can easily recognize the improperly installed bolts.

[0144] In addition, the above-mentioned structures may be appropriately changed, reorganized, combined or omitted without departing from the spirit of the present invention.

[0145] It should be understood that the items included in the list in the form of "at least one of A, B, and C" can mean (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C). Similarly, the items listed in the form of "at least one of A, B, or C" can mean (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C).

Claims

1. A passenger conveyor confirmation system, which can confirm the tightening state of each bolt fixing each step to the chain in a passenger conveyor having a plurality of steps connected to a chain that can move cyclically, characterized in that: The passenger conveyor confirmation system has: a detection unit that detects the prescribed color for each bolt from an image of each bolt captured by a photographing terminal when a washer having a bent portion with one side colored in a prescribed color is installed and a bolt is tightened to bend the bent portion in a manner in which the one side is presented; a determination unit that determines whether each of the bolts is properly installed based on a result of detection performed by the detection unit; as well as An output unit outputs a result determined by the determination unit.

2. The passenger conveyor confirmation system according to claim 1, characterized in that The passenger conveyor confirmation system includes a guide unit that guides the imaging terminal at a certain distance relative to the bolt, and a guide that can guide the imaging terminal in a manner that faces the bolt and an image obtained by the imaging terminal are displayed on a display device in an overlapping manner.

3. The passenger conveyor confirmation system according to claim 1, characterized in that: Setting boundary lines on the treads of the steps, In the image acquired by the imaging terminal when the steps move cyclically, when the boundary line of the steps is not displayed within a predetermined range, the detection unit detects the next step of the steps.

4. The passenger conveyor confirmation system according to claim 1, characterized in that: The passenger conveyor confirmation system comprises: an area measuring unit for obtaining the area of ​​the predetermined color detected by the detection unit for each of the bolts, and storing the obtained area in a storage device; The determination unit determines whether the bolt is loose based on the area currently obtained by the area measurement unit for the bolt of the step that is not planned to be attached or detached and the area previously obtained by the area measurement unit for the bolt.

5. The passenger conveyor confirmation system according to claim 1, characterized in that The passenger conveyor confirmation system comprises: an area measuring unit for obtaining the area of ​​the predetermined color detected by the detection unit for each of the bolts, and storing the obtained area in a storage device; The determination unit determines whether the step is mounted or removed based on the area of ​​the bolt of the step obtained this time by the area measurement unit and the area of ​​the bolt obtained last time by the area measurement unit.

6. The passenger conveyor confirmation system according to claim 1, characterized in that The prescribed color is red.

7. A passenger conveyor confirmation method for confirming the tightening state of each bolt fixing each step to the chain in a passenger conveyor having a plurality of steps connected to a chain that can move cyclically, characterized in that: The passenger conveyor confirmation method comprises: By installing a washer having a bent portion with one side colored in a predetermined color and tightening a bolt, the bent portion is bent in a manner in which the one side is presented, and the detection unit detects the predetermined color for each bolt from an image of each bolt captured by a photographing terminal; The determination unit determines whether the bolts are properly installed based on the detection result of the detection unit; as well as The output unit instructs the passenger conveyor to cyclically move the plurality of steps to a position where the bolts determined by the determination unit to be improperly installed can be visually confirmed.

Images