Passenger conveyor inspection device and passenger conveyor inspection method

Abstract

Provided is a passenger conveyor inspection device capable of inspecting the fastening state of a fixing member in various environments. A passenger conveyor inspection device inspects the fastening state of a fixing member colored in a prescribed color used to fasten a plurality of steps to a chain that moves in a loop and to which the plurality of steps can be coupled, the passenger conveyor inspection device being provided with: a calculation section that calculates a threshold value for detecting the fixing member based on an image of a calibration member obtained by a photographing device photographing the calibration member provided in the vicinity of the fixing member; and a determination section that determines the fastening state of the fixing member with respect to an image of the fixing member obtained by the photographing device photographing the fixing member based on the threshold value calculated by the calculation section.

Description

TECHNICAL FIELD

[0001] The present application relates generally to technology for inspecting a passenger conveyor. BACKGROUND

[0002] A passenger conveyor is a device for transporting people in a building, and is a device that is necessary in urban spaces. In a passenger conveyor, steps for people to ride on are fixed to a chain formed in a ring shape by several fixtures. Also, the chain is engaged with a gear-like member called a sprocket, and the sprocket is rotated, thereby driving the steps of the passenger conveyor.

[0003] In a passenger conveyor having such a driving mechanism, the steps are the part that comes into contact with passengers, and inspection is periodically performed in order to maintain a normal state. With respect to the inspection of a passenger conveyor, a device that detects abnormalities of the steps is disclosed (see Patent Document 1).

[0004] PRIOR ART DOCUMENTS

[0005] Patent Document 1: Japanese Patent Application Publication No. 2010-269884 SUMMARY

[0006] PROBLEMS TO BE SOLVED BY THE INVENTION

[0007] In periodic maintenance work, inspection of the state of the steps is performed, but it is particularly important to confirm whether the steps are properly fixed by the fixtures. The fixtures of the steps can be visually confirmed at the reversed portion of the steps, and thus, the ride plate is removed at the time of maintenance work, and the fastening state of the fixtures is confirmed at the reversed portion. There are a plurality of steps in one passenger conveyor, but the place where the fastening state of the fixtures can be confirmed by visual inspection is limited, and the number of people present at the time of the confirmation work is limited in one operation of the passenger conveyor, and thus, confirmation using a video camera is effective.

[0008] In this regard, in the technology described in Patent Document 1, in order to detect dirt, damage, or the like generated in the steps, a plurality of video cameras are provided in the passenger conveyor, and the dirt, damage, or the like of the steps is detected from the video camera images.

[0009] However, the environment in which the passenger conveyor is installed is various, and the time period in which the inspection is performed is also various. Since the ride plate is removed to perform the inspection, the amount of light, and the like, which is irradiated into the passenger conveyor, is not the same depending on the change in the surrounding environment. That is, in the inspection of the passenger conveyor, it is necessary to be able to confirm the fastening state of the fixtures in various environments, but a structure for coping with the environment at the time of inspection is not disclosed in Patent Document 1. Therefore, depending on the difference in the environment at the time of inspection, it is sometimes not possible to correctly perform determination of the fastening state of the fixtures based on the video camera.

[0010] The present application has been achieved in view of the above points, and aims to provide a passenger conveyor inspection device or the like capable of checking the fastening state of a fixing member in various environments.

[0011] Means for solving the problem

[0012] To solve such a problem, in the present application, a passenger conveyor inspection device is provided which checks the fastening state of a fixing member colored in a prescribed color used to fix a plurality of steps to a chain that circulates, in a passenger conveyor having the chain and the plurality of steps that can be linked to the chain, the passenger conveyor inspection device being provided with: a calculation section that calculates a threshold value for detecting the fixing member based on an image of a calibration member provided in the vicinity of the fixing member and obtained by a photographing device photographing the calibration member; and a determination section that determines the fastening state of the fixing member based on the image of the fixing member obtained by the photographing device photographing the fixing member, according to the threshold value calculated by the calculation section.

[0013] In the above structure, for example, calibration for detecting the fixing member is performed based on the image of the calibration member provided in the vicinity of the fixing member. According to the above structure, even in cases where the environment in which the passenger conveyor is provided is different, the determination of the fastening state of the fixing member can be performed with high precision.

[0014] Effects of the Invention

[0015] According to the present application, a passenger conveyor inspection system with high reliability can be realized. BRIEF DESCRIPTION OF DRAWINGS

[0016] Figure 1 is a diagram showing an example of the structure of a passenger conveyor inspection system of the first embodiment.

[0017] Figure 2 is a diagram showing the schematic structure of a step of the first embodiment.

[0018] Figure 3 is a diagram showing an example of a red washer of the first embodiment.

[0019] Figure 4 is a diagram showing an example of the hardware structure of a passenger conveyor inspection device of the first embodiment.

[0020] Figure 5 is a diagram showing an example of the functional structure of a passenger conveyor inspection device of the first embodiment.

[0021] Figure 6 is a diagram showing an example of an inspection process of the first embodiment.

[0022] Figure 7 is a diagram showing an example of an image of the first embodiment.

[0023] Figure 8 is a diagram showing an example of detection result data of the first embodiment.

[0024] Figure 9 is a diagram showing an example of inspection result data of the first embodiment.

[0025] Figure 10 is a diagram showing an example of an image of the second embodiment.

[0026] Explanation of Reference Numerals

[0027] 130 … calibration sheet, 140 … passenger conveyor inspection device, 220 … fixing member, 503 … calculation section, 505 … determination section. DETAILED DESCRIPTION

[0028] (I) First Embodiment

[0029] Hereinafter, an embodiment of the present application will be described in detail. However, the present application is not limited to the embodiment. In the present embodiment, a passenger conveyor inspection system that inspects a passenger conveyor having steps driven by a driving mechanism formed in a ring shape and an opening portion that can be opened and closed near an end portion of the ring of the ring-shaped steps at the time of maintenance work is described as an example.

[0030] Generally, in a passenger conveyor inspection system having a plurality of cameras in a passenger conveyor, although it is possible to always detect abnormalities of the steps, the passenger conveyor has a camera, and therefore, it is necessary to consider the influence on the inspection due to dust and the like that can be generated over the years. In addition, in the case where a stain, a breakage, and the like of a size that can be captured by the camera are detected, as a countermeasure, it is necessary to stop the passenger conveyor to perform maintenance work. The passenger conveyor is a device for transporting people in a building, and therefore, the maintenance work is implemented on a planned basis according to the utilization status, and therefore, it is desirable to maintain the steps in a normal state in the maintenance work planned on a regular basis. In addition, in order not to cause inconvenience to the users, it is necessary to reliably implement the confirmation work in a short work time.

[0031] In this regard, the present passenger conveyor inspection system has a photographing device that photographs an image (still image, video, and the like) at the time of maintenance work of the passenger conveyor and a calibration member for detecting a fixing member for fastening the driving mechanism and the steps of the passenger conveyor and coloring in a prescribed color. In the present passenger conveyor inspection system, the calibration member is provided at a position of the passenger conveyor near the fixing member, and in the photographing device, the fixing member and the calibration member in the opening portion are photographed as an image in the same angle of view.

[0032] The calibration member has at least one color mark of a color that is the same as the color of the fixing member, and a color mark of a color that is the complement of the color of the fixing member. Here, as the complement, for example, a hue that is 180° apart on a color wheel that shows the hue in the HSV color space that represents colors using a combination of three values of hue, saturation, and value can be used. Further, the calibration member can also have a luminance mark of a color that has the same luminance as the color of the fixing member instead of the color mark.

[0033] Next, embodiments of the present application will be described with reference to the drawings. The following description and drawings are examples for illustrating the present application, and are appropriately omitted and simplified for the sake of clarity of the description. The present application can also be implemented in other various ways. Each structural element can be singular or plural unless specifically limited.

[0034] Further, in the following description, the same reference numerals are attached to the same elements in the drawings, and the description is appropriately omitted. In addition, in the case where the same elements are described without distinguishing them, the common part of the reference numerals including the branch number (part other than the branch number) is sometimes used, and in the case where the same elements are described while distinguishing them, the reference numerals including the branch number are sometimes used. For example, in the case where the description is made without specifically distinguishing the reference numerals, it is sometimes described as "reference numeral 131", and in the case where the description is made while distinguishing the reference numerals, it is sometimes described as "reference numeral 131-1", "reference numeral 131-2".

[0035] In addition, the expressions "first", "second", "third", and the like in the present specification and the like are attached for the purpose of identifying structural elements, and are not necessarily limited in number or order. In addition, the numbers used for identifying structural elements are used in context, and the number used in one context does not necessarily indicate the same structure in other contexts. In addition, it is also not hindered that the structural element identified by a certain number has the function of the structural element identified by another number.

[0036] Figure 1 is a drawing that shows an example of the structure of a passenger conveyor inspection system 100. The passenger conveyor inspection system 100 is a system that assists in the inspection of the fastening state of a fixing member that fixes a step of a passenger conveyor such as an escalator, moving walk, or the like. For example, the passenger conveyor inspection system 100 is a system that automatically detects a colored washer that is inserted together with a step fixing bolt, and performs the good or bad determination of the fastening state of the step fixing bolt. Hereinafter, the description will be made using Figures 1-3 , taking an escalator 101 as an example of a passenger conveyor.

[0037] The escalator 101 has a frame 102 of an omitted building structure, a control panel 103, a railing portion 104, steps 105, rails 106, handrails 107, a drive mechanism 108, a transmission chain 109, a drive chain 110, a handrail drive device 111, a drive sprocket 112, and a driven sprocket 113 provided. Further, in Figure 1 and Figure 2 a coordinate system is sometimes used in which the short side direction (boarding direction) of the steps 105 is the X axis, the long side direction (width direction) of the steps 105 is the Y axis, and the height direction (vertical direction) of the steps 105 is the Z axis.

[0038] The control panel 103, the drive mechanism 108, and the drive sprocket 112 are provided on the upper floor side 114 of the frame 102. The driven sprocket 113 is provided on the lower floor side 115.

[0039] The drive mechanism 108 is configured to include a motor and a speed reducer. The motor is supplied with electric power from the control panel 103, and the operation of the motor is controlled by the control panel 103. A belt member 116 is wound around the motor and the speed reducer, and the rotational force of the motor is transmitted to the speed reducer via the belt member 116.

[0040] The transmission chain 109 is wound around the speed reducer and the drive sprocket 112. The driving force of the drive mechanism 108 is transmitted to the drive sprocket 112 via the transmission chain 109, and the drive sprocket 112 rotates.

[0041] One pair of drive chains 110 is wound around the drive sprocket 112 and the driven sprocket 113. The drive sprocket 112 rotates, whereby the driven sprocket 113 and the drive chains 110 rotate.

[0042] In addition, a handrail drive chain 117 is wound around the drive sprocket 112. The handrail drive chain 117 is wound around a plurality of transmission pulleys 118 and the handrail drive device 111.

[0043] One pair of rails 106 is provided in the width direction of the frame 102, and a plurality of steps 105 are movably supported by the one pair of rails 106. In addition, the plurality of steps 105 are connected in a loop shape via the one pair of drive chains 110 and are guided by the rails 106 to move in a loop shape on the outbound side and the inbound side.

[0044] The railing portion 104 is supported by the upper portion of the frame 102 and is provided on both sides in the width direction of the frame 102. The endless handrails 107 are installed in the railing portion 104. The handrails 107 are movably supported by the railing portion 104 and are moved in a loop shape in the same direction as the plurality of steps 105 by the handrail drive device 111. Thus, in the escalator 101, passengers who ride on the steps 105 and hold the handrails 107 can be safely transported.

[0045] In addition, the escalator 101 has a landing plate, which is not illustrated. The landing plate is provided to face the steps 105 from the inside of the building at the opening portion 119. The landing plate is a substantially rectangular plate, is a cover of the upper floor side 114 (a machine room located in the ground), and becomes a passage for passengers. However, in the present embodiment, an example in which the landing plate is detached for the work of detaching and installing the steps 105 is shown. Figure 1

[0046] At the opening portion 119, a calibration sheet 130 is provided in the step 105 side of the edge portion 120-1 of the frame 102 (a cross-sectional portion of the opening portion 119) along the Y-axis direction. The calibration sheet 130 is provided to the opening portion 119, a structural member near the opening portion 119, or the like, for example, is provided to a place where the steps 105 and the fixing member 220 can be photographed together.

[0047] One or more marks 131 are provided on the calibration sheet 130. More specifically, the calibration sheet 130 has three circular marks 131 provided on a rectangular main body (a sheet-shaped member). The central mark 131-1 of the three marks 131 is colored in the same color as the fixing member 220. The one-end mark 131-2 and the other-end mark 131-3 are colored in a color different from the color of the fixing member 220 (in the present embodiment, a complementary color is exemplified as the different color). Hereinafter, the mark 131-1 is sometimes referred to as a "same-color mark", and the marks 131-2 and 131-3 are sometimes referred to as "complementary-color marks". In addition, the color of the sheet-shaped member is white, black, or the like.

[0048] In addition, the shape of the calibration sheet 130 is not limited to a rectangle, and can be another shape. In addition, the shape of the marks 131 is not limited to a circle, and can be another shape. In addition, the shapes of the same-color mark and the complementary-color marks can be the same shape, or can be different shapes. In addition, the calibration sheet 130 can be a structure in which the installation and detachment are checked each time, or can be a structure in which the installation is performed only once at the beginning. Even in the latter structure, the opening portion 119 is closed by the landing plate in the ordinary time, and thus the calibration sheet 130 is not seen by the passengers. In addition, a structure in which the calibration sheet 130 is provided to the edge portion 120-1 is shown, but is not limited to this structure. The calibration sheet 130 can be provided to another place of the escalator 101 near the fixing member 220.

[0049] ​The passenger conveyor inspection system 100 has a passenger conveyor inspection device 140. The passenger conveyor inspection device 140 is disposed in the fixed jig 141 so as to face the step 105 (the fixing member 220) at a certain distance at the time of inspection. In addition, the passenger conveyor inspection device 140 can also be installed in the fixed jig 141 at all times. That is, as for the passenger conveyor inspection device 140, it can be movable which is carried by the operator or the work supervisor at each time of inspection, or it can be a permanent type which is fixed to the frame 102. In addition, instead of the fixed jig 141, a mark can be provided at a position where it can be disposed so as to face the step 105 at a certain distance. In addition, the setting place of the passenger conveyor inspection device 140 can be any place where the calibration sheet 130 and the fixing member 220 can be shot, and it is not limited to the upper portion of the machine room, but it can also be the inside of the machine room. In addition, the fixed jig 141 can also be a tripod-like stand.

[0050] In the present embodiment, an example in which the inspection of the step 105 is performed on the upper floor side 114 is described, but in the case where the opening portion is provided on the lower floor side 115, the inspection of the step 105 can also be performed on the lower floor side 115. Next, the configuration of the step 105 is described in detail.

[0051] Figure 2 is a diagram showing the schematic configuration of the step 105. The step 105 has a frame 200 which becomes a skeleton, and a tread plate 201 on which a passenger steps. The tread plate 201 is fixed to the upper portion of the frame 200. Although not shown in the drawing, a boundary strip colored in yellow or the like is provided at the end portions of the tread plate 201 on the front and rear sides and on the right and left sides. The passenger is guided to step on the tread plate 201 near the center thereof by the boundary strip. In addition, as for the boundary strip, the boundary strip on the rear side (kicker side) of the tread plate 201 can not be provided, or the boundary strips on the front and rear sides of the tread plate 201 can not be provided.

[0052] In addition, as shown in Figure 2 , the step 105 is fastened to the collar 212 which is rotatably externally fitted to the both end portions near the front wheel shaft 211 which is connected to the drive chain 110, via one or more step fixing bolts 220-1 provided in the not-shown hole of the frame 200. A red washer 220-2 is interposed between the step fixing bolt 220-1 and the frame 200. In addition, in the present embodiment, the step fixing bolt 220-1 and the red washer 220-2 are described as examples of the fixing member 220. Next, the red washer 220-2 is described in detail.

[0053] Figure 3is a drawing showing an example of the red washer 220-2. The first mode 310 shows the red washer 220-2 before the tightening of the step fixing bolt 220-1 is completed. In the first mode 310, the three tongues of the red washer 220-2 are in a state (for example, horizontal) parallel to the A direction and the B direction, and the surface is metallic. In contrast, the second mode 320 shows the red washer 220-2 after the tightening of the step fixing bolt 220-1 is completed. The operator shows the red 321 painted on the back of the red washer 220-2 by bending one of the three tongues of the red washer 220-2 in a direction (for example, vertical) parallel to the C direction. Further, the step fixing bolt 220-1 is confirmed to be properly installed by the bending of the tongue of the red washer 220-2 (representation of the red 321), and thus the bent tongue is preferably the tongue that the operator can most easily visually confirm.

[0054] Here, the washer inserted into the step fixing bolt 220-1 and the frame 200 is not limited to the red washer 220-2. For example, the back of the washer can also be a prescribed color (for example, green or the like, which is not used in the structural members of the step 105). In addition, for example, the number of tongues (bent portions) of the washer is not limited to three, and can be one or more than two. In addition, the red washer 220-2 can also not be provided. In this case, for example, a part or all of the step fixing bolt 220-1 is colored in a prescribed color (for example, red, green, or the like).

[0055] In the passenger conveyor inspection system 100, the passenger conveyor inspection device 140 detects the red 321 of the red washer 220-2 and performs the good or bad determination of the tightening state of the step fixing bolt 220-1. Next, the red washer 220-2 is used as a reference to determine the tightening state of the step fixing bolt 220-1. Figure 4 and Figure 5 The structure of the passenger conveyor inspection device 140 will be described.

[0056] Figure 4 is a drawing showing an example of the hardware structure of the passenger conveyor inspection device 140.

[0057] The passenger conveyor inspection device 140 is a smartphone, a tablet terminal, a notebook computer, or the like having a photographing function, an information processing function, and a display function. The passenger conveyor inspection device 140 is configured to include a control device 410, a computing device 420, a memory 430, a recording device 440, a display 450, and a sensor 460.

[0058] The control device 410 and the arithmetic device 420 are constituted by a processor such as a CPU (Central Processing Unit). The memory 430 is a main storage device that stores programs, data, and the like. The recording device 440 is an HDD (Hard Disk Drive), a flash memory, or the like. Programs, data, and the like stored in the recording device 440 are read into the memory 430 at any time. The display 450 is a display device having a touch panel. The sensor 460 is constituted to include a camera 461 (image sensor), a sound sensor (vibration sensor), a GPS (Global Positioning System) sensor, an inclination sensor, a gyro sensor, a LiDAR (Light Detection And Ranging), a magnetic sensor, an acceleration sensor, and the like. Furthermore, the camera 461 includes one or more wide-angle cameras, telephoto cameras, reflex cameras, TOF (Time Of Flight) cameras, and the like. In addition, a magnet or the like can be installed in the camera 461.

[0059] In the passenger conveyor inspection device 140, the display 450 is an input device that receives various inputs from an operator in addition to performing various displays. At the time of inspection, the operator performs inspection by inputting to the display 450, and calculates detection result data that indicates detection results of the steps 105 and detection results of the fixtures 220, and displays the inspection result data based on the detection result data on the display 450. Furthermore, the detection result data is stored in the recording device 440. As for the performance of inspection, the use of Figure 6 and Figure 7 will be described later. As for the detection result data, the use of Figure 8 will be described later. In addition, as for the inspection result data, the use of Figure 9 will be described later.

[0060] Figure 5 is a diagram that indicates an example of the functional structure of the passenger conveyor inspection device 140.

[0061] The passenger conveyor inspection device 140 has an input section 501, a setting section 502, a calculation section 503, a photographing section 504, a determination section 505, and an output section 506 as functions of the passenger conveyor inspection device 140.

[0062] The input section 501 inputs data (sensor values) acquired in the sensor 460. For example, the input section 501 inputs an image captured by the camera 461. The setting section 502 determines whether the calibration sheet 130 and the passenger conveyor inspection device 140 are set correctly, based on the sensor values input by the input section 501. The calculation section 503 calculates a calibration value for detecting the red color 321 of the red gasket 220-2, based on the image captured by the camera 461 input by the input section 501. The shooting section 504 instructs the camera 461 to start and end shooting. The determination section 505 determines the fastening state of the fixing member 220, based on the calibration value calculated by the calculation section 503, based on the image captured by the camera 461 based on the instruction by the shooting section 504. The output section 506 outputs the result determined by the determination section 505.

[0063] The functions of the passenger conveyor inspection device 140 can be realized by, for example, the control device 410 and the arithmetic device 420 reading out a program stored in the recording device 440 to the memory 430 and executing (software), by hardware such as a dedicated circuit, or by a combination of software and hardware. Further, one function of the passenger conveyor inspection device 140 can be divided into a plurality of functions, and a plurality of functions can be integrated into one function. In addition, a part of the functions of the passenger conveyor inspection device 140 can be provided to or included in other functions. In addition, a part of the functions of the passenger conveyor inspection device 140 can be realized by another computer capable of communicating with the passenger conveyor inspection device 140.

[0064] Figure 6 is a diagram showing an example of a process (inspection process) of inspecting the step 105.

[0065] In S601, the passenger conveyor inspection device 140 displays a setting instruction for setting the passenger conveyor inspection device 140 and the calibration sheet 130 at a prescribed position on the display 450. For example, the passenger conveyor inspection device 140 displays the setting instruction on the display 450 in a case where a start button on an inspection application, which is omitted from illustration, is pressed by an operator.

[0066] In S602, the passenger conveyor inspection device 140 and the calibration sheet 130 are set by the operator. For example, the step 105 is reversed in the vicinity of the opening portion 119, and therefore the passenger conveyor inspection device 140 is set at a position where the fixed member 220 can be imaged through the opening portion 119 at the timing of the reversal. In addition, the passenger conveyor inspection device 140 is set so as to accommodate the calibration sheet 130 and the fixed member 220 in the same angle of view through the opening portion 119. Further, after the passenger conveyor inspection device 140 and the calibration sheet 130 are set by the operator in accordance with the setting instructions so as to be accommodated in the prescribed image area (angle of view), the passenger conveyor inspection device 140 performs imaging (imaging of the image of the calibration sheet 130) in accordance with the operation from the operator.

[0067] In S603, the passenger conveyor inspection device 140 detects the complementary color mark of the calibration sheet 130.

[0068] Here, regarding the complementary color, as described above, for example, it can be specified by the HSV color space. In the HSV color space, in the case where the hue is expressed by a value of 0° to 360°, a color that differs by 180 degrees from the hue of the color of the fixed member 220 is set as the complementary color. For example, in the case where the hue of the color of the fixed member 220 is 0°, a color having a hue of 180° is the complementary color, and in the case where the hue of the color of the fixed member 220 is 30°, a color having a hue of 210° is the complementary color. In addition, in the case where the hue is 350°, a color having a hue of 170° is the complementary color.

[0069] In fact, a margin of 30° is set as the hue before and after the complementary color, and in the case where the hue is 0°, a range of 150° to 210° is specified as the range of the complementary color. This is because it is considered that the color of the calibration sheet 130 can appear to change from the actual color due to the lighting conditions and the like under actual imaging conditions. This is because, in the detection of the mark 131, the detection of the complementary color mark is performed first, but when the detection range thereof is limited to the exact complementary color of the color of the fixed member 220, the detection of the complementary color mark can fail. The detection of the complementary color mark is ultimately performed with the purpose of obtaining information as to what color the color of the same color mark can be imaged in the actual environment, and therefore it is not a problem regardless of how the color is actually seen by the passenger conveyor inspection device 140 (the camera 461). However, in the case where imaging is performed in a manner that is too different from the actual color, a false determination can occur in the subsequent inspection, and therefore in order to confirm that imaging is performed under appropriate environmental conditions, a certain range is set to specify the range of the complementary color.

[0070] For example, in S603, the passenger conveyor inspection device 140 detects the blocks of the two portions of the circle of the specific color in the calibration sheet 130 as the complementary color marks (the mark 131-2 and the mark 131-3) in a prescribed screen region within the captured image, based on color information of a specific color decided in advance (for example, a range of a complementary color of a red color 321 for detecting the red gasket 220-2).

[0071] In S604, the passenger conveyor inspection device 140 determines whether the two complementary color marks are detected. The passenger conveyor inspection device 140 transfers the process to S605 in a case where it is determined that the two complementary color marks are detected. The passenger conveyor inspection device 140 returns the process to S601 to perform the setting again in accordance with the setting instruction in a case where it is determined that the two complementary color marks are not detected, because the setting state of the passenger conveyor inspection device 140 and / or the calibration sheet 130 is not appropriate.

[0072] In S605, the passenger conveyor inspection device 140 measures the distance (pixel coordinate distance) between the complementary color marks within the image.

[0073] In S606, the passenger conveyor inspection device 140 calculates the distance conversion coefficient. The actual distance of the complementary color marks of the calibration sheet 130 is known, and thus the passenger conveyor inspection device 140 calculates a coefficient (distance conversion coefficient) for converting the pixel coordinate distance within the image into the actual distance by comparing the actual distance and the pixel coordinate distance.

[0074] In S607, the passenger conveyor inspection device 140 calculates the inclination of the passenger conveyor inspection device 140 (the camera 461) from the sensor value of the inclination sensor possessed by the passenger conveyor inspection device 140 and the deformation of the shape of the captured complementary color marks.

[0075] In S608, the passenger conveyor inspection device 140 determines whether the setting of the passenger conveyor inspection device 140 is appropriate from the distance conversion coefficient calculated in S606 and the inclination calculated in S607. The passenger conveyor inspection device 140 transfers the process to S609 in a case where it is determined that the setting of the passenger conveyor inspection device 140 is appropriate (in a case where it is determined that the distance conversion coefficient is within a range of a threshold value and the inclination is within a range of a threshold value). The passenger conveyor inspection device 140 returns the process to S601 in a case where it is determined that the setting of the passenger conveyor inspection device 140 is not appropriate.

[0076] In S609, the passenger conveyor inspection device 140 measures (acquires) color information of the same-color marks of the calibration sheet 130. The passenger conveyor inspection device 140 determines the same-color marks between the complementary-color marks, and acquires a numerical value of the color in the HSV space corresponding to the color of the same-color marks in the inspection environment.

[0077] In S610, the passenger conveyor inspection device 140 calculates a calibration value for correcting the color at the time of photographing, based on the color information acquired in S609. The passenger conveyor inspection device 140 sets a range including the color information (numerical value) acquired in S609 as a calibration value (threshold value). Further, the passenger conveyor inspection device 140 detects the color of the range in S616 described later, and determines the fastening state of the fixing member 220 (presence or absence of the fixing member 220, and the case where the fixing member 220 is properly installed) from the detected area.

[0078] In S611, photographing for inspection can be performed, and therefore, the passenger conveyor inspection device 140 displays a photographing OK instruction on the display 450.

[0079] In S612, the passenger conveyor inspection device 140 starts photographing of the video based on the camera 461, in accordance with a start instruction of video photographing from the operator.

[0080] In S613, the operator operates the escalator 101, and runs (drives) the escalator 101.

[0081] In S614, the passenger conveyor inspection device 140 ends photographing of the video based on the camera 461, in accordance with an end instruction of video photographing from the operator.

[0082] Further, the passenger conveyor inspection device 140 can also output an alarm urging to stop the fixing jig 141 and the like again, in a case where a vibration (shaking) of a prescribed value or more is detected in the photographing of the video. The output of the alarm can be performed during the photographing of the video, or can be performed after the photographing of the video, based on the vibration data stored in the recording device 440.

[0083] In S615, the passenger conveyor inspection device 140 detects the number of steps 105 based on the photographed video. For example, the passenger conveyor inspection device 140 detects the steps 105 by the disconnection of the boundary bar. Further, the detection method of the steps 105 is not limited to the above. For example, the passenger conveyor inspection device 140 can detect the steps 105 by pattern matching, can detect the steps 105 by a deep neural network, and can detect the steps 105 by another method.

[0084] In S616, the passenger conveyor inspection device 140 detects the fixing member 220 based on the calibration value acquired in S610. For example, in a case where the second step 105 appears after the first step 105 appears, the passenger conveyor inspection device 140 detects a color that satisfies the calibration value (threshold value) from an image that captures between the steps 105, determines whether or not the number of pixels (area) of the detected color block is equal to or greater than a predetermined value, and detects the number of blocks having an area equal to or greater than the predetermined value as the number of fixing members 220 installed in the second step 105.

[0085] In S617, the passenger conveyor inspection device 140 generates inspection result data based on the detection result data including the results detected in S615 and S616, displays the inspection result data on the display 450, and ends the inspection process.

[0086] Further, the inspection process is not limited to the above. For example, the passenger conveyor inspection device 140 can also perform detection of the steps 105 and the fixing members 220 in the capturing of the video. In this case, in a case where the fixing members 220 are not properly detected, the inspection process can also be suspended as an error. The operator can shorten the time required for the inspection by responding to the error output in real time, without performing capturing of the steps 105 from the step 105 where the error occurs to the remaining steps 105.

[0087] Figure 7 is a diagram that shows an example (image 700) of an image captured by the camera 461.

[0088] The image 700 includes a rim image 701 corresponding to the rim portion 120-1 of the frame 102, a calibration sheet image 710 corresponding to the calibration sheet 130, and a fixing member image 720 corresponding to the fixing member 220. The calibration sheet image 710 includes a mark image 711-1 corresponding to the mark 131-1, a mark image 711-2 corresponding to the mark 131-2, and a mark image 711-3 corresponding to the mark 131-3.

[0089] For example, in a case where the image 700 is used to determine whether or not the fixing member 220 on the left side of the image 700 is properly fastened, the number of pixels of red in the fixing member image 720-1 is detected based on the calibration value, and in a case where the number of detected pixels (area) is equal to or greater than a predetermined value, it is determined that the fixing member is properly fastened. Also, the same applies to the fixing member 220 on the right side of the image 700, and in a case where the area of red in the fixing member image 720-2 is equal to or greater than a predetermined value, it is determined that the fixing member is properly fastened. Also, in a case where it is determined that the fixing members 220 of all (both left and right) of the steps 105 are properly fastened, it is determined that the steps 105 are properly installed.

[0090] Figure 8is a view showing an example of detection result data generated in S615 and S616. The detection result data is stored in the recording device 440 as a CSV (Comma Separated Value) file 800 in which a file name is given to the date and time of the inspection for the device number of the escalator 101 designated by the operator.

[0091] The data of the frame number 801 assigned to the frame (1 frame of a still image constituting a video) continuously from the start time of the inspection, the step detection flag 802 in each frame, and the fixed member detection number 803 are included in the CSV file 800 separated by commas.

[0092] Since the fixed member 220 is located between the continuous steps 105, the step detection flag 802 is "1" in a case where the captured image mainly captures the steps 105, and otherwise, the step detection flag 802 is "0". The frame in which the step detection flag 802 is "0" is a frame in which the fixed member 220 should be detected, and thus, the detection of the fixed member 220 is performed in this part, and the number of the detected fixed members 220 is recorded as the fixed member detection number 803. In Figure 8 In the example shown in FIG. 8B, an example in which two fixed members 220 are detected for one step is shown.

[0093] Figure 9 is a view showing an example of inspection result data generated based on the detection result data (inspection result screen 900). The inspection result screen 900 is displayed on the display 450, for example.

[0094] In the inspection result screen 900, display areas of an inspection result 901, an inspection device number 902, an inspection date 903, a detected step number 904, and a detected fixed member number 905 are provided. The inspection result 901 is a display area expressed as "OK" or "NG" according to the number of the steps 105 detected in the inspection process and the number of the fixed members 220 detected in the inspection process. As a criterion for the pass or fail of the inspection result 901, a value set in advance in accordance with the device number of the passenger conveyor inspection device 140 can be used.

[0095] The inspection device number 902 is a display area displaying the device number of the escalator 101 as an inspection target. The inspection date 903 is a display area displaying the date on which the inspection is performed. The detected step number 904 is a display area displaying the total number of the steps 105 detected in the inspection process. The detected fixed member number 905 is a display area displaying the total number of the fixed members 220 detected in the inspection process.

[0096] According to the inspection result screen 900, the operator can easily grasp the inspection result. Further, as described above, the passenger conveyor inspection apparatus 140 determines whether the total number of the steps 105 of the inspection object is "60" and determines whether the total number of the fixing members 220 is "120", but can also issue an error when the number of the fixing members 220 is detected as "0" or "1" in each step 105. That is, the fastening state of all the fixing members 220 can be collectively inspected after the photographing is completed, but the fastening state of each fixing member 220 can also be inspected during the photographing, and an error can be issued when an abnormality is detected (in real time).

[0097] According to the present embodiment, even in a case where the amount of light irradiated to the passenger conveyor changes due to a change in the environment, calibration corresponding to the environment is performed using the calibration member, and thus the fastening state of the fixing member can be determined from the image, and the fastening state of the fixing member can be confirmed in various environments.

[0098] (II) Second Embodiment

[0099] The present embodiment differs from the first embodiment in that a complementary color mark is not provided to the calibration sheet. In the present embodiment, the same reference numerals are used for the same structures as those of the first embodiment, and the description thereof is omitted.

[0100] Figure 10 is a diagram showing an example (image 1000) of an image photographed by the camera 461.

[0101] In the present embodiment, the calibration sheet 1010 has one or more circular marks 1011. The mark 1011 is the same color as the fixing member 220 (same-color mark). In this way, in a case where only a single mark 1011 exists in the calibration sheet 1010, if the fixing member image 720 exists within the image 1000 at the time of detecting the mark 1011, it is possible that the fixing member image 720 is erroneously detected as a mark image 1021 corresponding to the mark 1011. Therefore, the mark detection region 1030 for detecting the mark image 1021 is manually decided within the image 1000, and the setting position of the calibration sheet 1010 is adjusted so that the fixing member image 720 does not enter the mark detection region 1030.

[0102] In this way, the mark image 1021 of the calibration sheet image 1020 is detected on the basis of the specified mark detection region 1030, and a calibration value for detecting the fixing member 220 is calculated from the color of the mark image 1021, whereby the color of the fixing member 220 can be detected even in various environments.

[0103] (III) Other Embodiments

[0104] In the above embodiment, the calibration value for detecting the fixing member 220 is calculated from the color of the mark 131, 1011 of the calibration sheet 130, 1010, but it is also possible to directly set the threshold value for detecting the fixing member 220 from the color of the mark 131, 1011. In this case, the fixing member 220 is located further inside the housing of the escalator 101 than the calibration sheet 130, 1010, and thus the amount of light received by the fixing member 220 decreases. Therefore, the brightness can decrease, and thus it is possible to set the calibration value (threshold value) of the fixing member 220 taking this into account.

[0105] In addition, in the second embodiment, the color of the fixing member 220 is detected, but in the case where the photographing is performed in a grayscale image, in the case where the brightness of the fixing member 220 is sufficiently large compared to others within the screen 1000, or in the case where it is possible to set a region in which the fixing member 220 can exist within the screen 1000 and the brightness of the fixing member 220 is sufficiently large compared to others within the region, it is also possible to detect the fixing member 220 from the brightness information. In this case, it is possible to set a mark (brightness mark) having the same brightness as the fixing member 220 to the calibration sheet 1010.

[0106] In addition, in the second embodiment, the case where the same-color mark having the same color as the fixing member 220 is set to the calibration sheet 1010 is described as an example, but it is also possible to have a structure in which a complementary-color mark composed of the complementary color of the color of the fixing member 220 is set instead of the same-color mark. In the case where the passenger conveyor inspection device 140 is able to detect the color of the complementary-color mark, the color having the opposite hue to the color is acquired as the color of the fixing member 220 in the HSV space, and the calibration value is calculated.

[0107] In addition, in the second embodiment, the case where the same-color mark having the same color as the fixing member 220 is set to the calibration sheet 1010 is described as an example, but the calibration sheet 1010 itself can also be the same-color mark (the calibration sheet 1010 has the same color as the fixing member 220).

[0108] In addition, in the detection of the step 105 and the fixing member 220, there are various pass / fail criteria. As described in the above embodiment, in addition to determining the numerical value from the detection result data, it is also possible to use the detection result data as reference information and confirm by additionally visually observing. In this case, it is also possible to store the video photographed in the inspection process and the image at the time of detection in the recording device 440 and display on the display 450 at the time of confirmation.

[0109] (IV) Postscript

[0110] In the above embodiment, for example, the following contents are included.

[0111] In the above-described embodiments, the case where the present application is applied to the passenger conveyor inspection system is described, but the present application is not limited thereto and can be widely applied to other various systems, devices, methods, programs.

[0112] In addition, in the above-described embodiments, a part or all of the program can also be installed from a program source to a device like a computer that implements the passenger conveyor inspection device 140. The program source can be, for example, a program distribution server connected through a network or a recording medium (for example, a non-transitory recording medium) that is readable by a computer. In addition, in the above-described description, two or more programs can be implemented as one program, or one program can be implemented as two or more programs.

[0113] In addition, in the above-described embodiments, the information of the passenger conveyor inspection system is described using CSV for convenience of description, but the data structure is not limited to CSV. The information related to the passenger conveyor inspection system can also be expressed by a data structure other than CSV, such as XML (Extensible Markup Language), YAML (YAML Ain't a Markup Language), a hash table, a tree structure, and the like.

[0114] In addition, in the above-described embodiments, the screens illustrated and described are one example, and can be any design as long as the information to be prompted is the same.

[0115] In addition, in the above-described embodiments, the output of the information is not limited to display to a display. The output of the information can be sound output based on a speaker, can be output to a file, can be printing to a paper medium or the like based on a printing device, can be projection to a screen or the like based on a projector, and can be other ways.

[0116] In addition, in the above-described description, the program, table, file, and the like that implement each function can be placed in a storage device such as a memory, a hard disk, an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, a DVD, and the like.

[0117] In the above-described embodiments, for example, the following characteristic structures are included. (1)

[0119] A passenger conveyor inspection device (for example, passenger conveyor inspection device 140) inspects a fastening state of a fixing member (for example, fixing member 220, step fixing bolt 220-1, and red washer 220-2) colored in a prescribed color (for example, red, green, or another color) that is used to fix a plurality of steps (for example, steps 105) to a chain (for example, drive chain 110) that moves in a loop in a passenger conveyor (for example, escalator 101) having the chain and the plurality of steps that can be linked to the chain. The passenger conveyor inspection device has a calculation section (for example, calculation section 503, operation device 420, circuit) that calculates a threshold value (for example, calibration value) for detecting the fixing member based on an image (for example, calibration sheet image 710, calibration sheet image 1020) of a calibration member (for example, calibration sheet 130, calibration sheet 1010) for detecting the fixing member that is disposed in the vicinity of the fixing member and is captured by a camera (for example, camera 461), and a determination section (for example, determination section 505, operation device 420, circuit) that determines the fastening state of the fixing member based on the image (for example, fixing member image 720) of the fixing member captured by the camera with reference to the threshold value calculated by the calculation section.

[0120] In the above structure, calibration for detecting the fixing member is performed based on the image of the calibration member disposed in the vicinity of the fixing member, for example. According to the above structure, the fastening state of the fixing member can be determined with high accuracy even in cases where the environment in which the passenger conveyor is disposed is different. (2)

[0122] The calibration member includes a same-color mark (for example, mark 131-1, mark 1011) that is the same color as the prescribed color, and the calculation section detects the color of the same-color mark from the image of the calibration member and calculates a threshold value for detecting the color of the fixing member based on the detected color.

[0123] In the above structure, the color of the same-color mark is detected in the environment in which the passenger conveyor is disposed, and a threshold value for correcting the color at the time of capturing is set, so the determination of the fastening state of the fixing member can be performed with high accuracy regardless of the amount of light irradiated onto the passenger conveyor. (3)

[0125] The calibration member includes a different-color mark (for example, different-color mark, complementary-color mark, mark 131-2, mark 131-3) that is a different color from the prescribed color, and the calculation section detects the different-color mark from the image captured by the camera and determines the image of the calibration member based on the different-color mark.

[0126] In the above structure, the same-color mark and the different-color mark are provided to the same calibration member, and thus the calibration member is determined based on the different-color mark, and as a result, the same-color mark can be detected. For example, in a case where the passenger conveyor does not use a member, a device, or the like having the same color as the different-color mark, the different-color mark can be easily detected, and the calibration member can be reliably determined, and thus, in detecting the color of the same-color mark, it is possible to avoid a case where the color of the fixing member is erroneously detected. (4)

[0128] The above calibration member is configured to include a complementary color mark (for example, a complementary color mark provided instead of the mark 1011, the mark 131-2, the mark 131-3) having a color that is a complement of the above prescribed color, the above calculation section detects the color of the complementary color mark from the image of the above calibration member, and calculates the threshold value for detecting the color of the above fixing member based on the detected color.

[0129] In the above structure, for example, the color of the fixing member is estimated from the color of the complementary color mark, and the threshold value is calculated, and thus, it is possible to avoid a case where the color of the fixing member is erroneously detected and a wrong threshold value is set. (5)

[0131] The above calibration member is configured to include a brightness mark (for example, a brightness mark) having a color having the same brightness as the above prescribed color, the above calculation section detects the brightness of the brightness mark from the image of the above calibration member, and calculates the threshold value for detecting the brightness of the above fixing member based on the detected brightness.

[0132] In the above structure, for example, the brightness of the brightness mark is detected in an environment where the passenger conveyor is provided, and the threshold value for correcting the brightness at the time of imaging is set, and thus, it is possible to implement the determination of the fastening state of the fixing member in the environment.

[0133] In addition, with respect to the above structure, changes, reorganization, combination, or omission can be appropriately made within a range that does not depart from the gist of the present application.

[0134] It is to be understood that the items included in a list in the form of "at least one of A, B, and C" can represent (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C). Likewise, the items listed in the form of "at least one of A, B, or C" can represent (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C).

Claims

1. A passenger conveyor inspection device that inspects a fastening state of a fixing member colored in a prescribed color, which is used to fix a plurality of steps to a chain that moves in a loop and to which the plurality of steps can be coupled, in a passenger conveyor having the chain and the plurality of steps, characterized by comprising: a calculation section that calculates a threshold value for detecting the fixing member based on an image of a calibration member for detecting the fixing member, which is captured by an imaging device, the calibration member being disposed in the vicinity of the fixing member; and a determination section that determines the fastening state of the fixing member with respect to an image of the fixing member captured by the imaging device based on the threshold value calculated by the calculation section.

2. The passenger conveyor inspection device according to claim 1, characterized in that the calibration member includes a different-color mark of a color different from the prescribed color, the calculation section detects the different-color mark from the image captured by the imaging device, and the calculation section determines the image of the calibration member based on the different-color mark.

3. The passenger conveyor inspection device according to claim 1, characterized in that the calibration member includes a complementary-color mark of a color complementary to the prescribed color, the calculation section detects the complementary-color mark from the image of the calibration member, and the calculation section calculates the threshold value for detecting the color of the fixing member based on the detected color.

4. The passenger conveyor inspection device according to claim 1, characterized in that the calibration member includes a luminance mark of a color having the same luminance as the prescribed color, the calculation section detects the luminance of the luminance mark from the image of the calibration member, and the calculation section calculates the threshold value for detecting the luminance of the fixing member based on the detected luminance.

5. A passenger conveyor inspection method that inspects a fastening state of a fixing member colored in a prescribed color, which is used to fix a plurality of steps to a chain that moves in a loop and to which the plurality of steps can be coupled, in a passenger conveyor having the chain and the plurality of steps, characterized by comprising: a calculation section that calculates a threshold value for detecting the fixing member based on an image of a calibration member for detecting the fixing member, which is captured by an imaging device, the calibration member being disposed in the vicinity of the fixing member; and a determination section that determines the fastening state of the fixing member with respect to an image of the fixing member captured by the imaging device based on the threshold value calculated by the calculation section.

6. The passenger conveyor inspection method according to claim 5, characterized in that the calibration member includes a different-color mark of a color different from the prescribed color, the calculation section detects the different-color mark from the image captured by the imaging device, and the calculation section determines the image of the calibration member based on the different-color mark.

7. The passenger conveyor inspection method according to claim 5, characterized in that the calibration member includes a complementary-color mark of a color complementary to the prescribed color, the calculation section detects the complementary-color mark from the image of the calibration member, and the calculation section calculates the threshold value for detecting the color of the fixing member based on the detected color.

8. The passenger conveyor inspection method according to claim 5, characterized in that the calibration member includes a luminance mark of a color having the same luminance as the prescribed color, the calculation section detects the luminance of the luminance mark from the image of the calibration member, and the calculation section calculates the threshold value for detecting the luminance of the fixing member based on the detected luminance. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​

Images