Passenger conveyor confirmation system

Abstract

To provide a passenger conveyor confirmation system capable of confirming whether a bolt for fixing a step to a chain is appropriately attached in a passenger conveyor.SOLUTION: A passenger conveyor confirmation system includes a detection part for detecting a bolt for fixing each of a plurality of steps to a chain from an image obtained by photographing the step by an imaging terminal, a read part for reading the total number of the plurality of steps from a recording medium provided in the passenger conveyor in which information indicating the total number of the plurality of steps is recorded, a determination part for determining whether the total number of the plurality of steps read by the reading part matches the total number of steps in which bolts is detected by the detection part, and an output part for outputting information indicating a determination result obtained by the determination part.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention generally relates to a technique for assisting the work of checking bolts that fix steps to a chain in a passenger conveyor.

Background Art

[0002] A passenger conveyor includes a frame installed in a building structure, and a plurality of steps provided in the frame and connected in an endless manner to circulate and move. An endless chain is connected to the plurality of steps, and by rotating and driving this chain, the plurality of steps circulate and move along a rail installed in the frame. By this circulating movement, the passenger conveyor transports passengers on the steps from one boarding and alighting口 to the other boarding and alighting口. The plurality of steps are connected to an endless chain by a plurality of bolts (hereinafter, step fixing bolts). A tongue washer (hereinafter, red washer) painted red on only one side and having three tongues is inserted into the step fixing bolts.

[0003] In a passenger conveyor having such a configuration, when replacing steps during inspection work inside the above frame, the steps are removed and attached by detaching and attaching the step fixing bolts. Conventionally, when attaching steps, a confirmation operation for the fastening state of the step fixing bolts is performed. After the operator tightens the step fixing bolts to a specified torque with a fastening tool, one of the three tongues provided on the inserted red washer is vertically bent to display the red color painted on only one side. Visually confirm the red display caused by bending this red washer, and double-check with the person in charge of the work. Then, the person in charge of the work visually checks the red display caused by bending the above red washer at all steps with the passenger conveyor in operation, and confirms the fastening state of the step fixing bolts, thereby completing the confirmation operation for the fastening state of the step fixing bolts. The person in charge of the work inputs the confirmation result into the check sheet each time the above confirmation operation is performed.

[0004] In recent years, a screw tightening prevention device has been disclosed that prevents forgetting to tighten multiple bolts or other screws that have been tightened with a torque wrench equipped with a marker (see Patent Document 1). In the screw tightening prevention device, multiple screw members are photographed with a photographic means, the marks attached to the heads of the screw members are photographed with the photographic means, the total area of ​​the marks obtained is calculated by binarizing the images, the centroid position of the marks is calculated, and the centroids of all screw members within a pre-registered photographic range are compared to determine whether all screw members have been tightened. [Prior art documents] [Patent Documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2004-249388 [Overview of the Initiative] [Problems that the invention aims to solve]

[0006] The information on the mark on the head of the screw member described in Patent Document 1 does not allow for the determination of whether or not a step fixing bolt is installed for all steps.

[0007] This invention was made in consideration of the above points, and aims to propose a passenger conveyor inspection system that can verify whether bolts for fixing steps to chains on a passenger conveyor are properly installed. [Means for solving the problem]

[0008] To solve the above problems, the present invention provides a passenger conveyor confirmation system that can confirm the fastening state of each bolt that fastens each of the steps to the chain, in a passenger conveyor comprising a plurality of steps fixed to a circulating chain by bolts, wherein for each of the plurality of steps, a detection unit detects a bolt for fastening the step to the chain from an image of the step taken by a camera terminal; a reading unit reads the total number of the plurality of steps from a recording medium provided on the passenger conveyor which records information indicating the total number of the plurality of steps; a determination unit that determines whether the total number of the plurality of steps read by the reading unit matches the total number of steps for which bolts have been detected by the detection unit; and an output unit that outputs information indicating the result determined by the determination unit.

[0009] According to the above configuration, for example, information is output indicating whether the total number of steps on the passenger conveyor matches the total number of steps on which bolts were detected. Therefore, for example, a supervisor can accurately and easily check which steps do not have bolts installed. [Effects of the Invention]

[0010] According to the present invention, a highly reliable passenger conveyor confirmation system can be realized. Other problems, configurations, and effects will be clarified by the following description of embodiments. [Brief explanation of the drawing]

[0011] [Figure 1] This figure shows an example of the configuration of a passenger conveyor confirmation system according to the first embodiment. [Figure 2] This figure shows a schematic configuration of the steps according to the first embodiment. [Figure 3] This figure shows an example of a step connection according to the first embodiment. [Figure 4] This figure shows an example of a step connection according to the first embodiment. [Figure 5] This figure shows an example of a red washer according to the first embodiment. [Figure 6] This figure shows an example of the placement of a two-dimensional code according to the first embodiment. [Figure 7] This figure shows an example of information recorded in a two-dimensional code according to the first embodiment. [Figure 8] This figure shows an example of the hardware configuration related to the shooting terminal according to the first embodiment. [Figure 9] This figure shows an example of the functional configuration of a shooting terminal according to the first embodiment. [Figure 10] This figure shows an example of the verification process according to the first embodiment. [Figure 11] This figure shows an example of an automatic image extraction method for bolt extraction according to the first embodiment. [Figure 12A] This figure shows an example of the output configuration according to the first embodiment. [Figure 12B] This figure shows an example of the output configuration according to the first embodiment. [Modes for carrying out the invention]

[0012] (I) First Embodiment One embodiment of the present invention will be described in detail below. However, the present invention is not limited to this embodiment.

[0013] The passenger conveyor confirmation system according to this embodiment includes a passenger conveyor confirmation device. The passenger conveyor confirmation device photographs the steps of the passenger conveyor in operation (captures images of the steps) and automatically extracts still images showing the step fixing bolts from the step images. The passenger conveyor confirmation device then automatically recognizes the recording medium from the still images. The recording medium contains information such as the total number of steps on the passenger conveyor, the number of each step, the number of steps in which a red washer is not inserted, the total number of such steps, and the work history. The recording medium is a barcode, a 2D code, etc.

[0014] The passenger conveyor inspection device extracts red color by bending a red washer using a still image and information on a recording medium, and determines the fastening state of the step fixing bolts. The passenger conveyor inspection device stores (records) the still image and the determination result of the fastening state of the step fixing bolts in a storage device or displays them on a display device. For example, the passenger conveyor inspection device compares the total number of steps of the passenger conveyor set in the storage medium with the total number of steps where the red washer is detected, thereby determining whether the fastening state of the step fixing bolts is good or not.

[0015] According to the above configuration, it is possible to accurately and simply confirm the fastening state of the step fixing bolts of the passenger conveyor, and to manage the maintenance history for each step fixing bolt.

[0016] Here, the passenger conveyor inspection device may count up or down the number of still images in which the step fixing bolts appear, based on the number of the step to which the recording medium is attached. According to such a configuration, it is possible to identify the numbers of the individual steps to which the recording medium is not attached.

[0017] Further, the passenger conveyor inspection device may compare the number of the first step where the red washer recorded on the recording medium is not inserted with the number of the second step where the red washer is not detected. According to such a configuration, it is possible to avoid determining whether the fastening state of the step fixing bolts is good or not for the first step.

[0018] The notations such as "first", "second", "third", etc. in this specification and the like are attached to identify components, and do not necessarily limit the number or order. Also, the numbers for identifying components are used for each context, and the numbers used in one context do not necessarily indicate the same configuration in other contexts. Further, it does not prevent a component identified by a certain number from also having the functions of a component identified by another number.

[0019] Next, embodiments of the present invention will be described with reference to the drawings. The following description and drawings are illustrative for explaining the present invention, and have been omitted and simplified as appropriate for clarity of explanation. The present invention can also be carried out in various other forms. Unless otherwise specified, each component may be singular or plural.

[0020] In the following explanation, identical elements in the drawings will be assigned the same number, and explanations will be omitted as appropriate. Furthermore, when describing similar elements without distinction, the common part of the reference numeral (excluding the sub-number) will be used, while when describing similar elements with distinction, the reference numeral including the sub-number may be used. For example, when describing step fixing bolts without particular distinction, they will be written as "step fixing bolt 303," while when describing individual step fixing bolts with distinction, they may be written as "step fixing bolt 303-1," "step fixing bolt 303-2," and so on.

[0021] In Figure 1, 100 represents the passenger conveyor confirmation system according to the first embodiment as a whole.

[0022] Figure 1 shows an example of the configuration of the passenger conveyor inspection system 100. The passenger conveyor inspection system 100 is a system that assists in checking the fastening status of step fixing bolts that secure the steps of passenger conveyors such as escalators and moving walkways. More specifically, the passenger conveyor inspection system 100 is a system that automatically detects the bending of red washers inserted together with the step fixing bolts from video and determines whether the fastening status of the step fixing bolts is good or bad. In the following explanation, an escalator 101 will be used as an example of a passenger conveyor.

[0023] The escalator 101 comprises a frame 102 installed in a building structure (not shown), a control panel 103, a railing 104, steps 105, rails 106, handrails 107, a drive mechanism 108, a transmission chain 109, a driving chain 110, a handrail drive device 111, a drive sprocket 112, and a driven sprocket 113. In the following description, a coordinate system may be used in which the horizontal direction is the x-axis, the width direction of the steps 105 is the y-axis, and the vertical direction is the z-axis. It should also be noted that the direction of travel of the steps 105 may be considered the x-axis, etc.

[0024] On the upper floor side 114 of the frame 102, the control panel 103, drive mechanism 108, and drive sprocket 112 are located. On the lower floor side 115, the driven sprocket 113 is located.

[0025] The drive mechanism 108 consists of an electric motor and a reduction gear. Power is supplied to the electric motor from the control panel 103, and the operation of the electric motor is controlled by the control panel 103. A belt member 116 is wrapped around the electric motor and the reduction gear, and the rotational force of the electric motor is transmitted to the reduction gear via the belt member 116.

[0026] A transmission chain 109 is wrapped around the reduction gear and the drive sprocket 112. The driving force of the drive mechanism 108 is transmitted to the drive sprocket 112 via the transmission chain 109, causing the drive sprocket 112 to rotate.

[0027] A pair of driving chains 110 are wrapped around the drive sprocket 112 and the driven sprocket 113. When the drive sprocket 112 rotates, the driven sprocket 113 and the driving chain 110 rotate.

[0028] Furthermore, a handrail drive chain 117 is wrapped around the drive sprocket 112. The handrail drive chain 117 is wrapped around multiple transmission pulleys 118, as well as around the handrail drive device 111.

[0029] A pair of rails 106 are arranged in the width direction of the frame 102, and multiple steps 105 are movably supported on this pair of rails 106. The multiple steps 105 are also endlessly connected via a pair of driving chains 110, and are guided by the rails 106 to circulate between the forward and return paths.

[0030] The railing section 104 is supported on the upper part of the frame 102 and is positioned on both sides of the frame 102 in the width direction. An endless handrail 107 is attached to the railing section 104. The handrail 107 is movably supported on the railing section 104 and moves in a cyclic manner in sync with the multiple steps 105 by a handrail drive device 111. This allows the escalator 101 to safely transport passengers who are standing on the steps 105 and holding onto the handrail 107.

[0031] Furthermore, the escalator 101 is equipped with a cover plate 119. The cover plate 119 is installed at the entrance / exit, facing the step 105 from inside the building. The cover plate 119 serves as a cover for the upper floor side 114 (machine room located within the floor surface) and also as a passageway for passengers. However, Figure 1 shows an example in which the cover plate 119 is opened for the removal and installation of the step 105 (detachment work).

[0032] The passenger conveyor inspection system 100 is equipped with a camera terminal 120. The camera terminal 120 is positioned via a stand 121 to face the step 105 (step fixing bolt) at a certain distance during inspection. More specifically, the person in charge of the work opens the cover plate 119 of the escalator 101 to expose the part where the step 105 switches from the outbound side to the return side. The camera terminal 120 is fixed via the stand 121 at an angle where the red washer of the step fixing bolt of the step 105 is visible. In this embodiment, since the step 105 is photographed in operation, the camera terminal 120 may vibrate during operation, potentially causing the image to blur. Therefore, the stand 121 must be securely fixed to the cover plate 119 or the frame 102.

[0033] In Figure 1, an example is shown in which the imaging terminal 120 is installed on the upper floor side 114 of the escalator 101, but it may also be installed on the lower floor side 115. Furthermore, the imaging terminal 120 may be permanently installed in the machine room. In other words, the imaging terminal 120 may be portable, transported by the worker or supervisor each time an inspection is performed, or it may be permanently fixed to the frame 102. The following explanation will use the case where the imaging terminal 120 is portable as an example. Also, the installation location of the imaging terminal 120 is any location from which the step fixing bolts of the step 105 can be photographed, and is not limited to the cover plate 119.

[0034] Next, the structure of step 105 will be described in detail using Figures 2 to 5. In this embodiment, we will describe an example in which a normal step 105 (hereinafter referred to as step 200) into which a red washer is inserted, and a special step 105 in which a red washer is not inserted, such as an inspection step 105. It should be added that the present invention is also applicable to escalators 101 in which the special step 105 is not provided.

[0035] Figure 2 shows a schematic configuration of step 200. Step 200 comprises a frame 201 that forms the skeleton, a step 202, and a riser 203 connected to the rear end of the step 202. The step 202 is fixed to the upper part of the frame 201. Demarcations 204, colored yellow or the like, are provided at the front, rear, left, and right ends of the step 202. The demarcations 204 guide passengers to stand near the center of step 200. Note that the form of the demarcations 204 is not limited to the form shown in Figure 2. For example, a demarcation 204 may not be provided at the rear of the step 202 (on the riser 203 side), nor may demarcations 204 be provided at the front and rear of the step 202.

[0036] Figures 3 and 4 show an example of the connection of step 200. As shown in Figures 3 and 4, step 200 is fastened with a number of step fixing bolts 303 (for example, a first step fixing bolt 303-1 and a second step fixing bolt 303-2) to a collar 302 that is rotatably fitted onto the ends of a front axle 301, which is connected to a driving chain 110, via a hole (not shown) provided in the frame 201. A red washer 304 is inserted between the step fixing bolt 303 and the frame 201.

[0037] Next, I will explain the red washer 304 in detail.

[0038] Figure 5 shows an example of a red washer 304. The first embodiment 510 shows the red washer 304 before the step fixing bolt 303 is fastened. In the first embodiment 510, the three tongues of the red washer 304 are parallel to the x and y directions (horizontal), and the surface is metallic in color. In contrast, the second embodiment 520 shows the red washer 304 after the step fixing bolt 303 has been fastened. The worker bends one of the three tongues of the red washer 304 in a direction parallel to the z direction (vertical), thereby displaying the red color 521 painted on the back of the red washer 304. It is preferable that the tongue that is bent is the tongue that is easiest for the worker to see.

[0039] Here, the washer inserted between the step fixing bolt 303 and the frame 201 is not limited to the red washer 304. For example, the back surface of the washer may be a predetermined color (for example, green, or a color not present in the components of the step 200). Also, for example, the number of tabs (folded parts) of the washer is not limited to three; it may be one or two or more.

[0040] The passenger conveyor inspection system 100 uses the camera terminal 120 to detect the red color 521 of the red washer 304 and determines whether the fastening condition of the step fixing bolt 303 is good or bad.

[0041] Next, Figure 6 will explain the location where the two-dimensional code 600, used to determine the fastening condition of the step fixing bolts 303, is attached. The two-dimensional code 600 contains information such as the total number of steps 105 of the escalator 101, the number of the special step 105 in which the red washer 304 is not inserted (step number), the work history, and the number of the step 200 to which the two-dimensional code 600 is attached. The information contained in the two-dimensional code 600 will be described later using Figure 7.

[0042] Figure 6 shows an example of the placement of the two-dimensional code 600. The two-dimensional code 600 is affixed to the step 200. Figure 6 shows an example where the first two-dimensional code 600-1 is affixed to the first step fixing bolt 303-1, and the second two-dimensional code 600-2 is affixed to the second step fixing bolt 303-2.

[0043] Since the 2D code 600 is captured by the camera terminal 120, it is desirable that it be affixed to a position directly facing the camera terminal 120. Therefore, the affixing position of the 2D code 600 is preferably on a surface perpendicular to the surface to which the step fixing bolt 303 of the frame 201 is fixed, and near the step fixing bolt 303. Note that the affixing position is not limited to the position shown in Figure 6, and the 2D code 600 may also be affixed to the red washer 304 which is directly facing the camera terminal 120. Furthermore, since the attachment and detachment of the left and right step fixing bolts 303 are performed simultaneously, if the left and right step fixing bolts 303 are in the same field of view, one 2D code 600 may be affixed to the center position of the left and right step fixing bolts 303.

[0044] Here, as an example of the operation method, we will explain an operation method in which a 2D code 600 is attached to at least one step 200 (all steps 200, the last step 200 to be attached or detached, etc.) where the step fixing bolt 303 has been attached or detached, and the 2D code 600 is updated each time the attachment or detachment work is performed. However, it is also possible to attach the 2D code 600 to all steps 200 in advance and update the 2D code 600 each time the attachment or detachment work is performed. Furthermore, in the case of a newly installed escalator 101, the 2D code 600 may be attached to all steps 105, and in the case of an existing escalator 101, the 2D code 600 may be attached to the step 105 to be inspected. In addition, the 2D code 600 is issued each time using information from a predetermined server device before the worker goes to perform the inspection work.

[0045] Figure 7 shows an example of information recorded in the two-dimensional code 600 (two-dimensional code information 700). The two-dimensional code information 700 is information recorded within the two-dimensional code 600 and includes information related to inspection work. More specifically, the two-dimensional code information 700 consists of configuration information 710 related to the configuration of the step 200 and the step fixing bolt 303, color information 720 indicating the color of the two-dimensional code 600, and work information 730 related to the content of inspection work such as maintenance work and repair work.

[0046] The configuration information 710 includes information on the manufacturing number 711, the left and right bolts 712, the step number 713, the total number of steps 714, and the total number of special steps 715. The manufacturing number 711 indicates the manufacturing number of the step 200 and / or the step fixing bolt 303 to which the 2D code 600 is attached. The left and right bolts 712 indicate the position in the step 200 where the step fixing bolt 303 is installed. The step number 713 indicates the number of the step 200. The total number of steps 714 indicates the total number of steps 105 in the escalator 101. The total number of special steps 715 indicates the total number of special steps 105 in which the red washer 304 is not inserted.

[0047] The work information 730 includes information on the normal step 732, the special step 733, and the work history 734 for each step number 731. The normal step 732 indicates whether or not it is step 200. The special step 733 indicates whether or not it is the special step 105. Note that the normal step 732 and special step 733 are recorded with the symbol "○", the flag "TURE", etc., if applicable. The work history 734 shows the history of attachment and detachment work. The work history 734 records information that can manage the history of attachment and detachment work, and the last work date may be information represented as a year, month, and day in 8 digits, or other information.

[0048] According to the 2D code information 700, for example, it is possible to prevent incorrect input of information related to inspection work.

[0049] Furthermore, the 2D code information 700 is not limited to the contents described above. For example, the 2D code information 700 may include a special step number 105 (special step number). Also, for example, the 2D code information 700 may include the red area described later. The 2D code information 700 may not include some of the information described above.

[0050] Next, the configuration of the shooting terminal 120 will be explained using Figures 8 and 9.

[0051] Figure 8 shows an example of the hardware configuration related to the camera terminal 120. As shown in Figure 8, the passenger conveyor confirmation system 100 includes a camera terminal 120 and a storage device 810. The camera terminal 120 and the storage device 810 are connected to each other via a network 820.

[0052] The shooting terminal 120 may be a smartphone, tablet, or laptop computer equipped with an imaging function and an information processing function, or it may be realized by combining an imaging means such as a digital camera or digital video camera with an information processing means such as a processor.

[0053] For example, the imaging terminal 120 includes a processor 801, a main memory 802, an auxiliary memory 803, an input device 804, an output device 805, a communication device 806, and an imaging device 807.

[0054] A processor 801 is a device that performs arithmetic processing. Examples of processors 801 include CPUs (Central Processing Units), MPUs (Micro Processing Units), GPUs (Graphics Processing Units), and AI (Artificial Intelligence) chips.

[0055] The main memory 802 is a device that stores programs, data, etc. Examples of main memory 802 include ROM (Read Only Memory) and RAM (Random Access Memory). ROM includes SRAM (Static Random Access Memory), NVRAM (Non-Volatile RAM), Mask ROM (Mask Read Only Memory), and PROM (Programmable ROM). RAM includes DRAM (Dynamic Random Access Memory).

[0056] The auxiliary storage device 803 includes HDDs (Hard Disk Drives), flash memory, SSDs (Solid State Drives), optical storage devices, etc. Optical storage devices include CDs (Compact Discs) and DVDs (Digital Versatile Discs). Programs, data, etc., stored in the auxiliary storage device 803 are read into the main memory 802 as needed.

[0057] The input device 804 is a user interface that receives information from the user. The input device 804 may be, for example, a keyboard, mouse, card reader, or touch panel.

[0058] The output device 805 is a user interface that outputs various types of information (display output, audio output, print output, etc.). The output device 805 may include, for example, a display device that visualizes various types of information, an audio output device (speaker), a print device, etc. The display device may be an LCD (Liquid Crystal Display), a graphics card, etc.

[0059] The communication device 806 is a communication interface that communicates with other devices via a communication medium. Examples of communication devices 806 include a NIC (Network Interface Card), a wireless communication module, a USB (Universal Serial Interface) module, and a serial communication module. The communication device 806 can also function as an input device that receives information from other devices that are connected to it for communication. Furthermore, the communication device 806 can also function as an output device that transmits information to other devices that are connected to it for communication.

[0060] The imaging device 807 is equipped with an imaging lens, an image sensor, etc., and is a device that converts the optical image formed by the imaging lens into an electrical signal using the image sensor. The imaging device 807 is composed of a CCD (Charge Coupled Device) sensor, a CMOS (Complementary Metal Oxide Semiconductor) sensor, etc.

[0061] The storage device 810 is an HDD, SSD, or the like for storing data. The storage device 810 may be included in the shooting terminal 120, may be connected to the shooting terminal 120 without going through the network 820, or may not be provided at all.

[0062] Figure 9 shows an example of the functional configuration of the imaging terminal 120. The imaging terminal 120 comprises an imaging unit 910, a pre-processing unit 920, and a post-processing unit 930.

[0063] The imaging unit 910 performs imaging-related processing in the imaging device 807 to acquire video 911 (captured video).

[0064] The preprocessing unit 920 comprises an input unit 921, a detection unit 922, and a reading unit 923. The input unit 921 performs image processing on the video 911 to input (acquire) a still image 924. The detection unit 922 extracts a bolt detection image 925 from the still image 924 for detecting the step fixing bolts 303. The detection unit 922 also extracts (detects) the red color 521 of the red washer 304 from the extracted bolt detection image 925. The detection unit 922 also calculates the area of ​​the detected red color 521 (hereinafter referred to as the red area). If the bolt detection image 925 contains an image of a two-dimensional code 600, the reading unit 923 reads the two-dimensional code information 700 recorded in the two-dimensional code 600.

[0065] The post-processing unit 930 includes a determination unit 931, an output unit 932, a specification unit 933, and a setting unit 934. The determination unit 931 determines whether the fastening state of the step fixing bolts 303 is good or bad. For example, the determination unit 931 determines that the step 200 is properly installed (pass) for step fixing bolts 303 in which the detection unit 922 detects a red color 521, and determines that the step 200 is not properly installed (fail) for step fixing bolts 303 in which the detection unit 922 does not detect a red color 521. The output unit 932 outputs the good or bad determination result 935 from the determination unit 931 to the output device 805, the management DB 940 in the storage device 810, etc. The output unit 932 may also instruct the escalator 101 (control panel 103) to circulate the step 200 to a position where the step fixing bolts 303 determined by the determination unit 931 to be not properly installed are visible. The identification unit 933 identifies the number of each of the multiple steps 105 in the escalator 101. The setting unit 934 sets a threshold for the detection unit 922 to detect the red color 521 of the red washer 304.

[0066] The functions of the imaging terminal 120 (imaging unit 910, pre-processing unit 920, post-processing unit 930, etc.) may be implemented, for example, by the processor 801 reading a program stored in the auxiliary storage device 803 into the main memory device 802 and executing it (software), or by hardware such as a dedicated circuit, or by a combination of software and hardware. One function of the imaging terminal 120 may be divided into multiple functions, or multiple functions may be combined into one function. Furthermore, some functions of the imaging terminal 120 may be provided as separate functions or included in other functions. In addition, some functions of the imaging terminal 120 may be implemented by another computer that can communicate with the imaging terminal 120.

[0067] The functions of the imaging terminal 120 are not limited to those described above. For example, the imaging terminal 120 may include a guide unit that guides the imaging terminal 120 to a certain distance from the step fixing bolt 303 and guides the imaging terminal 120 so that it faces the step fixing bolt 303 directly, and displays this guide on the output device 805 superimposed on the image acquired by the imaging terminal 120.

[0068] The storage device 810 includes a management DB 940. The management DB 940 stores information indicating the plan for the verification work (work plan information), bolt detection images 925 extracted by the pre-processing unit 920, pass / fail judgment results 935 determined by the post-processing unit 930, and the like.

[0069] For example, the supervisor takes a picture of all the steps 105 of the escalator 101 in operation using the camera terminal 120 on the upper floor side 114 of the frame 102. The video 911 captured by the imaging unit 910 is sent to the preprocessing unit 920, where the input unit 921 divides it into multiple still images 924 per unit time. The multiple still images 924 are sent in chronological order to the detection unit 922, where, through an automatic extraction process described later, bolt detection images 925 are automatically extracted and sent to the reading unit 923 and the determination unit 931.

[0070] The reading unit 923 is, for example, a code program that processes the 2D code 600, and reads the 2D code information 700 by automatically recognizing and decoding the position of the 2D code 600. The reading unit 923 sends the 2D code information 700 read from the 2D code 600 to the determination unit 931.

[0071] The determination unit 931 extracts the red component from the bolt detection image 925 using image processing techniques such as RGB detection. The determination unit 931 determines whether the fastening state of the step fixing bolt 303 is good or bad by detecting the presence or absence of the red color 521 of the red washer 304, and creates a good or bad determination result 935. At this time, the identification unit 933 identifies the numbers of individual steps 105 that do not have a 2D code 600 attached by counting up or counting down the number of bolt detection images 925 based on the numbers of the steps 200 to which the 2D code 600 is attached.

[0072] The determination unit 931 then sorts the multiple bolt detection images 925 based on the pass / fail judgment result 935. At this time, the number of steps 200 in which a red washer 304 was detected is counted as the number of red washer detection steps. Next, the determination unit 931 checks for missed detections by comparing the number of red washer detection steps with the total number of steps. Here, since there are special steps 105 in step 200 in which a red washer 304 is not provided, the determination unit 931 compares (total number of steps - total number of special steps 105) with the number of red washer detection steps. The determination unit 931 confirms that there are no missed detections because the two numbers are equal. The determination unit 931 sends the bolt detection images 925 for all steps 105 and the pass / fail judgment result 935 to the output unit 932. The output unit 932 displays the pass / fail judgment result 935, etc. on the output device 805. Furthermore, the output unit 932 saves the bolt detection images 925 for all 105 steps and the pass / fail judgment result 935 for step 200 to the management DB 940 via the communication device 806.

[0073] Based on the pass / fail judgment result 935, the work supervisor visually inspects the step fixing bolts 303 of the failed step 200 and, if necessary, performs the tightening work. This tightening work prevents the step fixing bolts 303 from being left untightened.

[0074] Furthermore, the output unit 932 can streamline the creation of work completion reports by outputting the pass / fail judgment result 935 to a check sheet. In addition, the shooting terminal 120 can perform history management by checking all of the multiple bolt detection images 925 stored in the management DB 940 and the pass / fail judgment result 935.

[0075] Next, the process related to the verification of the step fixing bolt 303 (verification process) will be explained using Figure 10.

[0076] Figure 10 shows an example of the verification process. The verification process begins with the step fixing bolts 303 fastened during the inspection of the escalator 101.

[0077] In S1001, the worker attaches a 2D code 600 near the step fixing bolt 303 on the frame 201 of the step 200 that was removed.

[0078] In S1002, the supervisor shifts the cover plate 119 on the top of the escalator 101 by approximately 150mm to 200mm to create an opening, and installs the camera terminal 120 via the stand 121. When both red washers 304 fit within the same field of view, the field of view is adjusted so that both red washers 304 face the camera terminal 120 and the midpoint of both red washers 304 is located in the center of the shooting screen. When both red washers 304 do not fit within the same field of view, the field of view is adjusted so that one of the red washers 304 faces the camera terminal 120 and that red washer 304 is located in the center of the shooting screen. At this time, the focus is set to the red washers 304.

[0079] In S1003, the supervisor operates the escalator 101 in short intervals and uses the camera terminal 120 to take one to two photos of the steps 105 of the escalator 101. At this time, the supervisor also takes one or more photos of the steps 200 to which the 2D code 600 is attached.

[0080] In S1004, the imaging terminal 120 sets a threshold used for detecting red 521. More specifically, the imaging terminal 120 performs brightness calibration on the captured image. One calibration method is for the supervisor to judge the degree of ambient light and select a pre-prepared brightness threshold such as "high," "medium," or "low." Alternatively, a 2D code 600 may be printed in a pre-set known red color system, and in S1002, the color system value of the 2D code 600 in the captured image (first value) and the value of the 2D code color information 720 contained in the 2D code 600 (second value) may be compared to set an appropriate red 521 threshold. In this case, for example, if the difference between the first value and the second value falls within the first range, the imaging terminal 120 sets the brightness threshold to "high," if the difference falls within the second range, it sets the brightness threshold to "medium," and if the difference falls within the third range, it sets the brightness threshold to "low."

[0081] In S1005, the imaging terminal 120 detects the red washer 304. For example, the imaging terminal 120 performs image processing such as RGB detection on the image captured in S1002 using the threshold set in S1004 to extract red pixels (detecting the red 521 of the red washer 304) and calculates the red area.

[0082] In S1006, the imaging terminal 120 determines whether or not it was able to detect the red washer 304. If the imaging terminal 120 determines that it was able to detect the red washer 304, it proceeds to S1007. If it determines that it was not able to detect the red washer 304, it proceeds to S1002, where the imaging terminal 120 adjusts its field of view and performs brightness calibration on the captured image again. This field of view adjustment and brightness calibration ensure that the imaging terminal 120 can determine whether or not the fastening condition of the step fixing bolts 303 of the target escalator 101 is good or bad.

[0083] In S1007, the camera terminal 120 reads the two-dimensional code 600 in the captured image. At this time, the camera terminal 120 obtains and sets information from the two-dimensional code 600, including the serial number 711, the left and right bolts 712, the step number 713, the total number of steps 714, the total number of special steps 715, the normal steps 732 and special steps 733 for each step number 731, and the work history 734.

[0084] In S1008, the supervisor operates the escalator 101 for maintenance and uses the camera terminal 120 to photograph all steps 105 of the escalator 101. At this time, the supervisor only needs to photograph all steps 105 without fail.

[0085] In S1009, the imaging terminal 120 detects the red washer 304. At this time, the imaging terminal 120 counts the number of steps in which the red washer 304 was detected as the red washer detection step number. For example, the imaging terminal 120 detects the boundary of step 105 using object matching based on shape, the break in the demarcation 204, etc., and counts the step number 105. By identifying the step number 105, the imaging terminal 120 can identify each step fixing bolt 303, and thus can manage the red area for each step fixing bolt 303.

[0086] In S1010, the imaging terminal 120 determines whether all red washers 304 have been detected for the step 200 to be checked (i.e., whether there is a problem with the fastening of the step fixing bolts 303).

[0087] For example, the imaging terminal 120 determines whether the number of steps for detecting red washers matches the total number of steps. If the imaging terminal 120 determines that the number of steps for detecting red washers matches the total number of steps, it proceeds to S1012. If it determines that the number of steps for detecting red washers does not match the total number of steps, it proceeds to S1012. The total number of steps is the value of the total number of steps 714 if there are no special steps 105, and is "value of total number of steps 714 - value of total number of special steps 715" if there are special steps 105.

[0088] Furthermore, if the two-dimensional code 600 contains information indicating a predetermined number of step fixing bolts 303 to be provided in each of the multiple steps 200 (for example, "2" which can be determined from the left and right bolts 712), the imaging terminal 120 may determine whether the number of bolts detected for each of the multiple steps 200 is the predetermined number. In this case, the imaging terminal 120 determines whether the total number of the multiple steps 200 matches the total number of steps 200 for which it has been determined that the predetermined number of step fixing bolts 303 are provided, and outputs the result of the determination for each step 200.

[0089] Furthermore, for example, the imaging terminal 120 may determine for each of the multiple steps 200 whether the detected step fixing bolt 303 is located in a predetermined position (e.g., left or right) of the step 200. In this case, the imaging terminal 120 determines whether the total number of multiple steps 200 matches the total number of steps 200 for which it has been determined that the step fixing bolt 303 is located in a predetermined position, and outputs the result of the determination for each step 200. With the above configuration, the result of the determination of whether or not the step fixing bolt 303 is located in a predetermined position is output for each of the multiple steps 200, so for example, the person in charge of the work can easily check the fastening status of the step fixing bolt 303 for each step 200. Output

[0090] Furthermore, for example, the imaging terminal 120 may determine whether the step number 731 of special step 733 matches the step number of step 105 in which the red washer 304 was not detected. In this case, the imaging terminal 120 may output information indicating the step number of step 105 in which it was determined that they did not match.

[0091] Here, the red washer 304 rotates to some extent around the step fixing bolt 303 when the step fixing bolt 303 is tightened, so the bending position is not necessarily the same. Therefore, the red area detected by the passenger conveyor confirmation system 100 changes. Based on this characteristic, the following two points can be achieved by comparing the bolt detection image 925 stored in the management DB 940 with the bolt detection image 925 from the work performed on the day in the judgment unit 931. In this case, the shooting terminal 120 obtains from the management DB 940 information indicating the plan for the current confirmation work (work plan information) and the red area and pass / fail judgment result 935 from the previous confirmation work (previous implementation information).

[0092] Firstly, if there is no difference between the red area of ​​the red washer 304 of step 200, which is scheduled to be removed in the work plan, and the red area of ​​the red washer 304 of step 200 stored in the management DB 940, it is possible to notify the administrator that the work plan has not been carried out and to manage the history. History management refers to managing step 200 that has been removed and installed, or step 200 that was scheduled to be removed but was not removed.

[0093] Secondly, the same comparison is made for step 200, which is not scheduled to be removed in the work plan. If there is a difference in the red area, it is assumed that the step fixing bolt 303 has loosened, and by instructing the work supervisor to tighten it further, it is possible to prevent the step from falling off due to the loosening of the step fixing bolt 303.

[0094] In S1011, the supervisor performs a visual inspection. At this time, the number of the step 200 that is presumed to have been missed may be presented. For example, the supervisor checks the fastening status of the step fixing bolt 303 and, if necessary, inserts a red washer 304, bends the red washer 304, or tightens the step fixing bolt 303. In this way, the supervisor can avoid forgetting to tighten the step fixing bolt 303 by visually inspecting the step fixing bolt 303 of the failed step 200 based on the pass / fail judgment result 935 from the imaging terminal 120 and, if necessary, performing the tightening work.

[0095] In this visual inspection, the camera terminal 120 may instruct the control panel 103 to operate the escalator 101 in maintenance mode and stop the step fixing bolts 303 (step 200) that were not found to be bent at a visible position (for example, the camera position). Alternatively, the supervisor may instruct the escalator 101 to operate and stop the step fixing bolts 303 that were not found to be bent at a visible position. If a visual inspection is performed on all steps 200 that are presumed to have been missed, the process in S1012 is performed.

[0096] In step S1012, the imaging terminal 120 displays the bolt detection images 925 and pass / fail judgment results 935 for all steps 105 on the output device 805. The display method will be described later with reference to Figure 12.

[0097] In S1013, the imaging terminal 120 stores all bolt detection images 925 and pass / fail judgment results 935 from step 105 into the management DB 940, and the verification process is completed. In S1013, by the imaging terminal 120 storing the bolt detection images 925 into the management DB 940, the administrator can perform history management by checking all of the multiple bolt detection images 925 and pass / fail judgment results 935 stored in the management DB 940. The imaging terminal 120 may also store the red area in the management DB 940.

[0098] This embodiment is not limited to the processing described above. For example, by outputting the pass / fail judgment result 935 to a check sheet following S1013, it is possible to streamline the creation of the work completion report.

[0099] Figure 11 shows an example of an automatic extraction method for bolt detection images 925. Figure 11 shows an example where the escalator 101 is operating in an upward direction. In the still images 924-1 to 924-4 arranged in chronological order, the step image 1110 representing the step 105 to be processed and the step image 1120 representing the step 105 immediately preceding the step 105 to be processed are gradually moving in the opposite direction to the z direction (downward). In addition, a rectangular area in the center of still image 924, which is long in the y direction, is designated as the detection area 1130 for detecting demarcation 204 (demarcation image 1170).

[0100] In still images 924-1 and 924-2, the bolt image 1140 representing the step fixing bolt 303 provided in step 105 to be processed, and the washer image 1150 representing the red washer 304 provided in step 105 to be processed, are partially or completely hidden by the step image 1120 representing the previous step 105. Therefore, the camera terminal 120 cannot detect all of them. In still image 924-3, the camera terminal 120 can fully detect the bolt image 1140 and the washer image 1150, but in still image 924-4, they are again hidden by the step image 1110, so the camera cannot detect all of them.

[0101] Therefore, the imaging terminal 120 needs to extract the bolt detection image 925 from the still images 924-3. Here, the location where the step fixing bolt 303 is attached is always between the step 105 being processed and the step 105 immediately preceding it. Thus, in the detection region 1130, the bolt detection image 925 can be automatically extracted by extracting an image in which both the demarcation image 1160 representing the demarcation 204 of the step 105 being processed and the demarcation image 1170 representing the demarcation 204 of the step 105 immediately preceding it are undetectable.

[0102] The detection of demarcation 204 can be performed using, for example, color extraction such as RGB detection or object matching based on shape. The imaging terminal 120 may also extract the number 1180 of step 105. As a method for extracting the number 1180 of step 105, publicly known digit reading techniques such as OCR or deep learning-based image analysis can be used. However, there is a problem in that the number 1180 of step 105 may not be readable if it is handwritten, dirty, or does not fit within the field of view. In this regard, the 2D code 600 can avoid situations where it is not possible to determine which step 105 the step fixing bolt 303 belongs to.

[0103] The automatic extraction method for bolt detection images 925 is shown as an example where the escalator 101 is operated upward and the left and right step fixing bolts 303 are photographed at the same time, but it is not limited to this. The images may also be taken while the escalator 101 is operated downward, or either the left or right step fixing bolts 303 may be photographed one at a time. Furthermore, images may be taken in two patterns: when the escalator 101 is operated upward and when it is operated downward. In this case, the imaging terminal 120 can compare the images acquired in these imaging operations to eliminate the influence of external disturbances such as lighting, thereby improving the accuracy of the determination.

[0104] Furthermore, to improve the accuracy of the judgment, a guide may be displayed on the output device 805 to instruct the user to position the shooting terminal 120 at a certain distance from the object, facing it directly, and to capture the image parallel to it. Similarly, the still image 924 extracted after shooting may be subjected to techniques such as shape correction using trapezoidal correction, angle correction to ensure parallelism, and brightness correction to equalize the brightness within the image by referencing the brightness of multiple points from the initial image. In addition, although this embodiment shows an example on the upper floor side 114, it may also be carried out on the lower floor side 115.

[0105] Figures 12A and 12B show examples of bolt detection images 925 and pass / fail judgment results 935 displayed on the imaging terminal 120 (screen 1200).

[0106] On screen 1200-1, the pass / fail judgment result 935 is displayed as a list 1210. In list 1210, step number 1211 and judgment result 1212 are displayed in correspondence. The "×" indicating a failure in judgment result 1212 is linked to the bolt detection image 925 corresponding to step number 1211. When "×" is pressed, the bolt detection image 925 is displayed.

[0107] On screen 1200-2, the pass / fail judgment results 935 are displayed as a list 1220 for each step fixing bolt 303. In list 1220, step number 1221 is associated with the left bolt judgment result 1222 and the right bolt judgment result 1223. Step number 1221 has a link to the bolt detection image 925 corresponding to step number 1221. When step number 1221 is pressed, the bolt detection image 925 corresponding to that step number 1221 is displayed.

[0108] According to screen 1200, the supervisor can easily identify the number of step 200 in which the fastening condition was faulty. Furthermore, the supervisor can review the bolt detection image 925, which indicates a faulty fastening condition, enabling them to quickly investigate the cause.

[0109] (II) Addendum The above-described embodiments include, for example, the following:

[0110] In the embodiments described above, the present invention was applied to a passenger conveyor confirmation system. However, the present invention is not limited to this and can be broadly applied to various other systems, devices, methods, and programs.

[0111] Furthermore, although the above-described embodiment uses a two-dimensional code 600 as the recording medium as an example, the present invention is not limited to this. For example, if the amount of information in the two-dimensional code information 700 is small, such as when only the total number of steps 714 is recorded, a barcode may be used. In this case, for example, a barcode reader may be connected to the imaging terminal 120, and the imaging terminal 120 may receive information from the barcode read by the barcode reader.

[0112] Furthermore, although the above-described embodiment mentions the case where the 2D code information 700 includes a total number of steps 714, the present invention is not limited to this. For example, the total number of step fixing bolts 303 may be included instead of or in addition to the total number of steps 714.

[0113] Furthermore, although the above-described embodiments distinguished between the worker and the supervisor, the present invention is not limited to the above distinction. For example, the worker and the supervisor may be the same person or different people. Also, the supervisor may perform some of the worker's tasks, the worker may perform some of the supervisor's tasks, or the worker and the supervisor may perform the tasks together.

[0114] Furthermore, although the above-described embodiment mentions the case where all step 200 numbers are displayed, the present invention is not limited to this. For example, the number of step 200 in which the red washer 304 was not detected may be displayed.

[0115] Furthermore, although the above-described embodiment mentions the case where the pass / fail judgment result 935 is managed using the step number 713 read from the 2D code, the present invention is not limited to this. For example, the number 1180 provided in the frame 201 may be extracted, and the pass / fail judgment result 935 may be managed using the extracted number 1180.

[0116] Furthermore, in the above-described embodiment, part or all of the program may be installed from the program source onto a device such as a computer that implements the shooting terminal 120. The program source may be, for example, a program distribution server connected via a network or a recording medium readable by a computer (e.g., a non-temporary recording medium). Also, in the above description, two or more programs may be implemented as one program, or one program may be implemented as two or more programs.

[0117] Furthermore, in the above-described embodiment, the configuration of each table is merely an example; one table may be divided into two or more tables, or all or part of two or more tables may constitute one table.

[0118] Furthermore, in the above-described embodiment, for the sake of explanation, information related to the passenger conveyor confirmation system was described using a table, but the data structure is not limited to a table. Information related to the passenger conveyor confirmation system may be represented by data structures other than tables, such as XML (Extensible Markup Language), YAML (YAML Ain't a Markup Language), hash tables, tree structures, etc.

[0119] Furthermore, the screens illustrated and described in the above-described embodiments are merely examples, and any design is acceptable as long as the information to be received is the same.

[0120] Furthermore, the screens illustrated and described in the above-described embodiments are merely examples, and any design is acceptable as long as the information presented is the same.

[0121] Furthermore, in the above-described embodiment, the output of information is not limited to display on a screen. The output of information may be audio output by a speaker, output to a file, printed on paper media by a printing device, projected onto a screen by a projector, or in any other form.

[0122] Furthermore, in the above description, information such as programs, tables, and files that implement each function can be stored in memory, storage devices such as hard disks and SSDs (Solid State Drives), or recording media such as IC cards, SD cards, and DVDs.

[0123] The above-described embodiment has, for example, the following characteristic configuration.

[0124] (1) In a passenger conveyor (e.g., escalator 101) comprising a plurality of steps (e.g., step 105, step 200) fixed to a circulating chain (e.g., driving chain 110) by bolts (e.g., step fixing bolts 303), a passenger conveyor confirmation system (e.g., passenger conveyor confirmation system 100) capable of confirming the fastening state of each bolt that fixes each of the plurality of steps to the chain, wherein for each of the plurality of steps, a detection unit (e.g., detection unit 922, circuit, shooting terminal 120, computer capable of communicating with shooting terminal 120) detects the bolt for fixing the step to the chain from an image (e.g., video 911) of the step taken by a shooting terminal (e.g., shooting terminal 120), and the plurality of The system includes: a reading unit (e.g., reading unit 923, circuit, imaging terminal 120, computer capable of communicating with imaging terminal 120) that reads the total number of steps from a recording medium (e.g., 2D code 600) provided on the passenger conveyor, which records information indicating the total number of steps (e.g., total number of steps 714); a determination unit (e.g., determination unit 931, circuit, imaging terminal 120, computer capable of communicating with imaging terminal 120) that determines whether the total number of steps read by the reading unit matches the total number of steps in which bolts are detected by the detection unit; and an output unit (e.g., output unit 932, circuit, imaging terminal 120, computer capable of communicating with imaging terminal 120) that outputs information indicating the result determined by the determination unit (e.g., pass / fail determination result 935, screen 1200).

[0125] According to the above configuration, for example, information is output indicating whether the total number of steps on the passenger conveyor matches the total number of steps on which bolts were detected. Therefore, for example, a supervisor can accurately and easily check which steps do not have bolts installed.

[0126] (2) The recording medium records information indicating a predetermined number of bolts to be provided in each of the multiple steps (for example, the value of 712 bolts to the left and right). The determination unit determines, for each of the multiple steps, whether the number of bolts detected by the detection unit is the predetermined number. The determination unit determines whether the total number of steps matches the total number of steps in which the determination unit determines that the predetermined number of bolts is provided. The output unit outputs the result of the determination by the determination unit for each step (see, for example, screen 1200).

[0127] According to the above configuration, for example, information indicating whether the total number of steps on the passenger conveyor matches the total number of steps in which a predetermined number of bolts have been detected is output for each step. Therefore, for example, a supervisor can easily identify steps in which the predetermined number of bolts have not been installed.

[0128] (3) The recording medium is provided at a predetermined step among the plurality of steps in which installation and removal are performed, and the recording medium records information indicating the number of the predetermined step (for example, step number 713). The reading unit reads the number of the predetermined step from the recording medium and includes an identification unit (for example, an identification unit 933, a circuit, an imaging terminal 120, and a computer capable of communicating with the imaging terminal 120) that identifies the number of each of the plurality of steps based on the number of the predetermined step read by the reading unit and the order in which each of the plurality of steps is photographed by the imaging terminal with respect to the predetermined step. The output unit outputs information indicating the number of the step in which the bolt was not detected by the detection unit (for example, step number 1211 "2", step number 1221 "2") based on the number of each of the plurality of steps identified by the identification unit.

[0129] With the above configuration, information indicating the step number where no bolts were detected is output, so for example, a work supervisor can quickly identify the steps where no bolts are installed.

[0130] (4) Each of the above-mentioned steps is a first step (e.g., step 200) in which a washer (e.g., red washer 304) having a bent portion with one side colored a predetermined color (e.g., red 521) is inserted and a bolt is tightened so that the bent portion is bent so that the one side is exposed, the passenger conveyor is configured to include a second step (e.g., special step 105) in which there is no bolt into which the washer is inserted, the recording medium records information indicating the number of the second step (e.g., step number 731 and special step 733), and the detection unit detects for each of the above-mentioned steps that the step is the same as the photographic terminal From the image captured by the camera, the camera detects the predetermined color for the bolts used to fix the step to the chain. The identification unit identifies the numbers of the first and second steps based on the number of the predetermined step read by the reading unit and the order in which the first and second steps are photographed by the camera with respect to the predetermined step. The determination unit determines whether the number of the second step read by the reading unit matches the number of the step in which the predetermined color was not detected by the detection unit. The output unit outputs information indicating the number of the step in which the determination unit determined they did not match.

[0131] According to the above configuration, when the passenger conveyor is configured to include a first step and a second step, for example, the supervisor will be able to identify if a washer has not been properly inserted in a step where washer insertion is required.

[0132] (5) The recording medium is provided in a location photographed by the imaging terminal together with the bolt provided in the first step (for example, near the step fixing bolt 303), the recording medium is a medium of the predetermined color, and the recording medium has information of a value indicating the predetermined color (for example, the value of the 2D code color information 720) recorded on it, the reading unit reads the value indicating the predetermined color from the recording medium, and the passenger conveyor confirmation system includes a setting unit (for example, a setting unit 934, a circuit, an imaging terminal 120, and a computer capable of communicating with the imaging terminal 120) that sets a threshold for the detection unit to detect the predetermined color based on the value indicating the predetermined color read by the reading unit and the value indicating the color of the recording medium photographed by the imaging terminal.

[0133] According to the above configuration, for example, a threshold for detecting a predetermined color is set according to the environment in which the passenger conveyor is installed, so the detection unit can detect the predetermined color with high accuracy.

[0134] It should be noted that the present invention is not limited to the embodiments described above, and includes various modifications. For example, the embodiments described above are described in detail to make the present invention easier to understand, and are not necessarily limited to those having all the configurations described. Furthermore, it is possible to replace parts of the configuration of one embodiment with the configuration of another embodiment. It is also possible to add configurations from other embodiments to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace parts of other configurations in each embodiment.

[0135] Furthermore, some or all of the above-described configurations, functions, processing units, and processing means may be implemented in hardware, for example, by designing them as integrated circuits. Alternatively, the above-described configurations and functions may be implemented in software by having the processor interpret and execute programs that realize each function. Information such as programs, tables, and files that realize each function can be stored in a recording device such as memory, a hard disk, or an SSD, or in a recording medium such as an IC card, an SD card, or a DVD.

[0136] Furthermore, the control lines and information lines shown are those deemed necessary for explanatory purposes, and not all control lines and information lines are necessarily shown in the actual product. In reality, it can be assumed that almost all components are interconnected.

[0137] It should be understood that items included in a list in the form "at least one of A, B, and C" can mean (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C). Similarly, items listed in the form "at least one of A, B, or C" can mean (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C). [Explanation of Symbols]

[0138] 100... Passenger conveyor confirmation system, 105... Step, 120... Camera terminal.

Claims

1. A passenger conveyor confirmation system that can confirm the fastening state of each bolt that secures each of the plurality of steps to the chain in a passenger conveyor that includes a plurality of steps secured by bolts to a circulating chain, comprising: a detection unit that detects, for each of the plurality of steps, a bolt for fixing the step to the chain from an image of the step photographed by an imaging terminal; a reading unit that reads the total number of steps from a recording medium provided on the passenger conveyor on which information indicating the total number of steps is recorded; a determination unit that determines whether or not the total number of the plurality of steps read by the reading unit matches the total number of steps in which bolts are detected by the detection unit; an output unit that outputs information indicating the result of the determination by the determination unit; A passenger conveyor verification system comprising:

2. information indicating a predetermined number of bolts to be provided in each of the plurality of steps is recorded on the recording medium; the determination unit determines whether or not the number of bolts detected by the detection unit is the predetermined number for each of the plurality of steps, and determines whether or not the total number of the plurality of steps matches the total number of steps in which it has been determined that the predetermined number of bolts is provided; the output unit outputs the result of the determination by the determination unit for each step.

2. The passenger conveyor verification system of claim 1.

3. the recording medium is provided at a predetermined step where the recording medium is attached and detached among the plurality of steps; information indicating the number of the predetermined step is recorded on the recording medium; the reading unit reads the number of the predetermined step from the recording medium; an identification unit that identifies the number of each of the plurality of steps based on the number of the predetermined step read by the reading unit and the order in which each of the plurality of steps is photographed by the photographing terminal with reference to the predetermined step; the output unit outputs information indicating the number of a step in which no bolt was detected by the detection unit, based on the number of each of the plurality of steps identified by the identification unit.

2. The passenger conveyor verification system of claim 1.

4. Each of the plurality of steps is a first step in which a washer having a bent portion, one surface of which is colored in a predetermined color, is inserted, a bolt is tightened, and the bent portion is bent so that the one surface appears; the passenger conveyor includes a second step in which no bolt is provided and into which the washer is inserted; information indicating the number of the second step is recorded on the recording medium; the detection unit detects, for each of the plurality of steps, the predetermined color of a bolt for fixing the step to the chain from an image of the step photographed by the photographing terminal; The identification unit identifies the numbers of the first step and the second step based on the number of the predetermined step read by the reading unit and the order in which the first step and the second step are photographed by the photographing terminal with respect to the predetermined step; the determination unit determines whether or not the number of the second step read by the reading unit matches the number of the step in which the predetermined color was not detected by the detection unit; the output unit outputs information indicating the step numbers of the steps determined by the determination unit to be inconsistent.

4. The passenger conveyor verification system of claim 3.

5. the recording medium is provided at a location where an image is taken by the photographing terminal together with a bolt provided at the first step, the recording medium is a medium of the predetermined color, information indicating a value of the predetermined color is recorded on the recording medium; the reading unit reads a value indicating the predetermined color from the recording medium; a setting unit that sets a threshold value for the detection unit to detect the predetermined color based on a value indicating the predetermined color read by the reading unit and a value indicating the color of the recording medium photographed by the photographing terminal; 5. The passenger conveyor verification system of claim 4.

Images