Inspection Equipment

Abstract

To provide an inspection device capable of being easily installed when inspecting steps of a passenger conveyor.SOLUTION: An inspection device includes an imaging device capable of imaging an image of a step used for inspection of a passenger conveyor, which includes steps provided with demarcations in respective boundaries between treads. The inspection device includes a calculation unit for calculating a brightness value indicating the degree of brightness of each of a plurality of images obtained by sequentially photographing one step in inspection operation of the passenger conveyor, a determination unit for determining whether or not the inspection device is installed at a predetermined position based on the fluctuation quantity of the brightness value calculated by the calculation unit, and an output unit for outputting a result determined by the determination unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] FIELD OF THE INVENTION The present invention relates generally to techniques for inspecting passenger conveyors. [Background technology]

[0002] Passenger conveyors such as escalators are devices that transport people within buildings and are essential in urban spaces. In a passenger conveyor, the steps on which people stand are fixed via several components to a looped chain. The chain engages with gear-like components called sprockets, and the steps of the passenger conveyor are driven by rotating the sprockets.

[0003] In passenger conveyors with such drive mechanisms, the steps are the parts that come into contact with passengers, and are inspected regularly to maintain their normal condition. When inspecting the steps, it is important to check whether they are properly secured, and workers must ensure that the components used to secure the steps are properly installed. To ensure that inspections are completed quickly and reliably without causing inconvenience to passengers, cameras are used for inspections.

[0004] In recent years, a device has been disclosed that uses an image sensor to detect abnormalities in the steps of an escalator (see Patent Document 1). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-180187 Summary of the Invention [Problem to be solved by the invention]

[0006] For example, if a camera detects dirt or damage large enough to capture an image, the escalator must be stopped and maintenance work performed. However, since escalators are used as a means of transporting people within a building, maintenance work is carried out in a planned manner according to usage, and it is desirable to keep the steps in good condition through regularly scheduled maintenance work.

[0007] The device described in Patent Document 1 detects abnormalities such as tilted steps or improper installation using an image sensor installed in advance at the inverted part of the escalator steps. Although the device described in Patent Document 1 can detect abnormalities in the steps, because the image sensor is installed inside the escalator, it is necessary to consider the impact that dust and other factors that may accumulate over time may have on the detection of abnormalities. In addition, when an abnormality is detected, workers must head to the site, which can result in a long time being required before work can begin to address the abnormality.

[0008] For these reasons, there is a need for an inspection device that can be installed by an operator so that abnormalities can be detected during regularly scheduled maintenance work and inspections can be completed in a short amount of time.

[0009] The present invention has been made in consideration of the above points, and aims to propose an inspection device etc. that can be easily installed for inspecting steps of a passenger conveyor. [Means for solving the problem]

[0010] In order to solve such problems, the present invention provides an inspection device equipped with an imaging device capable of capturing images of steps used in inspecting a passenger conveyor that includes steps with demarcations at the boundaries of the tread, and is provided with: a calculation unit that calculates a brightness value indicating the degree of brightness of an image for each of a plurality of images captured sequentially of one step during inspection operation of the passenger conveyor; a determination unit that determines whether the inspection device is installed in a predetermined position based on the amount of variation in the brightness value calculated by the calculation unit; and an output unit that outputs the result determined by the determination unit.

[0011] In the above configuration, the result of determining whether the inspection device is installed in a predetermined position is output, so that, for example, an operator can install the inspection device in an appropriate position. With the above configuration, for example, the time required for re-inspection due to a failed photograph can be reduced, thereby reducing the time the passenger conveyor is stopped due to inspection and the time that users cannot use the conveyor due to maintenance work. [Effects of the Invention]

[0012] According to the present invention, it is possible to realize a highly convenient inspection device. Problems, configurations, and effects other than those described above will become apparent from the following description of the embodiments. [Brief explanation of the drawings]

[0013] [Figure 1] 1 is a diagram illustrating an example of a configuration of an inspection system according to a first embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a configuration of an image capturing terminal according to the first embodiment. [Figure 3] FIG. 2 is a diagram showing an example of an image according to the first embodiment. [Figure 4] FIG. 2 is a diagram showing an example of a detection area according to the first embodiment. [Figure 5] FIG. 2 is a diagram showing an example of an image according to the first embodiment. [Figure 6] FIG. 3 is a diagram showing an example of a setting screen according to the first embodiment. [Figure 7] FIG. 4 is a diagram showing an example of a process related to installation of a photographing terminal according to the first embodiment. [Figure 8] FIG. 10 is a diagram illustrating an example of the configuration of an inspection system according to a second embodiment. [Figure 9] FIG. 10 is a diagram illustrating an example of the configuration of an imaging terminal according to the second embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a video according to the second embodiment. [Figure 11] FIG. 10 is a diagram showing an example of a detection area according to the second embodiment. [Figure 12] FIG. 10 is a schematic diagram showing fluctuations in average luminance value according to the second embodiment. [Figure 13] FIG. 10 is a schematic diagram showing fluctuations in average luminance value according to the second embodiment. [Figure 14] FIG. 10 is a diagram illustrating an example of a process related to installation of a photographing terminal according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0014] (I) First embodiment An embodiment of the present invention will be described in detail below, but the present invention is not limited to the embodiment.

[0015] Conventionally, inspection systems inspect passenger conveyors that have steps operated by a loop-shaped circulation drive mechanism and an opening that can be opened and closed during maintenance work near the end of the loop (the step reversal part). Maintenance work on passenger conveyors involves checking the condition of the steps. During this inspection, it is important to confirm that the steps are properly secured, and workers must ensure that the components securing the steps are properly attached. Because workers can visually check the securing components at the step reversal part, they check the condition of the securing components at the reversal part during maintenance work. While a single passenger conveyor has many steps, there are only a limited number of places where the status can be visually confirmed, and there is a limit to the number of people who can be present during the inspection work during a single passenger conveyor operation.

[0016] Furthermore, to avoid causing inconvenience to users, the inspection work must be completed reliably and quickly. Furthermore, the environments in which passenger conveyors are installed (installation environments) are diverse, and the time periods during which maintenance work is performed are also diverse. Therefore, the amount of light irradiated onto the passenger conveyor varies depending on the surrounding environment. Therefore, when using a camera for inspection, the camera must be installed so that it can photograph the steps (capture images of the steps) and perform inspections in a variety of environments.

[0017] However, in order to install the camera appropriately according to the installation environment, various conditions such as the camera installation position and the ambient light conditions must be taken into consideration, and if appropriate photography cannot be taken, re-measurements may be required, which may take time to take the photographs.

[0018] In this regard, the inspection system of this embodiment uses a photographing terminal installed at the inverted part of the steps of the passenger conveyor during maintenance work to simultaneously photograph the step fixing bolts and part of the step including the demarcation, and inspects the installation status of the steps of the passenger conveyor while the passenger conveyor is operating.

[0019] The photographing terminal sets a detection area for detecting step movement in the photographed video (step movement within the screen displaying the video). The detection area is, for example, rectangular, and is provided so that the long side of the rectangle is perpendicular to the direction of step movement. For example, the photographing terminal determines the installation state of the photographing terminal based on the amount of variation in the brightness value of the detection area, and notifies the worker of the determination result. The brightness value is an index indicating the brightness of the image within the detection area. In the following, the brightness value will be described using a brightness value indicating the brightness of the image as an example, but is not limited to a brightness value. For example, the brightness value may be a brightness value indicating the brightness of the image.

[0020] The passenger conveyor may be an escalator, a moving walkway, etc. In the following, an escalator will be used as an example of the passenger conveyor.

[0021] The designations "first," "second," "third," etc. in this specification are used to identify components and do not necessarily limit the number or order. Furthermore, numbers used to identify components are used in different contexts, and numbers used in one context do not necessarily indicate the same configuration in another context. Furthermore, this does not prevent a component identified by a certain number from also serving the function of a component identified by another number.

[0022] Next, an embodiment of the present invention will be described with reference to the drawings. The following description and drawings are examples for explaining the present invention, and some omissions and simplifications have been made as appropriate for clarity of explanation. The present invention can be implemented in various other forms. Unless otherwise specified, each component may be singular or plural.

[0023] In the following description, identical elements in the drawings are given the same numbers, and descriptions thereof will be omitted where appropriate. Furthermore, when describing elements of the same type without distinction, the common portion (the portion excluding the branch number) of the reference sign including the branch number will be used, and when describing elements of the same type with distinction, the reference sign including the branch number will be used. For example, when describing a bolt without distinction, it will be written as "bolt 115," and when describing individual bolts with distinction, it will be written as "bolt 115-1," "bolt 115-2," etc.

[0024] In Fig. 1, 100 indicates an inspection system according to a first embodiment as a whole. Fig. 1 is a diagram showing an example of the configuration of the inspection system 100. Fig. 1 shows the escalator 110 as seen from the front of the entrance / exit of the escalator 110.

[0025] An opening 112 is provided in a horizontal housing portion 111 at the entrance and exit of the escalator 110. Steps 113 of the escalator 110 can be seen from the opening 112. In order to improve visibility when a person steps on the step 113, the step 113 is provided with a conspicuous color (demarcation 114) such as yellow around (on the boundary) the surface (tread) on which people stand. The step 113 is also fixed to the chain of the escalator 110 via members such as bolts 115. Two or more bolts 115 may be provided for each step 113.

[0026] Here, step 113 is fixed to the chain of escalator 110 via several members. More specifically, step 113 is connected to an endless drive chain by a plurality of bolts 115. When connected by bolt 115, a tongued washer (red washer) with three tongues, one of which is painted red, is inserted. Note that the color of the tongued washer is not limited to red, and may be another color (predetermined color).

[0027] For example, when replacing step 113 during maintenance work on escalator 110, step 113 is removed and installed by removing and installing bolt 115. When installing step 113, the fastening state of bolt 115 is checked. After tightening bolt 115 to a specified torque using a fastening tool, a worker inserts a red washer and bends one of the three tongues vertically, thereby displaying the red color painted on only one side. The red display caused by the bending of the red washer is detected by photographing terminal 120, and it is determined whether the fastening state of bolt 115 is appropriate. In inspection system 100, photographing terminal 120 is installed so that red washer can be detected with high accuracy.

[0028] The photographing terminal 120 is an example of an inspection device, and is installed in a position close to the opening 112 via a jig 130. The jig 130 is an example of a tool used to fix the installation of the photographing terminal 120, and is a tripod, a stand, an arm, or the like.

[0029] FIG. 2 is a diagram showing an example of the configuration of the photographing terminal 120. As shown in FIG.

[0030] The photographing terminal 120 is a smartphone, tablet terminal, notebook computer, etc., which has an imaging function and an information processing function. Note that the photographing terminal 120 may be realized by combining an imaging means such as a digital camera or digital video camera with an information processing means such as a processor.

[0031] For example, the photographing terminal 120 includes a processor 210 , a main memory device 220 , an auxiliary memory device 230 , an input device 240 , an output device 250 , a communication device 260 , and an imaging device 270 .

[0032] The processor 210 is a device that performs arithmetic processing and is, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), an artificial intelligence (AI) chip, or the like.

[0033] The main memory device 220 is a device that stores programs, data, etc. The main memory device 220 is, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The ROM is, for example, an SRAM (Static Random Access Memory), an NVRAM (Non Volatile RAM), a Mask ROM (Mask Read Only Memory), a PROM (Programmable ROM), etc. The RAM is, for example, a DRAM (Dynamic Random Access Memory).

[0034] The auxiliary storage device 230 is a hard disk drive (HDD), a flash memory, a solid state drive (SSD), an optical storage device, etc. The optical storage device is a compact disc (CD), a digital versatile disc (DVD), etc. The programs, data, etc. stored in the auxiliary storage device 230 are read into the main storage device 220 as needed.

[0035] The input device 240 is a user interface that receives information from a worker, and is, for example, a keyboard, a mouse, a card reader, a touch panel, or the like.

[0036] The output device 250 is a user interface that outputs various types of information (display output, audio output, print output, etc.). The output device 250 is, for example, a display device that visualizes various types of information, an audio output device (speaker), a printer, etc. The display device is an LCD (Liquid Crystal Display), a graphics card, etc.

[0037] The communication device 260 is a communication interface that communicates with other devices via a communication medium. The communication device 260 is, for example, a network interface card (NIC), a wireless communication module, a universal serial interface (USB) module, a serial communication module, etc. The communication device 260 can also function as an input device that receives information from other devices that are communicatively connected. The communication device 260 can also function as an output device that transmits information to other devices that are communicatively connected.

[0038] The imaging device 270 includes an imaging lens, an imaging element, etc., and converts an optical image formed by the imaging lens into an electrical signal using the imaging element. The imaging device 270 is configured with a CCD (Charge Coupled Device) sensor, a CMOS (Complementary Metal Oxide Semiconductor) sensor, etc.

[0039] The functions of the photographing terminal 120 (such as the input unit 221, the calculation unit 222, the determination unit 223, and the output unit 224) may be realized, for example, by the processor 210 reading a program stored in the auxiliary storage device 230 into the main storage device 220 and executing it (software), or may be realized by hardware such as a dedicated circuit, or may be realized by a combination of software and hardware. Note that one function of the photographing terminal 120 may be divided into multiple functions, or multiple functions may be combined into one function. Also, some of the functions of the photographing terminal 120 may be provided as separate functions, or may be included in other functions. Also, some of the functions of the photographing terminal 120 may be realized by another computer capable of communicating with the photographing terminal 120.

[0040] The input unit 221 inputs (acquires) video captured by the imaging device 270, and performs image processing on the acquired video to acquire an image (still image). The photographing terminal 120 extracts a bolt detection image for detecting the bolt 115 from the image acquired by the input unit 221, and extracts (detects) the red color of the red washer from the extracted bolt detection image. The photographing terminal 120 also calculates the area of ​​the detected red color (hereinafter, red area), and determines whether the fastening state of the bolt 115 is good or bad based on the red area. For example, the photographing terminal 120 determines that the step 113 is properly attached (pass) for a bolt 115 for which red is detected, and determines that the step 113 is not properly attached (fail) for a bolt 115 for which red is not detected.

[0041] The calculation unit 222 calculates the brightness value for video (each of a plurality of images) in which one step 113 is sequentially captured during inspection operation of the escalator 110. The determination unit 223 determines whether or not the photographing terminal 120 is installed at a predetermined position (for example, a predetermined distance from the opening 112, a predetermined distance from the step 113) based on the amount of variation in the brightness value calculated by the calculation unit 222. The output unit 224 outputs the result of the determination by the determination unit 223 to the auxiliary storage device 230, the output device 250, etc. For example, the auxiliary storage device 230 stores information indicating a maintenance work plan, bolt detection images, the result of the determination by the determination unit 223, etc. Additionally, the auxiliary storage device 230 may be provided in an external server device. Furthermore, for example, the output device 250 displays the result of the determination by the determination unit 223, etc.

[0042] Fig. 3 is a diagram showing an example of an image (image 300) captured by the photographing terminal 120 when the photographing terminal 120 is installed as shown in Fig. 1. The image 300 is displayed on a screen 301 of the output device 250 of the photographing terminal 120. The screen 301 is a rectangle that is longer in the horizontal direction (X-axis direction) than in the vertical direction (Y-axis direction).

[0043] In the image 300, a step image 310 showing the step 113 of the escalator 110 and a bolt image 320 showing the bolt 115 for fixing the step 113 are displayed large on the screen 301.

[0044] Here, during inspection, an image is captured so that at least one of the bolts 115 that secure the step 113 is included in the angle of view. For example, if the photographing terminal 120 is installed so that only one of the two bolts 115 is included in the angle of view, then a separate image capture with an angle of view that includes the other bolt 115 is required. In other words, during inspection, the states of all of the bolts 115 must be determined. Note that image 300 is an example of an image captured so that one bolt 115 is included in the angle of view.

[0045] For example, if photography is performed for a predetermined time while the escalator 110 is in operation and video is acquired (for example, if a series of images is acquired during inspection operation), the step images 310 are displayed as if they are moving from top to bottom or bottom to top within the screen 301. The direction of movement is determined by the relationship between the installation location of the photography terminal 120 and the operating direction of the escalator 110.

[0046] For example, when the reverse section at the bottom (lower side) of escalator 110 is photographed as shown in Fig. 1, step image 310 moves from bottom to top in screen 301 when escalator 110 is in ascending operation. Also, when the reverse section at the bottom of escalator 110 is photographed, step image 310 moves from top to bottom in screen 301 when escalator 110 is in descending operation.

[0047] On the other hand, for example, when the inverted portion at the top (upper side) of escalator 110 is photographed (not shown), if escalator 110 is in ascending operation, step image 310 moves from top to bottom within screen 301. Also, for example, when the inverted portion at the top of escalator 110 is photographed, if escalator 110 is in descending operation, step image 310 moves from bottom to top within screen 301.

[0048] Here, image 300 is an image obtained by enlarging and capturing steps 113 of escalator 110. In other words, of the demarcations 114 present around step 113, the front and back portions of the tread surface of step 113 are captured as a line having a certain length in the horizontal direction (longitudinal direction) on screen 301. In photographing terminal 120, an area (detection area) for detecting this line portion is provided on screen 301 (image).

[0049] FIG. 4 is a diagram showing an example of a detection area (detection area 400).

[0050] Detection area 400 is an area for detecting demarcation image 311 showing demarcation 114, and extends in the horizontal direction of screen 301. Note that the shape of detection area 400 is not limited to a rectangle, and may be other shapes such as an elongated trapezoid or an elongated oval.

[0051] Here, the parts of escalator 110 other than demarcation image 311 are dark images overall, whereas demarcation image 311 is a bright image, so the brightness of demarcation image 311 is relatively high within screen 301. For example, in a series of images, when step image 310 moves from top to bottom within screen 301, the bright part of demarcation image 311 moves from top to bottom within screen 301.

[0052] In the series of images, the demarcation image 311 moves up and down within the screen 301, so it is preferable that the horizontal direction of the detection area 400 be set in the left-right direction perpendicular to the up-down direction (movement direction) of the demarcation image 311.

[0053] For example, when the average (average brightness value) of the brightness values ​​of each pixel of the image in detection area 400 is calculated, the average brightness value becomes relatively large when demarcation image 311 is included in detection area 400, and becomes relatively small when demarcation image 311 is not included in detection area 400. Therefore, if photographing terminal 120 is installed so that there is a time when demarcation image 311 is included in detection area 400 when escalator 110 is in operation, the brightness value of detection area 400 becomes large when demarcation image 311 is present in detection area 400, and becomes small when demarcation image 311 is not present in detection area 400.

[0054] By determining the amount of variation in the brightness value of the detection area 400, the photographing terminal 120 can determine whether the photographing terminal 120 is installed so that the detection area 400 in the screen 301 includes the demarcation image 311. The result of the determination is notified to the worker, so the worker can determine whether the installation state of the photographing terminal 120 is appropriate. Note that since the escalator 110 operates at a constant speed, by detecting the timing at which the demarcation image 311 passes while the escalator 110 is operating at a constant speed, it is possible to identify an image (bolt detection image) that can inspect the fastening state of the bolt 115 based on the relationship between the timing of the passage and the position of the detection area 400 in the screen 301.

[0055] FIG. 5 is a diagram showing an example of an image (image 500) when the photographing terminal 120 is placed so as to photograph the entire step 113.

[0056] As shown in FIG. 5, the detection area 400 includes a larger area relative to the step image 310 than in the case shown in FIG. 4. The detection area 400 is an area for evaluating whether the demarcation image 311 is present within the detection area 400. Therefore, it is desirable that the detection area 400 be set so that the demarcation image 311 fills the entire detection area 400. To achieve this, it is possible to reduce the size of the detection area 400, but if the size of the detection area 400 is small, the detection accuracy may decrease depending on the state of contamination of the demarcation 114, etc. Therefore, the detection area 400 needs to be set to a certain extent so as to include the demarcation image 311 within the detection area 400.

[0057] Here, the size of the detection area 400 relative to the step image 310 varies depending on how far the photographing terminal 120 is installed relative to the step 113. Therefore, the worker adjusts the size of the detection area 400 by moving the photographing terminal 120 or by operating the input device 240 of the photographing terminal 120 to change the size of the detection area 400 so that it is appropriate for the installation state.

[0058] 6 is a diagram showing an example of a setting screen (setting screen 600) for changing the size of the detection area 400. The setting screen 600 may be displayed on the output device 250 in response to a predetermined operation by an operator, or may be displayed on the output device 250 in response to the result of determining the installation state.

[0059] The setting screen 600 is configured to include an adjustment unit 601 that can change the size of the detection area 400. The operator operates the adjustment unit 601 to adjust the size of the detection area 400, more specifically, the positions of the four sides of the rectangle of the detection area 400, while checking the captured step image 310 and the size of the detection area 400. The adjustment unit 601 changes the vertical length of the detection area 400 or the horizontal length of the detection area 400 in response to an operation of the input device 240. The adjustment unit 601 may be a user interface for moving the position of the detection area 400.

[0060] FIG. 7 is a diagram showing an example of a process related to the installation of the photographing terminal 120. In FIG.

[0061] In S701, the photographing terminal 120 acquires an image. The worker sets up the photographing terminal 120, the jig 130, and other equipment, sets the photographing terminal 120 to a measurement state, operates the escalator 110 for a predetermined time or for several steps 113, and photographs the image using the photographing terminal 120.

[0062] In S702, the photographing terminal 120 sets a detection area 400 for the video (image) acquired in S701. For example, the worker checks the image displayed on the screen 301 of the output device 250, and if the demarcation image 311 does not fill the entire detection area 400, adjusts the size or position of the detection area 400 via the adjustment unit 601.

[0063] In S703, the photographing terminal 120 calculates the brightness values ​​within the detection area 400 in the images at each time of the video acquired in S701. For example, the photographing terminal 120 calculates the average (average brightness value) of the values ​​obtained by grayscale conversion (converting a color image into an image expressed in white, gray, or black) for each pixel of the image within the detection area 400. For the grayscale conversion, known methods such as a method of calculating the average by weighting each of the RGB brightnesses (for example, the NTSC weighted average method), a median method, a simple average method, or a median method can be used.

[0064] In S704, the photographing terminal 120 calculates the peak (for example, the maximum value) of the brightness value of the detection area 400. The photographing terminal 120 identifies the highest average brightness value (the average brightness value when the detection area 400 contains the most demarcation images 311) in the video acquired in S701 as the peak brightness value.

[0065] In S705, the photographing terminal 120 calculates a base of the brightness value of the detection area 400. For example, the photographing terminal 120 calculates, as the base of the brightness value, the average of the average brightness values ​​of images acquired in the video acquired in S701 during a time excluding a predetermined time before and after the peak of the brightness value (the average of the average brightness values ​​of images in which the demarcation image 311 is not included in the detection area 400).

[0066] In S706, the photographing terminal 120 determines whether the amount of variation in the brightness value is equal to or greater than a threshold. If the photographing terminal 120 determines that the amount of variation in the brightness value is equal to or greater than the threshold, it proceeds to S707, and if it determines that the amount of variation in the brightness value is less than the threshold, it proceeds to S709. In S706, the photographing terminal 120 calculates the difference between the peak brightness value and the base brightness value as the amount of variation in the brightness value. Note that the photographing terminal 120 may also calculate the slope of the peak (for example, the difference between the average brightness value of the peak and the average brightness value immediately before or after the peak) as the amount of variation in the brightness value.

[0067] In S707, the photographing terminal 120 determines whether the base of the brightness value is within a specified range (more broadly, whether the base of the brightness value exceeds a threshold, that is, whether the base of the brightness value is less than a first threshold and / or whether the base of the brightness value exceeds a second threshold). If the photographing terminal 120 determines that the base of the brightness value is within the specified range, it proceeds to S708, and if it determines that the base of the brightness value is outside the specified range, it proceeds to S710.

[0068] In S708, the photographing terminal 120 outputs information indicating that the photographing terminal 120 is correctly installed (installation OK).

[0069] In S709, the photographing terminal 120 outputs information indicating that the installation position of the photographing terminal 120 needs to be corrected (installation NG). For example, the photographing terminal 120 instructs the installation position to be reviewed so that the photographing terminal 120 is closer to step 113.

[0070] In S710, the output device 250 of the photographing terminal 120 outputs information indicating that the installation environment needs to be corrected (installation NG).

[0071] In the installation environment of the photographing terminal 120, if the base luminance value is outside the specified range, the luminance value of the detection area 400 may be extremely high due to external light or extremely low due to the influence of shadows from surrounding structures. Therefore, if the base luminance value is outside the specified range, the photographing terminal 120 displays on the output device 250 that the lighting conditions in the installation environment need to be improved.

[0072] Furthermore, for example, the photographing terminal 120 may notify the worker of the lighting conditions of the installation environment based on the amount of fluctuation in the brightness value of the detection area 400 and the base of the brightness value. In this case, if the base of the brightness value is smaller than the first threshold, it means that the demarcation 114 portion is dark, so the photographing terminal 810 presents environmental condition check items to be corrected, such as the brightness of the entire environment and whether a shadow is falling on the step 113 portion. Also, if the base of the brightness value is larger than the second threshold, it means that the demarcation 114 portion is too bright, so the photographing terminal 120 presents environmental condition check items to be corrected, such as whether halation due to external light is occurring.

[0073] In this way, if halation, shadows, etc. caused by external light are a problem, it may be possible to improve the situation by changing the positional relationship between the photographing terminal 120 and the escalator 110. In this case, the brightness value of the entire screen 301 is compared with the brightness value of the detection area 1100, and if the brightness value of only the detection area 400 is greater than or less than the threshold value, a message is displayed indicating that there is a possibility of halation, shadows, etc. caused by external light.

[0074] According to this embodiment, when inspecting the passenger conveyor, the worker can properly and easily install the inspection device.

[0075] (II) Second embodiment This embodiment differs from the first embodiment in that if the imaging terminal is installed at an angle so as not to be parallel to the longitudinal direction of the step, information is output to allow the worker to correct the installation direction of the imaging terminal. In this embodiment, the same components as in the first embodiment are denoted by the same reference numerals and their description will be omitted as appropriate.

[0076] 8 is a diagram showing an example of the configuration of an inspection system 800 according to this embodiment. The inspection system 800 includes an image capturing terminal 810.

[0077] 9 is a diagram showing an example of the configuration of the photographing terminal 810. The photographing terminal 810 includes a setting unit 900. The setting unit 900 sets a plurality of detection areas for the calculation unit 222 to calculate brightness values.

[0078] Here, when the photographing terminal 120 according to the first embodiment is installed at an angle with respect to the escalator 110, the image (video) acquired by the photographing terminal 120 will be as shown in FIG.

[0079] FIG. 10 is a diagram showing an example of an image (image 1000) captured by the photographing terminal 120 when the photographing terminal 120 is installed at an angle with respect to the escalator 110. As shown in FIG.

[0080] 10, the detection area 400 does not partially overlap the demarcation image 311. In other words, the detection area 400 is not completely filled with the demarcation image 311.

[0081] For example, when the amount of variation in brightness values ​​within the detection area 400 is calculated in a state in which the photographing terminal 120 is installed, such as the photographing terminal 810 shown in Fig. 8, it turns out that there are high brightness areas and low brightness areas within the detection area 400, and the amount of variation in brightness values ​​as a whole becomes small. In this case, it may be possible to address this by reducing the size of the detection area 400 in the adjustment unit 601, but as mentioned above, reducing the size of the detection area 400 may result in a decrease in detection accuracy. Therefore, rather than addressing this by reducing the size of the detection area 400, it is desirable to correct the installation state of the photographing terminal 120 so that the image 300 shown in Fig. 3 can be obtained.

[0082] In this embodiment, in order to assist in correcting the installation state of the photographing terminal 810, a configuration is adopted in which the long side of the detection area 400 is divided into two in the longitudinal direction (horizontal direction) within the screen 301.

[0083] FIG. 11 is a diagram showing an example of a detection area (detection area 1100) in the inspection system 800. As shown in FIG.

[0084] In the inspection system 800, a first detection area 1100-1 and a second detection area 1100-2 are provided on the screen 301 as shown in FIG.

[0085] When the photographing terminal 810 is properly installed, the first detection area 1100-1 and the second detection area 1100-2 each contain the demarcation image 311 at the same time, but when the photographing terminal 810 is installed as shown in Figure 8, the first detection area 1100-1 and the second detection area 1100-2 each contain the demarcation image 311 at different times.

[0086] 12 and 13 are schematic diagrams showing fluctuations in the average brightness value of the detection area 1100. FIG.

[0087] When the installation state of the photographing terminal 810 is parallel to the horizontal direction of the step 113 as in Fig. 1, the timing at which the average brightness value 1200 changes is the same (almost the same) for the average brightness value 1200-1 of the first detection area 1100-1 and the average brightness value 1200-2 of the second detection area 1100-2 as shown in Fig. 12. On the other hand, when the installation state of the photographing terminal 810 is tilted with respect to the horizontal direction of the step 113 as in Fig. 8, the timing at which the average brightness value 1300 changes is different for the average brightness value 1300-1 of the first detection area 1100-1 and the average brightness value 1300-2 of the second detection area 1100-2 as shown in Fig. 13.

[0088] 12, the waveform of the average brightness value 1200 in the detection area 1100 obtained from each of the first detection area 1100-1 and the second detection area 1100-2 becomes a waveform with a certain peak when the demarcation image 311 passes through the detection area 1100. When the waveform of the average brightness value 1200 exceeds the peak, the photographing terminal 810 determines that the demarcation image 311 has passed through the detection area 1100.

[0089] Furthermore, the photographing terminal 810 detects the maximum value of the waveform of the average brightness value obtained from the series of images as a peak. Then, if the time difference between the peak times of the waveform of the average brightness value between the first detection area 1100-1 and the second detection area 1100-2 is smaller than a predetermined value, the photographing terminal 810 determines that the installation state of the photographing terminal 810 is appropriate and notifies the worker to that effect. On the other hand, if the time difference between the peak times of the waveform of the average brightness value is larger than a predetermined value, the photographing terminal 810 determines that the installation state of the photographing terminal 810 needs to be corrected and notifies the worker to that effect.

[0090] In addition, the photographing terminal 810 may determine in which direction to correct the photographing terminal 810 based on the relationship between the timing of the peak of the average brightness value in the first detection area 1100-1 and the second detection area 1100-2 and the direction of movement of the step image 310 on the screen 301, and notify the worker of the direction of correction.

[0091] FIG. 14 is a diagram showing an example of a process related to installation of the photographing terminal 810. In FIG.

[0092] In S1401, the photographing terminal 810 acquires an image. The worker sets up the photographing terminal 810, the jig 130, and other equipment, sets the photographing terminal 810 to a measurement state, operates the escalator 110 for a predetermined time or for several steps 113, and photographs the image using the photographing terminal 810.

[0093] In S1402, the photographing terminal 810 sets a plurality of detection areas 1100 for the video (image) acquired in S1401. For example, the photographing terminal 810 sets a first detection area 1100-1 and a second detection area 1100-2.

[0094] In S1403, the photographing terminal 810 calculates the brightness value within the detection area 1100 in the image at each time for each detection area 1100. For example, the photographing terminal 120 calculates the average (average brightness value) of the grayscale converted values ​​for each pixel of the image within the detection area 1100.

[0095] In S1404, the photographing terminal 810 calculates the peak (for example, the maximum value) of the brightness value of each detection area 1100. The photographing terminal 810 specifies the highest average brightness value for each detection area 1100 in the video acquired in S1401 (the average brightness value when the most demarcation images 311 are included in each detection area 1100) as the peak brightness value.

[0096] In S1405, the photographing terminal 810 calculates a base of the brightness value of each detection area 1100. For example, the photographing terminal 120 calculates, as the base of the brightness value, for each detection area 1100 in the video acquired in S1401, the average of the average brightness values ​​of images acquired during a time excluding a predetermined time before and after the peak of the brightness value (the average of the average brightness values ​​of images that do not include the demarcation image 311 in each detection area 1100).

[0097] In S1406, the photographing terminal 810 calculates the time difference between the peaks of the brightness values ​​in each detection area 1100. For example, the photographing terminal 810 calculates the difference (peak time difference) between the peak time of the average brightness value of the first detection area 1100-1 and the peak time of the average brightness value of the second detection area 1100-2.

[0098] In S1407, the photographing terminal 810 determines whether the amount of variation in brightness value is equal to or greater than a threshold. If the photographing terminal 810 determines that the amount of variation in brightness value is equal to or greater than the threshold, it proceeds to S1408, and if it determines that the amount of variation in brightness value is less than the threshold, it proceeds to S1411. In S1407, the photographing terminal 120 may determine whether the amount of variation in brightness value of at least one detection area 1100 is equal to or greater than a threshold, or may determine whether the amount of variation in brightness value of all detection areas 1100 is equal to or greater than a threshold.

[0099] In S1408, the photographing terminal 810 determines whether the base of the brightness value is within a specified range. If the photographing terminal 810 determines that the base of the brightness value is within the specified range, it shifts the process to S1409, and if it determines that the base of the brightness value is outside the specified range, it shifts the process to S1412. In S1408, the photographing terminal 810 may determine whether the base of the brightness value of at least one detection area 1100 is within the specified range, or may determine whether the base of the brightness value of all detection areas 1100 is within the specified range.

[0100] In S1409, the photographing terminal 810 determines whether the time difference between the peaks is equal to or less than a predetermined value. If the photographing terminal 810 determines that the time difference between the peaks is equal to or less than the predetermined value, it shifts the process to S1410, and if it determines that the time difference between the peaks exceeds the predetermined value, it shifts the process to S1413.

[0101] In S1410, the photographing terminal 810 outputs information indicating that the photographing terminal 810 is correctly installed (installation OK).

[0102] In S1411, the photographing terminal 810 outputs information indicating that the installation position of the photographing terminal 810 needs to be corrected (installation NG).

[0103] In S1412, the photographing terminal 810 outputs information indicating that the installation environment needs to be corrected (installation NG).

[0104] In S1413, the photographing terminal 810 outputs information indicating the installation direction (NG installation).

[0105] Here, the corrected direction of the photographing terminal 810 (output installation direction) differs depending on the operating direction of the escalator 110 and whether the time difference between the peaks of the average brightness values ​​of the first detection area 1100-1 and the second detection area 1100-2 is positive or negative.

[0106] 11, if the photographing terminal 810 is installed so that an image is acquired in which the demarcation image 311 tilts from the upper left to the lower right within the screen 301, under photographing conditions in which the step image 310 moves from top to bottom within the screen 301, the demarcation image 311 will first appear in the second detection area 1100-2 located on the right side of the screen 301, and then the demarcation image 311 will appear in the first detection area 1100-1. Therefore, for example, when observing the fluctuations in the average brightness value 1300 in the first detection area 1100-1 and the second detection area 1100-2, the peak of the average brightness value 1300-2 in the second detection area 1100-2 will occur earlier.

[0107] Therefore, under imaging conditions in which the step 113 moves from top to bottom within the screen 301, when the timing of the peak of the average brightness value 1300-2 in the second detection area 1100-2 located on the right side of the screen 301 is earlier than that in the first detection area 1100-1, the left side of the photographing terminal 810 is closer to the step 113, and the photographing terminal 810 may be set in a state (orientation) as shown in Figure 8, so the photographing terminal 810 will display this information.

[0108] At this time, the photographing terminal 810 may notify not only the direction of correction of the photographing terminal 810 but also the angle of correction of the photographing terminal 810, the amount of movement for the correction, etc. For example, the photographing terminal 810 calculates the degree of tilt at which the demarcation image 311 is captured on the screen 301 from the movement speed of the step 113 and the distance to the center of the detection area 1100. Thereafter, the photographing terminal 810 calculates, from the distance between the photographing terminal 810 and the step 113, how much the photographing terminal 810 needs to be rotated to improve the installation state from that shown in FIG. 8 to that shown in FIG. 1, and notifies the worker of the rotation angle. Furthermore, the photographing terminal 810 calculates the distance by which one end of the photographing terminal 810 should be moved from the relationship between the rotation angle and the width of the photographing terminal 810, and notifies the worker of the calculated distance.

[0109] In this embodiment, an example in which two detection regions 1100 are set has been shown, but three or more detection regions may be set in order to grasp a more detailed state. Also, the predetermined value for detecting the maximum brightness value in the detection region 1100 may be the same for multiple detection regions, or may be set individually.

[0110] The time difference between the peaks of the detection area 1100 shown in this embodiment may be calculated from one specific peak, or the time differences between multiple peaks may be calculated and then their average value may be calculated. Furthermore, when calculating the time difference, it is preferable to select the closest peak because the installation state of the photographing terminal 810 is unlikely to deviate significantly in most cases, but if a large change in the installation state is expected, the closest peak and the second closest peak may be calculated and both may be presented as candidates for the correction amount.

[0111] (III) Supplementary Note The above-described embodiment includes, for example, the following contents.

[0112] In the above embodiment, the present invention is described as being applied to an inspection device, but the present invention is not limited to this and can be widely applied to various other systems, devices, methods, and programs.

[0113] In the above embodiment, the demarcation 114 is provided around the periphery of the tread, but the present invention is not limited to this. For example, the demarcation 114 may be provided to indicate the outer boundary of the tread (riser side), or the demarcation 114 may be provided to indicate both the outer boundary of the tread and the inner boundary of the tread.

[0114] Furthermore, in the above embodiment, the detection area is provided on the screen 301, but the present invention is not limited to this. For example, the detection area may be the entire screen.

[0115] Furthermore, in the above embodiment, a setting screen for changing the size of detection area 400 is provided, but the present invention is not limited to this. For example, a setting screen does not necessarily have to be provided.

[0116] Furthermore, in the above embodiment, the case where the determination in S707 (S1408) is performed has been described, but the present invention is not limited to this. For example, such a determination does not have to be performed.

[0117] In the above embodiment, the case where the determination in S1409 is performed after the determination in S1407 is described, but the present invention is not limited to this. For example, the determination in S1409 may be performed without performing the determination in S1407.

[0118] In the above-described embodiments, some or all of the programs may be installed from a program source into a device such as a computer that implements the inspection device. The program source may be, for example, a program distribution server connected via a network or a computer-readable recording medium (e.g., a non-transitory recording medium). In the above description, two or more programs may be implemented as one program, or one program may be implemented as two or more programs.

[0119] Furthermore, in the above-described embodiment, the screens shown and described are merely examples, and any design may be used as long as the information received is the same.

[0120] Furthermore, the screens shown and described in the above-described embodiment are merely examples, and any design may be used as long as the information presented is the same.

[0121] Furthermore, in the above-described embodiment, the case where the average value is used as the statistical value has been described, but the statistical value is not limited to the average value, and may be other statistical values ​​such as the maximum value, the minimum value, the difference between the maximum value and the minimum value, the mode, the median, the standard deviation, etc.

[0122] In the above-described embodiment, the output of information is not limited to display on a display screen, but may be audio output from a speaker, output to a file, printed on paper or the like by a printer, projected onto a screen or the like by a projector, or in other forms.

[0123] In addition, in the above description, information such as programs, tables, files, etc. that realize each function can be stored in a storage device such as a memory, a hard disk, or an SSD (Solid State Drive), or in a recording medium such as an IC card, an SD card, or a DVD.

[0124] The above-described embodiment has the following characteristic configurations, for example.

[0125] (1) An inspection device (e.g., photographing terminal 120, photographing terminal 810) equipped with an imaging device (e.g., imaging device 270) capable of capturing images of a step used to inspect a passenger conveyor (e.g., escalator 110) including a step (e.g., step 113) with a demarcation (e.g., demarcation 114) provided at the boundary of the tread, the inspection device (e.g., photographing terminal 120, photographing terminal 810) is equipped with: a calculation unit (e.g., calculation unit 222) that calculates a brightness value (e.g., brightness, luminosity) indicating the degree of brightness of the image for each of a plurality of images captured sequentially of one step during inspection operation of the passenger conveyor; a determination unit (e.g., determination unit 223) that determines whether the inspection device is installed at a predetermined position based on the amount of variation in the brightness value (e.g., amount of variation in the brightness value) calculated by the calculation unit; and an output unit (e.g., output unit 224) that outputs the result determined by the determination unit.

[0126] In the above configuration, the result of determining whether the inspection device is installed in a predetermined position is output, so that, for example, an operator can install the inspection device in an appropriate position. With the above configuration, for example, the time required for re-inspection due to a failed photograph can be reduced, thereby reducing the time the passenger conveyor is stopped due to inspection and the time that users cannot use the conveyor due to maintenance work.

[0127] (2) The calculation unit is provided with a setting unit (e.g., setting unit 900) that sets a plurality of regions (e.g., detection regions 400) for calculating the brightness value of an image, and the steps of the passenger conveyor are provided with at least one demarcation (e.g., inner demarcation 114 and / or outer demarcation 114) in the width direction of the tread of the step, and in each of a plurality of images in which a single step is sequentially captured during an inspection operation of the passenger conveyor, the step images representing the single step are sequentially positioned in an upward or downward direction, and the plurality of regions are arranged in a row in the left-right direction with respect to each of the plurality of images, and the calculation unit calculates the maximum value of the brightness value (e.g., peak of the luminance value) from the plurality of images for each of the plurality of regions, and the determination unit determines whether the inspection device is installed so as to directly face the single step based on the time at which the maximum value calculated by the calculation unit was obtained (e.g., time difference between peaks) (see, for example, S1409).

[0128] In the above configuration, for example, if the result of determining whether or not the inspection device is installed facing directly toward the step is output, the worker can correct the installation direction of the inspection device, and the inspection device can be inspected in the appropriate installation state.

[0129] (3) The output unit outputs information indicating the direction in which to correct the installation of the inspection device based on the time when the maximum value was obtained for each of the multiple regions and the direction of inspection operation of the passenger conveyor (see, for example, S1413).

[0130] According to the above configuration, if the installation orientation of the inspection device is inappropriate, information indicating the orientation in which to correct the installation of the inspection device is output, so that, for example, an operator can easily correct the installation orientation of the inspection device.

[0131] (4) The judgment unit judges whether the brightness value (e.g., the base of the luminance value) calculated by the calculation unit for an image that does not include a demarcation image indicating the demarcation provided in the one step exceeds a threshold value (e.g., S707, S1408), and the output unit outputs information indicating that brightness correction is necessary if the judgment unit judges that the brightness value calculated by the calculation unit exceeds the threshold value (e.g., S710, S1412).

[0132] In the above configuration, for example, if the brightness value of an image that does not contain a demarcation image exceeds a threshold value, the operator is prompted to correct the brightness, allowing the operator to correct the lighting conditions and the inspection device to perform inspections in an appropriate installation environment.

[0133] Furthermore, the above-described configurations may be modified, rearranged, combined, or omitted as appropriate within the scope of the present invention.

[0134] It should be understood that items included in a list in the format "at least one of A, B, and C" can mean (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C). Similarly, items listed in the format "at least one of A, B, or C" can mean (A), (B), (C), (A and B), (A and C), (B and C), or (A, B, and C). [Explanation of symbols]

[0135] 120...Photographing terminal (inspection device), 222...Calculation unit, 223...Determination unit, 224...Output unit.

Claims

1. An inspection device equipped with an imaging device capable of capturing an image of a step used to inspect a passenger conveyor configured to include a step having a demarcation at the boundary of the tread, a calculation unit that calculates a brightness value indicating a degree of brightness of each of a plurality of images sequentially captured during one step of the inspection operation of the passenger conveyor; a determination unit that determines whether the inspection device is installed at a predetermined position based on the amount of variation in the brightness value calculated by the calculation unit; an output unit that outputs the result of the determination by the determination unit; An inspection device equipped with:

2. a setting unit that sets a plurality of regions for the calculation unit to calculate the brightness value of the image; The steps of the passenger conveyor are provided with at least one demarcation in a width direction of the tread surface of the steps, In each of a plurality of images in which one step is sequentially captured during inspection operation of the passenger conveyor, step images representing the one step are sequentially positioned in an upward or downward direction, the plurality of regions are arranged in a line in the left-right direction for each of the plurality of images, the calculation unit calculates a maximum brightness value from the plurality of images for each of the plurality of regions; The determination unit determines whether the inspection device is installed so as to directly face the one step based on the time at which the maximum value calculated by the calculation unit is obtained. The inspection device according to claim 1.

3. the output unit outputs information indicating a direction in which to correct the installation of the inspection device based on the time when the maximum value was obtained for each of the plurality of regions and the direction of inspection operation of the passenger conveyor. The inspection device according to claim 2.

4. The determination unit determines whether or not the brightness value calculated by the calculation unit for an image that does not include a demarcation image indicating the demarcation provided in the one step exceeds a threshold value; the output unit outputs information indicating that brightness correction is necessary when the determination unit determines that the brightness value calculated by the calculation unit exceeds a threshold value. The inspection device according to claim 1.

Images