Elevator operation and maintenance control method and system based on image recognition

Abstract

The present invention relates to the technical field of elevator operation and maintenance, and provides an elevator operation and maintenance control method and system based on image recognition. The method comprises: processing and identifying an image at an elevator leveling sensor, analyzing data based on the elevator standard, calculating pulse parameter values ​​that need to be corrected to achieve leveling at each floor of the elevator, and performing operation and maintenance control on the elevator, thereby improving the operation and maintenance efficiency of the elevator, reducing the cost of manual maintenance, and ensuring the safe and stable operation of the elevator.

Description

Technical Field

[0001] The present invention relates to the technical field of elevator operation and maintenance, and in particular to an elevator operation and maintenance control method and system based on image recognition. Background Art

[0002] Vertical lift elevators need to rely on leveling sensors to achieve elevator leveling when they stop at each floor. However, as the elevator is used, the sensitivity of the leveling sensor decreases or other influences are encountered during the use of the elevator, which will cause the elevator to be unable to level and the floor of the car to be on different levels from the floor, affecting the use of the elevator. At this time, the operation and maintenance personnel need to shut down the elevator for inspection and maintenance, which is time-consuming and labor-intensive. Summary of the invention

[0003] The present invention provides an elevator operation and maintenance control method based on image recognition, which is used to solve the problem of low efficiency of elevator uneven floor maintenance in the prior art.

[0004] A first aspect of the present invention provides an elevator operation and maintenance control method based on image recognition, comprising:

[0005] Receive the normal operation signal of the elevator, obtain the first standard image and the second standard image at the leveling sensor of each floor; perform image processing on each standard image, and identify the first standard protruding size and the second standard protruding size of the magnetic isolation plate of each floor;

[0006] Identify the current elevator floor and the elevator running direction, obtain the first current image and the second current image of the leveling sensor, perform image processing, obtain the first current protrusion size and the second current protrusion size of the magnetic isolation plate, substitute the data into the preset leveling operation and maintenance correction model, and obtain the corrected pulse parameter value. The leveling operation and maintenance correction model is specifically:

[0007]

[0008] Where d1 is the first current protrusion size, d2 is the second current protrusion size, and d a D is the current maximum value of the protrusion size. a is the standard protrusion size corresponding to the larger value of the current protrusion size, D b is the standard running distance, n b is the standard pulse parameter value, Δn is the pulse correction value, N is the corrected pulse parameter value, c is the running direction correction coefficient, when going up, c=a-1, when going down, c=a;

[0009] The corrected pulse parameter value is sent to the elevator control terminal to replace the original pulse parameter value of the corresponding floor.

[0010] Optionally, the image processing for each standard image is specifically:

[0011] The standard image is converted into a grayscale image and image segmentation is performed to obtain at most two rectangular image areas. According to the width of each image area, the image area with a larger width is identified as the leveling sensor area, and the image area with a smaller width is identified as the magnetic isolation plate area.

[0012] Optionally, the step of substituting the data into a preset leveling maintenance and repair model is as follows:

[0013] The first current protrusion size and the second current protrusion size are compared with the size threshold range respectively. If any protrusion size is not within the size threshold range, the Ajing data is substituted into the preset leveling operation and maintenance correction model.

[0014] The second aspect of the present application provides an elevator operation and maintenance control system based on image recognition, comprising:

[0015] The standard size recognition module is used to receive the normal operation signal of the elevator, obtain the first standard image and the second standard image at the leveling sensor of each floor; perform image processing on each standard image, and recognize the first standard protruding size and the second standard protruding size of the magnetic isolation plate of each floor;

[0016] The parameter correction module is used to identify the current elevator floor and the elevator running direction, obtain the first current image and the second current image of the leveling sensor, and perform image processing to obtain the first current protrusion size and the second current protrusion size of the magnetic isolation plate, substitute the data into the preset leveling operation and maintenance correction model, and obtain the corrected pulse parameter value. The leveling operation and maintenance correction model is specifically:

[0017]

[0018] Where d1 is the first current protrusion size, d2 is the second current protrusion size, and d a D is the current maximum value of the protrusion size. a is the standard protrusion size corresponding to the larger value of the current protrusion size, D b is the standard running distance, n b is the standard pulse parameter value, Δn is the pulse correction value, N is the corrected pulse parameter value, c is the running direction correction coefficient, when going up, c=a-1, when going down, c=a;

[0019] The operation and maintenance setting module is used to send the corrected pulse parameter value to the elevator control terminal to replace the original pulse parameter value of the corresponding floor.

[0020] Optionally, in the standard size recognition module, the image processing for each standard image is specifically performed as follows:

[0021] The standard image is converted into a grayscale image and image segmentation is performed to obtain at most two rectangular image areas. According to the width of each image area, the image area with a larger width is identified as the leveling sensor area, and the image area with a smaller width is identified as the magnetic isolation plate area.

[0022] Optionally, in the parameter correction module, substituting data into a preset leveling maintenance correction model is specifically as follows:

[0023] The first current protrusion size and the second current protrusion size are compared with the size threshold range respectively. If any protrusion size is not within the size threshold range, the Ajing data is substituted into the preset leveling operation and maintenance correction model.

[0024] The third aspect of the present application provides an elevator operation and maintenance control method device based on image recognition, the device comprising a processor and a memory:

[0025] The memory is used to store program code and transmit the program code to the processor;

[0026] The processor is used to execute an elevator operation and maintenance control method based on image recognition according to any one of the first aspects of the present invention according to the instructions in the program code.

[0027] In a fourth aspect, the present application provides a computer-readable storage medium, which is used to store program code, and the program code is used to execute an elevator operation and maintenance control method based on image recognition as described in any one of the first aspects of the present invention.

[0028] It can be seen from the above technical scheme that the present invention has the following advantages: by processing and identifying the image at the elevator leveling sensor, analyzing the data based on the elevator standard, calculating the pulse parameter values ​​that need to be corrected to achieve leveling at each floor of the elevator, and controlling the operation and maintenance of the elevator, the operation and maintenance efficiency of the elevator is improved, the cost of manual maintenance is reduced, and the safe and stable operation of the elevator is guaranteed. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0030] Figure 1 is a flow chart of an elevator operation and maintenance control method based on image recognition;

[0031] Figure 2This is a structural diagram of an elevator operation and maintenance control system based on image recognition. DETAILED DESCRIPTION

[0032] In order to make the purpose, features and advantages of the present invention more obvious and easy to understand, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described below are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0033] The present invention provides an elevator operation and maintenance control method based on image recognition, which is used to solve the problem of low efficiency of elevator uneven floor maintenance in the prior art.

[0034] See also Figure 1 , Figure 1 The present invention provides a first flow chart of an elevator operation and maintenance control method based on image recognition according to an embodiment of the present invention.

[0035] S100, receiving a normal operation signal of the elevator, obtaining a first standard image and a second standard image at the leveling sensor of each floor; performing image processing on each standard image, and identifying a first standard protruding size and a second standard protruding size of the magnetic isolation plate of each floor;

[0036] It should be noted that a magnetic isolation plate will be installed at each floor. When the elevator car is running in the hoistway, the leveling sensor installed at the top or bottom of the elevator car will pass through the magnetic isolation plate. The magnetic isolation plate affects the magnetic field formed by the leveling sensor. The induction coil has a current change due to the change in the magnetic field, so as to determine the floor the elevator car has arrived at, and the specific floor can be determined by the specific change values ​​of the current and magnetic field;

[0037] Because the leveling sensor is fixed on the elevator car and moves up and down with it, and the magnetic isolation plate is fixed on each floor of the shaft, when the elevator is in the leveling position of each floor, that is, the elevator car floor and the floor floor are in the same plane, the leveling sensor and the magnetic isolation plate should also have corresponding relative positions; when the elevator is installed and the operation and maintenance personnel debug the elevator to be in normal operation, they can send a normal elevator signal to the main board of the elevator control system; generally, the leveling sensor will be equipped with at least two reed switches, and the magnetic isolation plate will completely pass through the two farthest reed switches at the final parking position, and each protrude a certain distance. At the correct parking position at the level, the two protruding distances should also be fixed. Therefore, an infrared camera can be set above and below the leveling sensor to obtain images of the leveling sensor reed switches protruding at both ends of the magnetic isolation plate;

[0038] After the elevator control system receives the normal operation signal of the elevator, as the elevator runs, images of the protruding reed switches of the leveling sensors at both ends of the magnetic isolation plate are obtained at each floor, i.e., a first standard image and a second standard image are obtained. In this embodiment, the first standard image is a protruding image of the upper end of the magnetic isolation plate, and the second standard image is a protruding image of the lower end of the magnetic isolation plate. The protruding length of the magnetic isolation plate is calculated by image processing to obtain a first standard protruding size and a second standard protruding size, i.e., the length of the upper end of the magnetic isolation plate protruding from the leveling sensor and the length of the lower end of the magnetic isolation plate protruding from the leveling sensor.

[0039] S200, identifying the current elevator floor and the elevator running direction, obtaining the first current image and the second current image of the leveling sensor, and performing image processing to obtain the first current protrusion size and the second current protrusion size of the magnetic isolation plate, substituting the data into a preset leveling operation and maintenance correction model to obtain a corrected pulse parameter value, wherein the leveling operation and maintenance correction model is specifically:

[0040]

[0041] Where d1 is the first current protrusion size, d2 is the second current protrusion size, and d a D is the current maximum value of the protrusion size. a is the standard protrusion size corresponding to the larger value of the current protrusion size, D b is the standard running distance, n b is the standard pulse parameter value, Δn is the pulse correction value, N is the corrected pulse parameter value, c is the running direction correction coefficient, when going up, c=a-1, when going down, c=a;

[0042] It should be noted that after a period of use, the elevator may have problems with uneven elevator car due to problems such as sensor aging and reduced sensitivity, but these problems are caused by the control process, and the actual magnetic isolation plate and the position of the leveling sensor have not changed. Therefore, this step can be performed after there is a leveling problem or after a preset maintenance time; the standard size corresponding to the floor is obtained by identifying the current floor of the elevator, and the current image is taken at the same time to calculate the first current protruding size and the second current protruding size of the magnetic isolation plate;

[0043] When the elevator is not leveled, the position of the magnetic isolation plate in the leveling sensor changes, and the leveling sensor may not protrude, resulting in the current protrusion size being 0, while the actual value is negative. Therefore, it is necessary to select a larger value in the current protrusion size for analysis; when the elevator car stops at each floor, it is necessary to count the pulse parameter value after the reed switch of the leveling sensor detects the entry of the magnetic isolation plate, so that the elevator car can stop accurately at the predetermined position. The standard running distance corresponds to the standard pulse parameter value. The standard pulse parameter value is to determine the magnetic isolation plate entering the leveling sensor and then stop at the predetermined standard running distance. , then leveling can be achieved; the second formula of the leveling operation and maintenance correction model is to calculate how much pulse value needs to be corrected for the distance of the current protrusion size change to restore to the standard running distance based on the ratio of the standard running distance and the pulse parameter value. Because the elevator runs in different directions, the larger protrusion value should be corrected to early parking or delayed parking. Therefore, it is necessary to add a running direction correction coefficient to correct the positive and negative of the pulse correction value; when the pulse correction value is negative, the corrected pulse parameter value will be smaller than the standard pulse parameter value, that is, the elevator should stop in advance when it reaches the current floor under the current running direction, and the opposite is true when the pulse correction value is positive.

[0044] S300, sending the corrected pulse parameter value to the elevator control terminal to replace the original pulse parameter value of the corresponding floor.

[0045] It should be noted that an electrical control system will be installed in the machine room at the top of the elevator shaft to control the elevator; the corrected pulse parameter value corresponds to its floor and up and down directions. After the corrected pulse parameter value is calculated, it will be sent to the elevator control end and the original standard pulse parameter value of the corresponding floor will be replaced. In the subsequent elevator control process, the elevator can stop correctly when passing the corresponding floor according to the corrected pulse parameter value and accurately achieve leveling.

[0046] In this embodiment, by processing and identifying the image at the elevator leveling sensor, analyzing the data based on the elevator standard, calculating the pulse parameter values ​​that need to be corrected to achieve leveling at each floor of the elevator, and controlling the elevator operation and maintenance, the elevator operation and maintenance efficiency is improved, the cost of manual maintenance is reduced, and the safe and stable operation of the elevator is guaranteed.

[0047] The above is a detailed description of the first embodiment of an elevator operation and maintenance control method based on image recognition provided by the present application. The following is a detailed description of the second embodiment of an elevator operation and maintenance control method based on image recognition provided by the present application.

[0048] In this embodiment, an elevator operation and maintenance control method based on image recognition is further provided. In the aforementioned step S100, the image processing for each standard image is specifically as follows:

[0049] The standard image is converted into a grayscale image and image segmentation is performed to obtain at most two rectangular image areas; the image areas are identified according to their widths, and the image areas with larger widths are identified as the leveling sensor areas, and the image areas with smaller widths are identified as the magnetic isolation plate areas;

[0050] It should be noted that the leveling sensor and the magnetic isolation plate are photographed horizontally in the standard image. In addition to these two components, the image also contains the wall of the stairwell. According to the depth of field of the objects in the image, the brightness of the leveling sensor, the magnetic isolation plate and the wall of the stairwell is different, and the grayscale levels in the grayscale image of the standard image are also different. The grayscale values ​​of the image pixels are classified by k-means clustering pixel grayscale values ​​to obtain at most three types of pixels. The grayscale values ​​correspond to the leveling sensor, the magnetic isolation plate and the wall of the stairwell from small to large, and the image areas of these three types of pixels are segmented. The leveling sensor and magnetic isolation plate appear rectangular in the image at a horizontal shooting angle, and the width of the leveling sensor is several times the width of the magnetic isolation plate. Therefore, after image segmentation, the widths of the rectangular areas can be compared, and the area with a larger width can be identified as the leveling sensor area, and the image area with a smaller width can be identified as the magnetic isolation plate area. Furthermore, after identifying the two areas, the length of the magnetic isolation plate area can be identified to obtain the corresponding protrusion size. Part of the magnetic isolation plate will be between the leveling sensors, while the part that exceeds the leveling sensors will be recorded in the image, and the length is the protrusion size.

[0051] Furthermore, in the aforementioned step S200, the data is substituted into the preset leveling maintenance and repair model as follows:

[0052] The first current protrusion size and the second current protrusion size are compared with the size threshold interval respectively. If any of the protrusion sizes is not within the size threshold interval, the data is substituted into the preset leveling operation and maintenance correction model. It should be noted that in the image processing detection process, when the identified protrusion size is within the normal range, even if the elevator is uneven, it is extremely subtle and passengers will not easily feel it. At this time, there is no need to correct the pulse parameter value, thereby reducing the operation and maintenance cost. The present embodiment can also preset the operation and maintenance time period, execute step S200 after the elevator has been used for a period of time, and perform pulse parameter value correction on each floor at regular intervals, or execute step S200 after receiving the passenger's alarm signal or the operation and maintenance personnel's instruction, and perform operation and maintenance as needed.

[0053] The above is a detailed description of an elevator operation and maintenance control method based on image recognition provided in the first aspect of the present application. The following is a detailed description of an embodiment of an elevator operation and maintenance control system based on image recognition provided in the second aspect of the present application.

[0054] See also Figure 2 , Figure 2This embodiment provides an elevator operation and maintenance control system based on image recognition, including:

[0055] The standard size recognition module 10 is used to receive the normal operation signal of the elevator, obtain the first standard image and the second standard image at the leveling sensor of each floor; perform image processing on each standard image, and recognize the first standard protruding size and the second standard protruding size of the magnetic isolation plate of each floor;

[0056] The parameter correction module 20 is used to identify the current elevator floor and the elevator running direction, obtain the first current image and the second current image of the leveling sensor, and perform image processing to obtain the first current protrusion size and the second current protrusion size of the magnetic isolation plate, substitute the data into the preset leveling operation and maintenance correction model, and obtain the corrected pulse parameter value. The leveling operation and maintenance correction model is specifically:

[0057]

[0058] Where d1 is the first current protrusion size, d2 is the second current protrusion size, and d a D is the current maximum value of the protrusion size. a is the standard protrusion size corresponding to the larger value of the current protrusion size, D b is the standard running distance, n b is the standard pulse parameter value, Δn is the pulse correction value, N is the corrected pulse parameter value, c is the running direction correction coefficient, when going up, c=a-1, when going down, c=a;

[0059] The operation and maintenance setting module 30 is used to send the corrected pulse parameter value to the elevator control terminal to replace the original pulse parameter value of the corresponding floor.

[0060] Furthermore, in the standard size recognition module 10, the image processing for each standard image is specifically as follows:

[0061] The standard image is converted into a grayscale image and image segmentation is performed to obtain at most two rectangular image areas. According to the width of each image area, the image area with a larger width is identified as the leveling sensor area, and the image area with a smaller width is identified as the magnetic isolation plate area.

[0062] Furthermore, in the parameter correction module 20, the data is substituted into the preset leveling maintenance correction model as follows:

[0063] The first current protrusion size and the second current protrusion size are compared with the size threshold range respectively. If any protrusion size is not within the size threshold range, the Ajing data is substituted into the preset leveling operation and maintenance correction model.

[0064] The third aspect of the present application also provides an elevator operation and maintenance control method device based on image recognition, including a processor and a memory: the memory is used to store program code and transfer the program code to the processor; the processor is used to execute the above-mentioned elevator operation and maintenance control method based on image recognition according to the instructions in the program code.

[0065] A fourth aspect of the present application provides a computer-readable storage medium, characterized in that the computer-readable storage medium is used to store program code, and the program code is used to execute the above-mentioned elevator operation and maintenance control method based on image recognition.

[0066] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and equipment can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0067] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0068] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0069] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0070] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0071] As described above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features thereof may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An elevator operation and maintenance control method based on image recognition, characterized in that include: Receive the normal operation signal of the elevator and obtain the first standard image and the second standard image at the leveling sensor of each floor; Perform image processing on each standard image to identify the first standard protruding size and the second standard protruding size of the magnetic isolation plate on each floor; Identify the current elevator floor and the elevator running direction, obtain the first current image and the second current image of the leveling sensor, and perform image processing to obtain the first current protrusion size and the second current protrusion size of the magnetic isolation plate, and compare the first current protrusion size and the second current protrusion size with the size threshold interval respectively. If any protrusion size is not within the size threshold interval, substitute the data into the preset leveling operation and maintenance correction model to obtain the corrected pulse parameter value. The leveling operation and maintenance correction model is specifically: Where d1 is the first current protrusion size, d2 is the second current protrusion size, and d a is the current larger value of the protrusion size, D a is the standard protrusion size corresponding to the larger value of the current protrusion size, D b is the standard running distance, n b is the standard pulse parameter value, Δn is the pulse correction value, N is the corrected pulse parameter value, c is the running direction correction coefficient, when going up, c=a-1, when going down, c=a; The corrected pulse parameter value is sent to the elevator control terminal to replace the original pulse parameter value of the corresponding floor.

2. The elevator operation and maintenance control method based on image recognition according to claim 1, characterized in that: The image processing for each standard image is specifically as follows: The standard image is converted into a grayscale image and image segmentation is performed to obtain at most two rectangular image areas. According to the width of each image area, the image area with a larger width is identified as the leveling sensor area, and the image area with a smaller width is identified as the magnetic isolation plate area.

3. An elevator operation and maintenance control system based on image recognition, characterized in that: include: A standard size recognition module is used to receive a normal operation signal of the elevator and obtain a first standard image and a second standard image at a leveling sensor of each floor; Perform image processing on each standard image to identify the first standard protruding size and the second standard protruding size of the magnetic isolation plate on each floor; The parameter correction module is used to identify the current elevator floor and the elevator running direction, obtain the first current image and the second current image of the leveling sensor, and perform image processing to obtain the first current protrusion size and the second current protrusion size of the magnetic isolation plate, and compare the first current protrusion size and the second current protrusion size with the size threshold interval respectively. If any protrusion size is not within the size threshold interval, the data is substituted into the preset leveling operation and maintenance correction model to obtain the corrected pulse parameter value. The leveling operation and maintenance correction model is specifically: Where d1 is the first current protrusion size, d2 is the second current protrusion size, and d a is the current larger value of the protrusion size, D a is the standard protrusion size corresponding to the larger value of the current protrusion size, D b is the standard running distance, n b is the standard pulse parameter value, Δn is the pulse correction value, N is the corrected pulse parameter value, c is the running direction correction coefficient, when going up, c=a-1, when going down, c=a; The operation and maintenance setting module is used to send the corrected pulse parameter value to the elevator control terminal to replace the original pulse parameter value of the corresponding floor.

4. The elevator operation and maintenance control system based on image recognition according to claim 3 is characterized in that: In the standard size recognition module, the image processing for each standard image is specifically performed as follows: The standard image is converted into a grayscale image and image segmentation is performed to obtain at most two rectangular image areas. According to the width of each image area, the image area with a larger width is identified as the leveling sensor area, and the image area with a smaller width is identified as the magnetic isolation plate area.

5. An elevator operation and maintenance control device based on image recognition, characterized in that: The device comprises a processor and a memory: The memory is used to store program code and transmit the program code to the processor; The processor is used to execute an elevator operation and maintenance control method based on image recognition as described in any one of claims 1-2 according to the instructions in the program code.

6. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store program code, and the program code is used to execute the elevator operation and maintenance control method based on image recognition as described in any one of claims 1-2.

Images