A method and device for detecting the safe operation of a conveyor belt, an electronic device, and a medium

Abstract

The present invention provides a method and device for detecting the safe operation of a conveyor belt, an electronic device and a medium. The method includes: determining whether the conveyor belt to be detected is in a load operation state according to the temperature value of the idler of the conveyor belt to be detected; when the conveyor belt to be detected is in a load operation state, determining the state of the conveyor belt to be detected according to the proportion occupied in the first detection area; when the conveyor belt to be detected is in a deviation state, sending a deviation correction signal to the controller corresponding to the conveyor belt to be detected so that the controller controls the conveyor belt to be detected to be in a non-deviation state; when the conveyor belt to be detected is in a non-deviation state, determining whether the surface of the conveyor belt to be detected is torn according to the surface image in the second detection area; when the surface of the conveyor belt to be detected is torn, sending an alarm signal to perform automatic detection and make corresponding operations in time when an abnormal operation condition occurs while the conveyor belt is in an operating state.

Description

Background Art

[0002] Belt conveyors are important equipment widely used in many industries such as metallurgy, mining, chemical industry, petroleum, power plants, ports, and building materials. Especially under the requirements of long-distance, high-power, large-capacity, and high-speed transportation, belt conveyors have become the main trend in the development of belt conveyors. As an important part of the conveyor, the conveyor belt mainly plays the role of connecting the driving device and transporting materials, and its cost accounts for about 40%-60% of the total cost of the entire conveyor. During the actual production process, the conveyor belt may be punctured by sharp objects or deviate. If the inspectors cannot detect it in time, the entire conveyor will be paralyzed due to large-area tearing of the conveyor belt, resulting in the dumping of goods, and in severe cases, it may even cause casualties to the inspectors, causing huge economic losses. Summary of the Invention

[0003] In view of the above technical problems, the technical solution adopted in the present invention is as follows:

[0004] According to one aspect of the present application, there is provided a method for detecting the safe operation of a conveyor belt, including:

[0005] Determine whether the conveyor belt to be detected is in a load operation state according to the temperature value of the idler of the conveyor belt to be detected;

[0006] In the case where the conveyor belt to be detected is in a load operation state, determine the state of the conveyor belt to be detected according to the proportion of the conveyor belt to be detected in the corresponding first detection area; the state of the conveyor belt to be detected includes a deviation state and a non-deviation state;

[0007] In the case where the conveyor belt to be detected is in a deviation state, send a deviation correction signal to the controller corresponding to the conveyor belt to be detected, so that the controller controls the conveyor belt to be detected to be in a non-deviation state;

[0008] In the case where the conveyor belt to be detected is in a non-deviation state, determine whether the surface of the conveyor belt to be detected is torn according to the surface image of the conveyor belt to be detected in the corresponding second detection area;

[0009] In the case where the surface of the conveyor belt to be detected is torn, send an alarm signal.

[0010] In an exemplary embodiment of the present application, determining whether the conveyor belt to be detected is in a load operation state according to the temperature value of the idler of the conveyor belt to be detected includes:

[0011] Obtain in real time the temperature value of the idler to be detected when the conveyor belt to be detected is in an operating state; the idler to be detected is any one of a plurality of idlers corresponding to the conveyor belt to be detected and / or the idler with the largest area among the plurality of idlers;

[0012] If the temperature of the idler to be detected in this detection is greater than the temperature of the idler to be detected in the previous detection, and the temperature difference is greater than the preset first temperature difference threshold, and the temperature of the idler to be detected in this detection is less than the temperature of the idler to be detected in the next detection, and the temperature difference is less than or equal to the preset second temperature difference threshold, it is determined that the conveyor belt to be detected is in a load operation state; the first temperature difference threshold is greater than or equal to the second temperature difference threshold.

[0013] In an exemplary embodiment of the present application, when the conveyor belt to be detected is in a load operation state, the state of the conveyor belt to be detected is determined according to the proportion of the conveyor belt to be detected in the corresponding first detection area, including:

[0014] When the conveyor belt to be detected is in a load operation state, a first detection image of the first detection area captured by the first image acquisition device corresponding to the conveyor belt to be detected is obtained in real time; the first detection area is the area captured by the first image acquisition device; the first image acquisition device is arranged below the conveyor belt to be detected, and the shooting angle of the first image acquisition device faces the edge of the conveyor belt to be detected;

[0015] The first detection image is subjected to semantic segmentation processing to obtain a conveyor belt image area corresponding to the conveyor belt to be detected included in the first detection image;

[0016] When the ratio of the area of the conveyor belt image area to the area of the first detection image is greater than the preset area ratio threshold, it is determined that the conveyor belt to be detected is in a deviation state;

[0017] When the ratio of the area of the conveyor belt image area to the area of the first detection image is less than or equal to the preset area ratio threshold, it is determined that the conveyor belt to be detected is in a non-deviation state.

[0018] In an exemplary embodiment of the present application, the execution method of the controller corresponding to the conveyor belt to be detected includes:

[0019] In response to receiving a deviation correction signal, controlling the conveyor belt to be detected to deviate by a deviation correction angle towards the initial position corresponding to the conveyor belt to be detected; the deviation correction angle is (T1 - T2) × T0; where T1 is the ratio of the area of the conveyor belt image area to the area of the first detection image in the first detection image at the current moment; T2 is the preset area ratio threshold; T0 is the preset initial deviation correction angle.

[0020] In an exemplary embodiment of the present application, when the conveyor belt to be detected is in a non-deviation state, according to the surface image of the conveyor belt to be detected in the corresponding second detection area, it is determined whether the surface of the conveyor belt to be detected is torn, including:

[0021] When the conveyor belt to be detected is in a non-deviated state, the second detection image of the second detection area captured by the second image acquisition device corresponding to the conveyor belt to be detected is obtained in real time; the second detection area is the area captured by the second image acquisition device; the second image acquisition device is arranged on the idler of the conveyor belt to be detected, and the shooting angle of the second image acquisition device faces the surface of the conveyor belt to be detected;

[0022] Perform grayscale processing on the second detection image to obtain a third detection image;

[0023] Perform Laplace transform on the third detection image to obtain the convolution kernel variance corresponding to the third detection image;

[0024] When the convolution kernel variance is greater than a preset variance threshold, perform image recognition on the second detection image to obtain the surface image area corresponding to the conveyor belt to be detected included in the second detection image;

[0025] Perform feature recognition on several pixel points in the surface image area, and determine the pixel points that conform to the preset tear feature rule as tear pixel points;

[0026] Determine the area composed of the tear pixel points as the tear area;

[0027] When the length of the tear area is greater than a preset length threshold, it is determined that the surface of the conveyor belt to be detected has a tear.

[0028] In an exemplary embodiment of the present application, performing Laplace transform on the third detection image to obtain the convolution kernel variance corresponding to the third detection image further includes:

[0029] When the convolution kernel variance is less than or equal to the preset variance threshold, send a cleaning signal to the controller corresponding to the conveyor belt to be detected, so that the controller controls the cleaning device to clean the shooting lens of the second image acquisition device.

[0030] In an exemplary embodiment of the present application, the conveyor belt operation safety detection method further includes:

[0031] Store the operation state data of the conveyor belt to be detected;

[0032] Wherein, the operation state data of the conveyor belt to be detected includes any one or a combination of the following:

[0033] The temperature value of the idler of the conveyor belt to be detected, the proportion of the conveyor belt to be detected in the corresponding first detection area when it is in a deviated state, and the surface image when the surface of the conveyor belt to be detected has a tear.

[0034] According to one aspect of the present application, a conveyor belt operation safety detection device is provided, including:

[0035] A load judgment module, configured to determine whether the conveyor belt to be detected is in a load operation state according to the temperature value of the idler of the conveyor belt to be detected;

[0036] A deviation judgment module, configured to determine the state of the conveyor belt to be detected according to the proportion of the conveyor belt to be detected in the corresponding first detection area when the conveyor belt to be detected is in a load operation state; the state of the conveyor belt to be detected includes a deviation state and a non-deviation state;

[0037] A deviation correction control module, configured to send a deviation correction signal to the controller corresponding to the conveyor belt to be detected when the conveyor belt to be detected is in a deviation state, so that the controller controls the conveyor belt to be detected to be in a non-deviation state;

[0038] A tear judgment module, configured to determine whether the surface of the conveyor belt to be detected is torn according to the surface image of the conveyor belt to be detected in the corresponding second detection area when the conveyor belt to be detected is in a non-deviation state;

[0039] A tear alarm module, configured to emit an alarm signal when the surface of the conveyor belt to be detected is torn.

[0040] According to one aspect of the present application, there is provided a non-transitory computer-readable storage medium, in which at least one instruction or at least one program segment is stored, and the at least one instruction or the at least one program segment is loaded and executed by a processor to implement the foregoing conveyor belt operation safety detection method.

[0041] According to one aspect of the present application, there is provided an electronic device, including a processor and the foregoing non-transitory computer-readable storage medium.

[0042] The present invention has at least the following beneficial effects:

[0043] The conveyor belt operation safety detection method of the present invention first determines whether the conveyor belt to be detected is in a load operation state according to the temperature value of the idler of the conveyor belt to be detected. If the conveyor belt to be detected is in a load operation state, it is determined whether the conveyor belt to be detected is in a deviation state according to the proportion of the conveyor belt to be detected in the corresponding first detection area. If the conveyor belt to be detected is in a deviation state, a deviation correction signal is sent to the controller corresponding to the conveyor belt to be detected, so that the controller controls the conveyor belt to be detected to be in a non-deviation state. If the conveyor belt to be detected is in a non-deviation state, it is further determined whether the surface of the conveyor belt to be detected is torn according to the surface image of the conveyor belt to be detected in the corresponding second detection area. If the surface of the conveyor belt to be detected is torn, an alarm signal is emitted to perform automatic detection when the conveyor belt is in an operating state and make corresponding operations in time when an abnormal operating condition occurs, so as to avoid economic losses caused by abnormal operation of the conveyor belt. Description of the Drawings

[0044] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0045] Figure 1 It is a flowchart of the conveyor belt operation safety detection method provided by the embodiment of the present invention;

[0046] Figure 2 It is a block diagram of the conveyor belt operation safety detection device provided by the embodiment of the present invention;

[0047] Figure 3 It is an infrared thermal image of the idler of the conveyor belt to be detected provided by the embodiment of the present invention;

[0048] Figures 4 - 6 It is a schematic diagram of the semantic segmentation process of the first detection image provided by the embodiment of the present invention;

[0049] Figure 7 It is a schematic diagram of the tear area on the second detection image of the conveyor belt to be detected provided by the embodiment of the present invention. Detailed Embodiments

[0050] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts fall within the scope of protection of the present invention.

[0051] Regarding the problem of abnormal operation of the current conveyor belt, it is necessary to conduct safety inspections on the conveyor belt in the running state to promptly detect the abnormal operation of the conveyor belt. Existing conveyor belt safety detection products (such as mine conveyor belt longitudinal tear recognition systems) all include functions such as conveyor belt tear and scratch recognition, and on-site sound and light alarms, and their algorithm basis is the CNN convolutional neural network (Convolutional Neural Networks) and object detection algorithms. Most of the existing conveyor belt detection technologies only stay at visually detecting tears and scratches in images and then giving sound and light alarms to prompt the staff to take further actions. It only serves as a reminder and cannot prevent the conveyor system from being paralyzed, and in severe cases, it may even cause casualties to the inspection personnel. In view of the fact that there is no comprehensive algorithm system that can truly achieve unmanned autonomous detection of the running state of the conveyor belt and autonomously give alarms and control the operation of the conveyor belt before an accident occurs, the conveyor belt running safety detection method described in the present invention is proposed.

[0052] As Figure 1 shown, the conveyor belt running safety detection method described in this application includes:

[0053] Step S100: Determine whether the conveyor belt to be detected is in a load-bearing running state according to the temperature value of the idler of the conveyor belt to be detected;

[0054] When the conveyor belt is in an unloaded running state, since there is no load on the conveyor belt, even if the conveyor belt has abnormal operations such as deviation or tear at this time, it will not cause a safety accident in the conveyor system. Therefore, in order to reduce the data processing volume, when the conveyor belt is in an unloaded running state, the conveyor belt running safety detection method described in this application is not executed, but the temperature value of the idler of the conveyor belt to be detected is obtained in real time, and according to the temperature value of the idler of the conveyor belt to be detected, it is determined whether the conveyor belt to be detected is in a load-bearing running state. If the conveyor belt to be detected is in a load-bearing running state, that is, there is an object on the conveyor belt to be detected, then the conveyor belt running safety detection method described in this application is executed to detect whether the conveyor belt to be detected has deviation / tear.

[0055] Further, determining whether the conveyor belt to be detected is in a load-bearing running state according to the temperature value of the idler of the conveyor belt to be detected in step S100, that is, the judgment method of the load-bearing running state of the conveyor belt to be detected, includes steps S110 - S120:

[0056] Step S110: Obtain in real time the temperature value of the idler to be detected when the conveyor belt to be detected is in a running state;

[0057] The idler to be detected is any one of several idlers corresponding to the conveyor belt to be detected and / or the idler with the largest area among several idlers.

[0058] Step S120: If the temperature of the idler to be detected in this detection is greater than the temperature of the idler to be detected in the previous detection, and the temperature difference is greater than the preset first temperature difference threshold, and the temperature of the idler to be detected in this detection is less than the temperature of the idler to be detected in the next detection, and the temperature difference is less than or equal to the preset second temperature difference threshold, it is determined that the conveyor belt to be detected is in the load operation state;

[0059] The first temperature difference threshold is greater than or equal to the second temperature difference threshold.

[0060] As Figure 3 shown, it is an infrared image of the temperature of the idler of the conveyor belt to be detected. The idler can be identified from the image through the target detection algorithm. When the conveyor belt to be detected is unloaded, since there is no contact between the conveyor belt to be detected and the idler, the temperature value on the idler is relatively low. When there is an object on the conveyor belt to be detected, due to the weight generated on the conveyor belt to be detected, it contacts the idler, and the conveyor belt to be detected is in the running state. Therefore, friction occurs between the conveyor belt to be detected and the idler, and the temperature value on the idler will increase, indicating that the conveyor belt to be detected is in the load operation state at this time.

[0061] Step S200: In the case where the conveyor belt to be detected is in the load operation state, determine the state of the conveyor belt to be detected according to the proportion of the conveyor belt to be detected in the corresponding first detection area; the state of the conveyor belt to be detected includes the deviation state and the non-deviation state;

[0062] Further, in the case where the conveyor belt to be detected is in the load operation state in Step S200, determine the state of the conveyor belt to be detected according to the proportion of the conveyor belt to be detected in the corresponding first detection area, that is, the method for judging the deviation state of the conveyor belt to be detected includes Steps S210 - S240:

[0063] Step S210: In the case where the conveyor belt to be detected is in the load operation state, continuously obtain the first detection image of the first detection area captured by the first image acquisition device corresponding to the conveyor belt to be detected;

[0064] The first detection area is the area captured by the first image acquisition device.

[0065] The first image acquisition device is arranged below the conveyor belt to be detected, and the shooting angle of the first image acquisition device faces the edge of the conveyor belt to be detected. Multiple first image acquisition devices can be set. For example, when the conveyor belt to be detected is relatively wide, one first image acquisition device can be set below each of the two edges of the conveyor belt to be detected. The first image acquisition device can be a visible light camera.

[0066] Step S220: Perform semantic segmentation processing on the first detection image to obtain the conveyor belt image area corresponding to the conveyor belt to be detected included in the first detection image;

[0067] As Figures 4 - 6 shown, Figure 4 is the original image of the first detection image, Figure 5 are two image regions obtained after semantic segmentation processing of the first detection image, Figure 6 is the image after binarization processing of the two image regions. The white region is the conveyor belt image region corresponding to the conveyor belt to be detected, and the black region is the background image region of the first detection image that does not include the conveyor belt to be detected, which is used to more clearly represent the conveyor belt image corresponding to the conveyor belt to be detected.

[0068] Semantic segmentation processing can be implemented through the FCN fully convolutional neural network (Fully Convolutional Networks). By using FCN semantic segmentation in deep learning to estimate the proportion of the conveyor belt deviation area, the parameters of the deviation correction device can be adjusted in a timely manner to reduce problems such as conveyor belt wear and material spillage. The algorithm based on FCN can handle more complex situations such as occlusion and illumination changes, so the universality and robustness of the algorithm are stronger.

[0069] Step S230: When the ratio of the area of the conveyor belt image region to the area of the first detection image is greater than a preset area ratio threshold, it is determined that the conveyor belt to be detected is in a deviation state;

[0070] Step S240: When the ratio of the area of the conveyor belt image region to the area of the first detection image is less than or equal to the preset area ratio threshold, it is determined that the conveyor belt to be detected is in a non-deviation state.

[0071] If the ratio of the area of the conveyor belt image region to the area of the first detection image is greater than the preset area ratio threshold, it means that the conveyor belt to be detected has deviated from the initial position, and it is determined that the conveyor belt to be detected is in a deviation state.

[0072] Step S300: When the conveyor belt to be detected is in a deviation state, a deviation correction signal is sent to the controller corresponding to the conveyor belt to be detected, so that the controller controls the conveyor belt to be detected to be in a non-deviation state;

[0073] Furthermore, the execution method of the controller corresponding to the conveyor belt to be detected includes step S310:

[0074] Step S310: In response to receiving the deviation correction signal, control the conveyor belt to be detected to offset by a deviation correction angle towards the initial position corresponding to the conveyor belt to be detected;

[0075] The deviation correction angle is (T1 - T2) × T0; where T1 is the ratio of the area of the conveyor belt image area in the first detection image at the current moment to the area of the first detection image; T2 is a preset area ratio threshold; and T0 is a preset initial deviation correction angle.

[0076] After receiving the deviation correction signal, the controller sends an instruction to the conveyor belt analog deviation correction device, commanding the conveyor belt analog deviation correction device to control the conveyor belt to be detected for deviation correction. The conveyor belt analog deviation correction device is a device that controls the movement of the servo motor of the conveyor belt to be detected through an analog input signal, generally controlling the torque, speed, or position of the motor, so as to achieve the purpose of adjusting the direction of the conveyor belt.

[0077] Step S400: When the conveyor belt to be detected is in a non-deviated state, determine whether the surface of the conveyor belt to be detected is torn according to the surface image of the conveyor belt to be detected in the corresponding second detection area.

[0078] The premise of detecting whether the surface of the conveyor belt to be detected is torn is that the conveyor belt to be detected is in a non-deviated state. If the conveyor belt to be detected is in a deviated state, first correct the deviation of the conveyor belt to be detected, and then determine whether the conveyor belt to be detected is torn.

[0079] Further, in step S400, when the conveyor belt to be detected is in a non-deviated state, determine whether the surface of the conveyor belt to be detected is torn according to the surface image of the conveyor belt to be detected in the corresponding second detection area, that is, the method for judging whether the conveyor belt to be detected is torn includes steps S410 - S470:

[0080] Step S410: When the conveyor belt to be detected is in a non-deviated state, continuously obtain the second detection image of the second detection area taken by the second image acquisition device corresponding to the conveyor belt to be detected.

[0081] The second detection area is the area photographed by the second image acquisition device.

[0082] The second image acquisition device is arranged on the idler of the conveyor belt to be detected. The shooting angle of the second image acquisition device faces the surface of the conveyor belt to be detected. The number of the second image acquisition devices can also be set to multiple. Its main function is to photograph the surface of the conveyor belt to be detected. The second image acquisition device can be an infrared camera.

[0083] Step S420: Perform grayscale processing on the second detection image to obtain a third detection image.

[0084] Grayscale processing is beneficial for subsequent feature recognition of the image.

[0085] Step S430: Perform a Laplace transform on the third detection image to obtain the convolution kernel variance corresponding to the third detection image;

[0086] The Laplace transform is used to detect the features of edges and textures in the third detection image, and the clarity of the third detection image is judged by the convolution kernel variance.

[0087] The Laplace operator in the Laplace transform is used to measure the second derivative of the third detection image. The Laplace transform highlights the image regions containing rapid intensity changes, which is very similar to the Sobel operator and the Scharr operator. Moreover, like these operators, the Laplace is usually used for edge detection. By calculating the sum of the second partial derivatives of the image on the horizontal and vertical coordinate axes, the edge and texture features in the image are determined. If the image contains a high variance, there is a wide range of responses, including edge-like and non-edge-like, representing a normal focused image. However, if the variance is very low, the distribution of the response is small, indicating that the edges in the image are very small. Therefore, the more blurred the image, the fewer the edges and the lower its convolution kernel variance.

[0088] Step S431: When the convolution kernel variance is less than or equal to a preset variance threshold, send a cleaning signal to the controller corresponding to the conveyor belt to be detected, so that the controller controls the cleaning device to clean the shooting lens of the second image acquisition device;

[0089] If the convolution kernel variance is less than or equal to the preset variance threshold, it means that the clarity of the second detection image of the second detection area captured by the second image acquisition device is low. Also, since the working environment of the conveyor belt is often an outdoor scene, it can be considered that there is dust or other obstacles on the shooting lens of the second image acquisition device. Then, the controller is commanded to send a cleaning instruction to the cleaning device so that the cleaning device cleans the shooting lens or the light source device of the second image acquisition device.

[0090] Step S440: When the convolution kernel variance is greater than the preset variance threshold, perform image recognition on the second detection image to obtain the surface image area corresponding to the conveyor belt to be detected included in the second detection image;

[0091] Step S450: Perform feature recognition on several pixel points in the surface image area, and determine the pixel points that conform to the preset tearing feature rule as tearing pixel points;

[0092] Step S460: Determine the area composed of the tearing pixel points as the tearing area;

[0093] Step S470: When the length of the tearing area is greater than the preset length threshold, determine that the surface of the conveyor belt to be detected has torn.

[0094] As Figure 7As shown, it is an image of the torn area on the second detection image of the conveyor belt to be detected. By comparing the length of the torn area, it is determined whether the surface of the conveyor belt to be detected has been torn or has scratches.

[0095] Step S500: When the surface of the conveyor belt to be detected is torn, an alarm signal is sent.

[0096] In addition, when the conveyor belt to be detected is in the load operation state, the operation state data of the conveyor belt to be detected is stored, and the stored operation state data of the conveyor belt to be detected is visually displayed to the user in real time, so that the user or staff can view the operation state of the conveyor belt at any time. The operation state data of the conveyor belt to be detected can be stored in the local database, or can be stored in the algorithm data middle platform or the data sharing center. The user can interact with the idler temperature detection algorithm, the conveyor belt deviation detection algorithm, the conveyor belt analog deviation correction device, the conveyor belt tear / scratch detection algorithm and the conveyor belt motor operation state signal control through the algorithm data middle platform.

[0097] Among them, the operation state data of the conveyor belt to be detected includes any one or a combination of the following: the temperature value of the idler of the conveyor belt to be detected, the proportion of the conveyor belt to be detected in the corresponding first detection area when it is in the deviation state, and the surface image when the surface of the conveyor belt to be detected is torn.

[0098] In addition, the present invention also provides a conveyor belt operation safety detection device 100, as Figure 2 shown, including:

[0099] A load judgment module 110, configured to determine whether the conveyor belt to be detected is in the load operation state according to the temperature value of the idler of the conveyor belt to be detected;

[0100] A deviation judgment module 120, configured to determine the state of the conveyor belt to be detected according to the proportion of the conveyor belt to be detected in the corresponding first detection area when the conveyor belt to be detected is in the load operation state; the state of the conveyor belt to be detected includes a deviation state and a non-deviation state;

[0101] A deviation correction control module 130, configured to send a deviation correction signal to the corresponding controller of the conveyor belt to be detected when the conveyor belt to be detected is in the deviation state, so that the controller controls the conveyor belt to be detected to be in the non-deviation state;

[0102] A tear judgment module 140, configured to determine whether the surface of the conveyor belt to be detected is torn according to the surface image of the conveyor belt to be detected in the corresponding second detection area when the conveyor belt to be detected is in the non-deviation state;

[0103] The tearing alarm module 150 is used to send an alarm signal when tearing occurs on the surface of the conveyor belt to be detected.

[0104] For the conveyor belt operation safety detection method of the present invention, first, according to the temperature value of the idler of the conveyor belt to be detected, it is determined whether the conveyor belt to be detected is in a load operation state. If the conveyor belt to be detected is in a load operation state, then according to the proportion of the conveyor belt to be detected in the corresponding first detection area, it is determined whether the conveyor belt to be detected is in a deviation state. If the conveyor belt to be detected is in a deviation state, a deviation correction signal is sent to the controller corresponding to the conveyor belt to be detected, so that the controller controls the conveyor belt to be detected to be in a non-deviation state. If the conveyor belt to be detected is in a non-deviation state, then according to the surface image of the conveyor belt to be detected in the corresponding second detection area, it is determined whether tearing occurs on the surface of the conveyor belt to be detected. If tearing occurs on the surface of the conveyor belt to be detected, an alarm signal is sent to perform automatic detection when the conveyor belt is in operation and make corresponding operations in a timely manner when abnormal operation conditions occur, integrate the deviation detection algorithm and the tearing detection algorithm into one system, realize unmanned automatic detection of conveyor belt operation, tearing, scratches, and alarms, and through the introduction of a lightweight network architecture algorithm and the combination of a sensor-side fast forward deployment framework, a complete control system algorithm for real-time detection of conveyor belt movement, longitudinal tearing of the conveyor belt, scratches, and deviation correction of the conveyor belt at the edge computing end is realized. By identifying the operation state of the conveyor belt, detecting the clarity state of the shooting lens of the second image acquisition device, and automatically wiping the lens when the shooting lens of the second image acquisition device is blurred, identifying the deviation state of the conveyor belt and controlling deviation correction, identifying the tearing / scratches of the conveyor belt, and performing a series of actions such as emergency shutdown before a possible safety accident to timely make up for the economic losses that the entire conveyor belt may be paralyzed.

[0105] An embodiment of the present invention also provides a computer program product, which includes program code. When the program product runs on an electronic device, the program code is used to cause the electronic device to execute the steps in the method according to various exemplary embodiments of the present invention described above in this specification.

[0106] In addition, although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that these steps must be executed in this specific order, or that all the steps shown must be executed to achieve the desired result. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step for execution, and / or one step may be decomposed into multiple steps for execution, etc.

[0107] Those skilled in the art can easily understand that the exemplary embodiments described herein can be implemented by software or by a combination of software and necessary hardware. Therefore, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (such as a personal computer, server, mobile terminal, or network device, etc.) to execute the method according to the embodiments of the present disclosure.

[0108] In an exemplary embodiment of the present disclosure, there is also provided an electronic device capable of implementing the above method.

[0109] Those skilled in the art can understand that various aspects of the present invention can be implemented as a system, a method, or a program product. Therefore, various aspects of the present invention can be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or an implementation combining hardware and software aspects, which can be collectively referred to as "circuitry", "module", or "system" here.

[0110] The electronic device according to this embodiment of the present invention. The electronic device is only an example and should not impose any limitations on the functions and usage scope of the embodiments of the present invention.

[0111] The electronic device is presented in the form of a general-purpose computing device. The components of the electronic device may include, but are not limited to: at least one of the above processors, at least one of the above memories, and a bus connecting different system components (including the memory and the processor).

[0112] Wherein, the memory stores program code, and the program code can be executed by the processor, so that the processor executes the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of this specification.

[0113] The memory may include a readable medium in the form of a volatile memory, such as a random access memory (RAM) and / or a cache memory, and may further include a read-only memory (ROM).

[0114] The memory may also include a program / utility having a set (at least one) of program modules, and such program modules include, but are not limited to: an operating system, one or more application programs, other program modules, and program data. The implementation of a network environment may be included in each or some combination of these examples.

[0115] The bus can represent one or more of several types of bus architectures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of the various bus architectures.

[0116] The electronic device can also communicate with one or more external devices (such as a keyboard, a pointing device, a Bluetooth device, etc.), can also communicate with one or more devices that enable a user to interact with the electronic device, and / or can communicate with any device that enables the electronic device to communicate with one or more other computing devices (such as a router, a modem, etc.). Such communication can be carried out through an input / output (I / O) interface. Moreover, the electronic device can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter.

[0117] Through the description of the above embodiments, those skilled in the art can easily understand that the exemplary embodiments described herein can be implemented by software or by a combination of software and necessary hardware. Therefore, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.

[0118] In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium, on which a program product capable of implementing the above method of this specification is stored. In some possible implementation manners, various aspects of the present invention can also be implemented in the form of a program product, which includes program code. When the program product runs on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of this specification.

[0119] The program product can adopt any combination of one or more readable media. The readable media can be a readable signal medium or a readable storage medium. The readable storage medium can, for example, be but is not limited to an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0120] A computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which readable program code is carried. Such a propagated data signal may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The readable signal medium may also be any readable medium other than a readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0121] The program code contained on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0122] The program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and also including conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computing device, partially on the user's device, executed as a stand-alone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., by connecting through the Internet using an Internet service provider).

[0123] In addition, the above-mentioned drawings are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present invention, and are not for limiting purposes. It is easy to understand that the processes shown in the above-mentioned drawings do not indicate or limit the time sequence of these processes. Additionally, it is also easy to understand that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0124] It should be noted that although several modules or units of a device for action execution are mentioned in the above detailed description, such a division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more of the above-mentioned modules or units may be embodied in one module or unit. Conversely, the features and functions of one module or unit described above may be further divided and embodied by multiple modules or units.

[0125] As described above, it is only the specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by those skilled in the art within the technical scope disclosed by the present invention should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A conveyor belt operation safety detection method, characterized in that: The method comprises: Determine whether the conveyor belt to be detected is in a load-carrying state according to the temperature value of the roller of the conveyor belt to be detected; When the conveyor belt to be detected is in a loaded running state, the state of the conveyor belt to be detected is determined according to the proportion of the conveyor belt to be detected in the corresponding first detection area; the state of the conveyor belt to be detected includes a deviation state and a non-deviation state; When the conveyor belt to be detected is in a deviated state, a deviation correction signal is sent to a controller corresponding to the conveyor belt to be detected, so that the controller controls the conveyor belt to be detected to be in a non-deviated state; When the conveyor belt to be detected is in a non-deviation state, determining whether the surface of the conveyor belt to be detected is torn according to the surface image of the conveyor belt to be detected in the corresponding second detection area; When a tear occurs on the surface of the conveyor belt to be detected, an alarm signal is issued; Wherein, determining whether the conveyor belt to be detected is in a load-carrying operation state according to the temperature value of the roller of the conveyor belt to be detected includes: Acquire in real time the temperature value of the roller to be detected when the conveyor belt to be detected is in a running state; the roller to be detected is any roller among the plurality of rollers corresponding to the conveyor belt to be detected and / or the roller with the largest area among the plurality of rollers; If the temperature of the roller to be tested in this detection is greater than the temperature of the roller to be tested in the previous detection, and the temperature difference is greater than the preset first temperature difference threshold, and the temperature of the roller to be tested in this detection is lower than the temperature of the roller to be tested in the next detection, and the temperature difference is less than or equal to the preset second temperature difference threshold, it is determined that the conveyor belt to be tested is in a load-bearing running state; the first temperature difference threshold is greater than or equal to the second temperature difference threshold.

2. The method according to claim 1, characterized in that When the conveyor belt to be detected is in a load-carrying state, determining the state of the conveyor belt to be detected according to the proportion of the conveyor belt to be detected in the corresponding first detection area includes: When the conveyor belt to be detected is in a loaded running state, a first detection image of a first detection area photographed by a first image acquisition device corresponding to the conveyor belt to be detected is acquired in real time; the first detection area is an area photographed by the first image acquisition device; the first image acquisition device is arranged below the conveyor belt to be detected, and the shooting angle of the first image acquisition device is toward the edge of the conveyor belt to be detected; Performing semantic segmentation processing on the first detection image to obtain a conveyor belt image area corresponding to the conveyor belt to be detected included in the first detection image; When the ratio of the area of ​​the conveyor belt image region to the area of ​​the first detection image is greater than a preset area ratio threshold, it is determined that the conveyor belt to be detected is in a deviation state; When the ratio of the area of ​​the conveyor belt image region to the area of ​​the first detection image is less than or equal to a preset area ratio threshold, it is determined that the conveyor belt to be detected is in a non-deviated state.

3. The method according to claim 2, characterized in that The execution method of the controller corresponding to the conveyor belt to be detected includes: In response to receiving a correction signal, the conveyor belt to be detected is controlled to offset a correction angle to the initial position corresponding to the conveyor belt to be detected; the correction angle is (T1-T2)×T0; wherein T1 is the ratio of the area of ​​the conveyor belt image area in the first detection image at the current moment to the area of ​​the first detection image; T2 is a preset area ratio threshold; and T0 is a preset correction initial angle.

4. The method according to claim 1, characterized in that: When the conveyor belt to be detected is in a non-deviation state, determining whether the surface of the conveyor belt to be detected is torn according to the surface image of the conveyor belt to be detected in the corresponding second detection area includes: When the conveyor belt to be detected is in a non-deviation state, a second detection image of a second detection area photographed by a second image acquisition device corresponding to the conveyor belt to be detected is acquired in real time; the second detection area is an area photographed by the second image acquisition device; the second image acquisition device is arranged on the roller of the conveyor belt to be detected, and the shooting angle of the second image acquisition device is toward the surface of the conveyor belt to be detected; grayscale the second detection image to obtain a third detection image; Performing Laplace transform on the third detection image to obtain a convolution kernel variance corresponding to the third detection image; When the variance of the convolution kernel is greater than a preset variance threshold, performing image recognition on the second detection image to obtain a surface image area corresponding to the conveyor belt to be detected included in the second detection image; Performing feature recognition on a plurality of pixel points in the surface image area, and determining pixel points that meet a preset tearing feature rule as tearing pixel points; Determine the area composed of torn pixels as the torn area; When the length of the torn area is greater than a preset length threshold, it is determined that a tear occurs on the surface of the conveyor belt to be detected.

5. The method according to claim 4, characterized in that The performing Laplace transform on the third detection image to obtain the convolution kernel variance corresponding to the third detection image further includes: When the variance of the convolution kernel is less than or equal to a preset variance threshold, a cleaning signal is sent to the controller corresponding to the conveyor belt to be detected, so that the controller controls the cleaning device to clean the shooting lens of the second image acquisition device.

6. The method according to claim 1, characterized in that The method further comprises: Storing the running status data of the conveyor belt to be detected; The running status data of the conveyor belt to be detected includes any one or more combinations of the following: The temperature value of the roller of the conveyor belt to be detected, the proportion of the conveyor belt to be detected in the corresponding first detection area when it is in a deviation state, and the surface image of the conveyor belt to be detected when the surface is torn.

7. A conveyor belt operation safety detection device, characterized in that: include: A load judgment module, used to determine whether the conveyor belt to be detected is in a loaded running state according to the temperature value of the roller of the conveyor belt to be detected; A deviation judgment module, used for determining the state of the conveyor belt to be detected according to the proportion of the conveyor belt to be detected in the corresponding first detection area when the conveyor belt to be detected is in a loaded running state; the state of the conveyor belt to be detected includes a deviation state and a non-deviation state; A deviation correction control module, used for sending a deviation correction signal to a controller corresponding to the conveyor belt to be detected when the conveyor belt to be detected is in a deviation state, so that the controller controls the conveyor belt to be detected to be in a non-deviation state; A tearing judgment module, used for determining whether a tear occurs on the surface of the conveyor belt to be detected according to a surface image of the conveyor belt to be detected in a corresponding second detection area when the conveyor belt to be detected is in a non-deviation state; A tearing alarm module, used for sending an alarm signal when a tear occurs on the surface of the conveyor belt to be detected; Wherein, determining whether the conveyor belt to be detected is in a load-carrying operation state according to the temperature value of the roller of the conveyor belt to be detected includes: Acquire in real time the temperature value of the roller to be detected when the conveyor belt to be detected is in a running state; the roller to be detected is any roller among several rollers corresponding to the conveyor belt to be detected and / or the roller with the largest area among several rollers; if the temperature of the roller to be detected detected this time is greater than the temperature of the roller to be detected detected last time, and the temperature difference is greater than a preset first temperature difference threshold, and the temperature of the roller to be detected detected this time is less than the temperature of the roller to be detected detected next time, and the temperature difference is less than or equal to a preset second temperature difference threshold, determine that the conveyor belt to be detected is in a load-bearing running state; the first temperature difference threshold is greater than or equal to the second temperature difference threshold.

8. A non-transitory computer-readable storage medium, wherein at least one instruction or at least one program is stored in the storage medium, characterized in that: The at least one instruction or the at least one program is loaded and executed by the processor to implement the conveyor belt operation safety detection method as described in any one of claims 1-6.

9. An electronic device, characterized in that: The invention comprises a processor and the non-transitory computer-readable storage medium as claimed in claim 8.

Images