Engineering equipment magnification detection method, processor, device and readable storage medium

Abstract

Embodiments of the present invention provide a method, processor, device, and readable storage medium for detecting the magnification of engineering equipment, belonging to the technical field of engineering equipment. The method acquires an image corresponding to the arm pulley assembly of the engineering equipment and recognizes the image based on a preset image recognition model, thereby reducing interference information and effectively improving the recognition accuracy of valid information to determine the magnification of the engineering equipment. If the engineering equipment is determined to be in an operating state, the magnification is sent to the torque limiter of the engineering equipment, thereby improving the effectiveness and practicality of the magnification information.

Description

Technical Field

[0001] The present invention relates to the technical field of engineering equipment, and in particular to an engineering equipment magnification detection method, processor, device and readable storage medium. Background Art

[0002] Traditionally, crane multipliers are manually input into the torque limiter for crane control. However, manual input can lead to errors or omissions, posing safety risks. Furthermore, automated crane operation necessitates automated multiplier detection.

[0003] In the existing automatic detection method of the magnification, the magnification is calculated by reverse calculation of the total load after the crane is hoisted and the tension of the single rope. However, a heavy object needs to be hoisted to achieve detection. The magnification is judged by detecting with sensors installed at the connection point between the pulley block and the wire rope. The number of sensors installed is large and they need to be close to the pulley block. When the magnification is changed, the sensors are easily damaged and the overall circuit is complicated. Conventional methods all have certain limitations and low practicality, and have not yet been widely used. Summary of the Invention

[0004] In view of the above-mentioned deficiencies in the prior art, an object of the embodiments of the present invention is to provide an engineering equipment magnification detection method, processor, device and readable storage medium.

[0005] In order to achieve the above-mentioned object, the first aspect of the present invention provides a method for detecting a magnification of engineering equipment, comprising:

[0006] Obtain the image corresponding to the arm pulley assembly of the engineering equipment;

[0007] Recognize the image based on a preset image recognition model to determine the magnification of the engineering equipment;

[0008] When it is determined that the engineering equipment is in a working state, the override is sent to the torque limiter of the engineering equipment.

[0009] In an embodiment of the present invention, the image is recognized based on a preset image recognition model to determine the magnification of the engineering equipment, including:

[0010] Cutting the image based on the preset slice position to obtain the image slice corresponding to the image;

[0011] Image slices are identified based on a preset image recognition model to determine the magnification of the engineering equipment.

[0012] In an embodiment of the present invention, identifying the image slice based on a preset image recognition model to determine the magnification of the engineering equipment includes:

[0013] Determine based on a preset image recognition model whether there is a wire rope in the rope groove of the boom head pulley block in the image slice or whether there is a connecting component at the wire rope connection point corresponding to the boom head pulley block;

[0014] Determine the multiplier of the engineering equipment based on the presence of wire ropes and connecting components.

[0015] In an embodiment of the present invention, determining whether a steel wire rope exists in a rope groove of a boom head pulley assembly in an image slice includes:

[0016] Determine a target image slice corresponding to the same rope groove in all image slices based on a preset slice position;

[0017] Determine the proportion of target image slices with wire ropes in the rope groove among all target image slices;

[0018] Based on whether the proportion is greater than a preset proportion threshold, it is determined whether there is a wire rope in the rope groove of the arm head pulley assembly in the image slice.

[0019] In an embodiment of the present invention, the following further comprises:

[0020] When the proportion is greater than zero and less than or equal to the preset proportion threshold, an error prompt message is output.

[0021] In an embodiment of the present invention, after the step of determining the magnification of the engineering equipment, the method further includes:

[0022] Obtain the current load and boom elevation angle corresponding to the torque limiter of the engineering equipment;

[0023] Whether the engineering equipment is in a working state is determined according to whether the current load is greater than the minimum working load and / or whether the boom elevation angle is greater than a working elevation angle threshold.

[0024] In an embodiment of the present invention, the following further comprises:

[0025] In the event that image recognition fails, the image acquisition module failure information is output.

[0026] A second aspect of the present invention provides a processor configured to implement the steps of the engineering equipment ratio detection method as described in the above embodiment when executing.

[0027] A third aspect of the present invention provides an engineering equipment rate detection device, comprising:

[0028] One or more image acquisition modules, installed above the arm head pulley block of the engineering equipment, for acquiring images corresponding to the arm head pulley block of the engineering equipment;

[0029] The processor as described in the above embodiment.

[0030] A fourth aspect of the present invention provides a machine-readable storage medium having stored thereon instructions for enabling a machine to execute the engineering equipment ratio detection method as described in the above embodiment.

[0031] Through the above technical solution, the image corresponding to the arm head pulley group of the engineering equipment is obtained, and the image slices are identified based on the preset image recognition model to reduce interference information and effectively improve the recognition accuracy of effective information to determine the magnification of the engineering equipment. When it is determined that the engineering equipment is in working condition, the magnification is sent to the torque limiter of the engineering equipment, thereby improving the effectiveness and practicality of the magnification information.

[0032] Other features and advantages of the embodiments of the present invention will be described in detail in the subsequent detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The accompanying drawings are used to provide a further understanding of the embodiments of the present invention and constitute a part of the specification. Together with the following detailed description, they are used to explain the embodiments of the present invention, but do not constitute a limitation of the embodiments of the present invention. In the accompanying drawings:

[0034] Figure 1 2 is a flow chart of a method for detecting a magnification of engineering equipment according to an embodiment of the present invention;

[0035] Figure 2 A schematic structural diagram of a pulley assembly according to an embodiment of the present invention;

[0036] Figure 3 Schematic diagram of an application scenario of rate detection according to an embodiment of the present invention. DETAILED DESCRIPTION

[0037] The following describes the specific embodiments of the present invention in detail with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only used to illustrate and explain the present invention and are not intended to limit the present invention.

[0038] It should be noted that if the embodiments of the present application involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the various components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indications will also change accordingly.

[0039] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present application, the descriptions of "first", "second", etc. are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of such features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the fact that they can be implemented by ordinary technicians in this field. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0040] Figure 1 FIG. 1 is a flow chart of a method for detecting a rate of engineering equipment according to an embodiment of the present invention. Figure 1 As shown, in an embodiment of the present invention, a method for detecting a magnification of engineering equipment is provided. Taking the method applied to a processor as an example, the method may include the following steps:

[0041] Step S100, obtaining an image corresponding to the arm pulley assembly of the engineering equipment;

[0042] In this embodiment, it should be noted that the safety control of the torque limiter of some lifting equipment and the interface display need to refer to the magnification of the equipment. This embodiment provides a magnification detection method for engineering equipment, taking the engineering equipment as a crane as an example. The image corresponding to the boom pulley block refers to the image captured by the image acquisition device installed above the boom pulley block of the engineering equipment, and the reference is made to the image acquisition device. Figure 2 In one embodiment, the pulley block structure may include a boom movable pulley, a hook movable pulley, and a wire rope connection point. In this embodiment, the image includes the boom fixed pulley block and the wire rope connection point near the boom fixed pulley block. The acquired image is used to identify the relevant information of the boom pulley block and the wire rope connection point to determine the magnification of the engineering equipment. Installing the image acquisition device directly above the boom pulley block to obtain the image corresponding to the boom pulley block can more accurately obtain the effective information required to determine the magnification. Compared with some conventional technologies that limit the image acquisition device to the side of the boom, the method of installing it directly above the boom pulley block can improve the accuracy of extracting effective information. It can be understood that when the field of view of a single image acquisition device cannot traverse the effective information of all boom pulley blocks, multiple image acquisition devices can be installed to capture images and perform image merging processing.

[0043] Step S200, recognizing the image based on a preset image recognition model to determine the magnification of the engineering equipment;

[0044] It should be noted that the magnification refers to the actual magnification of the crane, including the labor-saving or speed-increasing magnification of the crane's wire rope pulley assembly. It can be determined based on the number of wire rope strands between the fixed pulley assembly and the movable pulley assembly and the presence of wire rope connection components at the wire rope connection point. The specific algorithm of the preset image recognition model can adopt a machine vision algorithm, using edge detection and surface roughness multi-feature fusion to distinguish wire ropes and rope grooves using contour and surface texture features, and distinguish the location of wire rope connection points using contour features to complete the recognition of image slices. It can also be implemented using deep learning methods, such as algorithms such as convolutional neural networks to extract image slice features. The preset image recognition model can simultaneously recognize wire ropes and rope grooves and wire rope connection points. In one embodiment, the preset image recognition model can also include two models, one for recognizing wire ropes and rope grooves and the other for recognizing wire rope connection points.

[0045] Specifically, the image is recognized based on a preset image recognition model to determine the magnification of the engineering equipment, including:

[0046] Step a, intercepting the image based on a preset slice position to obtain an image slice corresponding to the image;

[0047] Step b: identifying the image slices based on a preset image recognition model to determine the magnification of the engineering equipment.

[0048] It should be noted that the image corresponding to the arm pulley block does not include all the content included in the image as valid information for determining the magnification. If the image captured by the image acquisition device is directly used for image recognition as a whole, the error in valid information recognition is large, which may easily lead to low accuracy in magnification detection. In this embodiment, the key positions in the image are intercepted based on the effective information related to the determination of the magnification to obtain image slices. The image slices contain less interference information and more accurate effective information than the image as a whole. The preset slice position is the key point position of the image corresponding to the arm pulley block of the engineering equipment that is pre-set. The image is intercepted based on the preset slice position. It can be understood that the preset slice positions corresponding to engineering equipment of different structures or different models are not necessarily the same, and can be adaptively adjusted according to the specific structure of the engineering equipment.

[0049] Step S300: When it is determined that the engineering equipment is in working state, the magnification is sent to the torque limiter of the engineering equipment.

[0050] It should be noted that while the image acquisition device can continuously capture images corresponding to the boom pulley assembly, when the crane is not in operation, it cannot ensure that the wire rope is always in the pulley groove. Therefore, determining the crane's magnification based on the captured images is of low reference value. In this embodiment, whether the engineering equipment is in operation is determined. Only when the engineering equipment is in operation is the determined magnification sent to the engineering equipment's torque limiter for safety control or to display the magnification on the interface.

[0051] refer to Figure 3 After the image acquisition module obtains the image corresponding to the arm head pulley group, it processes the image and obtains the magnification corresponding to the engineering equipment to send it to the torque limiter.

[0052] The present application provides a method for determining whether engineering equipment is in a working state based on the current load and boom elevation angle of a crane. Therefore, in one embodiment, after the step of determining the magnification of the engineering equipment, the method further includes:

[0053] Step c, obtaining the current load and boom elevation angle corresponding to the torque limiter of the engineering equipment;

[0054] Step d: determining whether the engineering equipment is in working condition according to whether the current load is greater than the minimum working load and / or whether the boom elevation angle is greater than the working elevation angle threshold.

[0055] In this embodiment, it should be noted that the current load refers to the load of the engineering equipment in its current state, the minimum working load refers to the minimum hook weight compatible with the type of engineering equipment, and the boom elevation angle refers to the angle between the boom and the horizontal plane. The working elevation angle threshold can be determined based on the actual type of engineering equipment and is set at 15° in this embodiment. The engineering equipment can be determined to be in the working state if the current load is greater than the minimum working load, the boom elevation angle is greater than the working elevation angle threshold, or if the current load is greater than the minimum working load and the boom elevation angle is greater than the working elevation angle threshold.

[0056] In one embodiment, it further includes:

[0057] Step e: if image recognition fails, output image acquisition module failure information.

[0058] It should be noted that the image acquisition module is used to perform image recognition, including image acquisition and image processing. If image recognition fails, it can be determined that there is an image acquisition error or an image processing error. At this moment, the image acquisition module fault is directly located and the image acquisition module fault information is output so that the operator can take corresponding maintenance measures based on the output fault information.

[0059] The above-mentioned engineering equipment ratio detection method obtains the image corresponding to the arm head pulley group of the engineering equipment, and identifies the image slice corresponding to the image based on the preset image recognition model, thereby reducing the difficulty of the algorithm while reducing interference information and effectively improving the recognition accuracy of effective information to determine the ratio of the engineering equipment. When it is determined that the engineering equipment is in working condition, the ratio is sent to the torque limiter of the engineering equipment, thereby improving the effectiveness and practicality of the ratio information.

[0060] In one embodiment, identifying the image slice based on a preset image recognition model to determine the magnification of the engineering equipment includes:

[0061] Step f, determining whether there is a wire rope in the rope groove of the arm head pulley block in the image slice or whether there is a connecting component at the wire rope connection point corresponding to the arm head pulley block based on a preset image recognition model;

[0062] Step g, determining the magnification of the engineering equipment based on the presence of the wire rope and the connecting components.

[0063] In this embodiment, it should be noted that each image slice is identified based on a preset image recognition model to determine whether there is a wire rope in the rope groove of the arm head pulley block in the image slice or whether there is a connecting component at the wire rope connection point corresponding to the arm head pulley block, and the feature search problem is simplified into two binary classification problems, among which the binary classification results of whether there is a wire rope in the rope groove are rope in the rope groove and no rope in the rope groove; the binary classification results of whether there is a connecting component at the wire rope connection point are connection point and no connection point.

[0064] Specifically, in this embodiment, the magnification of the engineering equipment can be calculated in the following way:

[0065] G=2*a+b+1

[0066] Where G represents the magnification; a represents the number of pulleys in the arm pulley block with wire rope in the rope groove; b represents whether there is a connecting component at the wire rope connection point. If there is a connecting component, b takes the value of 1; if there is no connecting component, b takes the value of 0.

[0067] It is understandable that different methods of calculating the magnification may be used based on different arm pulley block structures, and the magnification may be adaptively adjusted according to the actual structure of the engineering equipment.

[0068] In this embodiment, the feature search problem is simplified into two binary classification problems, which greatly reduces the amount of computation and the difficulty of data collection.

[0069] In one embodiment, determining whether a steel wire rope exists in a rope groove of a boom pulley assembly in an image slice includes:

[0070] Step h, determining a target image slice corresponding to the same rope groove in all image slices based on a preset slice position;

[0071] Step i, determining the proportion of target image slices in which the wire rope exists in the rope groove among all target image slices;

[0072] Step j: determining whether there is a steel wire rope in the rope groove of the arm head pulley assembly in the image slice based on whether the proportion is greater than a preset proportion threshold.

[0073] In this embodiment, it should be noted that once the preset slice positions are predetermined, the rope grooves of all pulleys included in different boom pulley assemblies can be categorized. Image slices corresponding to the rope grooves of the same pulley can be grouped into the same target image slice group. When determining whether a wire rope is present in a rope groove, a determination is made based on all target image slices corresponding to the rope groove. Specifically, in this embodiment, the presence of a wire rope in a rope groove is determined based on the proportion of target image slices indicating the presence of a wire rope in the rope groove relative to all target image slices. The preset proportion threshold is a predetermined basis for determining whether a wire rope is present in a rope groove. In one embodiment, the preset proportion threshold can be any value greater than 50%.

[0074] In one embodiment, it further includes:

[0075] Step k: when the proportion is greater than zero and less than or equal to a preset proportion threshold, output error prompt information.

[0076] When the proportion of target image slices in which a wire rope exists in the rope groove among all target image slices is greater than a preset proportion threshold, it is determined that a wire rope exists in the rope groove of the arm head pulley group in the image slice; when the proportion is greater than zero and less than or equal to the preset proportion threshold, it is determined that a smaller portion of the target image slices recognizes that there is a wire rope in the rope groove, but a larger portion of the target image slices recognizes that there is no wire rope in the rope groove, and an error prompt message is output at this time to prompt the operator to make a determination.

[0077] In this embodiment, the recognition result of the image slice is further judged by setting a preset ratio threshold, thereby reducing recognition errors and effectively improving the accuracy of magnification detection.

[0078] An embodiment of the present invention provides a processor, which is used to run a program, wherein the engineering equipment magnification detection method is executed when the program is run.

[0079] An embodiment of the present invention provides an engineering equipment rate detection device, comprising:

[0080] One or more image acquisition modules, installed above the arm head pulley block of the engineering equipment, for acquiring images corresponding to the arm head pulley block of the engineering equipment;

[0081] The processor as described in the above embodiment.

[0082] The engineering equipment rate detection device provided in the embodiment of the present application can achieve Figure 1 The various processes of the engineering equipment rate detection method in the method embodiment can achieve the same technical effect. To avoid repetition, they will not be described here.

[0083] An embodiment of the present invention provides a machine-readable storage medium having a program stored thereon. When the program is executed by a processor, the method for detecting the magnification of engineering equipment is implemented.

[0084] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0085] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the steps in the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0086] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0087] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0088] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0089] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0090] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media (transitory media), such as modulated data signals and carrier waves.

[0091] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

[0092] The above are merely embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should all be included within the scope of the claims of the present application.

Claims

1. A method for detecting the rate of engineering equipment, characterized in that: include: Obtain the image corresponding to the arm pulley assembly of the engineering equipment; Recognize the image based on a preset image recognition model to determine the magnification of the engineering equipment; When it is determined that the engineering equipment is in a working state, sending the magnification to a torque limiter of the engineering equipment; The identifying the image based on a preset image recognition model to determine the magnification of the engineering equipment includes: intercepting the image based on a preset slice position to obtain an image slice corresponding to the image; Determine whether there is a wire rope in the rope groove of the boom head pulley block in the image slice or whether there is a connecting component at the wire rope connection point corresponding to the boom head pulley block based on a preset image recognition model; determining a magnification of the engineering equipment based on the presence of the steel wire rope and the connecting component; Determining whether there is a steel wire rope in the rope groove of the arm head pulley assembly in the image slice includes: determining a target image slice corresponding to the same rope groove in all the image slices based on a preset slice position; Determine the proportion of the target image slices in which the wire rope exists in the rope groove among all the target image slices; determining whether there is a steel wire rope in the rope groove of the arm head pulley block in the image slice based on whether the proportion is greater than a preset proportion threshold; When the proportion is greater than zero and less than or equal to the preset proportion threshold, outputting error prompt information; The multiplication factor of the engineering equipment is calculated as follows: Where G represents the magnification; a represents the number of pulleys in the arm pulley block with wire rope in the rope groove; b represents whether there is a connecting component at the wire rope connection point. If there is a connecting component, b takes the value of 1; if there is no connecting component, b takes the value of 0.

2. The method for detecting the rate of engineering equipment according to claim 1, characterized in that: After the step of determining the magnification of the engineering equipment, the method further includes: Obtaining a current load and boom elevation angle corresponding to a torque limiter of the engineering equipment; Whether the engineering equipment is in a working state is determined according to whether the current load is greater than a minimum working load and / or whether the boom elevation angle is greater than a working elevation angle threshold.

3. The engineering equipment rate detection method according to claim 1, characterized in that: Also includes: In the event that image recognition fails, the image acquisition module failure information is output.

4. A processor, characterized in that: The method is configured to execute the method for detecting the magnification of engineering equipment according to any one of claims 1 to 3.

5. A device for detecting the rate of engineering equipment, characterized in that: include: One or more image acquisition modules, installed above the arm head pulley block of the engineering equipment, for acquiring images corresponding to the arm head pulley block of the engineering equipment; The processor according to claim 4.

6. A machine-readable storage medium having instructions stored thereon, wherein when the instructions are executed by a processor, the processor executes the engineering equipment ratio detection method according to any one of claims 1 to 3.

Images