Remote control system and method for crane

Through video analysis and suspension recognition model, alarm signals and regulation solutions are generated, which solves the problem that crane control systems in the existing technology are difficult to detect and regulate dangerous situations in a timely manner, and improves the safety of cranes and the accuracy of data analysis.

CN118992835AInactive Publication Date: 2024-11-22ANHUI JIANGHE INTELLIGENT EQUIP GRP CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410945948.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-15
Publication Date
2024-11-22
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The existing crane control system is difficult to detect and control dangerous situations in a timely manner based on the real-time operating status, resulting in low safety of remote control.

Method used

The real-time status of the crane is obtained through video analysis, the suspension recognition model is used to fit the cargo suspension change curve, generate alarm signals and control plans, adjust the crane operating status, and remind relevant personnel to improve safety.

Benefits of technology

Real-time monitoring and timely regulation of crane operating status is realized, the safety of cranes is improved, the accuracy of cargo suspension analysis is ensured and the amount of data is reduced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118992835A_ABST
    Figure CN118992835A_ABST
Patent Text Reader

Abstract

The invention discloses a remote control system and method for a crane, relates to the technical field of automatic control, and solves the problem that an existing crane control system is difficult to find dangerous conditions in the running process of the crane in time according to the real-time running state of the crane so as to carry out targeted regulation and control; and the safety of the remotely-controlled jack is relatively low. The data acquisition module is used for acquiring a state video of the lifting claw in real time; the central processing module is used for generating an interception interval according to the regulation and control speed, the cargo weight and the cargo volume; inputting the state image of the lifting claw into a suspension distance identification model to obtain a cargo suspension distance; generating a change curve according to the cargo suspension distance; generating an alarm signal and a regulation and control scheme according to the change curve; the crane control module adjusts the running state of the crane according to the regulation and control scheme; the danger alarm module gives an alarm according to the alarm signal; and the working state of the crane is adjusted in time, so that the safety of the crane in the operation process is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of automation control technology, and relates to automation control technology, and specifically to a crane remote control system and method. Background Art

[0002] With the continuous development of industrial automation and intelligent technology, remote control technology has been widely used in various fields. As an important equipment in industrial production, the research and development of remote control systems for cranes is particularly important. Through remote control technology, real-time monitoring, precise regulation and efficient management of cranes can be achieved, thereby improving production efficiency and safety.

[0003] Existing crane control systems often simply replace the fixed process control of the crane, and some are controlled manually. Regardless of whether it is fixed process control or manual remote control, it is difficult to detect dangerous situations in the operation of the crane in a timely manner according to the real-time operating status of the crane and perform targeted regulation, resulting in lower safety of remote-controlled cranes.

[0004] Therefore, a crane remote control system and method are needed. Summary of the invention

[0005] The present application aims to solve at least one of the technical problems existing in the prior art; to this end, the present application proposes a remote control system and method for a crane, which is used to solve the technical problem that the existing crane control system is difficult to detect dangerous situations in the operation process of the crane in time according to the real-time operating status of the crane and perform targeted regulation; resulting in low safety of the remote-controlled crane. The present application obtains a change curve of the cargo suspension distance through video analysis of the lifting grabbing state; generates an alarm signal and a control plan according to the change curve; and adjusts the operating status of the crane according to the control plan to solve the above-mentioned problem.

[0006] To achieve the above-mentioned purpose, the first aspect of the present application provides a crane remote control system, comprising: a data acquisition module, a central processing module, an information transmission module, a crane control module, a danger alarm module and a database;

[0007] The data acquisition module: acquires the lifting and grabbing state video in real time through the video acquisition device connected thereto, wherein the lifting and grabbing state video includes the lifting and grabbing lifting video and the lifting and grabbing transporting video; acquires the interception interval, and intercepts a number of frames of lifting and grabbing state images from the lifting and grabbing state video according to the interception interval;

[0008] The central processing module: obtains the control speed, cargo weight and cargo volume, and generates a cut-off interval according to the control speed, cargo weight and cargo volume; and obtains a number of lifting and grasping state images, inputs the several lifting and grasping state images into the overhang distance recognition model to obtain the cargo overhang distance; fits the cargo overhang distance into a cargo change curve according to the cut-off order of the corresponding lifting and grasping state images; generates an alarm signal and a control plan according to the change curve; wherein the overhang distance recognition model is obtained by training an artificial intelligence model;

[0009] The information transmission module: obtains the alarm signal and the control plan. When the alarm signal is an abnormal lifting speed alarm signal, the lifting control plan is first sent to the crane control module, and then the abnormal lifting speed alarm signal is sent to the danger alarm module; when the alarm signal is an abnormal transfer speed alarm signal, the transfer control plan is first sent to the crane control module, and then the abnormal transfer speed alarm signal is sent to the danger alarm module; when the alarm signal is an abnormal transfer alarm, the abnormal transfer alarm is directly sent to the danger alarm module;

[0010] Crane control module: obtains the control plan and adjusts the operation status of the crane according to the control plan;

[0011] Danger alarm module: obtains alarm signals and issues alarms based on the alarm signals.

[0012] The present application obtains the operation status of the crane and its corresponding real-time lifting grab status video; captures a number of lifting grab status image frames from the corresponding lifting grab status video according to the capture interval; inputs a number of lifting grab status images into an overhang recognition model to obtain the cargo overhang; fits the cargo overhang into a cargo change curve according to the capture order of its corresponding lifting grab status images; generates an alarm signal and a control plan according to the change curve; adjusts the operation status of the crane according to the control plan; issues an alarm according to the alarm signal; monitors the crane through the operation status of the lifting grab, and timely generates a control plan and an alarm signal according to the status of the lifting grab, timely adjusts the working status of the crane, and reminds relevant personnel to be prepared, so as to increase the safety of the crane during operation.

[0013] Preferably, generating the interception interval according to the control speed, cargo weight and cargo volume includes:

[0014] The cargo weight is marked as HZ, and the cargo volume is marked as HT; the cargo impact coefficient HY is calculated by the formula HY = α1×exp(-HZ / BZ)+α2×exp(-HT / BT); where α1 and α2 are weight coefficients, BZ is the set standard cargo mass; BT is the set standard cargo volume;

[0015] When the crane is operating in the lifting state, the lifting speed in the control speed is extracted and marked as TV, and the interception interval JJ is calculated by the formula JJ = [β1×exp(-TV / STV)+β2×HY]×SJ1;

[0016] When the crane is operating in the transport state, the transport speed in the control speed is extracted and marked as ZV, and the interception interval JJ is calculated by the formula JJ = [β3×exp(-ZV / SZV)+β4×HY+β5×exp(-ZH / QH)]×SJ1;

[0017] Among them, β1, β2, β3, β4 and β5 are adjustment coefficients, which are set according to experience; STV is the set standard lifting speed; SZV is the standard transfer speed, ZH is the transfer height, and QH is the crane height.

[0018] The present application obtains the interception intervals under different operating states of the crane in the above manner. When the crane is operating in the lifting state, the faster the lifting speed, or the heavier the cargo weight, or the larger the cargo volume, the greater the probability of an abnormality. This means that more image data needs to be obtained for analysis to improve the accuracy of the analysis results. That is, the corresponding interception interval is shorter. When the crane is working in the transfer state, the faster the transfer speed, or the heavier the cargo weight, or the larger the cargo volume, or the higher the cargo height, the greater the probability of an abnormality. This means that more image data needs to be obtained for analysis to improve the accuracy of the analysis results. That is, the corresponding interception interval is shorter. This embodiment ensures the accuracy of the data analysis results through the above manner, while also minimizing the amount of data used for analysis.

[0019] Preferably, the overhang recognition model is obtained by training an artificial intelligence model, including:

[0020] Acquire a number of historical lifting grabbing state images and their corresponding cargo suspension distances through a database; the cargo suspension distance is the distance between the cargo and the top of the crane;

[0021] Integrate the historical lifting and grabbing state images and the corresponding cargo suspension distances into a plurality of training data and test data;

[0022] The artificial intelligence model is trained using the training data; the trained artificial intelligence model is tested using the test data, and finally a suspension distance recognition model is obtained whose input is the lifting grasping state image and whose output is the suspension distance of the cargo; wherein the artificial intelligence model includes a BP neural network model or a RBF neural network model.

[0023] Preferably, generating the control scheme according to the acquired change curve includes:

[0024] When the crane is operating in the lifting state, a stability coefficient is generated according to the change curve; when the stability coefficient is greater than the stability threshold, the adjusted lifting speed TTV is calculated by the formula TTV=min[d[XJ(t)] / dt]; wherein XJ(t) is the change function corresponding to the change curve; and a lifting control scheme is generated according to the adjusted lifting speed;

[0025] When the crane is operating in the transfer state, obtain the change function XJ(t) corresponding to the change curve; when the change function XJ(t) is a periodic function, obtain the maximum amplitude M and change period T of the change function XJ(t); when the maximum amplitude exceeds the set amplitude threshold, or the change period is less than the set period threshold, the adjusted transfer speed TZV is calculated by the formula TZV=[1-γ3×exp(M-BM / BM)-γ4×exp(BT-T / BT)]×ZV; wherein BM is the amplitude threshold, BT is the period threshold; γ3 and γ4 are adjustment coefficients, and γ3∈(0,1); γ4∈(0,1); generate a transfer control scheme based on the adjusted transfer speed; the control scheme includes a lifting control scheme and a transfer control scheme. (If the lifting speed is variable)

[0026] Preferably, generating a stability coefficient according to the change curve includes:

[0027] Obtain the change function XJ(t) corresponding to the change curve; construct the speed difference function SC(t) by the formula SC(t)=d[XJ(t)] / dt-TV;

[0028] The corresponding stability coefficient WX is calculated by the formula WX=γ1×∫[SC(t)] / N+γ2×[max[SC(t)]-min[SC(t)]]; where γ1 and γ2 are weight coefficients; t∈(0,N).

[0029] Preferably, generating the alarm signal according to the acquired change curve comprises:

[0030] When the crane is operating in the lifting state, a stability coefficient is generated according to the change curve; when the stability coefficient is greater than the stability threshold, an abnormal lifting speed alarm signal is generated; otherwise, no alarm signal is generated;

[0031] When the crane is operating in the transfer state, the change function corresponding to the change curve is obtained to determine whether it is a periodic function;

[0032] If yes, the maximum amplitude and the variation period of the variation function are obtained; when the maximum amplitude exceeds the set amplitude threshold, or the variation period is less than the set period threshold, an abnormal transport speed alarm signal is generated; otherwise, no alarm signal is generated;

[0033] If not, a transfer abnormality alarm signal is generated; the alarm signal includes a lifting speed abnormality alarm signal, a transfer speed abnormality alarm signal and a transfer abnormality alarm signal.

[0034] Another aspect of the present application provides a crane remote control method, comprising the following steps:

[0035] Step 1, obtaining the crane operation state and its corresponding real-time lifting grab state video, wherein the crane operation state includes the lifting state and the transfer state; the lifting grab state video includes the lifting grab lifting video and the lifting grab transfer video; the lifting grab state video corresponding to the lifting state is the lifting grab lifting video; the lifting grab state video corresponding to the transfer state is the lifting grab transfer video;

[0036] Step 2: Obtain the control speed, cargo weight and cargo volume, and generate a cut-off interval according to the control speed, cargo weight and cargo volume;

[0037] Step 3: intercepting a number of frames of lifting and grasping state images from the corresponding lifting and grasping state video according to the interception interval;

[0038] Step 4: Inputting a number of lifting and grabbing state images into a suspension distance recognition model to obtain the cargo suspension distance, wherein the suspension distance recognition model is obtained by training an artificial intelligence model;

[0039] Step 5: Fit the cargo suspension distance into a cargo change curve according to the interception order of the corresponding lifting and grabbing state images;

[0040] Step 6: Generate alarm signals and control plans based on the change curve;

[0041] Step seven: obtaining an alarm signal, and sounding an alarm according to the alarm signal; and obtaining a control plan, and adjusting the operating state of the crane according to the control plan.

[0042] Compared with the prior art, the beneficial effects of this application are:

[0043] 1. The present application obtains the operation status of the crane and its corresponding real-time lifting grab status video; captures a number of lifting grab status image frames from the corresponding lifting grab status video according to the capture interval; inputs a number of lifting grab status images into an overhang recognition model to obtain the cargo overhang; fits the cargo overhang into a cargo change curve according to the capture order of its corresponding lifting grab status images; generates an alarm signal and a control plan according to the change curve; adjusts the operation status of the crane according to the control plan; issues an alarm according to the alarm signal; monitors the crane through the operation status of the lifting grab, and timely generates a control plan and an alarm signal according to the status of the lifting grab, timely adjusts the working status of the crane, and reminds relevant personnel to be prepared, so as to increase the safety of the crane during operation.

[0044] 2. The present application obtains the interception intervals under different operating states of the crane through the above method. When the crane is operating in the lifting state, the interception interval is generated according to the faster lifting speed, cargo weight and cargo volume; when the crane is working in the transfer state, the interception interval is generated according to the transfer speed, cargo weight and cargo volume; the accuracy of the data analysis results is ensured, and the amount of data used for analysis is reduced as much as possible. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0046] Figure 1 This is a schematic diagram of the principle of this application;

[0047] Figure 2 Schematic diagram of the steps of the application method. DETAILED DESCRIPTION

[0048] The technical solution of the present application will be described clearly and completely below in conjunction with the embodiments. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0049] See also Figure 1 , a first aspect of the present application provides a crane remote control system, comprising: a data acquisition module, a central processing module, an information transmission module, a crane control module, a danger alarm module and a database;

[0050] Data acquisition module: The lifting grab state video is acquired in real time through the video acquisition device connected thereto, and the lifting grab state video includes the lifting grab lifting video and the lifting grab transfer video; the video acquisition device includes a fixedly installed camera, etc. The lifting grab lifting video is a real-time acquired monitoring video of the crane working in the lifting state; the lifting grab transfer video is a real-time acquired monitoring video of the crane working in the transfer state; the lifting state is the operating state when the crane's lifting grab lifts the goods to a certain height; the transfer state is the operating state when the crane transfers the goods from an original position to a target position at the same height; the interception interval is acquired, and a number of frames of lifting grab state images are intercepted from the lifting grab state video according to the interception interval; the lifting grab state image is a lifting grab image intercepted from the corresponding lifting grab state video according to the interception interval; the interception interval is the time interval between two adjacent frames of the lifting grab state image.

[0051] Central processing module: obtain control speed, cargo weight and cargo volume, generate interception interval according to control speed, cargo weight and cargo volume; and obtain a number of lifting and grasping state images, input the several lifting and grasping state images into the overhang recognition model to obtain the cargo overhang; the cargo overhang is the distance between the cargo and the top of the crane; the cargo overhang is fitted into a cargo change curve according to the interception order of the corresponding lifting and grasping state images, and the interpolation method can be used here, or other methods can be used to fit the several cargo overhangs into a change curve according to the interception order; generate an alarm signal and a control plan according to the change curve; wherein, the overhang recognition model is obtained by training an artificial intelligence model;

[0052] Information transmission module: obtain alarm signals and control plans. When the alarm signal is an abnormal lifting speed alarm signal, the lifting control plan is first sent to the crane control module, and then the abnormal lifting speed alarm signal is sent to the danger alarm module; when the alarm signal is an abnormal transfer speed alarm signal, the transfer control plan is first sent to the crane control module, and then the abnormal transfer speed alarm signal is sent to the danger alarm module; when the alarm signal is an abnormal transfer alarm, the abnormal transfer alarm is directly sent to the danger alarm module; in this embodiment, the control plan is sent first, so that the crane can make corresponding adjustment operations in time, thereby increasing the safety of crane operation.

[0053] Crane control module: obtains the control plan and adjusts the operation status of the crane according to the control plan;

[0054] Danger alarm module: obtains alarm signals and issues alarms based on the alarm signals.

[0055] In this embodiment, the operation status of the crane and its corresponding real-time lifting grab status video are obtained; a number of lifting grab status image frames are captured from the corresponding lifting grab status video according to the capture interval; a number of lifting grab status images are input into the overhang recognition model to obtain the cargo overhang; the cargo overhang is fitted into a cargo change curve according to the capture order of the corresponding lifting grab status images; an alarm signal and a control scheme are generated according to the change curve; the operation status of the crane is adjusted according to the control scheme; an alarm is issued according to the alarm signal; the crane is monitored through the operation status of the lifting grab, and the control scheme and alarm signal are generated in time according to the status of the lifting grab, the working status of the crane is adjusted in time, and relevant personnel are reminded to be prepared, so as to increase the safety of the crane during operation.

[0056] Generate interception intervals based on control speed, cargo weight and cargo volume, including:

[0057] The cargo weight is marked as HZ, and the cargo volume is marked as HT; the cargo influence coefficient HY is calculated by the formula HY = α1×exp(-HZ / BZ)+α2×exp(-HT / BT); where α1 and α2 are weight coefficients, which are set according to experience; BZ is the set standard cargo mass; BT is the set standard cargo volume;

[0058] When the crane is operating in the lifting state, the lifting speed in the control speed is extracted and marked as TV, and the interception interval JJ is calculated by the formula JJ = [β1×exp(-TV / STV)+β2×HY]×SJ1;

[0059] When the crane is operating in the transfer state, the transfer speed in the control speed is extracted and marked as ZV, and the interception interval JJ is calculated by the formula JJ = [β3×exp(-ZV / SZV)+β4×HY+β5×exp(-ZH / QH)]×SJ1; among them, β1, β2, β3, β4 and β5 are adjustment coefficients, which are set according to experience; STV is the set standard lifting speed; SZV is the standard transfer speed, ZH is the transfer height, and QH is the crane height.

[0060] In this embodiment, the interception intervals under different operating states of the crane are obtained in the above manner. When the crane is operating in the lifting state, the faster the lifting speed, the heavier the cargo weight, or the larger the cargo volume, the greater the probability of an abnormality. This means that more image data need to be obtained for analysis to improve the accuracy of the analysis results. That is, the corresponding interception interval is shorter. When the crane is working in the transfer state, the faster the transfer speed, the heavier the cargo weight, the larger the cargo volume, or the higher the cargo height, the greater the probability of an abnormality. This means that more image data need to be obtained for analysis to improve the accuracy of the analysis results. That is, the corresponding interception interval is shorter. This embodiment ensures the accuracy of the data analysis results through the above manner, while also reducing the amount of data used for analysis as much as possible.

[0061] It is worth noting that if the lifting speed or transfer speed of the crane changes during operation, the lifting speed TV and transfer speed ZV used for calculation above are the maximum values ​​of the corresponding lifting speed and transfer speed respectively; or, the corresponding lifting and grabbing state video is segmented according to the lifting speed or transfer speed, and the same lifting speed or transfer speed in the lifting and grabbing state video is captured into one video segment; then the capture interval of each video segment is generated according to the above formula, and several frames of lifting and grabbing state images are captured in each video segment according to the capture interval.

[0062] The overhang distance recognition model is obtained through artificial intelligence model training, including: obtaining a number of historical lifting grab state images and their corresponding cargo overhang distances through a database; the cargo overhang distance is the distance between the cargo and the top of the crane; integrating the several historical lifting grab state images and their corresponding cargo overhang distances into a number of training data and inspection data; it can be understood that when identifying the lifting grab state image; there are corresponding punctuation marks on the lifting grab and the top of the crane to facilitate identification.

[0063] Use training data to train the artificial intelligence model; use test data to test the trained artificial intelligence model, specifically, input the crane state image in the test data into the trained artificial intelligence model to obtain the corresponding cargo overhang distance; determine whether the cargo overhang distance is consistent with the cargo overhang distance recorded in the corresponding test data, if yes, continue to test other test data; if not, adjust relevant parameters and continue to test this test data; until all test results meet the corresponding standards, which are set manually; finally obtain a overhang distance recognition model with the crane grab state image as input and the cargo overhang distance as output; wherein the artificial intelligence model includes a BP neural network model or an RBF neural network model.

[0064] Generate a control plan based on the acquired change curve, including:

[0065] When the crane is operating in the lifting state, obtain the change function XJ(t) corresponding to the change curve; construct the speed difference function SC(t) through the formula SC(t) = d[XJ(t)] / dt-TV; calculate the corresponding stability coefficient WX through the formula WX = γ1×∫[SC(t)] / N+γ2×[max[SC(t)]-min[SC(t)]]; wherein, γ1 and γ2 are weight coefficients, and are set according to experience; t∈(0, N). When the stability coefficient is greater than the stability threshold, the adjusted lifting speed TTV is calculated through the formula TTV = min[d[XJ(t)] / dt]; wherein XJ(t) is the change function corresponding to the change curve; and generate a lifting control plan based on the adjusted lifting speed; d[XJ(t)] / dt can indirectly indicate the actual running speed of the cargo;

[0066] In this embodiment, when the crane is operating in a lifting state, a speed difference function is obtained according to changes in the cargo suspension distance and the lifting speed, and a stability coefficient is obtained according to the difference between the average speed difference of the speed difference function and the maximum speed difference and the minimum speed difference. When the difference between the actual running speed of the cargo and the lifting speed is greater, or the actual running speed is more unstable, the corresponding stability coefficient is greater; this indicates that the cargo may be abnormal during the lifting process due to environmental or equipment aging, and the lifting speed needs to be regulated; at this time, the minimum value of the actual running speed is used as the target value for regulating the lifting speed, a lifting regulation plan is generated, and the crane is regulated; conversely, the smaller the stability coefficient is, the corresponding actual running speed of the cargo is not much different from the lifting speed, and no regulation is required.

[0067] When the crane is running in the transfer state, obtain the change function XJ(t) corresponding to the change curve; when the change function XJ(t) is a periodic function, obtain the maximum amplitude M and change period T of the change function XJ(t); when the maximum amplitude exceeds the set amplitude threshold, or the change period is less than the set period threshold, the transfer speed TZV is calculated by the formula TZV=[1-γ3×exp(M-BM / BM)-γ4×exp(BT-T / BT)]×ZV; among them, BM is the amplitude threshold, BT is the period threshold, which can be set according to experience or according to the transfer speed during transfer. Height and cargo quality, as well as cargo volume settings; when the transfer height is higher, or the cargo quality is greater, or the cargo volume is larger, the corresponding amplitude threshold is smaller and the cycle threshold is larger; such as through the formula BM=[a1×exp(-ZH / QH)+a2×HY]×SM, where a1 and a2 are adjustment coefficients, SM is the set standard amplitude, both of which are set in advance according to experience; γ3 and γ4 are adjustment coefficients, and are set according to experience, and γ3∈(0,1); γ4∈(0,1); a transfer control plan is generated according to the adjustment of the transfer speed; the control plan includes a lifting control plan and a transfer control plan.

[0068] When the goods are in the process of transshipment, the goods will swing periodically, which will cause the suspension distance of the goods to change periodically. In this embodiment, when the crane is operating in the transshipment state, it is determined whether the change function is a periodic function. If it is, the maximum amplitude and change period of the change function are obtained. When the maximum amplitude exceeds the set amplitude threshold, or the change period is less than the set period threshold, it means that the swing speed of the goods or the swing amplitude exceeds the safety range, and the speed needs to be reduced to ensure the safe operation of the crane. In this embodiment, the larger the swing amplitude or the smaller the change period, the more the corresponding speed is reduced on the basis of the original transshipment speed, and the transshipment speed is adjusted to adjust the transshipment speed of the crane to ensure the safety of the crane.

[0069] Generating an alarm signal according to the acquired change curve includes: when the crane is operating in a lifting state, generating a stability coefficient according to the change curve; when the stability coefficient is greater than a stability threshold, generating an abnormal lifting speed alarm signal; otherwise, not generating an alarm signal;

[0070] When the crane is operating in the transfer state, the change function corresponding to the change curve is obtained to determine whether it is a periodic function; if so, the maximum amplitude and change period of the change function are obtained; when the maximum amplitude exceeds the set amplitude threshold, or the change period is less than the set period threshold, an abnormal transfer speed alarm signal is generated; otherwise, no alarm signal is generated; if not, a transfer abnormality alarm signal is generated; the alarm signals include a lifting speed abnormality alarm signal, a transfer speed abnormality alarm signal and a transfer abnormality alarm signal.

[0071] See also Figure 2 Another aspect of the present application provides a crane remote control method, comprising the following steps:

[0072] Step 1, obtaining the crane operation state and its corresponding real-time lifting grab state video, wherein the crane operation state includes the lifting state and the transfer state; the lifting grab state video includes the lifting grab lifting video and the lifting grab transfer video; the lifting grab state video corresponding to the lifting state is the lifting grab lifting video; the lifting grab state video corresponding to the transfer state is the lifting grab transfer video;

[0073] Step 2: Obtain the control speed, cargo weight and cargo volume, and generate a cut-off interval according to the control speed, cargo weight and cargo volume;

[0074] Step 3: intercepting a number of frames of lifting and grasping state images from the corresponding lifting and grasping state video according to the interception interval;

[0075] Step 4: Inputting a number of lifting and grabbing state images into a suspension distance recognition model to obtain the cargo suspension distance, wherein the suspension distance recognition model is obtained by training an artificial intelligence model;

[0076] Step 5: Fit the cargo suspension distance into a cargo change curve according to the interception order of the corresponding lifting and grabbing state images;

[0077] Step 6: Generate alarm signals and control plans based on the change curve;

[0078] Step seven: obtaining an alarm signal, and sounding an alarm according to the alarm signal; and obtaining a control plan, and adjusting the operating state of the crane according to the control plan.

[0079] Part of the data in the above formula is calculated by removing the dimension and taking its numerical value. The formula is a formula closest to the actual situation obtained by software simulation of a large amount of collected data; the preset parameters and preset thresholds in the formula are set by technical personnel in this field according to actual conditions or obtained through simulation of a large amount of data.

[0080] How this application works:

[0081] The present application obtains the operation status of the crane and its corresponding real-time lifting grab status video; captures a number of lifting grab status image frames from the corresponding lifting grab status video according to the capture interval; inputs a number of lifting grab status images into an overhang recognition model to obtain the cargo overhang; fits the cargo overhang into a cargo change curve according to the capture order of its corresponding lifting grab status images; generates an alarm signal and a control plan according to the change curve; adjusts the operation status of the crane according to the control plan; issues an alarm according to the alarm signal; monitors the crane through the operation status of the lifting grab, and timely generates a control plan and an alarm signal according to the status of the lifting grab, timely adjusts the working status of the crane, and reminds relevant personnel to be prepared, so as to increase the safety of the crane during operation.

[0082] The above embodiments are only used to illustrate the technical method of the present application and are not intended to limit it. Although the present application has been described in detail with reference to the preferred embodiments, a person of ordinary skill in the art should understand that the technical method of the present application may be modified or replaced by equivalents without departing from the spirit and scope of the technical method of the present application.

Claims

1. A crane remote control system, comprising a data acquisition module, a central processing module, an information transmission module, a crane control module, a danger alarm module and a database; characterized in that: The data acquisition module: acquires the lifting and grabbing state video in real time through the video acquisition device connected thereto, wherein the lifting and grabbing state video includes the lifting and grabbing lifting video and the lifting and grabbing transporting video; acquires the interception interval, and intercepts a number of frames of lifting and grabbing state images from the lifting and grabbing state video according to the interception interval; The central processing module: obtains the control speed, cargo weight and cargo volume, and generates a cut-off interval according to the control speed, cargo weight and cargo volume; and obtains a number of lifting and grasping state images, and inputs the several lifting and grasping state images into the overhang recognition model to obtain the cargo overhang; fits the cargo overhang into a change curve of the cargo overhang according to the cut-off sequence of the corresponding lifting and grasping state images; generates an alarm signal and a control plan according to the change curve; wherein the overhang recognition model is obtained by training an artificial intelligence model; The information transmission module: obtains the alarm signal and the control plan, sends the control plan to the crane control module; sends the alarm signal to the danger alarm module; Crane control module: obtains the control plan and adjusts the operation status of the crane according to the control plan; Danger alarm module: obtains alarm signals and issues alarms based on the alarm signals.

2. A crane remote control system according to claim 1, characterized in that: The interception interval is generated according to the control speed, cargo weight and cargo volume, including: The cargo weight is marked as HZ, and the cargo volume is marked as HT; the cargo impact coefficient HY is calculated by the formula HY = α1×exp(-HZ / BZ)+α2×exp(-HT / BT); where α1 and α2 are weight coefficients, BZ is the set standard cargo mass; BT is the set standard cargo volume; When the crane is operating in the lifting state, the lifting speed in the control speed is extracted and marked as TV, and the interception interval JJ is calculated by the formula JJ = [β1×exp(-TV / STV)+β2×HY]×SJ1; When the crane is operating in the transport state, the transport speed in the control speed is extracted and marked as ZV, and the interception interval JJ is calculated by the formula JJ = [β3×exp(-ZV / SZV)+β4×HY+β5×exp(-ZH / QH)]×SJ1; Among them, β1, β2, β3, β4 and β5 are adjustment coefficients; STV is the set standard lifting speed; SZV is the standard transfer speed, ZH is the transfer height, and QH is the crane height.

3. A crane remote control system according to claim 1, characterized in that: The overhang recognition model is obtained by training an artificial intelligence model, and includes: Acquire a number of historical lifting grabbing state images and their corresponding cargo suspension distances through a database; the cargo suspension distance is the distance between the cargo and the top of the crane; Integrate the historical lifting and grabbing state images and the corresponding cargo suspension distances into a plurality of training data and test data; The artificial intelligence model is trained using the training data; the trained artificial intelligence model is tested using the test data, and finally a suspension distance recognition model is obtained whose input is the lifting grasping state image and whose output is the suspension distance of the cargo; wherein the artificial intelligence model includes a BP neural network model or a RBF neural network model.

4. A crane remote control system according to claim 1, characterized in that: Generating the control scheme according to the acquired change curve includes: When the crane is operating in the lifting state, a stability coefficient is generated according to the change curve; when the stability coefficient is greater than the stability threshold, the adjusted lifting speed TTV is calculated by the formula TTV=min[d[XJ(t)] / dt]; wherein XJ(t) is the change function corresponding to the change curve; and a lifting control scheme is generated according to the adjusted lifting speed; When the crane is operating in the transfer state, the change function XJ(t) corresponding to the change curve is obtained; when the change function XJ(t) is a periodic function, the maximum amplitude M and the change period T of the change function XJ(t) are obtained; when the maximum amplitude exceeds the set amplitude threshold, or the change period is less than the set period threshold, the adjusted transfer speed TZV is calculated by the formula TZV=[1-γ3×exp(M-BM / BM)-γ4×exp(BT-T / BT)]×ZV; wherein BM is the amplitude threshold, BT is the period threshold; γ3 and γ4 are adjustment coefficients, and γ3∈(0,1); γ4∈(0,1); a transfer control plan is generated according to the adjusted transfer speed; the control plan includes a lifting control plan and a transfer control plan.

5. A crane remote control system according to claim 4, characterized in that: The step of generating a stability coefficient according to the change curve includes: Obtain the change function XJ(t) corresponding to the change curve; construct the speed difference function SC(t) by the formula SC(t)=d[XJ(t)] / dt-TV; The corresponding stability coefficient WX is calculated by the formula WX=γ1×∫[SC(t)] / N+γ2×[max[SC(t)]-min[SC(t)]]; where γ1 and γ2 are weight coefficients; t∈(0,N).

6. A crane remote control system according to claim 5, characterized in that: Generating the alarm signal according to the acquired change curve includes: When the crane is operating in the lifting state, a stability coefficient is generated according to the change curve; when the stability coefficient is greater than the stability threshold, an abnormal lifting speed alarm signal is generated; otherwise, no alarm signal is generated; When the crane is operating in the transfer state, the change function corresponding to the change curve is obtained to determine whether it is a periodic function; If yes, the maximum amplitude and the variation period of the variation function are obtained; when the maximum amplitude exceeds the set amplitude threshold, or the variation period is less than the set period threshold, an abnormal transport speed alarm signal is generated; otherwise, no alarm signal is generated; If not, a transfer abnormality alarm signal is generated; the alarm signal includes a lifting speed abnormality alarm signal, a transfer speed abnormality alarm signal and a transfer abnormality alarm signal.

7. A crane remote control method, applied to a crane remote control system according to any one of claims 1 to 6, characterized in that: The following steps are involved: Step 1, obtaining the crane operation state and its corresponding real-time lifting grab state video, wherein the crane operation state includes the lifting state and the transfer state; the lifting grab state video includes the lifting grab lifting video and the lifting grab transfer video; the lifting grab state video corresponding to the lifting state is the lifting grab lifting video; the lifting grab state video corresponding to the transfer state is the lifting grab transfer video; Step 2: Obtain the control speed, cargo weight and cargo volume, and generate a cut-off interval according to the control speed, cargo weight and cargo volume; Step 3: intercepting a number of frames of lifting and grasping state images from the corresponding lifting and grasping state video according to the interception interval; Step 4: Inputting a number of lifting and grabbing state images into a suspension distance recognition model to obtain the cargo suspension distance, wherein the suspension distance recognition model is obtained by training an artificial intelligence model; Step 5: Fit the cargo suspension distance into a cargo change curve according to the interception order of the corresponding lifting and grabbing state images; Step 6: Generate alarm signals and control plans based on the change curve; Step 7: Obtain an alarm signal and sound an alarm according to the alarm signal; And, obtain a control plan, and adjust the operating state of the crane according to the control plan.