A remote control system for excavators based on 5G network

Through the 5G network-based excavator remote control system, combined with construction waste image and wind speed data, the appropriate excavation force and remote control frequency are determined, which solves the problem of insufficient control and stability of the excavator remote control and improves construction waste cleaning efficiency and safety.

CN118207930BActive Publication Date: 2024-11-05海江科技集团有限公司
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410464728.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-04-18
Publication Date
2024-11-05
Estimated Expiration
2044-04-18

AI Technical Summary

Technical Problem

The existing remote remote control technology of excavator has problems such as insufficient control, insufficient stability and insufficient operational stability in construction waste treatment, resulting in low cleaning efficiency, high risk of equipment wear and an increase in the possibility of accidents.

Method used

Using a 5G network-based excavator remote control system, the appropriate starting point is determined through the on-site environment acquisition module, mining operation analysis module, communication status testing module, remote transmission analysis module and information database. Excavating position, bucket excavation force and arm excavation force, and adjust the frequency of remote control command sending to generate customized excavation remote control commands.

Benefits of technology

It improves the accuracy and stability of the remote control of the excavator, ensures the efficiency and safety of construction waste cleaning, reduces the risk of equipment wear and accidents, and enhances the applicability and production capacity of the excavator in complex environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118207930B_ABST
    Figure CN118207930B_ABST
Patent Text Reader

Abstract

The present invention belongs to the technical field of excavator control and management, and specifically discloses a remote control system for an excavator based on a 5G network, which includes: a field environment acquisition module, an excavation operation analysis module, a communication status test module, a remote control transmission analysis module, an information library, and an excavation control terminal. The present invention combines the image of construction waste and the wind speed in the target area to confirm the appropriate starting excavation position, the appropriate bucket excavation force, and the appropriate arm excavation force, and confirms and adjusts the excavation remote control instruction transmission frequency according to the communication test data, which effectively solves the current problem of insufficient control over the remote control of the excavator, ensures the operating efficiency of the construction waste cleaning and the stability and reliability of the remote control of the excavator, and also improves the precision and accuracy of the excavator cleaning operation, thereby realizing flexible control according to different situations, and increasing the applicability and flexibility of the excavator in different environments.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of excavator control management and relates to an excavator remote control system based on a 5G network. Background Art

[0002] Excavator remote control technology combines wireless communication, automatic control and real-time video transmission technology to achieve real-time control of the excavator. It allows the operator to control the machine in a safe or more effective position, so it is widely used in various dangerous construction sites such as post-demolition construction waste disposal, mining, earth excavation, etc.

[0003] When excavators handle construction waste after demolition, they mainly use the cameras on board to collect images of the excavator's construction site. However, there is still a problem of insufficient control over the remote control of excavators when handling construction waste. Specifically, it is reflected in the following aspects: 1. Insufficient consideration of the stability of construction waste. Currently, the remote control mainly identifies the material and stacking volume of construction waste, and controls the excavation intensity. As a result, the effectiveness of the construction site assessment effect is not strong. Not only can the efficiency of construction waste cleaning be failed to be guaranteed, but the excavator may also face additional challenges during the handling process, increasing the risk of equipment wear and damage.

[0004] 2. Insufficient consideration has been given to the stability of the remote control of the excavator. Currently, there is no detailed monitoring of the on-site environment and the remote communication control status, and there are communication delays, which may cause deviations in the excavator's performance of tasks and fail to achieve the expected precision and accuracy.

[0005] 3. Insufficient consideration is given to the stability of the excavator operation. When performing remote excavation force control, the main consideration is whether the construction waste can be excavated, and the stability of the excavator operation is ignored. This may cause the excavator to tip over, tilt or slide when handling construction waste, increasing the risk of accidents. It may also cause the excavator to frequently adjust its posture or stop working during the operation, affecting the continuity and efficiency of waste treatment and reducing the production capacity of the operation. Summary of the invention

[0006] In view of this, in order to solve the problems raised in the above background technology, a remote control system for an excavator based on a 5G network is proposed.

[0007] The purpose of the present invention can be achieved through the following technical solutions: The present invention provides an excavator remote control system based on a 5G network, the system comprising: a field environment acquisition module, used to record the target construction waste area as the target area, record the cleaning excavator as the target equipment, and collect the construction waste image and wind speed in the target area.

[0008] The excavation operation analysis module is used to analyze the appropriate starting excavation position, the appropriate bucket excavation force and the appropriate arm excavation force of the target equipment according to the construction waste image.

[0009] The communication status test module is used to send a communication test instruction to the target device and record the communication test data of the target device and the currently set communication data sending frequency.

[0010] The remote control sending analysis module is used to perform mining remote control command sending adjustment analysis based on the communication test data of the target device, and obtain the adjustment mining remote control command sending frequency corresponding to the target device.

[0011] The information base is used to store the reference weight of each material type per unit volume, and to store the bucket digging force and arm digging force of each digging weight reference of the target cleaning excavator at each digging difficulty level.

[0012] The excavation control terminal is used to generate an excavation remote control instruction based on the appropriate starting excavation position, the appropriate bucket excavation force and the appropriate arm excavation force of the target device, and to send the corresponding remote control instruction according to the adjustment of the excavation remote control instruction sending frequency.

[0013] Compared with the prior art, the beneficial effects of the present invention are as follows: (1) The present invention combines the image of construction waste and wind speed in the target area to confirm the appropriate starting excavation position, appropriate bucket excavation force and appropriate arm excavation force, and confirms and adjusts the excavation remote control instruction sending frequency according to the communication test data, thereby realizing remote construction waste cleaning control of the excavator, effectively solving the current problem of insufficient control over the remote control of the excavator, ensuring the efficiency of construction waste cleaning, while also ensuring the stability and reliability of the remote control of the excavator, and also improving the precision and accuracy of the excavator's cleaning operation, thereby realizing flexible control of the excavator according to different situations, and increasing the applicability of the excavator in different environments.

[0014] (2) The present invention constructs a construction waste treatment model by identifying the outline, height, boundary and density distribution of the construction waste pile in the construction waste image, and sets the excavation interference weight and confirms the appropriate starting excavation position in combination with the density. It can formulate a customized operation strategy, which is convenient for better planning of the cleaning path, thereby reducing the possibility of accidents and improving operation safety. At the same time, it not only avoids additional interference or damage to the environment, but also ensures that the excavator can effectively clean up the garbage. On another level, it also improves the adaptability of the excavator in complex environments.

[0015] (3) The present invention sets the excavation interference weight according to the distance between the recommended starting excavation points, the outline and height of the construction waste pile, the wind speed in the target area, and the height layer to which each recommended starting excavation point belongs. This effectively makes up for the current lack of consideration of the stability of the construction waste pile, ensures the effectiveness of the construction site assessment, thereby improving the efficiency of cleaning construction waste, avoiding additional pressure and challenges on the excavator due to improper selection of the starting excavation position, and reducing the risk of wear and damage to the excavator.

[0016] (4) The present invention divides the construction waste pile into vertical and horizontal areas, calculates the vertical overlap ratio and the horizontal overlap ratio, and combines the wind speed, the height of the construction waste pile and the center of gravity offset of the construction waste pile to calculate the stacking stability. This makes up for the current lack of attention to key parameters such as the height, inclination and density of the construction waste pile, intuitively displays the stacking structure of the construction waste pile, and then objectively evaluates the stacking stability of the construction waste pile, and improves the reliability and rationality of the subsequent confirmation of a suitable starting excavation position.

[0017] (5) The present invention calculates the difficulty trend of excavating construction waste and analyzes the appropriate bucket excavation force based on the ground flatness of the area where the construction waste pile is located. This makes up for the lack of consideration of the stability of the remote control of the excavator when performing remote excavation force control. On the basis of ensuring that the construction waste can be excavated, the stability of the excavator is also ensured, reducing the probability of the excavator tipping over, tilting or sliding when handling construction waste, and also avoiding the need for the excavator to frequently adjust its posture or stop working during operation, thereby ensuring the continuity and efficiency of construction waste treatment and improving the production capacity of the excavator operation.

[0018] (6) The present invention conducts communication tests and sends adjustment type confirmation and adjusts the excavation remote control command sending frequency analysis in combination with the corresponding delay duration, packet loss rate and throughput during each communication test. It fully considers the on-site communication environment and intuitively displays the control status of remote communication. It avoids the current lack of consideration of stability during remote control of excavators, reduces the interference of subsequent communication delays on excavator operations, and minimizes the probability of deviations in the excavator when performing tasks, thereby ensuring the precision and accuracy of remote control of excavator operations, while also improving the reliability of remote control of excavator operations. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for describing the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.

[0020] Figure 1 It is a schematic diagram of the connection of each module of the system of the present invention. DETAILED DESCRIPTION

[0021] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0022] See also Figure 1 As shown, the present invention provides an excavator remote control system based on a 5G network, which includes: a field environment acquisition module, an excavation operation analysis module, a communication status test module, a remote control transmission analysis module, an information library and an excavation operation control terminal.

[0023] In the above, the mining operation analysis module is respectively connected to the field environment acquisition module, the information library and the mining operation control terminal, and the remote control transmission analysis module is respectively connected to the communication status test module and the mining operation control terminal.

[0024] The on-site environment acquisition module is used to record the target construction waste area as the target area, record the cleaning excavator as the target equipment, and collect the construction waste image and wind speed in the target area.

[0025] Specifically, the construction waste image and wind speed are monitored by a high-definition three-dimensional camera and a wind speed monitor respectively placed in the target area.

[0026] The excavation operation analysis module is used to analyze the appropriate starting excavation position, appropriate bucket excavation force and appropriate arm excavation force of the target equipment according to the construction waste image.

[0027] In a specific embodiment, bucket digging force and arm digging force are two important indicators of excavator performance parameters, which describe the force performance of the excavator when performing earthwork operations. Bucket digging force refers to the maximum force that the excavator bucket itself can exert when digging soil or other materials. Bucket digging force critically affects the efficiency and ability of the excavator in direct excavation operations, especially when dealing with hard or dense materials. Arm digging force refers to the maximum force that the excavator's arm (or boom) can exert during the excavation process. Arm digging force mainly affects the excavator's operating range and depth, as well as stability and strength when lifting heavy objects.

[0028] The embodiment of the present invention combines the image of construction waste and wind speed in the target area to confirm the appropriate starting excavation position, appropriate bucket digging force and appropriate arm digging force, and confirms and adjusts the sending frequency of excavation remote control instructions according to communication test data, so as to realize remote construction waste cleaning control of the excavator, effectively solves the current problem of insufficient control over the remote control of the excavator, ensures the operational efficiency of construction waste cleaning, and at the same time ensures the stability and reliability of the remote control of the excavator, and also improves the precision and accuracy of the excavator's cleaning operation, thereby realizing flexible control of the excavator according to different situations, and increasing the applicability of the excavator in different environments.

[0029] Exemplarily, analyzing the appropriate starting excavation position of the target equipment includes: A1, preprocessing the construction waste image by image processing technology, and identifying the outline, height, boundary and density distribution of the construction waste pile in the construction waste image by image recognition technology, and constructing a construction waste treatment model based on this.

[0030] In a specific embodiment, the image processing technology performs preprocessing including but not limited to denoising and edge detection, etc., wherein the image processing technology is a relatively mature technology, and its specific preprocessing process is not described in detail here.

[0031] In a specific embodiment, the image recognition technology is used to identify the outline, height and boundary of the garbage dump, which is a relatively mature technology. The specific recognition process will not be described in detail here.

[0032] In another specific embodiment, the specific identification and supplementation process of density distribution is as follows: J1. Segment the construction waste image to separate the waste pile from the background.

[0033] It should be added that separation of garbage piles from the background can be achieved through image segmentation techniques, such as threshold segmentation, edge detection, region growing, etc.

[0034] J2. Divide the construction waste image into multiple small areas or pixel blocks.

[0035] It should be added that the construction waste image is divided into a plurality of small regions or pixel blocks so as to perform density analysis on each region. In a specific embodiment, a fixed-size window or an adaptive division method based on pixel density can be used.

[0036] J3. For each small area, calculate the density of garbage pixels therein, and use the number of garbage pixels or pixel density as density information.

[0037] It should be added that the higher the pixel density of the garbage pixels, the greater the density.

[0038] J4. Draw the density information of each area into a density map to obtain the density distribution of each area.

[0039] It is necessary to plot the density information of each area into a density map to intuitively show the density distribution of the garbage dump. This can help identify the location and characteristics of different density areas in the garbage dump.

[0040] It is also necessary to add that the density map can be used to identify areas with higher density in the garbage dump, thereby providing recommendations for excavation points. These areas are often where garbage is stored more concentratedly in the garbage dump, so choosing these areas as the starting excavation points can improve excavation efficiency.

[0041] A2. Based on the contour, height, boundary and density distribution of the construction waste pile, the recommended starting excavation point locations are obtained through heuristic rule evaluation based on shape analysis.

[0042] It should be added that the algorithms corresponding to the recommended starting mining point positions mainly involve heuristic algorithms or machine learning techniques. In a specific embodiment, the evaluation of the recommended starting mining point positions can also be performed through pattern recognition based on deep learning.

[0043] It should also be added that the heuristic rules based on shape analysis and the pattern recognition based on deep learning are relatively mature algorithms currently available, and their specific evaluation process will not be described here.

[0044] A3. Mark the positions of the recommended starting excavation points in the construction waste treatment model to obtain the marked points, and extract the distances between the marked points.

[0045] A4. Locate the density of each marked point from the construction waste treatment model, denoted as ρ i , i represents the marking point number, i=1,2,......n.

[0046] A5. Based on the distance between the marked points and the outline of the construction waste pile, set the excavation interference weight of each marked point, denoted as η i .

[0047] A6. Calculate the mining recommendation index λ of each annotation point i , ρ′ and η′ are the interference excavation density and excavation interference weight of the reference respectively.

[0048] A7. The marked point with the largest mining recommendation index is used as the recommended marked point, and the recommended starting mining point position to which the recommended marked point belongs is used as the appropriate starting mining position for the target device.

[0049] The embodiment of the present invention constructs a construction waste treatment model by identifying the outline, height, boundary and density distribution of the construction waste pile in the construction waste image, and sets the excavation interference weight and confirms the appropriate starting excavation position in combination with the density. A customized operation strategy can be formulated, which is convenient for better planning of the cleaning path, thereby reducing the possibility of accidents and improving operation safety. At the same time, it not only avoids additional interference or damage to the environment, but also ensures that the excavator can effectively clean up the garbage. On another level, it also improves the adaptability of the excavator in complex environments.

[0050] Furthermore, in step A5, the mining interference weight of each annotation point is set, including: A51, comparing the distance between each annotation point with the set reference interference distance, if the distance between a certain annotation point and another annotation point is less than or equal to the set reference interference distance, then the other annotation point is used as the interference annotation point of the annotation point, and the number of interference annotation points of each annotation point is counted, which is recorded as D i .

[0051] A52. According to the outline and height of the construction waste pile and the wind speed in the target area, the stacking stability of the construction waste pile is calculated and recorded as ψ.

[0052] A53. Divide the construction waste pile into two equal parts by height to obtain the divided height layers. The height layer farthest from the ground is recorded as the upper layer, and the height layer close to the ground is recorded as the lower layer.

[0053] A54. If ψ≤0 and a marked point is located on the upper layer of the construction waste pile, set α 0 The position of the annotation point is used as the interference weight.

[0054] A55. If ψ≤0 and a marked point is located in the lower layer of the construction waste pile, set α 1 The position of the annotation point is used as the interference weight.

[0055] A56. If ψ>0 and a certain marked point is located on the upper layer of the construction waste pile, set α 2 The position of the annotation point is used as the interference weight.

[0056] A57. If ψ>0 and a marked point is located in the lower layer of the construction waste pile, set α 3 As the position mining interference weight of the annotation point, the position mining interference weight of each annotation point is obtained, which is recorded as The value is α 0 or α 1 or α 2 or α 3 , α 0 >α 1 >α 2 >α 3 .

[0057] It should be added that The value range is 0 to 1. In a specific embodiment, α 0 , α 1 , α 2 and α 3 The possible values ​​are 0.7, 0.6, 0.4 and 0.3 respectively.

[0058] A58, will As the mining interference weight of each annotation point, D′, They are used to set the number of reference interference annotation points and the position mining interference weight respectively.

[0059] It should be added that, in a specific embodiment, D′, The specific values ​​can be 2 and 0.4 respectively.

[0060] The embodiment of the present invention sets the excavation interference weight according to the distance between the positions of each recommended starting excavation point, the contour and height of the construction waste pile, the wind speed in the target area, and the height layer to which each recommended starting excavation point belongs, thereby effectively making up for the current lack of consideration of the stability of the construction waste pile, ensuring the effectiveness of the construction site assessment effect, thereby improving the cleaning efficiency of construction waste, avoiding additional pressure and challenges on the excavator due to improper selection of the starting excavation position, and reducing the risk of wear and damage to the excavator.

[0061] Furthermore, in step A52, the stacking stability of the construction waste pile is calculated, including: E1, the construction waste pile is divided into two equal parts according to the direction perpendicular to the ground, each vertical division area is obtained, and the contour area of ​​each vertical division area is extracted, which is recorded as S 1 and S 2 , and overlap and compare the contours of each vertically divided area, and record the overlapping contour area as S 0 ,Will As the vertical overlap ratio, denoted as k y .

[0062] E2. Divide the construction waste pile into two equal parts parallel to the ground. y The horizontal overlap ratio is obtained by the same analysis method, denoted as k x .

[0063] E3. The wind speed in the target area and the height of the construction waste pile are recorded as v and H respectively.

[0064] E4. Locate the centroid and center points from the outline of the construction waste pile, and take the horizontal distance between the centroid and center points as the centroid offset, denoted by L.

[0065] E5. Calculate the stability of the construction waste pile ψ, H′, v′ and L′ are respectively the stacking height, wind speed and center of gravity offset of the set reference stability disturbance.

[0066] The embodiment of the present invention divides the construction waste pile into areas in the vertical and horizontal directions, calculates the vertical overlap ratio and the horizontal overlap ratio, and calculates the stacking stability in combination with the wind speed, the height of the construction waste pile and the center of gravity offset of the construction waste pile. This makes up for the current lack of attention to key parameters such as the height, inclination and density of the construction waste pile, intuitively displays the stacking structure of the construction waste pile, and then objectively evaluates the stacking stability of the construction waste pile, and improves the reliability and rationality of the subsequent confirmation of a suitable starting excavation position.

[0067] Exemplarily, analyzing the suitable bucket excavation force of the target equipment includes: U1, locating each object located within and above the suitable starting excavation position corresponding to the target equipment from the construction waste treatment model as each excavation object, and extracting the material and volume of each excavation object.

[0068] U2, extract the reference weight per unit volume of the material of each excavated object from the information database, denoted as G′ j , the volume of each excavated object is recorded as V j , j represents the number of the excavated object, j = 1, 2, ... m, and the total weight of the excavated object is G 0 ,

[0069] U3. Locate the number of gaps on the garbage dump surface at the appropriate starting excavation position and the gap area of ​​each gap from the construction waste treatment model, count the construction waste excavation difficulty trend, and match and compare them with the excavation difficulty levels corresponding to the set excavation difficulty trends to obtain the matching excavation difficulty level.

[0070] Furthermore, the difficulty trend of construction waste excavation is calculated, including: U31, the number of gaps on the garbage dump surface where the starting excavation position is located is recorded as X 0 .

[0071] U32. Calculate the average of the gap areas corresponding to the gaps on the garbage dump surface at the appropriate starting excavation position, and record the result as S υ .

[0072] U33. Compare the materials of each excavated object with each other, and count the number of types of materials of the excavated objects, recorded as M 0 .

[0073] U34, statistical construction waste excavation difficulty trend δ, X' and S' are the number of gaps and the gap area of ​​the reference respectively.

[0074] U4. Extract the bucket digging force of the target device with reference to the total weight of the excavated object under the matching excavation difficulty level from the information database as the benchmark bucket digging force of the target device, denoted as N σ .

[0075] U5. Import the construction waste image into OpenCV and output the ground flatness of the area where the construction waste pile is located, recorded as Will The appropriate bucket digging force of the target equipment is denoted by N ω , is the set reference flatness, N ζ The reference reduced bucket digging force corresponding to the set unit flatness difference.

[0076] In a specific embodiment, the ground flatness of the area where the construction waste dump is located can also be obtained through MATLAB software, 3D reconstruction software, AI / deep learning model, ArcGIS software or QGIS software, etc.

[0077] It should be added that the stability of the excavator may be affected if the ground is uneven or unstable. Excessive digging force may cause the excavator to lose balance on uneven ground, increasing the risk of overturning, so the digging force correction is performed.

[0078] The embodiment of the present invention analyzes the appropriate bucket excavation force by statistically analyzing the difficulty trend of construction waste excavation and combining the ground flatness of the area where the construction waste pile is located, thereby making up for the insufficient consideration of the stability of the remote control of the excavator when performing remote excavation force control, etc., and ensuring that the construction waste can be excavated while also ensuring the stability of the excavator, reducing the probability of the excavator tipping over, tilting or sliding when handling construction waste, and also avoiding the need for the excavator to frequently adjust its posture or stop working during operation, thereby ensuring the continuity and efficiency of construction waste treatment and improving the production capacity of the excavator operation.

[0079] In another exemplary embodiment, analyzing the appropriate arm digging force of the target device includes: L1, extracting the arm digging force of the target device with reference to the total weight of the digging object under the matching digging difficulty level from the information database as the reference arm digging force of the target device, recorded as N ε .

[0080] L2, the density of the appropriate starting excavation position corresponding to the target equipment located from the construction waste treatment model, denoted as ρ τ .

[0081] L3. Based on the volume and material of each excavated object, the weight of each excavated object is counted, and the arm excavation force compensation weight is set, recorded as μ, and matched and compared with the reference compensation ratio corresponding to the set arm excavation force compensation weight to obtain the matched reference compensation ratio k a .

[0082] L4. Extract the mining interference weight corresponding to the target device corresponding to the appropriate starting mining position of the marked point from the mining interference weight of each marked point, denoted as η τ , according to k a The matching method of is similar to the matching method to obtain the matching reference compensation ratio k of the mining interference weight. b .

[0083] L5. Statistical target equipment's suitable arm digging force N φ , N φ =N ε *(1+k a +k b ).

[0084] Furthermore, in step L3, the arm excavation force compensation weight is set, including: L31, the weight of each excavation object is compared with the weight of the excavator interfering with the excavation object. By comparison, the statistics are greater than The number of excavated objects is denoted as Z 0 , and will be greater than The weight of each excavated object is averaged and the result is recorded as

[0085] L32, count the number of mined objects, record it as Z′, and then As the arm digging force compensation weight μ.

[0086] The communication status test module is used to send a communication test instruction to the target device, and record the communication test data of the target device and the currently set communication data sending frequency.

[0087] Specifically, the communication test data includes but is not limited to the corresponding delay duration, packet loss rate and throughput during each communication test.

[0088] It should be noted that the delay duration and packet loss rate are recorded by network diagnostic tools, where the network diagnostic tools include but are not limited to Wireshark and PingPlotter, and the throughput is recorded by speed test tools, such as Speedtest.

[0089] The remote control sending analysis module is used to perform mining remote control command sending adjustment analysis based on the communication test data of the target device to obtain the adjusted mining remote control command sending frequency corresponding to the target device.

[0090] Specifically, the remote control command sending adjustment analysis is carried out, including: Q1, extracting the corresponding delay time, packet loss rate and throughput of each communication test from the communication test data of the target device, and obtaining the average delay time, average packet loss rate and average throughput by mean calculation, which are recorded as T respectively. g , B g and R g , and respectively compare with the set reference delay time T′, packet loss rate B′ and throughput R′, and determine the sending adjustment type through the adjustment judgment rule, and the sending adjustment type is one of increase and decrease.

[0091] Q2. Record the communication data sending frequency currently set by the target device as f 0 , when the send adjustment type is increase, As the frequency of sending the adjusted excavation remote control command corresponding to the target device, χ′ is the communication state consistency of the setting reference, and f′ is the compensation communication data sending frequency under the setting reference communication state consistency. Indicates the floor symbol.

[0092] Q3. When the sending adjustment type is reduced, Adjust the frequency of sending excavation remote control commands corresponding to the target device.

[0093] Furthermore, the specific settings of adjusting the judgment rules are as follows: W1. If T g ≤T′, B g ≤B′ and R g ≥R′ is established at the same time, and the increase is used as the sending adjustment type.

[0094] W2, if T g ≤T′ and B g ≤B′ is true at the same time or B g ≤B′ and R g ≥R′ and T g ≤T′ and R g ≥R′ is established at the same time, and the increase is used as the sending adjustment type.

[0095] In a specific embodiment, when the transmission delay is large, the packet loss rate is small and the throughput is increased, appropriately increasing the sending frequency may help utilize the available bandwidth and improve the efficiency of data transmission. At the same time, due to the low packet loss rate, the data packet is likely to be successfully transmitted, while the large transmission delay may be caused by network congestion or bandwidth limitation. Increasing the sending frequency can speed up the data transmission speed and shorten the overall data transmission time, thereby reducing the delay. Moreover, due to the low packet loss rate, increasing the sending frequency is unlikely to cause excessive data packet loss, so increase is used as the sending adjustment type.

[0096] W3. If T g >T′、B g >B′、R g <R′ holds or T g >T′、B g >B′、R g If any two of the terms in <R′ hold, reduction is used as the sending adjustment type.

[0097] It should be added that a high packet loss rate usually indicates that there are transmission problems in the network, which may be caused by buffer overflows in routers or switches, or link errors, poor signal quality, etc. In this case, even if the latency is low, increasing the sending frequency often leads to more packet loss because the network can no longer handle the current data load, so when there is a high packet loss rate and low throughput, reduction is used as a sending adjustment type.

[0098] It should also be added that when the delay time is high, the packet loss rate is high, or when the delay time is high and the throughput is low, or when the packet loss rate is high and the throughput is low, it indicates that the network status is not good and the transmission power should be appropriately reduced to ensure the integrity of communication data transmission.

[0099] The embodiment of the present invention performs communication tests and sends adjustment type confirmation and adjusts the excavation remote control command sending frequency analysis in combination with the corresponding delay duration, packet loss rate and throughput during each communication test. It fully considers the on-site communication environment and intuitively displays the control status of remote communication. It avoids the current lack of consideration of stability during remote control of excavators, reduces the interference of subsequent communication delays on excavator operations, and minimizes the probability of deviations in the excavator when performing tasks, thereby ensuring the precision and accuracy of remote control of excavator operations, while also improving the reliability of remote control of excavator operations.

[0100] The information base is used to store the reference weight of each material type per unit volume, and to store the bucket excavation force and arm excavation force of each excavation weight reference of the target cleaning excavator at each excavation difficulty level.

[0101] The excavation manipulation control terminal is used to generate an excavation remote control instruction based on the appropriate starting excavation position, appropriate bucket excavation force and appropriate arm excavation force of the target device, and to send the corresponding remote control instruction according to the adjustment of the excavation remote control instruction sending frequency.

[0102] The above contents are merely examples and explanations of the concept of the present invention. Those skilled in the art may make various modifications or additions to the specific embodiments described or replace them in a similar manner. As long as they do not deviate from the concept of the invention or exceed the scope defined by the present invention, they shall all fall within the protection scope of the present invention.

Claims

1. A remote control system for excavators based on 5G network, Features: The system includes: A field environment acquisition module is used to record the target construction waste area as the target area, record the cleaning excavator as the target equipment, and collect the construction waste image and wind speed in the target area; An excavation operation analysis module, used for analyzing a suitable starting excavation position, a suitable bucket excavation force, and a suitable arm excavation force of a target device according to the construction waste image; The communication status test module is used to send a communication test instruction to the target device and record the communication test data of the target device and the currently set communication data sending frequency; The remote control sending analysis module is used to perform the mining remote control command sending adjustment analysis based on the communication test data of the target device, and obtain the adjustment mining remote control command sending frequency corresponding to the target device; An information database for storing reference weights of various material types per unit volume, and storing bucket digging forces and arm digging forces of references of various digging weights of a target cleaning excavator at various digging difficulty levels; The excavation control terminal is used to generate an excavation remote control instruction based on the appropriate starting excavation position, the appropriate bucket excavation force and the appropriate arm excavation force of the target device, and to send the corresponding remote control instruction according to the adjustment of the excavation remote control instruction sending frequency; The analysis of the appropriate starting excavation position of the target device includes: The construction waste images are preprocessed by image processing technology, and the outline, height, boundary and density distribution of the construction waste pile in the construction waste image are identified by image recognition technology, and a construction waste treatment model is constructed accordingly; Based on the contour, height, boundary and density distribution of the construction waste pile, the recommended starting excavation point locations are obtained through heuristic rule evaluation based on shape analysis; Mark the positions of the recommended starting excavation points in the construction waste treatment model to obtain the marked points, and extract the distances between the marked points; The density of each marked point is located from the construction waste treatment model, denoted as ρi, where i represents the marked point number, i=1, 2,...n; Based on the distance between the marked points and the outline of the construction waste pile, the excavation interference weight of each marked point is set, denoted as η i ; Statistical mining recommendation index λ of each annotation point i , ρ′ and η′ are the interference excavation density and excavation interference weight of the set reference respectively; The marked point with the largest excavation recommendation index is used as the recommended marked point, and the recommended starting excavation point position to which the recommended marked point belongs is used as the appropriate starting excavation position of the target device; The step of setting the mining interference weight of each annotation point includes: The distance between each annotation point is compared with the set reference interference distance. If the distance between a certain annotation point and another annotation point is less than or equal to the set reference interference distance, the other annotation point is used as the interference annotation point of the annotation point. The number of interference annotation points of each annotation point is counted and recorded as D i ; According to the outline and height of the construction waste pile and the wind speed in the target area, the stability of the construction waste pile is calculated and recorded as ψ; Divide the construction waste pile into two equal parts by height to obtain the divided height layers, record the height layer far from the ground as the upper layer, and record the height layer close to the ground as the lower layer; If ψ≤0 and a marked point is located on the upper layer of the construction waste pile, set α 0 Mining interference weight as the position of the annotation point; If ψ≤0 and a marked point is located in the lower layer of the construction waste pile, set α 1 Mining interference weight as the position of the annotation point; If ψ>0 and a certain marked point is located on the upper layer of the construction waste pile, set α 2 Mining interference weight as the position of the annotation point; If ψ>0 and a marked point is located in the lower layer of the construction waste pile, α 3 As the position mining interference weight of the annotation point, the position mining interference weight of each annotation point is obtained, which is recorded as The value is α 0 or α 1 or α 2 or α 3 , α 0 >α 1 >α 2 >α 3 ; Will As the mining interference weight of each annotation point, D′, They are used to set the number of reference interference annotation points and the position mining interference weight respectively.

2. According to the 5G network-based excavator remote control system according to claim 1, Features: The statistical method for determining the stability of the pile of construction waste includes: The construction waste pile is divided into two equal parts perpendicular to the ground to obtain each vertical division area, and the contour area of ​​each vertical division area is extracted and recorded as S 1 and S 2 , and overlap and compare the contours of each vertically divided area, and record the overlapping contour area as S 0 ,Will As the vertical overlap ratio, denoted as k y ; The construction waste pile is divided into two equal parts parallel to the ground. y The horizontal overlap ratio is obtained by the same analysis method, denoted as k x ; The wind speed and the height of the construction waste pile in the target area are recorded as v and H respectively; The centroid and center positions are located from the outline of the construction waste pile, and the horizontal distance between the centroid and center positions is taken as the centroid offset, recorded as L; Statistical analysis of the stacking stability of construction waste piles ψ, H′, v′ and L′ are respectively the stacking height, wind speed and center of gravity offset of the set reference stability disturbance.

3. According to the 5G network-based excavator remote control system of claim 1, Features: The analysis of the appropriate bucket digging force of the target equipment includes: Locate objects located within and above the appropriate starting excavation position corresponding to the target device from the construction waste treatment model as excavation objects, and extract the material and volume of each excavation object; Extract the reference weight per unit volume of the material of each excavated object from the information database, denoted as G j ′, the volume of each excavated object is recorded as V j , j represents the number of the excavated object, j = 1, 2, ... m, and the total weight of the excavated object is G 0 , The number of gaps on the garbage dump surface at the appropriate starting excavation position and the gap area of ​​each gap are located from the construction waste treatment model, the construction waste excavation difficulty trend is counted, and the excavation difficulty level corresponding to each set excavation difficulty trend is matched and compared to obtain the matching excavation difficulty level; Extract the bucket digging force of the target device with reference to the total weight of the excavated object under the matching excavation difficulty level from the information database as the benchmark bucket digging force of the target device, denoted as N σ ; Import the construction waste image into OpenCV and output the ground flatness of the area where the construction waste pile is located, denoted as Will The appropriate bucket digging force of the target equipment is denoted by N ω , is the set reference flatness, N ζ The reference reduced bucket digging force corresponding to the set unit flatness difference.

4. According to the 5G network-based excavator remote control system of claim 3, Features: The statistical construction waste excavation difficulty trend includes: The number of gaps on the garbage dump surface where the starting excavation position is located is recorded as X 0 ; The average gap area of ​​each gap corresponding to the garbage dump surface at the appropriate starting excavation position is calculated, and the calculation result is recorded as S υ ; The materials of each excavated object are compared with each other, and the number of types of materials of the excavated objects is counted, which is recorded as M 0 ; Statistical trend of construction waste excavation difficulty δ, X' and S' are the number of gaps and the gap area of ​​the reference respectively.

5. According to the 5G network-based excavator remote control system of claim 3, Features: The analysis of the appropriate arm digging force of the target equipment includes: Extract the arm digging force of the target device with the total weight of the excavated object under the matching excavation difficulty level from the information database as the benchmark arm digging force of the target device, denoted as N ε ; The density of the appropriate starting excavation position of the target equipment is located from the construction waste treatment model, denoted as ρ τ ; Based on the volume and material of each excavated object, the weight of each excavated object is counted, and the arm excavation force compensation weight is set, recorded as μ, and matched and compared with the reference compensation ratio corresponding to the set arm excavation force compensation weight to obtain the matched reference compensation ratio k a ; From the mining interference weights of each marked point, the mining interference weight corresponding to the marked point of the target device corresponding to the appropriate starting mining position is extracted, denoted as η τ , according to k a The matching method of is similar to the matching method to obtain the matching reference compensation ratio k of the mining interference weight. b ; Statistical target equipment suitable arm digging force N φ , N φ =N ε *(1+k a +k b ).

6. According to the 5G network-based excavator remote control system of claim 5, Features: The step of setting the arm digging force compensation weight comprises: The weight of each excavation object is compared with the weight of the excavator interfering with the excavation object. By comparison, the statistics are greater than The number of excavated objects is denoted as Z 0 , and will be greater than The weight of each excavated object is averaged and the result is recorded as Count the number of mined objects, record it as Z′, and then As the arm digging force compensation weight μ.

7. According to claim 1, a remote control system for excavators based on 5G network, Features: The step of performing the adjustment analysis of sending the excavation remote control command includes: The corresponding delay time, packet loss rate and throughput of each communication test are extracted from the communication test data of the target device, and the average delay time, average packet loss rate and average throughput are obtained by averaging, which are recorded as T g , B g and R g , and respectively compare with the set reference delay time T', packet loss rate B' and throughput R', and determine the sending adjustment type through the adjustment judgment rule, the sending adjustment type is one of increase and decrease; The communication data sending frequency currently set by the target device is recorded as f 0 , when the send adjustment type is increase, As the frequency of sending the adjusted excavation remote control command corresponding to the target device, χ′ is the communication state consistency of the setting reference, and f′ is the compensation communication data sending frequency under the setting reference communication state consistency. Indicates the floor symbol; When the send adjustment type is decrease, Adjust the frequency of sending excavation remote control commands corresponding to the target device.

8. According to claim 1, a remote control system for an excavator based on a 5G network, Features: The specific settings of the adjustment judgment rules are as follows: If T g ≤T′, B g ≤B′ and R g ≥R′ is true at the same time, the increase is taken as the sending adjustment type; If T g ≤T′ and B g ≤B′ is true at the same time or B g ≤B′ and R g ≥R′ and T g ≤T′ and R g ≥R′ is true at the same time, the increase is taken as the sending adjustment type; If T g >T′、B g >B′、R g <R′ holds or T g >T′、B g >B′、R g If any two of the terms in <R′ hold, reduction is used as the sending adjustment type.