A method, device, equipment and medium for slow descent of a distribution network construction cable drum down a slope

By using a guide rail device and an anti-disengagement device combined with a depth-deterministic strategy gradient algorithm to control the slow descent of the cable reel in the height-restricted environment of the basement of the community's power distribution room, the risk of personal injury during the cable reel handling process was solved, and safe and efficient cable reel handling was achieved.

CN117509043BActive Publication Date: 2026-01-02GUANGDONG POWER GRID CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311386658.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-10-24
Publication Date
2026-01-02
Estimated Expiration
2043-10-24

AI Technical Summary

Technical Problem

Given the height restrictions in the basement of the community's power distribution room, the lack of effective risk management methods in existing technologies leads to significant potential accident risks during the handling of cable reels, especially the risk of personal injury to construction workers.

Method used

A method and device for the slow descent of cable reels during power distribution network construction is adopted. The cable reels are slowly lowered by a guide rail device, and anti-disengagement devices and speed sensors are used to judge the disengagement and stalling trends and issue alarm information in a timely manner. The descent speed of the cable reels is controlled by a depth deterministic strategy gradient algorithm.

Benefits of technology

This effectively prevents personal injury to construction workers, improves the handling efficiency of cable reels, and ensures the safe and efficient handling of cable reels.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117509043B_ABST
    Figure CN117509043B_ABST
Patent Text Reader

Abstract

The application discloses a cable reel downhill slow lowering method, device, equipment and medium for network construction. The method comprises the following steps: when a cable reel is slowly lowered along a guide rail device arranged on the ground, it is determined whether a anti-tripping device has a tripping trend and whether the cable reel has a stall trend; and if the anti-tripping device has a tripping trend or the cable reel has a stall trend, an alarm information is sent to a worker. The embodiment of the application can avoid personal injury and improve the carrying efficiency of the cable reel.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of power grid construction, and particularly relates to a power distribution network construction cable reel downhill slow descent method, device, equipment and medium. BACKGROUND

[0002] At present, most of the community power distribution rooms are located in basements, and there are still a large number of factors such as high garage entrance height, which leads to the inability to use large machinery to transport cable reels, and there is still a great potential risk of accidents. During the transportation of the cable by the external construction unit, due to the height limit of the community basement, the transport vehicle cannot enter the basement for transportation, and the construction personnel incorrectly use the rolling cable reel downhill method to transport the cable reel, which is easy to cause the electric power personal accident of crushing to death. It is reflected that at present, the power distribution network lacks limited risk control methods and technical means for such operations.

[0003] Therefore, it is particularly important to study how to safely, efficiently and economically transport the cable reel under the restriction of the hoisting machinery by the environment, and to further effectively avoid personal injury and improve the transportation efficiency of the cable reel. SUMMARY

[0004] The present application provides a power distribution network construction cable reel downhill slow descent method, device, equipment and medium to avoid personal injury and improve the transportation efficiency of the cable reel.

[0005] According to an aspect of the present application, a power distribution network construction cable reel downhill slow descent method is provided, comprising:

[0006] When the cable reel is slowly descending along the guide rail device arranged on the ground, it is determined whether the anti-tripping device has a tripping trend and whether the cable reel has a stall trend, respectively;

[0007] If the anti-tripping device has a tripping trend or the cable reel has a stall trend, an alarm information is sent to the worker.

[0008] According to another aspect of the present application, a power distribution network construction cable reel downhill slow descent device is provided, comprising:

[0009] A slow descent safety judgment module is configured to determine whether the anti-tripping device has a tripping trend and whether the cable reel has a stall trend, respectively, when the cable reel is slowly descending along the guide rail device arranged on the ground;

[0010] A slow descent safety alarm module is configured to send an alarm information to the worker if the anti-tripping device has a tripping trend or the cable reel has a stall trend.

[0011] According to another aspect of the present application, an electronic device is provided, comprising:

[0012] at least one processor; and

[0013] A memory communicatively connected to the at least one processor; wherein,

[0014] The memory stores a computer program that can be executed by the at least one processor, which is then executed by the at least one processor to enable the at least one processor to perform the power distribution network construction cable reel downhill descent method according to any embodiment of the present invention.

[0015] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions, the computer instructions being configured to cause a processor to execute and implement the method for gradual descent of cable reel during power distribution network construction as described in any embodiment of the present invention.

[0016] The embodiments of the present invention are passed through

[0017] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1A This is a flowchart of a method for the gradual descent of a cable reel during power distribution network construction, according to an embodiment of the present invention.

[0020] Figure 1B This is a schematic diagram of a cable reel descent system for power distribution network construction according to an embodiment of the present invention;

[0021] Figure 2 This is a structural schematic diagram of a cable reel descent device for power distribution network construction according to another embodiment of the present invention;

[0022] Figure 3 This is a schematic diagram of the structure of an electronic device that implements an embodiment of the present invention. Detailed Implementation

[0023] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0024] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0025] Figure 1A This is a flowchart illustrating a method for the descent of a cable reel during power distribution network construction, provided in one embodiment of the present invention. This embodiment is applicable to situations where the basement of a residential area has height restrictions, preventing transport vehicles for power distribution network construction from entering the basement to move the cable reel. This method can be executed by a cable reel descent descent device, which can be implemented in hardware and / or software. This device can be configured in an electronic device with corresponding data processing capabilities, such as the control processor of a cable reel descent descent system. Figure 1A As shown, the method includes:

[0026] S110. When the cable reel is slowly descending along the guide rail device deployed on the ground, determine whether the anti-disengagement device has a tendency to disengage and whether the cable reel has a tendency to stall.

[0027] S120. If the anti-disengagement device has a tendency to disengage or the cable reel has a tendency to stall, an alarm message shall be sent to the staff.

[0028] Among them, such as Figure 1B As shown, the hardware components of the cable reel descent device for power distribution network construction mainly include a guide rail device, an anti-disengagement device, and a disengagement audible and visual alarm device.

[0029] Specifically, when there are height restrictions in the basement of the residential area, preventing transport vehicles from entering for handling, the guide rail device is fixed to the ground, and then an anti-disengagement device is installed. The cable reel that needs to be transported to the basement during power distribution network construction is hung on the guide rail. The cable reel and the anti-disengagement device are connected by a cable, allowing the cable reel to slowly descend along the guide rail to the designated location in the basement. During the slow descent of the cable reel, the anti-disengagement device and the cable reel are assessed for potential disengagement, allowing for early prediction of sudden detachment of the anti-disengagement device or sudden loss of speed of the cable reel due to excessive cable reel weight, excessive angle between the guide rail and the horizontal plane, etc. If a disengagement trend is detected in the anti-disengagement device or a loss of speed in the cable reel, an alarm is immediately triggered to alert personnel to take evasive action.

[0030] This invention provides a cable reel descent slow-descent system for power distribution network construction, and performs tripping and stalling trend judgments. This system provides timely warnings to workers before tripping or stalling occurs, effectively preventing personal injury and improving the handling efficiency of the cable reel.

[0031] Optionally, the anti-disengagement device is equipped with a speed sensor and an infrared sensor, which are used to determine whether the anti-disengagement device has a tendency to disengage and whether the cable reel has a tendency to stall, respectively.

[0032] Specifically, the anti-disengagement device is equipped with a speed sensor and an infrared sensor. The main purpose is to prevent the cable reel from descending too quickly when being transported downhill. The descent speed can be controlled by the anti-disengagement device. Secondly, the infrared sensor is used to determine whether the disengagement device is still fixed on the guide rail. If a stalling trend or a disengagement trend occurs, an alarm will be sounded immediately to remind the staff to take evasive action.

[0033] Optionally, the anti-disengagement device is also equipped with a motor for uniformly controlling the descent speed of the cable reel.

[0034] Specifically, the anti-disengagement device also has a built-in motor to control the speed at which the cable reel descends, keeping it at a fixed speed for transport. This overcomes the challenges of different angles, slopes, and construction sites, making it highly adaptable.

[0035] Optionally, the constant speed control of the descent speed of the cable reel includes:

[0036] A deep deterministic gradient algorithm is used to control the descent speed of the cable reel at a constant speed.

[0037] In the deep deterministic policy gradient algorithm, the Actor policy network explores and makes action decisions in the continuous action space, while the Critic value network is responsible for evaluating the quality of the decisions, thereby guiding the update of the Actor policy network parameters. The Critic estimation network updates in real time according to the guidance of its own target network.

[0038] Among them, the deep deterministic policy gradient algorithm, as an intelligent control algorithm for descent systems, is an excellent control algorithm commonly used in reinforcement learning to handle tasks with continuous action spaces. Its parameter update idea borrows from the dual-network delayed update and experience replay mechanism in the deep Q-network algorithm to cut off data correlations, and uses batch standardization during training to improve learning efficiency.

[0039] Specifically, the Actor policy network in the algorithm explores and makes action decisions in a continuous action space, while the Critic value network is responsible for evaluating the quality of these decisions, thereby guiding the update of the Actor policy network parameters. The Critic's estimation network updates in real time based on the guidance of its own target network. Therefore, the parameters of the estimation network are the latest parameters, while the target network parameters are updated with a delay using a moving average method based on the estimated network parameters.

[0040] Optionally, the Critic estimates the network parameters by minimizing the mean square error, and the update process is as follows:

[0041]

[0042] Where L represents the minimized mean square error, and N is the total number of data points retrieved from the experience pool; y i A better estimate of the target Q value at time i; Q(s) i ,a i |θ Q ) is the estimated Q value; s i Let a be the environment state at time i; i θ is the input action at time i; Q Here, Q represents the parameters of the estimated network in the Critic network; r i γ is the instantaneous reward at time i; γ is the discount rate; Q′(s) i+1 ,μ′(s i+1 |θ μ′ )∣θ Q′ ) represents the target Q value; μ′(s) i+1 |θ μ′ ) represents the deterministic policy, μ′ represents the target network in the Actor network, and θ represents the deterministic policy. μ′ θ represents the parameters of the target network within the Actor network. Q′Here, Q' represents the parameters of the target network within the Critic network.

[0043] Specifically, the first parameter that needs to be updated is a. i s i θ Q r i The update process is as follows: First, the initial state, with the cable reel placed in place, represents the initial environmental state s. i Its input action is 0, which means the cable reel has not yet been lowered. This is the network θ estimated at time i. Q The value of r. The experience pool contains data under different conditions, such as a slope of 30°, a slope length of 3 meters, and the weight of the cable reel, each corresponding to different inputs under different environments. i As the immediate reward at time i, it is used to correct for unexpected situations encountered during the downhill process, such as uneven road conditions. Therefore, it is calculated based on the possible y at time i+1. i The motor drive speed is calculated using the mean square error at the current moment to prevent the cable reel from descending too quickly. This allows for updating the motor speed at time i, thus controlling the cable reel's descent speed and preventing it from falling and injuring workers. Matching with a large amount of historical data yields the corresponding motor control parameters. Essentially, this minimizes the error between the estimation network and the target network, achieving optimized control. This is done by calculating the possible y values ​​at time i+1. i The motor drive speed is calculated using the mean square error L at the current moment to prevent the cable reel from descending too quickly. This updates the motor speed at time i, thus controlling the cable reel's descent speed and preventing it from injuring workers. Matching with a large amount of historical data yields the corresponding motor control parameters. For example, at time i+1, the desired scenario is a motor speed of 1 m / s. The motor parameters at time i are then adjusted to ensure the cable reel's descent speed is as expected. For instance, if the estimated motor speed at network time i is 1.5 m / s and the target network's motor speed is 1.2 m / s, the instantaneous reward r is adjusted accordingly. i The parameters in the network are updated with the goal of minimizing the mean square error.

[0044] Optionally, the process by which the Actor policy network updates its network parameters based on policy gradients is as follows:

[0045]

[0046] in, For the performance index J(θ) μ For parameter θ μThe gradient of μ is the estimated network in the Actor network; a is the input action; s is the environment state; μ(s) i ) represents the deterministic policy output by the estimation network in the Actor network when the environment state is si; The environment state is represented by s. i The action is μ(s) i When ), estimate the gradient of Q with respect to action a; μ(s|θ) μ () represents the deterministic policy learned by the Actor network. The environmental state is s i When, μ(s|θ) μ ) for θ μ The gradient.

[0047] Specifically, the Actor policy network can continuously adjust its network parameters θ in the direction that maximizes the reward. μ In other words, through s in a deterministic policy environment i To achieve the desired motor speed, with the cable reel descent speed controlled at 1.2 m / s, how can we control the motor's rotational speed? This can be represented as a gradient change, essentially a slope change process, maintaining it within this gradient range. In other words, we can obtain the speed at θ... μ The motor control parameters and cable reel descent speed are configured under various conditions. This allows for stable control of the cable reel descent, adapting to different slopes, lengths, weights, and road conditions.

[0048] Figure 2 This is a schematic diagram of a slope descent device for a power distribution network construction cable reel, provided as another embodiment of the present invention. Figure 2 As shown, the device includes:

[0049] The slow descent safety judgment module is used to determine whether the anti-disengagement device has a tendency to disengage and whether the cable reel has a tendency to stall when the cable reel is slowly descending along the guide rail device deployed on the ground.

[0050] The slow descent safety alarm module is used to issue an alarm message to the staff if the anti-disengagement device has a tendency to disengage or the cable reel has a tendency to stall.

[0051] The cable reel descent device for power distribution network construction provided in this embodiment can execute the cable reel descent method for power distribution network construction provided in any embodiment of this invention, and has the corresponding functional modules and beneficial effects of the method.

[0052] Optionally, the anti-disengagement device is equipped with a speed sensor and an infrared sensor, which are used to determine whether the anti-disengagement device has a tendency to disengage and whether the cable reel has a tendency to stall, respectively.

[0053] Optionally, the anti-disengagement device is also equipped with a motor for uniformly controlling the descent speed of the cable reel.

[0054] Optionally, the constant speed control of the descent speed of the cable reel includes:

[0055] A deep deterministic gradient algorithm is used to control the descent speed of the cable reel at a constant speed.

[0056] In the deep deterministic policy gradient algorithm, the Actor policy network explores and makes action decisions in the continuous action space, while the Critic value network is responsible for evaluating the quality of the decisions, thereby guiding the update of the Actor policy network parameters. The Critic estimation network updates in real time according to the guidance of its own target network.

[0057] Optionally, the Critic estimates the network parameters by minimizing the mean square error, and the update process is as follows:

[0058]

[0059] Where L represents the minimized mean square error, and N is the total number of data points retrieved from the experience pool; y i A better estimate of the target Q value at time i; Q(s) i ,a i |θ Q ) is the estimated Q value; s i Let a be the environment state at time i; i θ is the input action at time i; Q Here, Q represents the parameters of the estimated network in the Critic network; r i γ is the instantaneous reward at time i; γ is the discount rate; Q′(s) i+1 ,μ′(s i+1 |θ μ′ )∣θ Q′ ) represents the target Q value; μ′(s) i+1 |θ μ′ ) represents the deterministic policy, μ′ represents the target network in the Actor network, and θ represents the deterministic policy. μ′ θ represents the parameters of the target network within the Actor network. Q′ Here, Q' represents the parameters of the target network within the Critic network.

[0060] Optionally, the process by which the Actor policy network updates its network parameters based on policy gradients is as follows:

[0061]

[0062] in, For the performance index J(θ) μ For parameter θ μ The gradient of μ is the estimated network in the Actor network; a is the input action; s is the environment state; μ(s) i ) represents the deterministic policy output by the estimation network in the Actor network when the environment state is si; The environment state is represented by s. i The action is μ(s) i When ), estimate the gradient of Q with respect to action a; μ(s|θ) μ () represents the deterministic policy learned by the Actor network. The environmental state is s i When, μ(s|θ) μ ) for θ μ The gradient.

[0063] The cable reel descent device for power distribution network construction, as further explained, can also perform the cable reel descent method for power distribution network construction provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the method.

[0064] Figure 3 A schematic diagram of an electronic device 30 that can be used to implement embodiments of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0065] like Figure 3 As shown, the electronic device 30 includes at least one processor 31 and a memory, such as a read-only memory (ROM) 32 and a random access memory (RAM) 33, communicatively connected to the at least one processor 31. The memory stores computer programs executable by the at least one processor. The processor 31 can perform various appropriate actions and processes based on the computer program stored in the ROM 32 or loaded from storage unit 38 into the RAM 33. The RAM 33 can also store various programs and data required for the operation of the electronic device 30. The processor 31, ROM 32, and RAM 33 are interconnected via a bus 33. An input / output (I / O) interface 35 is also connected to the bus 34.

[0066] Multiple components in electronic device 30 are connected to I / O interface 35, including: input unit 36, such as keyboard, mouse, etc.; output unit 37, such as various types of monitors, speakers, etc.; storage unit 38, such as disk, optical disk, etc.; and communication unit 39, such as network card, modem, wireless transceiver, etc. Communication unit 39 allows electronic device 30 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0067] Processor 31 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 31 include, but are not limited to, central processing unit (CPU), graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, digital signal processors (DSPs), and any suitable processor, controller, microcontroller, etc. Processor 31 performs the various methods and processes described above, such as the method of descent of cable reels during power distribution network construction.

[0068] In some embodiments, the cable reel descent method for distribution network construction can be implemented as a computer program tangibly contained in a computer-readable storage medium, such as storage unit 38. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 30 via ROM 32 and / or communication unit 39. When the computer program is loaded into RAM 33 and executed by processor 31, one or more steps of the cable reel descent method for distribution network construction described above can be performed. Alternatively, in other embodiments, processor 31 can be configured to perform the cable reel descent method for distribution network construction by any other suitable means (e.g., by means of firmware).

[0069] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0070] Computer programs used to implement the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowcharts and / or block diagrams to be performed. The computer programs may be executed entirely on a machine, partially on a machine, or as a standalone software package, partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0071] In the context of this invention, a computer-readable storage medium can be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, apparatus, or device. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination thereof. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0072] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0073] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as data servers), or computing systems that include middleware components (e.g., application servers), or computing systems that include frontend components (e.g., user computers with graphical user interfaces or web browsers through which users can interact with implementations of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., communication networks). Examples of communication networks include local area networks (LANs), wide area networks (WANs), blockchain networks, and the Internet.

[0074] A computing system can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0075] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in this invention can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this invention can be achieved, and this is not limited herein.

[0076] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A method for gentle descent of a network construction cable drum down a slope, characterized in that, The method is applied to a cable reel downhill slow descent system for distribution network construction, and the method comprises the following steps: When the cable reel is slowly descending along a guide rail device arranged on the ground, it is determined whether the anti-tripping device has a tripping trend and whether the cable reel has a stall trend; If the anti-tripping device has a tripping trend or the cable reel has a stall trend, an alarm information is sent to the staff; The anti-tripping device is provided with a motor for uniform speed control of the slow descent speed of the cable reel; The uniform speed control of the slow descent speed of the cable reel comprises the following steps: The deep deterministic policy gradient algorithm is used to control the uniform speed of the slow descent speed of the cable reel; In the deep deterministic policy gradient algorithm, the Actor policy network explores in the continuous action space and makes action decisions, and the Critic value network is responsible for judging the pros and cons of the decisions to guide the parameter update of the Actor policy network, and the Critic estimation network updates in real time according to the guidance of the target network; The update mode of the Critic estimation network parameters is to minimize the mean square error, and the update process is as follows: ; wherein, N is the total number of data taken from the experience pool to minimize the mean square error; is a better estimate of the target Q value at time i; is an estimated Q value; is the environment state at time i; is the input action at time i; is the parameter of the estimation network in the Critic network, and Q represents the estimation network in the Critic network; is the immediate reward at time i; and γ is the discount rate; is the target Q value; is the deterministic policy, and μ' is the target network in the Actor network, is the parameter of the target network in the Actor network; is the parameter of the target network in the Critic network, and Q' is the target network in the Critic network; In the process of updating the network parameters based on the policy gradient, the Actor policy network is updated according to the following formula: ; in, For performance indicators For parameters The gradient of μ is the estimation network in the Actor network; a is the input action; s is the environment state; This represents the deterministic policy output by the estimation network in the Actor network when the environment state is si. Indicates the environmental state as Actions At that time, estimate the gradient of Q with respect to action a; To estimate the deterministic policy learned by the network in the Actor network; The environmental state is hour, right The gradient.

2. The method of claim 1, wherein, The anti-tripping device is provided with a speed sensor and an infrared sensor for determining whether the anti-tripping device has a tripping trend and whether the cable reel has a stall trend.

3. A device for controlled descent of a network construction cable drum down a slope, characterized in that The device is arranged in a cable reel downhill slow descent system for distribution network construction, and is used to realize the cable reel downhill slow descent method for distribution network construction according to claim 1, and the device comprises the following parts: A slow descent safety judgment module is arranged to determine whether the anti-tripping device has a tripping trend and whether the cable reel has a stall trend when the cable reel is slowly descending along a guide rail device arranged on the ground; A slow descent safety alarm module is arranged to send an alarm information to the staff if the anti-tripping device has a tripping trend or the cable reel has a stall trend.

4. The apparatus of claim 3, wherein, The anti-tripping device is provided with a speed sensor and an infrared sensor for determining whether the anti-tripping device has a tripping trend and whether the cable reel has a stall trend.

5. An electronic device, comprising: The electronic device comprises: at least one processor; and a memory connected with the at least one processor in communication; wherein The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to execute the cable reel downhill slow descent method for distribution network construction according to any one of claims 1-2.

6. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer instructions for enabling the processor to execute the cable reel downhill slow descent method for distribution network construction according to any one of claims 1-2.

Citation Information

Patent Citations

  • Power cable anti-theft alarm device and system

    CN108806143A

  • Network connection vehicle signal lamp control intersection economic passing method based on reinforcement learning

    CN113269963A