Power transmission line sensing device and low power consumption control method thereof

By obtaining the remaining battery energy in the transmission line sensing device and implementing different optimization strategies, the problem that traditional technology cannot adjust adaptively is solved, achieving the effect of low-power operation and battery life extension.

CN120129035APending Publication Date: 2025-06-10STATE GRID BEIJING ELECTRIC POWER CO +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202510396292.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-03-31
Publication Date
2025-06-10

AI Technical Summary

Technical Problem

Traditional low-power control algorithms cannot adaptively adjust the battery's real-time battery power, which makes it difficult to replace the sensor device with exhaustion and in complex environments.

Method used

By obtaining the remaining energy of the battery and comparing it with the preset threshold, different optimization strategies are implemented: the first optimization strategy comprehensively considers transmission delay and energy consumption, the second optimization strategy focuses on reducing energy consumption, and the third optimization strategy is a super power-saving mode, selecting the channel with the highest historical average of the channel for data transmission, and issuing an early warning.

Benefits of technology

Dynamic adjustment and optimization strategy based on battery residual energy is realized to minimize energy consumption, extend battery life, and improve the reliability of sensor devices in complex environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120129035A_ABST
    Figure CN120129035A_ABST
Patent Text Reader

Abstract

The invention belongs to the technical field of power transmission line power supply control, and relates to a power transmission line sensing device and a low-power-consumption control method thereof. The method comprises the following steps: acquiring residual energy of a battery, and comparing the residual energy of the battery with a first preset threshold value and a second preset threshold value; if the residual energy in the battery is greater than or equal to a first preset threshold value, executing a first optimization strategy; if the residual energy in the battery is smaller than the first preset threshold value and larger than or equal to a second preset threshold value, a second optimization strategy is executed; if the residual energy in the battery is smaller than a second preset threshold value, executing a third optimization strategy; the first optimization strategy comprehensively considers transmission delay and transmission energy consumption, and is a normal working mode; the second optimization strategy considers transmission energy consumption and is a power-saving mode; and the third optimization strategy is a super power-saving mode, and the channel with the highest historical income mean value is selected for data transmission. The problem that a traditional low-power-consumption control algorithm cannot be combined with the real-time electric quantity of the battery for self-adaptive adjustment is solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of power supply control for transmission lines, and particularly relates to a sensing device for transmission lines and a low-power consumption control method therefor. Background Art

[0002] In transmission scenarios, there are a large number of telemetry requirements for tower poles, overhead lines, etc. However, due to the relatively high voltage level in transmission scenarios, it is impossible to directly supply power to the sensing device. Therefore, at present, most sensing devices are battery-powered. On the other hand, the transmission scenario is relatively complex, including complex environments such as uninhabited areas, mountains, and river valleys. Once the power of the sensing device is exhausted, it is difficult to replace.

[0003] As Figure 1 shown, the monitoring requirements for transmission lines mainly include utility poles, electric towers, overhead lines, etc. The sensing device for transmission lines is responsible for environmental perception and collecting information such as temperature, humidity, tension, vibration, and inclination. The sensing device has a wireless communication function. Based on the public network communication method, it can directly or indirectly (multi-hop relay) transmit service data to a nearby base station, and the base station further transmits the data to a remote transmission line monitoring platform to achieve telemetry for the transmission line. Among them, the wireless channel between the sensing device and the base station adopts the orthogonal frequency division multiplexing modulation method, there is no co-frequency interference between channels, and the transmission capabilities of different channels are different. Selecting a channel with excellent transmission performance helps to reduce the energy consumption of the sensing device.

[0004] In the research and design of traditional low-power consumption devices for such scenarios, they often start from a single perspective of hardware circuit design and lack the integrated design of the control unit. Moreover, regardless of the actual monitoring requirements of the transmission line or cost considerations, the sensing device for the transmission line does not require a very high-performance processor. How to achieve low-power consumption operation of the hardware circuit as much as possible while meeting the actual use requirements is still a problem. In addition, in terms of the transmission control algorithm, traditional mathematical programming or heuristic algorithms often require complex iterative processes, and the transmission line sensing device characterized by miniaturization and low cost cannot be well equipped. Using a reinforcement learning algorithm with simple operation logic to make transmission control decisions is a good choice, but the traditional reinforcement learning algorithm still has the problem of poor convergence and cannot achieve adaptive adjustment of the strategy in combination with the actual business situation. Summary of the Invention

[0005] The purpose of the present invention is to provide a sensing device for transmission lines and a low-power consumption control method therefor, which solves the problem that the traditional low-power consumption control algorithm cannot perform adaptive adjustment in combination with the real-time battery power.

[0006] The present invention is realized through the following technical solutions: A low-power control method for a transmission line sensing device, specifically including the following processes: Obtain the remaining energy of the battery and compare the remaining energy of the battery with a first preset threshold and a second preset threshold; the first preset threshold is greater than the second preset threshold; If the remaining energy in the battery is greater than or equal to the first preset threshold, execute the first optimization strategy; If the remaining energy in the battery is less than the first preset threshold and greater than or equal to the second preset threshold, execute the second optimization strategy; If the remaining energy in the battery is less than the second preset threshold, execute the third optimization strategy; The first optimization strategy comprehensively considers transmission delay and transmission energy consumption and is the normal working mode; The second optimization strategy considers transmission energy consumption and is the power-saving mode; The third optimization strategy is the super power-saving mode, select the channel with the highest average historical gain of the channel for data transmission, and issue a warning.

[0007] Further, the first optimization strategy is: First, calculate the weighted sum of energy consumption and delay according to the first optimization objective formula; Calculate the first average historical gain and the second average historical gain according to the weighted sum of energy consumption and delay; the first average historical gain is the average historical gain of different transmission powers and channel combinations, and the second average historical gain is the average historical gain of different channels; Calculate the first total gain according to the first average historical gain; Select the transmission power and channel combination corresponding to the highest first total gain for service data transmission; After the service data is transmitted, obtain the corresponding transmission delay and transmission energy consumption, and perform learning and updating.

[0008] Further, the step of first calculating the weighted sum of energy consumption and delay according to the first optimization objective formula, the specific calculation formula is: ; Where, V is the weight coefficient, used to achieve a compromise between transmission energy consumption and transmission delay; Represents the weighted sum of energy consumption and delay; Is the remaining energy of the battery at the current moment, Is the maximum battery capacity; Is the transmission energy consumption; Where, ; Where, Is the transmission delay; Is the randomly selected transmission power, and the transmission power is set to multiple values according to a fixed gradient, ; Indicates the th channel; Select the transmission power and channel combination corresponding to the highest total first revenue for service data transmission. The expression is: ; Wherein, is the total first revenue, is the transmission power and channel combination.

[0009] Furthermore, calculate the average first historical revenue based on the weighted sum of energy consumption and delay. The specific calculation expression is: ; Let ; Wherein, represents the average first historical revenue; Calculate the average second historical revenue based on the weighted sum of energy consumption and delay. The specific calculation expression is: ; Let ; Wherein, represents the average second historical revenue.

[0010] Furthermore, the total first revenue and the total second revenue are expressed as:

[0011]

[0012] Wherein, is the size of the service data normalized by the min-max method; t represents the current round, is the number of selections of the transmission power and channel combination; is the corresponding number of channel selections; represents the total first revenue, represents the total second revenue; After the service data is transmitted, obtain the corresponding transmission delay and transmission energy consumption, and perform learning and update. Specifically: The number of selections of the transmission power and channel combination = +1, the corresponding number of channel selections = +1, round t = t + 1; Update the average first historical revenue and the average second historical revenue. The expression is:

[0013]

[0014] In the formula, is the forgetting coefficient, which is between 0 and 1.

[0015] Furthermore, the transmission delay has the following specific expression:

[0016] In the formula, is the transmission delay, is the size of the service data volume, is the transmission capacity; represents the th channel; For the wireless channel , the expression of the transmission capacity is:

[0017] In the formula, is the bandwidth, is the signal-to-interference-plus-noise ratio; When the selected transmission power is , the corresponding transmission energy consumption is: .

[0018] Furthermore, the second optimization strategy is: First, calculate the weighted sum of the energy consumption and the delay according to the second optimization objective formula; Calculate the first historical revenue average and the second historical revenue average according to the weighted sum of the energy consumption and the delay; the first historical revenue average is the historical revenue average of different combinations of transmission power and channels, and the second historical revenue average is the historical revenue average of different channels; Calculate the first total revenue according to the first historical revenue average; Calculate the second total revenue according to the second historical revenue average; Based on the historical data, select the combination of transmission power and channels corresponding to the highest first historical revenue average, adjust the input voltage of the communication unit so that the transmission power of the communication unit is maintained at the selected transmission power; the optimization variable is only the channel, and the transmission power control is no longer executed. At this time, select the channel with the largest second total revenue for service data transmission; After the service data is transmitted, perform parameter update.

[0019] Furthermore, first calculate the weighted sum of the energy consumption and the delay according to the second optimization objective formula, and the specific calculation formula is:

[0020] Among them, Represents the weighted sum of energy consumption and delay; V is the weight coefficient, used to achieve a trade-off between transmission energy consumption and transmission delay; is the remaining battery energy at the current moment, is the maximum battery capacity; is the transmission energy consumption; Among them,

[0021] is the randomly selected transmission power, and multiple values of the transmission power are set according to a fixed gradient, ; is the transmission delay; The selected total revenue The channel with the maximum revenue is selected for business data transmission, specifically: ; After the business data transmission is completed, parameter update is performed, specifically: The corresponding channel selection times = +1, round t = t + 1; The second historical revenue mean is updated, and the expression is: ; In the formula, is the forgetting coefficient, which is between 0 and 1.

[0022] Furthermore, the third optimization side strategy is: The communication unit sends corresponding signaling information to notify the operation and maintenance personnel to replace the battery or the device. At the same time, the power supply only retains the connection with the sensor unit and the communication unit, and closes the remaining module units. The channel with the highest historical revenue mean of the fixed selection channel is selected for data transmission until the battery or the new device is replaced, or the battery is recharged to a high power state.

[0023] The present invention also discloses a low-power sensing device for a transmission line, including: A sensor unit, used to monitor external information in real time; A control unit, powered by a power supply, used to execute the low-power control method and manage the power supply; A communication unit, used to wirelessly transmit the information monitored by the sensor unit; A clock synchronization unit, including a main clock and a low-frequency clock. The main clock is used as the main clock source of the control unit to provide working clocks for the control unit and the peripheral circuit; the low-frequency clock is used to wake up the system in the sleep state; The sensor unit, the communication unit, and the clock synchronization unit are all powered by a power supply; The sensor unit, the communication unit, the clock synchronization unit, and the control unit all adopt digital CMOS circuits; A circuit switch is provided between the sensor unit, communication unit, clock synchronization unit, control unit and the power supply, and the circuit switch is used to control the power supply of each unit.

[0024] Compared with the prior art, the present invention has the following beneficial technical effects: The present invention discloses a low-power control method for a transmission line sensing device, which adopts a control strategy adjustment method based on battery energy perception. By executing different optimization strategies according to the remaining energy of the battery, the first optimization strategy comprehensively considers the transmission delay and transmission energy consumption, and minimizes the energy consumption on the premise of ensuring the transmission delay, realizing efficient operation in the normal working mode; the second optimization strategy focuses on reducing the transmission energy consumption, and realizes energy-saving operation in the power-saving mode by fixing the maximum transmission power and selecting the optimal channel for data transmission; the third optimization strategy is the super power-saving mode, which only retains the functions related to information collection and transmission, issues a warning, fixes the channel selection as the current optimal channel, and only retains the basic data collection and transmission functions until the battery, device replacement or charging is completed, maximizing the service life of the battery. This method not only considers the transmission energy consumption, but also considers the circuit energy consumption, and can effectively reduce the overall energy consumption in the case of short transmission distance. Description of the Drawings

[0025] Figure 1 The low-power transmission system of the transmission line sensing device designed for the present invention; Figure 2 The low-power hardware architecture of the transmission line sensing device designed for the present invention; Figure 3 The flowchart of the low-power transmission control algorithm based on improved reinforcement learning provided by the present invention. Detailed Embodiments

[0026] In order to make the purpose, technical solutions and advantages of the present invention clearer, the following further detailed description is given in conjunction with the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention, that is, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments.

[0027] The components described and shown in the drawings and embodiments of the present invention can be arranged and designed in various different configurations. Therefore, the detailed description of the embodiments of the present invention provided in the following drawings is not intended to limit the scope of the claimed present invention, but merely represents a selected embodiment of the present invention. Based on the drawings and embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts belong to the protection scope of the present invention.

[0028] It should be noted that: The term "comprise", "include" or any other variant is intended to cover non-exclusive inclusion, such that a process, element, method, article or device that comprises a series of elements does not only include those elements but also other elements not expressly listed, or elements inherent to the process, element, method, article or device.

[0029] The features and performance of the present invention will be further described in detail below in conjunction with embodiments.

[0030] The present invention designs a hardware architecture for a low-power sensing device for transmission lines, as Figure 2 shown, including a power supply, a sensor unit, a control unit, a communication unit and a clock synchronization unit. Among them, the power supply is responsible for the functions of other units. The sensor unit is responsible for environmental perception and accesses the data to the communication unit. The communication unit transmits the data to a nearby base station. The control unit is responsible for the overall control of the sensing device, including functions such as power management and transmission control. The clock synchronization unit provides a working clock for other units.

[0031] Power supply: In the transmission environment, there is a situation of difficult power acquisition. More often, battery power supply is adopted, and the power supply uses a lithium battery.

[0032] Sensor unit: It is powered by the power supply and is designed according to the functions to be realized by the sensing device. It monitors external information in real time. According to the monitoring service types in the transmission scenario, there are various sensors applied in different scenarios, including temperature, humidity, tension, vibration, tilt and other sensors.

[0033] Control unit: It is powered by the power supply and takes a low-power MCU as the core to perform logical operations and transmission control of service data. The MCU also has advantages such as high integration and low cost. The adopted MCU is an integrated chip that integrates an internal processor (CPU), a memory, a counter, and I / O ports. Based on this hardware circuit, the data to be processed, calculation methods, steps, and operation commands are compiled into a program and stored in the internal or external memory of the MCU. When the MCU is running, it can automatically and continuously fetch and execute from the memory. In addition, the design of the MCU needs to consider the power consumption requirements of the device, and the MCU is suitable for controlling and managing various functions and tasks of the embedded system. Its computing power focuses more on specific control applications and simple data processing. Therefore, it is necessary to further discuss how to design a low-power solution for the sensing device from the aspects of hardware circuit and software algorithm.

[0034] In addition, to achieve the low-power function, a dynamic power management function should be available, which mainly completes battery charge and discharge management, power detection, temperature monitoring, and system power supply management. The dynamic power management unit can switch between the low-power mode and the normal working mode according to the real-time load condition of the circuit, and the low-power mode is achieved by means of circuit sleep mechanism or reducing circuit power, etc.

[0035] Communication unit: According to the real-time requirements of the power transmission service, the communication unit should have strong data transmission capabilities, adopt wireless communication forms, be based on the public network (GPRS / 4G / 5G) or multi-hop relay, and transmit the data collected by the sensing device to the nearby base station wirelessly.

[0036] Clock synchronization unit: The main clock is mainly used as the main clock source of the MCU to provide working clocks for the CPU and peripheral circuits. The low-frequency clock is mainly used to wake up the system in the sleep state.

[0037] In this invention, considering from the circuit aspects of each unit, the design of the low-power circuit for the hardware unit is carried out. The design of the low-power circuit follows the principle of streamlining the circuit and reducing the useless power consumption. First, when designing, reducing the connection length to reduce the load capacitance and reducing the working frequency to reduce the switching frequency can effectively reduce the power consumption. In addition, considering starting from reducing the switching activity transition rate, when the signal activity is zero, even if the load capacitance is very large, the circuit does not consume energy. Therefore, in the specific work practice, when a certain unit of the circuit is not working and is in the sleep state, the clocks of these systems can be shielded, which can stop the work and flipping of some circuits, thereby playing a role in reducing the circuit power consumption. The design of the low-power circuit is as follows: 1) Digital CMOS circuit: The digital CMOS circuit is a commonly used low-power circuit, and this mode is adopted for the interconnection between the hardware units in the device. It is composed of n-type MOS field-effect transistors and p-type MOS field-effect transistors, and realizes the logic function through complementary work. The CMOS circuit has the characteristics of low power consumption, high speed, high reliability, etc. The digital CMOS circuit is used between different units to realize the transmission and conversion of signals and data.

[0038] 2) Circuit switch and sleep mechanism: Circuit switches are added to meet the low-power requirements in different scenarios. The circuit switches are connected between each unit and the power supply. By controlling the on-off state of the switches, the power supply of each unit can be controlled, or they can also be connected inside the unit to put a specific functional module inside the unit into sleep. Currently, the sensing device for the power transmission line usually senses and transmits the environmental information at a fixed frequency, and the interval between two times is usually more than 10 minutes. During the interval, only the low-frequency clock can be kept on for timing, and other circuit switches are turned on. When the preset time interval is reached, the circuit switches are closed to wake up the system to start working.

[0039] 3) Voltage design: In the power supply design of the transmission line sensing device, reducing the operating voltage is an effective way to reduce power consumption. Design the circuit operating voltage in combination with the actual scenario, and design a high-efficiency power supply to reduce the power loss in voltage conversion, thereby reducing the power consumption of the device. The design principle of the output voltage of different units is designed according to the energy supply requirements of the unit. In the present invention, a gradient voltage is set, and different output voltages can determine different transmission powers of the communication unit, and can be dynamically adjusted according to the power decision result of the transmission control algorithm in the third part. The duty cycle modulation (PWM) method can be used to achieve this, that is, by changing the on and off times of the switching devices inside the switching power supply to adjust the magnitude of the output voltage. In the present invention, based on the power decision result of the transmission control algorithm in the third part, the control unit generates a corresponding PWM signal, and then drives the conduction and cutoff of the circuit control switching device (built-in in the adjustable power supply) in the power supply. The longer the conduction time, the larger the average output voltage, and vice versa.

[0040] In terms of the hardware architecture, a dynamic power management unit is introduced to realize the switching management between the low-power mode and the normal operation mode. The switching between the low-power mode and the normal operation mode can be carried out according to the actual situation. The low-power mode can be realized by methods such as the sleep mechanism or reducing the circuit power. A low-power MCU is used as the core control unit of the sensing device to perform logical operations and transmission control of service data. The MCU also has advantages such as high integration and low cost. A low-power digital CMOS circuit is used as the main body for the connection between units. A circuit switch is added to realize the sleep of the circuit under non-working conditions.

[0041] In the hardware circuit design, considering that the computing power of the low-power MCU is limited, a reinforcement learning algorithm with simple logical operations is adopted to avoid complex iterations, reduce the energy consumption of algorithm execution, realize the coordination between the hardware and the algorithm, and reduce the overall power consumption. In addition, the power consumption is reduced by reducing the operating voltage, and a gradient voltage is set. According to the power decision result of the transmission control algorithm, the transmission power of the communication unit is dynamically adjusted by using duty cycle modulation (PWM), providing hardware support for the transmission power control of the algorithm, and reducing the energy consumption while meeting the transmission requirements.

[0042] The low-power MCU processor adopted by the transmission line sensing device does not have very strong computing power, and a small-sized and low-cost transmission line sensing device does not need to carry overly complex algorithms. In traditional research, the transmission control algorithms based on heuristic algorithms or mathematical programming are not suitable for most transmission line sensing scenarios because a large number of iterative processes are required each time. Therefore, the present invention mainly develops a low-power transmission control algorithm based on improved reinforcement learning. This type of algorithm has the characteristics of simple control logic and being jointly guided by historical experience and future benefits.

[0043] The low-power transmission control algorithm is mainly introduced from the following aspects: 1) Transmission control system model Service model: Combining the current power transmission line sensing scenario, the general telemetry service types can be roughly divided into three categories, namely image services, monitoring services, and real-time positioning services. Among them, image services have the characteristics of large data volume, large computing volume, and low latency requirements; monitoring services have the characteristics of small data volume, small computing volume, and high latency requirements; real-time positioning services have the characteristics of medium data volume, medium computing volume, and high latency requirements.

[0044] Latency model: The processing latency of services can be mainly divided into two parts: waiting latency and transmission latency. The waiting latency is mainly limited by the MCU hardware circuit conditions and built-in data packaging and transmission control algorithms, and usually belongs to non-optimizable latency. The transmission latency depends on the hardware circuit conditions on the one hand and the transmission power and wireless channel conditions on the other hand, and belongs to optimizable latency.

[0045] The transmission power is set to multiple values according to a fixed gradient, denoted by the symbol Wireless channels usually use OFDM modulation, and there is no co-channel interference between channels. Different wireless channels in the network are denoted by the symbol For the wireless channel when the transmission power is its transmission capacity can be expressed according to the Shannon formula as:

[0046] In the formula is the bandwidth, is the signal-to-interference-plus-noise ratio. The signal-to-interference-plus-noise ratio is proportional to the transmission power in addition to being affected by the channel conditions and interference.

[0047] Then the calculated transmission latency is:

[0048] In the formula is the size of the service data volume.

[0049] Energy consumption model: The inherent energy consumption of the hardware circuit usually belongs to non-optimizable energy consumption. The present invention has achieved low-power operation of the power transmission line sensing device through hardware structure and circuit design. The other part is the transmission energy consumption, which belongs to optimizable energy consumption and is mainly achieved through the collaborative optimization of transmission power control and wireless channel selection. When the selected transmission power is the corresponding transmission energy consumption is: .

[0050] Optimization objective design: From the combination of the channel transmission capacity and the energy consumption formula, it can be seen that the minimization of energy consumption and delay is not necessarily completely consistent. For example, when choosing a larger transmission power, although the transmission delay will decrease, the transmission energy consumption does not necessarily decrease. In addition, considering the problem of difficult power extraction from the transmission line, solar panels can be added to charge the sensing device.

[0051] Therefore, in the actual optimization objective design, the delay and energy consumption should be comprehensively considered. The original optimization objective in this invention is expressed as:

[0052] In the formula, represents the weighted sum of energy consumption and delay; the weight On the one hand, it is used to achieve a compromise between energy consumption and delay. On the other hand, it can be adjusted in combination with different types of services. The larger the weight, the more inclined to optimize energy consumption, and vice versa, more inclined to optimize delay. is the remaining energy of the battery in the sensing device at the current moment, is the maximum battery capacity. The less the current energy, the more inclined to optimize energy consumption, and vice versa, more inclined to optimize delay.

[0053] 2) Low-power transmission control algorithm based on improved reinforcement learning Combining the transmission power and the channel, it is expressed as , by choosing different different delay and energy consumption performances can be obtained. This problem is modeled as a multi-armed bandit problem. The rewards for choosing different are defined as:

[0054] At the same time, record the average rewards that can be obtained by choosing different channels, that is:

[0055] Transmission power control and channel selection: Due to the strong volatility of the wireless channel, in actual selection, it cannot completely rely on historical experience information. Therefore, this invention uses the UCB algorithm to solve the transmission power control and channel selection problems, and improves it in combination with the actual application scenario of transmission line monitoring. The core of reinforcement learning lies in the balance between "exploitation" and "exploration". "Exploitation" means relying on existing experience and choosing the arm with the largest average historical reward. "Exploration" means trying other arms in the hope of obtaining greater rewards in the future. In this invention, the total rewards jointly dominated by historical experience and future rewards are specifically classified into the first total reward and the second total reward, expressed as:

[0056]

[0057] Among them, is the size of the service data normalized by the min-max method. t represents the current round, is the number of selections of the transmission power and channel combination; is the corresponding number of channel selections; represents the first total revenue, represents the second total revenue; represents the first historical revenue average; represents the second historical revenue average.

[0058] It can be seen from the above formula that when the service data is larger and the historical revenue average is larger, the proportion of the future revenue item in the total revenue decreases, and it is more inclined to a conservative selection decision, that is, to believe in historical experience. On the contrary, it is more inclined to select other , so as to explore whether it is possible to obtain greater revenue. Exploring when the service data is small can also prevent the service delay from exceeding the required threshold range.

[0059] It can be seen from the above formula that when the service data is larger and the historical revenue average is larger, the proportion of the future revenue item in the total revenue decreases, and it is more inclined to a conservative selection decision, that is, to believe in historical experience. On the contrary, it is more inclined to select other , so as to explore whether it is possible to obtain greater revenue. Exploring when the service data is small can also prevent the service delay from exceeding the required threshold range.

[0060] The low-power transmission control algorithm based on improved reinforcement learning proposed by the present invention is as Figure 3 shown, and it includes the following steps: Step 1: Initialization When used for the first time, it is necessary to initialize the number of selections of the transmission power and channel combination to , the corresponding number of channel selections , the historical revenue average of selecting different transmission power and channel combinations is , the historical revenue average of selecting different channels , the current selection round is .

[0061] Step 2: Cold start The power line sensing device usually collects and transmits data based on a fixed frequency. Every time after a fixed period of time, transmission power control and channel selection are performed. At the beginning, each time a that has not been selected yet is randomly selected, and the number of selections of the corresponding transmission power and channel combination is incremented by 1, that is, , the selection round is incremented by 1, that is, , the historical revenue average is updated based on the corresponding latency and energy consumption revenue, that is and until all have been selected once.

[0062] Step 3: Adjustment of control strategy based on battery energy awareness Obtain the remaining energy in the battery, and compare the remaining energy of the battery with the first preset threshold and the second preset threshold; the first preset threshold is greater than the second preset threshold; It is divided into three cases: If the remaining energy in the battery is greater than or equal to the first preset threshold, execute the first optimization strategy; If the remaining energy in the battery is less than the first preset threshold and greater than or equal to the second preset threshold, execute the second optimization strategy; If the remaining energy in the battery is less than the second preset threshold, execute the third optimization strategy; The first optimization strategy comprehensively considers transmission latency and transmission energy consumption and is a normal working mode; the second optimization strategy considers transmission energy consumption; the third optimization strategy is to only retain the functions related to information collection and transmission and issue a warning.

[0063] The specific content of the first optimization strategy is: First, calculate the weighted sum of energy consumption and latency according to the first optimization objective formula ; ; According to the weighted sum of energy consumption and latency calculate the historical revenue average of different transmission power and channel combinations, that is, the first historical revenue average , and the historical revenue average of different channels, that is, the second historical revenue average ; According to the first historical revenue average calculate the first total revenue ; Select the power and channel combination with the largest first total revenue for business data transmission; After the business data transmission is completed, obtain the corresponding transmission latency and energy consumption performance, and perform learning and updating.

[0064] Select the transmission power and channel combination corresponding to the highest first total revenue for business data transmission, that is:

[0065] After the business data transmission is completed, the corresponding latency and energy consumption performance can be obtained, and then learning and updating are performed. The corresponding selection times for this selection +1, that is , increment the selection count of the corresponding channel by 1, i.e., , update the corresponding historical revenue mean according to the following formula

[0066]

[0067] In the formula, is the forgetting coefficient, which lies between 0 and 1. Since the reinforcement learning algorithm has certain blindness and randomness in the early stage, the reliability and volatility of the performance are greater. To improve the convergence, an exponential forgetting coefficient can be introduced to improve the traditional UCB algorithm, and the earlier the strategy, the lower its proportion.

[0068] As can be seen from the above process, the proposed transmission control algorithm can be completed by only simple logical operations such as addition, subtraction, multiplication, division, and comparison, without a complex iterative optimization process. Therefore, the algorithm itself has the characteristic of low power consumption, and through the execution of the algorithm, the transmission energy consumption can be further reduced through the collaborative optimization of power control and channel selection.

[0069] The second optimization side strategy is specifically as follows: First, calculate the weighted sum of energy consumption and delay according to the second optimization objective formula ; ; According to the weighted sum of energy consumption and delay calculate the historical revenue mean of different transmission power and channel combinations, i.e., the first historical revenue mean , and the historical revenue mean of different channels, i.e., the second historical revenue mean ; According to the first historical revenue mean calculate the first total revenue ; According to the second historical revenue mean calculate the second total revenue ; Based on historical data, select the transmission power and channel combination corresponding to the highest historical revenue mean of different transmission power and channel combinations , adjust the input voltage of the communication unit to maintain the transmission power of the communication unit at the selected transmission power ; The optimization variable is only the channel, and the transmission power control is no longer executed. At this time, select the channel with the largest second total revenue for business data transmission, and only update the historical revenue mean of different channels , the corresponding channel selection count and the round t.

[0070] Update the historical revenue means of different channels and the corresponding channel selection times and round t, specifically as follows: The corresponding channel selection times = + 1, and round t = t + 1; Update the second historical revenue mean, and the expression is: ; In the formula, is the forgetting coefficient, which is between 0 and 1.

[0071] The third optimization side strategy is: if the remaining energy in the battery is less than the second preset threshold, it is considered that the energy is about to run out. The communication unit sends the corresponding signaling information to notify the operation and maintenance personnel to replace the battery or the device. At the same time, the sensing device only retains the functions related to information collection and transmission, and turns off the other irrelevant functions (such as the power management function and the proposed transmission control function), and only depends on the historical revenue mean of the channel selection at the current moment, and fixedly selects the channel with the highest revenue for data transmission until the battery or the new device is replaced, or the battery is recharged to a high power state.

[0072] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them. Although the present invention has been described in detail with reference to the above embodiments, those of ordinary skill in the art should understand that: it is still possible to modify the specific implementation manners of the present invention or make equivalent substitutions, and any modification or equivalent substitution without departing from the spirit and scope of the present invention shall be covered by the protection scope of the claims of the present invention.

Claims

1. A low power consumption control method for a power transmission line sensor device, characterized in that: The specific process includes the following: Obtaining the remaining energy of the battery, and comparing the remaining energy of the battery with a first preset threshold and a second preset threshold; the first preset threshold is greater than the second preset threshold; If the remaining energy in the battery is greater than or equal to a first preset threshold, executing a first optimization strategy; If the remaining energy in the battery is less than the first preset threshold and greater than or equal to the second preset threshold, executing the second optimization strategy; If the remaining energy in the battery is less than the second preset threshold, executing the third optimization strategy; The first optimization strategy comprehensively considers transmission delay and transmission energy consumption, which is the normal working mode; The second optimization strategy considers transmission energy consumption and is a power saving mode; The third optimization strategy is the super power saving mode, which selects the channel with the highest mean historical revenue for data transmission and issues an early warning.

2. A low power consumption control method for a power transmission line sensor device according to claim 1, characterized in that: The first optimization strategy is: According to the first optimization objective formula, the weighted sum of energy consumption and delay is first calculated; A first historical revenue mean and a second historical revenue mean are calculated based on a weighted sum of energy consumption and delay; the first historical revenue mean is a historical revenue mean of different transmission power and channel combinations, and the second historical revenue mean is a historical revenue mean of different channels; Calculate the first total return based on the first historical return average; Selecting a transmission power and channel combination corresponding to the highest first total benefit for service data transmission; After the business data is transmitted, the corresponding transmission delay and transmission energy consumption are obtained for learning and updating.

3. A low power consumption control method for a power transmission line sensor device according to claim 2, characterized in that: The weighted sum of energy consumption and delay is first calculated according to the first optimization objective formula. The specific calculation formula is: ; Among them, V is the weight coefficient, which is used to achieve a compromise between transmission energy consumption and transmission delay; Represents the weighted sum of energy consumption and delay; is the remaining battery energy at the current moment, is the maximum battery capacity; is the transmission energy consumption; in, ; in, is the transmission delay; The transmission power is randomly selected, and the transmission power is set to multiple values ​​according to a fixed gradient. ; Indicates channels; Select the transmission power and channel combination corresponding to the highest total benefit for service data transmission, the expression is: ; in, is the first total income, is the transmission power and channel combination.

4. The low power consumption control method of a power transmission line sensor device according to claim 3, characterized in that: The first historical revenue mean is calculated based on the weighted sum of energy consumption and delay. The specific calculation expression is: ; make ; in, represents the first historical return mean; The second historical return mean is calculated based on the weighted sum of energy consumption and delay. The specific calculation expression is: ; make ; in, Represents the second historical return mean.

5. The low power consumption control method of a power transmission line sensor device according to claim 4, characterized in that: The first total benefit and the second total benefit are expressed as: in, is the business data size after normalization by the min-max method; t represents the current round, is the number of selections of the transmission power and channel combination; Select the number of times for the corresponding channel; represents the first total benefit, represents the second total benefit; After the service data is transmitted, the corresponding transmission delay and transmission energy consumption are obtained, and learning and updating are performed, specifically: The number of selections of transmission power and channel combination = +1, the corresponding number of channel selections = +1, round t=t+1; The first historical return mean and the second historical return mean are updated, and the expression is: In the formula, is the forgetting coefficient, which is between 0 and 1.

6. The low power consumption control method of a power transmission line sensor device according to claim 2, characterized in that: Transmission delay The specific expression is: In the formula, is the transmission delay, is the amount of business data, is the transmission capacity; Indicates channels; For wireless channels , the expression of transmission capacity is: In the formula, is the bandwidth, For the letter dry restlessness ratio; When the selected transmission power is The corresponding transmission energy consumption is for: 。 7. The low power consumption control method of a power transmission line sensor device according to claim 1, characterized in that: The second optimization side strategy is: According to the second optimization objective formula, the weighted sum of energy consumption and delay is first calculated; A first historical revenue mean and a second historical revenue mean are calculated based on a weighted sum of energy consumption and delay; the first historical revenue mean is a historical revenue mean of different transmission power and channel combinations, and the second historical revenue mean is a historical revenue mean of different channels; Calculate the first total return based on the first historical return average; Calculate the second total return based on the second historical return average; Based on historical data, the transmission power and channel combination corresponding to the highest first historical benefit mean is selected, and the input voltage of the communication unit is adjusted so that the transmission power of the communication unit is maintained at the selected transmission power; the optimization variable is adjusted to be only the channel, and the transmission power control is no longer performed. At this time, the channel with the largest second total benefit is selected for service data transmission; After the business data is transmitted, the parameters are updated.

8. A low power consumption control method for a power transmission line sensor device according to claim 7, characterized in that: According to the second optimization objective formula, the weighted sum of energy consumption and delay is first calculated. The specific calculation formula is: in, Represents the weighted sum of energy consumption and delay; V is the weight coefficient, which is used to achieve a compromise between transmission energy consumption and transmission delay; is the remaining battery energy at the current moment, is the maximum battery capacity; is the transmission energy consumption; in, The transmission power is randomly selected, and the transmission power is set to multiple values ​​according to a fixed gradient. ; is the transmission delay; The total benefit of the selection The largest channel is used for business data transmission, specifically: ; After the service data is transmitted, the parameters are updated, specifically: The corresponding channel selection times = +1, round t=t+1; The second historical return mean is updated, and the expression is: ; In the formula, is the forgetting coefficient, which is between 0 and 1.

9. The low power consumption control method of a power transmission line sensor device according to claim 1, characterized in that: The third optimization side strategy is: The communication unit sends corresponding signaling information to notify the operation and maintenance personnel to replace the battery or device. At the same time, the power supply only remains connected to the sensor unit and the communication unit, and the remaining module units are turned off. The channel with the highest historical return average is fixedly selected for data transmission until the battery or new device is replaced, or the battery is recharged to a high power state.

10. A low power consumption sensor device for a power transmission line, characterized in that: include: A sensor unit for real-time monitoring of external information; A control unit, powered by a power supply, configured to execute the low power consumption control method according to any one of claims 1 to 9 to manage the power supply; A communication unit, used for wirelessly transmitting information monitored by the sensor unit; The clock synchronization unit includes a main clock and a low-frequency clock. The main clock uses the main clock source of the control unit to provide a working clock for the control unit and peripheral circuits; the low-frequency clock is used to wake up the system in a dormant state; The sensor unit, the communication unit and the clock synchronization unit are all powered by a power supply; The sensor unit, communication unit, clock synchronization unit and control unit all use digital CMOS circuits; A circuit switch is provided between the sensor unit, the communication unit, the clock synchronization unit, the control unit and the power supply, and the circuit switch is used to control the power supply of each unit.