Voltage source matrix control method based on optical chip

By using ESP32-S3 microcontroller, DAC8568 chip and 74HC4051 data selector in the voltage source system, combined with the multi-agent depth deterministic strategy gradient algorithm, the accurate dynamic regulation of the voltage output of the optical chip is achieved, and the existing voltage source system is solved In high-precision optical chip applications, the problems of power output limitation, system complexity and large size, insufficient control flexibility and low integration have achieved high precision, strong flexibility and high integration voltage source matrix control.

CN119440155AActive Publication Date: 2025-02-14XIAN RUIPU OPTICAL LINK TECHNOLOGY CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202411533797.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-31
Publication Date
2025-02-14
Estimated Expiration
2044-10-31

AI Technical Summary

Technical Problem

In high-precision optical chip applications, existing voltage source systems have problems such as power output limitations, system complexity and large size, insufficient control flexibility and low integration, which are difficult to meet the needs of multi-channel and high-precision.

Method used

Using the ESP32-S3 microcontroller as the core controller, combined with the multi-chip DAC8568 chip and the 74HC4051 data selector, the multi-agent depth deterministic strategy gradient algorithm can realize the precise dynamic regulation of the voltage output of the optical chip. The system communicates with high speed through the SPI interface. , and real-time voltage regulation is realized based on external feedback.

Benefits of technology

It realizes high-precision voltage output of 64 independent channels, improves the accuracy and flexibility of the system, and can meet the needs of modern optical chips for precise voltage control. The system is compact and suitable for high-power, multi-channel optical chip application scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119440155A_ABST
    Figure CN119440155A_ABST
Patent Text Reader

Abstract

The invention discloses a voltage source matrix control method based on an optical chip, and the method comprises the following steps: S1, an ESP32-S3 single-chip microcomputer is used as a core controller, and is responsible for the data communication with eight DAC8568 chips through an SPI interface, and each DAC8568 chip comprises eight independent 16-bit precision voltage output channels; s2, channel selection is realized through a 74HC4051 data selector, an ESP32-S3 single chip microcomputer controls a selection signal of the 74HC4051 through GPIO (General Purpose Input / Output), and a specific DAC8568 chip and a voltage output channel are dynamically selected; s3, a voltage output value is adjusted in real time through an ESP32-S3 single chip microcomputer, a 16-bit digital signal is sent to a selected DAC8568 voltage output channel through an SPI interface, and the DAC8568 converts the digital signal into a corresponding analog voltage; s4, dynamically adjusting the voltage output value of each voltage output channel based on a multi-agent depth deterministic strategy gradient algorithm; and S5, all control and communication circuits are integrated on one PCB. According to the invention, high-precision voltage matrix control of the optical chip is realized by using ESP32-S3 and a multi-agent algorithm.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of high-precision voltage source matrix, and in particular to a voltage source matrix control method based on an optical chip. Background Art

[0002] In modern optoelectronic applications, the performance of optical chips is highly dependent on the accuracy and stability of the supply voltage. With the advancement of optical communication and optical measurement technology, higher requirements are placed on the voltage source of optical chips. Optical chips require a high-precision and stable voltage source to ensure that they can accurately perform the required functions during operation. For example, optical sensors and optical transmitters usually require the voltage source to provide very small voltage fluctuations to ensure signal accuracy and system reliability.

[0003] Existing voltage source systems are mostly used for general power supply applications, and their accuracy and power output range usually cannot meet the needs of high-precision optical chips. Traditional voltage source systems have certain limitations in output accuracy, power driving capability and system integration, especially in applications that require independent control of multiple channels. These problems are more prominent.

[0004] At present, there are some technical solutions that attempt to solve the demand for high-precision voltage sources. For example, using a DAC (digital-to-analog converter) to provide accurate voltage output is a common method. Among them, the DAC8568 chip, as a 16-bit precision digital-to-analog converter, can provide high-precision voltage output. Traditional solutions usually use a monolithic DAC to drive one or more output channels, but when higher power or multiple channel control is required, complex circuit design and additional components are often required to achieve the combination or switching of multiple DACs. For example, some existing solutions use multiple DAC8568 chips and achieve control of multiple channels through manual switching or simple selection circuits. However, these solutions may have problems such as complex control, large system size and insufficient power output in practical applications, which are particularly evident in high-density integration and high-power applications.

[0005] The implementation method of the prior art includes the use of DAC8568 chip. DAC8568 is a 16-bit high-precision DAC that can provide precise voltage output. It is usually used in voltage control of a single channel or a small number of channels. For applications requiring multi-channel control, multiple DAC8568 chips and complex selection circuits are usually required. Use SPI interface to control DAC: SPI (Serial Peripheral Interface) is a commonly used communication protocol for controlling DAC. Through the SPI interface, precise control of the DAC can be achieved, but when multiple DACs are required, additional selection circuits are usually required to switch different DACs.

[0006] Although the high-precision voltage source system in the prior art can provide a certain degree of voltage output accuracy, it still has significant defects in many aspects:

[0007] The first is power output limitation. Many traditional voltage source systems have difficulty providing sufficient output capacity in high-power applications. This may cause output voltage instability when driving high-power optical chips, affecting the performance of the optical chips.

[0008] The second is system complexity and volume. In existing solutions, using multiple DAC chips for multi-channel control often requires complex selection circuits, which not only increases the complexity of the system, but also makes the overall design larger. This design is not suitable for compact integrated application scenarios.

[0009] The third is the lack of control flexibility. The channel selection and control mechanism in the traditional voltage source system is relatively simple, and usually cannot achieve flexible channel switching and independent control. This limits the applicability of the system in multi-channel, high-precision applications.

[0010] Fourth, low integration. Existing technologies usually require multiple discrete components to achieve high-precision, multi-channel output, which leads to low system integration and makes it difficult to meet the requirements of modern optical chips for compact design and high integration.

[0011] Therefore, how to provide a voltage source matrix control method based on an optical chip is a problem that those skilled in the art urgently need to solve. Summary of the invention

[0012] One purpose of the present invention is to propose a voltage source matrix control method based on an optical chip. The present invention adopts an ESP32-S3 single-chip microcomputer as the core controller, combines multiple DAC8568 chips and 74HC4051 data selectors, and realizes accurate dynamic regulation of the voltage output of the optical chip through a multi-agent deep deterministic policy gradient algorithm. The system communicates at high speed through an SPI interface and realizes real-time voltage regulation based on external feedback, ensuring the voltage stability and accuracy of the optical chip in a complex working environment. The entire system is integrated on a PCB board, with the advantages of high integration, flexible regulation and stable operation, and is particularly suitable for high-power, multi-channel optical chip application scenarios.

[0013] A voltage source matrix control method based on an optical chip according to an embodiment of the present invention comprises the following steps:

[0014] S1, using ESP32-S3 microcontroller as the core controller, responsible for data communication with eight DAC8568 chips through the SPI interface. The DAC8568 chip includes 8 independent 16-bit precision voltage output channels, a total of 64 voltage output channels;

[0015] S2. Channel selection is realized through the 74HC4051 data selector. The ESP32-S3 microcontroller controls the selection signal of the 74HC4051 data selector through GPIO to dynamically select a specific DAC8568 chip and voltage output channel.

[0016] S3, adjusting the voltage output value of each voltage output channel in real time through the ESP32-S3 single chip microcomputer, sending a 16-bit digital signal to the selected DAC8568 voltage output channel through the SPI interface, and the DAC8568 converts the digital signal into a corresponding analog voltage and outputs it through the corresponding voltage output channel;

[0017] S4, based on the multi-agent deep deterministic policy gradient algorithm, performs real-time analysis based on external environment feedback and the operating status of the optical chip, and dynamically adjusts the voltage output value of each voltage output channel;

[0018] S5. Integrate all control and communication circuits on a single PCB board.

[0019] Optionally, the ESP32-S3 single-chip microcomputer communicates data with eight DAC8568 chips through a full-duplex SPI interface, transmitting a 16-bit digital signal each time.

[0020] Optionally, the ESP32-S3 single chip microcomputer controls the 3-bit selection signal of the 74HC4051 data selector through GPIO to achieve dynamic selection and switching of eight DAC8568 chips and each voltage output channel.

[0021] Optionally, the ESP32-S3 microcontroller sends a 16-bit digital signal to the voltage output channel of the selected DAC8568 chip through the SPI interface, and the output voltage range is set by an external reference voltage.

[0022] Optionally, the S4 specifically includes:

[0023] S41. Define an agent for each voltage output channel. The agent constructs a state space s according to the real-time feedback signal of the voltage output. t , the state space s t Including voltage output value, external environment feedback and the operating status of the optical chip;

[0024] S42. Design an action space a for each agent t , the action space a t Determine the adjustment amount of voltage output, each action corresponds to the increase or decrease operation of the voltage output channel;

[0025] S43. Design a reward function R based on multi-dimensional factors for each agentt , the reward function R t To measure the accuracy and stability of voltage output:

[0026]

[0027] Among them, V target Indicates the target voltage value, V output represents the actual voltage output value, ∈ and δ represent smoothing factors, exp represents the exponential function, E stability represents the stability measure of the voltage output, γ 1 , γ 2 and γ 3 represents the weight parameter, Indicates the rate of change of voltage output over time, ΔV output represents the voltage change rate, n represents the number of agents involved in voltage control, and p, q, and r represent the regulation index;

[0028] S44, based on the policy network μ(s t |θ) and Q network The strategy network is used to generate a voltage regulation strategy, and the Q network is used to evaluate the value of each action;

[0029] S45. Share the experience pool among multiple agents through the deep deterministic policy gradient algorithm to update the strategy:

[0030]

[0031] Among them, θ represents the parameters of the policy network, η represents the learning rate, and T represents the total number of time steps in the policy network training. represents the gradient of the policy network, b(s t ) represents the baseline function, |a t -μ9s t |θ represents action a t And the policy network predicts the action μ(s t |θ),∈ 1 and v 2 represents the smoothing factor, σ t represents the uncertainty of the action, σ target represents the target uncertainty, R i (s t ,a t ) represents the gradient of the reward function of agent i, represents the parameters of agent i, represents the loss function, β i Represents an adjustment item. Representation parameters The gradient of

[0032] S46. The intelligent agent dynamically adjusts the action strategy according to the external environment feedback and global information. Each intelligent agent adjusts the voltage output value according to the global information of the experience pool.

[0033] Optionally, the control and communication circuit integrated on the PCB board specifically includes an ESP32-S3 single-chip microcomputer, a DAC8568 chip, a 74HC4051 data selector and a power management module.

[0034] The beneficial effects of the present invention are:

[0035] First of all, the present invention uses ESP32-S3 single-chip microcomputer as the core controller to communicate with multiple DAC8568 chips, and realizes high-precision voltage output of 64 independent channels. Compared with the traditional voltage source system, the present invention has higher accuracy and flexibility, and can meet the needs of modern optical chips for precise voltage control. In particular, full-duplex communication is carried out through the SPI interface, and 16-bit digital signals are transmitted each time, which ensures that the system can adjust the voltage output in real time and efficiently, and ensures the response speed and stability of the system.

[0036] In addition, through the dynamic selection mechanism of the 74HC4051 data selector, the present invention can flexibly control the output voltage of each channel and realize independent control and real-time adjustment of multiple voltage channels. Combined with the GPIO control selection signal, the system can dynamically adjust the output channel as needed in complex application scenarios, thereby improving the adaptability and expansion capability of the system. The system also performs fine adjustment through an external reference voltage, so that the output voltage range can be flexibly adapted to different application requirements.

[0037] By introducing a multi-agent deep deterministic policy gradient algorithm, the present invention can analyze and adjust the voltage value of the voltage output channel in real time based on external environment feedback and the operating status of the optical chip. This algorithm can utilize the collaborative learning mechanism of multiple agents to optimize the voltage output strategy, and through the global information sharing of the experience pool, ensure the stability and accuracy of the voltage on a global scale. The algorithm can also make adaptive adjustments based on complex reward functions to improve the control accuracy of the system in a dynamic environment, and is particularly suitable for optical chip application scenarios that require high precision and low volatility.

[0038] Finally, by integrating the control and communication circuits on a PCB, the present invention realizes a compact integrated design, greatly reduces the volume of the system, and improves the integration and reliability of the system. This integrated design is not only suitable for high-density optical chip application scenarios, but also ensures the stability and continuous power supply capability of the system under high power conditions through the power management module, thereby ensuring the long-term operation and reliability of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0040] Figure 1 This is a flow chart of a voltage source matrix control method based on an optical chip proposed by the present invention;

[0041] Figure 2 The present invention provides a flow chart for dynamically adjusting the voltage output value of a voltage source matrix control method based on an optical chip. DETAILED DESCRIPTION

[0042] The present invention will now be described in further detail with reference to the accompanying drawings. These drawings are simplified schematic diagrams, which only illustrate the basic structure of the present invention in a schematic manner, and therefore only show the components related to the present invention.

[0043] refer to Figure 1 and Figure 2 , a voltage source matrix control method based on an optical chip, comprising the following steps:

[0044] S1, using ESP32-S3 microcontroller as the core controller, responsible for data communication with eight DAC8568 chips through the SPI interface. The DAC8568 chip includes 8 independent 16-bit precision voltage output channels, a total of 64 voltage output channels;

[0045] S2. Channel selection is realized through the 74HC4051 data selector. The ESP32-S3 microcontroller controls the selection signal of the 74HC4051 data selector through GPIO to dynamically select a specific DAC8568 chip and voltage output channel.

[0046] S3, adjusting the voltage output value of each voltage output channel in real time through the ESP32-S3 single chip microcomputer, sending a 16-bit digital signal to the selected DAC8568 voltage output channel through the SPI interface, and the DAC8568 converts the digital signal into a corresponding analog voltage and outputs it through the corresponding voltage output channel;

[0047] S4, based on the multi-agent deep deterministic policy gradient algorithm, performs real-time analysis based on external environment feedback and the operating status of the optical chip, and dynamically adjusts the voltage output value of each voltage output channel;

[0048] S5. Integrate all control and communication circuits on a single PCB board.

[0049] In this implementation, the ESP32-S3 microcontroller communicates data with eight DAC8568 chips via a full-duplex SPI interface, transmitting a 16-bit digital signal each time.

[0050] In this implementation, the ESP32-S3 microcontroller controls the 3-bit selection signal of the 74HC4051 data selector through GPIO to achieve dynamic selection and switching of eight DAC8568 chips and each voltage output channel.

[0051] In this implementation, the ESP32-S3 microcontroller sends a 16-bit digital signal to the voltage output channel of the selected DAC8568 chip via the SPI interface, and the output voltage range is set by an external reference voltage.

[0052] In this implementation, S4 specifically includes:

[0053] S41. Define an agent for each voltage output channel. The agent constructs a state space s according to the real-time feedback signal of the voltage output. t , the state space s t Including voltage output value, external environment feedback and the operating status of the optical chip;

[0054] S42. Design an action space a for each agent t , the action space a t Determine the adjustment amount of voltage output, each action corresponds to the increase or decrease operation of the voltage output channel;

[0055] S43. Design a reward function R based on multi-dimensional factors for each agent t , the reward function R t To measure the accuracy and stability of voltage output:

[0056]

[0057] Among them, V target Indicates the target voltage value, V output represents the actual voltage output value, ∈ and δ represent smoothing factors, exp represents the exponential function, E stability represents the stability measure of the voltage output, γ 1 , γ 2 and γ 3 represents the weight parameter, Indicates the rate of change of voltage output over time, ΔV output represents the voltage change rate, n represents the number of agents involved in voltage control, and p, q, and r represent the regulation index;

[0058] S44, based on the policy network μ(s t|θ) and Q network The strategy network is used to generate a voltage regulation strategy, and the Q network is used to evaluate the value of each action;

[0059] S45. Share the experience pool among multiple agents through the deep deterministic policy gradient algorithm to update the strategy:

[0060]

[0061] Among them, θ represents the parameters of the policy network, η represents the learning rate, and T represents the total number of time steps in the policy network training. represents the gradient of the policy network, b(s t ) represents the baseline function, |a t -μ(s t |θ represents action a t And the policy network predicts the action μ(s t |θ),∈ 1 and ∈ 2 represents the smoothing factor, σ t represents the uncertainty of the action, σ target represents the target uncertainty, R i (s t ,a t ) represents the gradient of the reward function of agent i, represents the parameters of agent i, represents the loss function, β i Represents an adjustment item. Representation parameters The gradient of

[0062] S46. The intelligent agent dynamically adjusts the action strategy according to the external environment feedback and global information. Each intelligent agent adjusts the voltage output value according to the global information of the experience pool.

[0063] In this implementation manner, the control and communication circuit integrated on the PCB board specifically includes an ESP32-S3 single-chip microcomputer, a DAC8568 chip, a 74HC4051 data selector, and a power management module.

[0064] Embodiment 1:

[0065] In order to verify the feasibility of the present invention in implementation, the present invention is applied to the production line of a large optical communication equipment factory. There are multiple high-power optical chips in the production line that require precise voltage control. The traditional voltage source system uses a single-chip DAC control, the system has a limited number of voltage output channels, and the voltage regulation response time is slow, which cannot adapt to complex production requirements. In the actual production application of the factory, due to the extremely high voltage accuracy requirements of the optical chip, the traditional system is difficult to provide sufficient voltage stability, resulting in an error rate of up to 5% in the operation of the optical chip. This error is unacceptable in optical sensors and optical communication equipment with high precision requirements, and directly affects the performance of the optical chip and the factory qualification rate of the product.

[0066] In order to solve the above problems, the manufacturer decided to adopt the voltage source matrix control method based on optical chip of the present invention. In the actual application scenario, the ESP32-S3 microcontroller is used as the core controller to communicate with eight DAC8568 chips through the SPI interface to form 64 independent voltage output channels. Each channel can accurately control the 16-bit voltage output, covering the voltage requirement range of the device. In this scenario, ESP32-S3 controls the 74HC4051 data selector through the GPIO interface, selects the output channel of the DAC8568 chip in real time, and ensures that multiple channels can flexibly and independently perform voltage regulation.

[0067] To verify the effectiveness of this method, the factory conducted a three-month actual test, focusing on the voltage stability of the optical chip and the overall working efficiency of the equipment.

[0068] Table 1 Performance comparison between traditional method and voltage source matrix control method based on optical chip

[0069] Test items Traditional methods Method of the present invention Voltage error rate 5.0% 0.5% Voltage regulation response time 20ms 3ms Voltage fluctuation range 0.025V 0.005V Product qualification rate 92.0% 98.5% Equipment failure rate 4 times 2 times Installation and maintenance costs 150,000 yuan / year 100,000 yuan / year Production line space 50 sqm 42.5 sqm Continuous working time 72 hours 120 hours

[0070] Table 1 above shows the differences between the voltage source matrix control system based on optical chips of the present invention and the traditional voltage source system in multiple key performance indicators. First, in terms of voltage error rate, the error rate of the traditional system is 5.0%, while the system of the present invention significantly reduces the error rate to only 0.5% through the dynamic regulation of the multi-agent deep deterministic policy gradient algorithm. This shows that the system of the present invention can provide higher stability and reliability in voltage accuracy.

[0071] In terms of voltage adjustment response time, the traditional system has a slow response speed, requiring an average of 20 milliseconds to adjust the voltage, while the system of the present invention shortens the response time to 3 milliseconds through an efficient control and communication architecture, greatly improving the real-time performance of the system. This improvement is of great significance for quickly responding to changes in the external environment and ensuring the stable operation of the optical chip.

[0072] The voltage fluctuation range is also a major advantage of the system of the present invention. The voltage fluctuation range of the traditional system is 0.025V, while the system of the present invention controls the fluctuation within 0.005V, further ensuring the stability of the voltage output. This is crucial for the high-precision working requirements of the optical chip and can reduce the impact of voltage fluctuations on chip performance.

[0073] In terms of product qualification rate, the improvement of the system of the present invention is also very obvious. The qualification rate of the traditional system is 92.0%, while the system of the present invention increases the qualification rate to 98.5% through more precise voltage control, greatly reducing the number of unqualified products and significantly improving production efficiency and product quality.

[0074] The reduction in equipment failure rate reflects the reliability of the system in the long term. The traditional system has an average of 4 failures per month, while the system of the present invention reduces the failure rate to 2, which means that the operation of the equipment is more stable, reducing maintenance costs and downtime.

[0075] The system of the present invention also reduces installation and maintenance costs. The annual maintenance cost of the traditional system is about 150,000 yuan, while the cost of the system of the present invention is 100,000 yuan, saving 33% of the cost. Through the highly integrated design, the maintenance of the equipment is easier and the potential failure points are reduced.

[0076] In addition, the system of the present invention also shows a higher integration in terms of the space occupied by the production line. The traditional system occupies 50 square meters, while the system of the present invention reduces the space occupied to 42.5 square meters by integrating the control and communication circuits on a PCB board, reducing the space requirement by about 15%. This provides more flexibility for the layout of the production line and the installation of other equipment.

[0077] The system of the present invention also shows obvious advantages in terms of continuous working time. The traditional system has voltage fluctuations and failures after 72 hours of continuous working, while the system of the present invention can work continuously for 120 hours under high load conditions, further verifying its stability under long-term operation.

[0078] From the above analysis, it can be seen that the voltage source matrix control system of the present invention is superior to the traditional system in multiple key performance indicators, showing the advantages of higher voltage accuracy, faster response speed, more stable operation, lower maintenance cost and higher integration, which greatly improves the working efficiency of the optical chip and the overall reliability of the system.

[0079] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A voltage source matrix control method based on an optical chip, characterized in that: The steps include: S1, using ESP32-S3 microcontroller as the core controller, responsible for data communication with eight DAC8568 chips through the SPI interface. The DAC8568 chip includes 8 independent 16-bit precision voltage output channels, a total of 64 voltage output channels; S2. Channel selection is realized through the 74HC4051 data selector. The ESP32-S3 microcontroller controls the selection signal of the 74HC4051 data selector through GPIO to dynamically select a specific DAC8568 chip and voltage output channel. S3, adjusting the voltage output value of each voltage output channel in real time through the ESP32-S3 single chip microcomputer, sending a 16-bit digital signal to the selected DAC8568 voltage output channel through the SPI interface, and the DAC8568 converts the digital signal into a corresponding analog voltage and outputs it through the corresponding voltage output channel; S4, based on the multi-agent deep deterministic policy gradient algorithm, performs real-time analysis based on external environment feedback and the operating status of the optical chip, and dynamically adjusts the voltage output value of each voltage output channel; S5. Integrate all control and communication circuits on a single PCB board.

2. A voltage source matrix control method based on an optical chip according to claim 1, characterized in that: The ESP32-S3 microcontroller communicates data with eight DAC8568 chips through a full-duplex SPI interface, transmitting 16-bit digital signals each time.

3. The voltage source matrix control method based on an optical chip according to claim 1, characterized in that: The ESP32-S3 microcontroller controls the 3-bit selection signal of the 74HC4051 data selector through GPIO to achieve dynamic selection and switching of eight DAC8568 chips and each voltage output channel.

4. The voltage source matrix control method based on an optical chip according to claim 1, characterized in that: The ESP32-S3 microcontroller sends a 16-bit digital signal to the voltage output channel of the selected DAC8568 chip through the SPI interface, and the output voltage range is set by the external reference voltage.

5. The voltage source matrix control method based on an optical chip according to claim 1, characterized in that: The S4 specifically includes: S41. Define an agent for each voltage output channel. The agent constructs a state space s according to the real-time feedback signal of the voltage output. t , the state space s t Including voltage output value, external environment feedback and the operating status of the optical chip; S42. Design an action space a for each agent t , the action space a t Determine the adjustment amount of voltage output, each action corresponds to the increase or decrease operation of the voltage output channel; S43. Design a reward function R based on multi-dimensional factors for each agent t , the reward function R t To measure the accuracy and stability of voltage output: Among them, V target Indicates the target voltage value, V output represents the actual voltage output value, ∈ and δ represent smoothing factors, exp represents the exponential function, E stability represents the stability measure of the voltage output, γ1, γ2 and γ3 represent weight parameters, Indicates the rate of change of voltage output over time, ΔV output represents the voltage change rate, n represents the number of agents involved in voltage control, and p, q, and r represent the regulation index; S44, based on the policy network μ(s t |θ) and Q network The strategy network is used to generate a voltage regulation strategy, and the Q network is used to evaluate the value of each action; S45. Share the experience pool among multiple agents through the deep deterministic policy gradient algorithm to update the strategy: Among them, θ represents the parameters of the policy network, η represents the learning rate, and T represents the total number of time steps in the policy network training. represents the gradient of the policy network, b(s t ) represents the baseline function, |a t -μ(s t |θ represents action a t And the policy network predicts the action μ(s t |θ), ∈1 and ∈2 represent the smoothing factor, σ t represents the uncertainty of the action, σ target represents the target uncertainty, R i (s t ,a t ) represents the gradient of the reward function of agent i, represents the parameters of agent i, represents the loss function, β i Represents an adjustment item. Representation parameters The gradient of S46. The intelligent agent dynamically adjusts the action strategy according to the external environment feedback and global information. Each intelligent agent adjusts the voltage output value according to the global information of the experience pool.

6. The voltage source matrix control method based on an optical chip according to claim 1, characterized in that: The control and communication circuit integrated on the PCB board specifically includes an ESP32-S3 single-chip microcomputer, a DAC8568 chip, a 74HC4051 data selector and a power management module.

Citation Information

Patent Citations

  • Distributed feed-forward envelope tracking system

    CN110537327A

  • Storage and calculation integrated chip and DAC multiplexing control method thereof

    CN111611196A

  • Multi-resolution mode analog-to-digital conversion method and circuit

    CN118316451A

  • Power distribution network agent group cooperative regulation and control method and system based on deep reinforcement learning

    CN118611038A

  • Data driver of organic electroluminescence display device

    KR100666644B1