A dynamic power management system and method based on IPU chip
By designing a dynamic power management system on the IPU chip, collecting load information and temperature in real time, evaluating power scores and adjusting power output, the problem of low power resource utilization efficiency in the existing technology is solved, and high efficiency under different workloads is achieved Power management.
Patent Information
- Application Number
- CN202410888006.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-04
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2044-07-04
AI Technical Summary
The existing chip power management technology cannot adapt to the complex and changeable working environment in IPU chip processing data, resulting in inefficient utilization of power resources.
A dynamic power management system based on IPU chip is designed, including power output module, acquisition module, temperature detection module, scoring module and control module. By collecting the load information and temperature of the processing unit in real time, the power is evaluated and based on the score. Adjust the power output to realize dynamic power distribution.
It realizes flexible distribution of electricity under different workloads, improves the overall energy efficiency of the system, ensures that while meeting performance requirements, the minimum power consumption is minimized and the overall system efficiency is improved.
Smart Images

Figure CN118409645B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of chip power management, and in particular to a dynamic power management system and method based on an IPU chip. Background Art
[0002] IPU (Intelligent Processing Unit) usually has high computing power and specialized hardware accelerators for processing specific types of workloads, such as machine learning, graphics processing, etc. Since these tasks have high computing performance requirements, power management needs to dynamically adjust to meet the power requirements of its computing complexity while ensuring that the IPU has sufficient power support.
[0003] At present, traditional power management systems usually adopt static or rule-based methods to deal with different workloads and performance requirements, which lack sufficient intelligence. This means that they cannot adapt to system changes in real time and cannot dynamically adjust power allocation to meet actual computing needs. Since this fixed power management strategy cannot effectively adapt to complex and changing working environments, it leads to inefficient use of power resources.
[0004] Therefore, it is urgent to invent a practical power dynamic management technology for IPU chips to solve the problem that the existing chip power management technology cannot adapt to the complex and changeable working environment of the IPU chip in processing data, resulting in inefficient utilization of power resources. Summary of the invention
[0005] In view of this, the present invention proposes a dynamic power management system and method based on the IPU chip, aiming to solve the problem that the current chip power management technology cannot adapt to the complex and changeable working environment of the IPU chip in processing data, resulting in inefficient utilization of power resources.
[0006] The present invention proposes a dynamic power management system based on an IPU chip, comprising:
[0007] A power output module, electrically connected to the power supply and each processing unit in the IPU chip, respectively, the power output module is used to obtain electric energy from the power supply, and the power output module is also used to output electric energy to each processing unit;
[0008] A collection module, electrically connected to each of the processing units, and used to collect load information of each of the processing units;
[0009] A temperature detection module, electrically connected to each of the processing units, and used to detect the temperature of each of the processing units;
[0010] A scoring module, electrically connected to the acquisition module and the temperature detection module respectively, and used for evaluating the power demand score of each processing unit according to the load information and temperature of each processing unit;
[0011] A control module is electrically connected to the scoring module and the power output module respectively, and the control module is used to establish a power supply level for each processing unit according to the power demand score of each processing unit, and adjust the power output amount of the power output module to each processing unit according to the power supply level; wherein,
[0012] The control module is also used to obtain the real-time power supply level Q of the processing unit;
[0013] The control module is further used to preset a first preset power supply level Q1 and a second preset power supply level Q2, and the control module is further used to preset a first preset output power, a second preset output power and a third preset output power, and Q1<Q2, the first preset output power<the second preset output power<the third preset output power;
[0014] The control module is further configured to select a corresponding preset output power as the output power of the processing unit according to the relationship between the real-time power supply level Q of the processing unit and each preset power supply level:
[0015] When Q=Q1, the control module selects the first preset output power as the output power of the processing unit;
[0016] When Q1<Q≤Q2, the control module selects the second preset output power as the output power of the processing unit;
[0017] When Q>Q2, the control module selects the third preset output power as the output power of the processing unit.
[0018] Furthermore, the scoring module is further used to obtain the real-time task processing quantity L of the processing unit, and determine that the processing unit is in a dormant state according to the relationship between the real-time task processing quantity L and the preset task processing quantity L0:
[0019] When L<L0, the scoring module determines that the processing unit is in a dormant state, determines that the processing unit does not need to be powered, and does not evaluate the power requirement score of the processing unit;
[0020] When L≥L0, the scoring module determines that the processing unit is in working state, determines that the processing unit needs to be powered, and evaluates the power requirement score of the processing unit according to the relationship between the real-time task processing number L and the preset task processing number L0.
[0021] Furthermore, when the scoring module determines that the processing unit is in working state and evaluates the power demand score of the processing unit, it includes:
[0022] The scoring module is further used to obtain a task processing quantity difference △L between the real-time task processing quantity L and a preset task processing quantity L0, △L=L-L0, and the scoring module is further used to compare the task processing quantity difference △L with the preset task processing quantity difference, and select a corresponding preset score as the power demand score of the processing unit according to the comparison result;
[0023] The scoring module is further used to preset a first preset task processing quantity difference △L1 and a second preset task processing quantity difference △L2, and the scoring module is further used to preset a first preset score M1, a second preset score M2 and a third preset score M3, and △L1<△L2, M1<M2<M3;
[0024] When △L≤△L1, the first preset score M1 is selected as the power demand score of the processing unit;
[0025] When △L1<△L≤△L2, the second preset score M2 is selected as the power demand score of the processing unit;
[0026] When △L>△L2, the third preset score M3 is selected as the power demand score of the processing unit;
[0027] When the scoring module selects the i-th preset score Mi as the power demand score of the processing unit, i=1, 2, 3, and determines that the power demand score of the processing unit is W, and sets W=Mi.
[0028] Further, when the scoring module selects the i-th preset score Mi as the power demand score of the processing unit and determines that the power demand score of the processing unit is W, it includes:
[0029] The scoring module is also used to obtain the total amount K of the real-time processing task data of the processing unit, and the scoring module is also used to determine whether to adjust the power demand score W of the processing unit according to the relationship between the total amount K of the real-time processing task data and the preset full-load data processing amount K0;
[0030] When K<K0, the scoring module determines not to adjust the power demand score W of the processing unit;
[0031] When K≥K0, the scoring module determines that the processing unit is in full load or overload state, and adjusts the power demand score W of the processing unit according to the relationship between the total amount of real-time processing task data K and the preset full load data processing amount K0.
[0032] Furthermore, when the scoring module determines whether the processing unit is in a full load or overload state and adjusts the power demand score W of the processing unit, it includes:
[0033] The scoring module is also used to obtain the data volume difference △K between the total amount of real-time processing task data K and the preset full-load data processing volume K0, △K=K-K0; the scoring module is also used to compare the data volume difference △K with the preset data volume difference, and select a corresponding adjustment coefficient according to the comparison result to adjust the power demand score W of the processing unit;
[0034] The scoring module is further used to pre-set a first preset data volume difference △K1 and a second preset data volume difference △K2, and the scoring module is further used to pre-set a first preset adjustment coefficient N1, a second preset adjustment coefficient N2 and a third preset adjustment coefficient N3, and △K1<△K2, N1<N2<N3<0.5;
[0035] When △K≤△K1, the first preset adjustment coefficient N1 is selected to adjust the power demand score W of the processing unit;
[0036] When △K1<△K≤△K2, the second preset adjustment coefficient N2 is selected to adjust the power demand score W of the processing unit;
[0037] When △K>△K2, the third preset adjustment coefficient N3 is selected to adjust the power demand score W of the processing unit;
[0038] When the scoring module selects the i-th preset adjustment coefficient Ni to adjust the power demand score W of the processing unit, i=1, 2, 3, and determines that the adjusted power demand score of the processing unit is W1, and sets W1=W×Ni.
[0039] Further, when the scoring module selects the i-th preset adjustment coefficient Ni to adjust the power demand score W of the processing unit and determines that the adjusted power demand score of the processing unit is W1, it includes:
[0040] The scoring module is also used to obtain the real-time power consumption J of the processing unit.
[0041] The scoring module is further used to preset a first preset power consumption J1 and a second preset power consumption J2, and the scoring module is further used to preset a first preset correction coefficient B1, a second preset correction coefficient B2 and a third preset correction coefficient B3, and J1<J2, B1<B2<B3<0.3;
[0042] The scoring module is also used to compare the real-time power consumption of the processing unit with each preset power consumption, and select a corresponding correction coefficient according to the comparison result to correct the adjusted power demand score W1 of the processing unit; wherein,
[0043] When J≤J1, the third preset correction coefficient B3 is selected to correct the adjusted power demand score W1 of the processing unit;
[0044] When J1<J≤J2, the second preset correction coefficient B2 is selected to correct the adjusted power demand score W1 of the processing unit;
[0045] When J>J2, the first preset correction coefficient B1 is selected to correct the adjusted power demand score W1 of the processing unit;
[0046] When the scoring module selects the i-th preset correction coefficient Bi to correct the adjusted power demand score W1 of the processing unit, i=1,2,3, and determines that the corrected power demand score of the processing unit is W2, and sets W2=W1×Bi.
[0047] Further, when the scoring module selects the i-th preset correction coefficient Bi to correct the adjusted power demand score W1 of the processing unit and determines that the corrected power demand score of the processing unit is W2, it includes:
[0048] The scoring module is also used to obtain the real-time temperature H of the processing unit, and determine whether to calibrate the power demand score W2 of the processing unit after correction according to the relationship between the real-time temperature H and the preset temperature H0;
[0049] When H<H0, the scoring module does not correct the power demand score W2 of the processing unit;
[0050] When H≥H0, the scoring module determines that the temperature of the processing unit exceeds the preset temperature, and corrects the corrected power demand score W2 of the processing unit according to the relationship between the real-time temperature H and the preset temperature H0.
[0051] Furthermore, when the scoring module determines that the temperature of the processing unit exceeds a preset temperature and corrects the corrected power demand score W2 of the processing unit, it includes:
[0052] The scoring module is further used to obtain a temperature difference △H between the real-time temperature H and a preset temperature H0, △H=H-H0, and the scoring module is further used to compare the temperature difference △H with the preset temperature difference, and select a corresponding correction coefficient according to the comparison result to correct the corrected power demand score W2 of the processing unit;
[0053] The scoring module is further used to preset a first preset temperature difference △H1 and a second preset temperature difference △H2, and the scoring module is further used to preset a first preset correction coefficient C1, a second preset correction coefficient C2 and a third preset correction coefficient C3, and △H1<△H2, C1<C2<C3<0.2;
[0054] When △H≤△H1, the third preset correction coefficient C3 is selected to correct the modified power demand score W2 of the processing unit;
[0055] When △H1<△H≤△H2, the second preset correction coefficient C2 is selected to correct the modified power demand score W2 of the processing unit;
[0056] When △H>△H2, the first preset correction coefficient C1 is selected to correct the modified power demand score W2 of the processing unit;
[0057] When the scoring module selects the i-th preset correction coefficient Ci to correct the modified power demand score W2 of the processing unit, i=1,2,3, and determines that the corrected power demand score of the processing unit is W3, and sets W3=W2×Ci.
[0058] Furthermore, when the control module is used to establish a power supply level for each processing unit according to the power demand score of each processing unit, it includes:
[0059] The control module is also used to obtain a corrected power demand score W3 of the processing unit;
[0060] The control module is further used to compare the power demand score W3 with a preset power demand score, and establish the power supply level of the processing unit according to the comparison result:
[0061] The control module is further used to preset a first preset power demand score T1 and a second preset power demand score T2, and the control module is further used to preset a first preset level A1, a second preset level A2 and a third preset level A3, and T1<T2, A1<A2<A3;
[0062] When W3≤T1, the first preset level A1 is selected to establish a power supply level for the processing unit;
[0063] When T1<W3≤T2, the second preset level A2 is selected to establish a power supply level for the processing unit;
[0064] When W3>T2, the third preset level A3 is selected to establish a power supply level for the processing unit;
[0065] When the control module selects the i-th preset level Ai to establish the power supply level for the processing unit, i=1, 2, 3, and determines that the power supply level of the processing unit is Q, and sets Q=Ai.
[0066] Compared with the prior art, the beneficial effect of a dynamic power management system based on an IPU chip of the present invention is that through the power output module, the system can adjust the power output in real time according to the needs of each processing unit to realize dynamic power distribution. This helps to flexibly distribute electric energy under different workloads and improve the overall energy efficiency of the system. Secondly, by connecting the acquisition module and the temperature detection module to each processing unit respectively, the load information and temperature data of the processing unit can be collected in real time. This helps the subsequent scoring module to understand the working status of each processing unit more comprehensively and provide basic data for intelligent power management. At the same time, the processing unit is scored for power demand according to the load information and temperature of the processing unit through the scoring module. The control module then establishes the power supply level of the processing unit, allocates appropriate power resources to each processing unit, and realizes differentiated power supply. In addition, the control module presets the power supply level and output power, and dynamically adjusts according to actual needs. This helps to respond flexibly in different scenarios, ensures that power consumption is minimized while meeting performance requirements, and improves the efficiency of the overall system. Finally, the control module intelligently selects the corresponding preset output power according to the relationship between the real-time power supply level of the processing unit and the preset power supply level. This intelligent selection can accurately adjust power output under different workloads, thereby ensuring efficient use of power resources.
[0067] On the other hand, the present application also provides a dynamic power management method based on an IPU chip, comprising:
[0068] Acquire the power output of the power output module to each processing unit, the load information of each processing unit, and the temperature of each processing unit;
[0069] Evaluate the power demand score of each processing unit according to the load information and temperature of each processing unit;
[0070] A power supply level is established for each processing unit according to the power demand score of each processing unit, and the power output amount of the power output module to each processing unit is adjusted according to the power supply level.
[0071] It can be understood that the above-mentioned dynamic power management system and method based on IPU chip have the same beneficial effects and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0072] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present invention. Moreover, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:
[0073] Figure 1 A structural block diagram of a dynamic power management system based on an IPU chip provided in an embodiment of the present invention;
[0074] Figure 2 A flowchart of a dynamic power management method based on an IPU chip provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0075] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art. It should be noted that, in the absence of conflict, the embodiments of the present invention and the features described in the embodiments can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.
[0076] like Figure 1As shown, in some embodiments of the present application, this embodiment provides a dynamic power management system based on an IPU chip, including: a power output module, a collection module, a temperature detection module, a scoring module and a control module. The power output module is electrically connected to the power supply and each processing unit in the IPU chip, and the power output module is used to obtain the power of the power supply. The power output module is also used to output power to each processing unit. The collection module is electrically connected to each processing unit, and the collection module is used to collect the load information of each processing unit. The temperature detection module is electrically connected to each processing unit, and the temperature detection module is used to detect the temperature of each processing unit. The scoring module is electrically connected to the collection module and the temperature detection module, respectively, and the scoring module is used to evaluate the power demand score of each processing unit according to the load information and temperature of each processing unit. The control module is electrically connected to the scoring module and the power output module, respectively, and the control module is used to establish a power supply level for each processing unit according to the power demand score of each processing unit, and adjust the power output amount of the power output module to each processing unit according to the power supply level, wherein: the control module is also used to obtain the real-time power supply level Q of the processing unit. The control module is also used to pre-set a first preset power supply level Q1 and a second preset power supply level Q2. The control module is also used to pre-set a first preset output power, a second preset output power and a third preset output power, and Q1<Q2, the first preset output power<second preset output power<third preset output power. The control module is also used to select the corresponding preset output power as the output power of the processing unit according to the relationship between the real-time power supply level Q of the processing unit and each preset power supply level: when Q=Q1, the control module selects the first preset output power as the output power of the processing unit. When Q1<Q≤Q2, the control module selects the second preset output power as the output power of the processing unit. When Q>Q2, the control module selects the third preset output power as the output power of the processing unit.
[0077] It can be seen that intelligent power management is achieved through the synergy of the power output module, the acquisition module, the temperature detection module, the scoring module and the control module. The power output module obtains the power of the power supply and intelligently outputs power to each processing unit by connecting the power supply and the processing unit in the IPU chip. The acquisition module is responsible for collecting the load information of each processing unit, while the temperature detection module is used to monitor the temperature of each processing unit. The scoring module comprehensively considers the load information and temperature and scores the power demand of each processing unit. The control module establishes the power supply level of the processing unit according to the power demand score, and dynamically adjusts the power output of the power output module to each processing unit according to the power supply level. At the same time, the control module introduces the concepts of real-time power supply level and preset power supply level, and intelligently selects the corresponding preset output power according to these level relationships to more flexibly meet the power demand of different processing units.
[0078] It is understandable that by real-time monitoring and evaluation of the power demand score of each processing unit, the system can dynamically adjust the power output to optimize energy efficiency and minimize unnecessary power consumption. At the same time, the introduction of the concept of real-time power supply level and preset power supply level makes the power supply system more intelligent when supplying power according to the IPU chip, and can flexibly adjust the power output under different workloads, thereby improving the flexibility and adaptability of the power supply system.
[0079] In some embodiments of the present application, the scoring module is also used to obtain the number of real-time task processing L of the processing unit, and judge that the processing unit is in a dormant state based on the relationship between the number of real-time task processing L and the preset number of task processing L0: when L<L0, the scoring module judges that the processing unit is in a dormant state, judges that the processing unit does not need to be powered, and does not evaluate the power demand score of the processing unit. When L≥L0, the scoring module judges that the processing unit is in a working state, judges that the processing unit needs to be powered, and evaluates the power demand score of the processing unit based on the relationship between the number of real-time task processing L and the preset number of task processing L0.
[0080] In some embodiments of the present application, the scoring module determines that the processing unit is in a working state and evaluates the power demand score of the processing unit, including: the scoring module is also used to obtain the task processing quantity difference △L between the real-time task processing quantity L and the preset task processing quantity L0, △L=L-L0, the scoring module is also used to compare the task processing quantity difference △L with the preset task processing quantity difference, and select the corresponding preset score as the power demand score of the processing unit according to the comparison result: wherein, the scoring module is also used to pre-set a first preset task processing quantity difference △L1 and a second preset task processing quantity difference △L2, and the scoring module is also used to pre-set a first preset score M1, a second preset score M2 and a third preset score M3, and △L1<△L2, M1<M2<M3.
[0081] When ΔL≤ΔL1, the first preset score M1 is selected as the power demand score of the processing unit.
[0082] When ΔL1<ΔL≤ΔL2, the second preset score M2 is selected as the power demand score of the processing unit.
[0083] When ΔL>ΔL2, the third preset score M3 is selected as the power demand score of the processing unit.
[0084] When the scoring module selects the i-th preset score Mi as the power demand score of the processing unit, i=1, 2, 3, and determines that the power demand score of the processing unit is W, and sets W=Mi.
[0085] It can be seen that the scoring module not only considers the load information and temperature of the processing unit, but also judges the working state of the processing unit based on the relationship between the number of real-time task processing and the preset number of task processing, and intelligently scores its power demand. When the number of real-time task processing is lower than the preset number of task processing, the scoring module determines that the processing unit is in a dormant state, does not need to be powered, and does not score its power demand. When the number of real-time task processing reaches or exceeds the preset number of task processing, the scoring module determines that the processing unit is in a working state, and compares the difference between the number of real-time task processing and the preset number of task processing, and selects the corresponding preset score as the power demand score.
[0086] It is understandable that by comparing the number of real-time task processing and the number of preset task processing, the scoring module can intelligently determine whether the processing unit is in a dormant state. This helps to avoid unnecessary power supply to the dormant processing unit, reduce power consumption, and improve energy efficiency. Secondly, the scoring module selects the corresponding preset score according to the difference in the number of real-time task processing, and realizes a dynamic power demand score. This enables the control module to more accurately adjust the power output according to the task load when scoring according to the power demand, so as to meet the real-time needs of the processing unit and improve the overall power utilization efficiency. In addition, the difference in the number of preset task processing and the corresponding preset score can be reasonably set in the design stage, so that the scoring module has strong flexibility for the working state of different processing units. This helps to adapt to the task changes in different application scenarios and realize a more flexible power management strategy. Finally, the scoring module selects the corresponding preset score according to the size of the difference in the number of task processing, so that the power demand score can be closer to the change of the actual task load. This helps to accurately control the power output under different workloads and balance the relationship between performance and power consumption.
[0087] In some embodiments of the present application, when the scoring module selects the i-th preset score Mi as the power demand score of the processing unit and determines that the power demand score of the processing unit is W, it includes: the scoring module is also used to obtain the total amount of real-time processing task data K of the processing unit, and the scoring module is also used to determine whether to adjust the power demand score W of the processing unit according to the relationship between the total amount of real-time processing task data K and the preset full-load data processing volume K0: when K<K0, the scoring module determines not to adjust the power demand score W of the processing unit. When K≥K0, the scoring module determines that the working state of the processing unit is full load or overload state, and adjusts the power demand score W of the processing unit according to the relationship between the total amount of real-time processing task data K and the preset full-load data processing volume K0.
[0088] In some embodiments of the present application, when the scoring module determines that the working state of the processing unit is full load or overload state, and adjusts the power demand score W of the processing unit, it includes: the scoring module is also used to obtain the data volume difference △K between the total amount of real-time processing task data K and the preset full load data processing volume K0, △K=K-K0. The scoring module is also used to compare the data volume difference △K with the preset data volume difference, and select the corresponding adjustment coefficient according to the comparison result to adjust the power demand score W of the processing unit, wherein: the scoring module is also used to pre-set the first preset data volume difference △K1 and the second preset data volume difference △K2, and the scoring module is also used to pre-set the first preset adjustment coefficient N1, the second preset adjustment coefficient N2 and the third preset adjustment coefficient N3, and △K1<△K2, N1<N2<N3<0.5.
[0089] When △K≤△K1, the first preset adjustment coefficient N1 is selected to adjust the power demand score W of the processing unit.
[0090] When △K1<△K≤△K2, the second preset adjustment coefficient N2 is selected to adjust the power demand score W of the processing unit.
[0091] When ΔK>ΔK2, the third preset adjustment coefficient N3 is selected to adjust the power demand score W of the processing unit.
[0092] When the scoring module selects the i-th preset adjustment coefficient Ni to adjust the power demand score W of the processing unit, i=1, 2, 3, and determines that the adjusted power demand score of the processing unit is W1, and sets W1=W×Ni.
[0093] It can be seen that the scoring module makes further intelligent adjustments to the power demand score of the processing unit, taking into account the relationship between the total amount of real-time processing task data and the preset full-load data processing volume, as well as the adjustment of the data volume difference. Specifically, after the scoring module selects the preset score, it will also determine whether to adjust the power demand score based on the relationship between the total amount of real-time processing task data and the preset full-load data processing volume. When the working state is full load or overload, the scoring module dynamically adjusts the power demand score based on the data volume difference between the total amount of real-time processing task data and the preset full-load data processing volume through a preset adjustment coefficient.
[0094] It can be understood that by comparing the total amount of real-time task data with the full-load data processing volume, the scoring module can intelligently determine whether the processing unit is in a full-load or overload state. In this state, adjusting the power demand score can more accurately reflect the working state of the processing unit, help avoid insufficient or excessive power supply, and improve the stability of the chip during power supply. Secondly, by setting the preset adjustment coefficient range between 0 and 0.5, excessive adjustment is avoided, which enables the control module to flexibly adjust the power output under different workloads and balance the relationship between performance and power consumption. Through the intelligent power demand score adjustment mechanism, the total amount of real-time task processing data and the full-load situation of the processing unit are carefully considered, which further improves the intelligent perception of the power management system for the working state and realizes more accurate and flexible power management.
[0095] In some embodiments of the present application, when the scoring module selects the i-th preset adjustment coefficient Ni to adjust the power demand score W of the processing unit, and determines that the adjusted power demand score of the processing unit is W1, it includes: the scoring module is also used to obtain the real-time power consumption J of the processing unit, the scoring module is also used to pre-set the first preset power consumption J1 and the second preset power consumption J2, the scoring module is also used to pre-set the first preset correction coefficient B1, the second preset correction coefficient B2 and the third preset correction coefficient B3, and J1<J2, B1<B2<B3<0.3. The scoring module is also used to compare the real-time power consumption of the processing unit with each preset power consumption, and select the corresponding correction coefficient according to the comparison result to correct the adjusted power demand score W1 of the processing unit. Wherein:
[0096] When J≤J1, the third preset correction coefficient B3 is selected to correct the adjusted power demand score W1 of the processing unit.
[0097] When J1<J≤J2, the second preset correction coefficient B2 is selected to correct the adjusted power demand score W1 of the processing unit.
[0098] When J>J2, the first preset correction coefficient B1 is selected to correct the adjusted power demand score W1 of the processing unit.
[0099] When the scoring module selects the i-th preset correction coefficient Bi to correct the adjusted power demand score W1 of the processing unit, i=1,2,3, and determines that the corrected power demand score of the processing unit is W2, and sets W2=W1×Bi.
[0100] It is understandable that by introducing a comparison mechanism between real-time power consumption and preset power consumption, the scoring module can more comprehensively consider the actual power consumption of the processing unit. This helps to more accurately adjust the power output when the power consumption fluctuates greatly, ensuring the stability of each processing unit in the chip.
[0101] In some embodiments of the present application, when the scoring module selects the i-th preset correction coefficient Bi to correct the adjusted power demand score W1 of the processing unit, and determines that the corrected power demand score of the processing unit is W2, it includes: the scoring module is also used to obtain the real-time temperature H of the processing unit, and judge whether to correct the corrected power demand score W2 of the processing unit according to the relationship between the real-time temperature H and the preset temperature H0: when H<H0, the scoring module does not correct the power demand score W2 of the processing unit. When H≥H0, the scoring module determines that the temperature of the processing unit exceeds the preset temperature, and corrects the corrected power demand score W2 of the processing unit according to the relationship between the real-time temperature H and the preset temperature H0.
[0102] In some embodiments of the present application, when the scoring module determines that the temperature of the processing unit exceeds the preset temperature and corrects the corrected power demand score W2 of the processing unit, it includes: the scoring module is also used to obtain the temperature difference △H between the real-time temperature H and the preset temperature H0, △H=H-H0, the scoring module is also used to compare the temperature difference △H with the preset temperature difference, and select the corresponding correction coefficient according to the comparison result to correct the corrected power demand score W2 of the processing unit. Among them: the scoring module is also used to pre-set the first preset temperature difference △H1 and the second preset temperature difference △H2, the scoring module is also used to pre-set the first preset correction coefficient C1, the second preset correction coefficient C2 and the third preset correction coefficient C3, and △H1<△H2, C1<C2<C3<0.2.
[0103] When ΔH≤ΔH1, the third preset correction coefficient C3 is selected to correct the modified power demand score W2 of the processing unit.
[0104] When ΔH1<ΔH≤ΔH2, the second preset correction coefficient C2 is selected to correct the modified power demand score W2 of the processing unit.
[0105] When ΔH>ΔH2, the first preset correction coefficient C1 is selected to correct the modified power demand score W2 of the processing unit.
[0106] When the scoring module selects the i-th preset correction coefficient Ci to correct the modified power demand score W2 of the processing unit, i=1,2,3, and determines that the corrected power demand score of the processing unit is W3, and sets W3=W2×Ci.
[0107] It is understandable that by introducing the relationship between the real-time temperature and the preset temperature, the scoring module can more comprehensively consider the actual temperature condition of the processing unit. This helps to adjust the power output more accurately under high or low temperature conditions. Secondly, by comparing the temperature difference between the real-time temperature and the preset temperature, different correction coefficients are selected, which further enables the control module to adjust the power output differentially according to temperature changes. This helps the control module to achieve more accurate power management in different temperature environments. Finally, by incorporating temperature correction into the evaluation system, the scoring module can more comprehensively consider factors such as load information, temperature and power consumption to achieve more accurate power management. It further helps to improve the energy efficiency and performance of the chip when processing big data.
[0108] In some embodiments of the present application, when the control module is used to establish a power supply level for each processing unit according to the power demand score of each processing unit, the control module includes: the control module is also used to obtain the corrected power demand score W3 of the processing unit. The control module is also used to compare the power demand score W3 with the preset power demand score, and establish the power supply level of the processing unit according to the comparison result: wherein the control module is also used to pre-set a first preset power demand score T1 and a second preset power demand score T2, and the control module is also used to pre-set a first preset level A1, a second preset level A2 and a third preset level A3, and T1<T2, A1<A2<A3.
[0109] When W3≤T1, the first preset level A1 is selected to establish a power supply level for the processing unit.
[0110] When T1<W3≤T2, the second preset level A2 is selected to establish the power supply level for the processing unit.
[0111] When W3>T2, the third preset level A3 is selected to establish the power supply level for the processing unit.
[0112] When the control module selects the i-th preset level Ai to establish the power supply level for the processing unit, i=1,2,3, and determines that the power supply level of the processing unit is Q, and sets Q=Ai.
[0113] In the above embodiment, through the power output module, the system can adjust the power output in real time according to the needs of each processing unit to achieve dynamic power distribution. This helps to flexibly distribute electric energy under different workloads and improve the overall energy efficiency of the system. Secondly, by connecting the acquisition module and the temperature detection module to each processing unit respectively, the load information and temperature data of the processing unit can be collected in real time. This helps the subsequent scoring module to understand the working status of each processing unit more comprehensively and provide basic data for intelligent power management. At the same time, the processing unit is scored for power demand according to the load information and temperature of the processing unit through the scoring module. The control module then establishes the power supply level of the processing unit, allocates appropriate power resources to each processing unit, and realizes differentiated power supply. In addition, the control module presets the power supply level and output power, and dynamically adjusts according to actual needs. This helps to flexibly respond to different scenarios, ensure that power consumption is minimized while meeting performance requirements, and improve the efficiency of the overall system. Finally, the control module intelligently selects the corresponding preset output power according to the relationship between the real-time power supply level of the processing unit and the preset power supply level. This intelligent selection can accurately adjust the power output under different workloads, thereby ensuring the efficient use of power resources.
[0114] like Figure 2 As shown, in another preferred embodiment based on the above embodiment, this embodiment provides a dynamic power management method based on an IPU chip, including:
[0115] Step S100: obtaining the power output of the power output module to each processing unit, the load information of each processing unit, and the temperature of each processing unit.
[0116] Step S200: Evaluate the power demand score of each processing unit according to the load information and temperature of each processing unit.
[0117] Step S300: establishing a power supply level for each processing unit according to the power demand score of each processing unit, and adjusting the power output amount of the power output module to each processing unit according to the power supply level.
[0118] It can be understood that the above-mentioned dynamic power management system and method based on IPU chip have the same beneficial effects and will not be repeated here.
[0119] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0120] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0121] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0122] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0123] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that the specific implementation methods of the present invention can still be modified or replaced by equivalents. Any modification or equivalent replacement that does not depart from the spirit and scope of the present invention should be covered within the scope of protection of the claims of the present invention.
Claims
1. A dynamic power management system based on IPU chip, characterized in that: include: A power output module, electrically connected to the power supply and each processing unit in the IPU chip, respectively, the power output module is used to obtain electric energy from the power supply, and the power output module is also used to output electric energy to each processing unit; A collection module, electrically connected to each of the processing units, and used to collect load information of each of the processing units; A temperature detection module, electrically connected to each of the processing units, and used to detect the temperature of each of the processing units; A scoring module, electrically connected to the acquisition module and the temperature detection module respectively, and used for evaluating the power demand score of each processing unit according to the load information and temperature of each processing unit; A control module is electrically connected to the scoring module and the power output module respectively, and the control module is used to establish a power supply level for each processing unit according to the power demand score of each processing unit, and adjust the power output amount of the power output module to each processing unit according to the power supply level; wherein, The control module is also used to obtain the real-time power supply level Q of the processing unit; The control module is further used to preset a first preset power supply level Q1 and a second preset power supply level Q2, and the control module is further used to preset a first preset output power, a second preset output power and a third preset output power, and Q1<Q2, the first preset output power<the second preset output power<the third preset output power; The control module is further configured to select a corresponding preset output power as the output power of the processing unit according to the relationship between the real-time power supply level Q of the processing unit and each preset power supply level: When Q=Q1, the control module selects the first preset output power as the output power of the processing unit; When Q1<Q≤Q2, the control module selects the second preset output power as the output power of the processing unit; When Q>Q2, the control module selects the third preset output power as the output power of the processing unit; The scoring module is further used to obtain the real-time task processing quantity L of the processing unit, and determine whether the processing unit is in a dormant state according to the relationship between the real-time task processing quantity L and a preset task processing quantity L0: When L<L0, the scoring module determines that the processing unit is in a dormant state, determines that the processing unit does not need to be powered, and does not evaluate the power requirement score of the processing unit; When L≥L0, the scoring module determines that the processing unit is in working state, determines that the processing unit needs to be powered, and evaluates the power demand score of the processing unit according to the relationship between the real-time task processing number L and the preset task processing number L0; The scoring module determines that the processing unit is in working state and evaluates the power demand score of the processing unit, including: The scoring module is further used to obtain a task processing quantity difference △L between the real-time task processing quantity L and a preset task processing quantity L0, △L=L-L0, and the scoring module is further used to compare the task processing quantity difference △L with the preset task processing quantity difference, and select a corresponding preset score as the power demand score of the processing unit according to the comparison result; The scoring module is further used to preset a first preset task processing quantity difference △L1 and a second preset task processing quantity difference △L2, and the scoring module is further used to preset a first preset score M1, a second preset score M2 and a third preset score M3, and △L1<△L2, M1<M2<M3; When △L≤△L1, the first preset score M1 is selected as the power demand score of the processing unit; When △L1<△L≤△L2, the second preset score M2 is selected as the power demand score of the processing unit; When △L>△L2, the third preset score M3 is selected as the power demand score of the processing unit; When the scoring module selects the i-th preset score Mi as the power demand score of the processing unit, i=1, 2, 3, and determines that the power demand score of the processing unit is W, and sets W=Mi.
2. The IPU chip-based dynamic power management system according to claim 1, characterized in that: When the scoring module selects the i-th preset score Mi as the power demand score of the processing unit and determines that the power demand score of the processing unit is W, it includes: The scoring module is also used to obtain the total amount K of the real-time processing task data of the processing unit, and the scoring module is also used to determine whether to adjust the power demand score W of the processing unit according to the relationship between the total amount K of the real-time processing task data and the preset full-load data processing amount K0; When K<K0, the scoring module determines not to adjust the power demand score W of the processing unit; When K≥K0, the scoring module determines that the processing unit is in full load or overload state, and adjusts the power demand score W of the processing unit according to the relationship between the total amount of real-time processing task data K and the preset full load data processing amount K0.
3. The IPU chip-based dynamic power management system according to claim 2, characterized in that: The scoring module determines whether the processing unit is in a full load or overload state and adjusts the power demand score W of the processing unit, including: The scoring module is also used to obtain the data volume difference △K between the total amount of real-time processing task data K and the preset full-load data processing volume K0, △K=K-K0; the scoring module is also used to compare the data volume difference △K with the preset data volume difference, and select a corresponding adjustment coefficient according to the comparison result to adjust the power demand score W of the processing unit; The scoring module is further used to pre-set a first preset data volume difference △K1 and a second preset data volume difference △K2, and the scoring module is further used to pre-set a first preset adjustment coefficient N1, a second preset adjustment coefficient N2 and a third preset adjustment coefficient N3, and △K1<△K2, N1<N2<N3<0.5; When △K≤△K1, the first preset adjustment coefficient N1 is selected to adjust the power demand score W of the processing unit; When △K1<△K≤△K2, the second preset adjustment coefficient N2 is selected to adjust the power demand score W of the processing unit; When △K>△K2, the third preset adjustment coefficient N3 is selected to adjust the power demand score W of the processing unit; When the scoring module selects the i-th preset adjustment coefficient Ni to adjust the power demand score W of the processing unit, i=1, 2, 3, and determines that the adjusted power demand score of the processing unit is W1, and sets W1=W×Ni.
4. The IPU chip-based dynamic power management system according to claim 3, characterized in that: When the scoring module selects the i-th preset adjustment coefficient Ni to adjust the power demand score W of the processing unit, and determines that the adjusted power demand score of the processing unit is W1, it includes: The scoring module is also used to obtain the real-time power consumption J of the processing unit. The scoring module is further used to preset a first preset power consumption J1 and a second preset power consumption J2, and the scoring module is further used to preset a first preset correction coefficient B1, a second preset correction coefficient B2 and a third preset correction coefficient B3, and J1<J2, B1<B2<B3<0.3; The scoring module is also used to compare the real-time power consumption of the processing unit with each preset power consumption, and select a corresponding correction coefficient according to the comparison result to correct the adjusted power demand score W1 of the processing unit; wherein, When J≤J1, the third preset correction coefficient B3 is selected to correct the adjusted power demand score W1 of the processing unit; When J1<J≤J2, the second preset correction coefficient B2 is selected to correct the adjusted power demand score W1 of the processing unit; When J>J2, the first preset correction coefficient B1 is selected to correct the adjusted power demand score W1 of the processing unit; When the scoring module selects the i-th preset correction coefficient Bi to correct the adjusted power demand score W1 of the processing unit, i=1,2,3, and determines that the corrected power demand score of the processing unit is W2, and sets W2=W1×Bi.
5. The IPU chip-based dynamic power management system according to claim 4, characterized in that: When the scoring module selects the i-th preset correction coefficient Bi to correct the adjusted power demand score W1 of the processing unit and determines that the corrected power demand score of the processing unit is W2, it includes: The scoring module is also used to obtain the real-time temperature H of the processing unit, and determine whether to calibrate the power demand score W2 of the processing unit after correction according to the relationship between the real-time temperature H and the preset temperature H0; When H<H0, the scoring module does not correct the power demand score W2 of the processing unit; When H≥H0, the scoring module determines that the temperature of the processing unit exceeds the preset temperature, and corrects the corrected power demand score W2 of the processing unit according to the relationship between the real-time temperature H and the preset temperature H0.
6. The dynamic power management system based on the IPU chip as claimed in claim 5, characterized in that: When the scoring module determines that the temperature of the processing unit exceeds a preset temperature and corrects the corrected power demand score W2 of the processing unit, it includes: The scoring module is further used to obtain a temperature difference △H between the real-time temperature H and a preset temperature H0, △H=H-H0, and the scoring module is further used to compare the temperature difference △H with the preset temperature difference, and select a corresponding correction coefficient according to the comparison result to correct the corrected power demand score W2 of the processing unit; The scoring module is further used to preset a first preset temperature difference △H1 and a second preset temperature difference △H2, and the scoring module is further used to preset a first preset correction coefficient C1, a second preset correction coefficient C2 and a third preset correction coefficient C3, and △H1<△H2, C1<C2<C3<0.2; When △H≤△H1, the third preset correction coefficient C3 is selected to correct the modified power demand score W2 of the processing unit; When △H1<△H≤△H2, the second preset correction coefficient C2 is selected to correct the modified power demand score W2 of the processing unit; When △H>△H2, the first preset correction coefficient C1 is selected to correct the modified power demand score W2 of the processing unit; When the scoring module selects the i-th preset correction coefficient Ci to correct the modified power demand score W2 of the processing unit, i=1,2,3, and determines that the corrected power demand score of the processing unit is W3, and sets W3=W2×Ci.
7. The IPU chip-based dynamic power management system according to claim 6, characterized in that: When the control module is used to establish a power supply level for each processing unit according to the power demand score of each processing unit, it includes: The control module is also used to obtain a corrected power demand score W3 of the processing unit; The control module is further used to compare the power demand score W3 with a preset power demand score, and establish the power supply level of the processing unit according to the comparison result: The control module is further used to preset a first preset power demand score T1 and a second preset power demand score T2, and the control module is further used to preset a first preset level A1, a second preset level A2 and a third preset level A3, and T1<T2, A1<A2<A3; When W3≤T1, the first preset level A1 is selected to establish a power supply level for the processing unit; When T1<W3≤T2, the second preset level A2 is selected to establish a power supply level for the processing unit; When W3>T2, the third preset level A3 is selected to establish a power supply level for the processing unit; When the control module selects the i-th preset level Ai to establish the power supply level for the processing unit, i=1, 2, 3, and determines that the power supply level of the processing unit is Q, and sets Q=Ai.
8. A dynamic power management method based on an IPU chip, applicable to a dynamic power management system based on an IPU chip as described in any one of claims 1 to 7, characterized in that: include: Acquire the power output of the power output module to each processing unit, the load information of each processing unit, and the temperature of each processing unit; Evaluate the power demand score of each processing unit according to the load information and temperature of each processing unit; A power supply level is established for each processing unit according to the power demand score of each processing unit, and the power output amount of the power output module to each processing unit is adjusted according to the power supply level.
