Bandwidth control method and device, integrated circuit, electronic equipment and carrier

By dynamically controlling the bandwidth access of the operating system to the hardware unit, the problem of unreasonable bandwidth resource allocation in integrated circuits is solved, business performance and resource utilization are improved, and resource waste is reduced.

CN118964245APending Publication Date: 2024-11-15XG TECHNOLOGIES PTE LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411131916.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-16
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

When the integrated circuit runs multiple operating systems, the unreasonable allocation of bandwidth resources will affect the business performance of each operating system, and the resource utilization rate is low, resulting in resource waste.

Method used

By obtaining the usage status of the cache queue, determining the current limit parameters of each operating system, and dynamically controlling their bandwidth access to the hardware unit to achieve reasonable bandwidth allocation and resource utilization.

Benefits of technology

It improves the service performance of each operating system, reduces the waste of bandwidth resources, and improves the utilization rate of resources.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118964245A_ABST
    Figure CN118964245A_ABST
Patent Text Reader

Abstract

The embodiment of the invention relates to the technical field of integrated circuits, and provides a bandwidth control method and device, an integrated circuit, electronic equipment and a carrier. The method comprises the steps that the use state of a cache queue is obtained, and the cache queue is used for caching access of a plurality of operating systems to a second hardware unit; determining a current limiting parameter of each operating system based on the use state of the cache queue; and based on the current limiting parameter of each operating system, controlling the bandwidth of each operating system for accessing the second hardware unit. Therefore, according to the technical scheme provided by the embodiment of the invention, the bandwidth resources of the second hardware unit can be dynamically allocated to the plurality of operating systems, so that the service performance of each operating system can be improved, the utilization rate of the bandwidth resources can be improved, and the waste of the bandwidth resources can be reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of integrated circuit technology, and in particular to a bandwidth control method, device, integrated circuit, electronic device and carrier. Background Art

[0002] Some integrated circuits, such as system on chip (SoC), can run multiple operating systems (OS), and these operating systems share bandwidth resources corresponding to the integrated circuit, such as shared memory bandwidth.

[0003] Currently, when an integrated circuit runs multiple operating systems, there is an unreasonable allocation problem of bandwidth resources corresponding to the integrated circuit, which affects the service performance of each operating system. Summary of the invention

[0004] The embodiments of the present disclosure provide a bandwidth control method, device, integrated circuit, electronic device and carrier. When multiple operating systems are running on the integrated circuit, the resources of the integrated circuit can be dynamically allocated to each operating system, thereby improving the service performance and resource utilization of each operating system.

[0005] In a first aspect, an embodiment of the present disclosure provides a bandwidth control method, the method comprising: obtaining a usage status of a cache queue, wherein the cache queue is used to cache access of multiple operating systems running on a first hardware unit to a second hardware unit; based on the usage status of the cache queue, determining a first current limiting parameter of the first operating system; and based on the first current limiting parameter, controlling the bandwidth of the first operating system accessing the second hardware unit.

[0006] In a second aspect, an embodiment of the present disclosure provides a bandwidth control device, which includes: a first current limiting module, which is communicatively connected to a first hardware unit, the first hardware unit runs multiple operating systems, and the first current limiting module corresponds to the first operating system; the first current limiting module is configured to: obtain the usage status of a cache queue, wherein the cache queue is used to cache access to a second hardware unit by multiple operating systems running on the first hardware unit; determine a first current limiting parameter of the first operating system based on the usage status of the cache queue; and control the bandwidth of the first operating system accessing the second hardware unit based on the first current limiting parameter.

[0007] In a third aspect, an embodiment of the present disclosure provides an integrated circuit, comprising: a first hardware unit, the first hardware unit running multiple operating systems; multiple current limiting modules arranged in a one-to-one correspondence with the multiple operating systems, the multiple current limiting modules being communicatively connected to the first hardware unit, wherein at least one current limiting module is configured to implement the function of the first current limiting module of the second aspect, for example, executing the steps of the bandwidth control method provided in the first aspect.

[0008] In a fourth aspect, an embodiment of the present disclosure provides an electronic device, which includes the integrated circuit provided in the third aspect.

[0009] In a fifth aspect, an embodiment of the present disclosure provides a carrier, which includes the integrated circuit provided in the third aspect or the electronic device improved in the fourth aspect.

[0010] The technical solution provided by the embodiment of the present disclosure can control the bandwidth of each operating system accessing the second hardware unit according to the usage status of the cache queue, thereby realizing dynamic allocation of bandwidth resources of the second hardware unit, which can not only improve the business performance of each operating system, but also improve the utilization rate of bandwidth resources and reduce the waste of bandwidth resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and other purposes, features and advantages of the present disclosure will become more apparent by describing the embodiments of the present disclosure in more detail in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of the present disclosure and constitute a part of the specification. Together with the embodiments of the present disclosure, they are used to explain the present disclosure and do not constitute a limitation of the present disclosure. In the drawings, the same reference numerals generally represent the same components or steps.

[0012] Figure 1 is a structural block diagram of a cabin-driver integrated system provided by an exemplary embodiment of the present disclosure;

[0013] Figure 2 is a schematic diagram of the structure of a bandwidth control system provided by an exemplary embodiment of the present disclosure;

[0014] Figure 3 is a flow chart of a bandwidth control method provided by an exemplary embodiment of the present disclosure;

[0015] Figure 4 is a schematic diagram of dynamically controlling access bandwidth provided by an exemplary embodiment of the present disclosure;

[0016] Figure 5 is a flowchart of step S120 of a bandwidth control method provided by an exemplary embodiment of the present disclosure;

[0017] Figure 6 is a schematic diagram of determining a target bandwidth threshold provided by an exemplary embodiment of the present disclosure;

[0018] Figure 7 is a structural schematic diagram of a bandwidth control device provided by an exemplary embodiment of the present disclosure;

[0019] Figure 8 It is a schematic diagram of the structure of an integrated circuit provided by an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0020] Below, the exemplary embodiments according to the present disclosure will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present disclosure, rather than all the embodiments of the present disclosure, and it should be understood that the present disclosure is not limited to the exemplary embodiments described here.

[0021] It should be noted that the relative arrangement of components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

[0022] First, some technical terms involved in the embodiments of the present disclosure are explained.

[0023] Bandwidth: The amount of data transmitted per unit time. Bandwidth can be expressed in bits per second (bps), kilobits per second (kbps), megabits per second (Mbps), gigabits per second (Gbps), etc.

[0024] Memory: A device in a computer system used to temporarily store data and instructions so that the processor can quickly access and execute them. Memory can include random access memory (RAM), such as dynamic random access memory (DRAM), static random access memory (SRAM), etc.

[0025] Memory bandwidth: also known as memory bandwidth resources, refers to the amount of data that can be transmitted in a unit of time. The unit of memory bandwidth can be bps, kbps, Mbps, Gbps, etc.

[0026] SoC: An integrated circuit that integrates multiple modules / units of a computer system into a single chip. The modules / units that can be integrated on a SoC include: a central processing unit (CPU), a graphics processing unit (GPU), a brain processing unit (BPU), SRAM, an I / O interface, a digital signal processor (DSP), a deep learning processor (DPU), a neural network processor (NPU) and / or a tensor processing unit (TPU), an image signal processor (ISP), a memory controller, etc.

[0027] Application Overview

[0028] An operating system may be run on an integrated circuit. For example, an integrated circuit may include a processor, and an operating system may be run on the processor. The processor may establish communication with a memory (e.g., DRAM and SRAM). Thus, during the operation of the operating system, the operating system may load instructions into the memory, the processor may read instructions and data from the memory, and perform various operations such as arithmetic operations, logical operations, and data transfers according to these instructions, and then write the results of the instruction execution into the memory.

[0029] A high-performance integrated circuit, such as a high-performance SoC, can run multiple operating systems.

[0030] Figure 1 It is a structural block diagram of a cabin-and-cockpit integrated system provided by an exemplary embodiment of the present disclosure.

[0031] Among them, the cabin-driver integrated system can be applied to autonomous driving vehicles, such as vehicles (such as intelligent connected cars), ships, trains, subways, airplanes, etc., as well as various robots, such as service robots, transport robots, automated guided vehicles (AGVs), unmanned ground vehicles (UGVs), etc., and various engineering machinery.

[0032] like Figure 1As shown, in one embodiment, the cabin-pilot integrated system may include SoC 100. In one example, SoC 100 may include one or more processors. For example, one or more CPUs, and / or, one or more GPUs, and / or, one or more BPUs, and / or, one or more ISPs, and / or, one or more DSPs, and / or, one or more DPUs, and / or, one or more NPUs, and / or, one or more TPUs. These processors can be used to provide computing resources for multiple operating systems to support each operating system to implement its functions.

[0033] In one embodiment, the cabin-driver integrated system may further include a memory 200. The memory 200 may store instructions and data, and the processor may read and execute instructions in the memory 200, and write the results of the execution into the memory 200. In one example, the memory 200 may include a memory, such as a DRAM and / or an SRAM. Among them, the memory 200 is integrated on the SoC 100, such as an SRAM, and becomes a part of the SoC 100, or the memory 200 may also be an independent device outside the SoC 100, such as a DRAM, which is not specifically limited in the embodiments of the present disclosure. In one example, the SoC may further include a memory controller 110, which may manage and coordinate the access of each processor to the memory (such as SRAM and DRAM).

[0034] In one embodiment, SoC 100 can run multiple operating systems, such as OS1~OSN. Exemplarily, the multiple operating systems may include at least a cockpit operating system (referred to as the cockpit system) and an intelligent driving operating system (referred to as the intelligent driving system). Among them, the intelligent driving system is mainly responsible for the automatic driving and safety of the vehicle, including environmental perception, path planning, decision-making and control. The cockpit system is mainly responsible for the driving experience and human-computer interaction inside the vehicle, including infotainment, instrument display, media playback and environmental control. Compared with the independent cockpit system and intelligent driving system, the cabin-driving integrated system is more integrated and intelligent, which is conducive to improving the driving safety, comfort and driving experience of mobile vehicles.

[0035] During operation, multiple operating systems can call the processor to access the memory, such as reading instructions in the memory or writing the execution results of instructions to the memory. In other words, multiple operating systems will jointly occupy the memory bandwidth, such as jointly occupying the DRAM bandwidth and / or SRAM bandwidth.

[0036] In one implementation, memory bandwidth can be pre-allocated to each operating system. For example, if the SoC runs three operating systems, such as OS1, OS2, and OS3, and the DRAM bandwidth is 100 Gbps, 50 Gbps of DRAM bandwidth can be allocated to OS1, 30 Gbps of DRAM bandwidth can be allocated to OS2, and 20 Gbps of DRAM bandwidth can be allocated to OS3. However, since different operating systems have different functions and perform different tasks, different operating systems have different requirements for DRAM bandwidth. In addition, since the tasks performed by each operating system will change, the requirements of each operating system for DRAM bandwidth will also change dynamically.

[0037] Take multiple operating systems including intelligent driving system and cockpit system as an example:

[0038] For example, when the vehicle is in the intelligent driving state, the intelligent driving system needs to perform intelligent driving tasks. At this time, the intelligent driving system will load a large number of instructions and data related to the intelligent driving tasks into DRAM, which will be read and executed by the processor. The processor will also write a large number of instruction execution results into DRAM. Therefore, the intelligent driving system has a large demand for DRAM bandwidth. In the parking scenario, the intelligent driving system does not need to perform intelligent driving tasks. Therefore, the intelligent driving system writes fewer instructions and data into DRAM, and the intelligent driving system has a smaller demand for DRAM bandwidth.

[0039] For example, when the vehicle plays media, the cockpit system needs to perform the task of media playback. At this time, the cockpit system will load the instructions and media data into the DRAM, which will be read and executed by the processor, and the processor will write the instruction execution results into the DRAM. For example, the processor can decode the read media data and write the decoded media data into the DRAM. Therefore, the cockpit system has a large demand for DRAM bandwidth. In the standby scenario, the cockpit system does not need to perform tasks such as media playback, navigation, and games. Therefore, the cockpit system writes fewer instructions and data into the DRAM, and the cockpit system has a smaller demand for DRAM bandwidth.

[0040] Since the demand for memory bandwidth of each operating system changes dynamically, the method of pre-allocating memory bandwidth cannot achieve reasonable utilization of memory bandwidth, which leads to waste of memory bandwidth and the memory bandwidth allocated to the operating system cannot meet the business needs of the operating system.

[0041] Take multiple operating systems including intelligent driving system and cockpit system as an example:

[0042] For example, assume that the DRAM bandwidth allocated to the intelligent driving system is 50Gbps, and the DRAM bandwidth allocated to the cockpit system is 30Gbps. When the vehicle is in the parking state, the intelligent driving system does not need to perform intelligent driving tasks, so it can enter an idle state, for example, 40Gbps of DRAM bandwidth is idle. In this case, even if the cockpit system is running a game application and requires 40Gbps of DRAM bandwidth, the cockpit system can only use the 30Gbps of DRAM bandwidth allocated to it, and cannot use the DRAM bandwidth idled by the intelligent driving system. In other words, the DRAM bandwidth obtained by an operating system cannot be used by services in other operating systems. Not only can it not be used to improve the service performance of other operating systems, but it also leads to a waste of DRAM bandwidth.

[0043] For another example, assuming that the DRAM bandwidth allocated to OS1 is 50 Gbps, and the current service of OS1 requires 60 Gbps of DRAM bandwidth, then the DRAM bandwidth of OS1 will not be able to meet its own service needs, affecting the service performance in OS1.

[0044] It can be seen that when an integrated circuit runs multiple operating systems, there is an unreasonable allocation problem of bandwidth resources corresponding to the integrated circuit, such as memory bandwidth, which affects the service performance of each operating system.

[0045] The embodiments of the present disclosure provide a bandwidth control method, device, integrated circuit, electronic device and carrier, which can make the bandwidth resource allocation corresponding to the integrated circuit more reasonable when the integrated circuit runs multiple operating systems, improve the business performance of the operating system, and reduce resource waste.

[0046] Exemplary Systems

[0047] Figure 2 It is a structural diagram of a bandwidth control system provided by an exemplary embodiment of the present disclosure.

[0048] like Figure 2 As shown, the bandwidth control system may include: a first hardware unit 10.

[0049] The first hardware unit 10 may include a plurality of functional modules 11 on an integrated circuit (e.g., SoC). Each functional module 11 is used to implement one or more functions of the integrated circuit (e.g., SoC). For example, the functional module 11 may be a CPU, a GPU, a BPU, an NPU, a DPU, a TPU, an ISP, a DSP, etc. In addition, the functional module 11 may also be a core of a CPU, a stream processor of a GPU, a computing unit of a BPU, etc. In other words, each core of a CPU may be a functional module 11, each stream processor of a GPU may be a functional module 11, and each computing unit of a BPU may be a functional module 11.

[0050] The first hardware unit 10 may run multiple operating systems, such as an intelligent driving system, a cockpit system and / or other operating systems. The first hardware unit 10 may run multiple operating systems. Different operating systems may run in different functional modules 11, or in other words, different functional modules 11 may be managed by different operating systems.

[0051] For example, the first hardware unit 10 includes three operating systems, namely OS1 to OS3, and the CPU includes eight cores, namely core 1 to core 8. OS1 can run on core 1 and core 2 (or, core 1 and core 2 are managed by OS1), OS2 can run on core 3 to core 6 (or, core 3 to core 6 are managed by OS2), and OS3 can run on core 7 and core 8 (or, core 7 and core 8 are managed by OS3). Similarly, an operating system can manage one or more stream processors of a GPU, and an operating system can manage one or more computing units of a BPU.

[0052] When an ISP includes multiple ISP units, one operating system can manage at least one ISP unit, and different ISP units can be managed by different operating systems. Similarly, when a DSP includes multiple DSP units, one operating system can manage at least one DSP unit, and different DSP units can be managed by different operating systems.

[0053] In one implementation, each functional module 11 of the first hardware unit 10 may communicate with other hardware units (eg, the second hardware unit 20 ), for example, access the second hardware unit 20 .

[0054] Exemplarily, the first hardware unit 10 and the second hardware unit 20 may communicate via a bus. Specifically, the bus may be an advanced extensible interface (AXI) bus, and the AXI bus may include five channels, for example:

[0055] Read address channel (AR): used to transmit the address for read access.

[0056] Read data channel (R): used to transmit read access data.

[0057] Write address channel (AW): used to transmit the address for write access.

[0058] Write data channel (W): used to transmit write access data.

[0059] Write response channel (B): used to transmit responses for write access.

[0060] Of course, buses with other protocols may also be used, such as an advanced high-performance bus (AHB), an inter-integrated circuit (I2C) bus, a HyperTransport bus, etc., which is not limited in the embodiments of the present disclosure.

[0061] The second hardware unit 20 may include a memory, or other hardware units that communicate with the first hardware unit 10. Exemplarily, the second hardware unit 20 may be a DRAM and / or an SRAM. Accordingly, the bus may be a DRAM bus used by a functional module 11 (e.g., a CPU) in the SoC to access the DRAM, or an SRAM bus used to access the SRAM. Accordingly, the memory bandwidth is the bandwidth of the DRAM bus (referred to as DRAM bandwidth) and / or the bandwidth of the SRAM bus (referred to as SRAM bandwidth).

[0062] In the embodiment of the present disclosure, the first hardware unit 10 and the second hardware unit 20 may be located on different chips, for example, the first hardware unit 10 may be located in a SoC, and the second hardware unit 20 may be a DRAM independently provided relative to the SoC. Alternatively, the first hardware unit 10 and the second hardware unit 20 may also be located on the same chip, for example, the first hardware unit 10 may be located in a SoC, and the second hardware unit 20 may be an SRAM integrated on the SoC chip.

[0063] It should be noted that, in the case where the first hardware unit 10 includes multiple operating systems, each operating system will call the function module 11 managed by it to implement the corresponding function. Accordingly, in order to implement its function, each function module 11 can access the second hardware unit 20 (such as memory) to read instructions and data, or write the results of instruction execution, etc. Therefore, each function module 11 accessing the second hardware unit 20 can be described as each operating system accessing the second hardware unit 20, or in other words, it can be described as each operating system calling the function module 11 managed by it to access the second hardware unit 20. For example, the core 1 and core 2 of the CPU accessing DRAM can be described as OS1 accessing DRAM, and the DSP managed by OS2 accessing DRAM can be described as OS2 accessing DRAM.

[0064] In order to facilitate the description of the communication connection relationship between each module / unit in the bandwidth control system, taking the functional module 11 of the first hardware unit 10 accessing the second hardware unit 20 as an example, the transmission direction of the access is called the downstream direction, and the reverse direction of the access transmission is called the upstream direction.

[0065] In one implementation, the bandwidth control system may further include a bandwidth sharing module 30. The bandwidth sharing module 30 is located downstream of each functional module 11 and upstream of the second hardware unit 20. The bandwidth sharing module 30 is communicatively connected with each functional module 11 and the second hardware unit 20. In this way, the access of each functional module 11 can first reach the bandwidth sharing module 30 and then be transmitted to the second hardware unit 20.

[0066] In one implementation, the bandwidth sharing module 30 includes a cache queue, which can be used to cache access instructions and / or data. When the access of each functional module 11 reaches the bandwidth sharing module 30, it can first enter the cache queue for cache. Then, the bandwidth sharing module 30 can schedule the access in the cache queue according to a preset scheduling strategy, and transmit the access to the second hardware unit 20, such as: first-in-first-out FIFO scheduling, priority scheduling, round-robin scheduling, etc. Among them, the cache queue may include a read queue and a write queue, wherein the read access instructions and / or data of each functional module 11 can enter the read queue, and the write access instructions and / or data of each functional module 11 can enter the write queue. Of course, the read queue and the write queue can also be merged into one queue, and the read access and write access instructions and / or data of the functional module 11 both enter the queue. Among them, the cache queue can be a parallel queue or a serial queue, which is not limited in the embodiment of the present disclosure.

[0067] In one implementation, the bandwidth sharing module 30 may include a memory controller, or the function of the bandwidth sharing module 30 may be implemented by the memory controller. The memory controller may be, for example, a DDR controller (DDRC) or other types of memory controllers. Accordingly, the cache queue may be a read queue read_queue or a write queue write_queue in the memory controller.

[0068] It can be seen that the bandwidth sharing module 30 can manage and schedule the access of each functional module 11, so that each functional module 11 can efficiently use the memory bandwidth, and can also avoid conflicts when each module accesses the second hardware unit 20, thereby improving the stability of the system.

[0069] It can be understood that each functional module 11 can be classified based on the correspondence between each functional module 11 and each operating system. For example, the module running OS1 and managed by OS1 is classified as the functional module 11 of OS1, the module running OS2 and managed by OS2 is classified as the functional module 11 of OS2, and the module running OSN and managed by OSN is classified as the functional module 11 of OSN.

[0070] In the embodiment of the present disclosure, the bandwidth control system may further include a plurality of current limiting modules 40 corresponding to a plurality of operating systems, for example, current limiting modules 40-1 to current limiting modules 40-N. The current limiting module 40 may be arranged on the communication link between the function module 11 of the corresponding operating system and the bandwidth sharing module 30, that is, the current limiting module 40 is arranged downstream of the function module 11, and the bandwidth sharing module 30 is arranged downstream of the current limiting module 40. For example, the current limiting module 40-1 may be arranged on the communication link between the function module 11 of OS1 and the bandwidth sharing module 30, the current limiting module 40-2 may be arranged on the communication link between the function module 11 of OS2 and the bandwidth sharing module 30, and so on.

[0071] In this way, when a certain operating system accesses the second hardware unit 20, the access (such as instructions, data, etc.) first passes through the current limiting module 40 corresponding to the operating system, and then is transmitted to the second hardware unit 20 through the bandwidth sharing module 30. Among them, when the access passes through the current limiting module 40, the current limiting module 40 can limit the access. In this way, the transmission bandwidth of the access in the downstream can be controlled. In other words, the bandwidth of the operating system accessing the second hardware unit 20 is controlled.

[0072] In one implementation, each current limiting module 40 can control the bandwidth of its corresponding operating system to access the second hardware unit 20 based on the usage status of the cache queue. For example, when the number of cached accesses in the cache queue is large, that is, the cache queue is crowded, the current limiting module 40 can control its corresponding operating system to access the second hardware unit 20 with a lower bandwidth, that is, allocate a lower memory bandwidth to the operating system. When the number of cached accesses in the cache queue is small, that is, the cache queue is relatively idle, the current limiting module 40 can allow its corresponding operating system to access the second hardware unit 20 with a higher bandwidth, that is, allocate a higher memory bandwidth to the operating system.

[0073] It can be seen that the bandwidth scheduling system provided by the embodiment of the present disclosure is provided with a current limiting module 40 corresponding to each operating system. The current limiting module 40 can dynamically control the bandwidth of each operating system accessing the second hardware unit 20 according to the usage status of the cache queue, so that the bandwidth resource allocation of the second hardware unit 20 is more reasonable, which can not only improve the business performance of each operating system, but also improve the utilization rate of bandwidth resources and reduce the waste of bandwidth resources.

[0074] Exemplary Methods

[0075] Figure 3 is a flowchart of a bandwidth control method provided by an exemplary embodiment of the present disclosure.

[0076] Combine the following Figure 3 , each step of the method is exemplarily described. Among them, each step of the method can be executed by any current limiting module 40 in the bandwidth control system. For the convenience of description, any operating system among the multiple operating systems run by the first hardware unit 10 is referred to as the first operating system, and the current limiting module 40 corresponding to the first operating system is referred to as the first current limiting module.

[0077] In one embodiment, the method may include the following steps:

[0078] Step S110, obtaining the usage status of the cache queue.

[0079] The cache queue may be any queue in the bandwidth sharing module 30. The cache queue is used to cache accesses of multiple operating systems to the second hardware unit 20, such as cache access instructions and / or data, etc. The usage status of the cache queue may include any parameter value or indication information that can characterize the idleness / congestion degree of the cache queue.

[0080] In one implementation, the usage status of the cache queue may be indicated by a status value of the cache queue, or may be indicated by other information, such as a status level, a flag bit, etc., which is not specifically limited here.

[0081] Exemplarily, in the case where the bandwidth sharing module 30 includes a read queue and a write queue: the cache queue may include a read queue and / or a write queue. The read queue is used to cache read access instructions of multiple operating systems to the second hardware unit 20, and the write queue is used to cache write access instructions of multiple operating systems to the second hardware unit 20. Accordingly, the status value of the cache queue may include the status value of the read queue and / or the status value of the write queue.

[0082] Exemplarily, when the read queue and the write queue are merged into a read-write queue, the status value of the cache queue may include the status value of the read-write queue.

[0083] The state value of the cache queue may represent the idleness or congestion of the cache queue. The idleness or congestion of the cache queue is related to the access bandwidth of each operating system to the second hardware unit 20 .

[0084] For example, when the services in each operating system are relatively busy, the access of each operating system to the second hardware unit 20 will increase. Therefore, a large number of accesses will enter the cache queue, so that the number of accesses entering the cache queue is greater than the number of accesses leaving the cache queue, resulting in an increase in the number of accesses cached in the cache queue and a lower idleness of the cache queue. Accordingly, the bandwidth of each operating system accessing the second hardware unit 20 will also increase, reducing the idle bandwidth resources of the second hardware unit 20.

[0085] Similarly, when the services in each operating system are relatively idle, the access of each operating system to the second hardware unit 20 will be reduced. Therefore, only a small amount of access enters the cache queue, so that the number of accesses entering the cache queue is less than the number of accesses leaving the cache queue, resulting in a decrease in the number of accesses cached in the cache queue and a higher idleness of the cache queue. At the same time, the bandwidth of each operating system accessing the second hardware unit 20 will also be reduced, increasing the idle bandwidth resources of the second hardware unit 20.

[0086] In one implementation, the cache queue may include multiple channel entries, and each channel may cache an access instruction. In the read queue, the channel may be a read channel, and each read channel may cache a read access instruction; in the write queue, the channel may be a write channel, and each write channel may cache a write access instruction and may also cache data to be written. Accordingly, the status value of the cache queue may include the number of available channels (also called the number of idle channels) or the number of unavailable channels (also called the number of non-idle channels) of the cache queue.

[0087] Exemplarily, the cache queue includes 10 channels. If instructions are cached in 8 channels, then the number of available channels of the cache queue is 2 and the number of unavailable channels is 8. If instructions are cached in 2 channels, then the number of available channels of the cache queue is 8 and the number of unavailable channels is 2.

[0088] It is understandable that, in the case where the state value of the cache queue includes the number of available channels of the cache queue, the larger the state value, the more idle bandwidth resources of the second hardware unit 20; the smaller the state value, the fewer idle bandwidth resources of the second hardware unit 20. In the case where the state value of the cache queue includes the number of unavailable channels of the cache queue, the larger the state value, the fewer idle bandwidth resources of the second hardware unit 20; the smaller the state value, the more idle bandwidth resources of the second hardware unit 20.

[0089] In one implementation, the bandwidth sharing module 30 may send the status value of the cache queue to the first current limiting module, for example, sending the number of available channels or the number of unavailable channels of the cache queue to the first current limiting module. If the bandwidth sharing module 30 includes a read queue and a write queue, the bandwidth sharing module 30 may send the status value of the read queue and / or the status value of the write queue to the first current limiting module.

[0090] In one example, the bandwidth sharing module 30 can monitor the state value of the cache queue, such as monitoring the number of available channels or the number of unavailable channels of the cache queue. When the state value of the cache queue changes, the bandwidth sharing module 30 sends the changed state value to the first current limiting module. For example, when the number of available channels or the number of unavailable channels of the cache queue changes, the bandwidth sharing module 30 sends the changed number of available channels or the number of unavailable channels to the first current limiting module.

[0091] In one example, the bandwidth sharing module 30 may periodically send the state value of the cache queue to the first current limiting module. For example, a timer may be configured for the bandwidth sharing module 30, the timer periodically times out at a preset duration, and the bandwidth sharing module 30 may send the state value of the cache queue to the first current limiting module in response to a timeout signal of the timer.

[0092] In one example, since access to and from the cache queue will cause changes in the number of available channels and the number of unavailable channels of the cache queue, the bandwidth sharing module 30 can monitor the events of access to and from the cache queue, and when monitoring that there is access to or from the cache queue, the bandwidth sharing module 30 can obtain the latest number of available channels and the number of unavailable channels of the cache queue, and send the obtained number of available channels and the number of unavailable channels to the first current limiting module.

[0093] Step S120: determining a first current limiting parameter of the first operating system based on the usage status of the cache queue.

[0094] The first current limiting parameter is used to limit the access of the first operating system to the second hardware unit 20 , so as to control the bandwidth of the first operating system accessing the second hardware unit 20 .

[0095] In one implementation, a first current limiting parameter of the first operating system may be determined based on the state value of the cache queue, wherein the first current limiting parameter may include a target bandwidth threshold of the first operating system.

[0096] In one implementation, multiple current limiting parameters can be pre-set for the first operating system, and each current limiting parameter can include a preset bandwidth threshold. In addition, a correspondence between multiple state values ​​and multiple current limiting parameters of the first operating system can also be pre-set, so that after the state value of the cache queue is obtained, the current limiting parameter corresponding to the state value of the cache queue can be determined as the first current limiting parameter based on the correspondence.

[0097] It should be noted that in a multi-operating system scenario, the services of different operating systems may be different, and the bandwidth requirements for the second hardware unit 20 may also be different. Therefore, for the same state value, the current limiting parameters of each operating system may be the same or different. They can be reasonably set based on the business requirements of each operating system, and no specific limitations are made here.

[0098] Exemplarily, the correspondence between the number of available channels (or the number of unavailable channels) of the cache queue and the bandwidth threshold of each operating system can be preset, and the correspondence can be stored in the register corresponding to the first current limiting module. Wherein, each current limiting module 40 can correspond to a register, or multiple current limiting modules 40 can share a register, which is not limited here.

[0099] Exemplarily, when the state value of the cache queue includes the number of available channels of the cache queue, the bandwidth threshold of each operating system can increase with the increase of the number of available channels of the cache queue. Similarly, when the state value of the cache queue includes the number of unavailable channels of the cache queue, the bandwidth threshold of each operating system can decrease with the increase of the number of unavailable channels of the cache queue. In other words, the more idle bandwidth resources of the second hardware unit 20, the greater the bandwidth threshold of each operating system, and the fewer idle bandwidth resources of the second hardware unit 20, the smaller the bandwidth threshold of each operating system.

[0100] The bandwidth threshold of each operating system increases with the increase of the number of available channels of the cache queue, which may include: the bandwidth threshold of each operating system increases continuously with the increase of the number of available channels of the cache queue, or the bandwidth threshold of each operating system increases intermittently with the increase of the number of available channels of the cache queue. The bandwidth threshold of each operating system decreases with the increase of the number of unavailable channels of the cache queue, which may include: the bandwidth threshold of each operating system decreases continuously with the increase of the number of unavailable channels of the cache queue, or the bandwidth threshold of each operating system decreases intermittently with the increase of the number of unavailable channels of the cache queue.

[0101] That is to say, the correspondence between the number of available channels of the cache queue and the bandwidth threshold of each operating system can be flexibly set according to the actual flow limiting demand, and the embodiments of the present disclosure do not limit this.

[0102] Exemplarily, taking the bandwidth resource of the second hardware unit 20 as 100 Gbps and the number of channels of the cache queue as 100 as an example, the correspondence between the number of available channels of the cache queue and the bandwidth threshold of each operating system can be shown in Table 1. It should be noted that the values ​​disclosed in Table 1 are only examples and do not constitute a specific limitation on the embodiments of the present disclosure.

[0103] Table 1:

[0104] Number of available channels Bandwidth threshold for OS1 Bandwidth threshold for OS2 Bandwidth threshold for OS3 0 50Gbps 30Gbps 20Gbps … … … … 10 50Gbps 30Gbps 20Gbps … … … … 50 70Gbps 50Gbps 30Gbps … … … … 90 80Gbps 60Gbps 40Gbps … … … …

[0105] In this way, the first current limiting module can determine the target bandwidth threshold corresponding to the acquired number of available channels from the multiple bandwidth thresholds corresponding to the first operating system based on the number of available channels sent by the bandwidth sharing module 30 .

[0106] For example, if the number of available channels of the cache queue is 10, then the current limiting module 40-1 can determine the target bandwidth threshold of OS1 to be 50 Gbps, the current limiting module 40-2 can determine the target bandwidth threshold of OS2 to be 30 Gbps, and the current limiting module 40-3 can determine the target bandwidth threshold of OS3 to be 20 Gbps. If the number of available channels of the cache queue is 50, then the current limiting module 40-1 can determine the target bandwidth threshold of OS1 to be 70 Gbps, the current limiting module 40-2 can determine the target bandwidth threshold of OS2 to be 50 Gbps, and the current limiting module 40-3 can determine the target bandwidth threshold of OS3 to be 30 Gbps.

[0107] In one implementation, when the cache queue includes a read queue and a write queue, current limiting parameters can be set for read access and write access of the first operating system respectively, wherein the current limiting parameters for read access and write access corresponding to the same state value can be the same or different.

[0108] Exemplarily, as shown in Table 2, the correspondence between the number of available channels of the read queue and the read bandwidth threshold of each operating system may be preset.

[0109] Table 2:

[0110] The number of available channels for the read queue OS1 read bandwidth threshold OS2 read bandwidth threshold OS3 read bandwidth threshold … … … … 10 50Gbps 30Gbps 20Gbps … … … … 50 70Gbps 50Gbps 30Gbps … … … …

[0111] Exemplarily, as shown in Table 3, the correspondence between the number of available channels of the write queue and the write bandwidth threshold of each operating system may be preset.

[0112] Table 3:

[0113] The number of available channels for the write queue Write bandwidth threshold of OS1 OS2 write bandwidth threshold OS3 write bandwidth threshold … … … … 10 40Gbps 30Gbps 30Gbps … … … … 50 60Gbps 50Gbps 40Gbps … … … …

[0114] It should be noted that the numerical values ​​disclosed in Table 2 and Table 3 are only examples and do not constitute specific limitations on the embodiments of the present disclosure.

[0115] In this way, the read access and write access of the first operating system can be limited respectively.

[0116] Step S130: Based on the first current limiting parameter, the bandwidth of the first operating system accessing the second hardware unit is controlled.

[0117] In one implementation, when the first operating system accesses the second hardware unit 20 via the first current limiting module, the first current limiting module can limit the access based on the target bandwidth threshold of the first operating system, so that the bandwidth of the first operating system accessing the second hardware unit 20 is less than or equal to the target bandwidth threshold.

[0118] For example, in conjunction with Table 1, when the number of available channels of the cache queue is 10, the target bandwidth threshold of OS1 is 50 Gbps, and therefore, the current limiting module 40-1 can limit the bandwidth of OS1 accessing the second hardware unit 20 to be less than or equal to 50 Gbps. In contrast, when the number of available channels of the cache queue is 50, the target bandwidth threshold of OS1 is 70 Gbps, and therefore, the current limiting module 40-1 can limit the bandwidth of OS1 accessing the second hardware unit 20 to be less than or equal to 70 Gbps.

[0119] It should be noted that during the operation of each operating system, the amount of access to the second hardware unit 20 by each operating system changes dynamically, and accordingly, the number of available channels of the cache queue also changes dynamically, and therefore, the target bandwidth threshold of the first operating system also changes dynamically. In other words, the first current limiting module dynamically controls the bandwidth of the first operating system to access the second hardware unit 20.

[0120] Figure 4 It is a schematic diagram of dynamically controlling access bandwidth provided by an exemplary embodiment of the present disclosure.

[0121] Exemplarily, when the number of available channels in the cache queue is 50, the target bandwidth threshold of OS1 is 70 Gbps, and the target bandwidth threshold of OS2 is 50 Gbps. Therefore, if OS1 accesses the second hardware unit, the current limiting module 40-1 can limit the bandwidth of OS1 accessing the second hardware unit 20 to 70 Gbps. At this time, if OS2 also accesses the second hardware unit 20, then the access of OS2 will also enter the cache queue, resulting in an increase in the number of accesses entering the cache queue, and the number of available channels in the cache queue will decrease, for example, the number of available channels is reduced to 10. At this time, the bandwidth sharing module 30 can send the new number of available channels 10 to each current limiting module 40. After receiving the new number of available channels 10, the current limiting module 40-1 determines that the target bandwidth threshold of OS1 is reduced to 50 Gbps, and therefore reduces the bandwidth of OS1 accessing the second hardware unit 20 to 50 Gbps. Similarly, after receiving the new available channel number 10, the current limiting module 40-2 determines that the target bandwidth threshold of OS2 is reduced to 30 Gbps, and therefore reduces the bandwidth for OS2 to access the second hardware unit 20 to 30 Gbps.

[0122] It can be seen that when the number of available channels in the cache queue is small, that is, when the second hardware unit 20 has less idle bandwidth resources, the first current limiting module can control the first operating system to access the second hardware unit 20 with a lower bandwidth to take into account the needs of other operating systems for bandwidth resources. When the number of available channels in the cache queue is large, that is, when the second hardware unit 20 has more idle bandwidth resources, the first current limiting module can control the first operating system to access the second hardware unit 20 with a higher bandwidth to make full use of the bandwidth resources of the second hardware unit 20 and improve the service performance of the first operating system.

[0123] In addition, when the first current limiting parameter includes the number of available channels of the write queue and the number of available channels of the read queue, the first current limiting module limits the read access and the write access of the first operating system respectively. That is, the bandwidth of the write access of the first operating system to the second hardware unit 20 can be controlled, and the bandwidth of the read access of the first operating system to the second hardware unit 20 can also be controlled.

[0124] It can be seen from the above technical solutions that the method provided by the embodiment of the present disclosure can dynamically control the bandwidth of each operating system accessing the second hardware unit 20 according to the usage status of the cache queue, so that the bandwidth resource allocation of the second hardware unit 20 is more reasonable, which can not only improve the business performance of each operating system, but also improve the utilization rate of bandwidth resources and reduce the waste of bandwidth resources.

[0125] In one implementation, the state value of the cache queue may include multiple state value intervals. The multiple state value intervals may be separated by multiple state thresholds. In some examples, the state threshold may also be referred to as a waterline value, and the state value interval may also be referred to as a waterline value interval.

[0126] The number of state thresholds may be m, where m is an integer greater than or equal to 1. Then, the m state thresholds may form m+1 state value intervals in the order of values ​​from large to small or from small to large, which is specifically described below with reference to examples.

[0127] For example, the state threshold may be an available channel number threshold. If the cache queue contains 100 channels, then the available channel number threshold should be in the range of 0 to 100. For example, m available channel number thresholds W1 to W m W1=90、W2=80、…、W m-1 =20, W m = 10. These m available channel number thresholds can form a total of m+1 state value intervals, for example: the available channel number is greater than (or equal to) 90 corresponding to state value interval 1, the available channel number is less than (or equal to) 90 and greater than (or equal to) 80 corresponding to state value interval 2, the available channel number is less than (or equal to) 20 and greater than (or equal to) 10 corresponding to state value interval m, and the available channel number is less than (or equal to) 10 corresponding to state value interval m+1.

[0128] Exemplarily, the state threshold may be stored in a register, so that each current limiting module 40 can read the state threshold from the register. Among them, a register may be set for each current limiting module 40, so that a state threshold may be set for each current limiting module 40, that is, the state threshold set for each current limiting module 40 may be the same or different. Of course, each current limiting module 40 may also share a register, so that each current limiting module 40 may use the same state threshold. Moreover, by modifying the content of the register, the state threshold may be flexibly set to meet different bandwidth control requirements.

[0129] Among them, different state value intervals may correspond to different current limiting parameters. For the same state value interval, the current limiting parameters set for different operating systems may be the same or different. Table 4 takes the bandwidth resource of the second hardware unit 20 as 100 Gbps as an example, and illustrates the relationship between each bandwidth threshold and the state value interval of each operating system, wherein W represents the number of available channels of the cache queue.

[0130] Table 4:

[0131]

[0132]

[0133] It should be noted that the numerical values ​​disclosed in Table 4 are only examples and do not constitute specific limitations on the embodiments of the present disclosure.

[0134] Exemplarily, the relationship between the bandwidth threshold and the state value interval of each operating system can be stored in a register. Among them, a register can be set for each current limiting module 40, and each current limiting module 40 can also share a register, which is not specifically limited here. In addition, by modifying the content of the register, the relationship between the bandwidth threshold and the state value interval of each operating system can be flexibly set to meet different bandwidth control requirements.

[0135] Figure 5 It is a flowchart of step S120 of the bandwidth control method provided by an exemplary embodiment of the present disclosure.

[0136] like Figure 5 As shown, in one implementation, step S120 may include the following steps:

[0137] Step S121 : determining a first interval corresponding to the state value of the cache queue from a plurality of state value intervals.

[0138] Exemplarily, the state value of the cache queue may be numerically compared with at least one state threshold, and based on the numerical relationship between the state value and the at least one state threshold, a state value interval in which the state value lies may be determined, and the state value interval may be referred to as the first interval.

[0139] Step S122: determine the current limiting parameter corresponding to the first interval as the first current limiting parameter.

[0140] Exemplarily, the first current limiting module may determine the current limiting threshold of the first operating system corresponding to the first interval as the target bandwidth threshold of the first operating system. For example, the current limiting module 40-1 may determine the bandwidth threshold of OS1 corresponding to the first interval as the target bandwidth threshold of OS1, and the current limiting module 40-2 may determine the bandwidth threshold of OS2 corresponding to the first interval as the target bandwidth threshold of OS2.

[0141] Figure 6 It is a schematic diagram of determining a target bandwidth threshold provided by an exemplary embodiment of the present disclosure.

[0142] For example, Figure 6 As shown in Table 4, the m available channel number thresholds are W1=90, W2=80, ..., W m-1 =20, W m=10 as an example. If the number of available channels in the cache queue W = 91, then after comparison it can be determined that W≥W1, so the first interval is state value interval 1; then, the target bandwidth threshold of OS1 = 90Gbps, the target bandwidth threshold of OS2 = 70Gbps, and the target bandwidth threshold of OS3 = 60Gbps. If the number of available channels in the cache queue W = 85, then after comparison it can be determined that W1≥W≥W2, so the first interval is state value interval 2; then, the target bandwidth threshold of OS1 = 85Gbps, the target bandwidth threshold of OS2 = 65Gbps, and the target bandwidth threshold of OS3 = 55Gbps. If the number of available channels in the cache queue W = 8, then after comparison it can be determined that W≤W m Therefore, the first interval is the state value interval m+1; then, the target bandwidth threshold of OS1 = 50 Gbps, the target bandwidth threshold of OS2 = 30 Gbps, and the target bandwidth threshold of OS3 = 20 Gbps.

[0143] In one implementation, the first current limiting module may also compare the number of available channels of the cache queue with each available channel number threshold in sequence according to the order of the available channel number threshold from high to low or from low to high to determine the target bandwidth threshold of the first operating system.

[0144] In conjunction with Table 4, the current limiting module 40-1 determines the target bandwidth threshold of OS1 for example: if the number of available channels W = 95, the current limiting module 40-1 first compares the number of available channels W with the threshold of the number of available channels W1. Since W≥W1, the current limiting module 40-1 can determine that the target bandwidth threshold of OS1 is 90 Gbps without making subsequent comparisons. If the number of available channels W = 85, since W<W1, the current limiting module 40-1 first compares the number of available channels W with the threshold of the number of available channels W2. Since W≥W2, the current limiting module 40-1 can determine that the target bandwidth threshold of OS1 is 85 Gbps without making subsequent comparisons.

[0145] It can be seen that this implementation can reduce the number of comparisons, increase the speed at which the first current limiting module determines the target bandwidth threshold, and reduce the delay in the first current limiting module performing bandwidth control.

[0146] In the embodiment of the present disclosure, the first current limiting module may use bandwidth throttling to control the bandwidth of the first operating system accessing the second hardware unit 20, or may use outstanding request throttling to control the bandwidth of the first operating system accessing the second hardware unit 20. In addition, the first current limiting module may also use a combination of bandwidth throttling and outstanding request throttling to control the bandwidth of the first operating system accessing the second hardware unit 20. Of course, the first current limiting module may also use other current limiting methods to control the bandwidth of the first operating system accessing the second hardware unit 20, which is not limited in the embodiment of the present disclosure.

[0147] Exemplary Devices

[0148] The bandwidth control method provided by the embodiment of the present disclosure is introduced above. It is understandable that, in order to implement the functions of the control method, the integrated circuit (eg, SoC) or the first hardware unit in the SoC may include corresponding hardware and software for implementing the hardware functions.

[0149] Those skilled in the art should easily realize that, in combination with the steps of a bandwidth control method described in each embodiment of the present disclosure, each embodiment of the present disclosure can be implemented in the form of hardware, or in a combination of software-driven hardware. Whether a function is executed in hardware or software-driven hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present disclosure.

[0150] Figure 7 It is a structural diagram of a bandwidth control device provided by an exemplary embodiment of the present disclosure.

[0151] like Figure 7 As shown, in one embodiment, the bandwidth control device 300 includes:

[0152] The first current limiting module 310 is communicatively connected to the first hardware unit. For example, the first current limiting module 310 can be communicatively connected to at least one first functional module in the first hardware unit. The first hardware unit runs multiple operating systems, and the first current limiting module 310 corresponds to the first operating system. The first functional module may include: a functional module that runs the first operating system, and a functional module managed by the first operating system. The first current limiting module 310 is configured to: obtain the usage status of the cache queue, wherein the cache queue is used to cache the access of multiple operating systems running on the first hardware unit to the second hardware unit; determine the first current limiting parameter of the first operating system based on the usage status of the cache queue; and control the bandwidth of the first operating system accessing the second hardware unit based on the first current limiting parameter.

[0153] The cache queue is used to cache accesses of multiple operating systems to the second hardware unit. For example, the cache queue is used to cache read access instructions and / or write access instructions of multiple operating systems to the second hardware unit.

[0154] In one implementation, the first current limiting parameter includes a target bandwidth threshold of the first operating system; the first current limiting module 310 is configured to control the bandwidth of the first operating system accessing the second hardware unit to be less than or equal to the target bandwidth threshold.

[0155] In one implementation, the bandwidth control device 300 may further include a cache module 320. The cache module 320 is in communication with the first current limiting module 310 and the second hardware unit. The cache module 320 may include a cache queue. The usage status of the cache queue may be indicated by a status value of the cache queue, and the size of the status value represents the idleness or congestion of the cache queue. The cache module 320 is configured to send the status value of the cache queue to the first current limiting module 310.

[0156] In one example, the cache module 320 may be, for example, a bandwidth sharing module.

[0157] In one implementation, the cache queue may include multiple channels, each channel is used to cache an access instruction, and the state value of the cache queue includes the number of available channels or the number of unavailable channels of the cache queue. The cache module 320 is configured to send the number of available channels or the number of unavailable channels of the cache queue to the first current limiting module 310.

[0158] In one implementation, the first current limiting module 310 is configured to determine the first current limiting parameter from a plurality of current limiting parameters of the first operating system based on the state value, wherein each current limiting parameter includes a bandwidth threshold.

[0159] In one implementation, the first current limiting module 310 is configured to determine a first interval corresponding to a state value from multiple state value intervals, wherein each state value interval corresponds to a current limiting parameter; and determine the current limiting parameter corresponding to the first interval as the first current limiting parameter.

[0160] In one implementation, the plurality of state value intervals are separated by a plurality of state thresholds. The first current limiting module 310 is configured to determine the first interval based on a numerical relationship between the state value and at least one state threshold.

[0161] It can be seen from the above technical solutions that the device provided by the embodiment of the present disclosure can dynamically control the bandwidth of each operating system accessing the second hardware unit according to the usage status of the cache queue, so that the bandwidth resource allocation of the second hardware unit is more reasonable, which can not only improve the business performance of each operating system, but also improve the utilization rate of bandwidth resources and reduce the waste of bandwidth resources.

[0162] Exemplary Integrated Circuits

[0163] The embodiment of the present disclosure also provides an integrated circuit, which may be, for example, a SoC.

[0164] Figure 8 It is a schematic diagram of the structure of an integrated circuit provided by an exemplary embodiment of the present disclosure.

[0165] like Figure 8 As shown, in one implementation, the integrated circuit 1000 includes a first hardware unit 10, and the first hardware unit 10 runs multiple operating systems. Among them: the first hardware unit 10 may include multiple functional modules on the integrated circuit 1000. Each functional module is used to implement one or more functions of the integrated circuit 1000. For example, the functional module may be a CPU, a GPU, a BPU, an ISP, a DSP, etc. In addition, the functional module may also be a core of a CPU, a stream processor of a GPU, a computing unit of a BPU, etc.

[0166] In one implementation, each functional module of the first hardware unit 10 may communicate with other hardware units (eg, the second hardware unit 20 ), for example, access the second hardware unit 20 .

[0167] The second hardware unit 20 may include a memory, such as a memory, or other hardware units that communicate with the first hardware unit 10. Exemplarily, the second hardware unit 20 may be a DRAM and / or an SRAM. In one example, the second hardware unit 20 may be located on the integrated circuit 1000, for example, the second hardware unit 20 may be an SRAM integrated on the SoC. In another example, the second hardware unit 20 may also be independently provided relative to the integrated circuit 1000, for example, the second hardware unit 20 may be a DRAM independently provided relative to the SoC.

[0168] In one embodiment, the integrated circuit 1000 also includes: a plurality of current limiting modules 40 corresponding to a plurality of operating systems, wherein the current limiting modules 40 are communicatively connected to the first hardware unit 10; and at least one current limiting module 40 is configured to implement the function of the first current limiting module in the bandwidth control device, for example, to implement the steps of the bandwidth control method provided in the embodiment of the present disclosure.

[0169] In one example, the current limiting module 40 can obtain the usage status of the cache queue; based on the usage status of the cache queue, determine the current limiting parameters of the operating system corresponding to the current limiting module 40; next, the current limiting module 40 can control the bandwidth of the operating system corresponding to the current limiting module 40 accessing the second hardware unit 20 based on the current limiting parameters of the corresponding operating system.

[0170] In one implementation, the integrated circuit 1000 may further include a bandwidth sharing module 30. The bandwidth sharing module may also be referred to as a cache module.

[0171] In one example, the bandwidth sharing module 30 includes a cache queue. The usage status of the cache queue can be indicated by a status value of the cache queue, and the bandwidth sharing module 30 can send the status value of the cache queue to each current limiting module 40.

[0172] It can be seen from the above technical solutions that the integrated circuit provided by the embodiment of the present disclosure can dynamically control the bandwidth of each operating system accessing the second hardware unit according to the usage status of the cache queue, so that the bandwidth resource allocation of the second hardware unit is more reasonable, which can not only improve the business performance of each operating system, but also improve the utilization rate of bandwidth resources and reduce the waste of bandwidth resources.

[0173] Exemplary Electronic Devices

[0174] The present disclosure provides an electronic device that can be used in a vehicle, such as an intelligent network-connected car. The electronic device can be, for example, an on-board computing device, an on-board computing platform, an on-board computing unit, an intelligent driving computing platform, a mobile data center (MDC), etc.

[0175] In one embodiment, the electronic device may include an integrated circuit provided by an embodiment of the present disclosure, which may run at least one operating system, such as an intelligent driving system and a cockpit system, to implement relevant functions of the cabin-cockpit integrated system.

[0176] In one embodiment, the electronic device may further include:

[0177] The housing is used to accommodate and install various components of the electronic equipment, protect the components from being affected by dust and water, and improve the reliability of the electronic equipment.

[0178] The power module is used to supply power to various hardware units of the electronic device.

[0179] Heat dissipation modules, such as cooling fans, liquid cooling devices, etc., are used to dissipate heat for components of electronic equipment, reduce the operating temperature of each component, and improve the operating stability of each component.

[0180] External interfaces are used to connect various sensors on the vehicle, such as cameras, lidar, millimeter-wave radar, ultrasonic radar, etc., to send instructions to each sensor or receive data sent back by the sensor. External interfaces can also be connected to various actuators of the vehicle, such as the drive system, brake system, steering system, etc., to send control instructions to each system and receive feedback from each system.

[0181] Example Vehicles

[0182] The embodiments of the present disclosure provide a vehicle, which may include a land vehicle, an air vehicle, a water vehicle, an underwater vehicle, a space vehicle, etc. For details about the vehicle, please refer to the above embodiments, which will not be repeated here. The vehicle may include an integrated circuit or an electronic device provided by the embodiments of the present disclosure to implement the bandwidth control method provided by the embodiments of the present disclosure.

[0183] Exemplary computer program products and computer-readable storage media

[0184] In addition to the above-mentioned methods and devices, an embodiment of the present disclosure may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the bandwidth control method according to various embodiments of the present disclosure described in the above-mentioned "Exemplary Method" section of this specification.

[0185] The computer program product may be written in any combination of one or more programming languages ​​to write program code for performing the operations of the disclosed embodiments, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0186] In addition, an embodiment of the present disclosure may also be a computer-readable storage medium having computer program instructions stored thereon. When the computer program instructions are executed by a processor, the processor executes the steps of the bandwidth control method according to various embodiments of the present disclosure described in the above “Exemplary Method” section of this specification.

[0187] Computer readable storage media can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical memory device, a magnetic memory device, or any suitable combination of the above.

[0188] The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, and are not limitations. The above details do not limit the present disclosure to the necessity of adopting the above specific details to be implemented.

[0189] The block diagrams of the devices, apparatuses, equipment, and systems involved in this disclosure are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagrams. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including," "comprising," "having," and the like are open words, referring to "including but not limited to," and can be used interchangeably therewith. The words "or" and "and" used herein refer to the words "and / or," and can be used interchangeably therewith, unless the context clearly indicates otherwise. The word "such as" used herein refers to the phrase "such as but not limited to," and can be used interchangeably therewith.

[0190] It should also be noted that in the apparatus, device and method of the present disclosure, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present disclosure.

[0191] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

[0192] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present disclosure to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims

1. A bandwidth control method, comprising: Acquire a usage status of a cache queue, wherein the cache queue is used to cache access to a second hardware unit by multiple operating systems running on the first hardware unit; Determining a first current limiting parameter of a first operating system based on a usage status of the cache queue; Based on the first current limiting parameter, the bandwidth of the first operating system accessing the second hardware unit is controlled.

2. The method according to claim 1, wherein: The first current limiting parameter includes a target bandwidth threshold of the first operating system; The controlling the bandwidth of the first operating system accessing the second hardware unit based on the first current limiting parameter includes: controlling the bandwidth of the first operating system accessing the second hardware unit to be less than or equal to the target bandwidth threshold.

3. The method according to claim 2, wherein: The usage status of the cache queue is indicated by a status value, and the status value represents the idleness or congestion level of the cache queue.

4. The method according to claim 3, wherein: The cache queue includes a plurality of channels, each of which is used to cache an access instruction, and the status value includes the number of available channels or the number of unavailable channels of the cache queue.

5. The method according to claim 3 or 4, wherein: The determining, based on the usage status of the cache queue, a first current limiting parameter of the first operating system includes: Based on the state value, the first current limiting parameter is determined from a plurality of current limiting parameters of the first operating system, wherein each of the current limiting parameters includes a bandwidth threshold.

6. The method according to claim 5, wherein: The determining the first current limiting parameter from a plurality of current limiting parameters of the first operating system based on the usage status of the cache queue includes: Determine a first interval corresponding to the state value from a plurality of state value intervals, wherein each of the state value intervals corresponds to one of the current limiting parameters; The current limiting parameter corresponding to the first interval is determined as the first current limiting parameter.

7. The method according to claim 6, wherein: The plurality of state value intervals are separated by a plurality of state thresholds; Determining a first interval corresponding to the state value from a plurality of state value intervals includes: determining the first interval based on a numerical relationship between the state value and at least one of the state thresholds.

8. The method according to claim 4, wherein: In a case where the state value includes the number of available channels of the cache queue, the target bandwidth threshold increases as the number of available channels of the cache queue increases; In a case where the state value includes the number of unavailable channels of the cache queue, the target bandwidth threshold decreases as the number of available channels of the cache queue increases.

9. A bandwidth control device, comprising: A first current limiting module, the first current limiting module is communicatively connected with a first hardware unit, the first hardware unit runs a plurality of operating systems, and the first current limiting module corresponds to the first operating system; The first current limiting module is configured as follows: Acquire a usage status of a cache queue, wherein the cache queue is used to cache access to a second hardware unit by a plurality of the operating systems running on the first hardware unit; Determining a first current limiting parameter of the first operating system based on a usage status of the cache queue; Based on the first current limiting parameter, the bandwidth of the first operating system accessing the second hardware unit is controlled.

10. An integrated circuit comprising: a first hardware unit, wherein the first hardware unit runs a plurality of operating systems; A plurality of current limiting modules are arranged in one-to-one correspondence with the plurality of operating systems, and the plurality of current limiting modules are communicatively connected with the first hardware unit, wherein at least one of the current limiting modules is configured to execute the method described in any one of claims 1-9.

11. An electronic device, comprising: The integrated circuit of claim 10.

12. A vehicle, comprising: The integrated circuit of claim 10 or the electronic device of claim 11.