Communication link establishment method and device, equipment, medium and program product
By building point-to-point communication links between dies within a node, treating dies as independent computing devices, the problem of the upper limit on the number of GPUs within a node is solved, enabling larger-scale aggregate communication, reducing cross-node communication latency, saving cluster setup costs, and improving training efficiency.
Patent Information
- Application Number
- CN202511965420.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-12-23
- Publication Date
- 2026-01-23
- Estimated Expiration
- 2045-12-23
AI Technical Summary
In existing distributed training systems, the upper limit on the number of GPUs within a node restricts the scale of collective communication. Cross-node communication is costly and suffers from significant latency overhead, making it difficult to meet the needs of large-scale parallel training.
By building point-to-point communication links between multiple dies within a node, treating each die as an independent computing device, the scale of aggregated communication is expanded, and communication latency between nodes is avoided.
It enables larger-scale parallel communication within a single node, saving cluster setup costs, reducing latency overhead, and improving training efficiency.
Smart Images

Figure CN121387809A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] Embodiments of the present application relate to the technical field of artificial intelligence chip, and in particular to a method and apparatus for establishing a communication link, a device, a medium and a program product. BACKGROUND
[0002] With the rapid growth of the parameter scale of deep learning models, distributed parallel training has become a key technology. In such training, multiple computing devices need to work together, and the collective communication operation is the core of synchronizing gradients and ensuring consistent computation, and its performance directly determines the overall training efficiency.
[0003] Existing distributed training systems usually adopt a hierarchical communication architecture: intra-node communication and inter-node communication. Within a single computing node, multiple GPUs communicate with each other through dedicated point-to-point links. Such communication has extremely high bandwidth and extremely low latency, enabling efficient intra-node collective communication. However, due to physical design and cost constraints, the number of GPUs that a single node can accommodate has an upper limit (usually 8 GPUs), so the scale of intra-node collective communication is limited to this upper limit.
[0004] When the model scale is further expanded and a larger scale of parallel groups is needed (for example, the tensor parallel dimension is expanded to 16), it is necessary to build a multi-node computing cluster across single nodes. In this architecture, GPUs within a node communicate through point-to-point links, while inter-node communication relies on high-performance networks. This cross-node network expansion approach has two main problems. On the one hand, the infrastructure cost of building and maintaining a high-performance network is high. On the other hand, the network bandwidth between nodes is much lower than the bandwidth within a node, causing serious latency overhead for network communication. SUMMARY
[0005] Embodiments of the present application provide a method and apparatus for establishing a communication link, a device, a medium and a program product, to expand the scale of single-node collective communication while reducing the cost of building a cluster and avoiding the latency overhead caused by inter-node communication.
[0006] In a first aspect, the embodiments of the present application provide a method for establishing a communication link, the method comprising: obtaining attribute information of each computing device deployed in a node, wherein the node deploys multiple computing devices, and each computing device includes multiple dies; for each computing device, performing the following operations: based on the attribute information of the computing device, configuring the attribute information of each die in the computing device to obtain the attribute information of multiple dies; According to the attribute information of the plurality of dies, a point-to-point communication link between the plurality of dies is constructed.
[0007] In a second aspect, an embodiment of the present application provides a device for establishing a communication link, the device comprising: an obtaining unit configured to obtain attribute information of each computing device deployed in a node, wherein the node deploys a plurality of computing devices, and each computing device comprises a plurality of dies; a processing unit configured to, for each computing device, perform the following operations respectively: based on the attribute information of the computing device, configuring attribute information of each die in the computing device, and obtaining attribute information of a plurality of dies; a constructing unit configured to construct, according to the attribute information of the plurality of dies, a point-to-point communication link between the plurality of dies.
[0008] Optionally, the constructing unit is specifically configured to: construct a point-to-point communication link between a plurality of dies in a same computing device, and construct a point-to-point communication link between a plurality of dies in different computing devices.
[0009] Optionally, the attribute information of the computing device comprises: an identifier of the computing device, a connection relationship between the computing device and other computing devices, and a point-to-point communication link bandwidth of the computing device. The processing unit is specifically configured to: generate an identifier of each die in the computing device based on the identifier of the computing device; generate an initial connection relationship between each die in the computing device and a die in other computing devices according to the connection relationship between the computing device and other computing devices, and add a connection relationship between the die and other dies belonging to a same computing device in the initial connection relationship of each die to obtain a connection relationship attribute of each die; allocate the point-to-point communication link bandwidth of the computing device to a plurality of dies in the computing device according to a preconfigured allocation manner to obtain a point-to-point communication link bandwidth of each die; combine the identifier, the connection relationship attribute, and the point-to-point communication link bandwidth of each die to generate the attribute information of each die.
[0010] Optionally, the processing unit is specifically configured to: extract an initial connection relationship between each die in the computing device and a die in other computing devices from the connection relationship between the computing device and other computing devices, wherein the connection relationship between the computing device and other computing devices comprises a connection relationship between each die in the computing device and a die in other computing devices.
[0011] In a third aspect, an embodiment of the present application provides a computer device, comprising a memory, a processor chip, and a computer program stored in the memory and executable on the processor chip, wherein the processor chip implements the steps of the method for establishing a communication link when executing the program.
[0012] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium storing a computer program executable by a computer device, wherein the program, when executed on the computer device, causes the computer device to perform the steps of the method for establishing a communication link.
[0013] In a fifth aspect, an embodiment of the present application provides a computer program product, comprising a computer program stored on a computer-readable storage medium, wherein the computer program comprises program instructions, and the program instructions, when executed on a computer device, cause the computer device to perform the steps of the method for establishing a communication link.
[0014] In an embodiment of the present application, in the case that multiple computing devices are deployed in a node and each computing device comprises multiple dies, the attribute information of each computing device deployed in the node is acquired, and for each computing device, the attribute information of each die in the computing device is configured based on the attribute information of the computing device, thereby obtaining the attribute information of the multiple dies, and then the dies are regarded as computing devices independently participating in computing, and a point-to-point communication link between the multiple dies is constructed according to the attribute information of the multiple dies.
[0015] Taking the case that a server configures eight computing devices and each computing device comprises two dies as an example, in an embodiment of the present application, by regarding the dies as computing devices independently participating in computing, a point-to-point communication link between the multiple dies is constructed in a single node, thereby realizing communication between 16 dies in a single server without changing the number of physical computing devices (8), and each die can process data as a computing device independently, thereby expanding the scale of collective communication in the node, and when a larger parallel group (for example, the dimension of tensor parallelism is expanded to 16) is needed, the larger parallel group can be realized in a single node, without the need to build two servers, thereby saving the cost of building a cluster, and in the collective communication built by the embodiment of the present application, the communication between the 16 dies belongs to intra-node communication, thereby effectively avoiding the delay overhead caused by inter-node communication. BRIEF DESCRIPTION OF DRAWINGS
[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without any creative effort.
[0017] Figure 1 A structure schematic diagram of an artificial intelligence chip provided for an embodiment of the present application is provided. Figure 2 A flow schematic diagram of a communication link establishment method provided for an embodiment of the present application is provided. Figure 3 A principle schematic diagram of a generation mode of a connection relationship attribute of a die provided for an embodiment of the present application is provided. Figure 4 A principle schematic diagram of establishment of a communication link in related technologies provided for an embodiment of the present application is provided. Figure 5 A principle schematic diagram of establishment of a communication link provided for an embodiment of the present application is provided. Figure 6 A structure schematic diagram of a communication link establishment device provided for an embodiment of the present application is provided. Figure 7 A structure schematic diagram of a computer device provided for an embodiment of the present application is provided. DETAILED DESCRIPTION
[0018] To make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions of the present application will be described below in detail with the drawings of the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments described in the present application document, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the technical solutions of the present application.
[0019] Some concepts involved in the embodiments of the present application will be introduced below.
[0020] 1, Intra-node communication refers to data communication occurring between multiple processors (such as GPUs, central processing units (CPUs)) inside the same physical server (or computing node). The communication between multiple processors is realized through a high-speed direct connection bus or a point-to-point communication link at the mainboard level, which has the advantages of high bandwidth and low delay.
[0021] 2, Inter-node communication refers to data communication occurring between different physical servers (or computing nodes). Different physical servers are connected through external network equipment and cables, and usually communicate using network protocols such as high-speed Ethernet. Compared with intra-node communication, inter-node communication has lower bandwidth and higher delay, and is affected by network topology and congestion.
[0022] The design idea of the embodiments of the present application will be briefly introduced below: In the related art, the number of GPUs that a single node can accommodate has an upper limit, and the multi-node computing cluster architecture has the following problems: on the one hand, the infrastructure cost required for building and maintaining a high-performance network is high; on the other hand, the network bandwidth between nodes is much lower than the bandwidth within a node, which causes serious delay overhead for network communication.
[0023] The embodiment of the present application provides a communication link establishment method and device, equipment, medium and program product. In the case that a plurality of computing devices are deployed in a node and each computing device includes a plurality of dies, attribute information of each computing device deployed in the node is acquired, and for each computing device, attribute information of each die in the computing device is configured based on the attribute information of the computing device, so as to obtain attribute information of the plurality of dies. Then, the dies are regarded as computing devices that independently participate in computing, and a point-to-point communication link between the plurality of dies is constructed according to the attribute information of the plurality of dies.
[0024] Taking the case that a server is configured with eight computing devices and each computing device includes two dies as an example, the embodiment of the present application can construct a point-to-point communication link between the plurality of dies in a single node by regarding the dies as computing devices that independently participate in computing. In this way, communication between 16 dies can be realized in a single server without changing the number of physical computing devices (8), and each die can process data as a computing device, thereby expanding the scale of collective communication in the node. In addition, when a larger parallel group (for example, the tensor parallel dimension is expanded to 16) is needed, it can be realized in a single node without the need to build two servers, thereby saving the cost of building a cluster. In the collective communication built by the embodiment of the present application, the communication between the 16 dies belongs to intra-node communication, which can effectively avoid the delay overhead caused by inter-node communication.
[0025] The preferred embodiments of the present application are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present application, and are not used to limit the present application, and the embodiments in the present application and the features in the embodiments can be combined with each other without conflict.
[0026] Reference Figure 1 which is a structure diagram of an artificial intelligence chip to which the embodiment of the present application is applicable. The artificial intelligence chip 100 at least includes a plurality of dies 102, wherein each die 102 can include a plurality of streaming processor clusters (SPC for short).
[0027] In the embodiment of the present application, the node deploys multiple computing devices, and each computing device includes multiple dies. When establishing a communication link, the drive controller (or operating system) obtains attribute information of each computing device deployed in the node, and for each computing device, based on the attribute information of the computing device, configures attribute information of each die in the computing device, thereby obtaining attribute information of multiple dies, and then regards the dies as computing devices that independently participate in computing, and constructs a point-to-point communication link between the multiple dies according to the attribute information of the multiple dies.
[0028] Compared with the traditional scheme (multiple dies in a computing device participate in computing as a whole), the embodiment of the present application can expand the scale of collective communication in the node by regarding the dies as computing devices that independently participate in computing and constructing a point-to-point communication link between the multiple dies in the node, while saving the cost of building a cluster and avoiding the delay overhead caused by inter-node communication.
[0029] In addition to the above structure, the artificial intelligence chip 100 in the present application can also include other structures, which are not limited in the present application.
[0030] The artificial intelligence chip 100 can be a GPU, a general-purpose graphics processing unit (GPGPU), a domain specific architecture (DSA), etc.
[0031] Specifically, the communication link established by the embodiment of the present application can be applied to processing large model inference tasks in various scenarios, such as image processing scenarios, speech processing scenarios, text processing scenarios, etc. The large model can process various tasks in the communication link constructed by the embodiment of the present application.
[0032] For example, in the text processing scenario, the input tensor of the large model can be text data used in text generation, text recognition, etc. After receiving the text data, the communication link constructed by the embodiment of the present application is used for parallel processing in the process of processing the text data by the large model, so as to reduce the delay overhead of data transmission or data synchronization in the processing process, and improve the inference efficiency and inference speed of the large model.
[0033] For example, in the speech processing scenario, the input tensor of the large model can be speech data used in speech enhancement, speech recognition, speech synthesis, etc. After receiving the speech data, the communication link constructed by the embodiment of the present application is used for parallel processing in the process of processing the speech data by the large model, so as to reduce the delay overhead of data transmission or data synchronization in the processing process, and improve the inference efficiency and inference speed of the large model.
[0034] For example, in the image processing scenario, the input tensor of the large model can be image data used in image preprocessing, image segmentation, target detection and other tasks. After receiving the image data, the large model is used to process the image data. In the processing process, the communication link constructed by the embodiments of the present application is used for parallel processing to reduce the delay overhead of data transmission or data synchronization in the processing process, and to improve the inference efficiency and inference speed of the large model.
[0035] The following will be based on the architecture diagram of the artificial intelligence chip shown in Figure 1 to specifically introduce the flow of the method for establishing a communication link provided by the embodiments of the present application. Referring to Figure 2 , the method is executed by an operating system or a driver program, and the method includes the following steps: S201, obtaining attribute information of each computing device deployed in a node, wherein the node deploys a plurality of computing devices, and each computing device includes a plurality of dies.
[0036] It should be noted that in the embodiments of the present application, the node, i.e., the computing node, can be a server, and the computing node deploys a plurality of computing devices (e.g., GPUs), and each computing device includes a plurality of dies. Taking the case where a computing device includes two dies as an example, one of the two dies is a master die and the other is a slave die, and the master die and the slave die process data at the same time.
[0037] In specific implementation, the attribute information of each computing device deployed in the node can be obtained in the manner in the related art, which is not limited in the embodiments of the present application. The attribute information of the computing device at least includes: an identifier of the computing device, a connection relationship between the computing device and other computing devices, and a point-to-point communication link bandwidth of the computing device.
[0038] The identifier of the computing device is used to uniquely identify the computing device, and the identifiers of different computing devices are different so as to distinguish different computing devices; the connection relationship between the computing device and other computing devices includes the connection relationship between each die in the computing device and the dies in other computing devices; and the point-to-point communication link bandwidth of the computing device refers to the point-to-point communication link bandwidth available to the computing device.
[0039] S202, for each computing device, the following operations are performed respectively: based on the attribute information of the computing device, configuring the attribute information of each die in the computing device to obtain the attribute information of the plurality of dies.
[0040] In implementation, after obtaining the attribute information of each computing device, for each computing device, the attribute information of each die in the computing device is configured based on the attribute information of the computing device, and after the attribute information of the dies in all computing devices is configured, the attribute information of the plurality of dies in the node is obtained.
[0041] It should be noted that the attribute information of the computing device at least includes the identifier of the computing device, the connection relationship of the computing device and other computing devices, and the point-to-point communication link bandwidth of the computing device. Therefore, when configuring the attribute information of the die, at least the identifier of the die, the connection relationship attribute of the die, and the point-to-point communication link bandwidth of the die need to be configured.
[0042] In actual application, when configuring the attribute information of each die in the computing device based on the attribute information of the computing device, the identifier of each die in the computing device can be generated based on the identifier of the computing device; the initial connection relationship of each die in the computing device and the die in other computing devices is generated respectively according to the connection relationship of the computing device and other computing devices, and the connection relationship of the die and other dies belonging to the same computing device is added in the initial connection relationship of each die to obtain the connection relationship attribute of each die; and the point-to-point communication link bandwidth of the computing device is allocated to the plurality of dies in the computing device according to the pre-configured allocation mode to obtain the point-to-point communication link bandwidth of each die.
[0043] Specifically, when generating the identifier of each die in the computing device, the identifier of each die is generated based on the identifier of the computing device in the embodiment of the application. In this way, the computing device to which each die belongs can be determined conveniently. For example, assuming that the identifier of the computing device is A0, and the computing device includes two dies, the identifiers of the two dies can be configured as A0_1 and A0_2 respectively.
[0044] Of course, it should be noted that in other embodiments of the application, when generating the identifier of each die in the computing device, the identifier of each die can also be configured by redefining rules without depending on the identifier of the computing device.
[0045] Specifically, when the initial connection relationship of each die in the computing device and the die in other computing devices is generated according to the connection relationship of the computing device and other computing devices, since the attribute information of the computing device (the connection relationship of the computing device and other computing devices) includes the connection relationship between each die in the computing device and the die in other computing devices, the initial connection relationship of each die and the die in other computing devices can be directly extracted from the attribute information of the computing device (the connection relationship of the computing device and other computing devices), and then the connection relationship of the die and other dies belonging to the same computing device is added in the initial connection relationship of each die to obtain the connection relationship attribute of each die.
[0046] In one example, as shown in FIG. 8, it is assumed that 8 GPUs are deployed in a node, which are GPU0, GPU1, GPU2, GPU3, GPU4, GPU5, GPU6 and GPU7 respectively. Each GPU includes two dies, die 30 and die 31 in GPU0, die 32 and die 33 in GPU1, die 34 and die 35 in GPU2, die 36 and die 37 in GPU3, die 300 and die 301 in GPU4, die 302 and die 303 in GPU5, die 304 and die 305 in GPU6, and die 306 and die 307 in GPU7. Figure 3
[0047] After obtaining the attribute information of each GPU, the connection relationship between each die in the GPU and the dies in other GPUs can be obtained (as shown in FIG. 9). Taking GPU0 as an example, the connection relationship between each die in GPU0 and the dies in other GPUs is as follows: die 30 is connected with die 32 in GPU1, die 30 is connected with die 34 in GPU2, die 30 is connected with die 36 in GPU3, die 30 is connected with die 300 in GPU4, die 31 is connected with die 33 in GPU1, die 31 is connected with die 35 in GPU2, die 31 is connected with die 37 in GPU3, and die 31 is connected with die 301 in GPU4. Figure 4
[0048] When configuring the connection relationship attribute of each die, the initial connection relationship of each die can be extracted from the attribute information of the GPU. Still taking GPU0 as an example, the initial connection relationship of die 30 and die 31 is extracted from the connection relationship between each die in GPU0 and the dies in other GPUs. The initial connection relationship of die 30 is as follows: die 30 is connected with die 32, die 30 is connected with die 34, die 30 is connected with die 36, and die 30 is connected with die 300. The initial connection relationship of die 31 is as follows: die 31 is connected with die 33, die 31 is connected with die 35, die 31 is connected with die 37, and die 31 is connected with die 301.
[0049] Then, in the initial connection relationship of each die, the connection relationship of the die and other dies belonging to the same computing device is added to obtain the connection relationship attribute of each die. Still taking die 30 and die 31 as an example, die 30 and die 31 belong to the same computing device (GPU0), and then the connection relationship of die 30 and die 31 is added in the initial connection relationship of die 30, and the connection relationship of die 31 and die 30 is added in the initial connection relationship of die 31. Finally, the connection relationship attribute of die 30 is obtained as: die 30 is connected with die 32, die 30 is connected with die 34, die 30 is connected with die 36, die 30 is connected with die 300, and die 30 is connected with die 31; and the connection relationship attribute of die 31 is obtained as: die 31 is connected with die 33, die 31 is connected with die 35, die 31 is connected with die 37, die 31 is connected with die 301, and die 31 is connected with die 30.
[0050] Similarly, the connection relationship attribute of each die in other GPUs can be generated in the same way as the connection relationship attribute of die 30 and die 31 in GPU0.
[0051] When the point-to-point communication link bandwidth of the computing device is allocated to the plurality of dies in the computing device according to the preconfigured allocation mode to obtain the point-to-point communication link bandwidth of each die, the preconfigured allocation mode can be set according to experience, which is not limited in the embodiments of the present application. For example, the preconfigured allocation mode can be equal division, and when the computing device includes two dies, if the point-to-point communication link bandwidth of the computing device is A, then the point-to-point communication link bandwidth obtained by each die is A / 2.
[0052] In specific implementation, after obtaining the identification, the connection relationship attribute, and the point-to-point communication link bandwidth of each die, the identification, the connection relationship attribute, and the point-to-point communication link bandwidth of each die can be combined to obtain the attribute information of each die.
[0053] S203, constructing the point-to-point communication link between the plurality of dies according to the attribute information of the plurality of dies.
[0054] In specific implementation, after obtaining the attribute information of the plurality of dies, the point-to-point communication link between the plurality of dies can be constructed, which includes constructing the point-to-point communication link between the plurality of dies in the same computing device, and constructing the point-to-point communication link between the plurality of dies in different computing devices, to generate the connection topology between the plurality of dies, and to construct the collective communication between the plurality of dies.
[0055] The above describes each implementation step of the method for establishing a communication link provided by the embodiments of the present application respectively. The following describes the method for establishing a communication link provided by the embodiments of the present application in combination with Figure 4 and Figure 5Taking the case of deploying two GPUs inside a node as an example, the method for establishing a communication link provided in the embodiments of the present application is described in detail in comparison with the method in the related art.
[0056] As shown in Figure 4 , two computing devices, GPU0 and GPU1, are deployed inside the node, each computing device including two dies, GPU0 including die 40 and die 41, and GPU1 including die 42 and die 43. In the related art, when building collective communication, a point-to-point communication link is built between die 40 and die 42, and a point-to-point communication link is built between die 41 and die 43 to generate a connection topology between GPU0 and GPU1, and the collective communication of the two computing devices is built, with a communication scale of 2.
[0057] As shown in Figure 5 , still taking the case shown in Figure 4 as an example, when building collective communication, the embodiments of the present application obtain attribute information of GPU0 and attribute information of GPU1, and then configure attribute information of die 40 and attribute information of die 41 based on the attribute information of GPU0, and configure attribute information of die 42 and attribute information of die 43 based on the attribute information of GPU1.
[0058] Then, the dies are regarded as computing devices that independently participate in computing, specifically, die 40 can be regarded as GPU00, die 41 can be regarded as GPU01, die 42 can be regarded as GPU10, and die 43 can be regarded as GPU11, and according to the attribute information of dies 40-43, a point-to-point communication link between dies 40-43 is built, specifically including a point-to-point communication link between die 40 and die 41, a point-to-point communication link between die 40 and die 42, a point-to-point communication link between die 41 and die 43, and a point-to-point communication link between die 42 and die 43, to generate a connection topology between dies 40-43, and the collective communication of the four computing devices is built in the form of a virtual computing device, with a communication scale of 4.
[0059] In comparison with Figure 4 and Figure 5 , it can be seen that the method for establishing a communication link provided in the embodiments of the present application can expand the collective communication scale inside a node, and the upper limit of the configuration of computing devices in a single node is currently 8, and when a larger parallel group (for example, the tensor parallel dimension is expanded to 16) is needed, two nodes need to be configured, and inter-node communication is introduced, while using the method for establishing a communication link provided in the embodiments of the present application, it can be implemented inside a single node, without the need to build two servers, saving the cost of building a cluster, and the communication between 16 dies is node-internal communication, which can effectively avoid the delay overhead caused by inter-node communication.
[0060] Based on the same technical concept, embodiments of this application provide a schematic diagram of the structure of a communication link establishment device, such as... Figure 6 As shown, the communication link establishment device 600 includes: The acquisition unit 601 is used to acquire attribute information of each computing device deployed within the node, wherein multiple computing devices are deployed within the node, and each computing device includes multiple bare dies. The processing unit 602 is configured to perform the following operations for each computing device: based on the attribute information of the computing device, configure the attribute information of each die in the computing device, and obtain the attribute information of multiple dies; The construction unit 603 is used to construct a point-to-point communication link between multiple dies based on the attribute information of multiple dies.
[0061] Optionally, building unit 603 is specifically used for: Construct point-to-point communication links between multiple dies in the same computing device, and construct point-to-point communication links between multiple dies in different computing devices.
[0062] Optionally, the attribute information of the computing device includes: the identifier of the computing device, the connection relationship between the computing device and other computing devices, and the point-to-point communication link bandwidth of the computing device; Processing unit 602 is specifically used for: Based on the identifier of the computing device, generate the identifier of each bare die in the computing device; Based on the connection relationship between the computing device and other computing devices, the initial connection relationship between each bare die in the computing device and the bare dies in other computing devices is generated respectively. Then, the connection relationship between the bare die and other bare dies belonging to the same computing device is added to the initial connection relationship of each bare die, so as to obtain the connection relationship attribute of each bare die. Based on a pre-configured allocation method, the point-to-point communication link bandwidth of the computing device is allocated to multiple dies in the computing device, resulting in the point-to-point communication link bandwidth for each die. The attribute information of each chip is generated by combining the identifier, connection relationship attributes, and point-to-point communication link bandwidth of each chip.
[0063] Optionally, the processing unit 602 is specifically used for: From the connection relationships between the computing device and other computing devices, extract the initial connection relationships between each die in the computing device and the dies in other computing devices. The connection relationships between the computing device and other computing devices include the connection relationships between each die in the computing device and the dies in other computing devices.
[0064] Based on the same technical concept, embodiments of this application provide a computer device, such as... Figure 7As shown, the computer device includes at least one processor chip 701 and a memory 702 connected with the at least one processor chip. In the embodiments of the present application, the specific connection medium between the processor chip 701 and the memory 702 is not limited, Figure 7 For example, the processor chip 701 and the memory 702 are connected through a bus. The bus can be divided into an address bus, a data bus, a control bus, etc.
[0065] In the embodiments of the present application, the memory 702 stores instructions executable by the at least one processor chip 701. The at least one processor chip 701 can execute the steps of the method for establishing a communication link by executing the instructions stored in the memory 702.
[0066] The processor chip 701 is the control center of the computer device, and can connect various parts of the computer device through various interfaces and lines, and realize data processing by running or executing instructions stored in the memory 702 and calling data stored in the memory 702. Optionally, the processor chip 701 can include one or more processing units, and the processor chip 701 can integrate an application processor and a modem processor. The application processor mainly processes an operating system, a user interface, and an application program, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor can also not be integrated into the processor chip 701. In some embodiments, the processor chip 701 and the memory 702 can be implemented on the same chip, and in some embodiments, they can also be implemented on independent chips respectively.
[0067] The processor chip 701 can be a general-purpose processor, such as a graphics processing unit (GPU), a general-purpose computing on graphics processing units (GPGPU), a central processing unit (CPU), a digital signal processor, an application specific integrated circuit (ASIC), a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, which can implement or execute the methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as execution completed by a hardware processor, or executed by a combination of hardware and software modules in the processor.
[0068] The memory 702, as a non-volatile computer readable storage medium, can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory 702 can include at least one type of storage medium, for example, can include flash memory, hard disk, multimedia card, card type memory, random access memory (RAM), static random access memory (SRAM), programmable read-only memory (PROM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic storage, magnetic disk, optical disk, etc. The memory 702 is any other medium capable of carrying or storing desired program codes in the form of instructions or data structures and capable of being accessed by a computer device, but is not limited thereto. The memory 702 in the embodiments of the present application can also be a circuit or any other device capable of realizing a storage function, used to store program instructions and / or data.
[0069] Based on the same inventive concept, the embodiments of the present application provide a computer readable storage medium storing a computer program executable by a computer device, which, when executed on the computer device, causes the computer device to perform the steps of the method for establishing a communication link.
[0070] Based on the same inventive concept, the embodiments of the present application provide a computer program product, which comprises a computer program stored on a computer readable storage medium, the computer program comprising program instructions, which, when executed by a computer device, cause the computer device to perform the steps of the method for establishing a communication link.
[0071] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, or a computer program product. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage, etc.) containing computer-usable program code.
[0072] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 means for functionally implementing the steps listed in the flowchart block or blocks.
[0073] These computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture including instructions which implement the function specified in the flowchart block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 means for functionally implementing the steps listed in the flowchart block or blocks.
[0074] The computer program instructions can also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks. Figure 1 one or more flowcharts and / or blocks Figure 1 means for functionally implementing the steps listed in the flowchart block or blocks.
[0075] While the preferred embodiments of the application have been described, additional variations and modifications can be employed by those skilled in the art. Therefore, the appended claims are intended to cover all such variations and modifications as falling within the scope of the application.
[0076] Obviously, numerous modifications and variations of the present application are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims and their equivalents, the application can be practiced otherwise than as specifically described.
Claims
1. A method for establishing a communication link, characterized in that, The method includes: Obtain attribute information of each computing device deployed within the node, wherein multiple computing devices are deployed within the node, and each computing device includes multiple bare dies; For each of the aforementioned computing devices, the following operations are performed: Based on the attribute information of the computing device, configure the attribute information of each die in the computing device to obtain the attribute information of multiple dies; Based on the attribute information of the multiple dies, a point-to-point communication link is constructed between the multiple dies.
2. The method according to claim 1, characterized in that, The construction of the point-to-point communication link between the multiple dies includes: Construct point-to-point communication links between multiple dies in the same computing device, and construct point-to-point communication links between multiple dies in different computing devices.
3. The method according to claim 1, characterized in that, The attribute information of the computing device includes: the identifier of the computing device, the connection relationship between the computing device and other computing devices, and the point-to-point communication link bandwidth of the computing device; The step of configuring the attribute information of each die in the computing device based on the attribute information of the computing device includes: Based on the identifier of the computing device, generate the identifier of each die in the computing device; Based on the connection relationship between the computing device and other computing devices, the initial connection relationship between each die in the computing device and the dies in other computing devices is generated respectively. Then, the connection relationship between the die and other dies belonging to the same computing device is added to the initial connection relationship of each die to obtain the connection relationship attribute of each die. According to a pre-configured allocation method, the point-to-point communication link bandwidth of the computing device is allocated to multiple dies in the computing device to obtain the point-to-point communication link bandwidth of each die. The attribute information of each of the bare chips is generated by combining the identifier, connection relationship attributes, and point-to-point communication link bandwidth of each bare chip.
4. The method according to claim 3, characterized in that, The step of generating initial connection relationships between each die in the computing device and dies in other computing devices based on the connection relationships between the computing device and other computing devices includes: From the connection relationships between the computing device and other computing devices, the initial connection relationships between each die in the computing device and the dies in other computing devices are extracted, wherein the connection relationships between the computing device and other computing devices include: the connection relationships between each die in the computing device and the dies in other computing devices.
5. A communication link establishment device, characterized in that, The device includes: An acquisition unit is used to acquire attribute information of each computing device deployed within a node, wherein multiple computing devices are deployed within the node, and each computing device includes multiple bare dies; The processing unit is configured to perform the following operations for each of the computing devices: based on the attribute information of the computing device, configure the attribute information of each die in the computing device, and obtain the attribute information of multiple dies; The construction unit is used to construct a point-to-point communication link between the multiple dies based on their attribute information.
6. The apparatus according to claim 5, characterized in that, The building unit is specifically used for: Construct point-to-point communication links between multiple dies in the same computing device, and construct point-to-point communication links between multiple dies in different computing devices.
7. The apparatus according to claim 5, characterized in that, The attribute information of the computing device includes: the identifier of the computing device, the connection relationship between the computing device and other computing devices, and the point-to-point communication link bandwidth of the computing device; The processing unit is specifically used for: Based on the identifier of the computing device, generate the identifier of each die in the computing device; Based on the connection relationship between the computing device and other computing devices, the initial connection relationship between each die in the computing device and the dies in other computing devices is generated respectively. Then, the connection relationship between the die and other dies belonging to the same computing device is added to the initial connection relationship of each die to obtain the connection relationship attribute of each die. According to a pre-configured allocation method, the point-to-point communication link bandwidth of the computing device is allocated to multiple dies in the computing device to obtain the point-to-point communication link bandwidth of each die. The attribute information of each of the bare chips is generated by combining the identifier, connection relationship attributes, and point-to-point communication link bandwidth of each bare chip.
8. A computer device, comprising a memory, a processor chip, and a computer program stored in the memory and executable on the processor chip, characterized in that, When the processor chip executes the program, it implements the steps of the method according to any one of claims 1 to 4.
9. A computer-readable storage medium, characterized in that, It stores a computer program executable by a computer device, which, when run on the computer device, causes the computer device to perform the steps of the method according to any one of claims 1 to 4.
10. A computer program product, characterized in that, The computer program product includes a computer program stored on a computer-readable storage medium, the computer program including program instructions that, when executed by a computer device, cause the computer device to perform the steps of the method according to any one of claims 1-4.
Citation Information
Patent Citations
Local application partitioning in stacked memory system
CN116893777A
Computing method based on multiple bare chips and related equipment
CN117827419A
Die communication system, chip, and die communication method
CN118277325A
Backside interface for chiplet architecture mixing
CN120359615A
Tensor segmentation method and device, storage medium and program product
CN121050895A
Cited By
Communication method and device, electronic equipment, computer readable storage medium and computer program product
CN122019456A
Communication method and apparatus, electronic device, computer-readable storage medium, and computer program product
CN122019456B