This invention discloses a GPU ensemble communication method,
system, device, medium, and product. The method first maps ensemble communication interfaces from different GPU device manufacturers to a unified standard API interface based on GPU device manufacturer information, generating an interface mapping relationship. When responding to a ensemble communication request initiated by a user calling the API interface, the method translates the ensemble communication request into a corresponding manufacturer's ensemble
communication interface request based on the GPU type used by the user and the interface mapping relationship, thereby invoking the corresponding manufacturer's ensemble
communication interface to perform ensemble communication operations. Using this invention can reduce the development and maintenance complexity of multi-GPU ensemble communication systems and improve the overall performance and efficiency of distributed training of AI models.