A data processing method, an electronic device, and a storage medium

By setting partitioning information in memory, model parameters and data are partitioned, and multiple cores of a multi-core NPU are used for simultaneous processing. This solves the problems of wasted computing resources in multi-core NPUs and storage pressure on single cores, thereby improving data processing efficiency and reducing latency.

CN116957029BActive Publication Date: 2026-06-26ARM TECH CHINA CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
ARM TECH CHINA CO LTD
Filing Date
2023-07-28
Publication Date
2026-06-26

Smart Images

  • Figure CN116957029B_ABST
    Figure CN116957029B_ABST
Patent Text Reader

Abstract

The application relates to the technical field of artificial intelligence, and discloses a data processing method, an electronic device and a storage medium. In the method, part of cascaded nodes in a model is divided into a node set, parameters corresponding to all nodes in the node set are divided into a parameter set, a plurality of parameter sets are obtained, and / or input data of any node in the model is divided into a plurality of data sets. When a multi-core NPU performs data processing, a plurality of cores in the multi-core NPU can be used to simultaneously load different parameter sets corresponding to different node sets, and the input data of the node set can be processed respectively, and / or a plurality of cores in the multi-core NPU can be used to simultaneously load parameter sets corresponding to the same node, and different data sets of the node can be processed respectively. In this way, the waste of computing power resources of the multi-core NPU can be reduced under the condition that the input and output data before and after the model is divided are the same.
Need to check novelty before this filing date? Find Prior Art