神经网络推理芯片、方法及终端设备

By introducing a control scheduler (SSP), a vector processor (VSP), a multiplication matrix processor (MMP), and a partial sum processor (PSUM) into the neural network inference chip, the reuse of convolutional and non-convolutional computations in non-depth directions is achieved, solving the problem of insufficient computing resource utilization and improving computing efficiency and energy efficiency.

CN117332809BActive Publication Date: 2026-07-17GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
Filing Date
2022-06-22
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing dedicated neural network inference chips suffer from insufficient utilization of computing resources under high computational and memory resource requirements, making it difficult to effectively improve their efficiency.

Method used

By introducing a control scheduler (SSP), a vector processor (VSP), a multiplication matrix processor (MMP), and a partial sum processor (PSUM) into the neural network inference chip, the reuse of convolutional and non-convolutional computations in non-depth directions is achieved, sharing hardware computing resources.

Benefits of technology

It improves the utilization rate of computing resources, reduces the duplication of hardware resources for different computing types, and enhances the computing efficiency and energy efficiency of the chip.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117332809B_ABST
    Figure CN117332809B_ABST
Patent Text Reader

Abstract

本申请实施例公开一种神经网络推理芯片、方法及终端设备,芯片包括:控制调度器SSP和计算模块,计算模块包括:VSP、MMP以及PSUM;SSP,用于通过解析神经网络的结构参数生成控制指令,并将特征图及控制指令发送至VSP;VSP,用于根据特征图生成第一计算数据,并将控制指令中的非深度计算指令和第一计算数据发送至MMP;非深度计算指令包括第一卷积计算指令或非卷积计算指令;MMP,存储有权重数据,用于根据非深度计算指令、第一计算数据以及权重数据执行卷积计算,得到第一计算结果;PSUM,用于根据第一计算结果确定第二计算结果。实施本申请实施例,能够复用神经网络推理芯片进行不同算子的计算,可以提高计算资源的利用率。
Need to check novelty before this filing date? Find Prior Art