148results about "Operational speed enhancement" patented technology

The invention discloses a multiplication acceleration method and device for double sparse matrixes, equipment, a medium and a product. The method comprises the following steps: positioning a compression matrix set matched with a first sparse matrix and a second sparse matrix in a global memory of a computing chip according to a sparse matrix multiplication demand; carrying the compression matrix set and the second sparse matrix step by step from the global memory to a hardware register of the computing chip in a data block form; and gradually calculating a multiplication result of the first sparse matrix and the second sparse matrix through a sparse calculation unit of the calculation chip according to the data loaded in the hardware register by several times. According to the technical scheme of the embodiment of the invention, the hardware acceleration performance of the sparse computing unit in the computing chip can be brought into full play, so that the overhead of computing, bandwidth and storage resources in the double sparse matrix multiplication process is greatly optimized, and the method is particularly suitable for a model computing scene of a hybrid expert model.

The invention relates to a cluster-oriented large model parallelization method and device and an electronic device.The method is applied to the field of large models.The method comprises the steps that operator information of a cluster-oriented large model in a preset microprocessing batch and a preset parallelization mode is obtained, the operator information comprises operator time information and operator memory information of operators in the cluster-oriented large model; the cluster comprises one or more types of accelerators; determining an initial operator parallel configuration strategy of a plurality of assembly lines in the large model based on the operator information, model memory information required by the large model and a memory extreme value of an accelerator; and performing recursion processing on the initial operator parallel configuration strategy according to a preset load balancing mode to obtain a target operator parallel configuration strategy, and running the cluster-oriented large model based on the target operator parallel configuration strategy. According to the method and the device, the utilization efficiency of chip calculation performance during large model parallel configuration is improved, and high efficiency and wide application range of large model training are realized.

The invention relates to the technical field of computers, and discloses a heterogeneous acceleration system and method, computing equipment and a storage medium, and the system comprises a host end which is used for obtaining any acceleration task of the computing equipment, splitting the acceleration task into a plurality of sub-tasks, and unloading the plurality of sub-tasks to a heterogeneous acceleration card; the heterogeneous acceleration card is used for receiving and executing a plurality of sub-tasks, generating a corresponding interrupt sub-request when execution of any sub-task is completed, generating a target interrupt request under the condition that the total amount of the currently obtained interrupt sub-requests reaches a preset threshold value, and sending the target interrupt request to the host end; and the host end is used for receiving the target interrupt request and reading the execution result of the subtask from the heterogeneous accelerator card in response to the target interrupt request. The heterogeneous accelerator card is prevented from sending a large number of interrupt sub-requests to the host end in a short time, so that the host end is prevented from frequently responding to the interrupt request, and the overall performance of the computing device is improved.

The invention relates to the field of artificial intelligence, in particular to an AI accelerator construction method and a related device. The method comprises the following steps: importing machine learning models of different AI frames through a multi-frame adaptation interface, and converting the machine learning models into linear algebraic dialect representation by adopting an MMIR dialect conversion chain; through target-independent optimization processing, core calculation semantics in linear algebraic dialects are reserved, and linear algebraic dialect representation is reconstructed into optimization intermediate representation with an efficient data flow structure; identifying target hardware characteristics of the target hardware; adaptively executing hardware optimization processing matched with target hardware characteristics on the optimization intermediate representation; and converting the target intermediate representation into a hardware operation unit executable by the target hardware, loading the hardware operation unit into the target hardware to obtain an AI accelerator, thereby running the hardware operation unit on the target hardware through the AI accelerator, scheduling corresponding computing resources in the target hardware, and completing hardware acceleration of the machine learning model.

The invention discloses a pulse neural network hardware accelerator and a data processing method, and the accelerator is characterized in that a low-power-consumption three-stage pipeline CPU module is used for receiving input data, scheduling an SNN network acceleration instruction, and sending the input data to an asynchronous edge SNN hardware accelerator module through a coprocessor interface; the asynchronous edge SNN hardware accelerator module comprises a pulse data encoding and decoding module, L neuromorphic kernels and an on-chip network, the pulse data encoding and decoding module encodes input data into a pulse form and sends the pulse form into the neuromorphic kernels, and the neuromorphic kernels are used for performing calculation based on the data in the pulse form; the network-on-chip is used for communication between the neuromorphic kernels, and the connection between neurons before and after synapses in the neuromorphic kernels is realized by adopting a synaptic cross array. According to the invention, the data processing acceleration performance can be greatly improved.

Apparatuses, systems, and techniques to identify instructions for advanced execution. In at least one embodiment, a processor performs one or more instructions that have been identified by a compiler to be speculatively performed in parallel.

The invention relates to the field of instruction scheduling of a DSP (Digital Signal Processor), and discloses a self-adaptive weighted greedy instruction scheduling system and a self-adaptive weighted greedy instruction scheduling method for the DSP. The system comprises a ready instruction queue input module, a greedy scoring decision module, a self-adaptive weight adjustment module, a scheduling queue generation module, a scheduling termination check module, a ready queue updating module and a post-scheduling instruction queue output module. According to the system and method disclosed by the invention, factors such as instruction delay, register pressure and critical paths are comprehensively considered, an adaptive weight dynamic adjustment mechanism is introduced, multi-objective optimization is balanced on the basis of a greedy strategy, different program characteristics can be flexibly adapted, hardware resources are efficiently utilized, the scheduling quality in a complex scene is improved, and the scheduling efficiency is improved. The overall program performance is improved. Meanwhile, the algorithm is improved on the basis of an original algorithm, a large part of content is reused, the complexity is moderate, implementation and integration in a compiler are easy, and high practicability and engineering value are achieved.

The invention relates to the technical field of geographic information systems, in particular to a GIS buffer zone parameter inference method based on deep learning, and the method comprises the following steps: obtaining a natural language instruction input by a user; analyzing the natural language instruction to extract a geographic entity keyword and a fuzzy description word; based on the fuzzy description word, determining an initial distance parameter through a pre-trained language-space mapping model; querying a spatial database based on the geographic entity keyword to obtain geographic entity attributes; according to the geographic entity attribute, correcting the initial distance parameter to obtain a corrected distance parameter; a field programmable gate array (FPGA) is used for carrying out parallel calculation on the spatial relation matrix to generate an optimized buffer area; and outputting the optimized buffer area. According to the method, the FPGA is introduced to carry out parallel calculation of the spatial relation matrix, so that the data processing speed and the energy efficiency ratio are remarkably improved, and the real-time generation of the buffer area is realized.

The present application belongs to the technical field of communications. Disclosed are a data reduction method and apparatus, and a device and a computer-readable storage medium. The method is applied to at least one root node in a multi-dimensional direct-connect topology, wherein nodes in the multi-dimensional direct-connect topology are used for model training. The method comprises: receiving first data, wherein the first data is part of transmitted data, which is data transmitted between nodes in a model training process; obtaining second data, wherein the second data is part of first generated data, which is data generated by a root node in the model training process; performing reduction on the first data and the second data to obtain third data, wherein the third data is used by nodes in a multi-dimensional direct-connect topology to execute subsequent model training; and sending the third data to a first node in the multi-dimensional direct-connect topology, wherein the first node is a node in the multi-dimensional direct-connect topology other than the root node. The method can improve the communication efficiency in a data reduction process.

Embodiments described herein provided for an instruction and associated logic to enable a processing resource including a tensor accelerator to perform optimized computation of sparse submatrix operations. One embodiment provides a parallel processor comprising a processing cluster coupled with the cache memory. The processing cluster includes a plurality of multiprocessors coupled with a data interconnect, where a multiprocessor of the plurality of multiprocessors includes a tensor core configured to load tensor data and metadata associated with the tensor data from the cache memory, wherein the metadata indicates a first numerical transform applied to the tensor data, perform an inverse transform of the first numerical transform, perform a tensor operation on the tensor data after the inverse transform is performed, and write output of the tensor operation to a memory coupled with the processing cluster.

The invention discloses a data reduction method, device and equipment and a computer readable storage medium, and belongs to the technical field of communication. The method is applied to at least one root node in a multi-dimensional direct connection topology, the nodes in the multi-dimensional direct connection topology are used for model training, and the method comprises the steps that first data are received, the first data are partial data of transmission data, and the transmission data are data transmitted among the nodes in the model training process; second data is obtained, the second data is part of first generated data, and the first generated data is data generated by the root node in the model training process; the first data and the second data are reduced to obtain third data, and the third data are used for nodes in the multi-dimensional direct connection topology to execute subsequent model training; and sending the third data to a first node in the multi-dimensional direct connection topology, wherein the first node is a node except the root node in the multi-dimensional direct connection topology. According to the method, the communication efficiency in the data reduction process can be improved.

The embodiment of the invention provides an instruction distribution device and method, a processor and electronic equipment. The instruction distribution device comprises a write selection module, a plurality of micro instruction queues and a read distribution module. The write selection module is configured to write microinstructions into a plurality of microinstruction queues; the plurality of microinstruction queues are configured to cache written microinstructions; and the read distribution module is configured to read the microinstructions from the plurality of microinstruction queues, obtain a target microinstruction group to be distributed at this time based on the read microinstructions, and execute a distribution operation. The instruction distribution device improves the bandwidth of instruction distribution by setting a plurality of microinstruction queues and a scheduling method of the plurality of microinstruction queues, thereby promoting the improvement of the performance of a processor.

A data processing system is presented in a client-server configuration for executing first and second applications that a client in the client-server configuration can offload for execution onto the data processing system. The data processing system includes a server and a pool of reconfigurable data flow resources that is configured to execute the first application in a first runtime context and the second application in a second runtime context. The server is configured to establish a session with the client, receive first and second execution requests for executing the first application and the second application from the client, start respective first and second execution of the first and second applications in the respective first and second runtime contexts in response to receiving the first and second execution requests, and balance a first load from the first execution with a second load from the second execution.

The present invention discloses a method, apparatus, device, medium and product for accelerating the multiplication of double sparse matrices. The method includes: locating a set of compressed matrices matching a first sparse matrix and a second sparse matrix in the global memory of a computing chip according to the sparse matrix multiplication requirement; sequentially transferring the set of compressed matrices and the second sparse matrix from the global memory to the hardware registers of the computing chip in the form of data blocks; and gradually calculating the multiplication result of the first sparse matrix and the second sparse matrix by a sparse computing unit of the computing chip according to the data loaded in batches in the hardware registers. The technical solution of the embodiments of the present invention can give full play to the hardware acceleration performance of the sparse computing unit in the computing chip, and thus greatly optimize the overhead of computing, bandwidth and storage resources in the process of multiplying double sparse matrices, and is particularly applicable to the model calculation scenario of a mixture-of-experts model.

Disclosed are a method and apparatus for controlling a hardware accelerator. The method includes setting a delay time related to task performance of a specific hardware accelerator, switching to a sleep state during the set delay time from a request time point when making a request, to a central processing unit (CPU), for requesting the specific hardware accelerator to accelerate a task, polling the state of the specific hardware accelerator to the CPU by switching from the sleep state to an operating state after the delay time, not polling a state of the specific hardware accelerator to the CPU during the delay time when switching to the sleep state, and receiving result information corresponding to the polling from the CPU in response to the polling.

An operating method of a computational storage device includes: setting a first computing namespace, including a first queue and a first accelerator and having a first value as its first ID, per instructions from a first host; setting a second computing namespace, including a second queue and a second accelerator and having a second value as its first ID, per instructions from a second host; loading a first program from the first host in the first computing namespace; loading a second program from the second host in the second computing namespace; setting a second ID of the first computing namespace to a third value based on an ID of the first program per instructions to activate the first program; and setting the second ID of the second computing namespace to a fourth value based on an ID of the second program per instructions to activate the second program.

The present invention provides a vehicle scheduling simulation method, device and system, the method comprising: obtaining task data of multiple vehicle scheduling simulation tasks, and isolating and storing the task data of each of the vehicle scheduling simulation tasks; executing each of the vehicle scheduling simulation tasks in parallel based on the stored task data and the target vehicle scheduling algorithm, and obtaining the simulation result of each of the vehicle scheduling simulation tasks; obtaining the target simulation result of the target vehicle scheduling algorithm based on the simulation result of each of the vehicle scheduling simulation tasks. The vehicle scheduling simulation method, device and system provided by the present invention can realize the parallel execution of multiple vehicle scheduling simulation tasks, can reduce the time cost required for vehicle scheduling simulation, and improve the simulation efficiency of the vehicle scheduling algorithm.

A chip is disclosed, belonging to the field of electronic technology. The chip includes a dedicated scheduler, a general scheduler, and a plurality of hardware accelerators. The plurality of hardware accelerators are connected by soft connections, at least one hardware accelerator is connected to the dedicated scheduler, and at least one hardware accelerator is connected to the general scheduler. The processing flow of the dedicated scheduler is relatively fixed and the processing efficiency is relatively high. The processing flow of the general scheduler is relatively flexible and can overcome hardware design defects and improve performance through software programming. Therefore, it can provide processing flexibility while ensuring the processing efficiency of the chip.

The invention relates to the technical field of in-storage computing, and discloses a system and method for directly processing data in a storage medium, the storage medium is used for providing a hardware acceleration assembly specially used for data processing, and the hardware acceleration assembly comprises a mixed data loading component and a data processing component, the data directional division component divides data to be calculated and weights into different data temporary storage blocks; the task scheduling component schedules the divided data to a data calculation matrix unit; the data calculation matrix unit executes specific feature extraction operation to obtain an operation result; according to the method, an in-storage calculation architecture is adopted, a hardware acceleration component capable of efficiently carrying out parallel convolution operation is deployed, all calculation tasks are unloaded into the storage medium, feature extraction operation is executed in the storage medium, and a final result is returned. And a large amount of data movement overhead is saved.

A neural network acceleration coprocessor, processing system and processing method, the system includes a coprocessor, a main processor and a memory; the main processor is used to send extended instructions; the memory is used to store data; the coprocessor is used to receive the extended instructions sent by the main processor, read input data from the memory according to the received extended instructions, perform neural network calculations on the input data to obtain output data, and store the output data in the memory. By setting the coprocessor, the coprocessor processes the time-consuming operations in the convolutional neural network, and the main processor controls the coprocessor to perform neural network calculations on the input data through extended instructions, thereby reducing the utilization rate of the CPU. Compared with pure software, the convolution operation efficiency is improved by more than 20 times.

A system and an accelerator circuit includes an internal memory to store data received a memory associated with a processor and a filter circuit block comprising a plurality of circuit stripes, each circuit stripe including a filter processor, a plurality of filter circuits, and a slice of the internal memory assigned to the plurality of filter circuits, where the filter processor is to execute a filter instruction to read data values from the internal memory based on a first memory address, for each of the plurality of circuit stripes: load the data values in weight registers and input registers associated with the plurality of filter circuits of the circuit stripe to generate a plurality of filter results, and write a result generated using the plurality of filter circuits in the internal memory at a second memory address.

The present invention relates to a computing and archiving research environment that uses multi-data integration between different information or data with high requirements for data storage and high performance computing. The invention provides a platform for easy storage, analysis and sharing of different scientific data by providing different service combinations such as high performance computing (HPC), scientific clouds and data archiving.

The present invention relates to an on-chip code breakpoint debugging method, an on-chip processor, and a chip breakpoint debugging system. The method comprises: the on-chip processor starts and executes an on-chip code, and an output function is set at a breakpoint position of the on-chip code; the on-chip processor obtains output information of the output function, the output information is output information of the output function when the on-chip code is executed to the output function; the on-chip processor stores the output information into an off-chip memory. In the embodiments of the present invention, according to the output information, which is stored in the off-chip memory, of the output function, the on-chip processor can obtain execution conditions of breakpoints of the on-chip code in real time, can achieve the purpose of debugging multiple breakpoints in the on-chip code at the same time, and debugging efficiency of the on-chip code is improved.

An information processing apparatus includes a memory and a processor. The processor configured to acquire, among a plurality of solutions, a first solution corresponding to a best value among values of a plurality of the energy functions corresponding to the plurality of solutions, each of the plurality of solutions being represented by a value of each of a plurality of state variables included in an energy function, generate a first state variable string based on the first solution, and search for a solution with the first state variable string as a start state.

An electronic apparatus may include a memory, and a processor configured to perform an operation between a first index data and a second index data corresponding to a first data set and a second data set, respectively, to acquire first output data; identify a sparsity ratio of the first output data; based on the sparsity ratio exceeding the threshold value, determine a first method of processing the first data set and the second data set using the first data set and the second data set, as an operation method of the electronic apparatus; and based on the sparsity ratio being equal to or less than the threshold value, identify valid data included in the first index data and the second index data, and determine a second method of processing the first data set and the second data set using the valid data, as the operation method of the electronic apparatus.

A storage device includes: a storage controller to receive data from a host device, and to store the data in storage memory; and a reconfigurable integrated circuit communicably connected to the storage controller, and to accelerate logic operations executed on the data stored in the storage memory, the reconfigurable integrated circuit including: a first logic block to execute a static logic operation from among the logic operations; a second logic block to execute one or more dynamic logic operations from among the logic operations; and a plurality of memory buffers configured to store inputs and outputs of the first and second logic blocks.

The invention discloses a method for optimizing the computing performance of a neural network based on on-chip storage, which comprises the following steps: firstly, carrying out SPM space division according to the access characteristics of pulse input data, internal weight and external weight so as to improve the data utilization efficiency, then, carrying out batch processing on the computing process in the time step dimension so as to enable the task scheduling to be more balanced, and then, carrying out optimization on the computing performance of the neural network. According to the method, repeated transmission is reduced through one-time loading of internal weights, storage pressure is avoided through blocking loading of external weights according to needs, and finally, a continuous and stable neural network calculation process is constructed in combination with membrane potential updating and pulse output management. The method can be widely applied to scenes sensitive to computing resources and storage bandwidth, such as embedded AI chips and edge computing equipment. According to the method, the technical problems of unreasonable SPM space division and serious access conflict existing in an existing neural network calculation performance optimization method based on a hardware accelerator can be solved.

The present disclosure as a whole relates to reducing boot delays for memory devices in dual boot systems. Boot code is loaded into a data storage device controller in a flexible manner by being able to receive blocks of boot code from two separate locations, a host memory buffer (HMB) and a memory device that can be a NAND device. A portion of the boot code can be received from the HMB, and another portion of the boot code can be received from the memory device. If the HMB or the memory device can transfer blocks faster than the other location, the controller can receive blocks from the faster location and periodically confirm the transfer speed to ensure that the boot code delay is optimized.