Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

7111results about "Concurrent instruction execution" patented technology

Implementation of a data processing pipeline using assignable resources and pre-configured resources

Systems and methods are described for a implementing a streaming data processing system that includes a pool of pre-configured resources and a pool of dedicated resources. The streaming data processing system can implement a processing pipeline using compute resources. The pool of pre-configured resources can support previews of processing pipelines for a plurality of users and the pool of dedicated resources can support full deployments of processing pipelines for a particular user. The streaming data processing system can implement a preview of a processing pipeline using a pre-configured resource of the pool of pre-configured resources. Further, the streaming data processing system can implement the processing pipeline using a dedicated resource of the pool of dedicated resources. The streaming data processing system can provision the dedicated resource and deploy the processing pipeline using the dedicated resource.
Owner:CISCO TECHNOLOGY INC

Operator optimization method, electronic device, storage medium and program product

The invention relates to the technical field of artificial intelligence chips, and provides an operator optimization method, electronic equipment, a storage medium and a program product, and the method comprises the steps: determining the block size of operator data in each dimension based on the batch size and mask mode of the operator data and the hardware parameters of computing equipment, each dimension comprises a batch dimension and a sequence length dimension; segmenting the operator data based on the block size of the operator data in each dimension to obtain a plurality of data blocks; and distributing the calculation tasks corresponding to the plurality of data blocks to a plurality of processing units on the calculation equipment, and performing parallel execution on the calculation tasks corresponding to the plurality of data blocks based on the plurality of processing units. According to the method and the device, the data are segmented in the batch dimension and the sequence length dimension at the same time, so that when the data batch is small, a plurality of processing units on the computing equipment can also participate in computing at the same time, hardware resources are prevented from being idle, the utilization rate of the hardware resources is improved, and the overall computing efficiency is improved.
Owner:SHANGHAI BIREN TECH CO LTD

Low-power-consumption single-emission out-of-order execution RISC-V processor and instruction processing method

The invention discloses a low-power-consumption single-emission out-of-order execution RISC-V processor, which comprises seven stages of pipeline architecture, namely an instruction fetch unit, an instruction buffer unit, a decoding unit, an emission unit for single instruction emission, a physical register file, an execution unit for parallel out-of-order calculation and a retirement unit in sequence, and the instruction fetch unit is used as the front end of the RISC-V processor; a five-level pipeline architecture formed by the decoding unit, the transmitting unit, the physical register file, the execution unit and the retirement unit is used as the rear end of the RISC-V processor; through the technical scheme, the invention provides a micro-architecture which is more balanced in performance and power consumption, so that the applicability of a processor core in a scene with high computing requirements and sensitive power consumption is improved.
Owner:JINAN UNIVERSITY

Instruction processing method and processor

The embodiment of the invention provides an instruction processing method and a processor, and the method comprises the steps: obtaining a to-be-executed instruction, and determining a conflict type of the to-be-executed instruction; distributing a physical register for the to-be-executed instruction based on the conflict type; determining a dependency conflict condition and a resource conflict condition of the to-be-executed instruction, and determining an execution sequence of the to-be-executed instruction based on the dependency conflict condition and the resource conflict condition; determining a target execution unit based on the execution sequence, and sending the instruction to be executed to the target execution unit; and controlling the target execution unit to execute the to-be-executed instruction, and writing the to-be-executed instruction into the physical register when the to-be-executed instruction is executed, so that efficient out-of-order execution is realized through refined conflict detection, resource allocation and instruction scheduling, and the performance of the RISC-V processor can be remarkably improved. And the adaptability to complex applications is enhanced.
Owner:BEIJING INSTITUTE OF OPEN SOURCE CHIP

Systems, methods, and apparatuses for heterogeneous computing

Embodiments of systems, methods, and apparatuses for heterogeneous computing are described. In some embodiments, a hardware heterogeneous scheduler dispatches instructions for execution on one or more plurality of heterogeneous processing elements, the instructions corresponding to a code fragment to be processed by the one or more of the plurality of heterogeneous processing elements, wherein the instructions are native instructions to at least one of the one or more of the plurality of heterogeneous processing elements.
Owner:INTEL PRODUCTS IP LLC

Optimization method for improving parallelism and performance of RISC-V vector instruction executed by hardware

The invention provides an optimization method for improving parallelism and performance of hardware executing RISC-V vector instructions, which comprises the following steps: S1, an instruction fetching and decoding stage step: the step comprises an instruction fetching link and a decoding link, and the instruction fetching link reads instructions from a memory according to a program sequence and stores the instructions into an instruction queue; the decoding link comprises the steps of analyzing an instruction, identifying whether the instruction is a vector mask instruction or a vector length control instruction, and if the instruction needs an old value of a destination register, marking that the instruction needs to carry an old value dependency identifier, belonging to the technical field of optimization methods. According to the method, the instruction is transmitted without waiting for the old value of the target vector register to be ready, the instruction can be transmitted in advance after a certain condition is met, and the correct old value is obtained, so that the aim of improving the parallelism and the performance of hardware for executing the RISC-V vector instruction is fulfilled.
Owner:BEIJING YIHUA CLOUD NETWORK TECH CO LTD

GPU feature mining and analysis method and system based on computer microarchitecture independence

Disclosed in the present invention are a GPU feature mining and analysis method and system based on computer microarchitecture independence. The method comprises: building a target instrumentation library, analyzing a calling sequence of a target application program, and extracting a plurality of levels of performance features, wherein the performance features are high-level features of a program and are independent of a microarchitecture of a processor; analyzing a correlation between the performance features and execution performance of the target application program; and outputting an analysis result according to the obtained correlation, wherein the analysis result reflects a performance bottleneck of the target application program and a corresponding optimization suggestion. The present invention can help developers to adjust and optimize application programs, so as to fully use computing capabilities of GPUs.
Owner:SHENZHEN INST OF ADVANCED TECH

Neural morphology calculation system and method based on spiking neural network

The invention relates to a neuromorphic computing system and computing method based on a spiking neural network, and the system comprises a neuromorphic processor which is used for constructing a hardware-based spiking neural network through employing a plurality of physical neurons, and carrying out the pulse coding and target recognition of a real-time input image; the central processing unit is realized on the basis of an RISC-V instruction architecture and is used for executing a control instruction required for constructing the pulse neural network; the neuromorphic processor is also used for carrying out online learning on the pulse neural network under the control of the control instruction; and the memory is used for storing program instructions required by the operation of the central processing unit and data transmitted between the central processing unit and the neuromorphic processor. The invention further provides a neuromorphic calculation method. According to the technical scheme of neural morphology calculation, high balance among precision, calculation speed and energy efficiency is achieved, and dynamic and complex task data can be processed accurately and efficiently with low power consumption.
Owner:JINAN UNIVERSITY

Processor, chip product, computer equipment and tensor processing method

The invention discloses a processor, a chip product, computer equipment and a tensor processing method, and relates to the technical field of processors. A first tensor having a plurality of elements arranged according to a first arrangement order is stored in the first storage unit; the tensor storage engine is used for reading the plurality of elements from the first storage unit to the second storage unit according to a second arrangement sequence to obtain a rearranged tensor; the tensor calculation engine is used for executing logical operation on the rearranged tensor to obtain an operation result; the format conversion unit is used for converting the data format of each element in the operation result into a target data format to obtain an operation result after format conversion, and storing the operation result after format conversion into a third storage unit, the operation result after format conversion comprises the operation results of the multiple elements, and the third storage unit is used for storing the operation results after format conversion. A third arrangement sequence of the operation results of the plurality of elements in the third storage unit is the same as the first arrangement sequence. The development cost of the processor can be reduced.
Owner:MOORE THREADS TECH CO LTD

Analytical model to optimize deep learning models

Techniques for optimizing and deploying deep neural network (CNN) machine learning models for inference using static analysis are described. A method includes obtaining a deep neural network (DNN) machine learning (ML) model, generating an intermediate representation for the ML model, the intermediate representation including one or more nodes corresponding to one or more operators utilized by the ML model, identifying, for at least one node of the intermediate representation, an optimized schedule for at least one operator corresponding to the at least one node using a static analysis that is based on a hardware-specific cost model, generating an optimized intermediate representation using the optimized schedule that is optimized for execution on a hardware platform, and generating code corresponding to the ML model based at least in part on the optimized intermediate representation, wherein the code is specific to the hardware platform.
Owner:AMAZON TECH INC

Tensor core matrix multiplication and accumulation with hardware-based statistics collection and outlier suppression

An apparatus providing tensor core matrix multiplication and accumulation (MMA) with hardware-based statistics collection and outlier suppression is disclosed. The apparatus includes processor circuitry comprising at least one processor core comprising matrix multiplication circuitry to: execute a matrix multiplication operation on first input data from a first set of registers and on second input data from a second set of registers; collect, as part of executing the matrix multiplication operation via statistics collection hardware circuitry of the matrix multiplication circuitry, output statistics data corresponding to the matrix multiplication operation; and output the output statistics data along with a result of the matrix multiplication operation; and output statistics storage to store the output statistics data.
Owner:INTEL CORP

Airplane multi-mode instruction conflict resolution method and system

The invention belongs to the technical field of data processing, relates to an aircraft multi-mode instruction conflict resolution method and system, and aims to solve the problems of high conflict detection time delay and priority strategy staticization of a traditional method. The method comprises the steps that after a multi-mode instruction is received, semantic feature extraction and time sequence alignment are completed through a three-layer attention mechanism and a dynamic time warping algorithm, and a structured instruction set is generated; evaluating the priority of each instruction by combining a four-dimensional dynamic weight system with reinforcement learning; inputting the instruction set with the priority into a six-tuple model to identify a conflict type and an instruction set; and a three-level progressive arbitration method is adopted to resolve conflicts, an optimal execution sequence is generated, and the four-dimensional dynamic weight system is fed back and optimized according to an execution result. According to the method, the real-time performance and the dynamic adaptability of multi-mode instruction conflict resolution are remarkably improved, and reliable guarantee is provided for aviation instruction interaction safety.
Owner:CHINA SOUTHERN TECHNOLOGY (GUANGDONG HENGQIN) CO LTD

Artificial intelligence large model training method in heterogeneous multi-machine multi-card environment

The invention discloses an artificial intelligence large model training method in a heterogeneous multi-machine and multi-card environment, and belongs to the technical field of artificial intelligence large model training. Load balancing of heterogeneous equipment is realized by constructing a uniform interface, and the communication efficiency is optimized by adopting hierarchical pipeline aggregation and dynamic quantization compression; the node dynamic adjustment is realized in combination with the elastic topological structure, the problems of poor equipment compatibility, high communication delay and rigid topological structure in the prior art are effectively solved, and the method has the remarkable advantages of improving the utilization rate of heterogeneous computing resources, reducing the cross-node communication overhead and enhancing the fault-tolerant capability of the system.
Owner:SICHUAN HUIXIN INTELLIGENT COMPUTING TECHNOLOGY CO LTD

Instruction scheduling method and device, electronic equipment and medium

The invention provides an instruction scheduling method and apparatus, an electronic device and a medium. The method comprises the steps of obtaining a target instruction through a first instruction scheduling unit; identifying a target unit for executing the target instruction, the target unit being one of an execution unit or a first functional unit; under the condition that the target unit is the first function unit, a target tensor block corresponding to the target instruction and a target working group corresponding to the target tensor block are determined, and the target working group is used for indicating the memory address range of the target tensor block; and scheduling the target instruction to the target working group through the first instruction scheduling unit, scheduling the target working group to the target unit, reading the target tensor block based on the memory address range by the target unit, and executing the target instruction on the target tensor block. Based on the instruction scheduling method disclosed by the invention, the adaptation degree between a hardware layer and block-based GPU programming languages such as triton and the like can be improved.
Owner:SUZHOU YIZHU INTELLIGENT TECH CO LTD +1

Multi-level heterogeneous integrated chip task processing method and device, equipment and medium

The invention relates to the technical field of artificial intelligence, can be applied to service scenes of pension service, financial science and technology, medical health and the like, and discloses a multi-level heterogeneous integrated chip task processing method, device, equipment and medium, and the method comprises the steps: constructing a multi-level heterogeneous integrated chip composed of a perception processing layer, an intelligent decision-making layer and a driving control layer, the layers are connected through a vertical interconnection structure; receiving multi-modal task data and extracting features to generate feature vectors; inputting the feature vector into a neuromorphic processing unit to determine a task decision result; converting the decision result into a driving signal to control an execution device; adjusting synaptic weights based on the feedback signal; and monitoring chip operation state parameters and dynamically adjusting processing frequency and structure parameters. By integrating multi-modal sensing, neuromorphic decision and a dynamic feedback mechanism, data sensing, decision and execution processing are completed in a chip, and the real-time performance and the calculation efficiency are improved by combining operation state monitoring and adjusting frequency and structure.
Owner:PING AN TECH (SHENZHEN) CO LTD

GPGPU (General Purpose Graphics Processing Unit)-based instruction execution acceleration method and GPGPU architecture

The invention discloses an instruction execution acceleration method based on a GPGPU and a GPGPU architecture, and relates to the field of high-performance computation.The method comprises the steps that a thread execution task output by a host compiler is received, and the thread execution task is scheduled according to the current idle state of a computing unit; capturing instruction data output by the host compiler, and executing concurrent instruction decoding according to the corresponding instruction type to obtain a machine code corresponding to the instruction data; obtaining an operand corresponding to the instruction data, and generating a to-be-transmitted instruction based on the machine code corresponding to the instruction data and the operand after secondary verification; according to the calculation complexity, determining an optimal calculation unit, and sending the to-be-launched instruction to the optimal calculation unit; and receiving an execution result of the to-be-transmitted instruction, and returning the execution result to the terminal. The thread execution task is dynamically scheduled according to the idle state of the computing unit, so that computing resources can be fully utilized, and the operation efficiency is improved.
Owner:YUANQIXIN (SHANDONG) SEMICONDUCTOR TECHNOLOGY CO LTD

Two-level context caching and eviction for scatter-gather DMA

One aspect of the instant disclosure may provide a system and method for processing scatter-gather direct memory access (S-G DMA) instructions. During operation, the system may receive an S-G DMA instruction associated with a message and gather instruction context for the S-G DMA instruction. An S-G DMA processor may process the S-G DMA instruction based on the gathered instruction context and determine whether there exists a pending S-G DMA instruction associated with the message. In response to the presence of the pending S-G DMA instruction, the system stores the instruction context in a hot context cache at an address corresponding to the pending S-G DMA instruction. In response to the absence of the pending S-G DMA instruction, the system stores the instruction context in a cold context cache.
Owner:HEWLETT PACKARD ENTERPRISE DEV LP

Low-power-consumption control method and system of controller

The invention relates to the field of energy-saving computing, and discloses a low-power-consumption control method and system of a controller, which are used for realizing prediction-sleep-wake-up-response full-link hardware in the controller. Time sequence state data of a controlled object is collected in real time, and a predictive sleep window value is dynamically generated by utilizing a predictive cooperative computing unit, so that intelligent scheduling of sleep and awakening is realized, and the power consumption of a controller is effectively reduced. Meanwhile, in combination with the technologies of threshold comparison, DMA data transmission optimization and the like, the data processing efficiency is improved, and invalid data transmission is reduced. And on the awakening mechanism, an asynchronous awakening circuit and an interrupt request mechanism are adopted to ensure that power supply is quickly recovered and control response is executed when an effective instruction is received, so that the real-time performance of the system is guaranteed. According to the invention, a prediction algorithm, hardware acceleration and an intelligent scheduling technology are fused, the performance of the controller is ensured, the power consumption is obviously reduced, and the endurance time of equipment is prolonged.
Owner:WUXI DENVEL INTELLIGENT ELECTRONIC INC

Instruction processing method and device, storage medium and electronic device

The embodiment of the invention provides an instruction processing method and device, a storage medium and an electronic device.The method comprises the steps that a first type of to-be-processed instructions are determined from multiple to-be-processed instructions according to preset instruction codes, and a first vector parameter is updated into a second vector parameter in an updating mode corresponding to the first type of to-be-processed instructions; and splitting a long vector instruction in other to-be-processed instructions into a plurality of micro-operations based on the second vector parameter, and renaming the other to-be-processed instructions according to the plurality of micro-operations, the other to-be-processed instructions being instructions except the first type of to-be-processed instructions in the plurality of to-be-processed instructions. According to the method and the device, the problem that an execution part circuit in a processor is too complex and too large in area and power consumption due to the appearance of a long vector in a vector instruction in the related technology is solved, and the effects of reducing the design complexity of the execution part circuit and realizing better processing frequency in a limited area are achieved.
Owner:SANECHIPS TECH CO LTD

Instruction processing method, processor and electronic device

At least one embodiment of the invention provides an instruction processing method, a processor and an electronic device. The instruction processing method comprises the steps that an object instruction is extracted according to an instruction prefetching request, and the extracted object instruction is cached in an instruction cache queue; in response to instruction release information from a pipeline of the processor core, the object instruction is filled from the instruction cache queue into an instruction cache unit, and the instruction cache unit is configured to be directly accessed by the processor core. According to the instruction processing method, pollution of the instruction pre-fetched based on branch prediction to the instruction cache unit can be reduced, and the performance of the processor is improved.
Owner:HYGON INFORMATION TECH CO LTD

Intelligent data stream processing system based on Flink and implementation method thereof

The invention discloses an intelligent data stream processing system based on Flink and an implementation method thereof, and belongs to the technical field of distributed streaming data processing, and the implementation method comprises the following steps: a data source access layer uniformly accesses multi-source data; the entity monitoring layer captures service entity change in a non-intrusive manner based on JPA, generates a standardized message body and asynchronously delivers the standardized message body to double channels; the unified event model layer maps the data into a standardized event and expands the standardized event; the Flink stream processing engine layer is used for complex event processing, state management and window calculation, and supports declarative pipeline definition and dynamic construction; the anomaly detection layer performs multi-dimensional anomaly detection; the distributed task scheduling layer schedules tasks according to a DAG model, and realizes load balancing through hotspot splitting and state transition; and the result storage and visualization layer adopts a cold and hot separation strategy to store data, and provides a dynamic visualization interface. The real-time performance, the consistency and the intelligent level of data processing are remarkably improved, and the development and maintenance cost is reduced.
Owner:BEIJING NEUSOFT HUIJU INFORMATION TECH HLDG CO LTD

Memory access instruction processing method and processor

The invention provides a memory access instruction processing method and a processor, and relates to the technical field of data processing, and the method comprises the following steps: splitting a target vector memory access instruction into a plurality of target vector memory access micro-operations based on a memory access width, combining the target scalar memory access instruction with at least one unexecuted scalar memory access instruction into a target scalar memory access micro-operation; executing each target vector memory access micro-operation, and / or executing a target scalar memory access micro-operation; the memory access width is determined based on a number of data cache banks in a data cache in the processor and a bit width of the data cache banks. According to the memory access instruction processing method and the processor provided by the invention, resources can be more reasonably allocated for vector memory access and scalar memory access during data memory access through splitting of the vector memory access instruction and merging of the scalar memory access instruction, and maximum resource sharing of the vector memory access and the scalar memory access is realized.
Owner:BEIJING VCORE TECH CO LTD

Processor core, instruction processing method, electronic device and storage medium

The embodiment of the invention relates to a processor core comprising a front end, an instruction processing method, equipment and a medium. The processor core front end comprises N fetch decoding assembly lines, at least one instruction cache and at least one microinstruction cache, wherein N is an integer greater than or equal to 2. Each fetch decoding pipeline comprises fetch selection logic, an instruction cache port, a microinstruction cache port, a decoder and a first microinstruction queue. And the prediction information is processed by the instruction decoding assembly line or the micro instruction assembly line in the N instruction fetching decoding assembly lines to enter the first micro instruction queue for distribution. The processor core has a larger average front-end bandwidth and has improved processing performance.
Owner:HYGON INFORMATION TECH CO LTD

Integer parallel computing method and device based on distributed storage and computer equipment

The invention belongs to the field of high-performance computing, and relates to an integer parallel computing method and device based on distributed storage and computer equipment, and the method comprises the steps of collecting real-time resource indexes, dynamically identifying fault nodes, triggering task migration, and performing data verification and hard disk fault detection. The weight value of each node is calculated, the nodes are arranged according to the descending order of the weight values, and the nodes with high load capacity are selected to distribute tasks; dynamically distributing a data generation task to a computing node, executing parallel computing, and performing distributed storage on a result; obtaining an operand, converting the operand into a first-order tensor form of a basic operand, serializing tensor data, and sending the serialized tensor data to a parallel computing layer; distributing a search task to a computing node, retrieving storage data in parallel, reading effective data from a storage layer, and combining search results into a partial sum; and summarizing and then outputting. The system has dynamic resource management and fault-tolerant capabilities, and can realize efficient task allocation and load balancing.
Owner:SHENZHEN Y& D ELECTRONICS CO LTD

Instruction encoding to implement increased register capacity per thread

Described herein is a graphics processor comprising first circuitry configured to execute a decoded instruction and second circuitry configured to second circuitry configured to decode an instruction into the decoded instruction. The second circuitry is configured to determine a number of registers within a register file that are available to a thread of the processing resource and decode the instruction based on that number of registers.
Owner:INTEL CORP

Vector computational unit

A microprocessor system comprises a computational array and a vector computational unit. The computational array includes a plurality of computation units. The vector computational unit is in communication with the computational array and includes a plurality of processing elements. The processing elements are configured to receive output data elements from the computational array and process in parallel the received output data elements.
Owner:TESLA INC

Multi-head attention mechanism operator optimization method and system for domestic heterogeneous processor

The invention discloses an optimization method for a multi-head attention mechanism operator oriented to a domestic heterogeneous processor, which improves the efficiency of the multi-head attention mechanism operator from four aspects, and comprises the following steps of: firstly, combining the general computing power of a CPU (Central Processing Unit) and the advantages of a DSP (Digital Signal Processor) in the aspect of parallel computing; a high-performance multi-head attention mechanism operator operation method on a CPU + DSP heterogeneous processor is constructed; secondly, a previous softmax optimization algorithm is used for fusing the two batch processing matrix multiplication and a softmax operator, so that the memory access overhead of DSP equipment is reduced; then, a vector operation instruction of a DSP calculation core is used in the calculation process of a multi-head attention operator, and SIMD calculation characteristics of DSP equipment are fully utilized; and finally, during data transmission and calculation, a double-flow water mechanism is adopted, the data transmission time is covered, and the multi-head attention mechanism operator calculation efficiency is improved.
Owner:HUNAN UNIV

Concurrent multi-datatype execution within a processing resource

One embodiment provides for a graphics processing unit (GPU) to accelerate machine learning operations, the GPU comprising an instruction cache to store a first instruction and a second instruction, the first instruction to cause the GPU to perform a floating-point operation, including a multi-dimensional floating-point operation, and the second instruction to cause the GPU to perform an integer operation; and a general-purpose graphics compute unit having a single instruction, multiple thread architecture, the general-purpose graphics compute unit to concurrently execute the first instruction and the second instruction.
Owner:INTEL CORP

Dynamic instruction conversion memory access conflict optimization method based on memory partition

The invention discloses a memory partition-based dynamic instruction conversion memory access conflict optimization method, which comprises the following steps of: allocating memory sub-regions for each computing core according to a load condition in an ARM (Advanced RISC Machines) many-core system to establish a first mapping relation table; when the executable file is loaded and executed in a dynamic instruction conversion mode, obtaining a second mapping relation table between the thread and the calculation core, and obtaining a thread and a memory address corresponding to a to-be-converted instruction of a memory access instruction class, obtaining a converted first ARM virtual address and a related first address space according to the first mapping relation table and the second mapping relation table, and determining an adjustment mode of the converted instruction according to the relation between the first ARM virtual address and the first address space to complete instruction conversion. The memory access conflict in the dynamic conversion process from the x86 instruction to the ARM instruction on an ARM many-core system is effectively reduced, and the execution performance of a program after dynamic instruction conversion is improved.
Owner:北京麟卓信息科技有限公司