Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

48 results about "Instruction pipeline" patented technology

In computer science, instruction pipelining is a technique for implementing instruction-level parallelism within a single processor. Pipelining attempts to keep every part of the processor busy with some instruction by dividing incoming instructions into a series of sequential steps (the eponymous "pipeline") performed by different processor units with different parts of instructions processed in parallel. It allows faster CPU throughput than would otherwise be possible at a given clock rate, but may increase latency due to the added overhead of the pipelining process itself.

Instruction pipeline processing method of processor and processor

ActiveCN121166207AConcurrent instruction executionSpeculative executionProcessing Instruction
The invention provides an instruction pipeline processing method of a processor and the processor. A processor includes: a control module; the control module is set to execute the branch instruction speculatively according to the branch prediction direction when detecting that the first instruction subjected to initial decoding is the branch instruction, and execute the branch instruction if detecting that the second instruction subjected to initial decoding is the function call instruction or the function return instruction before the speculation execution result of the first instruction is generated. If yes, pausing all operations after the instruction processing assembly line performs initial decoding on the second instruction, and blocking the instruction fetching operation of the instruction processing assembly line on the next instruction until a speculation execution result of the first instruction is obtained; wherein the operation after the initial decoding comprises the step of carrying out a push-in or push-out operation of a return address stack (RAS) according to the second instruction. According to the technical scheme, the pollution risk caused by speculative execution of the branch instruction to the return address stack can be shielded, so that the hardware implementation logic of the return address stack is simplified, and the circuit area and power consumption are saved.
Owner:SUNMMIO SCIENCE & TECHNOLOGY (BEIJING) CO LTD

ALU operation fusion processing module and method suitable for neural network

The invention discloses an ALU operation fusion processing module and method suitable for a neural network, and the module comprises a control unit which is used for receiving and decoding a machine instruction, managing the execution processes of internal and external circulation and microinstruction circulation, and generating a control signal of each stage of a microinstruction assembly line; the microinstruction buffer area is used for storing a microinstruction sequence pre-generated by the neural network compiler; the register file is used for storing source operands and results of ALU operation; each entry of the register file is composed of a valid bit, a tag bit and a data bit; the ALU computing core adopts an SIMD (Single Instruction Multiple Data) architecture and comprises a plurality of paths of parallel arithmetic logic function units; the Load / Store unit is used for processing data exchange between a register file and a local buffer area; and the data selection interface is used for selecting a data source or a target buffer area according to the storage tag field of the microinstruction. According to the method, the high efficiency and the flexibility of the ALU in the neural network hardware accelerator can be effectively considered.
Owner:ZHEJIANG UNIV

Operating method of attention mechanism in chip, chip, electronic equipment, storage medium and program product

The invention provides an operation method of an attention mechanism in a chip, the chip, electronic equipment, a storage medium and a program product. In a forward stage of attention model training, forward calculation is performed on a query matrix, a key matrix and a value matrix in each thread of a calculation engine based on a first instruction pipeline to obtain a forward output matrix, in algorithm implementation, matrix multiplication is executed by calling a matrix multiplication unit through a first thread and a third thread, and a forward output matrix is obtained. The vector calculation is processed by a second thread calling vector calculation unit; in a reverse phase, performing reverse calculation on the query matrix, the key matrix, the value matrix and the output gradient matrix in each thread based on a second instruction pipeline to obtain a target gradient matrix; the matrix multiplication unit is called in the first thread and the third thread to execute matrix multiplication, the vector calculation unit is called in the second thread to execute vector calculation, and the data carrying unit is called in the idle first thread or the third thread to obtain all matrixes. According to the invention, the operation performance of the chip can be improved.
Owner:SHANGHAI ORIENTAL COMPUTER TECHNOLOGY CO LTD

Extraction across predictively employed branch instructions in extraction beam of processor-based device

Extraction across a predicted employed branch instruction in an extraction beam of a processor-based device is disclosed. In an exemplary aspect, a processor-based apparatus includes instruction processing circuitry configured to process a stream of instructions in an instruction pipeline. The instruction processing circuitry includes instruction fetch circuitry configured to generate a fetch bundle including a plurality of fetched instructions from the instruction stream, where a last fetched instruction of the plurality of fetched instructions is a branch instruction predicted to be taken. The instruction processing circuitry is further configured to identify the plurality of extracted instructions as loop iterations. The instruction processing circuitry is further configured to determine that at least one loop iteration copy is adapted to be placed within the fetch beam. The instruction processing circuitry is additionally configured to store the at least one loop iteration copy within the fetch beam in response to determining that the at least one loop iteration copy is adapted to be placed within the fetch beam.
Owner:QUALCOMM INC

Processors that delay flushing of the instruction pipeline

In a general aspect, a processor includes a plurality of control registers, an instruction processing pipeline operatively coupled to the plurality of control registers, and a pipeline flush control unit operatively coupled to the instruction processing pipeline. The pipeline flush control unit is configured to record an indication of a first instruction in response to completion of execution of the first instruction by the instruction processing pipeline. The first instruction is configured to write to a first control register of the control registers. The pipeline flush control unit is also configured to identify a second instruction in the instruction processing pipeline before completion of execution of the second instruction and determine whether the second instruction conflicts with the first instruction based on a predetermined set of criteria. If the second instruction is determined to conflict with the first instruction, the pipeline flush control unit initiates a flush of the instruction processing pipeline.
Owner:RIVOS INC

A coprocessor-based method and system for taint propagation

The application discloses a kind of based on coprocessor's taint propagation method and system.The steps of the method include:1) pre-analysis instruction semantics, construct the taint propagation mask table of instruction;2) by coprocessor, intervene CPU instruction pipeline decoding, write-back process;3) in decoding stage, the opcode and operand of current instruction are acquired in real time quickly, and the taint propagation mask corresponding to instruction is found in taint propagation mask table by coprocessor;4) in write-back stage, the mask table corresponding to current instruction is searched in real time quickly, and taint propagation calculation is implemented.The application can analyze the semantics of instruction, calculate taint propagation process by using the characteristics of hardware fast and accurate when CPU instruction is executed by configuring the input function return value of monitoring.
Owner:INST OF SOFTWARE - CHINESE ACAD OF SCI

Quantum measurement and control instruction assembly line parallel processing system

The invention discloses a quantum measurement and control instruction assembly line parallel processing system, which adopts a double-thread framework, connects a producer thread and a consumer thread through a limited-capacity buffer queue, and can ensure the execution sequence of quantum measurement and control instructions and improve the execution efficiency of the quantum measurement and control instructions at the same time. The problems that in an existing measurement and control equipment system, serial processing efficiency is low, and the resource utilization rate is insufficient are solved, namely the technical defects that when an upper computer generates an instruction, external equipment is idle, and when the external equipment executes the instruction, the upper computer is idle are overcome, and a parallel assembly line strategy of upper computer instruction generation and external equipment instruction execution is achieved. The processing efficiency and the resource utilization rate are remarkably improved, and the method has high universality, expandability and a perfect exception processing mechanism.
Owner:EAST CHINA INST OF COMPUTING TECH +1

Reusing fetched flushed instructions after instruction pipeline flush to reduce instruction refetch in response to hazard in processor

Reusing fetched, flushed instructions after instruction pipeline flushing in response to hazards in the processor is disclosed to reduce instruction refetching. The instruction processing circuitry is configured to detect fetched performance degradation instructions (PDIs) during the pre-execution phase of the instruction pipeline, which may result in a precise interrupt that causes instruction pipeline flushing. In response to detecting a PDI in the instruction pipeline, the instruction processing circuitry is configured to capture, in the pipeline refill circuitry, the fetched PDI and / or its subsequent, newer fetched instructions processed after the PDI in the instruction pipeline. If the subsequent execution of the PDI in the instruction pipeline causes instruction pipeline flushing, the instruction processing circuitry can inject the previously captured fetched PDI and / or its newer instructions from the pipeline refill circuitry into the instruction pipeline to be processed, without requiring such instructions to be refetched.
Owner:MICROSOFT TECHNOLOGY LICENSING LLC

Method for quickly releasing physical resources, processor core and processor

The invention provides a method for quickly releasing physical resources, a processor core and a processor, the method is applied to the processor core, and the processor core adopts an instruction pipeline mode to process an instruction; the method comprises the steps that under the condition that a register renaming unit completes register renaming operation on a first instruction, a submitting unit judges whether the first instruction is abnormal or not; and under the condition that the first instruction is determined not to be abnormal, the submitting unit releases a reordering buffer resource occupied by the first instruction, and the submitting unit sends a resource release message to the register renaming unit, the resource release message is used for notifying the register renaming unit to release the physical register resource occupied by the first instruction. According to the method, the physical resources occupied by the instruction can be more quickly released in the process that the processor core processes the instruction according to the instruction pipeline, so that the utilization rate of the physical resources and the performance of the processor can be improved.
Owner:PHYTIUM TECH CO LTD

Network processor and chip

The invention relates to a network processor and a chip, and the method comprises the steps: an instruction assembly line receives and analyzes a customer-defined instruction, reads a source data list and a command list from a storage module according to instruction analysis information, and transmits the source data list and the command list to a finite-state machine; in the finite-state machine, a data buffer stores source data and a command execution result, a command buffer stores a command list, a state controller reads a target command from the command list in sequence, obtains target source data from the data buffer according to the target command, then generates a task request and sends the task request to an execution unit, and the execution unit executes the task request. A command result returned by the execution unit is received and written into the data buffer, and finally, after the command list is executed, a write-back data write-back storage module is generated according to data in the data buffer. According to the method and the device, a customer can customize the custom instruction according to own requirements in the chip use process, and the utilization rate of the execution unit in the instruction assembly line is improved.
Owner:SHENZHEN JAGUAR MICROSYSTEMS CO LTD

IP address network division method and device, equipment and storage medium

This application provides an IP address network partitioning method, apparatus, device, and storage medium, belonging to the field of asset management technology. The method includes: converting a target IP address into an integrated IP address block, wherein the target IP address belongs to either IPv4 or IPv6; determining the host bit width based on a variable-length subnet mask, and logically right-shifting the tail address block within the IP address block according to the host bit width to obtain a bit value; comparing the bit value of the tail address block with a reference bit value of the tail address block in a preset network partitioning rule to determine whether the target IP address matches the network partitioning rule. This method eliminates code redundancy and branch prediction failures. It significantly improves cache locality and instruction pipeline efficiency, thereby enhancing the adaptability of the solution.
Owner:COSMO INSTITUTE OF INDUSTRIAL INTELLIGENCE (QINGDAO) CO LTD +1

Sample-parallel sparse cipher-block chaining (CBCS) encryption

A content provider in a content distribution system may be configured to reduce latency in a content distribution system by storing multiple frames from a sequence of frames in different buffers and encrypting, in parallel, the frames stored in the different buffers. For example, the content provider may encrypt each buffer via a different instruction pipeline of a processor.
Owner:COMCAST CABLE COMM LLC

Simulink code generation method and device based on instruction pipeline perception

The invention provides a Simulink code generation method and device based on instruction pipeline perception, and relates to the technical field of embedded code generation, and the method comprises the steps: carrying out instruction dependency analysis and delay modeling on a target Simulink model, and generating a dependency graph for describing a dependency relationship between modules and an instruction delay model combined with target processor system structure parameters; based on the dependency graph and the instruction delay model, determining an optimal execution sequence of each module through assembly line perception scheduling, and performing assembly line scheduling based on the optimal execution sequence to obtain a scheduling result; and based on the scheduling result, utilizing a local pipeline optimization strategy to generate a target code. According to the method provided by the invention, the data dependence path between the modules is determined by utilizing topology analysis, and the execution sequence is adaptively selected through the minimum penalty priority algorithm to avoid unnecessary waiting and resource conflicts, so that the number of pauses of the instruction assembly line is effectively reduced on the premise of ensuring the semantic consistency of the model.
Owner:TSINGHUA UNIVERSITY +1

A thread scheduling system and method, electronic device and storage medium

The present disclosure relates to a thread scheduling system and method, an electronic device and a storage medium, the system comprising: an instruction cache module, an instruction register module, an execution module; the instruction cache module is configured to pre-read instruction data of a plurality of threads; the instruction register module is configured to store the pre-read instruction data of the plurality of threads, and in one clock cycle, determine a target thread and a target instruction of the target thread according to the instruction data of the plurality of threads; and the instruction register module is configured to send the target instruction of the target thread to the execution module. The embodiment of the present disclosure effectively reduces the thread scheduling time in the instruction pipeline scenario, and improves the utilization rate of the execution module.
Owner:MOORE THREADS TECH CO LTD

A network processor and chip

This application relates to a network processor and chip, comprising: an instruction pipeline that receives and parses customer-defined instructions; reads a source data list and a command list from a storage module based on the instruction parsing information; and sends them to a finite state machine. In the finite state machine, a data buffer stores the source data and command execution results, a command buffer stores the command list, a state controller sequentially reads the target command from the command list, obtains the target source data from the data buffer based on the target command, generates a task request and sends it to the execution unit, receives the command result returned by the execution unit and writes it to the data buffer, and finally, after the command list is executed, generates a write-back data write-back storage module based on the data in the data buffer. This application enables customers to customize instructions according to their own needs during chip use and improves the utilization rate of the execution units in the instruction pipeline.
Owner:SHENZHEN JAGUAR MICROSYSTEMS CO LTD

Processor with Opportunistic Bypass of Dispatch Buffer and Reservation Station

Systems and methods related to a processor with opportunistic bypass of dispatch buffer and reservation station are disclosed herein. The microarchitecture of the processor can determine when conditions exist for the dispatch buffers, reservation station, or other components of an instruction pipeline, to be bypassed by an instruction. One or more components may be bypassed after at least a portion of the instruction pipeline is flushed or ignored. Instructions may bypass one or more components if the source operands of the instruction are ready, there is sufficient space at the destination bypass path, and if the bypassed component is empty. Systems and methods as disclosed herein may improve the efficiency of processing instructions and reduce penalties for branch interpretations and other errors.
Owner:TENSTORRENT USA INC

Processor, instruction processing apparatus, electronic device and instruction processing method

A processor, an instruction processing apparatus, an electronic device and an instruction processing method. The processor comprises: an instruction fetching unit, an instruction parsing unit, a DQ instruction execution unit and a CA instruction execution unit, wherein the instruction fetching unit, the instruction parsing unit and a first target unit form a first instruction pipeline; the instruction fetching unit, the instruction parsing unit and a second target unit form a second instruction pipeline; when a target condition is met, the first instruction pipeline and the second instruction pipeline are executed in parallel; and the first target unit comprises the DQ instruction execution unit, and the second target unit comprises the CA instruction execution unit.
Owner:MAXIO TECHNOLOGY (HANGZHOU) CO LTD

A method, apparatus and system for GPU performance prediction

This invention discloses a method, apparatus, and system for GPU performance prediction. In this embodiment, the following steps are taken: First, the hardware parameters of the function to be executed and the GPU to be tested are obtained. Then, the function to be executed is decomposed into multiple tasks according to a set decomposition method. These tasks are then allocated to multiple streaming multiprocessors (SMs) of the GPU according to a set scheduling method, and at least one task is assigned to each SM. Finally, the at least one task assigned to each SM is assigned to multiple instruction pipelines within that SM. A multi-level feature set is determined based on the multiple instruction pipelines. The multi-level feature set is then input into a multilayer perceptron (MLP), and the predicted latency is output. Through this method, the complex workflow of the function to be executed can be mapped to a fine-grained instruction pipeline. A multi-level feature set is constructed based on the instruction pipelines, and the MLP is used to capture nonlinear competition between different instruction pipelines, accurately predicting the latency of the GPU under test and determining its performance.
Owner:ALIBABA (CHINA) CO LTD

Methods and Systems for Inter-Pipeline Data Hazard Avoidance

PendingUS20250390310A1Software engineeringInstruction analysisInstruction pipelineReliability engineering
Data hazards are avoided by stalling from execution a received secondary instruction determined to be dependent on a primary instruction by an associated instruction pipeline if a counter of a plurality of counters associated with the primary instruction indicates that there is a hazard related to the primary instruction. In response to detecting that a hazard related to a primary instruction has been resolved by an instruction pipeline of a plurality of instruction pipelines, an adjustment signal is transmitted to a counter block that causes the value of the counter of the plurality of counters of the counter block associated with the primary instruction to be adjusted to indicate that the hazard related to the primary instruction has been resolved.
Owner:IMAGINATION TECH LTD

System for the secure execution of distributed computing tasks using hardware-based isolation mechanisms

UndeterminedDE202026102580U1Secure communicationComputer architecture
A system for the secure execution of distributed computing tasks using hardware-based isolation mechanisms, wherein the system comprises: a plurality of interconnected computing devices, each computing device comprising a processing unit containing at least one multi-core processor equipped with an isolation circuit configured to define a plurality of execution compartments, each execution compartment being configured to execute a computing task independently with isolated register states, cache allocation boundaries, and instruction pipelines; a memory subsystem electrically connected to the processing unit and consisting of a plurality of physically partitioned memory segments;a memory control unit configured to allocate an appropriate memory segment to each execution compartment and enforce access restrictions that prevent cross-compartment memory access; a secure communication unit configured to establish encrypted and authenticated communication channels between the multiple computing devices; a task distribution unit configured to assign distributed computing tasks to selected execution areas based on resource availability and predefined security restrictions; and a verification unit configured to authenticate executable instructions prior to execution using hardware-based cryptographic validation, ensuring that each distributed computing task is executed in a hardware-isolated execution environment across the multitude of computing devices.
Owner:ANBAZHAGAN SUGUNA +3

Predictively fetching a branch based on a fetch group address and branch history early in an instruction fetch circuit

Aspects include predictively fetching branches based on a fetch group address and branch history early in an instruction fetch circuit. The fetch group address comprises a plurality of instructions which are fetched together, in parallel, from an instruction cache by the fetch instruction circuit. A processor-based device provides the fetch group address, a branch history, and an instruction processing circuit configured to process an instruction stream in an instruction pipeline. The instruction processing circuit comprises the instruction fetch circuit configured to, in response to the fetch group address and the branch history, generate a target address for a fetch group, the fetch group comprising a plurality of fetched instructions from the instruction stream, wherein the target address is a predicted-taken branch. To this end, this branch prediction takes place early in the instruction fetch circuit, thus, decreasing the likelihood of pipeline stalls while also improving the performance of branch prediction.
Owner:QUALCOMM INC

Reusing fetched flushed instructions after instruction pipeline flush to reduce instruction refetch in response to hazard in processor

Embodiments of this disclosure relate to the retrieval of computer program instructions to be executed in a processor. Reusing retrieved, flushed instructions after instruction pipeline flushing in response to a danger in the processor is disclosed to reduce instruction refetching. Instruction processing circuitry is configured to detect retrieved performance degradation instructions (PDIs) during the pre-execution phase of the instruction pipeline, which may cause a precise interrupt that results in instruction pipeline flushing. In response to the detection of a PDI in the instruction pipeline, the instruction processing circuitry is configured to capture, in a pipeline refill circuitry, the retrieved PDI and / or its subsequent, newer retrieved instructions processed after the PDI in the instruction pipeline. If the subsequent execution of a PDI in the instruction pipeline causes instruction pipeline flushing, the instruction processing circuitry can inject the retrieved PDI and / or its newer instructions previously captured from the pipeline refill circuitry into the instruction pipeline to be processed, without requiring such instructions to be refetched.
Owner:MICROSOFT TECHNOLOGY LICENSING LLC

A method for processing instruction pipeline of a processor and the processor

ActiveCN121166207BConcurrent instruction executionSpeculative executionProcessing Instruction
The present disclosure provides a processor instruction pipeline processing method and a processor. A processor comprises a control module; the control module is configured to detect that a first instruction in preliminary decoding is a branch instruction, speculatively execute the branch instruction according to a branch prediction direction, and if a second instruction in preliminary decoding is detected before a result of the speculative execution of the first instruction is generated to be a function call instruction or a function return instruction, suspend all operations after preliminary decoding of the second instruction by an instruction processing pipeline and block an instruction fetching operation of a next instruction by the instruction processing pipeline until the result of the speculative execution of the first instruction is obtained; wherein the operations after preliminary decoding comprise stack or unstack operations of a return address stack (RAS) according to the second instruction. The technical solution herein can shield the pollution risk of the speculative execution of the branch instruction to the return address stack, thereby simplifying the hardware implementation logic of the return address stack, saving circuit area and power consumption.
Owner:SUNMMIO SCIENCE & TECHNOLOGY (BEIJING) CO LTD

Processor soft error injection system and method and chip

The embodiment of the invention discloses a processor soft error injection system and method and a chip, and relates to the technical field of integrated circuits. Comprises: an injection condition register configured to store at least one piece of preset injection trigger information; the injection triggering information comprises an instruction pipeline state information standard which needs to be met for triggering the execution of soft error injection to the target storage unit; the trigger monitoring circuit is configured to monitor instruction assembly line state information of a control circuit in the computing kernel in real time and output an injection trigger signal when the instruction assembly line state information is matched with an instruction assembly line state information standard; and the soft error injection execution circuit is connected with the output end of the trigger monitoring circuit and is configured to respond to the injection trigger signal and inject a soft error into a target storage unit through a second data channel. The problem that instruction stream execution is interfered in the prior art can be solved. The method is suitable for a soft error injection scene.
Owner:HYGON INFORMATION TECH CO LTD

Processing device with vector transformation execution

An integrated circuit (102) includes an instruction pipeline (108) that includes instruction fetch stage circuitry (110), instruction decode stage circuitry (112), and instruction execution circuitry (114). The instruction execution circuitry includes transform circuitry to receive, as input, an interleaved twin vector operand and output a first natural order vector that includes a first set of data values from the interleaved twin vector operand and a second natural order vector that includes a second set of data values from the interleaved twin vector operand.
Owner:TEXAS INSTRUMENTS INC

Processing apparatus with vector transform execution

The invention relates to a processing apparatus with vector transform execution. An integrated circuit (102) includes an instruction pipeline (108) including instruction fetch phase circuitry (110), instruction decode phase circuitry (112), and instruction execution circuitry (114). The instruction execution circuitry includes transform circuitry to receive as input an interleaved dual vector operand and output a first naturally sequential vector including a first set of data values from the interleaved dual vector operand and a second naturally sequential vector including a second set of data values from the interleaved dual vector operand A system.
Owner:TEXAS INSTRUMENTS INC

Detecting repetitive patterns in an instruction pipeline of a processor to reduce repetitive fetches

ActiveCN116018582BData streamRepeat pattern
Exemplary aspects disclosed herein include detecting a repeating pattern in an instruction pipeline of a processor to reduce repeated fetches. The processor includes a pattern recording circuit configured to receive information in a data stream (e.g., instructions or consumed data) in the instruction pipeline. The pattern recording circuit includes a first-in-first-out (FIFO) table circuit containing an input record column and a plurality of additional adjacent record columns. As new data appears in the data stream, the data recording circuit is configured to sequentially record next incoming data from the data stream into a next input entry of the input record column and then move previously recorded data to adjacent entries of the adjacent record columns. A distance between the input record column and an additional record column having matching data is a distance between repeated occurrences of data in the data stream.
Owner:MICROSOFT TECHNOLOGY LICENSING LLC

Processor and method of detecting soft error from processor

A processor includes an instruction pipeline that sequentially processes an original instruction and a duplicate instruction, which is generated by duplicating the original instruction. An original register file stores a result obtained by processing the original instruction in the instruction pipeline within a register of a nth index thereof. A duplicate register file stores a result obtained by processing the duplicate instruction in the instruction pipeline within a register of a nth index thereof. A comparing unit compares the register of the nth index in the original register file with the register of nth index in the duplicate register file and outputs an error detection signal, in response to a control signal.
Owner:SAMSUNG ELECTRONICS CO LTD +1