Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1640results about "Computation using non-contact making devices" patented technology

Ternary logic gate circuit, calculation circuit, chip and electronic equipment

The invention provides a ternary logic gate circuit, a calculation circuit, a chip and electronic equipment. The ternary logic gate circuit provided by the invention can realize addition and subtraction of 1 to an input logic value. Based on the ternary logic gate circuit, 27 univariate functions of ternary logic are utilized, the ternary logic gate circuit is applied to the ternary logic circuit, the purpose of simplifying the structure of the ternary logic circuit can be achieved, the number of transistors in the ternary logic circuit can be reduced, the power consumption of the ternary logic circuit can be reduced, and the reliability of the ternary logic circuit is improved. And the calculation efficiency of the ternary logic circuit is improved.
Owner:HUAWEI TECH CO LTD

Clock signal distribution using photonic fabric

Various embodiments provide for clock signal distribution within a processor, such as a machine learning (ML) processor, using a photonic fabric.
Owner:SICILY MERGER SUB II INC

Electro-photonic network for machine learning

Various embodiments provide for electro-photonic networks, including a plurality of processing elements connected by bidirectional photonic channels, suited for implementing neural-network models. Weights of the model may be preloaded into memory of the processing elements based on assignments of neural nodes to processing elements implementing them, and routers of the processing elements can be configured to stream activations between the processing elements based on a predetermined flow of activations in the model.
Owner:SICILY MERGER SUB II INC

Method and apparatus for direct convolution calculation

Systems and methods for efficient convolution based on matrix multiply and add (MMA) are described. An example processor having a plurality of processing lanes is configured to perform convolution of a matrix of activation elements and a filter matrix in accordance with a configurable series of instructions including a plurality of MMA instructions and shift instructions while reusing activation elements already loaded to the datapath or associated memory over a plurality of MMA operations. Associated methods are also described.
Owner:NVIDIA CORP

Vector computational unit

A microprocessor system comprises a computational array and a vector computational unit. The computational array includes a plurality of computation units. The vector computational unit is in communication with the computational array and includes a plurality of processing elements. The processing elements are configured to receive output data elements from the computational array and process in parallel the received output data elements.
Owner:TESLA INC

Multiple accumulate busses in a systolic array

Systems and methods are provided to enable parallelized multiply-accumulate operations in a systolic array. Each column of the systolic array can include multiple busses enabling independent transmission of input partial sums along the respective bus. Each processing element of a given columnar bus can receive an input partial sum from a prior element of the given columnar bus, and perform arithmetic operations on the input partial sum. Each processing element can generate an output partial sum based on the arithmetic operations, provide the output partial sum to a next processing element of the given columnar bus, without the output partial sum being processed by a processing element of the column located between the two processing elements that uses a different columnar bus. Use of columnar busses can enable parallelization to increase speed or enable increased latency at individual processing elements.
Owner:AMAZON TECH INC

Dynamic data type adjustment during neural network training

One embodiment provides a graphics processor comprising a base die including a plurality of chiplet sockets and a plurality of chiplets coupled with the plurality of chiplet sockets. At least one of the plurality of chiplets including first circuitry configured to perform a multi-dimensional matrix multiply accumulate operation to facilitate training for a neural network and second circuitry configured to perform dynamic datatype adjustment during the training for the neural network. The dynamic datatype adjustment is performed based on statistics generated based on output of the multi-dimensional matrix multiply accumulate operation, neural network model metadata, and training metadata associated with training operations to be performed for the neural network.
Owner:INTEL CORP

Multi-mode compute-in-memory systems and methods for operating the same

A circuit includes local computing cells. Each of the local computing cells can provide, in response to identifying that the input data elements and weight data elements are in a first data type, a first sum including (i) a first product of a first input data element and a first weight data element; and (ii) a second product of a second input data element and a second weight data element. Each of the local computing cells can provide, in response to identifying that the input data elements and weight data elements are in a second data type, (i) a second sum of a first portion of a third input data element and a first portion of a third weight data element; and (ii) a third product of a second portion of the third input data element and a second portion of the third weight data element.
Owner:TAIWAN SEMICONDUCTOR MANUFACTURING CO LTD

Calculation acceleration method based on cooperation of fast Fourier transform and neural network reasoning

The invention belongs to the field of edge computing acceleration, and relates to a fast Fourier transform and neural network reasoning collaborative computing acceleration method, which comprises the following steps of: deploying a computing method which is based on butterfly computing merging and a tensor mapping strategy and is mixed with DFT (Discrete Fourier Transform) and FFT (Fast Fourier Transform) in an operator deployment level; on the interface integration level, a bus interface of a register access path in a tensor accelerator control path is subjected to lightweight reconstruction, so that the bus interface is adaptive to an edge computing platform; in an operation level, a user-defined instruction is introduced into a tensor calculation unit, and an accelerator is enabled to independently complete a whole-process task of FFT signal processing and NN intelligent identification. According to the method, an operation instruction set is expanded on hardware, and delay overhead caused by returning a large amount of intermediate data to a processor is avoided, so that efficient execution of FFT and neural network tasks on unified hardware is guaranteed, and multiple requirements of high real-time performance, high precision and low power consumption are met.
Owner:ZHEJIANG UNIV

Chiplet-based matrix chain multiplication accelerator and acceleration method

The invention discloses a Chiplet-based matrix chain multiplication accelerator and an acceleration method. The matrix chain multiplication accelerator comprises a first matrix multiplication module, a first external memory interface and a nonlinear processing module, and a second matrix multiplication module and a second external memory interface which are connected with each other through Chiplet. The method comprises the following steps: acquiring operator data of a Transform network and preprocessing the operator data to obtain a matrix chain data stream; based on the matrix chain data stream, performing initialization processing on a matrix chain multiplication accelerator to obtain an initialized matrix chain multiplication accelerator; and inputting the matrix chain data stream into the initialized matrix chain multiplication accelerator for matrix multiplication operation to obtain attention matrix data. According to the embodiment of the invention, the utilization rate of the processing element can be improved, so that the memory access times and the data transmission delay are reduced, and the calculation efficiency is improved. The method can be widely applied to the technical field of computer hardware acceleration.
Owner:SUN YAT SEN UNIV

Hardware compression of sparse matrix content

The disclosure describes hardware compression of sparse matrix content. One embodiment provides a graphics processor, the graphics processor comprising: a base die, the base die comprising a plurality of chiplet slots; and a plurality of chiplets, the plurality of chiplets being coupled with the plurality of chiplet slots. At least one chiplet of the plurality of chiplets comprises: a graphical core cluster comprising a plurality of processing elements; a shared local memory coupled with the plurality of processing elements; a plurality of matrix engines coupled to the shared local memory; and codec circuitry coupled with the shared local memory and the plurality of matrix engines. Codec circuitry is configured to decode matrix data stored in a first format in a shared local memory into a second format for consumption by a plurality of matrix engines.
Owner:INTEL CORP

Matrix operation apparatus based on flexible RRAM memory-computing array

The present application relates to the technical field of integrated circuits and relates to a matrix operation apparatus based on a flexible RRAM memory-computing array, and solves the problem in the prior art of the inability to reduce the area of the memory-computing array without affecting the precision. The apparatus comprises: the flexible RRAM memory-computing array for outputting cumulative currents of columns of memory-computing units to a multiplexer (MUX) on the basis of multiple rows of inputs; the MUX for selecting the cumulative current of one column of memory-computing units from among the columns of memory-computing units and sending said cumulative current to an analog-to-digital converter (ADC); the ADC for converting the received cumulative current into a digital signal and sending said digital signal to a subtractor; a popcount module for receiving the multiple rows of inputs, obtaining the number of 1 in the multiple rows of inputs, and outputting the number of 1 to a multiplier; the multiplier for multiplying the number of 1 by a fixed value β and sending a product result to the subtractor; and the subtractor for subtracting the product result from the digital signal to obtain a multiply-accumulate result of the matrix. The present application realizes high-precision memory-computing based on a small-area memory-computing array, further enhances energy efficiency, and can be applied to flexible computing chips to create electronic skin.
Owner:INST OF MICROELECTRONICS CHINESE ACAD OF SCI LTD

Electro-photonic network for machine learning

Electro-photonic networks, including a plurality of processing elements connected by bidirectional photonic channels, suited for implementing neural-network models. Weights of the model may be preloaded into memory of the processing elements based on assignments of neural nodes to processing elements implementing them, and routers of the processing elements can be configured to stream activations between the processing elements based on a predetermined flow of activations in the model.
Owner:SICILY MERGER SUB II INC

Fusion multiply-add operation circuit compatible with multiple floating-point number formats

The invention discloses a fusion multiply-add operation circuit compatible with multiple floating-point number formats, and the circuit comprises an input device which is used for obtaining three floating-point numbers and control information in a fusion multiply-add operation instruction; the input decoding device is used for analyzing the control information and extracting the symbol, the index and the mantissa of each floating-point number; the multiplication correlation device is used for calculating an initial index, a mantissa product and an initial symbol; the addend aligning and shifting device is used for completing addend mantissa aligning and shifting; the additive operation correlation device is used for calculating an addition result, a symbol, a normalized shift bit number and a direction flag bit according to the mantissa product sum; the original result processing device is used for generating an initial rounding bit, a normalized shift pasting bit and intermediate result data; and the final result output device is used for outputting a final operation result compatible with the IEEE-754 or Point floating-point number according to the rounding information. The circuit area and power consumption are remarkably reduced through hardware integration, and meanwhile the calculation efficiency is improved.
Owner:SHANGHAI HIGH-PERFORMANCE INTEGRATED CIRCUIT DESIGN CENT

Multiply-accumulate operation method and device for extremely low precision training

The invention provides a multiply-accumulate operation method and device for extremely low precision training, and the method comprises the steps: obtaining an operated part and to-be-operated data, and the to-be-operated data comprises one or more of floating point, fixed point and logarithm data formats; if the high-precision floating-point number exists in the data to be calculated, decomposing the high-precision floating-point number into the sum of two low-precision floating-point numbers; floating-point, fixed-point and logarithm data formats in the data to be calculated are decoded to be uniform formats of symbols, indexes and mantissas, and input data in the uniform formats are generated; performing multi-term dot product on the input data with the unified format to realize combined calculation of data formats with different precision; and adding the combined calculation result and the calculated part sum by adopting an advanced random rounding method. The method can support the combined calculation among various formats, reduces the bit width of the accumulator on the premise of maintaining the precision requirement by using an advanced random rounding method, and reduces the operation cost and improves the training efficiency under extremely low precision compared with the existing operation hardware.
Owner:TSINGHUA UNIVERSITY

Multi-bit multiplication and addition operation circuit based on 6T-SRAM and control method of multi-bit multiplication and addition operation circuit

The invention relates to a 6T-SRAM (6T-Static Random Access Memory)-based multi-bit multiplication and addition operation circuit and a control method thereof. The circuit comprises a plurality of 6T-SRAM units, a control unit and a calculation unit, the plurality of 6T-SRAM units are arranged in parallel and are respectively controlled by different word lines, the first ends of the plurality of 6T-SRAM units are connected with the same first local bit line, and the second ends of the plurality of 6T-SRAM units are communicated with the same second local bit line; the calculation unit comprises fifth to eighth PMOS tubes and seventh to tenth NMOS tubes; the source electrode of the fifth PMOS tube and the drain electrode of the eighth NMOS tube are used for outputting nodes, the drain electrode of the seventh PMOS tube and the drain electrode of the eighth PMOS tube are used for accessing uncertain level signals, and the grid electrode of the ninth NMOS tube and the grid electrode of the tenth NMOS tube are signal input nodes; the grid electrode of the fifth PMOS tube and the grid electrode of the eighth NMOS tube are respectively connected with the second local bit line and the first local bit line through a control unit, and the control unit is used for realizing switch control. And the storage unit and the calculation unit are configured together, so that in-storage calculation is realized, and the calculation speed is greatly improved.
Owner:ANHUI UNIV

Method and system for generative design based on deep learning and topology optimization

A generative machine learning model, such as a convolutional neural network (CNN), can be trained with solutions from a topology optimization solver for a solution for a topology of a set of structures so that the generative machine learning model can generate a plurality of alternative designs for a structure that are alternative topology optimizations (for the structure) for a set of initial setup parameters. The generative model when being trained includes a generative network and a discriminator network. The generative model can be trained using outputs from a CNN autoencoder for densities and a CNN autoencoder for strain energies.
Owner:ANSYS INC

Multiplication hardware block with adaptive fidelity control system

Methods and systems relating to computational hardware are disclosed herein. One disclosed method for executing a multiplication computation using a computational hardware block includes storing a first operand and a second operand for the multiplication computation. The first operand includes a first set of bit strings. The second operand includes a second set of bit strings. The method also includes multiplying the first set of bit strings and the second set of bit strings in a set of temporal phases using the computational hardware block. Each temporal phase uses a different group of bit strings from the first set of bit strings and the second set of bit strings. A cardinality of the set of temporal phases is determined by a fidelity control value. The fidelity control value adaptively sets a fidelity of execution of the multiplication computation.
Owner:TENSTORRENT AI ULC

Memory device for computing in-memory

A memory device for CIM, applicable to a 3D AND-type flash memory, includes a memory array, input word line pairs, and a signal processing circuit. The memory array includes first and second pairs of memory cells. Each first pair of memory cells includes a first memory cell set coupled to a first GBL and a second memory cell set coupled to a second GBL. Each second pair of memory cells includes a third memory cell set coupled to the first GBL and a fourth memory cell set coupled to the second GBL. Each input word line pair includes a first input word line coupled to the first and the second memory cell sets, and a second input word line coupled to the third and the fourth memory cell sets s. The signal processing circuit is coupled to the first and second global bit lines.
Owner:MACRONIX INTERNATIONAL CO LTD

Complex operation lightweight architecture and method based on FPGA (Field Programmable Gate Array)

The invention provides a complex operation lightweight architecture and method based on an FPGA, the architecture comprises a main scheduling module, a calculation module and a floating point operator module, the calculation module comprises a storage unit and a calculation unit, the storage unit obtains and caches input data of a target algorithm, and the main scheduling module carries out the calculation of the target algorithm according to the operation sequence of the target algorithm. The target algorithm is divided into a plurality of calculation steps, and corresponding operation enable signals are generated and transmitted to the calculation unit; the calculation unit obtains target parameters required by calculation steps from the storage unit according to the operation enable signal, obtains floating point operator units required by the calculation steps from the floating point operator module, and executes the calculation steps to determine an operation intermediate result; and storing the operation intermediate result in a storage unit, generating an operation completion signal and transmitting the operation completion signal to a main scheduling module to control the next calculation step until a final operation result is obtained. Therefore, the FPGA architecture with low power consumption and miniaturization is realized.
Owner:EHIWAY MICROELECTRONIC SCI & TECH (SUZHOU) CO LTD

Srassen matrix multiplication acceleration method based on NPU

The invention discloses a Strassen matrix multiplication acceleration method based on NPU, and belongs to the technical field of hybrid programming. The problem that in the prior art, a method for realizing rapid matrix multiplication by adopting an open-source hybrid programming operator for a sublimation chip does not exist is solved. According to the method, an AscendStrassen operator data path is designed, and data carrying and segmentation are carried out on an input matrix to obtain a block matrix; performing first inter-matrix addition and subtraction operation according to the block matrixes to obtain input data in a matrix multiplication stage, and performing zero addition operation on part of the block matrixes to obtain a converted matrix; performing matrix multiplication to obtain a matrix multiplication result; according to a matrix multiplication result, carrying out second inter-matrix addition and subtraction operation to obtain a sub-matrix; and carrying out data handling and merging on the sub-matrixes to obtain an output matrix. According to the method, the matrix operation time is effectively shortened, the calculation precision is improved, and the method can be applied to mercuric chloride chip hybrid programming.
Owner:HARBIN INST OF TECH

Internal memory, chip and related electronic equipment

The embodiment of the invention discloses an internal memory, a chip and related electronic equipment. A target computing unit of the internal memory comprises a plurality of groups of primary multipliers, a plurality of adder trees and a plurality of secondary multipliers, one group of first-level multipliers is connected with one second-level multiplier through one adder tree; the group of first-level multipliers comprises a plurality of pairs of first multipliers, and each adder tree comprises a first adder, a second adder and a third adder; each pair of first multipliers respectively receive data to perform multiplication operation, and respectively input output results into the first adder to perform addition operation; each second adder receives the output results of the plurality of first adders or the second adder at the upper level to carry out addition operation, and respectively inputs the output results to the second adder at the lower level or the third adder; and each third adder receives the output results of the plurality of second adders to carry out addition operation, and inputs the output results to the secondary multiplier to carry out multiplication operation. By implementing the embodiment of the invention, the memory computing capability can be improved.
Owner:HUAWEI TECH CO LTD

Hardware accelerator with matrix block streaming

A hardware accelerator including tiles arranged in a systolic array. At each of the tiles, the systolic array receives a first input block that includes first input matrix elements of a first input matrix. In each of a plurality of multiplication iterations, at each of the tiles, the systolic array receives a respective second input block. The systolic array computes tile products of the first input matrix elements and second input matrix elements included in the second input blocks. The systolic array adds the tile products to column-wise partial sums and transmits the column-wise partial sums to subsequent tiles along accumulator rings included in array columns of the systolic array. In a subset of the multiplication iterations, the systolic array outputs product block rows of a product matrix. The product block rows each include product matrix blocks computed as rows of the column-wise partial sums.
Owner:MICROSOFT TECHNOLOGY LICENSING LLC

Computing core and data processing method

The embodiment of the invention provides a calculation core and a data processing method, relates to the technical field of chips, and solves the problems that an existing storage and calculation integrated device is low in calculation resource utilization rate and high in hardware cost. According to the specific scheme, a calculation core comprises a plurality of convolution circuits and a plurality of multiplexers, each multiplexer comprises an output end and at least two input ends, the output ends of the multiplexers correspond to the input ends of the convolution circuits in a one-to-one mode, the output end of each convolution circuit in the convolution circuits is coupled with the input ends of the L multiplexers, l is an integer greater than or equal to 2, at least one of the L multiplexers further comprises an external data output end, and at least one of the L convolution circuits corresponding to the L multiplexers further comprises an external data input end. Wherein the multiplexer is used for conducting the output end of at least one convolution circuit coupled with the multiplexer to the output end of the multiplexer.
Owner:HUAWEI TECH CO LTD

Future state estimation apparatus

A storage device stores a state transition model in which a first state transition probability (state transition probability function τ), which indicates the probability that a prediction subject will transition from a first state s to a second state s′ after a first time (Δt) has elapsed, is expressed by a linear combination of weighted basis functions (model storage unit). A computation device calculates a second state transition probability (attenuation-type state transition probability function D), which indicates the probability that the prediction subject will transition from the first state s to the second state s′ after a second time (Δt×∞) has elapsed, by means of a product-sum computation of a weight matrix ∇ representing a matrix the elements of which are the respective weights of the weighted basis functions (future state prediction computation unit).
Owner:HITACHI LTD

Method and apparatus for performing a MAC operation in a memory array

Aspects of the present disclosure are directed to devices and methods for performing MAC operations using a TCAM array as a compute-in-memory (CIM) device that can enable higher computational throughput, higher performance and lower energy consumption compared to computation using a processor outside of a memory array. In some embodiments, weights in a weight matrix may be programmed in SRAMs of a TCAM bit cell array. Each SRAM may operate as a multiplier that performs a multiplication between the stored weight to an input activation value applied at a search line in the TCAM bit cell array. The two SRAMs within a TCAM bit cell may operate independently to receive independently two input activation values on their respective select lines, and to perform a multiplication operation with the stored weight in each respective SRAM.
Owner:MEDIATEK SINGAPORE PTE LTD

Annotation tools for reconstructing three-dimensional roof geometry

Methods and systems for generating geometric models of pitched roofs of buildings based on multiview imagery are provided. An example method involves establishing a three-dimensional coordinate space for the multiview imagery, displaying, through an annotation platform, multiview imagery depicting the pitched roof from different points of view, and providing, through the annotation platform, functionality for a user to define a perimeter of the pitched roof, define a ridge line of the pitched roof, and define at least part of a roof facet of the pitched roof by connecting the ridge line of the pitched roof to the perimeter of the pitched roof.
Owner:ECOPIA TECH CORP