Unlock instant, AI-driven research and patent intelligence for your innovation.

Data calculation method and device, storage medium and equipment

A data calculation and data technology, applied in the field of data calculation, can solve the problems of precision deviation of final results, sacrifice calculation accuracy, etc., to achieve the effect of saving video memory, reducing calculation accuracy, and providing a better experience

Pending Publication Date: 2022-08-05
NETEASE (HANGZHOU) NETWORK CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, performing calculations after quantizing floating-point data into fixed-point data sacrifices calculation accuracy. If all floating-point data is quantized and processed into fixed-point data before calculation, the accuracy of the final result will have a large deviation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data calculation method and device, storage medium and equipment
  • Data calculation method and device, storage medium and equipment
  • Data calculation method and device, storage medium and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0067] The principles and spirit of the present application will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are given only to enable those skilled in the art to better understand and implement the present application, but do not limit the scope of the present application in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0068] Those skilled in the art know that the embodiments of the present application can be implemented as a system, apparatus, device, method or computer program product. Accordingly, the present disclosure may be embodied in entirely hardware, entirely software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

[0069] It should be noted that terms involved in various embodiments or drawings of the pres...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the field of data calculation, and provides a data calculation method and device, a storage medium and equipment. The method comprises the following steps: acquiring a target activation value and a target weight of a floating point type to be participated in target matrix multiplication; quantizing the target activation value and the target weight to obtain a quantized activation value of a fixed point type corresponding to the target activation value and a quantized weight of the fixed point type corresponding to the target weight; performing the target matrix multiplication operation by adopting the quantization activation value and the quantization weight; and performing inverse quantization processing on the result of the target matrix multiplication operation according to the quantization mode of the target activation value or the target weight to obtain floating point type target output data. By quantifying the limited number of target activation values and target weights meeting the condition, the resource and time consumed during calculation are reduced, the video memory is saved, and the calculation precision is not reduced.

Description

technical field [0001] The present application relates to the field of data computing, and more particularly to a data computing method, apparatus, storage medium and device. Background technique [0002] In some data calculation scenarios, the data is usually input into the model corresponding to the scenario, and the result corresponding to the data is obtained through the calculation of each layer in the model. Among them, the activation values ​​involved in the calculation of each layer in the model are usually floating-point data. [0003] For example, when generating images or texts through a generative model, the target text is obtained by inputting the generative target and latent variables into the model. The activation value involved in the calculation of each layer in the model is usually the corresponding 32-bit floating-point type data, and the target text is obtained after the operation is performed through the model. Among them, the activation value can refe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/08G06N3/04G06F17/16
CPCG06N3/082G06F17/16G06N3/045
Inventor 李恭政
Owner NETEASE (HANGZHOU) NETWORK CO LTD