Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and device for determining prompt vector of pre-training model and electronic equipment

A determination method and pre-training technology, applied in neural learning methods, biological neural network models, electrical digital data processing, etc., can solve the problems of deep layers, large amount of calculation, long time for prompt vector, etc., to save time, Improve efficiency and reduce the amount of data

Active Publication Date: 2022-07-26
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF15 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Usually the parameters of the pre-training model may be large, the number of layers may be deep, and the amount of calculation involved may be large, which may lead to a long time to calculate the hint vector

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for determining prompt vector of pre-training model and electronic equipment
  • Method and device for determining prompt vector of pre-training model and electronic equipment
  • Method and device for determining prompt vector of pre-training model and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding and should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted from the following description for clarity and conciseness.

[0031] Artificial intelligence is the study of making computers to simulate certain thinking processes and intelligent behaviors of people (such as learning, reasoning, thinking, planning, etc.), both hardware-level technology and software-level technology. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artifi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and device for determining a prompt vector of a pre-training model and electronic equipment, and particularly relates to the technical field of artificial intelligence such as natural language processing and deep learning. According to the scheme, the method comprises the steps of obtaining a first prompt vector and a first vector corresponding to sample data; fusing the first vector and the first prompt vector, and inputting the fused first vector and the fused first prompt vector into a pre-training model to obtain a reward value corresponding to the first prompt vector; based on the reward value, correcting the first prompt vector to determine a second prompt vector; and based on the second prompt vector, returning to execute the operation of obtaining the reward value until a target prompt vector corresponding to the sample data is determined. Therefore, the prompt vector can be corrected based on the reward value to determine the next prompt vector, that is, the target prompt vector is determined through forward inference, so that computing resources are saved, time for determining the target prompt vector is saved, efficiency is improved, and conditions are provided for industrial deployment.

Description

technical field [0001] The present disclosure relates to the field of computer technologies, in particular to the fields of artificial intelligence technologies such as natural language processing and deep learning, and in particular, to a method, device, electronic device and storage medium for determining a prompt vector of a pre-training model. Background technique [0002] With the development of computer technology, the application of natural language processing is becoming more and more extensive. [0003] In the related art, a set of continuous prompt prompt vectors can be added to the input end of the pre-training model, and then the training samples can be used to back-propagate and optimize the prompt vector when the parameters of the pre-training model are fixed to determine the optimal prompt vector. Tips vector. Usually, the parameters of the pre-trained model may be large, the number of layers may be deep, and the amount of computation involved may be large, w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/289G06K9/62G06N3/04G06N3/08
CPCG06F40/289G06N3/084G06N3/045G06F18/241
Inventor 柴业坤王硕寰孙宇
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD