Method and apparatus for prompt word management, device, and storage medium

Abstract

Embodiments of the present disclosure provide a method and apparatus for prompt word management, a device, and a storage medium. The method comprises: in response to receiving a prompt word editing request, presenting an editing interface, wherein the editing interface at least comprises an input area for receiving a target prompt word; and in response to receiving a prompt word publishing request, encapsulating the target prompt word into a callable target task at least on the basis of a user input in the editing interface, wherein the calling of the target task triggers the target prompt word to be inputted to a model. Thus, prompt words can be flexibly designed and managed, and the stability, reliability, convenience and high efficiency of prompt word management and model calling in practical application can be improved.

Description

Method, device, equipment and storage medium for prompt word management

[0001] This application claims priority to the Chinese invention patent application entitled “Method, apparatus, device and storage medium for prompt word management” filed on July 28, 2023, with application number 202310945515.8. The entire contents of that application are incorporated herein by reference. Technical Field

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to methods, devices, apparatuses, and computer-readable storage media for prompt word management. Background Art

[0003] With the development of machine learning technology, machine learning models can now be used to perform tasks in a variety of application environments. Since the development and maintenance of high-performance models requires a lot of technical and financial investment, including large data sets, high-performance computing resources, and professional research teams, Model as a Service (MaaS) has gradually become a viable solution. Users can input prompt words into the model in the cloud to obtain the model output for this prompt word. Therefore, the accuracy of the prompt word will affect the output of the model. How to quickly and easily manage the prompt word is a technical problem that needs to be explored.

[0004] Summary of the Invention

[0005] In a first aspect of the present disclosure, a method for prompt word management is provided. The method comprises: in response to receiving a prompt word edit request, presenting an editing interface, wherein the editing interface includes at least an input area for receiving a target prompt word; and in response to receiving a prompt word publish request, encapsulating the target prompt word into a callable target task based at least on user input in the editing interface, wherein calling the target task triggers the target prompt word to be input into a model.

[0006] In a second aspect of the present disclosure, a device for prompt word management is provided. The device includes: an interface presentation module configured to, in response to receiving a prompt word edit request, present an editing interface, wherein the editing interface includes at least an input area for receiving a target prompt word; and a publishing module configured to, in response to receiving the prompt word publish request, encapsulate the target prompt word into a callable target task based at least on user input in the editing interface, wherein calling the target task triggers the target prompt word to be input into a model.

[0007] In a third aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the electronic device to perform the method of the first aspect.

[0008] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the medium, and the computer program can be executed by a processor to implement the method of the first aspect.

[0009] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0011] FIG1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0012] 2A to 2J are schematic diagrams showing example interfaces of a prompt word management system according to some embodiments of the present disclosure;

[0013] FIG3 is a schematic diagram showing a process of prompt word management according to some embodiments of the present disclosure;

[0014] FIG4 shows a flowchart of a process for prompt word management according to some embodiments of the present disclosure;

[0015] FIG5 shows a schematic structural block diagram of an apparatus for prompt word management according to certain embodiments of the present disclosure; and

[0016] FIG6 illustrates an electronic device in which one or more embodiments of the present disclosure may be implemented. DETAILED DESCRIPTION

[0017] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0018] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below.

[0019] Herein, unless explicitly stated otherwise, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0020] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0021] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the type, scope of use, usage scenarios, etc. of the information involved in the present disclosure should be informed to relevant users and authorization should be obtained from relevant users in an appropriate manner in accordance with relevant laws and regulations. The relevant users may include any type of right holders, such as individuals, enterprises, and groups.

[0022] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can independently choose whether to provide information to the software or hardware such as the electronic device, application, server or storage medium that executes the operation of the technical solution of the present disclosure based on the prompt message.

[0023] As an optional but non-limiting implementation, in response to receiving an active request from a relevant user, a prompt message may be sent to the relevant user in the form of a pop-up window, in which the prompt message may be presented in text form. Furthermore, the pop-up window may also include a selection control for the user to select "agree" or "disagree" to provide information to the electronic device.

[0024] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0025] FIG1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. In this example environment 100, a prompt word management system 120 is running on an electronic device 110. A user 140 can interact with the prompt word management system 120 via the electronic device 110 and / or devices attached to the electronic device 110. The prompt word management system 120 integrates various functions or components to facilitate activities such as creating, modifying, and adjusting prompt words.

[0026] In some embodiments, the prompt word management system 120 can be downloaded and installed as an application on the electronic device 110. In some embodiments, the prompt word management system 120 can also be accessed through other means, such as through a web page.

[0027] In the environment 100 of FIG1 , if the prompt word management system 120 is started, the electronic device 110 may present an interface 150 of the prompt word management system 120. The interface 150 may include various user interfaces provided by the prompt word management system 120. The interface 150 is sometimes also referred to as a client interface.

[0028] In some embodiments, the prompt word management system 120 can use the model 130 to achieve the generation, verification, evaluation, etc. of prompt words. In this article, the prompt word is the input or input template of the model, which can be natural language and / or other modal data, used to guide or stimulate the model to complete specific processing to obtain the desired model output. The prompt word management system 120 can interact with the model 130 to provide model input to the model 130 and obtain corresponding model output from the model 130. The model 130 can run locally on the electronic device 110 or on a remote server. In some embodiments, the model 130 can be a machine learning model, a deep learning model, a learning model, a neural network, etc. In some embodiments, the model 130 can be based on a language model (LM). The language model can have question-answering capabilities by learning from a large amount of corpus. The model 130 can also be based on other appropriate models.

[0029] The electronic device 110 can be any type of device with computing capabilities, including a terminal device and / or a server device. The terminal device can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. The server device can, for example, include a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. In some embodiments, the prompt word management system 120 can be implemented based on a cloud service.

[0030] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.

[0031] The core concept of Model as a Service is to deploy models, especially excellent head models, in the cloud, and users can call models through APIs or SDKs to implement various functions. Model as a Service can quickly deploy and apply advanced AI technologies without incurring expensive R&D costs. Compared with the traditional method of training different models for tasks, the advantages of Model as a Service include lower cost, greater flexibility (users can choose appropriate models and services according to their needs and adjust usage plans at any time), easy integration (Model as a Service can be easily integrated with existing systems through APIs or SDKs without large-scale transformation), continuous updates (cloud models are regularly updated and optimized to ensure that users can enjoy the latest technological achievements), cross-platform compatibility (supports multiple platforms and devices, facilitating cross-platform development for users), as well as security and privacy protection, etc.

[0032] In addition, through the use of platforms and / or systems, calling the model becomes a very simple way. Currently, the use of models is mostly based on instructions and question-and-answer interactions. For users, they only need to design a prompt word to provide to the model to generate an answer. However, since the design of the prompt word needs to fully consider a lot of information, such as contextual information, domain knowledge, and the inherent limitations of the model, and the design of the prompt word needs to be continuously iterated and optimized. Therefore, in practical applications, designing a high-quality prompt word to guide the model to generate more accurate and relevant answers is a very challenging task.

[0033] According to an embodiment of the present disclosure, an improved scheme for prompt word management is proposed. In the embodiment of the present disclosure, in response to receiving a prompt word editing request, an editing interface that at least includes an input area for receiving a target prompt word is presented. In response to receiving a prompt word publishing request, the target prompt word is encapsulated into a callable target task based at least on user input in the editing interface. The call to the target task will trigger the target prompt word to be input into the model. In this way, prompt words can be flexibly designed and managed, and prompt words can be encapsulated into callable tasks, which makes the call of the model very simple, helping to improve the stability, reliability, convenience and efficiency of prompt word management and model call in actual applications.

[0034] Some example embodiments of the present disclosure will be described in detail below with reference to examples in the accompanying drawings.

[0035] In an embodiment of the present disclosure, when prompt word management system 120 is in operation, in response to receiving a prompt word edit request, prompt word management system 120 presents an editing interface including at least an input area for receiving a target prompt word. Prompt word edit requests herein may include, but are not limited to, task creation requests for new prompt words and task modification requests for existing prompt words. For example, if the prompt word edit request is a request to create a new prompt word, the target prompt word is the new prompt word to be created, and prompt word management system 120 may present an editing interface including an input area for receiving the new prompt word.

[0036] Further, in response to receiving a prompt word publishing request, the prompt word management system 120 obtains a callable target task based on the target prompt word at least based on the user input in the editing interface. Exemplarily, the target prompt word can be encapsulated into a section of code corresponding to the callable task, and by triggering the call to this section of code, the corresponding target prompt word can be input into the model. Exemplarily, if the target prompt word indicates a prompt word associated with the article translation, the target task of translating an article can be generated based on the call parameters of the target prompt word and the model, and the model then performs the target task. About the specific manner in which the model performs the target task, in response to calling the target task, the target prompt word is input into the model. The model can perform the operation indicated by the target task based on the target prompt word. For example, based on the target prompt word, the translation of an article is performed.

[0037] The following will describe example interfaces of the prompt word management system of some embodiments of the present disclosure in conjunction with Figures 2A to 2J. Figures 2A to 2J respectively show schematic diagrams of examples of editing interfaces according to some embodiments of the present disclosure. The editing interfaces shown in Figures 2A to 2J may correspond to the prompt word management system 120, which integrates multiple different types of components. It should be understood that the editing interfaces shown in Figures 2A to 2J are merely example interfaces, and various interface designs may actually exist. The various graphical elements in the interface may have different arrangements and different visual representations, one or more elements therein may be omitted or replaced, and one or more other elements may also exist. The embodiments of the present disclosure are not limited in this respect.

[0038] In some embodiments, when the prompt word management system 120 is in operation, the prompt word management system 120 may present an editing interface 200A for receiving a prompt word editing request as shown in FIG2A . In some embodiments, since the prompt word management system 120 supports multi-environment applications, before using the prompt word management system to perform tasks such as creating a new prompt word, it is necessary to first determine the target environment for the task application. In some embodiments, in response to detecting a trigger operation on the environment selection control 201, multiple candidate environments to be selected are presented (as shown in FIG2A , Region A Online, Region B Online, and Region C Online). The target environment for the task application can be determined in response to the selection operation on the candidate environment. For example, in response to receiving a click operation on the candidate environment Region A Online, it is determined as the target environment for the task application. Thus, a target environment that meets regional requirements can be selected based on user needs and the actual application environment.

[0039] In some embodiments, a task list including at least one created task can also be presented on the prompt word management system 120. As shown in Figure 2A, two task lists, "My Task List" and "Public Task List", are presented in the editing interface 200A. In one example, "My Task List" can be, for example, a task list including at least one task created by the current user corresponding to the prompt word management system 120, and "Public Task List" can be, for example, a task list including at least one task created by other users other than the current user and made public so that the current user can obtain it. It can be understood that other task lists can also be presented, or only one task list containing all tasks can be presented, and the present disclosure does not limit this. In response to detecting a trigger operation on "My Task List" or on "Public Task List", it can be switched to presenting at least one task in the corresponding task list. Figure 2A shows an example of presenting at least one task included in "My Task List", and "My Task List" includes Task A, Task B, Task C and Task D.

[0040] The task list includes a task ID and a task name that can be used to identify the task, a task keyword for indicating important task information (such as the required model, task purpose, etc.), the creation time, update time, and creator of the task. The creation time of the task is the time when the task was initially created, and the update time of the task is the time when the task was last updated. In some embodiments, at least one operation control can be presented in association with at least one task included in the task list. In some embodiments, the editing interface 200A includes at least one delete control 205 indicating the deletion of a task, and the at least one delete control 205 corresponds to at least one task in the task list. In response to detecting a trigger operation on the delete control 205, it can be determined that a task deletion request for the corresponding task has been received. In response to the task deletion request, the corresponding task will be removed from the editing interface 200A.

[0041] In some embodiments, the editing interface 200A may further include at least one modification control 204 associated with at least one task included in the task list, wherein the at least one modification control 204 corresponds to at least one task in the task list. In some embodiments, the editing interface 200A further includes a create control 203. It is understood that the editing interface 200A may further include other operation controls, which are not limited by the present disclosure. In some embodiments, in response to detecting a triggering operation on the create control 203, it may be determined that a task creation request for a new prompt word has been received. In response to detecting a triggering operation on the modification control 204, it may be determined that a task modification request for an existing prompt word has been received.

[0042] In some embodiments, since a task is associated with a prompt word, a task creation request and / or task modification request for a task can be understood as a creation request and / or modification request for a prompt word. Such a creation request and modification request both belong to a prompt word edit request for a prompt word. That is, in response to detecting a triggering operation on the create control 203 and / or the modify control 204, a prompt word edit request (create request and / or modification request) for a prompt word can be received.

[0043] In some embodiments, a prompt word edit request may also be received in other ways. For example, the prompt word edit request may be received in response to detecting a voice or gesture corresponding to the prompt word edit request, or detecting a click operation on a corresponding physical control. The voice or gesture here may be pre-set, or include pre-set keywords / key actions. For example, in response to detecting a voice message such as "create task" or "modify task A", it is determined that the prompt word edit request has been received.

[0044] It should be noted that when the prompt word edit request is a request to modify an already created task (e.g., a task modification request received in response to detecting a triggering operation on the modification control 204), the prompt word management system 120 may also determine the permissions of the current user. Specifically, a task may be created by the current user (e.g., at least one task included in the "My Task List" as shown in FIG2A ), or it may be created by another user and then made public so that the current user can access it (e.g., at least one task included in the "Public Task List" as shown in FIG2A ). For tasks created by a user, it can be understood that the user has the highest permission to edit the task and can modify or edit the task. However, for tasks created by another user and then made public so that the current user can access the task, the prompt word management system 120 needs to determine the permissions of the current user to determine whether the current user is eligible to edit the task. It is understood that different users may have different permissions for the same task. For example, user A may have edit permissions, while user B may only have use permissions but not edit permissions. For already created tasks, the prompt word management system 120 may only present the editing interface if it determines that the user has edit permissions for the created task. It is understood that when creating a new task, the prompt word management system 120 can directly present the editing interface without verifying the editing permission. This allows different users to have different permissions for the same task, facilitating task sharing among different users in a team, enabling rapid collaboration and effective communication, and improving the efficiency of prompt word management.

[0045] In some embodiments, the editing interface 200A may further include a help control 202. In response to detecting a trigger operation on the help document control 202, the interface may switch to a document presentation interface (not shown in the figure). The document presentation interface may include, for example, text information and / or image information for prompting the user about the interaction method of the prompt word management system 120, the prompt word creation operation steps, the prompt word modification operation steps, etc. The trigger operation here includes but is not limited to a click operation, a long press operation, a slide operation, a double-click operation, etc.

[0046] In some embodiments, after receiving the prompt word edit request, in response to the prompt word edit request, an editing interface 200B as shown in Figure 2B can be presented. Exemplary, in response to detecting a triggering operation for creating a control 203 and / or modifying a control 204, an editing interface 200B as shown in Figure 2B can be presented. The editing interface 200B can include a task definition area 210. In some embodiments, the task definition area 210 is used to receive the task identifier of the target task, and the task identifier can be used for subsequent calls to the target task. Specifically, when it is necessary to call the target task, the call to the target task can be performed based on the task identifier of the target task, which helps to improve the efficiency of task calling. The task identifier here includes at least one of the task name and the task description. It will be appreciated that the task identifiers of different tasks are different (that is, at least one of the task name and the task description is different).

[0047] Editing interface 200B includes an input area 215. In some embodiments, input area 215 can be used to receive a template for a target prompt word. This template can be used to define the structure of the target prompt word, including one or more variables contained in the target prompt word. This allows for a template to be designed, rather than defining the complete prompt word content once and for all, allowing for the values ​​of corresponding variables to be filled into the template in a specific application, resulting in a complete prompt word input into the model. In response to detecting user input in input area 215, prompt word management system 120 identifies the user input as the template for the received target prompt word. Input area 215 can also present the received target prompt word template to the user. As shown in FIG2B , the template for the target prompt word received in input area 215 may be, for example, "The echo function needs to be implemented based on the message. The original text must be returned without any additional content. message: {{msg}}echo:"

[0048] Since the target prompt word may include at least one variable (such as message, as shown in FIG. 2B ), to define the variable and ensure subsequent variable assignment is more accurate, the editing interface 200B may also include a variable definition area 220. In some embodiments, the variable definition area 220 is used to receive the definition of at least one variable involved in the target prompt word, including but not limited to the variable name (i.e., variable name), variable description, variable default value, etc. As shown in FIG. 2B , the variable definition may indicate the variable name as "msg" and the variable description as "message returned by echo." If user input is received in the "Variable Default Value" field, the received user input may be determined as the default value for the variable. If no user input is received in the "Variable Default Value" field, after the prompt word is issued, in response to detecting a call to the target task, an assignment prompt message may be presented to prompt the user to assign a value to the at least one variable. This presentation method includes but is not limited to voice, vibration, message box, pop-up window, etc. The user can manually assign a value to the at least one variable based on the assignment prompt message, or the prompt word management system 120 may be instructed to automatically assign a value based on an associated database.

[0049] The editing interface 200B also includes a model configuration area 230. In some embodiments, the model configuration area 230 can be used to receive a selection of a target model. When the target task is subsequently called, the target keyword will be input into the target model selected in the model configuration area 230. As shown in Figure 2B, the model configuration area 230 may include a model selection entry 231. In response to detecting a click operation on the model selection entry 231, multiple models can be presented, and then in response to a selection operation on a certain model (such as model A), it is determined as the target model to which the corresponding prompt word will be input. In some embodiments, the model selection entry 231 can also present a pre-set default model, which is the target model.

[0050] In some embodiments, to ensure the accuracy of subsequent task calls and task execution, the model configuration area 230 is also used to receive the definition of processing parameters for the target model. As shown in Figure 2B, the model configuration area 230 may include setting entries for parameters such as degree, maximum length, stop sequence, top, existence penalty, and frequency penalty.

[0051] Exemplarily, the parameters that can be configured in the model configuration area 230 may include a temperature parameter. The temperature can be used to control the diversity and creativity of the generated text. Its value range is usually between 0.1 and 1, indicating the degree of randomness when generating the text. When the value is low, the generated text will be more conservative and predictable, whereas it will be bolder and unpredictable if the value is low. For example, if the value of the temperature is set to 0.5, the generated text will have a certain degree of creativity and variation, but will still maintain a certain degree of coherence and readability. If the value of the temperature is set to 1, the generated text will be more random and unpredictable, and may contain some strange sentences and meaningless content. Therefore, it is necessary to adjust the value of the temperature according to specific needs and application scenarios to achieve the best effect.

[0052] Exemplarily, the parameters that can be configured in the model configuration area 230 may also include a maximum length parameter. The maximum length refers to the maximum length of the generated text. The length of the generated text can be controlled by setting the maximum length of the generated text. If the maximum length is set to 100, the generated text will not exceed 100 characters. This parameter can help control the length of the generated text to adapt to different application scenarios. For example, if you need to generate some short texts, you can set the maximum length to 50, and if you need to generate some long texts, you can set the maximum length to 500 or higher.

[0053] Exemplarily, the parameters that can be configured in the model configuration area 230 may also include a stop sequence parameter. The stop sequence is used to specify a sign to stop when generating text. When any sign specified in the stop sequence appears in the generated text, the API will stop generating text and return the result. This parameter can be used to control the length and content of the generated text, as well as to avoid generating meaningless or incoherent text. For example, if the stop sequence is set to a common period sign such as ".", "?", "!", the API will stop after generating a complete sentence to avoid generating overly long or incomplete text.

[0054] Exemplarily, the parameters that can be configured in the model configuration area 230 may also include a Top P parameter. Top is used to control the diversity and predictability of the generated text. Specifically, Top is a decimal between 0 and 1, indicating that only the top P words with the highest probability are considered when generating text. For example, if Top is set to 0.5, only the 50% of words with the highest probability are considered when generating text, while words with lower probabilities are ignored. This can make the generated text more predictable, but it may also cause the text to be too monotonous and lack creativity. Therefore, according to the specific application scenario and needs, the value of Top can be appropriately adjusted to balance the diversity and predictability of the text.

[0055] For example, the parameters that can be configured in the model configuration area 230 may also include a presence penalty parameter. The presence penalty is used to control whether specific words or phrases are included in the generated text. The higher the value of the presence penalty, the less likely the generated text will contain these words or phrases. This parameter can be used to control the style and content of the generated text to make it more in line with specific needs. For example, if you need to generate text about healthy eating, you can set a presence penalty to ensure that unhealthy food or drinks do not appear in the generated text.

[0056] Exemplarily, the parameters that can be configured in the model configuration area 230 may also include a frequency penalty parameter. The frequency penalty is used to control the frequency of repeated words in the generated text. If a higher frequency penalty value is set, the generated text will try to avoid reusing the same words, thereby making the generated text more diverse and rich. On the contrary, if a lower frequency penalty value is set, a large number of repeated words may appear in the generated text, making the generated text simpler and more repetitive. Therefore, by adjusting the frequency penalty parameter, the diversity and complexity of the generated text can be controlled.

[0057] In response to the setting operation received at at least one setting entrance, the processing parameters of the target model about degree, maximum length, stop sequence, top, existence penalty, frequency penalty, etc. can be determined. In certain embodiments, default parameters can be provided, and the user can modify the default parameters to determine the processing parameters of the target model. It will be appreciated that for different models, the processing parameters that can be configured can be different. In certain embodiments, when the target task is subsequently called, the target model will process the target prompt word to perform the target task according to the defined processing parameters. In certain embodiments, the target model determined in the model configuration area 230 model configuration area 230 can also be used for subsequent verification, evaluation, etc. of the template of the target prompt word.

[0058] As shown in FIG2B , in some embodiments, the editing interface 200B may further include an edit control presentation area 240. A save control 241 may be presented in the edit control presentation area 240. In some embodiments, in response to detecting a triggering operation on the save control 241, it may be determined that a save request for the target prompt word has been received. Information such as the template, variable definitions, and model processing parameters of the target prompt word determined in the editing interface 200B may be saved. In some embodiments, this information will be saved to a draft box for continued editing next time.

[0059] A validation control 242 may also be presented in the edit control presentation area 240. In some embodiments, before the target prompt word is published, that is, before receiving a prompt word publication request, a validation request for the target prompt word may be determined to have been received in response to detecting a trigger operation on the validation control 242. In response to receiving the validation request for the target prompt word, the target prompt word is input into a model based at least on user input in the edit interface, and a model output for the target prompt word is received from the model. Furthermore, the received model output may also be presented in the edit interface 200B. As shown in FIG2C , a validation request for the target prompt word may be determined to have been received in response to receiving a trigger operation on the validation control 242. Furthermore, in response to the validation request for the target prompt word, a validation area 250 may be presented in the edit interface 200B. The validation area 250 includes a variable presentation area 251, which may present values ​​assigned to variables in the template of the target prompt word based on user input (this value assignment is the user input). Verification area 250 also includes a template presentation area 252 for presenting a template for the target prompt word, and an output presentation area 253 for presenting the model output for the target prompt word received from the model. In some embodiments, verification area 250 also presents a cancel control 254 and a start debugging control 255. In response to detecting a triggering operation on cancel control 254, verification of the target prompt word can be terminated. It will be understood that after verification is canceled, editing interface 200B will stop presenting verification area 250. In response to detecting a triggering operation on start debugging control 255, verification of the target prompt word can be initiated, and the values ​​of the variables presented in variable presentation area 251 are assigned to the template shown in template presentation area 252 to obtain the target prompt word, which is then input into the model. The model output for the target prompt word can be received from the model and presented in output presentation area 253. Therefore, the user can determine whether the template of the target prompt word needs to be adjusted based on the model output presented in the output presentation area 253, and by repeating such verification operations multiple times, a prompt word template that meets the user's needs can be obtained, which can improve the accuracy of the finally generated prompt word.

[0060] As shown in Figure 2D, an evaluation control 243 may also be presented in the editing control presentation area 240. In some embodiments, in response to detecting a trigger operation on the evaluation control 243, it may be determined that a request for evaluating the target prompt word has been received. In response to receiving the evaluation request for the target prompt word, an evaluation input area may be presented. The evaluation input area may be used to receive evaluation data for the target prompt word, where the evaluation data indicates multiple values ​​of at least one variable involved in the template of the target prompt word. Furthermore, an evaluation result for the target prompt word is generated based on the evaluation data. As shown in Figure 2D, in response to receiving a trigger operation on the evaluation control 243, it may be determined that a request for evaluating the target prompt word has been received. In response to receiving the evaluation request, an evaluation prompt message 260 may be presented in the editing interface 200B. The evaluation prompt message 260 may prompt the user that the evaluation set template for evaluation is being generated by displaying text such as "Evaluation set template generating." In response to the completion of the evaluation set template generation, the presentation of the evaluation prompt message 260 may be canceled. Furthermore, an evaluation input area 270 as shown in FIG. 2E may be presented.

[0061] As shown in Figure 2E, in response to receiving a trigger operation for the evaluation control shown in Figure 2D, it is determined that an evaluation request for the target prompt word has been received. In response to receiving the evaluation request, the editing interface 200B can present an evaluation input area 270. The model configuration area 230 evaluation input area 270 can, for example, at least include an evaluation set input entry 271, an evaluation set upload control 272, and an evaluation control 273. The evaluation set input entry 271 can be used to receive evaluation data (also referred to as an evaluation set) for the target prompt word. The evaluation data here can indicate multiple values ​​of at least one variable involved in the template of the target prompt word. For example, the evaluation data can indicate that the three values ​​for variable A are a, b, and c.

[0062] In some embodiments, the evaluation data required for the evaluation can be manually entered by the user in the evaluation set input entry 271. In some embodiments, in response to detecting a trigger operation on the evaluation set upload control 272, a selection page for existing evaluation data can be presented, and in response to the user's selection of a certain evaluation data, the target evaluation data required for the evaluation can be determined. In some embodiments, the evaluation set input entry 271 can also be used to present user-entered evaluation data or target evaluation data selected by the user through the evaluation set upload control 272. As shown in Figure 2F, the evaluation data to be used for the evaluation can be presented at the evaluation set input entry 271: Evaluation Set A.

[0063] In some embodiments, after the evaluation data required for the evaluation is determined, the evaluation for the target prompt word can be performed in response to detecting a trigger operation on the evaluation control 273. In some embodiments, in response to detecting a trigger operation on the evaluation control 273, the editing interface 200B can present an evaluation prompt area 280 as shown in Figure 2G. The evaluation prompt area 180 is used to prompt the user that the evaluation for the target prompt word is currently being performed. In some embodiments, the evaluation prompt area 280 may include a cancel control 281. In response to detecting a trigger operation on the cancel control 281, the presentation of the evaluation prompt area 280 is canceled. In some embodiments, canceling the presentation of the evaluation prompt area 280 also stops the evaluation of the template for the target prompt word.

[0064] In some embodiments, in response to detecting a triggering operation on the cancel control 281, only the presentation of the evaluation prompt area 280 is canceled, and the execution of the evaluation will not be affected. In this case, after the evaluation prompt area 280 is canceled, the editing interface 200B can present the evaluation prompt information in the evaluation input area 270. As shown in Figure 2H, information such as "Evaluation is running" can be presented at the evaluation set input entrance 271 to prompt the user that the evaluation for the target prompt word is currently being performed. In addition, the evaluation termination control 274 can also be presented in the evaluation input area 270. In response to detecting a triggering operation on the evaluation termination control 274, the evaluation of the template of the target prompt word is stopped. It can be understood that after the evaluation is stopped, the information such as "Evaluation is running" presented at the evaluation set input entrance 271 will also be stopped.

[0065] Regarding the specific method of executing the evaluation, in some embodiments, an evaluation result can be generated based on the evaluation data for the target prompt word. Specifically, multiple test prompt words are generated by assigning multiple values ​​for at least one variable in the evaluation data to at least one variable. For example, assigning variable A in the template to a, b, and c can generate three different test prompt words. These multiple test prompt words are input into the model, so that the model generates model outputs for the test prompt words based on these multiple test words. The multiple model outputs for the test prompt words are obtained from the model, and the evaluation result is generated based on the multiple model outputs. In some embodiments, an access point for the evaluation results can also be provided in the editing interface 200B. As shown in Figure 2I, in response to receiving multiple output results from the model, the evaluation results can be generated based on the multiple model outputs. In response to the generation of the evaluation results, the editing interface 200B can present an access point 275 for the evaluation results in the evaluation input area 270. Access point 275 can be used to present the generated evaluation results. In response to receiving a triggering operation for the evaluation results presented in access entry 275, the details of the evaluation results can be presented. Furthermore, a prompt message such as "Evaluation results have been updated in this document" can be presented at access entry 275 to inform the user that the evaluation results have been generated and can be viewed. At this point, the evaluation of the target prompt word can be considered complete. Thus, an evaluation set containing a large dataset can be used to evaluate the prompt words to be published to determine whether the quality of the prompt words meets expectations, which helps improve the quality of the prompt words and, in turn, the quality of subsequent tasks.

[0066] It should be noted that in the above-mentioned verification and / or evaluation of the target prompt words, the prompt word management system 120 can be integrated with other tools and applications to realize an automated workflow, that is, it can automatically perform verification and / or evaluation of the target prompt words in response to the user's triggering operation on the corresponding control, which can reduce the manpower required and help improve the efficiency of verification and / or evaluation.

[0067] It should be noted that, although not shown in FIG2E , the editing interface 200B may still include the task definition area 210 and the model configuration area 230, and the same applies to subsequent figures. In some embodiments, the editing interface 200B further includes a sliding control 206. In response to detecting a pull-up operation or a swipe-down operation on the sliding control 206, other content may be presented in the editing interface 200B. It will be understood that other content may also be presented in the editing interface 200B in response to detecting a trigger operation on the corresponding physical control, and / or in response to detecting a sliding operation in the editing interface 200B (for example, presenting the task definition area 210 in response to detecting a swipe-down operation).

[0068] For the target prompt word of completing verification and / or completing evaluation, in response to receiving prompt word publishing request, the target prompt word is encapsulated into a callable target task. In some embodiments, in response to the completion of verification and / or evaluation, editing interface 200B will present publishing control. In response to detecting the triggering operation to publishing control, it is determined that the prompt word publishing request is received. In some embodiments, this publishing control can only be presented in editing interface 200B when completing verification and / or completing evaluation. Alternatively or additionally, in some embodiments, this publishing control can also be presented in editing interface 200B all the time, even if the target prompt word has not completed verification and / or completed evaluation, it can still be determined that the prompt word publishing request is received in response to detecting the triggering operation to publishing control, and then the target prompt word is encapsulated into a callable target task.

[0069] As shown in FIG2J , a publish control 244 may also be presented in the edit control presentation area 240 of the editing interface 200B. It should be noted that although the evaluation input area 270 is not shown in FIG2J , when the evaluation is completed, the evaluation input area 270 may be presented in the editing interface 200B in response to receiving a pull-down operation on the slide control 206, in response to detecting a trigger operation on a corresponding physical control, and / or in response to detecting a swipe-up operation in the editing interface 200B. Receipt of a prompt word publish request may be determined in response to detecting a trigger operation on the publish control 244.

[0070] In some embodiments, the user can also select the version number of the target task to be packaged before triggering the release control. As shown in Figure 2I, the editing interface 200B can also present a version selection entry 207. In response to detecting the triggering operation on the version selection entry 207, at least one version number can be presented, for example, the four version numbers "$DEV, 3, 2, 1" are presented. It should be noted that when the version number selection entry 207 corresponds to the development identifier DEV, it means that it is currently in the development state, that is, in the state of editing and unpublishing the target prompt word. In this case, the target prompt word cannot be called for a task, and operations such as editing, verification, and evaluation can only be performed on the target prompt word. When the version number selection entry 207 corresponds to a version number other than DEV, for example, corresponding to 1, it means that the target task is associated with version number 1.

[0071] In some embodiments, if the target task is determined to be associated with a specific, non-development version number, the editing interface 200B may further present a version disable indicator 208. In response to detecting a triggering operation on the version disable indicator 208, the currently selected version number is disabled. In some embodiments, the editing interface 200B further presents a status indicator control 209, which is used to indicate the current version status. Exemplarily, the status indicator control 209 may present three states: DEV, ACTIVE, and DISABLED.

[0072] It should be noted that, regarding the version number associated with the target task, when the prompt word edit request is a task creation request, the target task is associated with a first version number in response to the prompt word publish request. The first version number here can be any version number. When the prompt word edit request is a modification request for an already created task, the target task is associated with a second version number in response to the prompt word publish request. The second version number here is different from the version number of the already created task. Exemplarily, in the creation phase of the target task, the version number associated with the target task can be 1, and in the modification phase of the target task, the version number associated with the modified target task can be 2, 3, 4, and so on. Thus, target tasks at different stages can be associated with different version numbers, which helps users to search for the target task later. For example, if a user expects to find the target task after the second modification, the user can directly find the target task after the second modification from multiple target tasks based on the version number associated with the target task after the second modification.

[0073] In some embodiments, since target tasks at different stages are associated with different version numbers (e.g., a target task at the creation stage and a target task at the first modification stage), it is also possible to call a target task based on the target task's version number. This allows for quick and easy determination of the target task to be called from multiple target tasks, allows for calling target tasks with different historical versions, and helps improve the efficiency of target task calling.

[0074] 3 , which shows a schematic diagram of a process 300 for prompt word management according to some embodiments of the present disclosure. The process 300 may be implemented in the prompt word management system 120. For ease of discussion, the process 300 will be described with reference to the environment 100 of FIG1 .

[0075] At block 310 , the cue word management system 120 creates a target task on the cue word management system 120 in response to the received user input.

[0076] In block 320 , the prompt word management system 120 defines a prompt word template in response to user input in the prompt word management system 120 . The prompt word template here is a template of the target prompt word.

[0077] In block 330 , in response to receiving the evaluation request for the prompt word, the prompt word management system 120 performs an evaluation operation on the prompt word to evaluate the actual effect of the prompt word.

[0078] At block 340, a determination is made as to whether the prompt word meets the launch criteria. In some embodiments, the prompt word can be evaluated to determine whether it meets user expectations. If it does, the launch criteria are determined to be met. Furthermore, at block 350, the prompt word meeting the launch criteria can be published.

[0079] In some embodiments, if the actual evaluation results do not meet expectations, it can be determined that the release criteria have not been met. The prompt word management system 120 can prompt the user to modify the prompt word template, thereby returning to the steps shown in block 320. In some embodiments, the evaluation steps shown in block 330 and the determination steps shown in block 340 can be continued for the modified prompt word template until the modified prompt word template meets the release criteria and can be released.

[0080] In some embodiments, in addition to performing the evaluation method shown in block 33 on the prompt word, verification may also be performed on it to determine its actual effect.

[0081] To sum up, according to the embodiments of the present disclosure, prompt words can be flexibly designed and managed, and prompt words can be encapsulated into callable tasks, which makes the call of the model very simple and can improve the stability, reliability, convenience and efficiency of prompt word management and model call in actual applications.

[0082] It should be understood that some embodiments of the present disclosure are described above with reference to the specific examples in the accompanying drawings, but these specific examples do not limit the scope of the embodiments of the present disclosure. The described embodiments can also be implemented in various other variations.

[0083] FIG4 shows a flow chart of a process 400 for prompt word management according to some embodiments of the present disclosure. The process 400 may be implemented at the prompt word management system 120. The process 400 is described below with reference to FIG1.

[0084] In block 410 , in response to receiving the prompt word editing request, the prompt word management system 120 presents an editing interface, where the editing interface at least includes an input area for receiving a target prompt word.

[0085] In block 420 , in response to receiving the prompt word publishing request, the prompt word management system 120 encapsulates the target prompt word into a callable target task based at least on the user input in the editing interface, wherein calling the target task triggers the target prompt word to be input into the model.

[0086] In some embodiments, the editing interface also includes a variable definition area for receiving a definition of at least one variable involved in the target prompt word, and wherein the call to the target task will trigger the at least one variable to be assigned a value and the target prompt word with the at least one assigned variable to be input into the model.

[0087] In some embodiments, the editing interface further comprises a model definition area for receiving a selection of a target model, and wherein the invocation of the target task triggers the target prompt word to be input into the selected target model.

[0088] In some embodiments, the model definition area is further used to receive a definition of processing parameters of the target model, and wherein the call to the target task will trigger the target model to process the target prompt word according to the defined processing parameters.

[0089] In some embodiments, the editing interface further includes a task definition area for receiving a task identifier of the target task, and wherein calling the target task includes calling the target task according to the task identifier of the target task.

[0090] In some embodiments, the input area is used to receive a template of a target prompt word, where the template defines the structure of the target prompt word.

[0091] In some embodiments, process 400 further includes: before receiving a prompt word publishing request, in response to receiving a verification request for a target prompt word, inputting the target prompt word into the model based at least on user input in the editing interface; receiving a model output for the target prompt word from the model; and presenting the received model output.

[0092] In some embodiments, process 400 further includes: in a case where the prompt word edit request is a task creation request, in response to the prompt word publish request, associating the target task with a first version number; and in a case where the prompt word edit request is a modification request for an already created task, in response to the prompt word publish request, associating the target task with a second version number, the second version number being different from the version number of the already created task.

[0093] In some embodiments, calling the target task includes calling the target task according to a version number of the target task.

[0094] In some embodiments, process 400 further includes: in response to receiving an evaluation request for a target prompt word, presenting an evaluation input area; receiving evaluation data for the target prompt word in the evaluation input area, the evaluation data indicating multiple values ​​of at least one variable involved in the target prompt word; generating an evaluation result for the target prompt word based on the evaluation data; and providing access to the evaluation result.

[0095] In some embodiments, generating an evaluation result includes: generating multiple test prompt words by assigning at least one variable using multiple values ​​for at least one variable in the evaluation data; inputting the multiple test prompt words into the model respectively; receiving multiple model outputs for the test prompt words from the model; and generating an evaluation result based on the multiple model outputs.

[0096] In some embodiments, presenting the editing interface includes: determining the authority of the user who initiated the prompt word editing request if the prompt word editing request is a modification request for an already created task; and presenting the editing interface if the user has an editing request for the already created task.

[0097] In some embodiments, the process 400 further includes: presenting a task list on the prompt word management system, where the task list includes at least one created task.

[0098] FIG5 shows a schematic structural block diagram of an apparatus 500 for prompt word management according to certain embodiments of the present disclosure. The apparatus 500 may be implemented as or included in the prompt word management system 120. Each module / component in the apparatus 500 may be implemented by hardware, software, firmware, or any combination thereof.

[0099] As shown, the apparatus 500 includes an interface presentation module 510 configured to, in response to receiving a prompt word edit request, present an editing interface, wherein the editing interface includes at least an input area for receiving a target prompt word. The apparatus 700 also includes a publishing module 520 configured to, in response to receiving a prompt word publish request, encapsulate the target prompt word into a callable target task based at least on user input in the editing interface, wherein calling the target task triggers the target prompt word to be input into the model.

[0100] In some embodiments, the editing interface also includes a variable definition area for receiving a definition of at least one variable involved in the target prompt word, and wherein the call to the target task will trigger the at least one variable to be assigned a value and the target prompt word with the at least one assigned variable to be input into the model.

[0101] In some embodiments, the editing interface further comprises a model definition area for receiving a selection of a target model, and wherein the invocation of the target task triggers the target prompt word to be input into the selected target model.

[0102] In some embodiments, the model definition area is further used to receive a definition of processing parameters of the target model, and wherein the call to the target task will trigger the target model to process the target prompt word according to the defined processing parameters.

[0103] In some embodiments, the editing interface further includes a task definition area for receiving a task identifier of the target task, and wherein calling the target task includes calling the target task according to the task identifier of the target task.

[0104] In some embodiments, the input area is used to receive a template of a target prompt word, where the template defines the structure of the target prompt word.

[0105] In some embodiments, the device 500 also includes: a prompt word input module, which is configured to input the target prompt word into the model in response to receiving a verification request for the target prompt word before receiving the prompt word release request, at least based on user input in the editing interface; an output receiving module, which is configured to receive a model output for the target prompt word from the model; and an output presentation module, which is configured to present the received model output.

[0106] In some embodiments, the device 500 also includes: a first association module, configured to associate the target task with a first version number in response to a prompt word publication request when the prompt word editing request is a task creation request; and a second association module, configured to associate the target task with a second version number in response to a prompt word publication request when the prompt word editing request is a modification request for an already created task, the second version number being different from the version number of the already created task.

[0107] In some embodiments, calling the target task includes calling the target task according to a version number of the target task.

[0108] In some embodiments, the device 500 also includes: an evaluation area presentation module, configured to present an evaluation input area in response to receiving an evaluation request for a target prompt word; an evaluation data receiving module, configured to receive evaluation data for the target prompt word in the evaluation input area, the evaluation data indicating multiple values ​​of at least one variable involved in the target prompt word; an evaluation result generation module, configured to generate an evaluation result for the target prompt word based on the evaluation data; and an access entry providing module, configured to provide an access entry for the evaluation result.

[0109] In some embodiments, the evaluation result generation module includes: a test prompt word generation module, configured to generate multiple test prompt words by assigning at least one variable using multiple values ​​for at least one variable in the evaluation data; an input module, configured to input the multiple test prompt words into the model respectively; a receiving module, configured to receive multiple model outputs for the test prompt words from the model; and a generation module, configured to generate evaluation results based on the multiple model outputs.

[0110] In some embodiments, the interface presentation module 510 includes: an authority determination module, configured to determine the authority of the user who initiates the prompt word editing request when the prompt word editing request is a modification request for an already created task; and a presentation module, configured to present an editing interface if the user has an editing request for an already created task.

[0111] In some embodiments, the apparatus 500 further includes: a task list presenting module configured to present a task list on the prompt word management system, where the task list includes at least one created task.

[0112] The modules and / or units included in the device 500 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more modules and / or units can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the modules and / or units in the device 500 can be implemented at least in part by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0113] It should be understood that one or more steps in the above method may be performed by an appropriate electronic device or combination of electronic devices, which may include, for example, the electronic device 110 in FIG. 1 and / or a combination with other electronic devices.

[0114] FIG6 shows a block diagram of an electronic device 600 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 600 shown in FIG6 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 600 shown in FIG6 can be used to implement the electronic device 110 of FIG1 .

[0115] As shown in FIG6 , electronic device 600 is a general-purpose electronic device. Components of electronic device 600 may include, but are not limited to, one or more processors or processing units 610, memory 620, storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. Processing unit 610 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 620. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to enhance the parallel processing capabilities of electronic device 600.

[0116] The electronic device 600 typically includes a plurality of computer storage media. Such media can be any available media accessible to the electronic device 600, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 620 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 630 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 600.

[0117] The electronic device 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG6 , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 620 may include a computer program product 625 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0118] The communication unit 640 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 600 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 600 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0119] The input device 650 may be one or more input devices, such as a mouse, keyboard, or trackball. The output device 660 may be one or more output devices, such as a display, a speaker, or a printer. The electronic device 600 may also communicate with one or more external devices (not shown) through the communication unit 640 as needed, such as a storage device, a display device, or the like, with one or more devices that allow a user to interact with the electronic device 600, or with any device that allows the electronic device 600 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0120] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0121] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0122] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0123] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0124] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0125] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for prompt word management, executed by a prompt word management system, the method comprising: In response to receiving a prompt word editing request, presenting an editing interface, wherein the editing interface at least includes an input area for receiving a target prompt word; as well as In response to receiving a prompt word publishing request, the target prompt word is encapsulated into a callable target task based at least on user input in the editing interface, wherein calling the target task will trigger the target prompt word to be input into the model.

2. The method according to claim 1, wherein the editing interface further comprises a variable definition area for receiving a definition of at least one variable involved in the target prompt word, and The call to the target task will trigger the at least one variable to be assigned a value and the target prompt word with the at least one assigned variable to be input into the model.

3. The method according to claim 1, wherein the editing interface further comprises a model definition area for receiving a selection of a target model, and The call to the target task will trigger the target prompt word to be input into the selected target model.

4. The method according to claim 3, wherein the model definition area is further used to receive a definition of processing parameters of the target model, and The call to the target task will trigger the target model to process the target prompt word according to the defined processing parameters.

5. The method according to claim 1, wherein the editing interface further comprises a task definition area for receiving a task identifier of the target task, and The calling of the target task includes calling the target task according to a task identifier of the target task. 6 . The method according to claim 1 , wherein the input area is used to receive a template of the target prompt word, the template defining the structure of the target prompt word.

7. The method according to claim 1, further comprising: Before receiving the prompt word publishing request, in response to receiving a verification request for the target prompt word, inputting the target prompt word into the model based at least on a user input in the editing interface; receiving a model output for the target cue word from the model; as well as The received model output is presented.

8. The method according to claim 1, further comprising: In the case where the prompt word editing request is a task creation request, in response to the prompt word publishing request, associating the target task with a first version number; as well as In the case that the prompt word editing request is a modification request for a created task, in response to the prompt word publishing request, the target task is associated with a second version number that is different from the version number of the created task. 9 . The method according to claim 8 , wherein calling the target task comprises calling the target task according to a version number of the target task.

10. The method according to claim 1, further comprising: In response to receiving an evaluation request for the target prompt word, presenting an evaluation input area; receiving evaluation data for the target prompt word in the evaluation input area, the evaluation data indicating multiple values ​​of at least one variable involved in the target prompt word; Generating an evaluation result for the target prompt word based on the evaluation data; as well as Providing access to the evaluation results.

11. The method according to claim 10, wherein generating the evaluation result comprises: Generating a plurality of test prompt words by respectively assigning a value to the at least one variable using a plurality of values ​​for the at least one variable in the evaluation data; Inputting the plurality of test prompt words into the model respectively; receiving a plurality of model outputs from the model for the test cue word; as well as The evaluation result is generated based on the plurality of model outputs.

12. The method according to claim 1, wherein presenting the editing interface comprises: In the case where the prompt word editing request is a request to modify a created task, determining the authority of the user who initiated the prompt word editing request; as well as If the user has an editing request for the created task, the editing interface is presented.

13. The method according to claim 1, further comprising: A task list is presented on the prompt word management system, wherein the task list includes at least one created task.

14. A device for prompt word management, comprising: An interface presentation module is configured to present an editing interface in response to receiving a prompt word editing request, wherein the editing interface at least includes an input area for receiving a target prompt word; as well as The publishing module is configured to encapsulate the target prompt word into a callable target task in response to receiving a prompt word publishing request, at least based on user input in the editing interface, wherein the call to the target task will trigger the target prompt word to be input into the model.

15. An electronic device, comprising: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 13 when executed by the at least one processing unit.

16. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 13.

Images