Information processing system and program

The system addresses the challenge of creating effective prompts for generative AI systems by enabling prompt generation and refinement through user interaction and AI feedback, ensuring desired output quality.

JP7620171B1Active Publication Date: 2025-01-23CLINKS

Patent Information

Application Number
JP2024166440
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-09-25
Publication Date
2025-01-23
Estimated Expiration
2044-09-25

AI Technical Summary

Technical Problem

Inexperienced users face difficulty in creating appropriate prompts for generative AI systems, leading to undesired AI output information, and struggle to improve these prompts effectively.

Method used

An information processing system and program that includes a control means, storage means, and communication means to facilitate prompt generation, transmission, and improvement, allowing users to generate and refine prompts based on AI output feedback.

Benefits of technology

Enables users to obtain improved AI-generated information by generating and refining prompts using user input and AI output feedback, ensuring desired output quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007620171000001_ABST
    Figure 0007620171000001_ABST
Patent Text Reader

Abstract

To provide an information processing system and a program capable of improving prompts when AI output information from a generation AI system is not as desired. [Solution] The information processing system comprises a control means 20 and a memory means 21, and the control means 20 comprises a user terminal communication unit 30, a prompt generation unit 31, a prompt sending unit 33, and an AI output information acquisition unit 34, wherein the prompt generation unit 31 sends AI output information acquired in response to the initial prompt to the user terminal 12, and then generates an improvement request prompt that requests an improvement prompt that improves the initial prompt based on the AI ​​output improvement information input at the user terminal 12, the prompt sending unit 33 sends the improvement request prompt to the generation AI system, and the user terminal communication unit 30 sends the improvement prompt included in the AI ​​output information acquired in response to the improvement request prompt to the user terminal 12.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing system and program for generating and improving prompts to be sent to a generative AI system. [Background technology]

[0002] In recent years, generative AI systems using large-scale language models (LLMs) have been used to provide services that generate sentences in a dialogue with users. In order to obtain the desired output from such generative AI systems, users must create appropriate prompts and input them to the generative AI system.

[0003] However, it is difficult for an inexperienced user to create an appropriate prompt. For this reason, a system that generates a prompt for a generative AI system is also known. For example, Patent Document 1 lists a system that generates a prompt to be input to a generative AI system using LLM. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 7313757 Summary of the Invention [Problem to be solved by the invention]

[0005] AI output information can be obtained by sending a prompt created or generated by a user or system to the generation AI system. If the prompt is not written properly, the AI ​​output information may not be what the user wants. In this case, the prompt needs to be improved to obtain the desired AI output information, but it is difficult for an inexperienced user to determine how to improve the prompt.

[0006] The present invention has been made in consideration of the above-mentioned problems, and aims to provide an information processing system and program that can improve prompts when the AI ​​output information from a generation AI system is not as desired. [Means for solving the problem]

[0007] In order to solve the above problem, the information processing system of the present invention is an information processing system that can be used from a user terminal, and is equipped with a control means and a storage means, wherein the control means is equipped with a user terminal communication unit that transmits and receives information between the user terminal, a prompt generation unit that generates a prompt to be transmitted to a generative AI system, a prompt transmission unit that transmits the prompt to the generative AI system, and an AI output information acquisition unit that acquires AI output information from the generative AI system, wherein the prompt generation unit transmits the AI ​​output information acquired in response to an initial prompt transmitted from the prompt transmission unit to the user terminal, and then generates an improvement request prompt that requests an improvement prompt that improves the initial prompt based on AI output improvement information input at the user terminal, the prompt transmission unit transmits the improvement request prompt to the generative AI system, and the user terminal communication unit transmits the improvement prompt included in the AI ​​output information acquired in response to the improvement request prompt to the user terminal.

[0008] In addition, in the information processing system of the present invention, the user terminal communication unit acquires AI generation request information input on the user terminal, and the prompt generation unit, if the AI ​​generation request information is a prompt, sets the prompt to the initial prompt, and if the AI ​​generation request information is information other than a prompt, sets a prompt generated based on the information to the initial prompt.

[0009] In the information processing system according to the present invention, the prompt generating section causes the improvement request prompt to include an instruction statement clearly indicating a change in the improvement prompt from the initial prompt.

[0010] In order to solve the above problem, the program of the present invention is a program that can be used from a user terminal, and causes a computer to execute a user terminal communication process for sending and receiving information between the user terminal, a prompt generation process for generating a prompt to be sent to the generation AI system, a prompt transmission process for sending the prompt to the generation AI system, and an AI output information acquisition process for acquiring AI output information from the generation AI system, wherein the prompt generation process sends the AI ​​output information acquired in response to the initial prompt sent in the prompt sending process to the user terminal, and then generates an improvement request prompt that requests an improvement prompt that improves the initial prompt based on AI output improvement information input at the user terminal, the prompt sending process sends the improvement request prompt to the generation AI system, and the user terminal communication process sends the improvement prompt included in the AI ​​output information acquired in response to the improvement request prompt to the user terminal. Effect of the Invention

[0011] According to the information processing system and program of the present invention, when the AI-generated information generated by the initial prompt does not meet the user's expectations, an improvement prompt is generated based on the AI ​​output improvement information input by the user, and the generation AI system is caused to generate AI-generated information using the improvement prompt, thereby assisting the user in obtaining AI-generated information while improving the prompt. [Brief description of the drawings]

[0012] [Figure 1] 1 shows a configuration diagram of an information processing system according to an embodiment of the present invention. [Diagram 2] 3 shows a detailed configuration diagram of a control means. [Diagram 3] 1 is a flowchart in an information processing system. [Figure 4] 13 is an example of a screen displayed on a display means of a user terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] An embodiment of the present invention will be described in detail with reference to the drawings. The information processing system 10 of this embodiment generates an initial prompt based on information inputted at a user terminal 12, and if the AI ​​output information acquired by transmitting the initial prompt to a generation AI system 15 is not as desired by the user, generates an improved prompt based on additional information inputted at the user terminal 12, and is a system that can support the user in creating a prompt. A large-scale language model (LLM) is a language model constructed using a large amount of text data and deep learning technology. This allows the generation AI system 15 to perform natural language processing and generate natural dialogue and sentences like a human. The generation AI system 15 can receive a prompt from a user and transmit AI output information corresponding to the prompt.

[0014] As shown in Fig. 1, an information processing system 10 can be connected to a plurality of user terminals 12 via a communication network 16. This allows a plurality of users to log in and use the information processing system 10. Each user terminal 12 has a display means 13 such as a monitor. The user terminal 12 is a computer such as a PC, or a mobile information terminal such as a smartphone. However, the user terminal 12 is not limited to these.

[0015] The information processing system 10 can be connected to the generative AI system 15 via a communication network 16. The information processing system 10 can send a prompt to the generative AI system 15 to obtain AI output information. The information processing system 10 may be capable of connecting to multiple generative AI systems 15, or the information processing system 10 itself may include a generative AI system 15.

[0016] In Figure 1, the information processing system 10 is connected to multiple user terminals 12 and the generation AI system 15 via a single communication network 16, but the information processing system 10 may also be connected to the user terminals 12 and the generation AI system 15 via separate communication networks. For example, the information processing system 10 can be connected to the user terminals 12 via an in-house LAN and to the generation AI system 15 via the Internet.

[0017] The information processing system 10 can be configured with a computer such as a server. The information processing system 10 includes at least a control means 20, a storage means 21, and a communication means 22. The control means 20 can be configured with a processor such as a CPU. The storage means 21 can be configured with, for example, a RAM, a DRAM, a HDD, an SSD, or an external cloud or distributed storage. The communication means 22 can be configured with, for example, a NIC or a wireless LAN connection device.

[0018] As shown in Figure 2, the control means 20 has a user terminal communication unit 30 that transmits and receives information between the user terminal 12, a prompt generation unit 31 that generates a prompt to be transmitted to the generation AI system 15, a prompt transmission unit 33 that transmits the prompt to the generation AI system 15, and an AI output information acquisition unit 34 that acquires AI output information from the generation AI system 15.

[0019] Next, a flow of using the generation AI system 15 from the user terminal 12 using the information processing system 10 will be described. As shown in FIG. 3, first, user attributes are set (S1). User attributes are input at the user terminal 12 when the user registers. Examples of the input user attributes include information that can be used to generate prompts, such as department name, main job content, and most recent task. The content of the user attributes set here can be set arbitrarily depending on the purpose of the information processing system 10, etc. The input user attribute information is acquired by the user terminal communication unit 30 of the information processing system 10 and stored in the storage means 21.

[0020] Next, in the user terminal 12, the user inputs AI generation request information required to generate an initial prompt (S2). The AI ​​generation request information for generating an initial prompt consists of required input items and optional input items. The required input items are the purpose of using the generation AI system. For this reason, the user terminal communication unit 30 displays a pop-up for inputting the purpose in the user terminal 12. The pop-up displays a form for the user to input, together with the text "Please tell us what you want to achieve by utilizing the generation AI." The optional input items are information for supplementing the purpose more specifically. The user terminal communication unit 30 displays an area for optional input items in the pop-up. The pop-up displays a form for the user to input, together with the text "Supplementary information such as the target product, background information, and constraint conditions," and "By entering the supplementary information, it becomes easier to generate a prompt that matches your purpose." When the user enters at least the purpose in the form, or enters the purpose and supplementary information and submits it, the user terminal communication unit 30 acquires the AI ​​generation request information.

[0021] Next, the prompt generation unit 31 generates a prompt for generating an initial prompt based on the AI ​​generation request information (S3). The prompt for generating the initial prompt includes an instruction sentence that instructs the user to present the AI ​​generation request information, analyze in detail the given user's purpose and supplementary information such as constraints and background information, identify necessary additional information, and create an effective prompt for the generation AI system 15 from the user's perspective. The prompt for generating the initial prompt also includes a description of constraints such as the length of the prompt, the language, and the output format. The prompt for generating the initial prompt may include an instruction sentence other than these. For example, the prompt for generating the initial prompt may include an instruction sentence that instructs the user to generate a prompt from the perspective of providing a useful learning experience. By including such an instruction sentence, the user who uses the generation AI system 15 can passively learn the configuration of the prompt, necessary elements, etc. by repeatedly generating a prompt through the information processing system 10 of this embodiment.

[0022] Next, the prompt sending unit 33 sends the prompt generated by the prompt generating unit 31 to the generation AI system 15 (S4). The AI ​​output information acquiring unit 34 receives AI output information including the initial prompt from the generation AI system 15, and the user terminal communication unit 30 displays the initial prompt on the user terminal 12 (S5). S5 allows the user to check the generated initial prompt.

[0023] As shown in Fig. 4, the display means 13 of the user terminal 12 displays a prompt input area 40, a prompt display area 43, and a chat display area 42 that displays an AI output information display area 44 in a chat format. The initial prompt is first displayed in a pop-up in which the user has inputted their purpose, together with a button for "use prompt." When the user presses the button for "use prompt," the initial prompt is displayed in the prompt display area 43 of the chat display area 42.

[0024] The prompt sending unit 33 sends the initial prompt to the generating AI system 15 (S6). AI output information is generated by the generating AI system 15 in response to the initial prompt, and the generated AI output information is received by the AI ​​output information acquiring unit 34, and the user terminal communication unit 30 causes the AI ​​output information to be displayed on the user terminal 12 (S7). The AI ​​output information is displayed in the AI ​​output information display area 44 of the chat display area 42.

[0025] A "Good" button and a "Bad" button are displayed at the bottom of the AI ​​output information display area 44 on the display means 13 of the user terminal 12. If the AI ​​output information is as expected, the user presses the "Good" button, and if the AI ​​output information is not as expected, the user presses the "Bad" button (S8). If the user presses the "Good" button to indicate that it is as expected, the flow ends (S9). If the user presses the "Bad" button in S8 to indicate that it is not as expected, the flow for improving the prompt is implemented in S10 and onwards.

[0026] In S10, AI output improvement information, which is information for improving the prompt, is input at the user terminal 12. The AI ​​output improvement information is a problem or issue with the AI ​​output information.

[0027] Next, the prompt generation unit 31 generates an improvement request prompt that requests an improvement prompt that improves the initial prompt, based on the AI ​​output improvement information input at the user terminal 12 (S11). The improvement request prompt presents the initial prompt and the AI ​​output improvement information input at S10, and includes an instruction to reconstruct the initial prompt into a better prompt in accordance with the AI ​​output improvement information and to propose an improved prompt. The improvement request prompt also includes a description of constraints such as the output format.

[0028] Once the improvement prompt is generated, the prompt sending unit 33 sends an improvement request prompt to the generating AI system 15 (S12). The AI ​​output information acquiring unit 34 receives the improvement prompt from the generating AI system 15, and the user terminal communication unit 30 causes the user terminal 12 to display the improvement prompt (S13). The improvement prompt is sent from the prompt sending unit 33 to the generating AI system 15 (S14), the AI ​​output information acquiring unit 34 receives the AI-generated information, and the user terminal communication unit 30 causes the user terminal 12 to display the AI-generated information (S15).

[0029] Thereafter, information processing system 10 repeats steps S8 to S15. When the AI-generated information is displayed on user terminal 12 in S15, user terminal communication unit 30 causes display means 13 of user terminal 12 to display a "Good" button and a "Bad" button asking whether the AI ​​output information is as expected, and if the user answers that it is as expected, the flow ends. If the AI-generated information generated by the improvement prompt is not as expected by the user, the improvement prompt is replaced with the initial prompt and an improvement prompt is generated again.

[0030] In this way, when the AI-generated information generated by the initial prompt does not meet the user's expectations, the information processing system 10 generates an improvement prompt based on the AI ​​output improvement information input by the user, and has the generation AI system 15 generate AI-generated information using the improvement prompt, thereby assisting the user in obtaining AI-generated information while improving the prompt.

[0031] Also, the program used in the information processing system 10 of this embodiment can be provided independently. In this case, the program executes a user terminal communication process for transmitting and receiving information to and from the user terminal 12, a prompt generation process for generating a prompt to be transmitted to the generation AI system 15, a prompt transmission process for transmitting the prompt to the generation AI system 15, and an AI output information acquisition process for acquiring AI output information from the generation AI system 15. In the prompt generation process, after transmitting the AI ​​output information acquired as a response to the initial prompt transmitted in the prompt transmission process to the user terminal 12, an improvement request prompt is generated to request an improvement prompt that improves the initial prompt based on the AI ​​output improvement information inputted in the user terminal 12, the improvement request prompt is transmitted to the generation AI system 15 in the prompt transmission process, and the improvement prompt included in the AI ​​output information acquired as a response to the improvement request prompt is transmitted to the user terminal 12 in the user terminal communication process.

[0032] Although the embodiment of the present invention has been described above, the application of the present invention is not limited to this embodiment, and may be applied in various ways within the scope of its technical concept. In the above embodiment, the initial prompt is generated based on AI generation request information input by the user, but the user may input the prompt at the user terminal 12. In this case, the prompt generation unit 31 uses the prompt input at the user terminal 12 as the initial prompt as is. In addition, the initial prompt input at the user terminal 12 can be subject to improvement in the flow from S8 onwards in FIG. 3. [Explanation of symbols]

[0033] 10. Information Processing Systems 12 User terminals 13 Display means 15 Generative AI System 16 Communication Networks 20 Control Means 21 Memory means 22 Means of communication 30 User terminal communication unit 31 Prompt Generation Unit 33 Prompt sending section 34 AI output information acquisition section 40 Prompt Input Area 42 Chat display area 43 Prompt display area 44 AI output information display area

Claims

1. An information processing system available from a user terminal, A control means and a storage means are provided, The control means A user terminal communication unit for transmitting and receiving information between the user terminal and the user terminal; A prompt generator that generates a prompt to be sent to the generation AI system; a prompt sending unit that sends the prompt to the generating AI system; An AI output information acquisition unit that acquires AI output information from the generation AI system; Equipped with The prompt generation unit transmits the AI ​​output information acquired as a response to the initial prompt transmitted from the prompt transmission unit to the user terminal, and then generates an improvement request prompt that requests an improvement prompt that improves the initial prompt based on the AI ​​output improvement information input at the user terminal; The prompt sending unit sends the improvement request prompt to the generating AI system; The user terminal communication unit transmits the improvement prompt contained in the AI ​​output information acquired in response to the improvement request prompt to the user terminal.

2. The user terminal communication unit acquires AI generation request information inputted at the user terminal, The information processing system of claim 1, wherein the prompt generation unit sets the prompt as the initial prompt when the AI ​​generation request information is a prompt, and sets a prompt generated based on the information as the initial prompt when the AI ​​generation request information is information other than a prompt.

3. 3. The information processing system according to claim 1, wherein the prompt generating unit includes in the improvement request prompt an instruction statement that clearly indicates a change in the improvement prompt from the initial prompt.

4. A program available from a user terminal, On the computer, A user terminal communication process for transmitting and receiving information to and from the user terminal; A prompt generation process that generates a prompt to be sent to the generation AI system; a prompt sending process for sending the prompt to the generating AI system; An AI output information acquisition process for acquiring AI output information from the generation AI system; Run the command, In the prompt generation process, the AI ​​output information acquired as a response to the initial prompt transmitted in the prompt transmission process is transmitted to the user terminal, and then an improvement request prompt is generated to request an improvement prompt that improves the initial prompt based on the AI ​​output improvement information input in the user terminal; In the prompt sending process, the improvement request prompt is sent to the generating AI system; In the user terminal communication processing, a program transmits the improvement prompt contained in the AI ​​output information obtained in response to the improvement request prompt to the user terminal.

Citation Information

Patent Citations

  • Software demand document generation method and device, electronic equipment and storage medium

    CN117908838A

  • Self-adaptive retrieval enhancement generation method and system based on model knowledge boundary

    CN118503354A

  • Text generation device and text generation method

    JP7313757B1

  • JPP7396762B

  • Systems and methods for chain of thought META-prompting for machine learning models

    WO2024163363A1

Cited By

  • Programs, methods, information processing devices, systems

    JP2026118862A

  • Information processing systems, programs, and information processing methods

    JP2026135935A

  • Information processing system, program, and information processing method

    WO2026172701A1