Information processing device, information processing method, and information processing program

Abstract

To suppress the amount of conversation history information input to a generative AI in a service which exchanges messages with users in a conversational format.SOLUTION: An information processing device comprises a reception unit, a first acquisition unit, a second acquisition unit, a first generation unit, and a second generation unit. The reception unit receives input information of a user for an application-specific service in a conversational format using a generative AI which generates output information corresponding to the input information. The first acquisition unit inputs information including the input information into the generative AI and acquires output information corresponding to the input information from the generative AI. The second acquisition unit acquires information corresponding to the output information. The first generation unit generates response information for the input information on the basis of the information according to the output information acquired by the second acquisition unit. The second generation unit generates a user conversation history to be input to the generative AI as a conversation history with the user on the basis of the output information acquired by the first acquisition unit.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, services that exchange messages with users in a conversational format have been known. For example, Patent Document 1 proposes a technology that receives an input message input by a user through speech, inputs information including the input message into a generation AI such as a language model, and causes the generation AI to generate a response message. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with the above-mentioned technology, in order to improve the accuracy of the conversation with user U, it is possible to input the conversation history with user U into the generation AI in addition to the user's input message, but this has the problem of inputting a lot of information into the generation AI.

[0005] The present application has been made in consideration of the above, and aims to provide an information processing device, an information processing method, and an information processing program that can reduce the amount of information in the conversation history input to a generation AI in a service that exchanges messages with users in a conversational format. [Means for solving the problem]

[0006] The information processing device according to the present application includes a reception unit, a first acquisition unit, a second acquisition unit, a first generation unit, a provision unit, and a second generation unit. The reception unit receives user input information for a specific purpose service in a conversational format using a generation AI that generates output information in response to the input information. The first acquisition unit inputs information including the input information received by the reception unit to the generation AI and acquires output information in response to the input information from the generation AI. The second acquisition unit acquires information in response to the output information acquired by the first acquisition unit. The first generation unit generates answer information for the input information based on information in response to the output information acquired by the second acquisition unit. The provision unit provides the answer information generated by the first generation unit to the user. The second generation unit generates a user conversation history to be input to the generation AI as a conversation history with the user based on the output information acquired by the first acquisition unit. [Effects of the Invention]

[0007] According to one aspect of the embodiment, it is possible to reduce the amount of information in the conversation history input to the generation AI in a service in which messages are exchanged between users in a conversational format. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram for explaining information processing according to the embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of the configuration of an information processing system according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a user information table stored in the user information storage unit of the information processing device according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a dialogue data table stored in the dialogue data storage unit of the information processing device according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of processing by the processing unit of the information processing device according to the embodiment. [Figure 7] FIG. 7 is a diagram (part 1) showing an example of information arranged in a chat room displayed on a terminal device according to the embodiment. [Figure 8] FIG. 8 is a diagram (part 2) showing an example of information arranged in a chat room displayed on a terminal device according to the embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of dialogue data generated by a generating unit in the processing unit of the information processing device according to the embodiment. [Figure 10] FIG. 10 is a diagram illustrating an example of location information added to the dialogue data as variable information of the user by the generation unit in the processing unit of the information processing apparatus according to the embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of dialogue data updated by a generating unit in the processing unit of the information processing device according to the embodiment. [Figure 12] FIG. 12 is a diagram (part 1) showing an example of a conversation history added to dialogue data by a generating unit in the processing unit of the information processing device according to the embodiment. [Figure 13] FIG. 13 is a diagram (part 2) illustrating an example of a reservation history added to dialogue data by a generating unit in the processing unit of the information processing device according to the embodiment. [Figure 14] FIG. 14 is a diagram illustrating an example of input information that is information input for generation by an acquisition unit in the processing unit of the information processing apparatus according to the embodiment. [Figure 15] FIG. 15 is a diagram (part 1) showing an example of information on functions related to search included in the function information shown in FIG. [Figure 16] FIG. 16 is a diagram (part 2) showing an example of information on a function related to a question included in the function information shown in FIG. [Figure 17] FIG. 17 is a diagram (part 3) showing an example of information on a function related to a reservation included in the function information shown in FIG. [Figure 18] FIG. 18 is a diagram showing another example of input information that is information input for generation by the acquisition unit in the processing unit of the information processing device according to the embodiment. [Figure 19] FIG. 19 is a diagram showing yet another example of input information that is information input for generation by the acquisition unit in the processing unit of the information processing device according to the embodiment. [Figure 20] FIG. 20 is a diagram showing another example of input information that is information input for generation by the acquisition unit in the processing unit of the information processing device according to the embodiment. [Figure 21] FIG. 21 is a flowchart showing an example of information processing by the processing unit of the information processing device according to the embodiment. [Figure 22] FIG. 22 is a flowchart illustrating an example of a search process by the processing unit of the information processing device according to the embodiment. [Figure 23] FIG. 23 is a flowchart illustrating an example of a question process performed by the processing unit of the information processing device according to the embodiment. [Figure 24] FIG. 24 is a flowchart illustrating an example of a reservation process by the processing unit of the information processing device according to the embodiment. [Figure 25] FIG. 25 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, modes for implementing an information processing device, an information processing method, and an information processing program according to the present application (hereinafter referred to as "embodiments") will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program according to the present application are not limited to these embodiments. Furthermore, the respective embodiments can be appropriately combined within the scope of not causing any contradiction in the processing content. Furthermore, the same components in the following embodiments will be assigned the same reference numerals, and redundant explanations will be omitted.

[0010] [1. An example of information processing] First, an example of information processing according to the embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram for explaining information processing according to the embodiment.

[0011] The information processing device 1 shown in Fig. 1 is an information processing device that cooperates with a terminal device 2 of a user U and provides various types of information to the user U online, and is realized, for example, by one or more servers or a cloud system. The terminal device 2 is, for example, a smartphone or a tablet. Although the example shown in Fig. 1 shows one terminal device 2, the information processing device 1 cooperates with each of multiple terminal devices 2 and provides various services online to the user U of each terminal device 2.

[0012] The service provided to user U by information processing device 1 is a service conducted in an interactive format between user U and the information processing device 1 using a generating AI (artificial intelligence) that outputs answer information in response to input information, and is, for example, a service for a specific purpose.

[0013] An example of a generative AI is a text generation AI, which is a large-scale language model trained to predict and output the next token from an input token sequence, such as a transfer-based model or an RNN (Recurrent Neural Network)-based model.

[0014] Examples of transfer-based models include, but are not limited to, Generative Pre-trained Transformer (GPT) and Bidirectional Auto Regressive Dialogues (BARD). Examples of RNN-based models include, but are not limited to, Receptance Weighted Key Value (RWKV).

[0015] It is desirable that the input information be trained so that it will not be used as a new answer, thereby concealing the input information, such as personal information. The generation AI may also be a language model that has been trained (for example, fine-tuned) specifically for generating answer information. The generation AI is located in an external information processing device, and the information processing device 1 uses the generation AI via an API (Application Programming Interface), but the generation AI may also be located within the information processing device 1.

[0016] An example of a specific-purpose service provided in a conversational format using a generation AI is a restaurant reservation service, but is not limited to such an example. For example, instead of or in addition to a service with a specific purpose of restaurant reservations, the information processing device 1 can also provide services with specific purposes such as hotel reservations, travel and accommodation reservations, personal property transactions, real estate transactions, video distribution, news distribution, and recruitment.

[0017] A communication app, which is an application program for sending and receiving messages between users U or with other users U, is installed on the terminal device 2 of user U. The communication app has, for example, a chat function, a calling function, a wallet function, etc. The communication app may also have various other functions such as a news providing function, a taxi dispatch function, a shopping function, a gift function, etc. The communication app is sometimes called a super app, etc.

[0018] User U can use the communication app to use chat functions, calling functions, wallet functions, etc. The chat function is a function that allows user U to exchange messages with other users U or store S in chat rooms on message channels that have been subscribed to. Channel subscription is sometimes called friend subscription.

[0019] The call function allows user U to make voice and video calls with other users U who have subscribed to the channel by user U. The wallet function has functions such as payment and remittance, and user U can use the wallet function to pay for products or services.

[0020] The terminal device 2 can transmit and receive information to and from the information processing device 1 via an API using a communication application, but may also transmit and receive information to and from the information processing device 1 without using an API.

[0021] The user U can use the functions of the communication application by operating the terminal device 2 to start the communication application and displaying an application screen, which is a screen of the communication application, on the terminal device 2.

[0022] The app screen includes a registration list screen showing a list of other users U and services subscribed to the channel, and a chat screen for exchanging chat messages in chat rooms with other users U subscribed to the channel or in chat rooms of subscribed services. Hereinafter, chat rooms of subscribed services may be simply referred to as chat rooms. Note that a communication app may be an application dedicated to a service for a specific purpose.

[0023] The information processing device 1 may function as a distribution device that distributes control information to the terminal device 2. Here, the control information is written in, for example, a script language such as JavaScript (registered trademark) or a style sheet language such as CSS (Cascading Style Sheets). The communication app itself distributed from the information processing device 1 may be regarded as the control information.

[0024] In the following, an example will be described in which a user U makes a restaurant search request followed by a restaurant reservation request in a conversational format using a generation AI, which is a specific-purpose service provided by the information processing device 1, but this example is not limited to this.

[0025] 1, the information processing device 1 receives input information transmitted from the terminal device 2 (step S1). The input information is information input into a chat room displayed on the terminal device 2 by a user U operating the terminal device 2, and is information displayed as text. The terminal device 2 transmits the information input into the chat room by the user U to the information processing device 1.

[0026] In the example shown in (a1) of Figure 1, the string "A friend is coming to visit, so I'm thinking of going out for dinner tonight. Are there any good seafood restaurants nearby?" is entered as input information (input message) by user U into terminal device 2, and this input information is sent from terminal device 2 to information processing device 1.

[0027] Next, the information processing device 1 inputs information including the user input information, which is the input information received in step S1, to the generation AI (step S2), and obtains output information corresponding to the user input information from the generation AI (step S3).

[0028] For example, the information processing device 1 inputs information including intention definition information and user input information for extracting the intention type and intention content from the user input information to the generation AI, and obtains intention information including information indicating the intention type and information indicating the intention content from the generation AI as output information.

[0029] The intent type is, for example, the type of intent of the input sentence indicated in the user input information, and in the case where the specific use service is a restaurant reservation service, for example, restaurant search, restaurant related question, restaurant reservation, etc., but is not limited to such examples.

[0030] The intent content is the content of the intent of the input sentence indicated by the user input information, and if the specific use service is a restaurant reservation service and the intent type is a restaurant search, it is indicated by information specifying the type of restaurant, the location of the restaurant, the date of use, the time of use, the number of people using the restaurant, etc. The type of restaurant is, for example, a genre of food served by the restaurant, such as Japanese, Chinese, Italian, French, family restaurant, seafood, or izakaya, but is not limited to such examples.

[0031] Furthermore, if the intent type is a question about a restaurant, the intent content is indicated by information identifying the restaurant (e.g., restaurant ID (Identifier)), and if the intent type is a reservation for a restaurant, the intent content is indicated by information identifying the restaurant (e.g., restaurant ID), reservation date and time, reservation time, number of people for reservation, etc.

[0032] The intention definition information includes, for example, instruction information including an instruction to extract an intention type and an intention content from the user input information, and definition information including an intention type and information defining the intention type. The instruction information is, for example, a character string such as "You are a professional operator of a restaurant reservation service. Please determine the intention type of the input sentence from the following multiple intention types and output the intention type and the intention content. Note that if the intention type of the input sentence does not exist from the following multiple intention types, please output "no intention type." However, the instruction information is not limited to such an example.

[0033] For example, if the intent type is a search for a restaurant, the definition information may be a string such as "intent type: search for a restaurant\n intent content: type of restaurant, location of restaurant, date of use, time of use, number of people\n example of output format: intent type: search for a restaurant\n type of restaurant: seafood restaurant\n location of restaurant: Akasaka\n date of use: 2023 / 10 / 15\n time of use: 18:00\ number of people: 2", but is not limited to such examples.

[0034] As a result, the information processing device 1 can obtain intention information including information indicating the intention type and information indicating the intention content as output information from the generation AI, and can appropriately generate answer information for the user information using such output information.

[0035] Furthermore, the information processing device 1 can use a generation AI that has been trained to output intention information as output information when information including user information and definition information is input. The definition information is information that defines each of a plurality of functions that can be executed by the information processing device 1. In this case, the information processing device 1 acquires, from the generation AI, information that includes information that identifies a function according to an intention type and information that indicates arguments of the function according to the intention type, as output information according to the user input information. In the following description, the information processing device 1 will be described as acquiring, from the generation AI, output information according to the user input information using definition information that defines each of a plurality of functions.

[0036] When the specific-purpose service is a restaurant reservation service, the multiple functions include, for example, a search-related function, a question-related function, and a reservation-related function. The search-related function is a function that uses a search API provided by a search server that searches for restaurants, the question-related function is a function that uses a function that uses the search API and a function that uses a generation AI, and the reservation-related function is a function that uses a reservation API provided by a reservation server that makes restaurant reservations.

[0037] The information processing device 1 can also use a generation AI that has been trained to output, as intention information, function identification information that includes information indicating a function from among multiple functions to be used to generate answer information and the argument of that function. In this case, the information processing device 1 inputs user information to the generation AI, but does not input definition information to the generation AI.

[0038] Arguments for functions related to searches include, but are not limited to, information such as the type of restaurant, the location of the restaurant, the date of use, the time of use, and the number of people using the restaurant. Arguments for functions related to questions include, but are not limited to, information such as the restaurant ID and the search target. Arguments for functions related to reservations include, but are not limited to, information such as the restaurant ID, reservation date and time, reservation time, and the number of people using the reservation.

[0039] When the string "A friend is coming over and we're thinking of going out for dinner tonight, are there any good seafood restaurants nearby?" is input into the generation AI along with function information as user input information, function-specific information including information that identifies the function related to the search is output from the generation AI as intent information.

[0040] In this case, the function identification information includes, in addition to information identifying the search function, information on the arguments of the search function: the character string "Seafood Restaurant" as information indicating the type of restaurant; the character string "User's Location" as information indicating the location of the restaurant; the character string "2023 / 10 / 16" as information indicating the date of use; and the character string "18:00" as information indicating the time of use. These pieces of argument information are information indicating the intent and search condition information, which is information indicating the search conditions.

[0041] Based on the output information acquired in step S3, the information processing device 1 generates dialogue data as information for conducting a conversation with the user U (step S4). The dialogue data is data to which, for example, a conversation history with the user U, variable information about the user U, information indicating a specific event, etc. are added, and is generated, for example, for each conversation with the user U. A conversation unit is a unit defined by the period from the start to the end of a conversation with the user U.

[0042] The variable information of the user U is, for example, information indicating the location of the user U, but is not limited to such an example. The dialogue data is information in a predetermined format, for example, structured information (structured data) that can be easily searched, analyzed, etc. The structured information (structured data) is, for example, structured information (structured data) in JSON (JavaScript Object Notation) format, but is not limited to such an example.

[0043] The information indicating a specific event is, for example, information indicating that an argument in the function identification information is specific information, and includes information indicating the event type, information indicating the event content, etc. The information indicating the event type is, for example, information indicating the absence of the location of user U.

[0044] The information indicating the event content includes, for example, information on the character string "search," information on the character string "seafood restaurant," and information on the character string "user location," etc. The information on the character string "search" is information indicating the intention type, and the information on the character string "seafood restaurant" and information on the character string "user location" is information indicating the intention content.

[0045] In the dialog data, the conversation history is supplemented with the user conversation history input to the generation AI as the conversation history of user U, and the generation AI conversation history input to the generation AI as the conversation history of the generation AI. The dialog data generated in step S4 includes, as the user conversation history, information indicating the intent type and information indicating the intent content contained in the intent information acquired from the generation AI in step S3.

[0046] In the example shown in (b1) of FIG. 1, the information indicating the intent type is the information of the string "intent":"search", and the information indicating the intent content is the information of the string "query":"seafood restaurant", the information of the string "USER_LOCATION", the information of the string "date":"20231016", and the information of the string "time":"18:00".

[0047] In addition, the dialogue data shown in (b1) of Figure 1 includes the information of the string "lackOfUserLocation", which is information indicating the absence of user U's location, as information indicating the event type, and includes information indicating the content of the event, indicating that the search type is search, the restaurant type is seafood restaurant, and the location is user U's location.

[0048] In addition, the information processing device 1 can also add the information indicating the intention type and the information indicating the intention content contained in the intention information acquired from the generation AI in step S3 to the dialog data in step S9 described below, without including them in the dialog data in step S4.

[0049] Since the information indicating the location of the restaurant as search condition information is indicated by the information of the string "lackOfUserLocation", the information processing device 1 transmits inquiry information, which is information inquiring of the user U as to whether or not to transmit the location information, to the terminal device 2 (step S5). Based on the inquiry information transmitted from the information processing device 1, the terminal device 2 displays information indicating an inquiry about the location of the restaurant in the chat room.

[0050] In the example shown in (a1) of FIG. 1, the information of the character string "May I obtain your current location from your terminal device?" and two buttons for asking the user U whether or not to send the location information are displayed in a chat room displayed on the terminal device 2. The two buttons include a first button containing the information of the character string "Yes" and a second button containing the information of the character string "No."

[0051] When user U operates terminal device 2 to select the first button, for example by tapping it, terminal device 2 acquires location information, which is data indicating the current location, from the built-in location sensor using the function of the communication app, and transmits first button selection information including the acquired location information as user U's location information to information processing device 1.

[0052] The location information is an example of sensor detection information that the information processing device 1 acquires from the terminal device 2. The sensor detection information that the information processing device 1 acquires from the terminal device 2 is not limited to location information and may be, for example, biometric information of the user U.

[0053] The first button selection information is information indicating that the first button has been selected by the user U, and includes data indicating the current location of the user U in latitude and longitude as the location information of the user U.

[0054] Furthermore, when the user U operates the terminal device 2 to select the second button, for example by tapping it, the terminal device 2 transmits second button selection information, which is information indicating that the second button has been selected by the user U, to the information processing device 1. Hereinafter, when the first button selection information and the second button selection information are referred to without being distinguished from each other, they will be referred to as button information.

[0055] The information processing device 1 acquires the button information transmitted from the terminal device 2 (step S6). Upon acquiring the first button selection information, the information processing device 1 generates a search query whose search condition information includes the position information indicated by the first button selection information and information indicating an argument of a function related to the search identified by the intention information acquired in step S3, and transmits the generated search query to the search server via the search API (step S7).

[0056] The location information indicated by the first button selection information is, for example, but not limited to, information indicating the current location of user U or information indicating an area including the current location of user U. The search condition information included in the search query includes, for example, the location information indicated by the first button selection information and information indicating the type of restaurant, date of use, time of use, etc. as information indicating arguments of a function related to the search specified by the intention information.

[0057] Then, the information processing device 1 acquires search results corresponding to the search query from the search server via the search API (step S8). The search results include, for example, information indicating one or more restaurants of the type indicated by the search condition information, located near the current location of the user U indicated by the search condition information, and open on the date and time of use indicated by the search condition information.

[0058] In the example shown in FIG. 1, the search results include information indicating the number of seafood restaurants that match the criteria and are open as of 6:00 PM on October 16, 2023, as well as information indicating one or more matching seafood restaurants. In the example shown in (a2) of FIG. 1, the following information is displayed in a chat room on terminal device 2: "One seafood restaurant was found near your current location from 6:00 PM today, October 16, 2023. ABC Seafood - Enjoy delicious seafood delivered directly from the fishing port!"

[0059] Next, the information processing device 1 updates the dialogue data as information for conducting a conversation with the user U based on the output information acquired in step S3, the position information contained in the button information acquired in step S6, and the search results acquired in step S8 (step S9).

[0060] The dialogue data includes the intention information acquired from the generation AI in step S3 or information corresponding to this intention information as a user conversation history. For example, the user conversation history includes information indicating the intention type and information indicating the intention content included in the intention information acquired from the generation AI in step S3.

[0061] In the dialogue data shown in (b2) of FIG. 1, the information indicating the intent type is the information of the string "intent":"search", and the information indicating the intent content includes the information of the string "query":"seafood restaurant", the information of the string "USER_LOCATION", the information of the string "date":"20231016", and the information of the string "time":"18:00".

[0062] The dialogue data shown in (b2) of FIG. 1 also includes the search results obtained from the search server in step S8 or information corresponding to these search results as a generated AI conversation history. In the example shown in (b2) of FIG. 1, the generated AI conversation history includes information on the string "name:ABC Seafood" and the string "description:Enjoy delicious tuna dishes delivered directly from the fishing port!". If the search results obtained in step S8 include information on multiple restaurants, the dialogue data will include information indicating the multiple restaurants.

[0063] The dialogue data also includes, as variable information of user U, the string "userLocation:{"lat":123.456,"lon":987.654}" which is information indicating the current location of user U. The information indicating the current location of user U is information specified by the button information acquired in step S7, and the information processing device 1 adds the information indicating the current location of user U to the dialogue data based on the button information acquired in step S7.

[0064] Next, the information processing device 1 generates answer information based on the search result acquired in step S8, and transmits the generated answer information (response message) to the terminal device 2 (step S10). The terminal device 2 displays the answer information transmitted from the information processing device 1 in the chat room.

[0065] For example, the search results obtained in step S8 may include the information of the string "id":"r000093218", the information of the string "name":"ABC Seafood", and the information of the string "description":"Enjoy delicious tuna dishes delivered directly from the fishing port!". The information of the string "id":"r000093218"" is information that indicates the restaurant ID.

[0066] In this case, the information processing device 1 generates, for example, the following information as response information: "One seafood restaurant near your current location was found from 18:00 on October 16, 2023.\n\n◇ABC Seafood\n You can enjoy delicious tuna dishes delivered directly from the fishing port!". Based on the response information transmitted from the information processing device 1, the terminal device 2 displays the following information in the chat room: "One seafood restaurant near your current location was found from 18:00 on October 16, 2023.◇ABC Seafood You can enjoy delicious tuna dishes delivered directly from the fishing port!".

[0067] When user U operates terminal device 2 to input text in a chat room, the input information is transmitted from terminal device 2 to information processing device 1. For example, as shown in (a2) of FIG. 1, information indicating the character string "Can I make a reservation?" is input as input information into terminal device 2 by user U, and the input information is transmitted from terminal device 2 to information processing device 1.

[0068] Next, the information processing device 1 accepts input information (input message) transmitted from the terminal device 2 (step S11). The information processing device 1 generates information including the user input information, which is the input information accepted in step S11, intention definition information, and a conversation history with the user U, and inputs the generated information to the generation AI (step S12).

[0069] The conversation history with user U includes the conversation history of user U and the conversation history of the generation AI. In step S12, the information processing device 1 generates a user conversation history corresponding to the intention information extracted by the generation AI from the dialogue data as the conversation history with user U. For example, the information processing device 1 generates information such as the character string "Search for seafood restaurants from 18:00 on October 16, 2023" as the user conversation history based on the dialogue data shown in (b2) of FIG. 1.

[0070] This allows the information processing device 1 to reduce the number of characters while still appropriately adding information indicating the date and time, compared to when, for example, the string "A friend is coming to visit, so I'm thinking of going out for dinner tonight. Are there any good seafood restaurants nearby?" is used as the user conversation history.

[0071] Furthermore, the information processing device 1 generates a generated AI conversation history corresponding to the search results from the dialogue data as a conversation history with the user U. For example, the information processing device 1 generates information such as the character string "1 item found.\nName: ABC Seafood\nRestaurant ID: r000093218" as the generated AI conversation history based on the dialogue data shown in (b2) of FIG. 1.

[0072] The generated AI conversation history does not include information indicating the details of the restaurant, such as the character string "Enjoy delicious tuna dishes delivered directly from the fishing port!" This allows the information processing device 1 to appropriately delete unnecessary information while reducing the number of characters in the generated AI conversation history.

[0073] Next, the information processing device 1 acquires output information from the generation AI according to the user input information input to the generation AI in step S12 (step S13). For example, in step S12, the information processing device 1 inputs the conversation history with the user U, the user input information, and the intention definition information to the generation AI, and in step S13 acquires intention information including information indicating the intention type and information indicating the intention content as output information from the generation AI.

[0074] For example, the information indicating the intent type is information indicating a function related to a reservation, and the information indicating the intent content is information indicating the conditions for the reservation. The information indicating the intent content includes, for example, the information of the string "id":"r000093218" as the restaurant ID, the information of the string "2023 / 10 / 16" as the date of use, the information of the string "18:00" as the time of use, and the information of the string "2" as the number of people to use, as argument information of the function related to the reservation.

[0075] The information of these arguments is reservation condition information, which is information indicating the reservation conditions. If the function identification information does not include information indicating the number of users, the information processing device 1 inquires of the user U about the number of users and acquires information indicating the number of users from the terminal device 2.

[0076] Next, the information processing device 1 generates a reservation availability query including information indicating reservation confirmation conditions based on the output information acquired in step S13, and transmits the generated reservation availability query to the reservation server via the reservation API (step S14). The reservation availability query includes, for example, the information of the character string "id:r000093218" as the restaurant ID, the information of the character string "2023 / 10 / 16" as the date of use, the information of the character string "18:00" as the time of use, and the information of the character string "2" as the number of people using the restaurant.

[0077] Next, the information processing device 1 acquires reservation availability information corresponding to the reservation availability query from the reservation server through the reservation API (step S15). The reservation availability information is information indicating, for example, whether a reservation for the restaurant specified in the reservation availability query is possible under the conditions specified in the reservation availability query.

[0078] Next, based on the reservation availability information acquired in step S15, the information processing device 1 transmits information indicating whether a reservation is possible or not for the restaurant that was the subject of the reservation availability inquiry made by user U in the user input information in step S11 as answer information (response message) to the terminal device 2 (step S16).

[0079] In this way, the information processing device 1 displays a button on the terminal device 2 for acquiring sensor detection information from the terminal device 2 of the user U in a conversational service using a generation AI that outputs answer information according to input information, and accepts selection of the button by the user U. Then, when the information processing device 1 accepts selection of the button, it acquires the sensor detection information and generates information according to the sensor detection information that is included in the input information input to the generation AI. This allows the information processing device 1 to appropriately acquire information about the user U in a service in which messages are exchanged between the information processing device 1 and the user U in a conversational format.

[0080] Furthermore, the information processing device 1 accepts input information from a user U for a specific-purpose service in a conversational format using a generation AI that generates output information in response to the input information, inputs information including the input information to the generation AI, and obtains output information in response to the input information from the generation AI. The information processing device 1 then obtains information in response to the output information from the generation AI, generates response information to the input information based on the information in response to the output information, and generates a user conversation history to be input to the generation AI as a conversation history with the user U based on the output information. This allows the information processing device 1 to reduce the amount of conversation history information input to the generation AI in a service in which messages are exchanged in a conversational format with the user U.

[0081] [2. Information Processing System Configuration] 2 is a diagram showing an example of the configuration of an information processing system according to an embodiment. As shown in FIG. 2, the information processing system 100 according to an embodiment includes an information processing device 1, a plurality of terminal devices 2, a generation AI server 3, a search server 4, and a reservation server 5.

[0082] The multiple terminal devices 2 are used by different users U. The terminal devices 2 are, for example, laptop personal computers (PCs), desktop PCs, smartphones, tablet PCs, and wearable devices. The wearable devices are, for example, smart glasses or smart watches, but are not limited to these examples.

[0083] The generation AI server 3 is an information processing device that inputs input information acquired from the information processing device 1 to the generation AI through the generation AI-API, which is an API dedicated to the generation AI server 3, and provides output information output from the generation AI to the information processing device 1 through the generation AI-API. Note that the generation AI may be located in the information processing device 1.

[0084] The search server 4 is an information processing device that searches for information corresponding to a search query acquired from the information processing device 1 through a search API, which is an API dedicated to the search server 4, and provides the search results to the information processing device 1 through the search API. Note that the functions of the search server 4 may be included in the information processing device 1.

[0085] The reservation server 5 is an information processing device that performs processing in response to a query received from the information processing device 1 through a reservation API, which is an API dedicated to the reservation server 5, and provides the processing results to the information processing device 1 through the reservation API. Note that the functions of the reservation server 5 may be included in the information processing device 1.

[0086] The information processing device 1, terminal device 2, generation AI server 3, search server 4, and reservation server 5 are each connected to each other via a network N so that they can communicate with each other via wired or wireless means. Note that the information processing system 100 shown in Figure 2 may include multiple information processing devices 1, generation AI servers 3, search servers 4, and reservation servers 5.

[0087] The network N includes, for example, a WAN (Wide Area Network) such as the Internet and a mobile communication network such as LTE (Long Term Evolution), 4G (4th Generation), and 5G (5th Generation: 5th generation mobile communication system).

[0088] The terminal device 2 can connect to the network N via short-range wireless communication such as a mobile communication network, Bluetooth (registered trademark), or wireless LAN (Local Area Network), and communicate with the information processing device 1, the generation AI server 3, the search server 4, and the reservation server 5, etc.

[0089] 3. Configuration of Information Processing Device 1 3 is a diagram showing an example of the configuration of the information processing device 1 according to the embodiment. As shown in FIG. 3, the information processing device 1 includes a communication unit 10, a storage unit 11, and a processing unit 12.

[0090] [3.1. Communication Unit 10] The communication unit 10 is realized by, for example, a communication module or a network interface card (NIC). The communication unit 10 is connected to a network N by wire or wirelessly, and transmits and receives information to and from various other devices. For example, the communication unit 10 transmits and receives information to and from the terminal device 2 via the network N.

[0091] [3.2. Storage section 11] The storage unit 11 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 11 has a user information storage unit 20 and a dialogue data storage unit 21.

[0092] [3.2.1. User information storage unit 20] The user information storage unit 20 stores various types of information related to the user U. Fig. 4 is a diagram showing an example of a user information table stored in the user information storage unit 20 of the information processing device 1 according to the embodiment.

[0093] 4, the user information table stored in the user information storage unit 20 includes items such as "user ID," "attribute information," etc. The "user ID" is identification information that identifies the user U.

[0094] "Attribute information" is information about the user attributes of user U corresponding to "user ID," and includes information about psychographic attributes, demographic attributes, etc. Demographic attributes include, for example, gender, age, place of residence, and occupation, while psychographic attributes include interests such as travel, clothing, cars, and religion, lifestyle, thoughts, and ideological tendencies.

[0095] 3.2.2. Dialogue Data Storage Unit 21 The dialogue data storage unit 21 stores various types of information related to dialogue data. Fig. 5 is a diagram showing an example of a dialogue data table stored in the dialogue data storage unit 21 of the information processing device 1 according to the embodiment.

[0096] 5, the dialogue data table stored in the dialogue data storage unit 21 includes items such as "dialogue ID," "user ID," and "dialogue data." The "dialogue ID" is identification information that identifies the dialogue data.

[0097] "User ID" is the user ID of user U linked to the dialogue data corresponding to the "dialog ID." "Dialogue data" is dialogue data corresponding to the "dialog ID" and includes the conversation history between user U associated with the "user ID." The conversation history between user U includes, for example, the conversation history of user U and the conversation history of the generation AI.

[0098] User U's conversation history is information generated as user U's conversation information based on output information, which is information extracted by the generation AI from user input information, which is input information from user U, and is information input to the generation AI as part of the input information as the conversation history between user U.

[0099] The conversation history of the generation AI is information generated as conversation information of the generation AI based on information obtained based on the output information output from the generation AI in response to user input information (for example, search results from the search server 4 or reservation availability information from the reservation server 5), and is information input to the generation AI as part of the input information as a conversation history with the user U.

[0100] [3.3. Processing Unit 12] The processing unit 12 is a controller, and is realized by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) executing various programs (corresponding to examples of information processing programs) stored in a storage device inside the information processing device 1 using RAM or the like as a working area.

[0101] The processing unit 12 is a controller, and may be realized by an integrated circuit such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or a general purpose graphic processing unit (GPGPU).

[0102] 3, the processing unit 12 has a receiving unit 30, an acquiring unit 31, a generating unit 32, and a providing unit 33, and realizes or executes the functions and actions of information processing described below. Note that the internal configuration of the processing unit 12 is not limited to the configuration shown in FIG. 3, and may be any other configuration as long as it performs the information processing described below.

[0103] 3.3.1. Reception unit 30 The reception unit 30 receives various pieces of information transmitted from the terminal device 2 of the user U, and thereby receives various operations such as input of information by the user U and selection of buttons.

[0104] For example, the receiving unit 30 receives user input information, which is input information of a user U for a specific purpose service in a conversational format using a generation AI that generates output information according to the input information.

[0105] The specific-purpose service is a restaurant reservation service, which is a service for the specific purpose of making restaurant reservations, but is not limited to such an example. For example, the specific-purpose service may be a service for the specific purpose of making hotel reservations, travel and accommodation reservations, property transactions, real estate transactions, video distribution, news distribution, or recruitment, instead of or in addition to the restaurant reservation service.

[0106] The reception unit 30 receives, for example, information on a string of natural language characters that a user U inputs as a conversation by the user U into a chat room displayed on the terminal device 2 by operating the terminal device 2 as input information of the user U in the chat room.

[0107] When a user U operates the terminal device 2 to input a string of characters in natural language as the user U's conversation into a chat room displayed on the terminal device 2, the terminal device 2 transmits information about the string of characters to the information processing device 1 as the user U's input information in the chat room.

[0108] The reception unit 30 also receives button information transmitted from the terminal device 2, thereby receiving a button selection by the user U. For example, the reception unit 30 receives first button selection information transmitted from the terminal device 2, thereby receiving a first button selection by the user U, and receives second button selection information transmitted from the terminal device 2, thereby receiving a second button selection by the user U.

[0109] In addition, the reception unit 30 receives the selection of the third button by the user U by receiving the third button selection information transmitted from the terminal device 2, and receives the selection of the fourth button by the user U by receiving the fourth button selection information transmitted from the terminal device 2.

[0110] [3.3.2. Acquisition part 31] The acquisition unit 31 acquires various types of information. The acquisition unit 31 acquires sensor detection information transmitted from the terminal device 2. The sensor detection information is information detected by sensors built into the terminal device 2. The sensors built into the terminal device 2 include a position sensor, a gyro sensor, an acceleration sensor, a geomagnetic sensor, an illuminance sensor, a temperature sensor, a barometric pressure sensor, a biosensor, and the like.

[0111] The position sensor detects, for example, the position of the terminal device 2, which is the current location of the user U. The position sensor receives multiple positioning signals transmitted from multiple positioning satellites in the GNSS (Global Navigation Satellite System), and detects the current location of the user U based on the multiple received positioning signals.

[0112] Examples of the biosensor include a sensor that detects the poster's heart rate, a sensor that detects the poster's pulse, a sensor that detects the poster's blood pressure, a sensor that detects the poster's pupillary response, a sensor that detects the poster's brain waves, a sensor that detects the poster's blood oxygen level, etc. Note that the sensor detection information may be information detected by a terminal device other than terminal device 2 and acquired by terminal device 2.

[0113] In addition, the acquisition unit 31 acquires various information from, for example, the terminal device 2, the generation AI of the generation AI server 3, the search server 4, the reservation server 5, the memory unit 11, etc. The acquisition unit 31 acquires, for example, user input information accepted by the acceptance unit 30.

[0114] For example, when the reception unit 30 receives the selection of the first button, the acquisition unit 31 acquires sensor detection information from the terminal device 2. The sensor detection information acquired by the acquisition unit 31 includes, for example, location information of the user U, environmental information indicating the brightness, temperature, pressure, etc. of the surroundings of the user U, and biometric information of the user U.

[0115] In addition, the acquisition unit 31 inputs information including input information from the user U to the generation AI and acquires output information corresponding to the input information from the generation AI. The acquisition unit 31 inputs input information to the generation AI through the generation AI-API, for example, and acquires output information corresponding to the input information from the generation AI through the generation AI-API.

[0116] An example of a generative AI is a text generation AI, which is a language model trained to predict and output the next token from an input token sequence, such as a transfer-based model or an RNN-based model.

[0117] Examples of transfer-based models include, but are not limited to, GPT and BARD, and examples of RNN-based models include, but are not limited to, RWKV.

[0118] It is desirable that the input information be trained so that it will not be used as a new answer, thereby concealing the input information, such as personal information. The generation AI may also be a language model that has been trained (for example, fine-tuned) specifically for generating answer information. The generation AI is located in an external information processing device, and the acquisition unit 31 uses the generation AI via an API, but the generation AI may also be located within the information processing device 1.

[0119] Furthermore, the acquisition unit 31 transmits a search query to the search server 4 and acquires search results corresponding to the search query from the search server 4. The acquisition unit 31 transmits the search query to the search server 4 via a search API, for example, and acquires search results corresponding to the search query from the search server 4 via the search API.

[0120] Furthermore, the acquisition unit 31 transmits queries such as a reservation availability query or a reservation query to the reservation server 5, and acquires processing results corresponding to the queries from the reservation server 5. For example, the acquisition unit 31 transmits a search query to the reservation server 5 via a reservation API, and acquires processing results corresponding to the queries from the reservation server 5 via the search API.

[0121] The acquisition unit 31 has a first acquisition unit 40, a second acquisition unit 41, and a third acquisition unit 42, and below, each of these first acquisition unit 40, second acquisition unit 41, and third acquisition unit 42 will be described in detail.

[0122] [3.3.2.1. 1st acquisition part 40] The first acquisition unit 40 acquires user input information, which is the input information of the user U accepted by the acceptance unit 30, inputs information including such user input information to the generation AI, and acquires output information corresponding to the user input information from the generation AI.

[0123] For example, the first acquisition unit 40 inputs information including intention definition information and user input information for extracting the intention type and intention content from the user input information to the generation AI, and acquires intention information including information indicating the intention type and information indicating the intention content from the generation AI as output information.

[0124] The intent type is, for example, the type of intent of the input sentence indicated in the user input information, and in the case where the specific use service is a restaurant reservation service, for example, restaurant search, restaurant related question, restaurant reservation, etc., but is not limited to such examples.

[0125] The intent content is the content of the intent of the input sentence indicated by the user input information, and if the specific use service is a restaurant reservation service and the intent type is a restaurant search, it is indicated by information specifying the type of restaurant, the location of the restaurant, the date of use, the time of use, the number of people using the restaurant, etc. The type of restaurant is, for example, a genre of food served by the restaurant, such as Japanese, Chinese, Italian, French, family restaurant, seafood, or izakaya, but is not limited to such examples.

[0126] Furthermore, if the intent type is a question about a restaurant, the intent content is indicated by information identifying the restaurant (e.g., restaurant ID), and if the intent type is a reservation for a restaurant, the intent content is indicated by information identifying the restaurant (e.g., restaurant ID), reservation date and time, reservation time, number of people for reservation, etc.

[0127] The intention definition information includes, for example, instruction information including an instruction to extract an intention type and an intention content from the user input information, and definition information including an intention type and information defining the intention type. The instruction information is, for example, a character string such as "You are a professional operator of a restaurant reservation service. Please determine the intention type of the input sentence from the following multiple intention types and output the intention type and the intention content. Note that if the intention type of the input sentence does not exist from the following multiple intention types, please output "no intention type." However, the instruction information is not limited to such an example.

[0128] For example, if the intent type is a search for a restaurant, the definition information may be a string such as "intent type: search for a restaurant\n intent content: type of restaurant, location of restaurant, date of use, time of use, number of people\n example of output format: intent type: search for a restaurant\n type of restaurant: seafood restaurant\n location of restaurant: Akasaka\n date of use: 2023 / 10 / 15\n time of use: 18:00\ number of people: 2", but is not limited to such examples.

[0129] As a result, the first acquisition unit 40 can acquire intention information including information indicating the intention type and information indicating the intention content as output information from the generation AI, and can appropriately generate answer information for the user information using such output information.

[0130] Furthermore, the first acquisition unit 40 can use a generation AI that has been trained to output intention information as output information when information including user information and definition information is input. The definition information is information that defines each of a plurality of functions that can be executed by the processing unit 12 of the information processing device 1. In this case, the first acquisition unit 40 acquires, from the generation AI, information that includes information that identifies a function according to the intention type and information that indicates an argument of the function according to the intention type, as output information according to the user input information.

[0131] In this way, the first acquisition unit 40 inputs information including definition information that defines each of the multiple functions as intention definition information to the generation AI, and can acquire function identification information from the generation AI as intention information, which is information that identifies a function (a function according to the intention type) from the multiple functions to be used to generate answer information and information indicating the arguments of the function.

[0132] When the specific-purpose service is a restaurant reservation service, the multiple functions include, for example, a search-related function, a question-related function, and a reservation-related function. The search-related function is a function that uses a search API provided by a search server 4 that searches for restaurants, the question-related function is a function that uses a function that uses the search API and a function that uses a generation AI, and the reservation-related function is a function that uses a reservation API provided by a reservation server 5 that makes restaurant reservations.

[0133] The first acquisition unit 40 may use a generation AI that has been trained to output, as intention information, function identification information that includes information indicating a function from among a plurality of functions used to generate answer information and the argument of the function. In this case, the first acquisition unit 40 inputs user information to the generation AI, but does not input definition information to the generation AI.

[0134] Arguments for functions related to searches include, but are not limited to, information such as the type of restaurant, the location of the restaurant, the date of use, the time of use, and the number of people using the restaurant. Arguments for functions related to questions include, but are not limited to, information such as the restaurant ID and the search target. Arguments for functions related to reservations include, but are not limited to, information such as the restaurant ID, reservation date and time, reservation time, and the number of people using the reservation.

[0135] When the string "A friend is coming over and we're thinking of going out for dinner tonight, are there any good seafood restaurants nearby?" is input into the generation AI along with function information as user input information, function-specific information including information that identifies the function related to the search is output from the generation AI as intent information.

[0136] In this case, the function identification information includes, in addition to information identifying the search function, information on the arguments of the search function: the character string "Seafood Restaurant" as information indicating the type of restaurant; the character string "User's Location" as information indicating the location of the restaurant; the character string "2023 / 10 / 16" as information indicating the date of use; and the character string "18:00" as information indicating the time of use. These pieces of argument information are information indicating the intent and search condition information, which is information indicating the search conditions.

[0137] If the generation AI cannot identify a function corresponding to the user input information, it does not output the function identification information as output information, and in this case, the first acquisition unit 40 cannot acquire the function identification information from the generation AI.

[0138] The first acquisition unit 40 inputs information including the conversation history included in the dialogue data, in addition to the input information etc. accepted by the acceptance unit 30, to the generation AI, and acquires output information corresponding to the input information from the generation AI.

[0139] The conversation history included in the dialog data includes a user conversation history, which is the conversation history of user U, and a generation AI conversation history, which is the conversation history of the generation AI. The user conversation history can be information from which some information has been extracted rather than the user input information itself, and the generation AI conversation history can be information from which some information has been extracted rather than the response information to user U itself.

[0140] Therefore, the first acquisition unit 40 can reduce the amount of information (for example, the number of tokens) of the conversation history input to the generation AI in a service in which messages are exchanged between the first acquisition unit 40 and the user U in a conversational format.

[0141] For example, if the input information of user U is the character string "A friend is coming to visit, so we're thinking of going out for dinner tonight. Are there any good seafood restaurants nearby?", the dialogue data will include, as the user conversation history, the character string "Search for seafood restaurants from 18:00 on October 16, 2023." This allows the first acquisition unit 40 to appropriately add information indicating the date and time while reducing the number of characters compared to when the input information of user U is used as the user conversation history.

[0142] Furthermore, if the response information for user U is the string "1 item found.\nName: ABC Fresh Fish\nEnjoy delicious tuna dishes delivered directly from the fishing port!", the generated AI conversation history will be the string "1 item found.\nName: ABC Fresh Fish\nRestaurant ID: r000093218", and will not include information indicating the details of the restaurant, such as the string "Enjoy delicious tuna dishes delivered directly from the fishing port!". This allows the first acquisition unit 40 to appropriately delete unnecessary information while reducing the number of characters in the generated AI conversation history.

[0143] In addition, the first acquisition unit 40 can extract a portion of the conversation history contained in the dialogue data, input information including the extracted information and the input information accepted by the acceptance unit 30 to the generation AI, and acquire output information corresponding to the input information from the generation AI.

[0144] For example, when the dialogue data contains multiple pieces of search information, the first acquisition unit 40 extracts new search information from the multiple pieces of search information, inputs information containing the new search information into the generation AI, and acquires output information corresponding to the input information from the generation AI.

[0145] Furthermore, even when the dialogue data includes multiple pieces of search information and question information corresponding to the latest search information, the first acquisition unit 40 extracts new search information from the multiple pieces of search information, inputs information including the new search information into the generation AI, and acquires output information corresponding to the input information from the generation AI.

[0146] [3.3.2.2.Second acquisition part 41] The second acquisition unit 41 acquires information corresponding to the output information acquired by the first acquisition unit 40. For example, the second acquisition unit 41 acquires, as the information corresponding to the output information, information corresponding to the intention information including information indicating the intention type and information indicating the intention content acquired by the first acquisition unit 40.

[0147] The second acquisition unit 41 determines an access target based on the information indicating the intention type acquired by the first acquisition unit 40, and acquires information corresponding to the information indicating the intention content from the determined access target as information corresponding to the output information. The access target is, for example, one or more servers among a plurality of servers including the generation AI server 3, the search server 4, and the reservation server 5. Note that the access target is not limited to a server, and may be, for example, the memory unit 11 or another information processing device.

[0148] For example, if the information indicating the intention type is information indicating a search, the second acquisition unit 41 generates a search query based on the information indicating the intention content acquired by the first acquisition unit 40. Then, the second acquisition unit 41 transmits the generated search query to the search server 4 via the search API, and acquires search results corresponding to the search query from the search server 4 via the search API as information corresponding to the output information.

[0149] When the third acquisition unit 42 acquires sensor detection information, the second acquisition unit 41 transmits a search query including the sensor detection information as search condition information to the search server 4 and acquires the sensor detection information as information corresponding to the output information from the search server 4. When the sensor detection information is location information of the user U, the second acquisition unit 41 transmits a search query including the current location of the user U as search condition information to the search server 4, and when the sensor detection information is biometric information, the second acquisition unit 41 transmits a search query including the biometric information of the user U as search condition information to the search server 4.

[0150] Furthermore, for example, if the information indicating the intention type is information indicating a question, the second acquisition unit 41 acquires necessary information from the search server 4 through the search API based on the information indicating the intention content, etc. If the intention information does not include information indicating the intention content, the second acquisition unit 41 can also acquire detailed information about the restaurant from the search server 4 through the search API.

[0151] When sensor detection information is acquired by the third acquisition unit 42, the second acquisition unit 41 can also send a search query including the sensor detection information as search condition information to the search server 4 and acquire the necessary information from the search server 4.

[0152] When the second acquisition unit 41 acquires information from the search server 4, it inputs information including the information acquired from the search server 4 and the user input information accepted by the acceptance unit 30 into the generation AI, and acquires information corresponding to the output information from the generation AI.

[0153] Furthermore, for example, if the information indicating the intention type is information indicating a reservation, the second acquisition unit 41 generates a query based on the information indicating the intention content acquired by the first acquisition unit 40. Then, the second acquisition unit 41 transmits the generated query to the reservation server 5 via the reservation API, and acquires a processing result corresponding to the query from the reservation server 5 via the reservation API as information corresponding to the output information.

[0154] [3.3.2.3. Third acquisition part 42] When the acceptance unit 30 accepts the selection of the first button, the third acquisition unit 42 acquires the sensor detection information.

[0155] For example, when the reception unit 30 receives the selection of the first button, the third acquisition unit 42 acquires location information as sensor detection information. The third acquisition unit 42 acquires the sensor detection information included in the first button selection information received by the reception unit 30. The first button is a button including information indicating a character string "Search by current location," but is not limited to this example, and may be, for example, a button including information indicating a character string "Allow transmission of sensor information from the terminal device and search by current location."

[0156] Furthermore, when the selection of the first button is accepted, the third acquisition unit 42 can acquire biometric information of the user U as sensor detection information in addition to or instead of the location information. In this case, the first button includes, for example, information indicating the character string "Allow transmission of sensor information and search using sensor information" instead of information indicating the character string "Search by current location."

[0157] In addition, if the first button selection information does not include sensor detection information, the third acquisition unit 42 can send a sensor detection information transmission request to the terminal device 2 requesting that the terminal device 2 transmit sensor detection information, and acquire the sensor detection information transmitted from the terminal device 2 in response to the sensor detection information transmission request.

[0158] [3.3.3. Generation unit 32] Based on the information acquired by the acquisition unit 31, the generation unit 32 generates answer information for the user U, input information to be input to the generation AI, and the like.

[0159] For example, the generation unit 32 generates answer information for the user U based on information corresponding to the information indicating the intention type and the information indicating the intention content acquired by the second acquisition unit 41 of the acquisition unit 31.

[0160] Furthermore, the generation unit 32 generates information corresponding to the sensor detection information acquired by the acquisition unit 31 and included in the input information input to the generation AI.

[0161] The generating unit 32 has a first generating unit 43 and a second generating unit 44, and the first generating unit 43 and the second generating unit 44 will be specifically described below.

[0162] [3.3.3.1. First generation unit 43] The first generating unit 43 generates response information to the input information based on information corresponding to the output information acquired by the second acquiring unit 41.

[0163] For example, the first generation unit 43 generates answer information based on information corresponding to the information indicating the intention type and the information indicating the intention content acquired by the second acquisition unit 41 as information corresponding to the output information.

[0164] For example, suppose that the intention type indicated by the information indicating the intention type is search, and the information acquired by the second acquisition unit 41 as information corresponding to the output information is the search result acquired from the search server 4. Then, suppose that the search result includes information of the character string "id":"r000093218", information of the character string "name":"ABC Seafood", and information of the character string "description":"Enjoy delicious tuna dishes delivered directly from the fishing port!". The information of the character string "id":"r000093218"" is information indicating the restaurant ID.

[0165] In this case, the first generation unit 43 generates, for example, the following information as answer information: a string of characters: "One seafood restaurant was found near your current location from 18:00 on 16 / 10 / 2023.\n\n◇ABC Seafood\n You can enjoy delicious tuna dishes delivered directly from the fishing port!"

[0166] Furthermore, it is assumed that the intention type indicated by the information indicating the intention type is a question, and that the information is acquired from the generation AI as information corresponding to the output information by the second acquisition unit 41. In this case, the first generation unit 43 generates, as answer information, information including the information acquired from the generation AI.

[0167] For example, suppose the information obtained from the generative AI contains the string ""description":" ABC Seafood serves excellent lobster dishes. The lobster is sautéed in butter and garlic, and its rich flavor fills your mouth. We also recommend trying our fresh tuna steaks."

[0168] In this case, the first generation unit 43 generates the information of the string ""answer":" ABC Seafood serves excellent lobster dishes. The lobster is sautéed with butter and garlic, and its mellow flavor fills your mouth. We also recommend that you try the fresh tuna steak."" as answer information.

[0169] Furthermore, the first generating unit 43 generates information indicating an error as answer information when the function identifying information is not acquired by the first acquiring unit 40. For example, the first generating unit 43 generates, as answer information, the information indicating an error, such as a character string "Unfortunately, this is not subject to processing and we cannot answer." or a character string "Please enter information about searching for restaurants, asking questions about restaurants, and making reservations for restaurants."

[0170] For example, when the generation AI is OpenAI's GPT, if the output information of the generation AI is not a function calling response, the first acquisition unit 40 will not acquire the function identification information, and so the first generation unit 43 generates information indicating an error as answer information. The function calling response includes, for example, the information of the string ""finish_reason":"function_call"", and the first acquisition unit 40 determines whether or not it is a function calling response based on the information of the string ""finish_reason":"function_call"", and acquires the function identification information.

[0171] [3.3.3.2. Second generation unit 44] The second generating unit 44 generates and updates dialogue data as information for conducting a conversation with the user U.

[0172] The dialogue data is data to which, for example, past conversation history with user U, variable information about user U, information indicating specific events, etc. are added, and is generated, for example, for each conversation with user U. A conversation unit is a unit that is separated by the period from the start to the end of a conversation with user U.

[0173] The variable information of the user U is, for example, information indicating the location of the user U, but is not limited to such an example. The dialogue data is information in a predetermined format, for example, structured information (structured data) that can be easily searched and analyzed. The structured information (structured data) is, for example, structured information (structured data) in JSON format, but is not limited to such an example.

[0174] The information indicating a specific event is, for example, information indicating that an argument in the function identification information is specific information, and includes information indicating the event type, information indicating the event content, etc. The information indicating the event type is, for example, information indicating the absence of the location of user U.

[0175] The information indicating the event content includes, for example, information on the character string "search," information on the character string "seafood restaurant," and information on the character string "user location," etc. The information on the character string "search" is information indicating the intention type, and the information on the character string "seafood restaurant" and information on the character string "user location" is information indicating the intention content.

[0176] In the dialog data, the conversation history includes the user conversation history that is input to the generation AI as the user U's conversation history, and the generation AI conversation history that is input to the generation AI as the generation AI's conversation history.

[0177] The second generation unit 44 generates a user conversation history to be input to the generation AI as a conversation history with the user U, based on the output information of the generation AI acquired by the first acquisition unit 40 of the acquisition unit 31. The second generation unit 44 adds the generated user conversation history to the dialog data.

[0178] For example, the second generation unit 44 generates information indicating the intention type and information indicating the intention content as a user conversation history based on the information indicating the intention type and information indicating the intention content acquired by the first acquisition unit 40, and adds the generated user conversation history to the dialog data.

[0179] In addition, the second generation unit 44 generates a generated AI conversation history to be input to the generated AI as the conversation history of the generated AI based on information corresponding to the output information acquired by the second acquisition unit 41 of the acquisition unit 31.

[0180] For example, the second generation unit 44 generates information indicating the intention type, information indicating the processing target, information indicating the intention content, and output information of the generated AI as a generated AI conversation history based on information corresponding to the output information acquired by the second acquisition unit 41 of the acquisition unit 31, and adds the generated generated AI conversation history to the dialog data.

[0181] In order to prevent the amount of dialogue data from increasing, the second generation unit 44 deletes a part of the conversation history included in the dialogue data when a predetermined condition is satisfied. For example, when the dialogue data includes search information and new search information is to be added, the second generation unit 44 deletes the old search information from the dialogue data.

[0182] For example, when the dialog data is in the state shown in (b2) of FIG. 1, assume that the information of the character string "After all, let's have a yakiniku restaurant" is sent from the terminal device 2 to the information processing device 1 as input information from the user U. In this case, based on the input information, the generation AI outputs information specifying a search-related function as information indicating the intention type, and information of the argument of the function, such as the information of the character string ""query":"yakiniku restaurant"" instead of the information of the character string ""query":"seafood restaurant"".

[0183] The second acquisition unit 41 transmits a search query including information indicating the restaurant type "yakiniku restaurant" as a search condition to the search server 4, and acquires search results from the search server 4. Then, based on the search intention acquired by the first acquisition unit 40 and the search results acquired by the second acquisition unit 41, the second generation unit 44 deletes the previous search information from the dialogue data and adds the current search information to the dialogue data.

[0184] In this case, the previous search information to be deleted from the dialog data is the string "intent":"search","condition":{"query":"Seafood Restaurant","location”:"USER_LOCATION ","date":"20231016","time":"18:00"},"restaurants":{"id": "r000093218", "name": "ABC Seafood","description":"Enjoy delicious seafood dishes delivered directly from the fishing port!"

[0185] In addition, the search information added to the dialogue data this time is, for example, the string "intent":"search", "condition":{"query":"Yakiniku restaurant","location":"USER_LOCATION ","date":"20231016","time":"18:00"},"restaurants":{"id": "r000287231", "name": "Hishakaku Akasaka branch","description":"All-you-can-eat A5-grade Yakiniku!"

[0186] The second generation unit 44 may also set a predetermined condition that the search conditions have changed by more than a predetermined range, and delete all past search information from the dialogue data when the predetermined condition is met. The predetermined range may be, for example, a range within a prefecture or a predetermined range in the case of a location condition, or a range within a restaurant genre group in the case of a restaurant type condition, but is not limited to such examples.

[0187] Furthermore, when the dialogue data includes question information and new search information is added to the dialogue data, the second generation unit 44 can also delete the question information included in the dialogue data in addition to past search conditions included in the dialogue data. This makes it possible to prevent the amount of conversation history data included in the dialogue data from increasing too much.

[0188] [3.3.4.Providing Department 33] The providing unit 33 provides the user U with various pieces of information by transmitting the various pieces of information to the terminal device 2.

[0189] For example, the providing unit 33 provides the answer information generated by the first generating unit 43 of the generating unit 32 to the user U, and provides various buttons to the user U. The providing unit 33 has a display control unit 45 that displays the answer information generated by the first generating unit 43 and various buttons in the chat room.

[0190] 3.3.4.1. Display control unit 45 The display control unit 45 transmits the answer information generated by the first generation unit 43 to the terminal device 2, thereby causing the answer information generated by the first generation unit 43 to be displayed in the chat room displayed on the terminal device 2.

[0191] Furthermore, by transmitting button information to the terminal device 2, the display control unit 45 causes the terminal device 2 to display a button for acquiring sensor detection information from the terminal device 2, which is information detected by a sensor (not shown) built into the terminal device 2. The button information is, for example, the first button information or second button information described above, and the button is the first button or second button described above. In this way, the display control unit 45 causes the terminal device 2 to display a button for acquiring sensor detection information from the terminal device 2 of the user U in a conversational service using a generation AI that outputs answer information according to input information.

[0192] The display control unit 45 displays a button on the terminal device 2 based on, for example, the output information of the generation AI acquired by the acquisition unit 31. For example, when the output information of the generation AI acquired by the acquisition unit 31 includes information of a specific string, the display control unit 45 displays the first button on the terminal device 2 by transmitting first button information to the terminal device 2. The information of the specific string is, for example, information of the string "USER_LOCATION", but is not limited to this example.

[0193] 4. Example of Processing by Processing Unit 12 Fig. 6 is a diagram for explaining an example of processing by the processing unit 12 of the information processing device 1 according to the embodiment. Fig. 7 and Fig. 8 are diagrams showing an example of information located in a chat room displayed on a terminal device 2 according to the embodiment. In Fig. 6, one of the four terminal devices 2 is referred to as terminal device 2A for convenience, and a user U of terminal device 2A is referred to as user UA.

[0194] As shown in (a) of Figure 7, when user UA operates terminal device 2A to input a string of characters into a chat room, information on the string of characters input by user UA is sent from terminal device 2A to information processing device 1 as input information, as shown in Figure 6.

[0195] In the example shown in (a) of Figure 7, the string "A friend is coming over and we're thinking of going out to eat. Do you know any good seafood restaurants?" is sent to the information processing device 1 as input information.

[0196] The receiving unit 30 in the processing unit 12 of the information processing device 1 receives input information transmitted from the terminal device 2A (step S20). The first obtaining unit 40 in the obtaining unit 31 of the processing unit 12 inputs information including the input information received in step S20 to the generation AI as an intention analysis request through the generation AI-API (step S21), and obtains intention information in response to the intention analysis request as output information from the generation AI through the generation AI-API (step S22).

[0197] For example, in step S21, the acquisition unit 31 inputs information including intention definition information for extracting the intention type and the intention content from the input information and the user input information to the generation AI via the generation AI-API. Then, in step S22, the acquisition unit 31 acquires intention information including information indicating the intention type and the intention content as output information from the generation AI via the generation AI-API.

[0198] In Figure 6, the generation AI that inputs and outputs information through the generation AI-API is a generation AI that has been trained to output intention information as output information when information including user information and definition information is input. The definition information is information that defines each of multiple functions.

[0199] 14 is a diagram showing an example of input information that is information input to the generation AI by the acquisition unit 31 in the processing unit 12 of the information processing device 1 according to the embodiment. The input information 60 shown in FIG. 14 includes date and time information 61, user input information 62, function instruction information 63, and function information 64a, 64b, and 64c.

[0200] In Figure 14, date and time information 61 is information indicating the current time, and user input information 62 is input information by user UA, which is the string "A friend is coming to visit, so I'm thinking of going out for dinner tonight. Are there any good seafood restaurants?"

[0201] In addition, in the example shown in Figure 14, the function instruction information 63 shows an example in which the generating AI is a large-scale language model called GPT3.5-turbo from OpenAI, and includes the string "function_call:"auto"" as information for outputting function identification information from the generating AI.

[0202] 14 includes function information 64a, which is information on a function related to a search indicated by the function name "searchRestaurant", function information 64b, which is information on a function related to a question indicated by the function name "askRestaurantInfo", and function information 64c, which is information on a function related to a reservation indicated by the function name "eserveRestaurant". Note that in the function information 64a, 64b, and 64c shown in FIG. 14, information defining specific arguments of each function is omitted by information of the character string "(omitted)".

[0203] Fig. 15 is a diagram showing an example of information about a function related to a search included in the function information shown in Fig. 14. Function information 64a shown in Fig. 15 is information that defines a function related to a search, and includes information about the character string "askRestaurantInfo" that identifies the function name, information about "query" (type of restaurant), information about "location" (position), information about "date" (date of use), information about "time" (time of use), and information about "people" (number of users) as information about arguments (parameters) of the function related to the search.

[0204] Fig. 16 is a diagram showing an example of information about a function related to a question included in the function information shown in Fig. 14. Function information 64b shown in Fig. 16 is information that defines a function related to a question, and includes information about a character string "searchRestaurant" as information that identifies the function name, information about "restaurantId" (restaurant ID), and information about "question" (question) as information about an argument (parameter) of the function related to the question.

[0205] Fig. 17 is a diagram showing an example of information about a function related to a reservation included in the function information shown in Fig. 14. Function information 64c shown in Fig. 17 is information that defines a function related to a reservation, and includes information on the character string "reserveRestaurant" that identifies the function name, information on "restaurantId" (restaurant ID), information on "date" (date of use), information on "time" (time of use), and information on "people" (number of people using) as information on arguments (parameters) of the function related to the reservation.

[0206] When the string "A friend is coming over and we're thinking of going out to eat, do you know any good seafood restaurants?" is sent to the information processing device 1 as input information, the generation AI outputs function identification information as output information, which includes information that identifies a function related to the search and information that identifies the arguments of the function related to the search.

[0207] Based on the output information acquired in step S22, the information processing device 1 generates dialogue data as information for conducting a conversation with the user UA (step S23). The dialogue data is data to which, for example, a conversation history with the user UA, variable information about the user UA, information indicating a specific event, etc. are added, and is generated, for example, for each conversation with the user UA. A conversation unit is a unit defined by the period from the start to the end of a conversation with the user UA.

[0208] 9 is a diagram showing an example of dialogue data generated by the generation unit 32 in the processing unit 12 of the information processing device 1 according to the embodiment. The dialogue data 70 shown in FIG. 9 includes search information 71, user variable information 72, and event information 73.

[0209] The search information 71 is information related to a search, and includes information indicating an intent type and information indicating an intent content. The search information 71 includes information of the character string "intent:search" as information indicating an intent type, and information of the character string "query:seafood restaurant", information of the character string "USER_LOCATION", information of the character string "date:20231016", and information of the character string "time:18:00" as information indicating an intent content.

[0210] The user variable information 72 also includes information indicating that the location of the user UA has not been set. The event information 73 includes, as information indicating the event type, information of the character string "lackOfUserLocation," which is information indicating the absence of the location of the user UA, and includes, as information indicating the content of the event, information indicating that the search type is "search," the restaurant type is "seafood restaurant," and the location is the location of the user UA.

[0211] Next, if information indicating the absence of the user UA's location is included in the dialogue data 70 as event information 73, the display control unit 45 in the providing unit 33 of the processing unit 12 sends the first button information to the terminal device 2A and displays the first button etc. in the chat room displayed on the terminal device 2A (step S24).

[0212] In the example shown in (b) of Figure 7, information indicating the string "May I obtain your current location from your terminal device?", a first button containing the string "Yes", and a second button containing the string "Yes" are displayed in the chat room.

[0213] When user UA operates terminal device 2A to select the first button, for example by tapping it, terminal device 2A acquires location information, which is data indicating the current location, from the built-in location sensor using the function of the communication app, and transmits first button selection information including the acquired location information as the location information of user UA to information processing device 1.

[0214] The first button selection information is information indicating that the first button has been selected by the user UA, and includes data indicating the user UA's current location using latitude and longitude as the user UA's location information, but the user UA's location information does not have to be included in the first button selection information. In this case, the third acquisition unit 42 requests the terminal device 2A to transmit the location information in response to the selection of the first button.

[0215] In addition, when the user UA operates the terminal device 2A to select the second button, for example by tapping it, the terminal device 2A transmits third button selection information to the information processing device 1, which is information indicating that the second button has been selected by the user UA.

[0216] The third acquisition unit 42 in the acquisition unit 31 of the processing unit 12 acquires the first button selection information transmitted from the terminal device 2A (step S25). When the first button selection information is acquired by the third acquisition unit 42, the second generation unit 44 in the generation unit 32 of the processing unit 12 updates the dialog data 70 based on the position information indicated by the first button selection information (step S26).

[0217] 10 is a diagram showing an example of location information added to the dialogue data 70 as variable information of the user UA by the generation unit 32 in the processing unit 12 of the information processing device 1 according to the embodiment. In the example shown in FIG. 10, the location information 74 added to the dialogue data 70 includes the information of the character string "userLocation":{"lat":123.456,"lon":987.654}}.

[0218] Furthermore, when adding location information 74 to the dialog data 70, the second generation unit 44 deletes information indicating the absence of the location of the user UA (for example, event information 73 shown in FIG. 9 ) from the dialog data 70. The location information 74 is an example of user-variable information. This allows the second generation unit 44 to reduce the amount of data in the dialog data 70.

[0219] The first generation unit 43 in the generation unit 32 generates a search query whose search condition information includes the location information indicated by the first button selection information accepted by the acceptance unit 30 and information indicating the intended content indicated by the output information acquired in step S22. Then, the second acquisition unit 41 in the acquisition unit 31 of the processing unit 12 transmits the search query generated by the first generation unit 43 to the search server 4 via the search API (step S27).

[0220] In step S27, since the function identified by the function identification information acquired by the first acquisition unit 40 in step S22 is a function related to search, the second acquisition unit 41 sends a search query to the search server 4 via the search API, the search query including, as search condition information, the argument information included in the function identification information acquired by the first acquisition unit 40 and the location information indicated by the first button selection information.

[0221] The second acquisition unit 41 acquires search results corresponding to the search query from the search server 4 via the search API (step S28). Then, the second generation unit 44 in the generation unit 32 of the processing unit 12 updates the dialogue data 70 based on the search results acquired by the second acquisition unit 41 in step S28 (step S29).

[0222] 11 is a diagram showing an example of dialogue data 70 updated by the generation unit 32 in the processing unit 12 of the information processing device 1 according to the embodiment. The dialogue data 70 shown in Fig. 11 includes search information 71 arranged in step S23, location information 74 added in step S26, and search results 75 added in step S29.

[0223] 11 includes a plurality of pieces of restaurant information 75a, 75b, etc. Restaurant information 75a includes information on the character string "id:r0028374981" (restaurant ID), information on the character string "name:ABC Seafood" (restaurant name), and information on "Enjoy delicious tuna dishes delivered directly from the fishing port!" (restaurant details).

[0224] The restaurant information 75b includes information on the character string "id":"r0083720123" (restaurant ID), information on the character string "name":"DEF Seafood" (restaurant name), and information on "We serve fresh seafood bowls. Very popular with women!" (restaurant details). Note that the search results 75 shown in FIG. 11 omit information on the third and subsequent restaurants.

[0225] The second generation unit 44 can also generate the dialogue data 70 by performing the process of step S23 and the process of step S26 together in step S29.

[0226] Next, the first generation unit 43 in the generation unit 32 of the processing unit 12 generates answer information based on the search results acquired by the second acquisition unit 41 in step S23, and the display control unit 45 in the provision unit 33 of the processing unit 12 displays the answer information generated by the first generation unit 43 on the terminal device 2A of the user UA (step S30).

[0227] Terminal device 2A receives the answer information transmitted by display control unit 45 and displays the received answer information. In the example shown in (c) of Fig. 7, the following information is displayed as answer information in the chat room displayed on terminal device 2A: "A total of three seafood restaurants were found that accept reservations from 18:00 today, October 16, 2023. 1. ABC Seafood Enjoy delicious tuna dishes delivered directly from the fishing port! 2. DEF Seafood\n Serves fresh seafood bowls. Very popular with women! HIJ Seafood..."

[0228] As shown in (d) of Fig. 7, when user UA operates terminal device 2A to input a character string into a chat room, information on the character string input by user UA is transmitted as input information from terminal device 2A to information processing device 1, as shown in Fig. 6. In the example shown in (d) of Fig. 7, information on the character string "What kind of ABC seafood is there? I want to eat something delicious." is transmitted as input information to information processing device 1.

[0229] The receiving unit 30 in the processing unit 12 of the information processing device 1 receives input information transmitted from the terminal device 2A (step S31). The first acquiring unit 40 in the acquiring unit 31 of the processing unit 12 inputs information including the input information received in step S31 as an intention analysis request to the generating AI through the generating AI-API (step S32).

[0230] For example, in step S32, the first acquisition unit 40 inputs information including intention definition information for extracting the intention type and the intention content from the input information and the user input information to the generation AI via the generation AI-API. Then, in step S33, the acquisition unit 31 acquires intention information including information indicating the intention type and the intention content as output information from the generation AI via the generation AI-API.

[0231] 18 is a diagram showing another example of input information that is information input to the generation AI by the acquisition unit 31 in the processing unit 12 of the information processing device 1 according to the embodiment. The input information 60 shown in FIG. 18 includes date and time information 61, user input information 62, function instruction information 63, function information 64a, 64b, and 64c, and conversation histories 65a and 65b.

[0232] In FIG. 18, user input information 62 is information of the character string "What kind of ABC seafood is there? I want to eat something delicious.", and is input information accepted by the accepting unit 30 in step S31.

[0233] 18, the conversation history 65a is information of the character string "Search for a seafood restaurant that can accept reservations from 18:00 on October 16, 2023." The first generation unit 43 generates the conversation history 65a as the user conversation history based on the search information 71 included in the dialogue data 70 shown in FIG.

[0234] This allows the second generation unit 44 to reduce the number of characters while still appropriately adding information indicating the date and time compared to when the information in the string "A friend is coming to visit, so I'm thinking of going out for dinner tonight. Do you know any good seafood restaurants?" is used as the user conversation history.

[0235] 18, the conversation history 65b is the generated AI conversation history, and is information of the character string "3 results found.\nName ABC Seafood, ID r0028374981\nName DEF Seafood, ID Ir0083720123\nName HIJ Seafood ID r0072630123." The first generation unit 43 generates the generated AI conversation history based on the search result 75 included in the dialogue data 70 shown in FIG.

[0236] As a result, the second generation unit 44 uses the search results corresponding to the intention information as the generated AI conversation history instead of the intention information generated by the generation AI, and therefore can provide a more appropriate content as a conversation history with the user UA compared to when the intention information is used as the generated AI conversation history. Also, the second generation unit 44 does not include descriptions of restaurants, etc., included in the response information to the user UA, in the generated AI conversation history, and therefore can reduce the amount of information in the generated AI conversation history compared to when the response information to the user UA is used as the generated AI conversation history.

[0237] The second acquisition unit 41 of the acquisition unit 31 acquires the intention information in response to the intention analysis request from the generation AI through the generation AI-API (step S33). The intention information acquired in step S33 includes information indicating the intention type and information indicating the intention content.

[0238] The information indicating the intention type included in the intention information output from the generation AI is information indicating a function related to the question, and the information indicating the intention content includes restaurant ID information that identifies the restaurant. The second acquisition unit 41 generates a search query that includes the restaurant ID as search condition information and is used to search for detailed information about the restaurant corresponding to the restaurant ID, and transmits the generated search query to the search server 4 via the search API (step S34).

[0239] Then, the second obtaining unit 41 obtains search results corresponding to the search query from the search server 4 via the search API (Step S35). The search results include, for example, detailed information about the restaurant corresponding to the restaurant ID indicated in the search query.

[0240] Next, the second acquisition unit 41 generates input information to be input to the generation AI based on the dialog data, the user input information accepted by the acceptance unit 30 in step S31, and the search results acquired in step S35, and inputs the generated input information to the generation AI via the generation AI-API (step S36).

[0241] 19 is a diagram showing yet another example of input information that is information input to the generation AI by the acquisition unit 31 in the processing unit 12 of the information processing device 1 according to the embodiment. In the input information 80 shown in FIG. 19, the information of the character string "The following is information about a restaurant called ABC Seafood.\n\nYou can enjoy delicious seafood dishes delivered directly from the fishing port!" is information generated based on dialogue data.

[0242] 19, the information of the character string "ABC Kaisen is a seafood restaurant that serves dishes made with fresh seafood..." is the search result acquired in step S35. Also, in Fig. 19, the information of the character string "What kind of dishes does ABC Kaisen have? I want to eat something delicious." is the user-input information accepted by the accepting unit 30 in step S31.

[0243] The second acquisition unit 41 acquires output information corresponding to the input information from the generation AI through the generation AI-API (step S37). The second generation unit 44 of the generation unit 32 updates the dialog data 70 based on the input information accepted by the acceptance unit 30 in step S31, the search results acquired by the second acquisition unit 41 in step S35, and the output information of the generation AI acquired by the second acquisition unit 41 in step S37 (step S38).

[0244] 12 is a diagram showing an example of a conversation history added to the dialogue data 70 by the generation unit 32 in the processing unit 12 of the information processing device 1 according to the embodiment. The conversation history 76 shown in FIG. 12 includes information on the character string "'intent':'question'" as information indicating the intent type, information on the character string "'restaurantId':'r0028374981'" as information on the restaurant ID, information on the character string "'restaurantName':'ABC Seafood'" as information on the restaurant name, and information on the character string "What kind of ABC Seafood do they have? I want to eat something delicious." as a user conversation history. This user conversation history is input information accepted by the acceptance unit 30 in step S31.

[0245] 12 includes the following information as an AI conversation history: "ABC Seafood serves excellent lobster dishes. The lobster is sautéed in butter and garlic, and its rich flavor fills your mouth. We also recommend trying the fresh tuna steak." This AI conversation history is the output information of the generated AI acquired by the second acquisition unit 41 in step S37.

[0246] Next, the first generation unit 43 in the generation unit 32 of the processing unit 12 generates answer information based on the output information of the generation AI acquired by the second acquisition unit 41 in step S37, and the display control unit 45 in the provision unit 33 of the processing unit 12 displays the answer information generated by the first generation unit 43 on the terminal device 2A of the user UA (step S39).

[0247] Terminal device 2A receives the answer information transmitted by display control unit 45 and displays the received answer information. In the example shown in (a) of Fig. 8, the character string "ABC Seafood serves excellent lobster dishes. The lobster is sautéed in butter and garlic, and its mellow flavor fills your mouth. We also recommend trying the fresh tuna steak." is displayed as answer information in the chat room displayed on terminal device 2A.

[0248] As shown in (b) of Fig. 8, when user UA operates terminal device 2A to input a character string into a chat room, information on the character string input by user UA is transmitted as input information from terminal device 2A to information processing device 1, as shown in Fig. 6. In the example shown in (b) of Fig. 8, information on the character string "May I make a reservation for ABC Seafood? For two people?" is transmitted as input information to information processing device 1.

[0249] The receiving unit 30 in the processing unit 12 receives input information transmitted from the terminal device 2A (step S40). The first acquiring unit 40 in the acquiring unit 31 in the processing unit 12 inputs information including the input information received in step S31 as an intention analysis request to the generating AI through the generating AI-API (step S41).

[0250] For example, in step S40, the first acquisition unit 40 inputs information including intention definition information for extracting the intention type and the intention content from the input information and the user input information to the generation AI through the generation AI-API. Then, in step S41, the acquisition unit 31 acquires intention information including information indicating the intention type and the intention content as output information from the generation AI through the generation AI-API.

[0251] 20 is a diagram showing another example of input information that is information input to the generation AI by the acquisition unit 31 in the processing unit 12 of the information processing device 1 according to the embodiment. The input information 60 shown in FIG. 20 includes date and time information 61, user input information 62, function instruction information 63, function information 64a, 64b, and 64c, and conversation histories 65a, 65b, 65c, and 65d.

[0252] 18, and this user input information 62 is used as the user conversation history. Conversation history 65d is the output information acquired by the second acquisition unit 41 in step S37, and this output information is used as the AI ​​conversation history.

[0253] The second acquisition unit 41 acquires intention information, which is output information corresponding to the input information input to the generation AI in step S41, from the generation AI through the generation AI-API (step S42). If the user input information accepted by the acceptance unit 30 in step S40 is user input information 62 shown in Fig. 20, the generation AI outputs function identification information including information for identifying a function related to a reservation and information for identifying an argument of the function related to a reservation as intention information.

[0254] The information indicating the intended content includes, for example, the following information as argument information for a reservation function: the restaurant ID (string "id":"r000093218"), the date of use (string "2023 / 10 / 16"), the time of use (string "18:00"), and the number of people (string "2"). This argument information is reservation condition information, which is information indicating the reservation conditions.

[0255] Since the information indicating the intention type indicated in the intention information acquired by the first acquisition unit 40 in step S42 is information that identifies a function related to a reservation, the second acquisition unit 41 generates a reservation possibility query including information indicating the reservation confirmation conditions, and sends the generated reservation possibility query to the reservation server 5 via the reservation API (step S43).

[0256] The reservation availability query includes, for example, the restaurant ID (string "id":"r000093218"), the date of use (string "2023 / 10 / 16"), the time of use (string "18:00"), and the number of people using (string "2")

[0257] Next, the second acquisition unit 41 acquires reservation availability information corresponding to the reservation availability query from the reservation server 5 through the reservation API (step S44). The reservation availability information is, for example, information indicating whether a reservation for the restaurant specified in the reservation availability query is possible under the conditions specified in the reservation availability query.

[0258] Next, based on the reservation availability information acquired in step S15, the display control unit 45 of the providing unit 33 transmits information indicating whether or not a reservation is possible for the restaurant that was the subject of the reservation availability inquiry made by user U in the user input information in step S11 as response information to the terminal device 2A, and displays the response information on the terminal device 2A (step S45).

[0259] The terminal device 2A receives the answer information transmitted by the display control unit 45 and displays the received answer information. In the example shown in (c) of Fig. 8, the character string "I'd like to make a reservation for ABC Seafood for two people from 18:00 on October 16, 2023. Is that okay?" is displayed as answer information in the chat room displayed on the terminal device 2A.

[0260] 8(c), the display control unit 45 causes the terminal device 2A to display two buttons for inquiring of the user UA as to whether or not the reservation can be confirmed. The two buttons include a third button containing information indicating the character string "Yes" and a fourth button containing information indicating the character string "No."

[0261] When user UA operates terminal device 2A to select the third button, for example by tapping it, terminal device 2A acquires location information, which is data indicating the current location, from the built-in location sensor using the function of the communication app, and transmits fourth button selection information, which includes the acquired location information as the location information of user UA, to information processing device 1.

[0262] The third acquisition unit 42 of the acquisition unit 31 acquires the button information sent from the terminal device 2, and the second acquisition unit 41 of the acquisition unit 31 sends information indicating the confirmation of the reservation to the reservation server 5 via the reservation API. This completes the reservation for ABC Seafood. As shown in (d) of FIG. 8, the display control unit 45 displays the following information on the terminal device 2A: "A reservation has been made for ABC Seafood for two people starting at 18:00 today, 10 / 16 / 2023." as information indicating that the reservation has been confirmed.

[0263] When the reservation for ABC Seafood is completed, the second generation unit 44 of the generation unit 32 adds a reservation history indicating that the reservation for ABC Seafood has been completed to the dialogue data 70 (step S46). The reservation history is part of the conversation history.

[0264] 13 is a diagram showing an example of a reservation history added to the dialogue data 70 by the generation unit 32 in the processing unit 12 of the information processing device 1 according to the embodiment. The conversation history 77 shown in FIG. 13 includes information on the character string "intent:reserve" as information indicating the intent type, information on the character string "restaurantId:r0028374981" as information on the restaurant ID, information on the character string "restaurantName:ABC Seafood" as information on the restaurant name, information on the character string "date:20231016" as information on the date of use, information on the character string "time:18:00" as information on the time of use, and information on the character string "person:2" as information on the number of people using the service.

[0265] As described above, answer information for user U other than answer information to questions about stores is generated by the generation unit 32 of the information processing device 1, not by the generation AI, so the information processing device 1 will not, for example, include a non-existent store in the search results or respond that a reservation has been made when no reservation has been made. Therefore, the information processing device 1 can be operated in a way that prevents hallucinations, a problem specific to generation AI.

[0266] [5. Processing Procedure] Next, a procedure of information processing by the processing unit 12 of the information processing device 1 according to the embodiment will be described. Fig. 21 is a flowchart showing an example of information processing by the processing unit 12 of the information processing device 1 according to the embodiment.

[0267] 21, the processing unit 12 of the information processing device 1 determines whether or not it has received user input information, which is input information transmitted from the terminal device 2 (step S50). If it determines that it has received the user input information (step S50: Yes), the processing unit 12 inputs the user input information to the generation AI (step S51) and obtains output information corresponding to the user input information from the generation AI (step S52).

[0268] The processing unit 12 determines whether the intention type indicated by the output information acquired in step S52 is search (step S53). If the processing unit 12 determines that the intention type is search (step S53: Yes), it performs search processing (step S54). The search processing in step S54 is the processing of steps S70 to S72 shown in FIG. 22, and will be described in detail later.

[0269] If the processing unit 12 determines that the intention type is not a search (step S53: No), it determines whether the intention type is a question (step S55). If the processing unit 12 determines that the intention type is a question (step S55: Yes), it performs question processing (step S56). The search processing in step S56 is the processing of steps S80 to S84 shown in FIG. 23, and will be described in detail later.

[0270] If the processing unit 12 determines that the intention type is not a question (step S55: No), it determines that the intention type is a reservation and performs reservation processing (step S57). The reservation processing in step S57 is the processing of steps S90 to S92 shown in Fig. 24, and will be described in detail later.

[0271] When the processing of step S54, step S56, or step S57 is completed, the processing unit 12 provides the answer information to the user U (step S58). Then, the processing unit 12 generates or updates the dialogue data 70 based on the processing result of step S54, step S56, or step S58 (step S59).

[0272] When the processing of step S60 is completed or when it is determined that the user input information has not been received (step S50: No), the processing unit 12 determines whether or not the operation end timing has arrived (step S60). The processing unit 12 determines that the operation end timing has arrived when, for example, the power of the information processing device 1 is turned off.

[0273] If the processing unit 12 determines that the operation end time has not yet arrived (step S60: No), it proceeds to step S50, and if it determines that the operation end time has arrived (step S60: Yes), it terminates the processing shown in Figure 21.

[0274] 22 is a flowchart showing an example of search processing by the processing unit 12 of the information processing device 1 according to the embodiment. As shown in FIG. 22, the processing unit 12 generates a search query based on the output information of the generation AI, and transmits the generated search query to the search server 4 (step S70).

[0275] Next, the processing unit 12 acquires search results corresponding to the search query from the search server 4 (step S71), generates answer information based on the acquired search results (step S72), and ends the processing shown in FIG.

[0276] 23 is a flowchart showing an example of question processing by the processing unit 12 of the information processing device 1 according to the embodiment. As shown in FIG. 23, the processing unit 12 generates a search query based on the output information of the generation AI, and transmits the generated search query to the search server 4 (step S80).

[0277] Next, the processing unit 12 acquires search results corresponding to the search query from the search server 4 (step S81). The processing unit 12 inputs information including the search results acquired in step S81 and the user input information accepted in step S50 to the generation AI (step S82), and acquires output information from the generation AI (step S83). Then, the processing unit 12 generates answer information based on the output information acquired in step S83 (step S84), and ends the processing shown in FIG.

[0278] 24 is a flowchart showing an example of reservation processing by the processing unit 12 of the information processing device 1 according to the embodiment. As shown in FIG. 24, the processing unit 12 generates a query based on the output information of the generation AI, and transmits the generated query to the reservation server 5 (step S90).

[0279] Next, the processing unit 12 acquires a processing result corresponding to the query from the reservation server 5 (step S91), generates answer information based on the acquired processing result (step S92), and ends the processing shown in FIG.

[0280] [6. Modifications] In the above example, a text generation AI has been described as an example of a generation AI, but the generation AI may also be a multimodal generation AI.

[0281] Multimodal generative AI is, for example, a generative AI that generates speech from text, generates text from speech, generates speech from speech, or generates text from text, such as GPT-4V, but is not limited to such examples.

[0282] Furthermore, user U can, for example, make an utterance to terminal device 2 and input the information of the utterance into terminal device 2 as input information, and the information of the utterance input by user U is transmitted from terminal device 2 to information processing device 1 as input information.

[0283] When voice information, which is an utterance of the user U, is transmitted as input information from the terminal device 2, the information processing device 1 can also convert the voice information into text. Note that the terminal device 2 can also convert the voice information, which is an utterance of the user U, into text and transmit the converted text from the terminal device 2 to the information processing device 1 as input information.

[0284] [7. Hardware Configuration] The information processing device 1 according to the embodiment described above is realized by, for example, a computer 200 configured as shown in Fig. 25. Fig. 25 is a hardware configuration diagram showing an example of the computer 200 that realizes the functions of the information processing device 1 according to the embodiment. The computer 200 has a CPU 201, a RAM 202, a ROM (Read Only Memory) 203, an HDD (Hard Disk Drive) 204, a communication interface (I / F) 205, an input / output interface (I / F) 206, and a media interface (I / F) 207.

[0285] The CPU 201 operates and controls each unit based on programs stored in the ROM 203 or the HDD 204. The ROM 203 stores a boot program executed by the CPU 201 when the computer 200 starts up, programs that depend on the hardware of the computer 200, and the like.

[0286] HDD 204 stores programs executed by CPU 201, data used by such programs, etc. Communication interface 205 receives data from other devices via network N (see FIG. 5) and sends it to CPU 201, and transmits data generated by CPU 201 to other devices via network N.

[0287] The CPU 201 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input / output interface 206. The CPU 201 acquires data from the input devices via the input / output interface 206. The CPU 201 also outputs generated data to the output devices via the input / output interface 206.

[0288] The media interface 207 reads a program or data stored in the recording medium 208 and provides it to the CPU 201 via the RAM 202. The CPU 201 loads the program or data from the recording medium 208 onto the RAM 202 via the media interface 207 and executes the loaded program. The recording medium 208 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

[0289] For example, when the computer 200 functions as the information processing device 1 according to the embodiment, the CPU 201 of the computer 200 executes programs loaded onto the RAM 202 to realize the functions of the processing unit 12. In addition, the HDD 204 stores data in the storage unit 11. The CPU 201 of the computer 200 reads and executes these programs from the recording medium 208, but as another example, the CPU 201 may obtain these programs from another device via the network N.

[0290] [8. Other] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0291] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0292] For example, the information processing device 1 described above may be realized by a terminal device and a server computer, or may be realized by multiple server computers. Furthermore, depending on the function, the configuration can be flexibly changed, such as by calling an external platform using an API or network computing.

[0293] Furthermore, the above-described embodiments and modifications can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0294] [9. Effects] As described above, the information processing device 1 according to the embodiment includes a receiving unit 30, a first acquiring unit 40, a second acquiring unit 41, a first generating unit 43, a providing unit 33, and a second generating unit 44. The receiving unit 30 receives input information from a user U for a specific purpose service in a conversational format using a generation AI that generates output information in response to the input information. The first acquiring unit 40 inputs information including the input information received by the receiving unit 30 to the generation AI and acquires output information in response to the input information from the generation AI. The second acquiring unit 41 acquires information in response to the output information acquired by the first acquiring unit 40. The first generating unit 43 generates answer information for the input information based on information in response to the output information acquired by the second acquiring unit 41. The providing unit 33 provides the answer information generated by the first generating unit 43 to the user U. The second generating unit 44 generates a user conversation history to be input to the generation AI as a conversation history between the user U and the user U, based on the output information acquired by the first acquiring unit 40. This allows the information processing device 1 to reduce the amount of information in the conversation history input to the generation AI in a service in which messages are exchanged between the information processing device 1 and the user U in a conversational format.

[0295] Furthermore, the second generation unit 44 generates a generation AI conversation history to be input to the generation AI as the conversation history of the generation AI based on information corresponding to the output information acquired by the second acquisition unit 41. This enables the information processing device 1 to reduce the amount of information in the conversation history to be input to the generation AI.

[0296] Furthermore, the first acquisition unit 40 inputs information including the input information 60 and intention definition information for extracting the intention type and the intention content from the input information 60 to the generation AI, and acquires intention information including information indicating the intention type and information indicating the intention content as output information from the generation AI, the first generation unit 43 generates answer information based on information corresponding to the information indicating the intention type and the information indicating the intention content, and the second generation unit 44 generates a user conversation history based on the information indicating the intention type and the information indicating the intention content. This allows the information processing device 1 to appropriately provide a service for exchanging messages with the user U in a conversational format.

[0297] The first acquiring unit 40 inputs information including definition information defining each of the plurality of functions as intention definition information to the generation AI, and acquires function specifying information including information specifying a function to be used in the generation AI of the answer information from the plurality of functions and information indicating the arguments of the function as intention information from the generation AI. This allows the information processing device 1 to appropriately provide a service for exchanging messages with the user U in a conversational format.

[0298] The functions include a function related to a search API, a function related to a question, and a function related to a reservation API. This allows the information processing device 1 to appropriately provide a service in which messages are exchanged between the information processing device 1 and the user U in a conversational format.

[0299] Furthermore, the functions related to the search API are functions that use the search API, the functions related to questions are functions that use the search API and the generation AI, and the functions related to the reservation API are functions that use the reservation API. This allows the information processing device 1 to appropriately provide a service in which messages are exchanged between the information processing device 1 and the user U in a conversational format.

[0300] The specific purpose service is a restaurant reservation service. This allows the information processing device 1 to appropriately provide a service in which messages are exchanged between the information processing device 1 and the user U in a conversational format.

[0301] Furthermore, the second generating unit 44 generates the conversation history as structured data, which allows the information processing device 1 to appropriately provide a service for exchanging messages with the user U in a conversational format.

[0302] Furthermore, the first acquisition unit 40 extracts a portion of the conversation history, inputs information including the extracted information and the input information 60 accepted by the acceptance unit 30 to the generation AI, and acquires output information corresponding to the input information from the generation AI. This allows the information processing device 1 to appropriately provide a service for exchanging messages with the user U in a conversational format.

[0303] The above describes the embodiments of the present application in detail based on the drawings, but this is merely an example, and the present invention can be implemented in other forms that include the embodiments described in the Disclosure of the Invention section and that have been modified and improved in various ways based on the knowledge of those skilled in the art.

[0304] Furthermore, the above-mentioned "section, module, unit" can be read as "means" or "circuit," etc. For example, an acquisition unit can be read as an acquisition means or an acquisition circuit. [Explanation of symbols]

[0305] 1. Information processing equipment 2,2A Terminal Equipment 3 Generative AI Server 4 Search Server 5 Reservation Server 10. Communications Department 11 Storage section 12 Processing section 20 User information storage unit 21 Dialogue data storage unit 30 Reception 31 Acquisition Department 32 Generation part 33 Providing Department 40 First acquisition part 41 Second acquisition part 42 Third acquisition part 43 1st generation part 44 Second generation part 45 Display control unit 100 Information Processing Systems N Network

Claims

1. a reception unit that receives input information from a user for a specific purpose service in an interactive format using a generation AI that generates output information according to the input information; a first acquisition unit that inputs information including the input information received by the reception unit into the generation AI and acquires output information corresponding to the input information from the generation AI; a second acquisition unit that determines an access target based on the output information acquired by the first acquisition unit, and acquires information corresponding to the output information from the determined access target; a first generation unit that generates answer information to the input information based on information corresponding to the output information acquired by the second acquisition unit; a providing unit that provides the answer information generated by the first generating unit to the user; a second generation unit that generates a user conversation history to be input to the generation AI as a conversation history with the user based on the output information acquired by the first acquisition unit.

1. An information processing device comprising:

2. The second generation unit Based on information corresponding to the output information acquired by the second acquisition unit, a generated AI conversation history is generated to be input to the generated AI as a conversation history of the generated AI.

2. The information processing apparatus according to claim 1, wherein:

3. The first acquisition unit inputting information including the input information and intention definition information for extracting an intention type and an intention content from the input information into the generation AI, and obtaining intention information including information indicating the intention type and information indicating the intention content from the generation AI as the output information; The first generation unit generating the response information based on information corresponding to the information indicating the intention type and the information indicating the intention content; The second generation unit The user conversation history is generated based on the information indicating the intention type and the information indicating the intention content.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

4. The first acquisition unit Information including definition information defining each of a plurality of functions is input to the generating AI as the intention definition information, and function specification information including information specifying a function from the plurality of functions to be used in generating the answer information and information indicating an argument of the function is obtained from the generating AI as the intention information.

4. The information processing apparatus according to claim 3,

5. The plurality of functions are: Includes search functions, question functions, and reservation functions 5. The information processing apparatus according to claim 4,

6. The function for the search is: A function that uses the search API: The function for the question is: a function that uses the search API and the generation AI, The reservation function is: This is a function that uses the reservation API.

6. The information processing apparatus according to claim 5,

7. The specific purpose service is It is a restaurant reservation service.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

8. The second generation unit The conversation history is generated as structured data.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

9. The first acquisition unit A part of the conversation history is extracted, and information including the extracted information and the input information accepted by the accepting unit is input to the generating AI, and output information corresponding to the input information is obtained from the generating AI.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

10. 1. A computer-implemented information processing method, comprising: a receiving step of receiving input information from a user for a specific purpose service in an interactive format using a generation AI that generates output information according to the input information; a first acquisition step of inputting information including the input information received by the receiving step into the generation AI and acquiring output information corresponding to the input information from the generation AI; a second acquisition step of determining an access target based on the output information acquired by the first acquisition step, and acquiring information corresponding to the output information from the determined access target; a first generation step of generating response information to the input information based on information corresponding to the output information acquired in the second acquisition step; a providing step of providing the answer information generated by the first generating step to the user; and a second generation step of generating a user conversation history to be input to the generation AI as a conversation history with the user based on the output information acquired by the first acquisition step.

1. An information processing method comprising:

11. An acceptance procedure for accepting user input information for a specific purpose service in an interactive format using a generation AI that generates output information according to the input information; a first acquisition step of inputting information including the input information received by the reception step into the generation AI and acquiring output information corresponding to the input information from the generation AI; a second acquisition step of determining an access target based on the output information acquired by the first acquisition step, and acquiring information corresponding to the output information from the determined access target; a first generation step of generating response information to the input information based on information corresponding to the output information acquired by the second acquisition step; a providing step of providing the answer information generated by the first generating step to the user; and a second generation step of generating a user conversation history to be input to the generation AI as a conversation history with the user based on the output information acquired by the first acquisition step. An information processing program characterized by:

Images