Program, computer, system, and information processing method

Abstract

To provide a program, a computer, a system, and an information processing method configured to generate an input text based on information according to an action of a user, thereby improving flexibility of answers.SOLUTION: Receiving means 52 receives action information related to an action performed by a user on an application screen, out of the application screen displayed on a user terminal 10 and a chatbot screen which is a screen for chatbot operation and different from the application screen. Input text generation means 54 generates an input text according to the action, based on the action information received by the receiving means 52. Answer acquisition means 55 acquires information on an answer to the input text generated by the input text generation means 54.SELECTED DRAWING: Figure 11

Description

[Technical Field]

[0001] The present disclosure relates to a program, a computer, a system, and an information processing method related to a chatbot. [Background technology]

[0002] Chatbots are computer programs that can converse with humans in natural language and are used in a wide range of fields, including customer service, information search, education, and entertainment. In recent years, the use of artificial intelligence and other technologies has enabled chatbots to perform more complex tasks and provide more natural and fluent interactions with humans. Patent Document 1 discloses a method for acquiring suggested response items based on user input or events in an embedded application and providing corresponding commands. Specifically, the method disclosed in Patent Document 1 displays suggested response items between user devices based on events occurring in chat or an embedded application, and provides related commands. Furthermore, the suggested response items are displayed in a chat interface or an embedded interface, and specific commands can be executed according to a user's selection. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6718028 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional chatbots could only provide answers based on a database that stores combinations of user input sentences and answers, which meant that they had limited flexibility in their answers.

[0005] The present disclosure has been made in consideration of these points, and aims to provide a program, computer, system, and information processing method that can increase the flexibility of responses by creating input sentences based on information corresponding to the user's actions. [Means for solving the problem]

[0006] The program disclosed herein is a program that causes a control unit of a computer to function as a receiving unit, an input sentence generating unit, an answer obtaining unit, and a sending unit, the receiving means receives action information regarding an action performed by a user on an application screen displayed on the user terminal and a chatbot screen that is a screen for operating a chatbot and is different from the application screen; the input sentence generation means generates an input sentence according to the action based on the action information received by the reception means; the answer acquisition means acquires information about an answer to the input sentence generated by the input sentence generation means, The transmitting means is characterized in that it transmits to the user terminal display information for displaying the answer acquired by the answer acquiring means on the chatbot screen.

[0007] In the program of the present disclosure, The answer acquisition means may acquire information about the answer by transmitting the input sentence generated by the input sentence generation means to a large-scale language model and receiving from the large-scale language model the answer to the input sentence calculated by the large-scale language model.

[0008] Furthermore, when consent to the use of the chatbot is input into the user terminal, an action detection program that detects the action performed by the user on the user terminal is executed on the user terminal, The action information regarding the action performed by the user on the application screen, which is detected by the action detection program, may be transmitted from the user terminal to the computer.

[0009] Further, the action is an action in which the user selects an image displayed on the application screen and drops it onto the chatbot screen, The input sentence generation means may, when detecting the dropping action, obtain a base answer to a pre-input sentence generated based on the dropped image and the action information, and generate the input sentence based on the base answer and the action information.

[0010] In addition, the input sentence generation means may, when detecting the dropping action, send the pre-input sentence generated based on the dropped image and the action information to a first database server, and obtain information on the base answer by receiving from the first database server the base answer to the pre-input sentence extracted by the first database server.

[0011] The transmitting means transmits to the user terminal an instruction requesting approval of the base answer acquired by the input sentence generating means, The input sentence generation means may, upon receiving information regarding approval of the base answer from the user terminal, generate the input sentence based on the approved base answer and the action information.

[0012] The input sentence generation means may further acquire specification information of the user terminal, and generate the input sentence by referring to the specification information in addition to the base answer and the action information.

[0013] Furthermore, the action is an action in which the user accesses a second database server that stores information displayed on the application screen, The input sentence generation means may acquire the action information regarding the action to be accessed and information stored in the second database server to be accessed based on the content entered by the user on the chatbot screen, and generate the input sentence based on the content entered by the user, the action information, and the information stored in the second database server to be accessed.

[0014] Furthermore, the type of database to be accessed from among a plurality of types of databases may be determined depending on the type of action.

[0015] The control unit further functions as a user information acquisition unit, the user information acquisition means acquires information about the user from the user terminal; The input sentence generation means may generate the input sentence according to the action by referring to information about the user acquired by the user information acquisition means in addition to the action information accepted by the acceptance means.

[0016] In addition, the answer acquisition means may acquire information about the answer by sending the input sentence generated by the input sentence generation means to a third database server in which data on the set input sentence and the set answer are stored in association with each other, and receiving from the third database server the answer corresponding to the input sentence extracted based on the data on the set input sentence and the set answer stored in the third database server.

[0017] The computer further includes a storage unit in which data of the input sentence and the answer are stored in association with each other, The answer acquisition means may acquire information on the answer corresponding to the input sentence based on data on the set input sentence and the set answer stored in the storage unit.

[0018] The control unit further functions as a learning unit, the learning means transmits to an administrator terminal an instruction to inquire about the content of the input sentence corresponding to the content of the action in the action information received by the receiving means, and performs learning by associating the content of the input sentence received from the administrator terminal with the content of the action; When the receiving means receives the action information, the input sentence generating means may generate the input sentence corresponding to the action based on the content of learning performed by the learning means.

[0019] In addition, the input sentence generation means may generate a plurality of input sentences according to the action, and display the generated plurality of input sentences on the user terminal, thereby making it possible to select one of the plurality of input sentences or to create a new input sentence on the user terminal.

[0020] The program disclosed herein causes a control unit of a computer to function as a receiving unit, an input sentence generating unit, an answer obtaining unit, and a sending unit, the accepting means accepts action information relating to an action performed by a user at a user terminal; the input sentence generation means generates an input sentence according to the action based on the action information received by the reception means; the answer acquisition means acquires information about an answer to the input sentence generated by the input sentence generation means, the transmitting means transmits to the user terminal display information for displaying the answer acquired by the answer acquiring means on a chatbot screen; When consent to the use of the chatbot is input into the user terminal, an action detection program is executed in the user terminal to detect actions other than input to the chatbot made by the user of the user terminal, The action information regarding the actions other than input to the chatbot made by the user, detected by the action detection program, is transmitted from the user terminal to the computer.

[0021] The computer of the present disclosure is a computer in which a control unit functions as a receiving means, an input sentence generating means, an answer obtaining means, and a sending means by executing a program, the receiving means receives action information regarding an action performed by a user on an application screen displayed on the user terminal and a chatbot screen that is a screen for operating a chatbot and is different from the application screen; the input sentence generation means generates an input sentence according to the action based on the action information received by the reception means; the answer acquisition means acquires information about an answer to the input sentence generated by the input sentence generation means, The transmitting means is characterized in that it transmits to the user terminal display information for displaying the answer acquired by the answer acquiring means on the chatbot screen.

[0022] The computer of the present disclosure is a computer in which a control unit functions as a receiving means, an input sentence generating means, an answer obtaining means, and a sending means by executing a program, the accepting means accepts action information relating to an action performed by a user at a user terminal; the input sentence generation means generates an input sentence according to the action based on the action information received by the reception means; the answer acquisition means acquires information about an answer to the input sentence generated by the input sentence generation means, the transmitting means transmits to the user terminal display information for displaying the answer acquired by the answer acquiring means on a chatbot screen; When consent to the use of the chatbot is input into the user terminal, an action detection program is executed in the user terminal to detect actions other than input to the chatbot made by the user of the user terminal, The action information regarding the actions other than input to the chatbot made by the user, detected by the action detection program, is transmitted from the user terminal to the computer.

[0023] The system of the present disclosure comprises: a web server for displaying a website on a user terminal; a computer in which a control unit functions as a receiving means, an input sentence generating means, an answer acquiring means, and a sending means by executing a program; A system comprising: the receiving means receives action information regarding an action performed by a user on an application screen of the website displayed on the user terminal and a chatbot screen that is a screen for operating a chatbot and is different from the application screen; the input sentence generation means generates an input sentence according to the action based on the action information received by the reception means; the answer acquisition means acquires information about an answer to the input sentence generated by the input sentence generation means, The transmitting means is characterized in that it transmits to the user terminal display information for displaying the answer acquired by the answer acquiring means on the chatbot screen.

[0024] The system of the present disclosure comprises: a web server for displaying a website on a user terminal; a computer in which a control unit functions as a receiving means, an input sentence generating means, an answer acquiring means, and a sending means by executing a program; A system comprising: the accepting means accepts action information regarding an action taken by a user on the website at the user terminal; the input sentence generation means generates an input sentence according to the action based on the action information received by the reception means; the answer acquisition means acquires information about an answer to the input sentence generated by the input sentence generation means, the transmitting means transmits to the user terminal display information for displaying the answer acquired by the answer acquiring means on a chatbot screen; When consent to the use of the chatbot is input into the user terminal, an action detection program is executed in the user terminal to detect actions other than input to the chatbot made by the user of the user terminal, The action information regarding the actions other than input to the chatbot made by the user, detected by the action detection program, is transmitted from the user terminal to the computer.

[0025] The information processing method of the present disclosure includes: An information processing method executed by a computer having a control unit, The control unit receives action information regarding an action performed by a user on an application screen displayed on the user terminal, the application screen being a screen for operating a chatbot and different from the application screen; generating an input sentence corresponding to the action based on the received action information by the control unit; a step of the control unit acquiring information of a generated response to the input sentence; a step of the control unit transmitting information of the acquired answer to the user terminal; The present invention is characterized by the following features.

[0026] The information processing method of the present disclosure includes: An information processing method executed by a computer having a control unit, a step of receiving action information relating to an action performed by a user on a user terminal by the control unit; generating an input sentence corresponding to the action based on the received action information by the control unit; a step of the control unit acquiring information of a generated response to the input sentence; a step in which the control unit transmits display information for displaying the acquired answer on a chatbot screen to the user terminal; Equipped with When consent to the use of the chatbot is input into the user terminal, an action detection program is executed in the user terminal to detect actions other than input to the chatbot made by the user of the user terminal, The action information regarding the actions other than input to the chatbot made by the user, detected by the action detection program, is transmitted from the user terminal to the computer. [Effects of the Invention]

[0027] According to the program, computer, system, and information processing method disclosed herein, the flexibility of responses can be increased by creating an input sentence based on information corresponding to the user's actions. [Brief explanation of the drawings]

[0028] [Figure 1] 1 is a block diagram illustrating a configuration of a system according to an embodiment of the present disclosure. [Figure 2] 2 is a block diagram showing the configuration of a user terminal in the system shown in FIG. 1. FIG. [Figure 3] 2 is a block diagram showing the configuration of a tag management server in the system shown in FIG. 1. FIG. [Figure 4]FIG. 2 is a block diagram showing the configuration of a web server in the system shown in FIG. [Figure 5] 2 is a block diagram showing the configuration of a second database server in the system shown in FIG. 1. [Figure 6] 2 is a block diagram showing the configuration of a chat server in the system shown in FIG. 1. [Figure 7] FIG. 2 is a block diagram showing the configuration of a language model server in the system shown in FIG. [Figure 8] 2 is a block diagram showing the configuration of a first database server in the system shown in FIG. 1. FIG. [Figure 9] FIG. 2 is a chart showing the flow of information between the components in the system shown in FIG. 1 when a user agrees to use a chatbot on a user terminal. [Figure 10] 2 is a chart showing the flow of information between the components in the system shown in FIG. 1 when an action is detected at a user terminal. [Figure 11] 2 is a flowchart showing the operation of a chat server in the system shown in FIG. [Figure 12] 2 is a diagram showing the contents of a screen displayed on a display unit of a user terminal in the system shown in FIG. 1. FIG. [Figure 13] 2 is a diagram showing the contents of a screen displayed on a display unit of a user terminal in the system shown in FIG. 1. FIG. [Figure 14] 2 is a diagram showing the contents of a screen displayed on a display unit of a user terminal in the system shown in FIG. 1. FIG. [Figure 15] 2 is a diagram showing the contents of a screen displayed on a display unit of a user terminal in the system shown in FIG. 1. FIG. [Figure 16] 2 is a diagram showing the contents of a screen displayed on a display unit of a user terminal in the system shown in FIG. 1. FIG. DETAILED DESCRIPTION OF THE INVENTION

[0029] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. Figures 1 to 11 are diagrams showing a system 1 according to this embodiment and the components of this system 1. Figures 12 to 16 are diagrams showing the contents of a screen displayed on a display unit of a user terminal in the system shown in Figure 1.

[0030] [Overall configuration of System 1] As shown in FIG. 1, the system 1 of this embodiment includes a tag management server 20, a web server 30, a second database server 40, a chat server 50, a language model server 60 (large-scale language model), a first database server 70, an administrator terminal 80, and a third database server 90. The system 1 of this embodiment enables a user to use a chatbot in a browser on a user terminal 10, such as a personal computer, a PC tablet, or a smartphone owned by a user. The tag management server 20 is communicatively connected to the user terminal 10 via a communication network such as the Internet. The web server 30 is communicatively connected to each of the user terminal 10 and the second database server 40 via a communication network such as the Internet. The chat server 50 is communicatively connected to each of the user terminal 10, the language model server 60, the first database server 70, the administrator terminal 80, and the third database server 90 via a communication network such as the Internet. Each component of the system 1 and the user terminal 10 will be described in detail below.

[0031] [Configuration of user terminal 10] The configuration of the user terminal 10 will be described with reference to Fig. 2. As described above, the user terminal 10 includes, but is not limited to, a personal computer, a PC tablet, a smartphone, etc. As shown in Fig. 2, the user terminal 10 has a control unit 11, a display unit 13, an operation unit 14, an imaging unit 15, a microphone 16, a storage unit 18, and a communication unit 19. The control unit 11 is connected to each of the display unit 13, the operation unit 14, the imaging unit 15, the microphone 16, the storage unit 18, and the communication unit 19 via a bus 11a.

[0032] The control unit 11 is composed of a microcomputer including a CPU and semiconductor memory, and controls the operation of the user terminal 10 by executing programs stored in the storage unit 18. The display unit 13 is composed of, for example, a liquid crystal display, and functions as a means for displaying various information. The display unit 13 displays various information in response to instructions from the control unit 11. The operation unit 14 functions as a means for inputting various instructions by the user. For example, a keyboard, a mouse, a touch panel, etc. are used as the operation unit 14. When the operation unit 14 is a touch panel, such a touch panel is superimposed on the display unit 13, and an operation signal is input to the control unit 11 when the user touches the touch panel.

[0033] The imaging unit 15 is, for example, a camera, and captures an image or video by capturing an object. The microphone 16 converts voices emitted by the user and sound waves in the air around the user terminal 10 into electrical signals. The storage unit 18 is composed of a hard disk drive (HDD), random access memory (RAM), read-only memory (ROM), solid state drive (SSD), or the like. The storage unit 18 stores programs executed by the control unit 11. The storage unit 18 also stores information input by the user via the operation unit 14, images and videos captured by the imaging unit 15, electrical signals converted from sound waves by the microphone 16, and the like. The communication unit 19 includes a communication interface that transmits and receives various data between the control unit 11 and external devices such as the tag management server 20, the web server 30, and the chat server 50 via a communication network.

[0034] [Configuration of tag management server 20] The configuration of the tag management server 20 will be described with reference to FIG. 3. The tag management server 20 is a platform that can manage website tags by combining predetermined commands without directly writing code, and it can cause the user terminal 10 to execute JavaScript as an action detection program. Specifically, by entering code that accesses the tag management server 20 into a website displayed on the display unit 13 of the user terminal 10, action detection and chatbot execution via the tag management server 20 are possible. For example, by executing JavaScript as an action detection program obtained from the tag management server 20 on the user terminal 10, specific actions on the user terminal 10 are detected, and information about the detected action is transmitted to the chat server 50. Note that the action detection program, such as JavaScript, executed by the user terminal 10 detects actions other than inputs to a chatbot by the user on the user terminal 10. As shown in FIG. 3, the tag management server 20 includes a control unit 21, a memory unit 28, and a communication unit 29. The control unit 21 is connected to the memory unit 28 and the communication unit 29 via a bus 21a.

[0035] The control unit 21 is configured by a computer including a CPU and a semiconductor memory, and controls the operation of the tag management server 20 by executing a program stored in the storage unit 28. Specifically, the control unit 21 functions as a receiving means 22 and a transmitting means 23 by executing a program stored in the storage unit 28. When the receiving means 22 receives access from the user terminal 10, the transmitting means 23 transmits tag information to the user terminal 10 that is the sender of the access information.

[0036] The storage unit 28 is configured with an HDD, RAM, ROM, SSD, etc. The storage unit 28 stores a program executed by the control unit 21. The storage unit 28 also stores tag information to be transmitted to the user terminal 10.

[0037] The communication unit 29 includes a communication interface that transmits and receives various data between the control unit 21 and the user terminal 10 via a communication network.

[0038] [Configuration of Web Server 30] The configuration of the web server 30 will be described with reference to FIG. 4. The web server 30 is managed by a business (client) that sells products or provides services to users. The web server 30 displays websites for selling products or providing services on a browser or the like displayed on the display unit 13 of the user terminal 10. Websites displayed on the display unit 13 of the user terminal 10 by the web server 30 include various sites, such as e-commerce sites and accommodation reservation sites. When a chatbot is running on a website, the display unit 13 of the user terminal 10 accessing the website includes an application screen and a chatbot screen, which is a screen for operating the chatbot and is different from the application screen. The application screen refers to a display area that displays content different from the chatbot on the website accessed by the user. The chatbot screen refers to a display area on the website where the chatbot is displayed. The chatbot screen may be displayed on the website or elsewhere. Specifically, the window displaying the website may have both an application display area and a chatbot display area, or two windows may be displayed on the display unit 13: one displaying the application screen and the other displaying the chatbot screen.

[0039] As shown in FIG. 4, the web server 30 includes a control unit 31, a storage unit 38, and a communication unit 39. The control unit 31 is connected to the storage unit 38 and the communication unit 39 via a bus 31a. The control unit 31 is configured as a microcomputer including a CPU and a semiconductor memory, and controls the operation of the web server 30 by executing a program stored in the storage unit 38. Specifically, the control unit 31 functions as a reception unit 32 and a transmission unit 33 by executing the program stored in the storage unit 38. When the reception unit 32 receives URL information from the user terminal 10, the transmission unit 33 transmits to the user terminal 10 a display instruction for a website corresponding to the URL information received by the reception unit 32 and stored in the storage unit 38. This causes the website to be displayed in a browser or the like displayed on the display unit 13 of the user terminal 10. Furthermore, when a user inputs consent to use of the chatbot on the user terminal 10, the reception unit 32 receives consent information from the user terminal 10. The consent information is information indicating that the user has consented. When the receiving means 32 receives the consent information, the transmitting means 33 transmits to the user terminal 10 an instruction to display a chatbot screen and an instruction to access the tag management server 20. As a result, the chatbot screen is displayed on the website displayed on the display unit 13 of the user terminal 10. Furthermore, when the receiving means 32 receives login information from the user terminal 10, it transmits access information to the second database server 40.

[0040] The storage unit 38 is configured with an HDD, RAM, ROM, SSD, etc. The storage unit 38 stores programs executed by the control unit 31. The storage unit 38 also stores various website information (specifically, HTML information that constructs websites, etc.) in association with URL information.

[0041] The communication unit 39 includes a communication interface that transmits and receives various data between the control unit 31, the user terminal 10, and the second database server 40 via a communication network.

[0042] [Configuration of the second database server 40] The configuration of the second database server 40 will be described with reference to FIG. 5. The second database server 40 is managed by a client and stores a membership database, product information, service information, and the like related to the client's web server. The membership database, product information, service information, and the like stored in the second database server 40 are linked to each website. For example, if the website displayed on the display 13 of the user terminal 10 by the web server 30 is an e-commerce site, the membership database uses the name, address, telephone number, past product purchase history, and e-commerce site browsing history of the user of the e-commerce site. Also, if the website displayed on the display 13 of the user terminal 10 by the web server 30 is an e-commerce site, the product information uses the name, specification information, sales price, past sales quantity, and the like of the product sold on the e-commerce site. Also, if the website displayed on the display 13 of the user terminal 10 by the web server 30 is an accommodation reservation site, the membership database uses the name, address, telephone number, past accommodation usage history, and browsing history of the accommodation reservation site of the user of the accommodation reservation site. Furthermore, if the website displayed on the display unit 13 of the user terminal 10 by the web server 30 is a reservation site for accommodations, the service information used may include the names, addresses, website URLs, and accommodation prices of accommodations available for reservation on the reservation site. Although only one second database server 40 is illustrated in FIG. 1, multiple types of second database servers 40 may be communicatively connected to the web server 30, and the type of second database server 40 to be accessed may be determined from the multiple types of second database servers 40 depending on the type of user action (described later). As shown in FIG. 5, the second database server 40 includes a control unit 41, a memory unit 48, and a communication unit 49. The control unit 41 is connected to each of the memory unit 48 and the communication unit 49 via a bus 41a.

[0043] The control unit 41 is configured by a microcomputer including a CPU and semiconductor memory, and controls the operation of the second database server 40 by executing a program stored in the storage unit 48. Specifically, the control unit 41 functions as a reception means 42 and a transmission means 43 by executing a program stored in the storage unit 48. When the reception means 42 receives access information from the web server 30, the transmission means 43 transmits the user's personal information, product information, service information, etc. to the web server 30 based on the member database, product information, service information, etc. stored in the storage unit 48.

[0044] The storage unit 48 is composed of an HDD, RAM, ROM, SSD, etc. The storage unit 48 stores programs executed by the control unit 41. The storage unit 48 also stores a member database, product information, service information, etc. linked to each website.

[0045] The communication unit 49 includes a communication interface for transmitting and receiving various data between the control unit 41 and the web server 30 via a communication network.

[0046] [Configuration of chat server 50] The configuration of chat server 50 will be described with reference to Fig. 6. Chat server 50 is managed by a business (administrator) that provides chatbot services, and manages chatbots on a website displayed on display unit 13 of user terminal 10. As shown in Fig. 6, chat server 50 has control unit 51, storage unit 58, and communication unit 59. Control unit 51 is connected to each of storage unit 58 and communication unit 59 via bus 51a.

[0047] The control unit 51 is configured by a microcomputer including a CPU and a semiconductor memory, and controls the operation of the chat server 50 by executing a program stored in the storage unit 58. Specifically, the control unit 51 functions as a reception unit 52, a user information acquisition unit 53, an input sentence generation unit 54, a response acquisition unit 55, and a transmission unit 56 by executing the program stored in the storage unit 58. The reception unit 52 receives action information and the like from the user terminal 10. The user information acquisition unit 53 acquires information about the user from the user terminal 10. The input sentence generation unit 54 generates an input sentence corresponding to the action based on the action information and the like received by the reception unit 52. The response acquisition unit 55 acquires information about a response to the input sentence generated by the input sentence generation unit 54. The transmission unit 56 transmits display information to the user terminal 10 for displaying the response acquired by the response acquisition unit 55 on the chatbot screen. The functions of these units 52, 53, 54, 55, and 56 will be described in detail below.

[0048] The storage unit 58 is configured with a HDD, RAM, ROM, SSD, etc. The storage unit 58 stores programs executed by the control unit 51.

[0049] The communication unit 59 includes a communication interface that transmits and receives various data between the control unit 51 and each of the user terminal 10, the language model server 60, the first database server 70, the administrator terminal 80, and the third database server 90 via a communication network.

[0050] [Configuration of the language model server 60] The configuration of the language model server 60 will be described with reference to FIG. 7 . The language model server 60 is designed to generate responses quickly in response to requests from the chat server 50 using, for example, a large-scale language model (LLM). The large-scale language model is a machine learning model for natural language processing, capable of generating sentences based on input information. For example, the large-scale language model is a machine learning model based on a Transformer model with a self-attention mechanism. The Transformer model is, for example, a Generative Pre-trained Transformer (GPT) model. The large-scale language model is trained using a large dataset, enabling general-purpose sentence generation tasks. For example, the large-scale language model may be a model trained using a large dataset using the GPT-3 or GPT-4 algorithm developed by OpenAI (registered trademark) (e.g., a GPT model generated by combining training using a large dataset and reinforcement learning using a reward prediction model). The language model server 60 hosts models, invokes them in response to requests, and returns results. The language model server 60 is also designed to reuse models once trained. As shown in Fig. 7, the language model server 60 has a control unit 61, a storage unit 68, and a communication unit 69. The control unit 61 is connected to each of the storage unit 68 and the communication unit 69 via a bus 61a. The language model server 60 is also designed to be able to vectorize input sentences using a vector conversion model and output vector values. The vector conversion model is a machine learning model that converts input sentences into coordinate information in multiple dimensions (e.g., 1536 dimensions) based on parameters generated by learning. For example, the vector conversion model is the embedding API model developed by OpenAI (registered trademark).

[0051] The control unit 61 is configured by a microcomputer including a CPU and a semiconductor memory, and controls the operation of the language model server 60 by executing a program stored in the storage unit 68. Specifically, the control unit 61 functions as a receiving means 62, a response generating unit 63, and a sending means 64 by executing the program stored in the storage unit 68. When the receiving means 62 receives an input sentence from the chat server 50, the response generating unit 63 generates a response using, for example, OpenAI (registered trademark), and the sending means 64 sends the generated response to the chat server 50.

[0052] The storage unit 68 is configured with an HDD, RAM, ROM, SSD, etc. The storage unit 68 stores a program executed by the control unit 61. The storage unit 68 also stores a huge amount of learned data.

[0053] The communication unit 69 includes a communication interface that transmits and receives various data between the control unit 61 and the chat server 50 via a communication network.

[0054] [Configuration of the first database server 70] The configuration of the first database server 70 will be described with reference to FIG. 8. The first database server 70 is managed by a business operator (administrator) that provides chatbot services, and stores vector values ​​vectorized by the language model server 60. A vector value refers to coordinate information in multiple dimensions (e.g., 1,536 dimensions). For example, a vector value is a feature that indicates magnitude and direction in multiple dimensions. As shown in FIG. 8, the first database server 70 includes a control unit 71, a storage unit 78, and a communication unit 79. The control unit 71 is connected to each of the storage unit 78 and the communication unit 79 via a bus 71a. For example, the vector values ​​stored in the first database server 70 are values ​​obtained by converting prepared anticipated questions into vector values ​​by the language model server 60. The first database server 70 also stores pairs of anticipated questions converted into vector values ​​and base answers that are anticipated answers to the anticipated questions. The vector values ​​stored in the first database server 70 may be vector values ​​vectorized by an information processing device other than the language model server 70.

[0055] The control unit 71 is configured as a computer including a CPU and semiconductor memory, and controls the operation of the first database server 70 by executing a program stored in the storage unit 78. Specifically, the control unit 71 functions as a receiving unit 72 and a transmitting unit 73 by executing a program stored in the storage unit 78. When the receiving unit 72 receives a vector search request from the chat server 50, the transmitting unit 73 transmits to the chat server 50 a base answer corresponding to an approximate value of the vector value based on the vector value stored in the storage unit 78. Here, the vector search is a process of calculating the distance between pieces of information contained in the vectors to calculate the approximate value. For example, the vector search is a process of determining the cosine similarity between the vector value to be searched included in the vector search request and multiple stored vector values, and transmitting the base answer that is the pair of vector values ​​with the highest cosine similarity as the search result to the chat server 50.

[0056] The storage unit 78 is configured with a HDD, RAM, ROM, SSD, etc. The storage unit 78 stores a program executed by the control unit 71. The storage unit 78 also stores base answers and vector values ​​in an associated state.

[0057] The communication unit 79 includes a communication interface that transmits and receives various data between the control unit 71 and the chat server 50 via a communication network.

[0058] The configurations of the administrator terminal 80 and the third database server 90 will be described in detail later.

[0059] [System 1 operation] Next, the operation of the system 1 according to this embodiment will be described with reference to Figs. 9 to 16. Fig. 9 is a chart showing the flow of information between the components when a user agrees to use a chatbot on the user terminal 10 in the system 1 shown in Fig. 1, and Fig. 10 is a chart showing the flow of information between the components when an action is detected on the user terminal 10 in the system 1 shown in Fig. 1. Fig. 11 is a flowchart showing the operation of the chat server 50 in the system 1 shown in Fig. 1. Figs. 12 to 16 are diagrams showing the contents of the screens displayed on the display unit 13 of the user terminal 10 in the system 1 shown in Fig. 1, respectively.

[0060] First, the flow of information between the components of the system 1 shown in FIG. 1 when a user agrees to use a chatbot on the user terminal 10 will be described with reference to FIG.

[0061] When a user accesses a predetermined website using a browser or the like displayed on the display unit 13 of the user terminal 10, the receiving means 32 of the web server 30 receives URL information of the predetermined website from the user terminal 10. The transmitting means 33 transmits to the user terminal 10 a display instruction for the website stored in the memory unit 38 and corresponding to the URL information received by the receiving means 32. As a result, the predetermined website is displayed on the browser or the like displayed on the display unit 13 of the user terminal 10. Furthermore, when the user agrees to use the chatbot on this website, consent information is transmitted from the user terminal 10 to the web server 30. When the receiving means 32 of the web server 30 receives the consent information from the user terminal 10, the transmitting means 33 transmits to the user terminal 10 an instruction to display a chatbot screen and a command to access the tag management server 20. As a result, the chatbot screen is displayed on the website displayed on the display unit 13 of the user terminal 10. Note that if the user does not agree to use the chatbot on the website displayed on the display unit 13 of the user terminal 10, the chatbot screen will not be displayed on the website. Furthermore, an access command to the tag management server 20 is transmitted to the user terminal 10, thereby allowing the user terminal 10 to access the tag management server 20. When the reception means 22 of the tag management server 20 receives access from the user terminal 10, the transmission means 23 transmits tag information (e.g., information including an action detection program) to the user terminal 10, which is the sender of the access information. Then, when the tag information transmitted from the tag management server 20 to the user terminal 10 is read by the user terminal 10, communication between the user terminal 10 and the chat server 50 becomes possible. Specifically, JavaScript, which serves as the action detection program acquired from the tag management server 20, is executed by the user terminal 10, thereby detecting a specific action in the user terminal 10 and transmitting information about the detected action to the chat server 50. Furthermore, the chatbot displayed on the website is executed.

[0062] When a user logs in to their personal page on a specific website displayed on the display unit 13 of the user terminal 10 by, for example, entering a login ID and password, the login information is sent from the user terminal 10 to the web server 30, allowing the user to access their personal page. When the accepting means 32 of the web server 30 accepts the login information, the transmitting means 33 sends access information to the second database server 40, thereby enabling the user to access the member database, product information, service information, etc. linked to the website in the second database server 40. In this way, when the web server 30 acquires the user's personal information, product information, and service information from the second database server 40, the information is encrypted using a public key issued by the operator (administrator) providing the chatbot service. The user's personal information, product information, etc. encrypted by the web server 30 are sent to the user terminal 10. The operation of encrypting the user's personal information, product information, service information, etc. acquired from the second database server 40 by the web server 30 and transmitting the information to the user terminal 10 as described above may be performed when a user action, which will be described later, is detected, or may be performed in advance before the action is detected. Performing the operation in advance before the action is detected has the advantage that the series of processes can be performed quickly, but it also has the problem that the capacity of the storage unit 18 of the user terminal 10 must be increased because the encrypted user's personal information, product information, etc. must be stored in the storage unit 18.

[0063] Next, the flow of information between the components and the operation of the chat server 50 when an action is detected by the user terminal 10 in the system 1 shown in FIG. 1 will be described with reference to FIGS.

[0064] When a user performs a specific action on a website displayed on the display unit 13 of the user terminal 10, JavaScript, an action detection program provided by the tag management server 20 and executed on the user terminal 10, detects the specific action on the user terminal 10 and transmits the detected action information to the chat server 50. Here, specific actions include actions such as selecting specific text, images, or videos on a website displayed on the user terminal 10, selecting a specific image on a website displayed on the user terminal 10 and dropping it onto the chatbot screen, accessing a database storing information displayed on an application screen, scrolling a website on the browser, and transitioning from one website to another on the browser. The action of selecting an image or video also includes hovering the pointer over an image or video. User actions detected by JavaScript include a first action, which is detected even if the user does not enter any questions or other information on the chatbot screen, and a second action, which is detected when the user enters a question or other information on the chatbot screen after performing a predetermined action. Details of these first and second actions will be described later. Note that the user actions detected by JavaScript are not limited to those described above, but include various other actions. When a user action is detected by JavaScript, the action information, the user's personal information, product information, etc. encrypted by the web server 30 are sent to the chat server 50.

[0065] When the user terminal 10 and the chat server 50 are in a communicable state ("YES" in step S1 of FIG. 11), the receiving means 52 of the chat server 50 receives action information, etc. ("YES" in step S2 of FIG. 11), and generates a pre-input sentence from the received action information, etc. based on predetermined pre-input generation information. The transmitting means 56 of the chat server 50 transmits an instruction to the language model server 60 to vectorize the pre-input sentence (step S3 of FIG. 11). When the receiving means 62 of the language model server 60 receives the instruction, the answer generating unit 63 obtains a vector value by vectorizing the pre-input sentence. The transmitting means 64 of the language model server 60 transmits the vector information (specifically, the vector value) generated by the answer generating unit 63 to the chat server 50. As a result, when the receiving means 52 of the chat server 50 receives vector information (step S4 in FIG. 11 ), the transmitting means 56 transmits to the first database server 70 a vector search request to search the first database server 70 for vector values ​​that approximate the vector values ​​of the pre-input sentence generated by the language model server 60 (step S5 in FIG. 11 ). When the receiving means 72 of the first database server 70 receives the vector search request from the chat server 50, it extracts, from the vector values ​​stored in the storage unit 78, those that approximate the vector values ​​in the received vector search request, and the transmitting means 73 of the first database server 70 transmits a base answer corresponding to this approximate value to the chat server 50. As a result, the receiving means 52 of the chat server 50 receives, from the first database server 70, a base answer that approximates the vector value transmitted from the language model server 60 (step S6 in FIG. 11 ). In another embodiment, the control unit 51 of the chat server 50 may determine information necessary for a base answer based on predetermined pre-input generation information from the user's actions detected by JavaScript and the content of the question entered by the user on the chatbot screen, and may request and acquire the information necessary for the base answer (encrypted user personal information, product information, etc.) from the user terminal 10. The pre-input generation information is information including rules, etc. necessary for generating a pre-input sentence based on the accepted action.For example, the pre-input generation information is a rule that, when the received action is "an action in which a user selects an image displayed on an application screen and drops the image onto a chatbot screen," reads a predetermined sentence, such as "Please tell me information about {image}," from the content of the action, obtains metadata of the dropped image (e.g., part name A), combines it with the sentence, and generates a pre-input sentence, such as "Please tell me information about part name A." Note that the information may be a rule-based model or a machine learning model. For example, a large-scale language model may be previously stored with the information, "The action of dropping an image determines that the user wants to know information about the image," and the large-scale language model may be input with the following input to generate a pre-input sentence: "Action content (the user performed an action to drop an image), the metadata of the image dropped into the action content is 'part name A', generate a possible question for the user."

[0066] Furthermore, in the chat server 50, the control unit 51 decrypts the encrypted information using an encryption key issued by the business (administrator) that provides the chatbot service (step S7 in FIG. 11 ). In this way, the user information acquisition means 53 acquires the user's personal information. Note that information such as the specifications of the user terminal 10 itself may be acquired by JavaScript executed on the user terminal 10, and the acquired information may be transmitted from the user terminal 10 to the chat server 50 by JavaScript, thereby allowing the user information acquisition means 53 to acquire information such as the specifications of the user terminal 10 itself. Then, the input sentence generation means 54 generates an input sentence to be sent to the language model server 60 based on the acquired base answer, action information, decrypted information, etc. (step S8 in FIG. 11 ). The transmission means 56 transmits the input sentence generated by the input sentence generation means 54 to the language model server 60 (step S9 in FIG. 11 ). When the receiving means 62 of the language model server 60 receives an input sentence, the answer generating unit 63 generates an answer corresponding to the input sentence, and the transmitting means 64 transmits the answer generated by the answer generating unit 63 to the chat server 50. When the receiving means 52 receives an answer from the language model server 60 in this way, the answer acquiring means 55 acquires the answer from the language model server 60 corresponding to the input sentence generated by the input sentence generating means 54 (step S10 in FIG. 11 ). Then, the transmitting means 56 of the chat server 50 transmits an instruction to the user terminal 10 to display the answer information generated by the language model server 60 (step S11 in FIG. 11 ). As a result, the answer generated by the language model server 60 is displayed on the chatbot screen of the website displayed on the display unit 13 of the user terminal 10.

[0067] A specific example of the operation of the system 1 will be described in more detail using display screens on the display unit 13 of the user terminal 10 shown in FIGS.

[0068] First, an example of a first action detected by JavaScript even if the user does not enter any questions or the like on the chatbot screen will be described. FIG. 12 is a diagram showing a display screen when an e-commerce site for users to purchase electrical appliances and their parts is displayed on the display unit 13 of the user terminal 10 as a website provided by the web server 30. The left area 13a of this display screen is an application screen that displays the product names, model numbers, images 13c, specifications, etc. of the electrical appliances and their parts available for purchase, and the right area 13b of the display screen shown in FIG. 12 is a chatbot screen. As described above, this chatbot screen is not displayed if the user does not agree to use the chatbot on the website displayed on the display unit 13 of the user terminal 10. If the user does not agree to use the chatbot, the chatbot will not detect any actions performed by the user and will be activated to respond to the user's questions entered on the user terminal 50 based only on information stored in the first database server 70 and the third database server 90 described below (i.e., to respond without using information stored in the second database server 40). When a chatbot screen is displayed on the website, the user can input a question into the chatbot screen using the operation unit 14. For example, when the user inputs a question into the chatbot screen using the operation unit 14 to ask for detailed information about an electrical appliance or its parts displayed on the application screen, an answer to the input question is displayed on the chatbot screen. When a user logs into their personal page on a website such as that shown in FIG. 12, the user's personal information, product information, etc. are encrypted by the web server 30, and the encrypted information is sent from the web server 30 to the user terminal 10 and temporarily stored in the memory unit 18 of the user terminal 10.

[0069] Furthermore, when a user selects an image 13c of an electrical appliance or its part displayed on the application screen on the screen of the display unit 13 of the user terminal 10 with the cursor and drops it onto the chatbot screen as first action information, JavaScript detects this action as first action information. Then, JavaScript determines information to send to the chat server 50 based on the first action information, and the action information based on the first action information, information about the image 13c, and encrypted personal information, product information, etc. are sent from the user terminal 10 to the chat server 50. Note that the information about the image 13c includes metadata assigned to the image 13c (e.g., the title and description of the image 13c). The encrypted personal information includes the user's past purchase history of electrical appliances and parts. The encrypted product information includes information such as the specifications and price of the product displayed on the application screen. In addition, information such as the specifications of the user terminal 10 itself is obtained by JavaScript executed on the user terminal 10, and the obtained information is sent from the user terminal 10 to the chat server 50 by JavaScript, whereby information such as the specifications of the user terminal 10 itself is obtained by the user information obtaining means 53.

[0070] When the receiving means 52 of the chat server 50 receives action information and the like from the user terminal 10, the transmitting means 56 of the chat server 50 transmits to the language model server 60 a command to vectorize a pre-input sentence (e.g., a sentence such as "I want to know the specifications of image 13c") generated based on the action information and the like received by the receiving means 52 (specifically, the action of selecting with the cursor an image 13c of an electrical appliance or its component displayed on the application screen and dropping it on the chatbot screen, the information on image 13c, and the identification information of the product corresponding to image 13c) and the pre-input generation information. When the receiving means 62 of the language model server 60 receives the command, the answer generating unit 63 obtains a vector value by vectorizing the pre-input sentence generated based on the action information and the like. Thereafter, when the receiving means 52 of the chat server 50 receives the vector value as vector information, the transmitting means 56 transmits to the first database server 70 a vector search request to search the first database server 70 for a vector value approximate to the vector value generated by the language model server 60. When the receiving means 72 of the first database server 70 receives a vector search request from the chat server 50, it extracts vector values ​​that are approximate to the vector value in the received vector search request from the vector values ​​stored in the storage unit 78, and the transmitting means 73 of the first database server 70 transmits a base answer corresponding to this approximate value to the chat server 50. Here, for example, an answer such as "The specifications of the product corresponding to the image 13c dropped on the chatbot screen are A" is obtained as the base answer corresponding to the approximate value.

[0071] In addition, in the chat server 50, the control unit 51 decrypts encrypted information using an encryption key issued by a business (administrator) that provides the chatbot service. The input sentence generation means 54 generates an input sentence to the language model server 60 based on predetermined input generation information, based on the acquired base answer (specifically, the specifications of the product corresponding to the image 13c dropped on the chatbot screen), the information on the image 13c, the action information, and the decrypted information (specifically, the product information, etc.). For example, "The user wants to know the specifications of the image 13c," "The specifications of the product corresponding to the image 13c are A," and "The user has previously purchased product B." The input generation information includes rules and the like necessary for generating an input sentence based on the accepted action. For example, the input generation information is a rule that, when the received action is "an action in which a user selects an image displayed on an application screen and drops the image on a chatbot screen," the input generation information reads a predetermined sentence, "Please tell me information about {image}," from the content of the action, obtains metadata of the dropped image (e.g., part name A) and combines it with the sentence to generate an input sentence, "Please tell me information about part name A." When the transmission means 56 transmits the input sentence generated by the input sentence generation means 54 to the language model server 60, the answer generation unit 63 of the language model server 60 generates an answer corresponding to the input sentence, and the transmission means 64 transmits the answer generated by the answer generation unit 63 to the chat server 50. Then, the transmission means 56 of the chat server 50 transmits an instruction to the user terminal 10 to display the answer information generated by the language model server 60. As a result, the answer generated by the language model server 60 is displayed on the chatbot screen of the website displayed on the display unit 13 of the user terminal 10, as shown in FIG. 13 . Specifically, an answer obtained by comparing the specifications of the product corresponding to the image 13c dropped onto the chatbot screen with the specifications of the user terminal 10 itself is displayed on the chatbot screen.Furthermore, the language model server 60 creates a message on the chatbot screen that prompts the user to select whether or not to display a page that introduces multiple parts that can operate with the specifications of the user terminal 10, and the created message is displayed on the chatbot screen (see reference numeral 13d in FIG. 13). This allows the user to select whether or not to display a page on the chatbot screen that introduces multiple parts that can operate with the specifications of the user terminal 10. Here, if the user selects to display a page that introduces multiple parts that can operate with the specifications of the user terminal 10, a page 13e that introduces multiple such parts is displayed on the chatbot screen, as shown in FIG. 14.

[0072] 12 and 14, when a user drags a specific character (e.g., the character "core block") displayed on an application screen on the screen of the display unit 13 of the user terminal 10, such an action is detected by JavaScript as first action information. Then, the action information and encrypted personal information, product information, etc. are transmitted from the user terminal 10 to the chat server 50. When the receiving means 52 of the chat server 50 receives the action information, etc. from the user terminal 10, the transmitting means 56 of the chat server 50 transmits to the language model server 60 a command to vectorize the action information, etc. received by the receiving means 52 (specifically, information that the user has dragged a specific character displayed on the application screen and the content of the dragged character). When the receiving means 62 of the language model server 60 receives the command, the answer generating unit 63 obtains a vector value by vectorizing the action information, etc. Thereafter, when the receiving means 52 of the chat server 50 receives a vector value as vector information, the transmitting means 56 transmits to the first database server 70 a vector search request for searching the first database server 70 for a vector value that is approximate to the vector value generated by the language model server 60. When the receiving means 72 of the first database server 70 receives the vector search request from the chat server 50, it extracts, from the vector values ​​stored in the storage unit 78, a vector value that is approximate to the vector value in the received vector search request, and the transmitting means 73 of the first database server 70 transmits a base answer corresponding to this approximate value to the chat server 50. Here, as the base answer corresponding to the approximate value, for example, an answer may be obtained that provides an explanation of the dragged character and obtains specification information of the user terminal 10 itself related to the dragged character.

[0073] In the chat server 50, the control unit 51 decrypts the encrypted information using an encryption key issued by a business operator (administrator) that provides the chatbot service. The input sentence generation means 54 generates an input sentence to the language model server 60 based on the acquired base answer (specifically, an explanation of the dragged character and acquisition of specification information of the dragged character of the user terminal 10 itself), action information, and decrypted information (specifically, product information, etc.). When the transmission means 56 transmits the input sentence generated by the input sentence generation means 54 to the language model server 60, the answer generation unit 63 of the language model server 60 generates an answer corresponding to the input sentence, and the transmission means 64 transmits the answer generated by the answer generation unit 63 to the chat server 50. The transmission means 56 of the chat server 50 then transmits an instruction to the user terminal 10 to display the answer information generated by the language model server 60. As a result, the answer generated by the language model server 60 is displayed on the chatbot screen of the website displayed on the display unit 13 of the user terminal 10, as shown in FIG. 15 . Specifically, an explanation of the dragged character is provided, and an answer comparing the specification information of the dragged character on the user terminal 10 itself with the specification information of the dragged character on the product displayed on the application screen is displayed on the chatbot screen.

[0074] Next, we will explain an example of a second action detected by JavaScript when the user inputs a question or the like on the chatbot screen after performing a predetermined action on the chatbot screen. FIG. 16 is a diagram showing a display screen on the display unit 13 of the user terminal 10 when a reservation site for making reservations at accommodations is displayed as a website provided by the web server 30. The left area 13a of this display screen is an application screen that displays the names of available accommodations, descriptions of the accommodations, accommodation prices, addresses, maps, etc., while the right area 13b of the display screen shown in FIG. 16 is a chatbot screen that is a screen for operating the chatbot and is different from the application screen. As mentioned above, this chatbot screen is not displayed if the user does not agree to use the chatbot on the website displayed on the display unit 13 of the user terminal 10. When the chatbot screen is displayed on the website, the user can input a question on the chatbot screen using the operation unit 14. When a user logs in to their personal page on a website such as that shown in Figure 16, the user's personal information, accommodation service information, etc. are encrypted by the web server 30, and the encrypted information is sent from the web server 30 to the user terminal 10, where it is temporarily stored in the memory unit 18 of the user terminal 10.

[0075] When a user displays a page for a specific accommodation on the screen of the display unit 13 of the user terminal 10 as shown in FIG. 16 and inputs the phrase "I would like to make a reservation" on the chatbot screen, this action is detected by JavaScript as second action information. The action information, encrypted personal information, service information, etc. are then transmitted from the user terminal 10 to the chat server 50. The encrypted personal information includes the user's past accommodation usage history. The encrypted service information includes information such as the content of the accommodation description displayed on the application screen, accommodation price, and address. When the reception means 52 of the chat server 50 receives the action information, etc. from the user terminal 10, the transmission means 56 of the chat server 50 transmits to the language model server 60 a command to vectorize the action information, etc. received by the reception means 52 (the user's action of displaying a page for a specific accommodation and inputting the phrase "I would like to make a reservation" on the chatbot screen). When the reception means 62 of the language model server 60 receives the command, the response generation unit 63 obtains vector values ​​by vectorizing the action information, etc. Thereafter, when the receiving means 52 of the chat server 50 receives a vector value as vector information, the transmitting means 56 transmits to the first database server 70 a vector search request for searching the first database server 70 for a vector value that is approximate to the vector value generated by the language model server 60. When the receiving means 72 of the first database server 70 receives the vector search request from the chat server 50, the receiving means 72 extracts, from the vector values ​​stored in the storage unit 78, a vector value that is approximate to the vector value in the received vector search request, and the transmitting means 73 of the first database server 70 transmits a base answer corresponding to this approximate value to the chat server 50. Here, as the base answer corresponding to the approximate value, for example, an answer is obtained that allows the user to select whether they want to reserve an accommodation displayed on the application screen, whether they want to reserve an accommodation suggested based on the user's past accommodation usage history, or neither.

[0076] In addition, in the chat server 50, the control unit 51 decrypts encrypted information using an encryption key issued by a business operator (administrator) that provides the chatbot service. The input sentence generation means 54 generates an input sentence to the language model server 60 based on the acquired base answer (an answer that prompts the user to select whether they would like to reserve an accommodation facility displayed on the application screen, an accommodation facility suggested based on the user's past accommodation usage history, or neither), action information, and decrypted information (specifically, the user's past accommodation usage history, service information of the accommodation facility displayed on the application screen, etc.). When the transmission means 56 transmits the input sentence generated by the input sentence generation means 54 to the language model server 60, the response generation unit 63 of the language model server 60 generates a response corresponding to the input sentence, and the transmission means 64 transmits the response generated by the response generation unit 63 to the chat server 50. The transmission means 56 of the chat server 50 then transmits an instruction to display the response information generated by the language model server 60 to the user terminal 10. As a result, as shown in FIG. 16, the answer generated by the language model server 60 is displayed on the chatbot screen of the website displayed on the display unit 13 of the user terminal 10. Specifically, an option 13f is displayed on the chatbot screen, prompting the user to select whether they would like to reserve the accommodation displayed on the application screen, whether they would like to reserve an accommodation suggested based on the user's past accommodation usage history, or neither. This allows the user to select on the chatbot screen whether they would like to reserve the accommodation displayed on the application screen, whether they would like to reserve an accommodation suggested based on the user's past accommodation usage history, or neither. Here, if the user selects that they would like to reserve an accommodation suggested based on the user's past accommodation usage history, a message for making a reservation for this accommodation (e.g., a message to confirm the reservation date) is displayed on the chatbot screen based on the decrypted information, as shown in FIG. 16.

[0077] 16, on the screen of the display unit 13 of the user terminal 10, the input sentence generation means 54 generates a plurality of input sentences corresponding to the action (for example, "I would like to reserve Kirana Garden," "I would like to reserve Bayside Garden," etc.), and displays the generated plurality of input sentences on the user terminal 10, thereby enabling the user to select one input sentence from the plurality of input sentences or to create a new input sentence on the user terminal 10. This allows the user to obtain a more appropriate answer from the chatbot by selecting one input sentence from the plurality of input sentences or creating a new input sentence.

[0078] [Summary of the configuration and operation of this embodiment] According to the program, computer (specifically, chat server 50), system 1 combining web server 30 and chat server 50, and information processing method of the present embodiment configured as described above, the program causes control unit 51 of chat server 50 to function as reception means 52, input statement generation means 54, response acquisition means 55, and transmission means 56. The reception means 52 receives action information related to an action performed by a user on an application screen displayed on user terminal 10, or a chatbot screen, which is a screen for operating the chatbot and different from the application screen. Based on the action information received by the reception means 52, input statement generation means 54 generates an input statement corresponding to the action, and response acquisition means 55 acquires response information for the input statement generated by input statement generation means 54. The transmission means 56 transmits display information for displaying the response acquired by response acquisition means 55 on the chatbot screen to user terminal 10. According to the program, chat server 50, system 1, and information processing method described above, input statements based on information corresponding to a user's action can be generated, thereby increasing the flexibility of responses. More specifically, conventional chatbots could only provide answers based on a database that stores combinations of user input sentences and answers, which had the problem of low flexibility in answers. However, the program, chat server 50, system 1, and information processing method of this embodiment can refer to action information regarding actions performed by the user on the application screen when creating an input sentence, thereby increasing the flexibility of answers compared to when answers are provided based on a database that stores combinations of user input sentences and answers.

[0079] Furthermore, in the program, computer (specifically, chat server 50), system 1, and information processing method of the present embodiment, as described above, the answer obtaining means 55 transmits the input sentence generated by the input sentence generation means 54 to the language model server 60 and obtains answer information by receiving from the language model server 60 a response to the input sentence calculated by the language model server 60. This makes it possible to improve the accuracy of the response to the input sentence by using the language model server 60. Note that in another aspect of the present embodiment, the language model server 60 as a large-scale language model may be provided inside the chat server 50, rather than being provided separately from the chat server 50. Furthermore, the answer obtaining means 55 is not limited to transmitting the input sentence generated by the input sentence generation means 54 to the language model server 60 and receiving from the language model server 60 a response to the input sentence calculated by the language model server 60 to obtain answer information. As long as an input sentence is created based on information corresponding to a user's action, an answer may be obtained from the input sentence by a method other than inputting the input sentence to the language model server 60.

[0080] Furthermore, in the program, computer (specifically, chat server 50), system 1, and information processing method of this embodiment, as described above, when consent to use of a chatbot is input into the user terminal 10, an action detection program that detects actions performed by the user on the user terminal 10 is executed on the user terminal 10, and action information regarding actions performed by the user on the application screen, detected by the action detection program, is transmitted from the user terminal 10 to the chat server 50. This makes it possible for the action detection program to reliably detect actions performed by the user on the application screen. Note that in this embodiment, the action detection program is not limited to JavaScript, and various other programs may be used.

[0081] Furthermore, in the program, computer (specifically, chat server 50), system 1, and information processing method of this embodiment, as described above, the action is an action (first action) in which a user selects an image displayed on an application screen and drops it onto a chatbot screen. When the input sentence generation means 54 detects the dropping action, it acquires a base answer for a pre-input sentence generated based on the dropped image and action information, and generates an input sentence based on the base answer and action information. This allows the input sentence generation means 54 to generate an input sentence with high accuracy. Note that, as described above, "based on the dropped image" means based on metadata (image title and description) assigned to the image. Furthermore, the input sentence is transmitted from the chat server 50 to the language model server 60, and the pre-input sentence is transmitted from the chat server 50 to the first database server 70 to create an input sentence.

[0082] Furthermore, at this time, when the input sentence generation means 54 detects a dropping action, it transmits a pre-input sentence generated based on the dropped image and action information to the first database server 70, and acquires information on the base answer by receiving from the first database server 70 a base answer to the pre-input sentence extracted by the first database server 70. In this case, by using the base answer stored in the first database server 70, the input sentence generation means 54 can generate an input sentence with even greater accuracy.

[0083] Furthermore, the sending means 56 may be configured to send an instruction to the user terminal 10 requesting approval of the base answer acquired by the input sentence generation means 54, and the input sentence generation means 54 may be configured to generate an input sentence based on the approved base answer and action information when receiving information regarding the approval of the base answer from the user terminal 10. In this case, by obtaining the user's approval of the base answer, the input sentence generation means 54 can generate an input sentence with even greater accuracy.

[0084] As described above, the input sentence generation means 54 may further acquire specification information of the user terminal 10 and generate an input sentence by referring to the specification information in addition to the base answer and action information. In this case, by referring to the specification information of the user terminal 10, the input sentence generation means 54 can generate an input sentence with even greater accuracy.

[0085] Furthermore, in the program, computer (specifically, chat server 50), system 1, and information processing method of this embodiment, as described above, the action is an action (second action) of accessing the second database server 40 that stores the information displayed on the application screen by the user, and the input sentence generation means 54 acquires action information related to the action to be accessed based on the content entered by the user on the chatbot screen and information stored in the accessed second database server 40, and generates an input sentence based on the content entered by the user, the action information, and the information stored in the accessed second database server 40. In this case, by referring to the information stored in the second database server 40, the input sentence generation means 54 can generate an input sentence with higher accuracy.

[0086] In this case, the type of second database server 40 to be accessed may be determined from multiple types of second database servers 40 according to the type of action. In this case, by obtaining information from the second database server 40 corresponding to the user's action on the user terminal 10, the obtained information can be more appropriate.

[0087] Furthermore, in the program, computer (specifically, chat server 50), system 1, and information processing method of this embodiment, as described above, the program causes control unit 51 to further function as user information acquisition means 53, and user information acquisition means 53 acquires information about the user from user terminal 10, and input sentence generation means 54 may generate an input sentence according to the action by referring to the information about the user acquired by user information acquisition means 53 in addition to the action information accepted by acceptance means 52. In this case, by referring to the information about the user acquired by user information acquisition means 53, input sentence generation means 54 can generate an input sentence with higher accuracy.

[0088] Furthermore, in the program, computer (specifically, chat server 50), system 1, and information processing method of this embodiment, as described above, the input sentence generation means 54 generates a plurality of input sentences according to the action, and displays the generated plurality of input sentences on the user terminal 10, thereby enabling the user to select one input sentence from the plurality of input sentences or to create a new input sentence on the user terminal 10. This allows the user to obtain a more appropriate answer from the chatbot by selecting one input sentence from the plurality of input sentences or creating a new input sentence.

[0089] Furthermore, in the program, computer (specifically, chat server 50), system 1, and information processing method of this embodiment, when consent to use of the chatbot is input into the user terminal 10, an action detection program (e.g., JavaScript) that detects actions other than input to the chatbot performed by the user on the user terminal 10 is executed on the user terminal 10, and action information regarding actions other than input to the chatbot performed by the user, detected by the action detection program, is transmitted from the user terminal 10 to the chat server 50. With such a program, chat server 50, system 1, and information processing method, too, the flexibility of responses can be increased by creating input sentences based on information corresponding to the user's actions.

[0090] [Other Aspects of the Present Embodiment] The program, computer (specifically, chat server 50), system 1, and information processing method according to this embodiment are not limited to the above-described aspects, and various modifications can be made.

[0091] For example, in the above description, the answer obtaining means 55 transmits the input sentence generated by the input sentence generation means 54 to the language model server 60 and receives from the language model server 60 the answer to the input sentence calculated by the language model server 60, thereby obtaining answer information; however, this embodiment is not limited to this configuration. As another configuration, a third database server 90, in which data on the set input sentence and the set answer are stored in association with each other, may be connected to the chat server 50 so as to be able to communicate with the chat server 50. The answer obtaining means 55 may transmit the input sentence generated by the input sentence generation means 54 to the third database server 90, and obtain answer information by receiving from the third database server 90 the answer corresponding to the input sentence extracted based on the data on the set input sentence and the set answer stored in the third database server 90. In another embodiment, instead of sending the answer sent from the third database server 90 to the chat server 50 directly to the user terminal 10 and displaying it on the chatbot, the answer sent from the third database server 90 to the chat server 50 and the question by the user sent from the user terminal 10 to the chat server 50 may be sent to the language model server 60. In this case, the language model server 60 generates an answer based on the question by the user and the answer obtained from the third database server 90, and the answer generated by the language model server 60 is sent from the chat server 50 to the user terminal 10 and displayed on the chatbot.

[0092] In yet another embodiment, data on the set input sentence and the set answer may be stored in association with each other in the memory unit 58 of the chat server 50, and the answer acquisition means 55 may acquire information on the answer corresponding to the input sentence based on the data on the set input sentence and the set answer stored in the memory unit 58.

[0093] Furthermore, the method for generating an input sentence by the input sentence generation means 54 is not limited to the method using the vector information stored in the storage unit 78 of the first database server 70 as described above. Various other methods can be used as the method for generating an input sentence by the input sentence generation means 54 as long as they are based on the action information accepted by the acceptance means 52.

[0094] Furthermore, in the program, computer (specifically, chat server 50), system 1, and information processing method of the present embodiment, the program may further cause control unit 51 to function as learning means 57. For example, when an administrator logs in to an administration page, rather than a personal page, using an administrator account on a website displayed on a display unit (not shown) of administrator terminal 80, such as a personal computer owned by the administrator, the learning means 57 can cause the chatbot to learn responses to input sentences. Specifically, learning means 57 of chat server 50 transmits an instruction to administrator terminal 80 inquiring about the content of an input sentence corresponding to the content of an action in the action information received by receiving means 52, and performs learning by associating the content of the input sentence received from administrator terminal 80 with the content of the action. Then, when receiving means 52 receives action information, input sentence generation means 54 generates an input sentence corresponding to the action based on the content of the learning performed by learning means 57. Even in this case, by learning by associating the content of the input sentence received from the administrator terminal 80 with the content of the action, the input sentence generation means 54 can generate highly accurate input sentences, and the answer acquisition means 55 can obtain highly accurate answers.

[0095] In yet another embodiment, instead of or in addition to an action performed on a browser or the like displayed on the display unit 13 of the user terminal 10, an actual action (e.g., turning one's head, closing one's eyes, speaking, etc.) of the user operating the user terminal 10 may be detected, and information about the detected action may be transmitted from the user terminal 10 to the chat server 50, whereby the input sentence generation means 54 generates an input sentence corresponding to the action based on the action information, and the answer acquisition means 55 acquires information about an answer to the input sentence generated by the input sentence generation means 54. Such an actual action of the user operating the user terminal 10 is detected by the imaging unit 15, microphone 16, etc. of the user terminal 10. In this case, the user can obtain an answer from the chatbot based on the actual action of the user operating the user terminal 10 in addition to an action performed on a browser or the like displayed on the display unit 13 of the user terminal 10, thereby further improving the convenience of the chatbot. [Explanation of symbols]

[0096] 1 System 10 User terminal 11 Control section 11a Bus 13 Display section 14 Control section 15 Imaging unit 16. Mike 18 Memory section 19 Communications Department 20 Tag Management Server 21 Control section 21a Bus 22 Reception methods 23 Transmission Method 28 Memory section 29 Communications Department 30 Web Server 31 Control Unit 31a Bus 32 Reception methods 33 Transmission means 38 Memory section 39 Communications Department 40 Second Database Server 41 Control Unit 41a Bus 42 Reception methods 43 Transmission Method 48 Memory section 49 Communications Department 50 Chat Server 51 Control section 51a Bus 52 Reception methods 53 User information acquisition method 54 Input sentence generation means 55 Means of obtaining answers 56 Transmission Method 57 Learning Methods 58 Memory section 59 Communications Department 60 Language Model Server 61 Control Unit Bus 61a 62 Reception methods 63 Answer generation part 64 Transmission Method 68 Memory section 69 Communications Department 70 First Database Server 71 Control Unit Bus 71a 72 Reception methods 73 Transmission Method 78 Memory section 79 Communications Department 80 Administrator terminal 90 Third Database Server

Claims

1. A program that causes a control unit of a computer to function as a receiving means, an input sentence generating means, an answer obtaining means, and a sending means, the receiving means receives action information regarding an action performed by a user on an application screen displayed on the user terminal and a chatbot screen that is a screen for operating a chatbot and is different from the application screen; the input sentence generation means generates an input sentence according to the action based on the action information received by the reception means; the answer acquisition means acquires information about an answer to the input sentence generated by the input sentence generation means, The transmission means is a program that transmits display information to the user terminal for displaying the answer acquired by the answer acquisition means on the chatbot screen.

2. 2. The program according to claim 1, wherein the answer acquisition means transmits the input sentence generated by the input sentence generation means to a large-scale language model, and acquires information about the answer by receiving from the large-scale language model the answer to the input sentence calculated by the large-scale language model.

3. When consent to the use of the chatbot is input into the user terminal, an action detection program that detects the action performed by the user on the user terminal is executed on the user terminal, 2. The program according to claim 1, wherein the action information regarding the action performed by the user on the application screen, detected by the action detection program, is transmitted from the user terminal to the computer.

4. the action is an action in which the user selects an image displayed on the application screen and drops it onto the chatbot screen, The program of claim 1, wherein the input sentence generation means, when detecting the dropping action, obtains a base answer for a pre-input sentence generated based on the dropped image and the action information, and generates the input sentence based on the base answer and the action information.

5. 5. The program according to claim 4, wherein the input sentence generation means, when detecting the dropping action, transmits the pre-input sentence generated based on the dropped image and the action information to a first database server, and acquires information on the base answer by receiving from the first database server the base answer to the pre-input sentence extracted by the first database server.

6. the transmitting means transmits to the user terminal an instruction requesting approval of the base answer acquired by the input sentence generating means; 5. The program according to claim 4, wherein the input sentence generation means, upon receiving information regarding approval of the base answer from the user terminal, generates the input sentence based on the base answer for which approval has been obtained and the action information.

7. 5. The program according to claim 4, wherein the input sentence generation means further acquires specification information of the user terminal, and generates the input sentence by referring to the specification information in addition to the base answer and the action information.

8. the action is an action in which the user accesses a second database server that stores information displayed on the application screen, The program of claim 1, wherein the input sentence generation means acquires the action information regarding the action to be accessed and information stored in the second database server to be accessed based on the content entered by the user on the chatbot screen, and generates the input sentence based on the content entered by the user, the action information, and the information stored in the second database server to be accessed.

9. 9. The program according to claim 8, wherein the type of the second database server to be accessed from among a plurality of types of the second database servers is determined according to the type of the action.

10. causing the control unit to further function as a user information acquisition unit; the user information acquisition means acquires information about the user from the user terminal; 2. The program according to claim 1, wherein the input sentence generation means generates the input sentence according to the action by referring to information about the user acquired by the user information acquisition means in addition to the action information accepted by the acceptance means.

11. 2. The program according to claim 1, wherein the answer acquisition means transmits the input sentence generated by the input sentence generation means to a third database server in which data of the set input sentence and the set answer are stored in association with each other, and acquires information about the answer by receiving from the third database server the answer corresponding to the input sentence extracted based on the data of the set input sentence and the set answer stored in the third database server.

12. the computer has a storage unit in which data of a setting input sentence and a setting response are stored in association with each other, 2. The program according to claim 1, wherein the answer acquisition means acquires information about the answer corresponding to the input sentence based on data about the set input sentence and the set answer stored in the storage unit.

13. causing the control unit to further function as a learning unit; the learning means transmits to an administrator terminal an instruction to inquire about the content of the input sentence corresponding to the content of the action in the action information received by the receiving means, and performs learning by associating the content of the input sentence received from the administrator terminal with the content of the action; 2. The program according to claim 1, wherein when the accepting means accepts the action information, the input sentence generating means generates the input sentence corresponding to the action based on the content of learning performed by the learning means.

14. 2. The program according to claim 1, wherein the input sentence generation means generates a plurality of the input sentences in accordance with the action, and displays the generated plurality of input sentences on the user terminal, thereby enabling the user to select one of the plurality of input sentences or to create a new input sentence on the user terminal.

15. A program that causes a control unit of a computer to function as a receiving means, an input sentence generating means, an answer obtaining means, and a sending means, the accepting means accepts action information relating to an action performed by a user at a user terminal; the input sentence generation means generates an input sentence according to the action based on the action information received by the reception means; the answer acquisition means acquires information about an answer to the input sentence generated by the input sentence generation means, the transmitting means transmits to the user terminal display information for displaying the answer acquired by the answer acquiring means on a chatbot screen; When consent to the use of the chatbot is input into the user terminal, an action detection program is executed in the user terminal to detect actions other than input to the chatbot made by the user of the user terminal, A program in which the action information regarding actions other than input to the chatbot made by a user, detected by the action detection program, is transmitted from the user terminal to the computer.

16. A computer in which a control unit functions as a receiving means, an input sentence generating means, an answer acquiring means, and a sending means by executing a program, the receiving means receives action information regarding an action performed by a user on an application screen displayed on the user terminal and a chatbot screen that is a screen for operating a chatbot and is different from the application screen; the input sentence generation means generates an input sentence according to the action based on the action information received by the reception means; the answer acquisition means acquires information about an answer to the input sentence generated by the input sentence generation means, The sending means is a computer that sends display information to the user terminal for displaying the answer acquired by the answer acquisition means on the chatbot screen.

17. A computer in which a control unit functions as a receiving means, an input sentence generating means, an answer acquiring means, and a sending means by executing a program, the accepting means accepts action information relating to an action performed by a user at a user terminal; the input sentence generation means generates an input sentence according to the action based on the action information received by the reception means; the answer acquisition means acquires information about an answer to the input sentence generated by the input sentence generation means, the transmitting means transmits to the user terminal display information for displaying the answer acquired by the answer acquiring means on a chatbot screen; When consent to the use of the chatbot is input into the user terminal, an action detection program is executed in the user terminal to detect actions other than input to the chatbot made by the user of the user terminal, A computer, wherein the action information regarding the action other than the input to the chatbot made by the user, detected by the action detection program, is transmitted from the user terminal to the computer.

18. a web server for displaying a website on a user terminal; a computer in which a control unit functions as a receiving means, an input sentence generating means, an answer acquiring means, and a sending means by executing a program; A system comprising: the receiving means receives action information regarding an action performed by a user on an application screen of the website displayed on the user terminal and a chatbot screen that is a screen for operating a chatbot and is different from the application screen; the input sentence generation means generates an input sentence according to the action based on the action information received by the reception means; the answer acquisition means acquires information about an answer to the input sentence generated by the input sentence generation means, The transmission means transmits display information to the user terminal for displaying the answer acquired by the answer acquisition means on the chatbot screen.

19. a web server for displaying a website on a user terminal; a computer in which a control unit functions as a receiving means, an input sentence generating means, an answer acquiring means, and a sending means by executing a program; A system comprising: the accepting means accepts action information regarding an action taken by a user on the website at the user terminal; the input sentence generation means generates an input sentence according to the action based on the action information received by the reception means; the answer acquisition means acquires information about an answer to the input sentence generated by the input sentence generation means, the transmitting means transmits to the user terminal display information for displaying the answer acquired by the answer acquiring means on a chatbot screen; When consent to the use of the chatbot is input into the user terminal, an action detection program is executed in the user terminal to detect actions other than input to the chatbot made by the user of the user terminal, A system in which the action information regarding actions other than input to the chatbot made by the user, detected by the action detection program, is transmitted from the user terminal to the computer.

20. An information processing method executed by a computer having a control unit, The control unit receives action information regarding an action performed by a user on an application screen displayed on the user terminal, the application screen being a screen for operating a chatbot and different from the application screen; generating an input sentence corresponding to the action based on the received action information by the control unit; a step of the control unit acquiring information of a generated response to the input sentence; a step of the control unit transmitting information of the acquired answer to the user terminal; An information processing method comprising:

21. An information processing method executed by a computer having a control unit, a step of receiving action information relating to an action performed by a user on a user terminal by the control unit; generating an input sentence corresponding to the action based on the received action information by the control unit; a step of the control unit acquiring information of a generated response to the input sentence; a step in which the control unit transmits display information for displaying the acquired answer on a chatbot screen to the user terminal; Equipped with When consent to the use of the chatbot is input into the user terminal, an action detection program is executed in the user terminal to detect actions other than input to the chatbot made by the user of the user terminal, An information processing method in which the action information regarding actions other than input to the chatbot made by the user, detected by the action detection program, is transmitted from the user terminal to the computer.

Images