System

Abstract

To provide a system for enabling a user to naturally interact with a specific character desired by the user himself / herself, and to obtain mental stability by reducing a feeling of loneliness.SOLUTION: The system includes an interface means for a user to input information of a character, a means for a client to receive the inputted information from the user and transmit the corresponding information to a server, a means for the server to generate a personality profile and a response pattern of the character using a generation AI based on the received information, a means for the server to store the generated character information in a database, a means for the client to transmit a message from the user to the server, a means for the server to pass the received message to the generation AI and generate a response, and a means for the server to transmit the generated response to the client and for the client to display the response.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, feelings of isolation and lack of communication have become serious problems. In particular, not having anyone to talk to in confidence can increase mental stress and feelings of loneliness, which can lead to health and psychological problems. Furthermore, with the advancement of technology, automatic response systems and dialogue systems using AI have become widespread, but it remains difficult to achieve natural, human-like dialogue.

[0005] Furthermore, there are still few systems that allow users to enjoy conversations with specific characters of their choice, and these systems do not meet user needs. Therefore, new methods are needed to improve users' mental stability and reduce feelings of loneliness. [Means for solving the problem]

[0006] To solve the above-mentioned problems, the present invention employs the following configuration. It provides an interface means for the user to input character information, and includes a means for the terminal to receive the input information from the user and transmit the information to a server. The server also has a means for generating a character's personality profile and response patterns using a generation AI based on the received information, thereby realizing natural dialogue. Furthermore, the server stores the generated character information in a database, and the terminal has a means for transmitting messages from the user to the server, enabling real-time dialogue.

[0007] In addition, the server has a means to pass the received message to the generation AI and generate a reply, and the server sends the generated reply to the device, which then displays the reply, allowing the user to enjoy a conversation with the character. This configuration allows the user to have a natural conversation with the specific character they want, reducing feelings of loneliness and achieving mental stability.

[0008] A "user" is a person who uses the system to interact with characters.

[0009] A "character" is a virtual being with a personality generated based on information entered by the user.

[0010] "Interface means" refers to means for providing screens and functions for users to input character information.

[0011] A "terminal" is a device used by a user, such as a smartphone or tablet.

[0012] A "server" is a device that receives user input information and generates and manages characters using generation AI.

[0013] "Generative AI" is an artificial intelligence system that generates a character's personality profile and answer patterns based on user input information.

[0014] A "personality profile" is a data set that defines a character's personality, characteristics, behavioral patterns, etc.

[0015] An "answer pattern" is a response pattern that the generation AI generates based on the character's profile.

[0016] A "database" is a collection of data for storing and managing generated character information.

[0017] A "message" is text or audio information that a user sends to a character.

[0018] A "reply" is a response that a character generates to a user's message.

[0019] "Natural dialogue" is dialogue that is smooth and natural, just like a conversation between humans.

[0020] "Real time" means immediate processing without delay.

[0021] The above are definitions of important words included in the claims. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0023] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0024] First, the terms used in the following description will be explained.

[0025] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0026] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0027] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0028] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0030] [First embodiment]

[0031] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0032] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0033] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0034] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0035] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0036] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0037] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0038] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0039] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0040] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0041] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0042] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0043] ---

[0044] The present invention is a system that allows users to enjoy natural conversations with characters. This system uses a generation AI to generate characters based on user input information, and allows users to interact with the characters in real time. Specific embodiments of the system are described below.

[0045] 1. The user enters character information

[0046] How users enter information

[0047] Users launch the application using a device such as a smartphone or tablet. The application provides an interface for entering character profile information, such as name, personality, hobbies, and favorite phrases. When the user enters this information and presses the send button, the device sends the entered information to the server.

[0048] 2. Character Generation

[0049] Server-based character generation

[0050] The server receives the user's input information sent from the device and passes it to the generation AI. The generation AI generates a character's personality profile and response patterns based on the provided information. The generated character profile includes the name, personality, hobbies, and typical response style. This information is stored in a database by the server.

[0051] 3. User-character interaction

[0052] How the user initiates the interaction

[0053] The user opens a dialogue screen within the application and enters a new message while past conversation history is displayed. For example, when the user enters "Sakura, how was your day?" and presses the send button, the device sends the message to the server.

[0054] Server Message Processing

[0055] The server receives user messages sent from the device and passes them to the generation AI, which generates natural responses based on the message and the character's personality profile. The responses generated by the generation AI are received by the server and sent to the device.

[0056] 4. Displaying replies

[0057] Display of response by terminal

[0058] The device receives the response sent back from the server and displays it to the user. For example, a response such as "Today was a good day. How was it for you?" is displayed. This process allows the user to enjoy natural dialogue with the character.

[0059] Specific examples

[0060] As a concrete example, consider a case where a user wants to create a character named "Sakura" who has a bright and kind personality. The user uses a device application to enter the following information:

[0061] Name: Sakura

[0062] Personality: Cheerful and kind

[0063] Hobbies: Listening to music and cooking

[0064] Favorite phrase: "Let's do our best today!"

[0065] When a user enters information and presses the send button, the device sends this information to the server, which then invokes the AI ​​generator to generate Sakura's personality profile and response patterns based on this information, and stores the generated information in a database.

[0066] Then, when the user sends a message like "Sakura, how was your day?", the server passes this message to the AI ​​generator, which generates a response. For example, "It was a great day today. How was your day?" This response is generated, sent to the device, and displayed to the user.

[0067] In this way, the system of the present invention allows the user to have natural conversations with a specific character of their choice, thereby reducing feelings of loneliness and achieving mental stability.

[0068] The processing flow will be explained below.

[0069] ---

[0070] Entering character information

[0071] Step 1:

[0072] The user launches the app on their device, which provides the user with an interface for entering character profile information.

[0073] Step 2:

[0074] The device receives information entered by the user, such as name, personality, hobbies, and favorite phrases.

[0075] Step 3:

[0076] The user enters various information into the input form and presses the "Submit" button.

[0077] Step 4:

[0078] The terminal converts the input information into JSON format.

[0079] Step 5:

[0080] The device sends JSON format data to the server as an HTTP POST request.

[0081] Character Generation

[0082] Step 6:

[0083] The server receives the POST request sent from the terminal and parses the user input information from the payload.

[0084] Step 7:

[0085] The server passes the analyzed information to the generation AI, instructing it to generate the character's personality profile and response patterns.

[0086] Step 8:

[0087] The generative AI generates a character's personality profile and answer patterns based on the information provided.

[0088] Step 9:

[0089] The server stores the generated character information in a database.

[0090] User-character interaction

[0091] Step 10:

[0092] The user opens a dialogue screen within the application. The device retrieves and displays the past conversation history from the server.

[0093] Step 11:

[0094] The user enters a new message in the interactive screen and presses the send button.

[0095] Step 12:

[0096] The terminal converts the input message into JSON format.

[0097] Step 13:

[0098] The device sends an HTTP POST request containing the user message to the server.

[0099] Step 14:

[0100] The server receives and analyzes the message sent by the user.

[0101] Step 15:

[0102] The server passes the parsed message to the generation AI, instructing it to generate a response for the character.

[0103] Step 16:

[0104] Generative AI generates responses to user messages based on the character's personality profile.

[0105] Step 17:

[0106] The server receives the generated response message and converts it to JSON format.

[0107] Step 18:

[0108] The server sends an HTTP POST request containing a response message to the terminal.

[0109] Step 19:

[0110] The terminal receives the response message sent from the server, analyzes it, and displays it.

[0111] Step 20:

[0112] The user checks the response from the character displayed on the terminal and enters the next message.

[0113] ---

[0114] The above is a concrete explanation of the processing of the system program.

[0115] Example 1

[0116] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0117] Existing character dialogue systems have difficulty generating a character based on user-input information and engaging in natural dialogue with that character. Furthermore, the generated character may not meet the user's needs or may not be able to respond naturally in certain situations. Furthermore, there is a need for a system that can efficiently process user-input information and respond quickly.

[0118] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0119] In this invention, the server includes interface means for the user to input character information, means for the terminal to receive input information from the user and transmit the information to the server, means for the server to generate a character's personality profile and answer patterns using the generation AI based on the received information, means for the server to store the generated character information in a database, means for the terminal to transmit a message from the user to the server, means for the server to pass the received message to the generation AI and generate a response, means for the server to transmit the generated response to the terminal and display the response, means for the server to generate a request to the generation AI as a prompt sentence and pass it to the generation AI, and means for the terminal to receive the response from the server and display it on an interactive screen. This enables the user to have natural conversations with the character quickly and efficiently.

[0120] "Interface means" refers to the means by which a user inputs character information, and includes fields and buttons for inputting information on the application screen.

[0121] "Terminal" refers to a device that is directly operated by a user, including devices such as smartphones, tablets, and computers.

[0122] A "server" refers to a computer system that receives, processes, generates, and transmits data, and is the main device that performs various processes.

[0123] "Generative AI" refers to an artificial intelligence model that generates a character's personality profile and response patterns, such as an AI model that performs natural language processing.

[0124] A "personality profile" is a collection of data that includes information such as a character's name, personality, hobbies, and typical response style.

[0125] "Answer pattern" refers to a group of information that serves as a standard or template when a character responds to a message from a user.

[0126] A "database" is a system for systematically storing and managing generated character information and other related data.

[0127] "Message" refers to information such as text or voice that a user sends to a character.

[0128] "Prompt text" refers to the words or data input to the generating AI to obtain a specific output, including the user's message and the contents of the character profile.

[0129] "Dialogue screen" refers to the screen within the application where the user and the character exchange messages, and is an area for displaying past conversation history and new messages.

[0130] The present invention is a system that allows users to enjoy natural conversations with characters. This system uses a generation AI to generate characters based on user input information, and allows users to interact with the characters in real time. Specific embodiments of the system are described below.

[0131] Entering character information

[0132] 1. How users enter character information

[0133] Users launch the application using a device such as a smartphone or tablet. The application provides an interface for entering character profile information, such as name, personality, hobbies, and favorite phrases. When the user enters this information and presses the send button, the device sends the entered information to the server.

[0134] Character Generation

[0135] 2. Character generation using generative AI

[0136] The server receives the user's input information sent from the device and passes it to the generation AI. The generation AI generates a character's personality profile and response patterns based on the provided information. The generated character profile includes the name, personality, hobbies, and typical response style. This information is stored in a database by the server.

[0137] User-character interaction

[0138] 3. How users initiate interactions

[0139] The user opens a dialogue screen within the application and enters a new message while past conversation history is displayed. For example, when the user enters "Sakura, how was your day?" and presses the send button, the device sends the message to the server.

[0140] 4. Message Processing by the Server

[0141] The server receives user messages sent from the device and passes them to the generation AI, which generates natural responses based on the message and the character's personality profile. The generated responses are received by the server and sent to the device.

[0142] View Responses

[0143] 5. Displaying Responses on the Device

[0144] The device receives the response sent back from the server and displays it to the user. For example, a response such as "Today was a good day. How was it for you?" is displayed. This allows the user to enjoy natural dialogue with the character.

[0145] Examples of concrete examples and prompts

[0146] Specific scenarios

[0147] Let's say a user creates a character named "Sakura" and sets her personality as "cheerful and kind" and her hobbies as "listening to music and cooking."

[0148] User Input: "Sakura, how was your day?"

[0149] Server Action:

[0150] 1. Pass the user's message to the generation AI.

[0151] 2. The generative AI generates a response: "Today was a good day. How was it for you?"

[0152] Display on terminal: The response is displayed to the user.

[0153] Prompt Sentence Examples

[0154] "Generate a response based on the following character information: The character's name is Sakura, her personality is cheerful and kind, and her hobbies are listening to music and cooking. The user's message is 'Sakura, how was your day?'"

[0155] In this way, the system of the present invention allows the user to have natural conversations with specific characters of their choice, thereby reducing feelings of loneliness and achieving mental stability.

[0156] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0157] Step 1:

[0158] User Action:

[0159] A user launches an application on their smartphone or tablet.

[0160] Input: The user taps the application icon to launch it.

[0161] Specific behavior:

[0162] Tap the application icon to launch it.

[0163] Output: The application starts and the character information input screen is displayed.

[0164] Step 2:

[0165] User Action:

[0166] The user enters character information through the application interface.

[0167] Input: Name, personality, hobbies, favorite phrases

[0168] Specific behavior:

[0169] Enter "Sakura" in the name field, "cheerful and kind" in the personality field, "listening to music and cooking" in the hobby field, and "Let's do our best today too!" in the favorite phrase field, then press the send button.

[0170] Output: The device receives the user's input information and generates data to send to the server.

[0171] Step 3:

[0172] Terminal operations:

[0173] The device sends the user's input information to the server.

[0174] Input: Character information entered by the user

[0175] Specific behavior:

[0176] After completing the input, press the send button to send an HTTP request to the server.

[0177] Output: The server receives the user's character information.

[0178] Step 4:

[0179] Server operations:

[0180] The server receives the user's input information sent from the terminal.

[0181] Input: Character information sent by the device

[0182] Specific behavior:

[0183] The server receives the HTTP request at the API endpoint and stores it in a database.

[0184] Output: The input information is saved on the server.

[0185] Step 5:

[0186] Server operations:

[0187] The server passes the received input information to the generation AI.

[0188] Input: Received character information

[0189] Specific behavior:

[0190] The server creates a prompt for the generation AI based on the input information and sends a request to the generation AI API.

[0191] Output: Character profile and answer patterns generated by the generation AI.

[0192] Step 6:

[0193] Generative AI operations:

[0194] Generative AI generates a character's personality profile and answer patterns based on the information provided.

[0195] Input: Character information formatted as a prompt sentence

[0196] Specific behavior:

[0197] The AI ​​generates a personality based on the name "Sakura," personality type "cheerful and kind," hobbies "listening to music and cooking," and favorite phrase "Let's do our best today too!" and returns that information.

[0198] Output: Generated character profile and answer patterns.

[0199] Step 7:

[0200] Server operations:

[0201] The server stores the generated character profile information in a database.

[0202] Input: Character profile information returned by the generated AI

[0203] Specific behavior:

[0204] The profile information returned from the generation AI is stored in a database.

[0205] Output: Character profile saved in database.

[0206] Step 8:

[0207] User Action:

[0208] The user opens a dialog box and enters a new message.

[0209] Input: User message "Sakura, how was your day?"

[0210] Specific behavior:

[0211] Open the dialogue screen, enter "Sakura, how was your day?" in the input field, and press the send button.

[0212] Output: The device generates data to send the user's message.

[0213] Step 9:

[0214] Terminal operations:

[0215] The device sends the user's message to the server.

[0216] Input: The message entered by the user

[0217] Specific behavior:

[0218] After entering the message, press the send button and an HTTP request will be sent to the server.

[0219] Output: The server receives the user's message.

[0220] Step 10:

[0221] Server operations:

[0222] The server receives the message sent from the terminal.

[0223] Input: User message sent by the terminal

[0224] Specific behavior:

[0225] The server receives a user message at an API endpoint.

[0226] Output: The message is saved on the server.

[0227] Step 11:

[0228] Server operations:

[0229] The server passes the received message to the generation AI, prompting it to generate a response.

[0230] Input: Received message and character profile

[0231] Specific behavior:

[0232] The server creates a prompt based on the user message and saved character profile information and sends a request to the generation AI API.

[0233] Output: A response is generated from the generation AI.

[0234] Step 12:

[0235] Generative AI operations:

[0236] Generative AI generates natural responses based on the user message and character profile.

[0237] Input: User message formatted as a prompt and character profile information

[0238] Specific behavior:

[0239] The generation AI generates a response based on the prompt and returns it to the server.

[0240] Output: The generated response.

[0241] Step 13:

[0242] Server operations:

[0243] The server receives the generated response and sends it to the terminal.

[0244] Input: The response returned by the generation AI

[0245] Specific behavior:

[0246] Receive the response from the generation AI and return it to the terminal as an HTTP response.

[0247] Output: The device receives the reply.

[0248] Step 14:

[0249] Terminal operations:

[0250] The device receives the response sent back from the server and displays it to the user.

[0251] Input: The response sent by the server

[0252] Specific behavior:

[0253] The device receives the response and displays it on the dialogue screen, for example, "Today was a good day. How was it for you?"

[0254] Output: User confirms response.

[0255] (Application example 1)

[0256] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0257] Food delivery services have become extremely popular in modern society, but conventional systems have a monotonous user interface and a lack of enjoyment in the ordering process. Furthermore, in order for users to make accurate menu selections, the system must provide appropriate recommendations to the user. However, conventional systems have difficulty making flexible suggestions based on user preferences. There is a need to provide a system that can solve these issues and enable users to order food delivery efficiently while still enjoying the process.

[0258] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0259] In this invention, the server includes an interface means for a user to input character information, a means for a terminal to receive input information from a user and transmit the information to the server, a means for the server to generate a character's personality profile and answer patterns using a generation AI based on the received information, a means for the server to store the generated character information in a database, a means for the terminal to transmit a message from the user to the server, a means for the server to pass the received message to the generation AI and generate a response, a means for the server to transmit the generated response to the terminal and the terminal to display the response, and a means for the user to receive recommendations through dialogue and place a desired delivery order. This enables the user to enjoy natural dialogue while receiving efficient and appropriate suggestions and placing a food delivery order.

[0260] "User" refers to a person who uses the system to interact with characters and order food delivery.

[0261] "Character information" refers to the character's profile information entered by the user, such as name, personality, hobbies, and favorite phrases.

[0262] "Interface" refers to the means by which a user inputs character information and messages.

[0263] "Terminal" refers to an electronic device such as a smartphone or tablet that transmits input information and messages from the user to the server.

[0264] "Server" refers to the central processing unit that receives user input information, uses generative AI to generate character profiles and responses, and stores them in a database.

[0265] "Generative AI" refers to artificial intelligence that generates characters based on user input and engages in natural conversations.

[0266] A "personality profile" is information created by the generative AI that compiles characteristics such as a character's personality, hobbies, and response style.

[0267] "Answer pattern" refers to a set of response mechanisms that the generative AI uses to generate dialogue between a character and a user.

[0268] "Database" refers to a storage device that stores generated character information and allows searching and retrieval as needed.

[0269] "Reply" refers to a response from a character that the generation AI generates in response to a user's message.

[0270] "Recommendations" refers to menu suggestions and ordering advice provided to users by the generative AI.

[0271] "Food delivery order" refers to a request for food delivery made by a user through interaction with a character.

[0272] MODE FOR CARRYING OUT THE INVENTION

[0273] The present invention is a food delivery system that allows users to place orders through natural interactions with a character. This system utilizes a generative AI model to generate a character based on user input and allows users to interact with the character in real time. Specific embodiments of the system are described below.

[0274] 1. The user enters character information

[0275] Users launch the application using a device such as a smartphone. The application provides an interface for entering profile information such as the character's name, personality, hobbies, and catchphrases. The information entered by the user is sent from the device to the server.

[0276] 2. Character Generation

[0277] The server receives the information sent by the user and passes it to the generation AI. The generation AI generates the character's personality profile and answer patterns based on the provided information. The generated information is saved in a database. This allows the created character information to be used when the user accesses the game again.

[0278] 3. User-character interaction

[0279] The user opens a dialogue screen within the application, enters a message, and sends it. For example, when the user enters "What's your recommendation today?" and presses the send button, the device sends the message to the server. The server passes the received message to the generation AI, which generates a natural response based on the character's personality profile.

[0280] 4. Displaying replies

[0281] The server sends the response generated by the AI ​​to the device, which then displays the response to the user. For example, the device may display a response such as, "Seafood pasta is recommended today." This process allows users to enjoy natural conversations with the character while ordering food delivery.

[0282] 5. Food delivery advisories

[0283] Through dialogue between the user and the character, the generative AI can suggest menu items based on the user's preferences. For example, if the user says, "I want to try something new," the generative AI can suggest, "How about a new vegan menu item?" This allows users to make the best choice while enjoying dialogue with the character, rather than simply choosing a menu item.

[0284] Hardware and software used

[0285] The system's main hardware is the smartphones and tablets used by users. The server is equipped with a high-performance processing unit and a large-capacity database. The software used is the Flask framework for server-side processing, and OpenAI's GPT-3 is used as the generative AI model.

[0286] Examples of concrete examples and prompts

[0287] As a concrete example, let's say a user wants to create a character called "Delivery Assistant." The user enters the following information:

[0288] Name: Delivery Assistant

[0289] Personality: Kind and efficient

[0290] Hobbies: Proposing new dishes

[0291] Favorite phrase: "If you're hungry, leave it to me!"

[0292] When a user asks a character generated based on this information, "What's your recommended menu for dinner tonight?", the character responds, "Seafood pasta is delicious today." This response was generated by the AI ​​based on the character's personality profile selected by the user.

[0293] Example prompt sentence:

[0294] The delivery assistant is friendly and efficient, and his hobby is suggesting new dishes. Below is a chat with him / her.

[0295] User: What's your recommendation for dinner tonight?

[0296] Delivery Assistant:

[0297] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0298] Step 1:

[0299] The user launches the application using a device. The user enters character information (name, personality, hobbies, and catchphrases). This information is sent from the device to the server.

[0300] input:

[0301] Character information entered by the user through the interface.

[0302] output:

[0303] The terminal sends the input information to the server.

[0304] Operation:

[0305] When the user presses the "Submit" button, the input information is sent to the server via the Internet.

[0306] Step 2:

[0307] The server passes the received character information to the generation AI, which generates the character's personality profile and answer patterns based on the user's input.

[0308] input:

[0309] Character information sent from the device.

[0310] output:

[0311] Personality profile and answer patterns of characters generated by the generative AI.

[0312] Operation:

[0313] The server sends the information to the generation AI, which then generates a profile and stores that information in the server's database.

[0314] Step 3:

[0315] The user opens an interactive screen using a terminal, enters a message, and sends it. The message is then sent from the terminal to the server.

[0316] input:

[0317] A message entered by the user.

[0318] output:

[0319] The device sends a user message to the server.

[0320] Operation:

[0321] When the user presses the "send" button, the message is sent to the server.

[0322] Step 4:

[0323] The server passes the received message to a generation AI, which generates natural responses based on the character's personality profile.

[0324] input:

[0325] User messages and character personality profiles.

[0326] output:

[0327] A response generated by the generation AI.

[0328] Operation:

[0329] The generative AI uses prompt text to combine the user's message with the character's information to generate an appropriate response.

[0330] Step 5:

[0331] The server sends the response generated by the generation AI to the terminal, which displays the response.

[0332] input:

[0333] A response generated by the generation AI.

[0334] output:

[0335] The character's response will be displayed on the device.

[0336] Operation:

[0337] The server sends the generated response to the terminal, which displays the response on its screen.

[0338] Step 6:

[0339] Users can order food delivery through conversations with the character, who will then provide recommendations and suggestions to the user.

[0340] input:

[0341] An additional message that the user enters during the interaction.

[0342] output:

[0343] Additional suggestions and final ordering information.

[0344] Operation:

[0345] The user and the character continue to interact, with the generative AI providing successive replies and suggestions, until the user finally confirms the order.

[0346] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0347] ---

[0348] This invention is a system that allows users to enjoy natural conversations with specific characters, and further combines it with an emotion engine that recognizes the user's emotions and reflects them in responses. This system is designed so that a generation AI generates a character based on user input information and can provide advanced responses using the emotion engine.

[0349] Entering character information

[0350] How users enter information

[0351] Users launch a dedicated application on their smartphone, tablet, or other device. This application provides an interface for entering information such as the character's name, personality, hobbies, and favorite phrases. After entering this information, the user presses the send button, which causes the device to send the information to the server.

[0352] Character Generation

[0353] Server-based character generation

[0354] The server receives the input information sent by the user. Based on this information, the server issues commands to the generation AI to generate a character's personality profile and answer patterns. The generation AI creates a character profile based on the input information and stores it in a database on the server.

[0355] User-character interaction

[0356] How the user initiates the interaction

[0357] When a user opens a dialogue screen in the application, the device retrieves and displays past conversation history from the server. The user then enters a new message and presses the send button, at which point the device sends the message to the server.

[0358] Server Message Processing

[0359] The server receives messages sent by users and passes them to the generation AI, instructing it to generate a reply. The generation AI generates a reply to the user's message, taking into account the character's profile and answer patterns. The generated reply is returned to the server, and then sent from the server to the device. The device displays the reply to the user.

[0360] Introducing the Emotion Engine

[0361] Emotion analysis using an emotion engine

[0362] Furthermore, by using an emotion engine, emotions can be analyzed from user input information (e.g., text messages, voice input, etc.). The emotion engine analyzes the user's emotional state (e.g., happy, sad, angry, etc.) in real time and passes that emotional information to the generation AI.

[0363] Response generation that reflects emotional information

[0364] The server passes the emotion information obtained from the emotion engine to the generation AI, which then generates a response that takes the user's emotions into consideration. For example, if a user enters "I'm really tired today," the emotion engine identifies the emotion "tired," and the generation AI generates a corresponding response (e.g., "Thank you for your hard work today. Please take a short rest.").

[0365] Specific examples

[0366] For example, consider the process when a user sends a message saying, "Work was hard today." The user enters the message and presses the send button. The device sends the message to the server, and the server receives the message.

[0367] The server sends the received message to the emotion engine to analyze the user's emotions before passing it on to the generation AI. The emotion engine analyzes the "feeling of fatigue" from the user's text, "It was tough," and returns that emotional information to the server. The server then passes that emotional information to the generation AI, which then generates a response that takes the "feeling of fatigue" into consideration.

[0368] The generated response (for example, "Thank you for your hard work. Take a good rest today.") is sent to the terminal by the server, and the terminal displays the response to the user. In this way, the user can enjoy natural conversation with the character.

[0369] The system of the present invention allows users to enjoy natural, emotional dialogue with specific characters, thereby reducing feelings of loneliness and achieving mental stability.

[0370] ---

[0371] The processing flow will be explained below.

[0372] ---

[0373] Entering character information

[0374] Step 1:

[0375] The user launches the app on their device, which displays an interface for the user to enter character information.

[0376] Step 2:

[0377] The user enters information into the interface, such as the character's name, personality, hobbies, and favorite phrases, and presses the "Submit" button.

[0378] Step 3:

[0379] The device converts the information entered by the user into JSON format.

[0380] Step 4:

[0381] The terminal sends an HTTP POST request to the server and transmits the input information.

[0382] Character Generation

[0383] Step 5:

[0384] The server receives the POST request sent from the terminal and parses the user input information from the payload.

[0385] Step 6:

[0386] The server passes the analyzed information to the generation AI, instructing it to generate the character's personality profile and response patterns.

[0387] Step 7:

[0388] The generative AI generates a character's personality profile and answer patterns based on the information provided.

[0389] Step 8:

[0390] The server stores the generated character information in a database.

[0391] User-character interaction

[0392] Step 9:

[0393] The user opens a dialogue screen within the application. The device retrieves and displays the conversation history from the server.

[0394] Step 10:

[0395] The user enters a new message into the interactive screen and presses the send button.

[0396] Step 11:

[0397] The terminal converts the input message into JSON format.

[0398] Step 12:

[0399] The device sends an HTTP POST request containing the user message to the server.

[0400] Step 13:

[0401] The server receives and analyzes the message sent by the user.

[0402] Step 14:

[0403] The server sends the received message to the emotion engine and instructs it to perform emotion analysis.

[0404] Step 15:

[0405] The emotion engine analyzes the content of the message, identifies the user's emotional state, and sends the emotion information back to the server.

[0406] Step 16:

[0407] The server passes emotional information to the generation AI, instructing it to generate a response that takes the user's emotions into account.

[0408] Step 17:

[0409] Generative AI generates responses to user messages based on the character's personality profile and emotional information.

[0410] Step 18:

[0411] The server receives the generated response message and converts it to JSON format.

[0412] Step 19:

[0413] The server sends an HTTP POST request containing a response message to the terminal.

[0414] Step 20:

[0415] The terminal receives the response message sent from the server, analyzes it, and displays it.

[0416] Step 21:

[0417] The user checks the response from the character displayed on the terminal and enters the next message.

[0418] ---

[0419] The above is a specific flow of processing of the invention that uses an emotion engine.

[0420] Example 2

[0421] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0422] Conventional dialogue systems have made it difficult for users to enjoy natural conversations with characters. Furthermore, they lacked a system that could recognize the user's emotions and automatically generate appropriate responses. As a result, users often felt lonely or responses were unnatural.

[0423] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for passing the user's message to an emotion analysis engine to acquire emotion information, a means for passing the emotion information to a generative AI model and generating a response that takes emotion into consideration, and a means for sending the generated response to the terminal and for the terminal to display the response. This enables natural dialogue according to the user's emotion.

[0424] 1. "Interface means" refers to the function used by the user to input character information.

[0425] 2. "Terminal" refers to a device used by a User to input and transmit information.

[0426] 3. "Generative AI Model" refers to artificial intelligence software that generates a character's personality profile and response patterns based on information received from the user.

[0427] 4. "Database" refers to the storage area within the system for storing generated character information.

[0428] 5. "Sentiment Analysis Engine" means software used to analyze and extract emotional information from users' messages.

[0429] 6. "Reply" refers to a response generated by a server or a generative AI model in response to a user's message.

[0430] 7. "Natural dialogue" refers to dialogue that is natural to the user, fluent, and takes place in an appropriate context.

[0431] This invention is a system that allows users to enjoy natural conversations with specific characters, and further combines it with an emotion analysis engine that recognizes the user's emotions and reflects them in responses. This system is designed so that a generative AI model generates a character based on user input information and can provide advanced responses using emotion analysis.

[0432] Entering character information

[0433] How users enter information

[0434] Users launch a dedicated application on their smartphone, tablet, or other device. This application provides an interface for entering information such as the character's name, personality, hobbies, and favorite phrases. After entering this information, the user presses the send button, which causes the device to send the information to the server.

[0435] Examples:

[0436] The user enters the following information into the app's form: "Name: Akane," "Personality: Cheerful," "Hobbies: Music," and "Phrase: Good morning!"

[0437] When the user taps the send button, the device sends the information in JSON format to the server.

[0438] Character Generation

[0439] Server-based character generation

[0440] The server receives the input information sent by the user. Based on the received information, the server issues commands to the generative AI model to generate the character's personality profile and response patterns. The generative AI model uses, for example, OpenAI's GPT-4. The generated profile is stored in a database on the server.

[0441] Examples:

[0442] The server sends a prompt to the generative AI model saying, "Create a character's personality profile and response patterns from this information."

[0443] The generative AI generates a profile and stores it in a database on the server.

[0444] User-character interaction

[0445] How the user initiates the interaction

[0446] When a user opens a dialogue screen in the application, the device retrieves and displays the past conversation history from the server. The user then enters a new message and presses the send button. At this time, the device sends the message to the server.

[0447] Examples:

[0448] The user types "Happy birthday!" and taps the send button.

[0449] The device sends a message to the server.

[0450] Server Message Processing

[0451] The server receives messages sent by users and passes them to a generative AI model to generate a reply. The generative AI generates a reply to the user message while taking into account the character's profile and answer patterns. The generated reply is sent from the server to the device, and the device displays the reply to the user.

[0452] Examples:

[0453] The server sends a prompt to the generated AI model saying, "You have received a message from the user. Please create a reply to this message taking into account the character's profile."

[0454] The generation AI generates a reply saying "Nice to meet you!" and returns it to the server.

[0455] Introducing a sentiment analysis engine

[0456] Emotion analysis using an emotion analysis engine

[0457] Furthermore, by using a sentiment analysis engine, emotions can be analyzed from user input information (e.g., text messages, voice input, etc.). The sentiment analysis engine uses, for example, IBM Watson's sentiment analysis API. The sentiment analysis engine analyzes the user's emotional state in real time and passes that emotional information to the generative AI model.

[0458] Examples:

[0459] The server sends the message "Thank you for your continued support today!" to the emotion analysis engine, and obtains "positive" emotion as the analysis result.

[0460] Response generation that reflects emotional information

[0461] The server passes the acquired emotional information to the generative AI model and instructs it to generate a response that takes the user's emotions into account. The generative AI then takes the emotional information into account and generates an appropriate response.

[0462] Examples:

[0463] The server sends the generative AI model a prompt message: "The user sent the message 'Have a great day!' with positive emotions. Generate a response to this."

[0464] The generation AI generates a reply saying "Nice to meet you!" and returns it to the server.

[0465] In this way, it is possible to realize natural conversations between the user and the character with high accuracy. This system allows the user to enjoy natural conversations with specific characters that are accompanied by emotions, which in turn reduces feelings of loneliness and improves mental stability.

[0466] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0467] Step 1:

[0468] User enters and submits character information

[0469] The user launches a dedicated application and inputs information such as the character's name, personality, hobbies, phrases, etc. When the user presses the send button, the device sends this information to the server.

[0470] Input: Character information entered by the user into the app (e.g., "Name: Akane," "Personality: Cheerful," "Hobbies: Music," "Phrase: Good morning!")

[0471] Data processing: The device converts the input information into pseudo-structured data (e.g., JSON).

[0472] Output: The submitted pseudo-structured data arrives at the server.

[0473] Specific behavior: The user enters information into the app's form and taps the submit button. The device converts the information into JSON format and sends it to the server.

[0474] Step 2:

[0475] The server receives and formats character information

[0476] The server receives character information submitted by the user and formats it into the appropriate form to be passed to the generative AI model.

[0477] Input: Pseudo-structured data (e.g. JSON) sent from the device

[0478] Data processing: The server formats the received data into the required format (e.g., converting it back to plain text)

[0479] Output: Formatted data (e.g. character information in text format)

[0480] Specific operation: The server parses the JSON format data, extracts the necessary information, and formats it.

[0481] Step 3:

[0482] The server instructs the generation AI to generate a character.

[0483] The server passes the formatted character information to a generative AI model, instructing it to generate the character's personality profile and response patterns.

[0484] Input: Formatted character information (e.g., text format)

[0485] Data computation: Generative AI models generate character profiles and response patterns

[0486] Output: Generated character profile and answer patterns (e.g., returned in JSON format)

[0487] Specific operation: The server issues a command to the generative AI model to "create a character's personality profile and response patterns from this information." The generative AI generates a profile and stores it in the server's database.

[0488] Step 4:

[0489] User initiates interaction

[0490] When a user opens the application's interactive screen, the device retrieves and displays past conversation history from the server, and the user enters a new message and presses the send button.

[0491] Input: The user's new message (e.g., "Happy birthday!")

[0492] Data processing: The device converts the message into pseudo-structured data (e.g., JSON)

[0493] Output: The sent message arrives at the server

[0494] Specific behavior: The user types "Have a nice day!" and taps the send button. The device converts the message into JSON format and sends it to the server.

[0495] Step 5:

[0496] The server receives and processes the user's message.

[0497] The server receives messages sent by users and performs any necessary pre-processing (e.g. text cleaning) before passing them to the sentiment analysis engine.

[0498] Input: Pseudo-structured data sent by the user (e.g., a message in JSON format)

[0499] Data processing: The server cleans the message and prepares it for the sentiment analysis engine

[0500] Output: Cleaned text data

[0501] What happens: The server receives the user's message ("Happy New Year!") and removes any unnecessary characters or data.

[0502] Step 6:

[0503] The server sends the user's message to the sentiment analysis engine

[0504] The server sends the cleaned message to a sentiment analysis engine to obtain sentiment information.

[0505] Input: Cleaned text data (e.g., "Happy Birthday!")

[0506] Data calculation: The emotion analysis engine analyzes emotions and generates emotion information

[0507] Output: Emotion information (e.g., "positive")

[0508] Specific operation: The server sends the message "Thank you for your continued support today!" to the sentiment analysis engine, and obtains "positive" sentiment as the analysis result.

[0509] Step 7:

[0510] Server generates response using AI

[0511] The server passes the acquired emotional information and message to the generative AI model, instructing it to generate a response that takes the user's emotions into account.

[0512] Input: Emotion information (e.g., "Positive") and message (e.g., "Have a great day!")

[0513] Data computation: Generative AI models generate responses based on emotional information

[0514] Output: The generated response (e.g. "Nice to meet you!")

[0515] Specific operation: The server sends the command to the generative AI model: "A user sends a message with positive emotions saying, 'Have a nice day!' Generate a response to this." The generative AI generates a response saying, "Thank you very much!" and returns it to the server.

[0516] Step 8:

[0517] The server sends a response to the device

[0518] The server receives the response returned by the generation AI and sends it to the user's device.

[0519] Input: Generated response (e.g. "Nice to meet you!")

[0520] Data processing: Convert the response into pseudo-structured data (e.g., JSON format)

[0521] Output: Response data arrives at the terminal

[0522] Specific behavior: The server converts the generated response into JSON format and sends it to the user's device.

[0523] Step 9:

[0524] The device displays the response to the user

[0525] The device receives the response sent by the server and displays it to the user within the application.

[0526] Input: Pseudo-structured data sent by the server (e.g., a JSON response)

[0527] Data processing: Convert responses into display format

[0528] Output: Response displayed on screen (e.g. "Character: Nice to meet you!")

[0529] Specific behavior: The device displays the response it receives on the screen so that the user can review it.

[0530] The above is a detailed description of the specific processing steps of the system program and their respective operations.

[0531] (Application example 2)

[0532] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0533] While conventional factory robots are useful for improving production work and efficiency, they do not address the mental health and communication needs of employees. As a result, employees do not receive appropriate feedback on emotions such as stress and fatigue they feel while working, which can lead to a decline in work efficiency. In addition, the lack of communication between employees and robots makes it difficult for the robots to provide detailed support.

[0534] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for recording the user's voice message and sending it to the server, means for the server to pass the voice message to an emotion engine and analyze the emotional state, and means for the generation AI to generate a response based on the emotion information analyzed by the server. This generates a response that corresponds to the user's emotion, making it possible to have a natural conversation while taking into consideration the mental health of employees.

[0535] "Users" refer to factory employees and human operators.

[0536] "Interface means" refers to devices such as smartphones, tablets, and smart glasses, and their applications, which employees use to input character information and messages.

[0537] "Device" refers to a hardware device used by a user to input and receive information, such as a smartphone, smart glasses, or head-mounted display.

[0538] "Server" refers to the computer system on the network that is required to receive input information and messages from users, store them in a database, and process them using generative AI and emotion engines.

[0539] "Generative AI" refers to artificial intelligence that automatically generates a character's personality profile and answer patterns based on information entered by the user.

[0540] A "character personality profile" refers to information about a character's characteristics and personality that is created by the AI ​​based on information entered by the user, such as the character's name, personality, hobbies, and favorite phrases.

[0541] "Answer pattern" refers to the response pattern to a user's message that the generation AI generates based on the character's personality profile.

[0542] The "database" refers to a system that stores the personality profiles and conversation histories of characters created by the generative AI.

[0543] "Message" refers to text or voice information entered by a user when interacting with a device.

[0544] "Emotion engine" refers to software that analyzes user input and identifies the user's emotional state (e.g., joy, sadness, anger, fatigue, etc.).

[0545] "Emotional information" refers to data regarding the user's emotional state analyzed by the emotion engine.

[0546] "Reply" refers to a response from a character that the generation AI generates based on the user's message and emotional information.

[0547] System Overview

[0548] This invention is a system that allows users to enjoy natural conversations with specific characters. It also combines an emotion engine that recognizes the user's emotions and reflects them in responses. This system is designed so that a generative AI generates a character based on user input information and can provide sophisticated responses using the emotion engine. In a factory environment, natural conversations between workers and robots are realized.

[0549] Entering character information

[0550] How users enter information

[0551] Users launch a dedicated application using a device such as a smartphone, smart glasses, or head-mounted display. This application provides an interface for inputting information such as the character's name, personality, hobbies, and favorite phrases. After entering this information, the user presses the send button, and the device sends the input information to the server.

[0552] Character Generation

[0553] Server-based character generation

[0554] The server receives the input information sent by the user. Based on this information, it issues commands to the generation AI to generate the character's personality profile and answer patterns. The generation AI creates a character profile based on the input information and stores it in a database on the server.

[0555] User-character interaction

[0556] How the user initiates the interaction

[0557] When a user opens a dialogue screen in the application, the device retrieves and displays past conversation history from the server. The user then enters a new message and presses the send button, at which point the device sends the message to the server.

[0558] Server Message Processing

[0559] The server receives messages sent by users and passes them to the generation AI, instructing it to generate a reply. The generation AI generates a reply to the user's message, taking into account the character's profile and answer patterns. The generated reply is returned to the server, and then sent from the server to the device. The device displays the reply to the user.

[0560] Introducing the Emotion Engine

[0561] Emotion analysis using an emotion engine

[0562] Furthermore, by using an emotion engine, emotions can be analyzed from user input information (e.g., text messages, voice input, etc.). The emotion engine analyzes the user's emotional state (e.g., happy, sad, angry, etc.) in real time and passes that emotional information to the generation AI.

[0563] Response generation that reflects emotional information

[0564] The server passes the emotion information obtained from the emotion engine to the generation AI, which then generates a response that takes the user's emotions into consideration. For example, if a user enters "I'm really tired today," the emotion engine identifies the emotion "tired," and the generation AI generates a corresponding response (e.g., "Thank you for your hard work today. Please take a short rest.").

[0565] Specific examples

[0566] Specifically, when a factory worker says through their smart glasses, "Machine maintenance is tough today," the smart glasses send a voice message to the server. The server uses an emotion engine to analyze "stress" from this message and passes the results to the generation AI. The generation AI takes the emotional information into consideration and generates a response such as, "That's tough. If you look tired, please take a break," which the server then displays on the smart glasses.

[0567] Example prompt for a generative AI model:

[0568] "If an employee says, 'Machine maintenance is hard today,' the emotion engine detects stress and generates an appropriate response."

[0569] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0570] Step 1:

[0571] Input: The user enters character information (such as name, personality, hobbies, and favorite phrases) into a smartphone app.

[0572] Processing: The device receives input information from the user and sends it to the server.

[0573] Output: User input is passed to the server.

[0574] Step 2:

[0575] Input: User's character information received by the server.

[0576] Processing: The server issues commands to the generation AI based on the information received, generating the character's personality profile and response patterns.

[0577] Output: The generation AI generates character profiles and answer patterns, which the server stores in a database.

[0578] Step 3:

[0579] Input: The user types a new message through the smart glasses.

[0580] Processing: The device records the user's voice message and sends it to the server.

[0581] Output: The server receives the user's voice message.

[0582] Step 4:

[0583] Input: The user's voice message received by the server.

[0584] Processing: The server passes the voice message to the emotion engine to analyze the emotional state. The emotion engine extracts emotion data from the voice message.

[0585] Output: The emotion information analyzed by the emotion engine is returned to the server.

[0586] Step 5:

[0587] Input: Emotion information received by the server from the emotion engine and the user's message.

[0588] Processing: The server passes the emotion information and the user's message to the generation AI, instructing it to generate a response that reflects the emotion. The generation AI generates a response based on the emotion information.

[0589] Output: The generated response is returned to the server.

[0590] Step 6:

[0591] Input: The response received by the server from the generation AI.

[0592] Processing: The server generates a response and sends it to the terminal, which displays it to the user.

[0593] Output: The generated response is displayed on the user's smart glasses.

[0594] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0595] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0596] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0597] [Second embodiment]

[0598] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0599] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0600] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0601] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0602] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0603] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0604] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0605] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0606] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0607] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0608] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0609] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0610] ---

[0611] The present invention is a system that allows users to enjoy natural conversations with characters. This system uses a generation AI to generate characters based on user input information, and allows users to interact with the characters in real time. Specific embodiments of the system are described below.

[0612] 1. The user enters character information

[0613] How users enter information

[0614] Users launch the application using a device such as a smartphone or tablet. The application provides an interface for entering character profile information, such as name, personality, hobbies, and favorite phrases. When the user enters this information and presses the send button, the device sends the entered information to the server.

[0615] 2. Character Generation

[0616] Server-based character generation

[0617] The server receives the user's input information sent from the device and passes it to the generation AI. The generation AI generates a character's personality profile and response patterns based on the provided information. The generated character profile includes the name, personality, hobbies, and typical response style. This information is stored in a database by the server.

[0618] 3. User-character interaction

[0619] How the user initiates the interaction

[0620] The user opens a dialogue screen within the application and enters a new message while past conversation history is displayed. For example, when the user enters "Sakura, how was your day?" and presses the send button, the device sends the message to the server.

[0621] Server Message Processing

[0622] The server receives user messages sent from the device and passes them to the generation AI, which generates natural responses based on the message and the character's personality profile. The responses generated by the generation AI are received by the server and sent to the device.

[0623] 4. Displaying Responses

[0624] Display of response by terminal

[0625] The device receives the response sent back from the server and displays it to the user. For example, a response such as "Today was a good day. How was it for you?" is displayed. This process allows the user to enjoy natural dialogue with the character.

[0626] Specific examples

[0627] As a concrete example, consider a case where a user wants to create a character named "Sakura" who has a bright and kind personality. The user uses a device application to enter the following information:

[0628] Name: Sakura

[0629] Personality: Cheerful and kind

[0630] Hobbies: Listening to music and cooking

[0631] Favorite phrase: "Let's do our best today!"

[0632] When a user enters information and presses the send button, the device sends this information to the server, which then invokes the AI ​​generator to generate Sakura's personality profile and response patterns based on this information, and stores the generated information in a database.

[0633] Then, when the user sends a message like "Sakura, how was your day?", the server passes this message to the AI ​​generator, which generates a response. For example, "It was a great day today. How was your day?" This response is generated, sent to the device, and displayed to the user.

[0634] In this way, the system of the present invention allows the user to have natural conversations with a specific character of their choice, thereby reducing feelings of loneliness and achieving mental stability.

[0635] The processing flow will be explained below.

[0636] ---

[0637] Entering character information

[0638] Step 1:

[0639] The user launches the app on their device, which provides the user with an interface for entering character profile information.

[0640] Step 2:

[0641] The device receives information entered by the user, such as name, personality, hobbies, and favorite phrases.

[0642] Step 3:

[0643] The user enters various information into the input form and presses the "Submit" button.

[0644] Step 4:

[0645] The terminal converts the input information into JSON format.

[0646] Step 5:

[0647] The device sends JSON format data to the server as an HTTP POST request.

[0648] Character Generation

[0649] Step 6:

[0650] The server receives the POST request sent from the terminal and parses the user input information from the payload.

[0651] Step 7:

[0652] The server passes the analyzed information to the generation AI, instructing it to generate the character's personality profile and response patterns.

[0653] Step 8:

[0654] The generative AI generates a character's personality profile and answer patterns based on the information provided.

[0655] Step 9:

[0656] The server stores the generated character information in a database.

[0657] User-character interaction

[0658] Step 10:

[0659] The user opens a dialogue screen within the application. The device retrieves and displays the past conversation history from the server.

[0660] Step 11:

[0661] The user enters a new message in the interactive screen and presses the send button.

[0662] Step 12:

[0663] The terminal converts the input message into JSON format.

[0664] Step 13:

[0665] The device sends an HTTP POST request containing the user message to the server.

[0666] Step 14:

[0667] The server receives and analyzes the message sent by the user.

[0668] Step 15:

[0669] The server passes the parsed message to the generation AI, instructing it to generate a response for the character.

[0670] Step 16:

[0671] Generative AI generates responses to user messages based on the character's personality profile.

[0672] Step 17:

[0673] The server receives the generated response message and converts it to JSON format.

[0674] Step 18:

[0675] The server sends an HTTP POST request containing a response message to the terminal.

[0676] Step 19:

[0677] The terminal receives the response message sent from the server, analyzes it, and displays it.

[0678] Step 20:

[0679] The user checks the response from the character displayed on the terminal and enters the next message.

[0680] ---

[0681] The above is a concrete explanation of the processing of the system program.

[0682] Example 1

[0683] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0684] Existing character dialogue systems have difficulty generating a character based on user-input information and engaging in natural dialogue with that character. Furthermore, the generated character may not meet the user's needs or may not be able to respond naturally in certain situations. Furthermore, there is a need for a system that can efficiently process user-input information and respond quickly.

[0685] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0686] In this invention, the server includes interface means for the user to input character information, means for the terminal to receive input information from the user and transmit the information to the server, means for the server to generate a character's personality profile and answer patterns using the generation AI based on the received information, means for the server to store the generated character information in a database, means for the terminal to transmit a message from the user to the server, means for the server to pass the received message to the generation AI and generate a response, means for the server to transmit the generated response to the terminal and display the response, means for the server to generate a request to the generation AI as a prompt sentence and pass it to the generation AI, and means for the terminal to receive the response from the server and display it on an interactive screen. This enables the user to have natural conversations with the character quickly and efficiently.

[0687] "Interface means" refers to the means by which a user inputs character information, and includes fields and buttons for inputting information on the application screen.

[0688] "Terminal" refers to a device that is directly operated by a user, including devices such as smartphones, tablets, and computers.

[0689] A "server" refers to a computer system that receives, processes, generates, and transmits data, and is the main device that performs various processes.

[0690] "Generative AI" refers to an artificial intelligence model that generates a character's personality profile and response patterns, such as an AI model that performs natural language processing.

[0691] A "personality profile" is a collection of data that includes information such as a character's name, personality, hobbies, and typical response style.

[0692] "Answer pattern" refers to a group of information that serves as a standard or template when a character responds to a message from a user.

[0693] A "database" is a system for systematically storing and managing generated character information and other related data.

[0694] "Message" refers to information such as text or voice that a user sends to a character.

[0695] "Prompt text" refers to the words or data input to the generating AI to obtain a specific output, including the user's message and the contents of the character profile.

[0696] "Dialogue screen" refers to the screen within the application where the user and the character exchange messages, and is an area for displaying past conversation history and new messages.

[0697] The present invention is a system that allows users to enjoy natural conversations with characters. This system uses a generation AI to generate characters based on user input information, and allows users to interact with the characters in real time. Specific embodiments of the system are described below.

[0698] Entering character information

[0699] 1. How users enter character information

[0700] Users launch the application using a device such as a smartphone or tablet. The application provides an interface for entering character profile information, such as name, personality, hobbies, and favorite phrases. When the user enters this information and presses the send button, the device sends the entered information to the server.

[0701] Character Generation

[0702] 2. Character generation using generative AI

[0703] The server receives the user's input information sent from the device and passes it to the generation AI. The generation AI generates a character's personality profile and response patterns based on the provided information. The generated character profile includes the name, personality, hobbies, and typical response style. This information is stored in a database by the server.

[0704] User-character interaction

[0705] 3. How users initiate interactions

[0706] The user opens a dialogue screen within the application and enters a new message while past conversation history is displayed. For example, when the user enters "Sakura, how was your day?" and presses the send button, the device sends the message to the server.

[0707] 4. Message Processing by the Server

[0708] The server receives user messages sent from the device and passes them to the generation AI, which generates natural responses based on the message and the character's personality profile. The generated responses are received by the server and sent to the device.

[0709] View Responses

[0710] 5. Displaying Responses on the Device

[0711] The device receives the response sent back from the server and displays it to the user. For example, a response such as "Today was a good day. How was it for you?" is displayed. This allows the user to enjoy natural dialogue with the character.

[0712] Examples of concrete examples and prompts

[0713] Specific scenarios

[0714] Let's say a user creates a character named "Sakura" and sets her personality as "cheerful and kind" and her hobbies as "listening to music and cooking."

[0715] User Input: "Sakura, how was your day?"

[0716] Server Action:

[0717] 1. Pass the user's message to the generation AI.

[0718] 2. The generative AI generates a response: "Today was a good day. How was it for you?"

[0719] Display on terminal: The response is displayed to the user.

[0720] Prompt Sentence Examples

[0721] "Generate a response based on the following character information: The character's name is Sakura, her personality is cheerful and kind, and her hobbies are listening to music and cooking. The user's message is 'Sakura, how was your day?'"

[0722] In this way, the system of the present invention allows the user to have natural conversations with specific characters of their choice, thereby reducing feelings of loneliness and achieving mental stability.

[0723] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0724] Step 1:

[0725] User Action:

[0726] A user launches an application on their smartphone or tablet.

[0727] Input: The user taps the application icon to launch it.

[0728] Specific behavior:

[0729] Tap the application icon to launch it.

[0730] Output: The application starts and the character information input screen is displayed.

[0731] Step 2:

[0732] User Action:

[0733] The user enters character information through the application interface.

[0734] Input: Name, personality, hobbies, favorite phrases

[0735] Specific behavior:

[0736] Enter "Sakura" in the name field, "cheerful and kind" in the personality field, "listening to music and cooking" in the hobby field, and "Let's do our best today too!" in the favorite phrase field, then press the send button.

[0737] Output: The device receives the user's input information and generates data to send to the server.

[0738] Step 3:

[0739] Terminal operations:

[0740] The device sends the user's input information to the server.

[0741] Input: Character information entered by the user

[0742] Specific behavior:

[0743] After completing the input, press the send button to send an HTTP request to the server.

[0744] Output: The server receives the user's character information.

[0745] Step 4:

[0746] Server operations:

[0747] The server receives the user's input information sent from the terminal.

[0748] Input: Character information sent by the device

[0749] Specific behavior:

[0750] The server receives the HTTP request at the API endpoint and stores it in a database.

[0751] Output: The input information is saved on the server.

[0752] Step 5:

[0753] Server operations:

[0754] The server passes the received input information to the generation AI.

[0755] Input: Received character information

[0756] Specific behavior:

[0757] The server creates a prompt for the generation AI based on the input information and sends a request to the generation AI API.

[0758] Output: Character profile and answer patterns generated by the generation AI.

[0759] Step 6:

[0760] Generative AI operations:

[0761] Generative AI generates a character's personality profile and answer patterns based on the information provided.

[0762] Input: Character information formatted as a prompt sentence

[0763] Specific behavior:

[0764] The AI ​​generates a personality based on the name "Sakura," personality type "cheerful and kind," hobbies "listening to music and cooking," and favorite phrase "Let's do our best today too!" and returns that information.

[0765] Output: Generated character profile and answer patterns.

[0766] Step 7:

[0767] Server operations:

[0768] The server stores the generated character profile information in a database.

[0769] Input: Character profile information returned by the generated AI

[0770] Specific behavior:

[0771] The profile information returned from the generation AI is stored in a database.

[0772] Output: Character profile saved in database.

[0773] Step 8:

[0774] User Action:

[0775] The user opens a dialog box and enters a new message.

[0776] Input: User message "Sakura, how was your day?"

[0777] Specific behavior:

[0778] Open the dialogue screen, enter "Sakura, how was your day?" in the input field, and press the send button.

[0779] Output: The device generates data to send the user's message.

[0780] Step 9:

[0781] Terminal operations:

[0782] The device sends the user's message to the server.

[0783] Input: The message entered by the user

[0784] Specific behavior:

[0785] After entering the message, press the send button and an HTTP request will be sent to the server.

[0786] Output: The server receives the user's message.

[0787] Step 10:

[0788] Server operations:

[0789] The server receives the message sent from the terminal.

[0790] Input: User message sent by the terminal

[0791] Specific behavior:

[0792] The server receives a user message at an API endpoint.

[0793] Output: The message is saved on the server.

[0794] Step 11:

[0795] Server operations:

[0796] The server passes the received message to the generation AI, prompting it to generate a response.

[0797] Input: Received message and character profile

[0798] Specific behavior:

[0799] The server creates a prompt based on the user message and saved character profile information and sends a request to the generation AI API.

[0800] Output: A response is generated from the generation AI.

[0801] Step 12:

[0802] Generative AI operations:

[0803] Generative AI generates natural responses based on the user message and character profile.

[0804] Input: User message formatted as a prompt and character profile information

[0805] Specific behavior:

[0806] The generation AI generates a response based on the prompt and returns it to the server.

[0807] Output: The generated response.

[0808] Step 13:

[0809] Server operations:

[0810] The server receives the generated response and sends it to the terminal.

[0811] Input: The response returned by the generation AI

[0812] Specific behavior:

[0813] Receive the response from the generation AI and return it to the terminal as an HTTP response.

[0814] Output: The device receives the reply.

[0815] Step 14:

[0816] Terminal operations:

[0817] The device receives the response sent back from the server and displays it to the user.

[0818] Input: The response sent by the server

[0819] Specific behavior:

[0820] The device receives the response and displays it on the dialogue screen, for example, "Today was a good day. How was it for you?"

[0821] Output: User confirms response.

[0822] (Application example 1)

[0823] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0824] Food delivery services have become extremely popular in modern society, but conventional systems have a monotonous user interface and a lack of enjoyment in the ordering process. Furthermore, in order for users to make accurate menu selections, the system must provide appropriate recommendations to the user. However, conventional systems have difficulty making flexible suggestions based on user preferences. There is a need to provide a system that can solve these issues and enable users to order food delivery efficiently while still enjoying the process.

[0825] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0826] In this invention, the server includes an interface means for a user to input character information, a means for a terminal to receive input information from a user and transmit the information to the server, a means for the server to generate a character's personality profile and answer patterns using a generation AI based on the received information, a means for the server to store the generated character information in a database, a means for the terminal to transmit a message from the user to the server, a means for the server to pass the received message to the generation AI and generate a response, a means for the server to transmit the generated response to the terminal and the terminal to display the response, and a means for the user to receive recommendations through dialogue and place a desired delivery order. This enables the user to enjoy natural dialogue while receiving efficient and appropriate suggestions and placing a food delivery order.

[0827] "User" refers to a person who uses the system to interact with characters and order food delivery.

[0828] "Character information" refers to the character's profile information entered by the user, such as name, personality, hobbies, and favorite phrases.

[0829] "Interface" refers to the means by which a user inputs character information and messages.

[0830] "Terminal" refers to an electronic device such as a smartphone or tablet that transmits input information and messages from the user to the server.

[0831] "Server" refers to the central processing unit that receives user input information, uses generative AI to generate character profiles and responses, and stores them in a database.

[0832] "Generative AI" refers to artificial intelligence that generates characters based on user input and engages in natural conversations.

[0833] A "personality profile" is information created by the generative AI that compiles characteristics such as a character's personality, hobbies, and response style.

[0834] "Answer pattern" refers to a set of response mechanisms that the generative AI uses to generate dialogue between a character and a user.

[0835] "Database" refers to a storage device that stores generated character information and allows searching and retrieval as needed.

[0836] "Reply" refers to a response from a character that the generation AI generates in response to a user's message.

[0837] "Recommendations" refers to menu suggestions and ordering advice provided to users by the generative AI.

[0838] "Food delivery order" refers to a request for food delivery made by a user through interaction with a character.

[0839] MODE FOR CARRYING OUT THE INVENTION

[0840] The present invention is a food delivery system that allows users to place orders through natural interactions with a character. This system utilizes a generative AI model to generate a character based on user input and allows users to interact with the character in real time. Specific embodiments of the system are described below.

[0841] 1. The user enters character information

[0842] Users launch the application using a device such as a smartphone. The application provides an interface for entering profile information such as the character's name, personality, hobbies, and catchphrases. The information entered by the user is sent from the device to the server.

[0843] 2. Character Generation

[0844] The server receives the information sent by the user and passes it to the generation AI. The generation AI generates the character's personality profile and answer patterns based on the provided information. The generated information is saved in a database. This allows the created character information to be used when the user accesses the game again.

[0845] 3. User-character interaction

[0846] The user opens a dialogue screen within the application, enters a message, and sends it. For example, when the user enters "What's your recommendation today?" and presses the send button, the device sends the message to the server. The server passes the received message to the generation AI, which generates a natural response based on the character's personality profile.

[0847] 4. Displaying replies

[0848] The server sends the response generated by the AI ​​to the device, which then displays the response to the user. For example, the device may display a response such as, "Seafood pasta is recommended today." This process allows users to enjoy natural conversations with the character while ordering food delivery.

[0849] 5. Food delivery advisories

[0850] Through dialogue between the user and the character, the generative AI can suggest menu items based on the user's preferences. For example, if the user says, "I want to try something new," the generative AI can suggest, "How about a new vegan menu item?" This allows users to make the best choice while enjoying dialogue with the character, rather than simply choosing a menu item.

[0851] Hardware and software used

[0852] The system's main hardware is the smartphones and tablets used by users. The server is equipped with a high-performance processing unit and a large-capacity database. The software used is the Flask framework for server-side processing, and OpenAI's GPT-3 is used as the generative AI model.

[0853] Examples of concrete examples and prompts

[0854] As a concrete example, let's say a user wants to create a character called "Delivery Assistant." The user enters the following information:

[0855] Name: Delivery Assistant

[0856] Personality: Kind and efficient

[0857] Hobbies: Proposing new dishes

[0858] Favorite phrase: "If you're hungry, leave it to me!"

[0859] When a user asks a character generated based on this information, "What's your recommended menu for dinner tonight?", the character responds, "Seafood pasta is delicious today." This response was generated by the AI ​​based on the character's personality profile selected by the user.

[0860] Example prompt sentence:

[0861] The delivery assistant is friendly and efficient, and his hobby is suggesting new dishes. Below is a chat with him / her.

[0862] User: What's your recommendation for dinner tonight?

[0863] Delivery Assistant:

[0864] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0865] Step 1:

[0866] The user launches the application using a device. The user enters character information (name, personality, hobbies, and catchphrases). This information is sent from the device to the server.

[0867] input:

[0868] Character information entered by the user through the interface.

[0869] output:

[0870] The terminal sends the input information to the server.

[0871] Operation:

[0872] When the user presses the "Submit" button, the input information is sent to the server via the Internet.

[0873] Step 2:

[0874] The server passes the received character information to the generation AI, which generates the character's personality profile and answer patterns based on the user's input.

[0875] input:

[0876] Character information sent from the device.

[0877] output:

[0878] Personality profile and answer patterns of characters generated by the generative AI.

[0879] Operation:

[0880] The server sends the information to the generation AI, which then generates a profile and stores that information in the server's database.

[0881] Step 3:

[0882] The user opens an interactive screen using a terminal, enters a message, and sends it. The message is then sent from the terminal to the server.

[0883] input:

[0884] A message entered by the user.

[0885] output:

[0886] The device sends a user message to the server.

[0887] Operation:

[0888] When the user presses the "send" button, the message is sent to the server.

[0889] Step 4:

[0890] The server passes the received message to a generation AI, which generates natural responses based on the character's personality profile.

[0891] input:

[0892] User messages and character personality profiles.

[0893] output:

[0894] A response generated by the generation AI.

[0895] Operation:

[0896] The generative AI uses prompt text to combine the user's message with the character's information to generate an appropriate response.

[0897] Step 5:

[0898] The server sends the response generated by the generation AI to the terminal, which displays the response.

[0899] input:

[0900] A response generated by the generation AI.

[0901] output:

[0902] The character's response will be displayed on the device.

[0903] Operation:

[0904] The server sends the generated response to the terminal, which displays the response on its screen.

[0905] Step 6:

[0906] Users can order food delivery through conversations with the character, who will then provide recommendations and suggestions to the user.

[0907] input:

[0908] An additional message that the user enters during the interaction.

[0909] output:

[0910] Additional suggestions and final ordering information.

[0911] Operation:

[0912] The user and the character continue to interact, with the generative AI providing successive replies and suggestions, until the user finally confirms the order.

[0913] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0914] ---

[0915] This invention is a system that allows users to enjoy natural conversations with specific characters, and further combines it with an emotion engine that recognizes the user's emotions and reflects them in responses. This system is designed so that a generation AI generates a character based on user input information and can provide advanced responses using the emotion engine.

[0916] Entering character information

[0917] How users enter information

[0918] Users launch a dedicated application on their smartphone, tablet, or other device. This application provides an interface for entering information such as the character's name, personality, hobbies, and favorite phrases. After entering this information, the user presses the send button, which causes the device to send the information to the server.

[0919] Character Generation

[0920] Server-based character generation

[0921] The server receives the input information sent by the user. Based on this information, the server issues commands to the generation AI to generate a character's personality profile and answer patterns. The generation AI creates a character profile based on the input information and stores it in a database on the server.

[0922] User-character interaction

[0923] How the user initiates the interaction

[0924] When a user opens a dialogue screen in the application, the device retrieves and displays past conversation history from the server. The user then enters a new message and presses the send button, at which point the device sends the message to the server.

[0925] Server Message Processing

[0926] The server receives messages sent by users and passes them to the generation AI, instructing it to generate a reply. The generation AI generates a reply to the user's message, taking into account the character's profile and answer patterns. The generated reply is returned to the server, and then sent from the server to the device. The device displays the reply to the user.

[0927] Introducing the Emotion Engine

[0928] Emotion analysis using an emotion engine

[0929] Furthermore, by using an emotion engine, emotions can be analyzed from user input information (e.g., text messages, voice input, etc.). The emotion engine analyzes the user's emotional state (e.g., happy, sad, angry, etc.) in real time and passes that emotional information to the generation AI.

[0930] Response generation that reflects emotional information

[0931] The server passes the emotion information obtained from the emotion engine to the generation AI, which then generates a response that takes the user's emotions into consideration. For example, if a user enters "I'm really tired today," the emotion engine identifies the emotion "tired," and the generation AI generates a corresponding response (e.g., "Thank you for your hard work today. Please take a short rest.").

[0932] Specific examples

[0933] For example, consider the process when a user sends a message saying, "Work was hard today." The user enters the message and presses the send button. The device sends the message to the server, and the server receives the message.

[0934] The server sends the received message to the emotion engine to analyze the user's emotions before passing it on to the generation AI. The emotion engine analyzes the "feeling of fatigue" from the user's text, "It was tough," and returns that emotional information to the server. The server then passes that emotional information to the generation AI, which then generates a response that takes the "feeling of fatigue" into account.

[0935] The generated response (for example, "Thank you for your hard work. Take a good rest today.") is sent to the terminal by the server, and the terminal displays the response to the user. In this way, the user can enjoy natural conversation with the character.

[0936] The system of the present invention allows users to enjoy natural, emotional conversations with specific characters, which in turn reduces feelings of loneliness and provides mental stability.

[0937] ---

[0938] The processing flow will be explained below.

[0939] ---

[0940] Entering character information

[0941] Step 1:

[0942] The user launches the app on their device, which displays an interface for the user to enter character information.

[0943] Step 2:

[0944] The user enters information into the interface, such as the character's name, personality, hobbies, and favorite phrases, and presses the "Submit" button.

[0945] Step 3:

[0946] The device converts the information entered by the user into JSON format.

[0947] Step 4:

[0948] The terminal sends an HTTP POST request to the server and transmits the input information.

[0949] Character Generation

[0950] Step 5:

[0951] The server receives the POST request sent from the terminal and parses the user input information from the payload.

[0952] Step 6:

[0953] The server passes the analyzed information to the generation AI, instructing it to generate the character's personality profile and response patterns.

[0954] Step 7:

[0955] The generative AI generates a character's personality profile and answer patterns based on the information provided.

[0956] Step 8:

[0957] The server stores the generated character information in a database.

[0958] User-character interaction

[0959] Step 9:

[0960] The user opens a dialogue screen within the application. The device retrieves and displays the conversation history from the server.

[0961] Step 10:

[0962] The user enters a new message into the interactive screen and presses the send button.

[0963] Step 11:

[0964] The terminal converts the input message into JSON format.

[0965] Step 12:

[0966] The device sends an HTTP POST request containing the user message to the server.

[0967] Step 13:

[0968] The server receives and analyzes the message sent by the user.

[0969] Step 14:

[0970] The server sends the received message to the emotion engine and instructs it to perform emotion analysis.

[0971] Step 15:

[0972] The emotion engine analyzes the content of the message, identifies the user's emotional state, and sends the emotion information back to the server.

[0973] Step 16:

[0974] The server passes emotional information to the generation AI, instructing it to generate a response that takes the user's emotions into account.

[0975] Step 17:

[0976] Generative AI generates responses to user messages based on the character's personality profile and emotional information.

[0977] Step 18:

[0978] The server receives the generated response message and converts it to JSON format.

[0979] Step 19:

[0980] The server sends an HTTP POST request containing a response message to the terminal.

[0981] Step 20:

[0982] The terminal receives the response message sent from the server, analyzes it, and displays it.

[0983] Step 21:

[0984] The user checks the response from the character displayed on the terminal and enters the next message.

[0985] ---

[0986] The above is a specific flow of processing of the invention that uses an emotion engine.

[0987] Example 2

[0988] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0989] Conventional dialogue systems have made it difficult for users to enjoy natural conversations with characters. Furthermore, they lacked a system that could recognize the user's emotions and automatically generate appropriate responses. As a result, users often felt lonely or responses were unnatural.

[0990] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for passing the user's message to an emotion analysis engine to acquire emotion information, a means for passing the emotion information to a generative AI model and generating a response that takes emotion into consideration, and a means for sending the generated response to the terminal and for the terminal to display the response. This enables natural dialogue according to the user's emotion.

[0991] 1. "Interface means" refers to the function used by the user to input character information.

[0992] 2. "Terminal" refers to a device used by a User to input and transmit information.

[0993] 3. "Generative AI Model" refers to artificial intelligence software that generates a character's personality profile and response patterns based on information received from the user.

[0994] 4. "Database" refers to the storage area within the system for storing generated character information.

[0995] 5. "Sentiment Analysis Engine" means software used to analyze and extract emotional information from users' messages.

[0996] 6. "Reply" refers to a response generated by a server or a generative AI model in response to a user's message.

[0997] 7. "Natural dialogue" refers to dialogue that is natural to the user, fluent, and takes place in an appropriate context.

[0998] This invention is a system that allows users to enjoy natural conversations with specific characters, and further combines it with an emotion analysis engine that recognizes the user's emotions and reflects them in responses. This system is designed so that a generative AI model generates a character based on user input information and can provide advanced responses using emotion analysis.

[0999] Entering character information

[1000] How users enter information

[1001] Users launch a dedicated application on their smartphone, tablet, or other device. This application provides an interface for entering information such as the character's name, personality, hobbies, and favorite phrases. After entering this information, the user presses the send button, which causes the device to send the information to the server.

[1002] Examples:

[1003] The user enters the following information into the app's form: "Name: Akane," "Personality: Cheerful," "Hobbies: Music," and "Phrase: Good morning!"

[1004] When the user taps the send button, the device sends the information in JSON format to the server.

[1005] Character Generation

[1006] Server-based character generation

[1007] The server receives the input information sent by the user. Based on the received information, the server issues commands to the generative AI model to generate the character's personality profile and response patterns. The generative AI model used is, for example, OpenAI's GPT-4. The generated profile is stored in a database on the server.

[1008] Examples:

[1009] The server sends a prompt to the generative AI model saying, "Create a character's personality profile and response patterns from this information."

[1010] The generative AI generates a profile and stores it in a database on the server.

[1011] User-character interaction

[1012] How the user initiates the interaction

[1013] When a user opens a dialogue screen in the application, the device retrieves and displays the past conversation history from the server. The user then enters a new message and presses the send button. At this time, the device sends the message to the server.

[1014] Examples:

[1015] The user types "Happy birthday!" and taps the send button.

[1016] The device sends a message to the server.

[1017] Server Message Processing

[1018] The server receives messages sent by users and passes them to a generative AI model to generate a reply. The generative AI generates a reply to the user message while taking into account the character's profile and answer patterns. The generated reply is sent from the server to the device, and the device displays the reply to the user.

[1019] Examples:

[1020] The server sends a prompt to the generated AI model saying, "You have received a message from the user. Please create a reply to this message taking into account the character's profile."

[1021] The generation AI generates a reply saying "Nice to meet you!" and returns it to the server.

[1022] Introducing a sentiment analysis engine

[1023] Emotion analysis using an emotion analysis engine

[1024] Furthermore, by using a sentiment analysis engine, emotions can be analyzed from user input information (e.g., text messages, voice input, etc.). The sentiment analysis engine uses, for example, IBM Watson's sentiment analysis API. The sentiment analysis engine analyzes the user's emotional state in real time and passes that emotional information to the generative AI model.

[1025] Examples:

[1026] The server sends the message "Thank you for your continued support today!" to the emotion analysis engine, and obtains "positive" emotion as the analysis result.

[1027] Response generation that reflects emotional information

[1028] The server passes the acquired emotional information to the generative AI model and instructs it to generate a response that takes the user's emotions into account. The generative AI then takes the emotional information into account and generates an appropriate response.

[1029] Examples:

[1030] The server sends the generative AI model a prompt message: "The user sent the message 'Have a great day!' with positive emotions. Generate a response to this."

[1031] The generation AI generates a reply saying "Nice to meet you!" and returns it to the server.

[1032] In this way, it is possible to realize natural conversations between the user and the character with high accuracy. This system allows the user to enjoy natural conversations with specific characters that are accompanied by emotions, which in turn reduces feelings of loneliness and improves mental stability.

[1033] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1034] Step 1:

[1035] User enters and submits character information

[1036] The user launches a dedicated application and inputs information such as the character's name, personality, hobbies, phrases, etc. When the user presses the send button, the device sends this information to the server.

[1037] Input: Character information entered by the user into the app (e.g., "Name: Akane," "Personality: Cheerful," "Hobbies: Music," "Phrase: Good morning!")

[1038] Data processing: The device converts the input information into pseudo-structured data (e.g., JSON).

[1039] Output: The submitted pseudo-structured data arrives at the server.

[1040] Specific behavior: The user enters information into the app's form and taps the submit button. The device converts the information into JSON format and sends it to the server.

[1041] Step 2:

[1042] The server receives and formats character information

[1043] The server receives character information submitted by the user and formats it into the appropriate form to be passed to the generative AI model.

[1044] Input: Pseudo-structured data (e.g. JSON) sent from the device

[1045] Data processing: The server formats the received data into the required format (e.g., converting it back to plain text)

[1046] Output: Formatted data (e.g. character information in text format)

[1047] Specific operation: The server parses the JSON format data, extracts the necessary information, and formats it.

[1048] Step 3:

[1049] The server instructs the generation AI to generate a character.

[1050] The server passes the formatted character information to a generative AI model, instructing it to generate the character's personality profile and response patterns.

[1051] Input: Formatted character information (e.g., text format)

[1052] Data computation: Generative AI models generate character profiles and response patterns

[1053] Output: Generated character profile and answer patterns (e.g., returned in JSON format)

[1054] Specific operation: The server issues a command to the generative AI model to "create a character's personality profile and response patterns from this information." The generative AI generates a profile and stores it in the server's database.

[1055] Step 4:

[1056] User initiates interaction

[1057] When a user opens the application's interactive screen, the device retrieves and displays past conversation history from the server, and the user enters a new message and presses the send button.

[1058] Input: The user's new message (e.g., "Happy birthday!")

[1059] Data processing: The device converts the message into pseudo-structured data (e.g., JSON)

[1060] Output: The sent message arrives at the server

[1061] Specific behavior: The user types "Have a nice day!" and taps the send button. The device converts the message into JSON format and sends it to the server.

[1062] Step 5:

[1063] The server receives and processes the user's message.

[1064] The server receives messages sent by users and performs any necessary pre-processing (e.g. text cleaning) before passing them to the sentiment analysis engine.

[1065] Input: Pseudo-structured data sent by the user (e.g., a message in JSON format)

[1066] Data processing: The server cleans the message and prepares it for the sentiment analysis engine

[1067] Output: Cleaned text data

[1068] What happens: The server receives the user's message ("Happy New Year!") and removes any unnecessary characters or data.

[1069] Step 6:

[1070] The server sends the user's message to the sentiment analysis engine

[1071] The server sends the cleaned message to a sentiment analysis engine to obtain sentiment information.

[1072] Input: Cleaned text data (e.g., "Happy Birthday!")

[1073] Data calculation: The emotion analysis engine analyzes emotions and generates emotion information

[1074] Output: Emotion information (e.g., "positive")

[1075] Specific operation: The server sends the message "Thank you for your continued support today!" to the sentiment analysis engine, and obtains "positive" sentiment as the analysis result.

[1076] Step 7:

[1077] Server generates response using AI

[1078] The server passes the acquired emotional information and message to the generative AI model, instructing it to generate a response that takes the user's emotions into account.

[1079] Input: Emotion information (e.g., "Positive") and message (e.g., "Have a great day!")

[1080] Data computation: Generative AI models generate responses based on emotional information

[1081] Output: The generated response (e.g. "Nice to meet you!")

[1082] Specific operation: The server sends the command to the generative AI model: "A user sends a message with positive emotions saying, 'Have a nice day!' Generate a response to this." The generative AI generates a response saying, "Thank you very much!" and returns it to the server.

[1083] Step 8:

[1084] The server sends a response to the device

[1085] The server receives the response returned by the generation AI and sends it to the user's device.

[1086] Input: Generated response (e.g. "Nice to meet you!")

[1087] Data processing: Convert the response into pseudo-structured data (e.g., JSON format)

[1088] Output: Response data arrives at the terminal

[1089] Specific behavior: The server converts the generated response into JSON format and sends it to the user's device.

[1090] Step 9:

[1091] The device displays the response to the user

[1092] The device receives the response sent by the server and displays it to the user within the application.

[1093] Input: Pseudo-structured data sent by the server (e.g., a JSON response)

[1094] Data processing: Convert responses into display format

[1095] Output: Response displayed on screen (e.g. "Character: Nice to meet you!")

[1096] Specific behavior: The device displays the response it receives on the screen so that the user can review it.

[1097] The above is a detailed description of the specific processing steps of the system program and their respective operations.

[1098] (Application example 2)

[1099] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1100] While conventional factory robots are useful for improving production work and efficiency, they do not address the mental health and communication needs of employees. As a result, employees do not receive appropriate feedback on emotions such as stress and fatigue they feel while working, which can lead to a decline in work efficiency. In addition, the lack of communication between employees and robots makes it difficult for the robots to provide detailed support.

[1101] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for recording the user's voice message and sending it to the server, means for the server to pass the voice message to an emotion engine and analyze the emotional state, and means for the generation AI to generate a response based on the emotion information analyzed by the server. This generates a response that corresponds to the user's emotion, making it possible to have a natural conversation while taking into consideration the mental health of employees.

[1102] "Users" refer to factory employees and human operators.

[1103] "Interface means" refers to devices such as smartphones, tablets, and smart glasses, and their applications, which employees use to input character information and messages.

[1104] "Device" refers to a hardware device used by a user to input and receive information, such as a smartphone, smart glasses, or head-mounted display.

[1105] "Server" refers to the computer system on the network that is required to receive input information and messages from users, store them in a database, and process them using generative AI and emotion engines.

[1106] "Generative AI" refers to artificial intelligence that automatically generates a character's personality profile and answer patterns based on information entered by the user.

[1107] A "character personality profile" refers to information about a character's characteristics and personality that is created by the AI ​​based on information entered by the user, such as the character's name, personality, hobbies, and favorite phrases.

[1108] "Answer pattern" refers to the response pattern to a user's message that the generation AI generates based on the character's personality profile.

[1109] The "database" refers to a system that stores the personality profiles and conversation histories of characters created by the generative AI.

[1110] "Message" refers to text or voice information entered by a user when interacting with a device.

[1111] "Emotion engine" refers to software that analyzes user input and identifies the user's emotional state (e.g., joy, sadness, anger, fatigue, etc.).

[1112] "Emotional information" refers to data regarding the user's emotional state analyzed by the emotion engine.

[1113] "Reply" refers to a response from a character that the generation AI generates based on the user's message and emotional information.

[1114] System Overview

[1115] This invention is a system that allows users to enjoy natural conversations with specific characters. It also combines an emotion engine that recognizes the user's emotions and reflects them in responses. This system is designed so that a generative AI generates a character based on user input information and can provide sophisticated responses using the emotion engine. In a factory environment, natural conversations between workers and robots are realized.

[1116] Entering character information

[1117] How users enter information

[1118] Users launch a dedicated application using a device such as a smartphone, smart glasses, or head-mounted display. This application provides an interface for inputting information such as the character's name, personality, hobbies, and favorite phrases. After entering this information, the user presses the send button, and the device sends the input information to the server.

[1119] Character Generation

[1120] Server-based character generation

[1121] The server receives input information sent by the user. Based on this information, it issues commands to the generation AI to generate a character's personality profile and response patterns. The generation AI creates a character profile based on the input information and stores it in a database on the server.

[1122] User-character interaction

[1123] How the user initiates the interaction

[1124] When a user opens a dialogue screen in the application, the device retrieves and displays past conversation history from the server. The user then enters a new message and presses the send button, at which point the device sends the message to the server.

[1125] Server Message Processing

[1126] The server receives messages sent by users and passes them to the generation AI, instructing it to generate a reply. The generation AI generates a reply to the user's message, taking into account the character's profile and answer patterns. The generated reply is returned to the server, and then sent from the server to the device. The device displays the reply to the user.

[1127] Introducing the Emotion Engine

[1128] Emotion analysis using an emotion engine

[1129] Furthermore, by using an emotion engine, emotions can be analyzed from user input information (e.g., text messages, voice input, etc.). The emotion engine analyzes the user's emotional state (e.g., happy, sad, angry, etc.) in real time and passes that emotional information to the generation AI.

[1130] Response generation that reflects emotional information

[1131] The server passes the emotion information obtained from the emotion engine to the generation AI, which then generates a response that takes the user's emotions into consideration. For example, if a user enters "I'm really tired today," the emotion engine identifies the emotion "tired," and the generation AI generates a corresponding response (e.g., "Thank you for your hard work today. Please take a short rest.").

[1132] Specific examples

[1133] Specifically, when a factory worker says through their smart glasses, "Machine maintenance is tough today," the smart glasses send a voice message to the server. The server uses an emotion engine to analyze "stress" from this message and passes the results to the generation AI. The generation AI takes the emotional information into consideration and generates a response such as, "That's tough. If you look tired, please take a break," which the server then displays on the smart glasses.

[1134] Example prompt for a generative AI model:

[1135] "If an employee says, 'Machine maintenance is hard today,' the emotion engine detects stress and generates an appropriate response."

[1136] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1137] Step 1:

[1138] Input: The user enters character information (such as name, personality, hobbies, and favorite phrases) into a smartphone app.

[1139] Processing: The device receives input information from the user and sends it to the server.

[1140] Output: User input is passed to the server.

[1141] Step 2:

[1142] Input: User's character information received by the server.

[1143] Processing: The server issues commands to the generation AI based on the information received, generating the character's personality profile and response patterns.

[1144] Output: The generation AI generates character profiles and answer patterns, which the server stores in a database.

[1145] Step 3:

[1146] Input: The user types a new message through the smart glasses.

[1147] Processing: The device records the user's voice message and sends it to the server.

[1148] Output: The server receives the user's voice message.

[1149] Step 4:

[1150] Input: The user's voice message received by the server.

[1151] Processing: The server passes the voice message to the emotion engine to analyze the emotional state. The emotion engine extracts emotion data from the voice message.

[1152] Output: The emotion information analyzed by the emotion engine is returned to the server.

[1153] Step 5:

[1154] Input: Emotion information received by the server from the emotion engine and the user's message.

[1155] Processing: The server passes the emotion information and the user's message to the generation AI, instructing it to generate a response that reflects the emotion. The generation AI generates a response based on the emotion information.

[1156] Output: The generated response is returned to the server.

[1157] Step 6:

[1158] Input: The response received by the server from the generation AI.

[1159] Processing: The server generates a response and sends it to the terminal, which displays it to the user.

[1160] Output: The generated response is displayed on the user's smart glasses.

[1161] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1162] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1163] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1164] [Third embodiment]

[1165] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1166] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1167] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1168] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1169] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1170] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1171] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1172] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1173] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1174] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1175] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1176] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1177] ---

[1178] The present invention is a system that allows users to enjoy natural conversations with characters. This system uses a generation AI to generate characters based on user input information, and allows users to interact with the characters in real time. Specific embodiments of the system are described below.

[1179] 1. The user enters character information

[1180] How users enter information

[1181] Users launch the application using a device such as a smartphone or tablet. The application provides an interface for entering character profile information, such as name, personality, hobbies, and favorite phrases. When the user enters this information and presses the send button, the device sends the entered information to the server.

[1182] 2. Character Generation

[1183] Server-based character generation

[1184] The server receives the user's input information sent from the device and passes it to the generation AI. The generation AI generates a character's personality profile and response patterns based on the provided information. The generated character profile includes the name, personality, hobbies, and typical response style. This information is stored in a database by the server.

[1185] 3. User-character interaction

[1186] How the user initiates the interaction

[1187] The user opens a dialogue screen within the application and enters a new message while past conversation history is displayed. For example, when the user enters "Sakura, how was your day?" and presses the send button, the device sends the message to the server.

[1188] Server Message Processing

[1189] The server receives user messages sent from the device and passes them to the generation AI, which generates natural responses based on the message and the character's personality profile. The responses generated by the generation AI are received by the server and sent to the device.

[1190] 4. Displaying replies

[1191] Display of response by terminal

[1192] The device receives the response sent back from the server and displays it to the user. For example, a response such as "Today was a good day. How was it for you?" is displayed. This process allows the user to enjoy natural dialogue with the character.

[1193] Specific examples

[1194] As a concrete example, consider a case where a user wants to create a character named "Sakura" who has a bright and kind personality. The user uses an application on their device to enter the following information:

[1195] Name: Sakura

[1196] Personality: Cheerful and kind

[1197] Hobbies: Listening to music and cooking

[1198] Favorite phrase: "Let's do our best today!"

[1199] When a user enters information and presses the send button, the device sends this information to the server, which then invokes the AI ​​generator to generate Sakura's personality profile and response patterns based on this information, and stores the generated information in a database.

[1200] Then, when the user sends a message like "Sakura, how was your day?", the server passes this message to the AI ​​generator, which generates a response. For example, "It was a great day today. How was your day?" This response is generated, sent to the device, and displayed to the user.

[1201] In this way, the system of the present invention allows the user to have natural conversations with a specific character of their choice, thereby reducing feelings of loneliness and achieving mental stability.

[1202] The processing flow will be explained below.

[1203] ---

[1204] Entering character information

[1205] Step 1:

[1206] The user launches the app on their device, which provides the user with an interface for entering character profile information.

[1207] Step 2:

[1208] The device receives information entered by the user, such as name, personality, hobbies, and favorite phrases.

[1209] Step 3:

[1210] The user enters various information into the input form and presses the "Submit" button.

[1211] Step 4:

[1212] The terminal converts the input information into JSON format.

[1213] Step 5:

[1214] The device sends JSON format data to the server as an HTTP POST request.

[1215] Character Generation

[1216] Step 6:

[1217] The server receives the POST request sent from the terminal and parses the user input information from the payload.

[1218] Step 7:

[1219] The server passes the analyzed information to the generation AI, instructing it to generate the character's personality profile and response patterns.

[1220] Step 8:

[1221] The generative AI generates a character's personality profile and answer patterns based on the information provided.

[1222] Step 9:

[1223] The server stores the generated character information in a database.

[1224] User-character interaction

[1225] Step 10:

[1226] The user opens a dialogue screen within the application. The device retrieves and displays the past conversation history from the server.

[1227] Step 11:

[1228] The user enters a new message in the interactive screen and presses the send button.

[1229] Step 12:

[1230] The terminal converts the input message into JSON format.

[1231] Step 13:

[1232] The device sends an HTTP POST request containing the user message to the server.

[1233] Step 14:

[1234] The server receives and analyzes the message sent by the user.

[1235] Step 15:

[1236] The server passes the parsed message to the generation AI, instructing it to generate a response for the character.

[1237] Step 16:

[1238] Generative AI generates responses to user messages based on the character's personality profile.

[1239] Step 17:

[1240] The server receives the generated response message and converts it to JSON format.

[1241] Step 18:

[1242] The server sends an HTTP POST request containing a response message to the terminal.

[1243] Step 19:

[1244] The terminal receives the response message sent from the server, analyzes it, and displays it.

[1245] Step 20:

[1246] The user checks the response from the character displayed on the terminal and enters the next message.

[1247] ---

[1248] The above is a concrete explanation of the processing of the system program.

[1249] Example 1

[1250] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1251] Existing character dialogue systems have difficulty generating a character based on user-input information and engaging in natural dialogue with that character. Furthermore, the generated character may not meet the user's needs or may not be able to respond naturally in certain situations. Furthermore, there is a need for a system that can efficiently process user-input information and respond quickly.

[1252] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1253] In this invention, the server includes interface means for the user to input character information, means for the terminal to receive input information from the user and transmit the information to the server, means for the server to generate a character's personality profile and answer patterns using the generation AI based on the received information, means for the server to store the generated character information in a database, means for the terminal to transmit a message from the user to the server, means for the server to pass the received message to the generation AI and generate a response, means for the server to transmit the generated response to the terminal and display the response, means for the server to generate a request to the generation AI as a prompt sentence and pass it to the generation AI, and means for the terminal to receive the response from the server and display it on an interactive screen. This enables the user to have natural conversations with the character quickly and efficiently.

[1254] "Interface means" refers to the means by which a user inputs character information, and includes fields and buttons for inputting information on the application screen.

[1255] "Terminal" refers to a device that is directly operated by a user, including devices such as smartphones, tablets, and computers.

[1256] A "server" refers to a computer system that receives, processes, generates, and transmits data, and is the main device that performs various processes.

[1257] "Generative AI" refers to an artificial intelligence model that generates a character's personality profile and response patterns, such as an AI model that performs natural language processing.

[1258] A "personality profile" is a collection of data that includes information such as a character's name, personality, hobbies, and typical response style.

[1259] "Answer pattern" refers to a group of information that serves as a standard or template when a character responds to a message from a user.

[1260] A "database" is a system for systematically storing and managing generated character information and other related data.

[1261] "Message" refers to information such as text or voice that a user sends to a character.

[1262] "Prompt text" refers to the words or data input to the generating AI to obtain a specific output, including the user's message and the contents of the character profile.

[1263] "Dialogue screen" refers to the screen within the application where the user and the character exchange messages, and is an area for displaying past conversation history and new messages.

[1264] The present invention is a system that allows users to enjoy natural conversations with characters. This system uses a generation AI to generate characters based on user input information, and allows users to interact with the characters in real time. Specific embodiments of the system are described below.

[1265] Entering character information

[1266] 1. How users enter character information

[1267] Users launch the application using a device such as a smartphone or tablet. The application provides an interface for entering character profile information, such as name, personality, hobbies, and favorite phrases. When the user enters this information and presses the send button, the device sends the entered information to the server.

[1268] Character Generation

[1269] 2. Character generation using generative AI

[1270] The server receives the user's input information sent from the device and passes it to the generation AI. The generation AI generates a character's personality profile and response patterns based on the provided information. The generated character profile includes the name, personality, hobbies, and typical response style. This information is stored in a database by the server.

[1271] User-character interaction

[1272] 3. How users initiate interactions

[1273] The user opens a dialogue screen within the application and enters a new message while past conversation history is displayed. For example, when the user enters "Sakura, how was your day?" and presses the send button, the device sends the message to the server.

[1274] 4. Message Processing by the Server

[1275] The server receives user messages sent from the device and passes them to the generation AI, which generates natural responses based on the message and the character's personality profile. The generated responses are received by the server and sent to the device.

[1276] View Responses

[1277] 5. Displaying Responses on the Device

[1278] The device receives the response sent back from the server and displays it to the user. For example, a response such as "Today was a good day. How was it for you?" is displayed. This allows the user to enjoy natural dialogue with the character.

[1279] Examples of concrete examples and prompts

[1280] Specific scenarios

[1281] Let's say a user creates a character named "Sakura" and sets her personality as "cheerful and kind" and her hobbies as "listening to music and cooking."

[1282] User Input: "Sakura, how was your day?"

[1283] Server Action:

[1284] 1. Pass the user's message to the generation AI.

[1285] 2. The generative AI generates a response: "Today was a good day. How was it for you?"

[1286] Display on terminal: The response is displayed to the user.

[1287] Prompt Sentence Examples

[1288] "Generate a response based on the following character information: The character's name is Sakura, her personality is cheerful and kind, and her hobbies are listening to music and cooking. The user's message is 'Sakura, how was your day?'"

[1289] In this way, the system of the present invention allows the user to have natural conversations with specific characters of their choice, thereby reducing feelings of loneliness and achieving mental stability.

[1290] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1291] Step 1:

[1292] User Action:

[1293] A user launches an application on their smartphone or tablet.

[1294] Input: The user taps the application icon to launch it.

[1295] Specific behavior:

[1296] Tap the application icon to launch it.

[1297] Output: The application starts and the character information input screen is displayed.

[1298] Step 2:

[1299] User Action:

[1300] The user enters character information through the application interface.

[1301] Input: Name, personality, hobbies, favorite phrases

[1302] Specific behavior:

[1303] Enter "Sakura" in the name field, "cheerful and kind" in the personality field, "listening to music and cooking" in the hobby field, and "Let's do our best today too!" in the favorite phrase field, then press the send button.

[1304] Output: The device receives the user's input information and generates data to send to the server.

[1305] Step 3:

[1306] Terminal operations:

[1307] The device sends the user's input information to the server.

[1308] Input: Character information entered by the user

[1309] Specific behavior:

[1310] After completing the input, press the send button to send an HTTP request to the server.

[1311] Output: The server receives the user's character information.

[1312] Step 4:

[1313] Server operations:

[1314] The server receives the user's input information sent from the terminal.

[1315] Input: Character information sent by the device

[1316] Specific behavior:

[1317] The server receives the HTTP request at the API endpoint and stores it in a database.

[1318] Output: The input information is saved on the server.

[1319] Step 5:

[1320] Server operations:

[1321] The server passes the received input information to the generation AI.

[1322] Input: Received character information

[1323] Specific behavior:

[1324] The server creates a prompt for the generation AI based on the input information and sends a request to the generation AI API.

[1325] Output: Character profile and answer patterns generated by the generation AI.

[1326] Step 6:

[1327] Generative AI operations:

[1328] Generative AI generates a character's personality profile and answer patterns based on the information provided.

[1329] Input: Character information formatted as a prompt sentence

[1330] Specific behavior:

[1331] The AI ​​generates a personality based on the name "Sakura," personality type "cheerful and kind," hobbies "listening to music and cooking," and favorite phrase "Let's do our best today too!" and returns that information.

[1332] Output: Generated character profile and answer patterns.

[1333] Step 7:

[1334] Server operations:

[1335] The server stores the generated character profile information in a database.

[1336] Input: Character profile information returned by the generated AI

[1337] Specific behavior:

[1338] The profile information returned from the generation AI is stored in a database.

[1339] Output: Character profile saved in database.

[1340] Step 8:

[1341] User Action:

[1342] The user opens a dialog box and enters a new message.

[1343] Input: User message "Sakura, how was your day?"

[1344] Specific behavior:

[1345] Open the dialogue screen, enter "Sakura, how was your day?" in the input field, and press the send button.

[1346] Output: The device generates data to send the user's message.

[1347] Step 9:

[1348] Terminal operations:

[1349] The device sends the user's message to the server.

[1350] Input: The message entered by the user

[1351] Specific behavior:

[1352] After entering the message, press the send button and an HTTP request will be sent to the server.

[1353] Output: The server receives the user's message.

[1354] Step 10:

[1355] Server operations:

[1356] The server receives the message sent from the terminal.

[1357] Input: User message sent by the terminal

[1358] Specific behavior:

[1359] The server receives a user message at an API endpoint.

[1360] Output: The message is saved on the server.

[1361] Step 11:

[1362] Server operations:

[1363] The server passes the received message to the generation AI, prompting it to generate a response.

[1364] Input: Received message and character profile

[1365] Specific behavior:

[1366] The server creates a prompt based on the user message and saved character profile information and sends a request to the generation AI API.

[1367] Output: A response is generated from the generation AI.

[1368] Step 12:

[1369] Generative AI operations:

[1370] Generative AI generates natural responses based on the user message and character profile.

[1371] Input: User message formatted as a prompt and character profile information

[1372] Specific behavior:

[1373] The generation AI generates a response based on the prompt and returns it to the server.

[1374] Output: The generated response.

[1375] Step 13:

[1376] Server operations:

[1377] The server receives the generated response and sends it to the terminal.

[1378] Input: The response returned by the generation AI

[1379] Specific behavior:

[1380] Receive the response from the generation AI and return it to the terminal as an HTTP response.

[1381] Output: The device receives the reply.

[1382] Step 14:

[1383] Terminal operations:

[1384] The device receives the response sent back from the server and displays it to the user.

[1385] Input: The response sent by the server

[1386] Specific behavior:

[1387] The device receives the response and displays it on the dialogue screen, for example, "Today was a good day. How was it for you?"

[1388] Output: User confirms response.

[1389] (Application example 1)

[1390] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1391] Food delivery services have become extremely popular in modern society, but conventional systems have a monotonous user interface and a lack of enjoyment in the ordering process. Furthermore, in order for users to make accurate menu selections, the system must provide appropriate recommendations to the user. However, conventional systems have difficulty making flexible suggestions based on user preferences. There is a need to provide a system that can solve these issues and enable users to order food delivery efficiently while still enjoying the process.

[1392] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1393] In this invention, the server includes an interface means for a user to input character information, a means for a terminal to receive input information from a user and transmit the information to the server, a means for the server to generate a character's personality profile and answer patterns using a generation AI based on the received information, a means for the server to store the generated character information in a database, a means for the terminal to transmit a message from the user to the server, a means for the server to pass the received message to the generation AI and generate a response, a means for the server to transmit the generated response to the terminal and the terminal to display the response, and a means for the user to receive recommendations through dialogue and place a desired delivery order. This enables the user to enjoy natural dialogue while receiving efficient and appropriate suggestions and placing a food delivery order.

[1394] "User" refers to a person who uses the system to interact with characters and order food delivery.

[1395] "Character information" refers to the character's profile information entered by the user, such as name, personality, hobbies, and favorite phrases.

[1396] "Interface" refers to the means by which a user inputs character information and messages.

[1397] "Terminal" refers to an electronic device such as a smartphone or tablet that transmits input information and messages from the user to the server.

[1398] "Server" refers to the central processing unit that receives user input information, uses generative AI to generate character profiles and responses, and stores them in a database.

[1399] "Generative AI" refers to artificial intelligence that generates characters based on user input and engages in natural conversations.

[1400] A "personality profile" is information created by the generative AI that compiles characteristics such as a character's personality, hobbies, and response style.

[1401] "Answer pattern" refers to a set of response mechanisms that the generative AI uses to generate dialogue between a character and a user.

[1402] "Database" refers to a storage device that stores generated character information and allows searching and retrieval as needed.

[1403] "Reply" refers to a response from a character that the generation AI generates in response to a user's message.

[1404] "Recommendations" refers to menu suggestions and ordering advice provided to users by the generative AI.

[1405] "Food delivery order" refers to a request for food delivery made by a user through interaction with a character.

[1406] MODE FOR CARRYING OUT THE INVENTION

[1407] The present invention is a food delivery system that allows users to place orders through natural interactions with a character. This system utilizes a generative AI model to generate a character based on user input and allows users to interact with the character in real time. Specific embodiments of the system are described below.

[1408] 1. The user enters character information

[1409] Users launch the application using a device such as a smartphone. The application provides an interface for entering profile information such as the character's name, personality, hobbies, and catchphrases. The information entered by the user is sent from the device to the server.

[1410] 2. Character Generation

[1411] The server receives the information sent by the user and passes it to the generation AI. The generation AI generates the character's personality profile and answer patterns based on the provided information. The generated information is saved in a database. This allows the created character information to be used when the user accesses the game again.

[1412] 3. User-character interaction

[1413] The user opens a dialogue screen within the application, enters a message, and sends it. For example, when the user enters "What's your recommendation today?" and presses the send button, the device sends the message to the server. The server passes the received message to the generation AI, which generates a natural response based on the character's personality profile.

[1414] 4. Displaying replies

[1415] The server sends the response generated by the AI ​​to the device, which then displays the response to the user. For example, the device may display a response such as, "Seafood pasta is recommended today." This process allows users to enjoy natural conversations with the character while ordering food delivery.

[1416] 5. Food delivery advisories

[1417] Through dialogue between the user and the character, the generative AI can suggest menu items based on the user's preferences. For example, if the user says, "I want to try something new," the generative AI can suggest, "How about a new vegan menu item?" This allows users to make the best choice while enjoying dialogue with the character, rather than simply choosing a menu item.

[1418] Hardware and software used

[1419] The system's main hardware is the smartphones and tablets used by users. The server is equipped with a high-performance processing unit and a large-capacity database. The software used is the Flask framework for server-side processing, and OpenAI's GPT-3 is used as the generative AI model.

[1420] Examples of concrete examples and prompts

[1421] As a concrete example, let's say a user wants to create a character called "Delivery Assistant." The user enters the following information:

[1422] Name: Delivery Assistant

[1423] Personality: Kind and efficient

[1424] Hobbies: Proposing new dishes

[1425] Favorite phrase: "If you're hungry, leave it to me!"

[1426] When a user asks a character generated based on this information, "What's your recommended menu for dinner tonight?", the character responds, "Seafood pasta is delicious today." This response was generated by the AI ​​based on the character's personality profile selected by the user.

[1427] Example prompt sentence:

[1428] The delivery assistant is friendly and efficient, and his hobby is suggesting new dishes. Below is a chat with him / her.

[1429] User: What's your recommendation for dinner tonight?

[1430] Delivery Assistant:

[1431] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1432] Step 1:

[1433] The user launches the application using a device. The user enters character information (name, personality, hobbies, and catchphrases). This information is sent from the device to the server.

[1434] input:

[1435] Character information entered by the user through the interface.

[1436] output:

[1437] The terminal sends the input information to the server.

[1438] Operation:

[1439] When the user presses the "Submit" button, the input information is sent to the server via the Internet.

[1440] Step 2:

[1441] The server passes the received character information to the generation AI, which generates the character's personality profile and answer patterns based on the user's input.

[1442] input:

[1443] Character information sent from the device.

[1444] output:

[1445] Personality profile and answer patterns of characters generated by the generative AI.

[1446] Operation:

[1447] The server sends the information to the generation AI, which then generates a profile and stores that information in the server's database.

[1448] Step 3:

[1449] The user opens an interactive screen using a terminal, enters a message, and sends it. The message is then sent from the terminal to the server.

[1450] input:

[1451] A message entered by the user.

[1452] output:

[1453] The device sends a user message to the server.

[1454] Operation:

[1455] When the user presses the "send" button, the message is sent to the server.

[1456] Step 4:

[1457] The server passes the received message to a generation AI, which generates natural responses based on the character's personality profile.

[1458] input:

[1459] User messages and character personality profiles.

[1460] output:

[1461] A response generated by the generation AI.

[1462] Operation:

[1463] The generative AI uses prompt text to combine the user's message with the character's information to generate an appropriate response.

[1464] Step 5:

[1465] The server sends the response generated by the generation AI to the terminal, which displays the response.

[1466] input:

[1467] A response generated by the generation AI.

[1468] output:

[1469] The character's response will be displayed on the device.

[1470] Operation:

[1471] The server sends the generated response to the terminal, which displays the response on its screen.

[1472] Step 6:

[1473] Users can order food delivery through conversations with the character, who will then provide recommendations and suggestions to the user.

[1474] input:

[1475] An additional message that the user enters during the interaction.

[1476] output:

[1477] Additional suggestions and final ordering information.

[1478] Operation:

[1479] The user and the character continue to interact, with the generative AI providing successive replies and suggestions, until the user finally confirms the order.

[1480] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1481] ---

[1482] This invention is a system that allows users to enjoy natural conversations with specific characters, and further combines it with an emotion engine that recognizes the user's emotions and reflects them in responses. This system is designed so that a generation AI generates a character based on user input information and can provide advanced responses using the emotion engine.

[1483] Entering character information

[1484] How users enter information

[1485] Users launch a dedicated application on their smartphone, tablet, or other device. This application provides an interface for entering information such as the character's name, personality, hobbies, and favorite phrases. After entering this information, the user presses the send button, which causes the device to send the information to the server.

[1486] Character Generation

[1487] Server-based character generation

[1488] The server receives the input information sent by the user. Based on this information, the server issues commands to the generation AI to generate a character's personality profile and answer patterns. The generation AI creates a character profile based on the input information and stores it in a database on the server.

[1489] User-character interaction

[1490] How the user initiates the interaction

[1491] When a user opens a dialogue screen in the application, the device retrieves and displays past conversation history from the server. The user then enters a new message and presses the send button, at which point the device sends the message to the server.

[1492] Server Message Processing

[1493] The server receives messages sent by users and passes them to the generation AI, instructing it to generate a reply. The generation AI generates a reply to the user's message, taking into account the character's profile and answer patterns. The generated reply is returned to the server, and then sent from the server to the device. The device displays the reply to the user.

[1494] Introducing the Emotion Engine

[1495] Emotion analysis using an emotion engine

[1496] Furthermore, by using an emotion engine, emotions can be analyzed from user input information (e.g., text messages, voice input, etc.). The emotion engine analyzes the user's emotional state (e.g., happy, sad, angry, etc.) in real time and passes that emotional information to the generation AI.

[1497] Response generation that reflects emotional information

[1498] The server passes the emotion information obtained from the emotion engine to the generation AI, which then generates a response that takes the user's emotions into consideration. For example, if a user enters "I'm really tired today," the emotion engine identifies the emotion "tired," and the generation AI generates a corresponding response (e.g., "Thank you for your hard work today. Please take a short rest.").

[1499] Specific examples

[1500] For example, consider the process when a user sends a message saying, "Work was hard today." The user enters the message and presses the send button. The device sends the message to the server, and the server receives the message.

[1501] The server sends the received message to the emotion engine to analyze the user's emotions before passing it on to the generation AI. The emotion engine analyzes the "feeling of fatigue" from the user's text, "It was tough," and returns that emotional information to the server. The server then passes that emotional information to the generation AI, which then generates a response that takes the "feeling of fatigue" into consideration.

[1502] The generated response (for example, "Thank you for your hard work. Take a good rest today.") is sent to the terminal by the server, and the terminal displays the response to the user. In this way, the user can enjoy natural conversation with the character.

[1503] The system of the present invention allows users to enjoy natural, emotional dialogue with specific characters, thereby reducing feelings of loneliness and achieving mental stability.

[1504] ---

[1505] The processing flow will be explained below.

[1506] ---

[1507] Entering character information

[1508] Step 1:

[1509] The user launches the app on their device, which displays an interface for the user to enter character information.

[1510] Step 2:

[1511] The user enters information into the interface, such as the character's name, personality, hobbies, and favorite phrases, and presses the "Submit" button.

[1512] Step 3:

[1513] The device converts the information entered by the user into JSON format.

[1514] Step 4:

[1515] The terminal sends an HTTP POST request to the server and transmits the input information.

[1516] Character Generation

[1517] Step 5:

[1518] The server receives the POST request sent from the terminal and parses the user input information from the payload.

[1519] Step 6:

[1520] The server passes the analyzed information to the generation AI, instructing it to generate the character's personality profile and response patterns.

[1521] Step 7:

[1522] The generative AI generates a character's personality profile and answer patterns based on the information provided.

[1523] Step 8:

[1524] The server stores the generated character information in a database.

[1525] User-character interaction

[1526] Step 9:

[1527] The user opens a dialogue screen within the application. The device retrieves and displays the conversation history from the server.

[1528] Step 10:

[1529] The user enters a new message into the interactive screen and presses the send button.

[1530] Step 11:

[1531] The terminal converts the input message into JSON format.

[1532] Step 12:

[1533] The device sends an HTTP POST request containing the user message to the server.

[1534] Step 13:

[1535] The server receives and analyzes the message sent by the user.

[1536] Step 14:

[1537] The server sends the received message to the emotion engine and instructs it to perform emotion analysis.

[1538] Step 15:

[1539] The emotion engine analyzes the content of the message, identifies the user's emotional state, and sends the emotion information back to the server.

[1540] Step 16:

[1541] The server passes emotional information to the generation AI, instructing it to generate a response that takes the user's emotions into account.

[1542] Step 17:

[1543] Generative AI generates responses to user messages based on the character's personality profile and emotional information.

[1544] Step 18:

[1545] The server receives the generated response message and converts it to JSON format.

[1546] Step 19:

[1547] The server sends an HTTP POST request containing a response message to the terminal.

[1548] Step 20:

[1549] The terminal receives the response message sent from the server, analyzes it, and displays it.

[1550] Step 21:

[1551] The user checks the response from the character displayed on the terminal and enters the next message.

[1552] ---

[1553] The above is a specific flow of processing of the invention that uses an emotion engine.

[1554] Example 2

[1555] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1556] Conventional dialogue systems have made it difficult for users to enjoy natural conversations with characters. Furthermore, they lacked a system that could recognize the user's emotions and automatically generate appropriate responses. As a result, users often felt lonely or responses were unnatural.

[1557] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for passing a user's message to an emotion analysis engine to acquire emotion information, a means for passing the emotion information to a generative AI model and generating a response that takes emotion into consideration, and a means for sending the generated response to a terminal and for the terminal to display the response. This enables natural dialogue according to the user's emotion.

[1558] 1. "Interface means" refers to the function used by the user to input character information.

[1559] 2. "Terminal" refers to a device used by a User to input and transmit information.

[1560] 3. "Generative AI Model" refers to artificial intelligence software that generates a character's personality profile and response patterns based on information received from the user.

[1561] 4. "Database" refers to the storage area within the system for storing generated character information.

[1562] 5. "Sentiment Analysis Engine" means software used to analyze and extract emotional information from users' messages.

[1563] 6. "Reply" refers to a response generated by a server or a generative AI model in response to a user's message.

[1564] 7. "Natural dialogue" refers to dialogue that is natural to the user, fluent, and takes place in an appropriate context.

[1565] This invention is a system that allows users to enjoy natural conversations with specific characters, and further combines it with an emotion analysis engine that recognizes the user's emotions and reflects them in responses. This system is designed so that a generative AI model generates a character based on user input information and can provide advanced responses using emotion analysis.

[1566] Entering character information

[1567] How users enter information

[1568] Users launch a dedicated application on their smartphone, tablet, or other device. This application provides an interface for entering information such as the character's name, personality, hobbies, and favorite phrases. After entering this information, the user presses the send button, which causes the device to send the information to the server.

[1569] Examples:

[1570] The user enters the following information into the app's form: "Name: Akane," "Personality: Cheerful," "Hobbies: Music," and "Phrase: Good morning!"

[1571] When the user taps the send button, the device sends the information in JSON format to the server.

[1572] Character Generation

[1573] Server-based character generation

[1574] The server receives the input information sent by the user. Based on the received information, the server issues commands to the generative AI model to generate the character's personality profile and response patterns. The generative AI model used is, for example, OpenAI's GPT-4. The generated profile is stored in a database on the server.

[1575] Examples:

[1576] The server sends a prompt to the generative AI model saying, "Create a character's personality profile and response patterns from this information."

[1577] The generative AI generates a profile and stores it in a database on the server.

[1578] User-character interaction

[1579] How the user initiates the interaction

[1580] When a user opens a dialogue screen in the application, the device retrieves and displays the past conversation history from the server. The user then enters a new message and presses the send button. At this time, the device sends the message to the server.

[1581] Examples:

[1582] The user types "Happy birthday!" and taps the send button.

[1583] The device sends a message to the server.

[1584] Server Message Processing

[1585] The server receives messages sent by users and passes them to a generative AI model to generate a reply. The generative AI generates a reply to the user message while taking into account the character's profile and answer patterns. The generated reply is sent from the server to the device, and the device displays the reply to the user.

[1586] Examples:

[1587] The server sends a prompt to the generated AI model saying, "You have received a message from the user. Please create a reply to this message taking into account the character's profile."

[1588] The generation AI generates a reply saying "Nice to meet you!" and returns it to the server.

[1589] Introducing a sentiment analysis engine

[1590] Emotion analysis using an emotion analysis engine

[1591] Furthermore, by using a sentiment analysis engine, emotions can be analyzed from user input information (e.g., text messages, voice input, etc.). The sentiment analysis engine uses, for example, IBM Watson's sentiment analysis API. The sentiment analysis engine analyzes the user's emotional state in real time and passes that emotional information to the generative AI model.

[1592] Examples:

[1593] The server sends the message "Thank you for your continued support today!" to the emotion analysis engine, and obtains "positive" emotion as the analysis result.

[1594] Response generation that reflects emotional information

[1595] The server passes the acquired emotional information to the generative AI model and instructs it to generate a response that takes the user's emotions into account. The generative AI then takes the emotional information into account and generates an appropriate response.

[1596] Examples:

[1597] The server sends the generative AI model a prompt message: "The user sent the message 'Have a great day!' with positive emotions. Generate a response to this."

[1598] The generation AI generates a reply saying "Nice to meet you!" and returns it to the server.

[1599] In this way, it is possible to realize natural conversations between the user and the character with high accuracy. This system allows the user to enjoy natural conversations with specific characters that are accompanied by emotions, which in turn reduces feelings of loneliness and improves mental stability.

[1600] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1601] Step 1:

[1602] User enters and submits character information

[1603] The user launches a dedicated application and inputs information such as the character's name, personality, hobbies, phrases, etc. When the user presses the send button, the device sends this information to the server.

[1604] Input: Character information entered by the user into the app (e.g., "Name: Akane," "Personality: Cheerful," "Hobbies: Music," "Phrase: Good morning!")

[1605] Data processing: The device converts the input information into pseudo-structured data (e.g., JSON).

[1606] Output: The submitted pseudo-structured data arrives at the server.

[1607] Specific behavior: The user enters information into the app's form and taps the submit button. The device converts the information into JSON format and sends it to the server.

[1608] Step 2:

[1609] The server receives and formats character information

[1610] The server receives character information submitted by the user and formats it into the appropriate form to be passed to the generative AI model.

[1611] Input: Pseudo-structured data (e.g. JSON) sent from the device

[1612] Data processing: The server formats the received data into the required format (e.g., converting it back to plain text)

[1613] Output: Formatted data (e.g. character information in text format)

[1614] Specific operation: The server parses the JSON format data, extracts the necessary information, and formats it.

[1615] Step 3:

[1616] The server instructs the generation AI to generate a character.

[1617] The server passes the formatted character information to a generative AI model, instructing it to generate the character's personality profile and response patterns.

[1618] Input: Formatted character information (e.g., text format)

[1619] Data computation: Generative AI models generate character profiles and response patterns

[1620] Output: Generated character profile and answer patterns (e.g., returned in JSON format)

[1621] Specific operation: The server issues a command to the generative AI model to "create a character's personality profile and response patterns from this information." The generative AI generates a profile and stores it in the server's database.

[1622] Step 4:

[1623] User initiates interaction

[1624] When a user opens the application's interactive screen, the device retrieves and displays past conversation history from the server, and the user enters a new message and presses the send button.

[1625] Input: The user's new message (e.g., "Happy birthday!")

[1626] Data processing: The device converts the message into pseudo-structured data (e.g., JSON)

[1627] Output: The sent message arrives at the server

[1628] Specific behavior: The user types "Have a nice day!" and taps the send button. The device converts the message into JSON format and sends it to the server.

[1629] Step 5:

[1630] The server receives and processes the user's message.

[1631] The server receives messages sent by users and performs any necessary pre-processing (e.g. text cleaning) before passing them to the sentiment analysis engine.

[1632] Input: Pseudo-structured data sent by the user (e.g., a message in JSON format)

[1633] Data processing: The server cleans the message and prepares it for the sentiment analysis engine

[1634] Output: Cleaned text data

[1635] What happens: The server receives the user's message ("Happy New Year!") and removes any unnecessary characters or data.

[1636] Step 6:

[1637] The server sends the user's message to the sentiment analysis engine

[1638] The server sends the cleaned message to a sentiment analysis engine to obtain sentiment information.

[1639] Input: Cleaned text data (e.g., "Happy Birthday!")

[1640] Data calculation: The emotion analysis engine analyzes emotions and generates emotion information

[1641] Output: Emotion information (e.g., "positive")

[1642] Specific operation: The server sends the message "Thank you for your continued support today!" to the sentiment analysis engine, and obtains "positive" sentiment as the analysis result.

[1643] Step 7:

[1644] Server generates response using AI

[1645] The server passes the acquired emotional information and message to the generative AI model, instructing it to generate a response that takes the user's emotions into account.

[1646] Input: Emotion information (e.g., "Positive") and message (e.g., "Have a great day!")

[1647] Data computation: Generative AI models generate responses based on emotional information

[1648] Output: The generated response (e.g. "Nice to meet you!")

[1649] Specific operation: The server sends the command to the generative AI model: "A user sends a message with positive emotions saying, 'Have a nice day!' Generate a response to this." The generative AI generates a response saying, "Thank you very much!" and returns it to the server.

[1650] Step 8:

[1651] The server sends a response to the device

[1652] The server receives the response returned by the generation AI and sends it to the user's device.

[1653] Input: Generated response (e.g. "Nice to meet you!")

[1654] Data processing: Convert the response into pseudo-structured data (e.g., JSON format)

[1655] Output: Response data arrives at the terminal

[1656] Specific behavior: The server converts the generated response into JSON format and sends it to the user's device.

[1657] Step 9:

[1658] The device displays the response to the user

[1659] The device receives the response sent by the server and displays it to the user within the application.

[1660] Input: Pseudo-structured data sent by the server (e.g., a JSON response)

[1661] Data processing: Convert responses into display format

[1662] Output: Response displayed on screen (e.g. "Character: Nice to meet you!")

[1663] Specific behavior: The device displays the response it receives on the screen so that the user can review it.

[1664] The above is a detailed description of the specific processing steps of the system program and their respective operations.

[1665] (Application example 2)

[1666] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1667] While conventional factory robots are useful for improving production work and efficiency, they do not address the mental health and communication needs of employees. As a result, employees do not receive appropriate feedback on emotions such as stress and fatigue they feel while working, which can lead to a decline in work efficiency. In addition, the lack of communication between employees and robots makes it difficult for the robots to provide detailed support.

[1668] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for recording the user's voice message and sending it to the server, means for the server to pass the voice message to an emotion engine and analyze the emotional state, and means for the generation AI to generate a response based on the emotion information analyzed by the server. This generates a response that corresponds to the user's emotion, making it possible to have a natural conversation while taking into consideration the mental health of employees.

[1669] "Users" refer to factory employees and human operators.

[1670] "Interface means" refers to devices such as smartphones, tablets, and smart glasses, and their applications, which employees use to input character information and messages.

[1671] "Device" refers to a hardware device used by a user to input and receive information, such as a smartphone, smart glasses, or head-mounted display.

[1672] "Server" refers to the computer system on the network that is required to receive input information and messages from users, store them in a database, and process them using generative AI and emotion engines.

[1673] "Generative AI" refers to artificial intelligence that automatically generates a character's personality profile and answer patterns based on information entered by the user.

[1674] A "character personality profile" refers to information about a character's characteristics and personality that is created by the AI ​​based on information entered by the user, such as the character's name, personality, hobbies, and favorite phrases.

[1675] "Answer pattern" refers to the response pattern to a user's message that the generation AI generates based on the character's personality profile.

[1676] The "database" refers to a system that stores the personality profiles and conversation histories of characters created by the generative AI.

[1677] "Message" refers to text or voice information entered by a user when interacting with a device.

[1678] "Emotion engine" refers to software that analyzes user input and identifies the user's emotional state (e.g., joy, sadness, anger, fatigue, etc.).

[1679] "Emotional information" refers to data regarding the user's emotional state analyzed by the emotion engine.

[1680] "Reply" refers to a response from a character that the generation AI generates based on the user's message and emotional information.

[1681] System Overview

[1682] This invention is a system that allows users to enjoy natural conversations with specific characters. It also combines an emotion engine that recognizes the user's emotions and reflects them in responses. This system is designed so that a generative AI generates a character based on user input information and can provide sophisticated responses using the emotion engine. In a factory environment, natural conversations between workers and robots are realized.

[1683] Entering character information

[1684] How users enter information

[1685] Users launch a dedicated application using a device such as a smartphone, smart glasses, or head-mounted display. This application provides an interface for inputting information such as the character's name, personality, hobbies, and favorite phrases. After entering this information, the user presses the send button, and the device sends the input information to the server.

[1686] Character Generation

[1687] Server-based character generation

[1688] The server receives input information sent by the user. Based on this information, it issues commands to the generation AI to generate a character's personality profile and response patterns. The generation AI creates a character profile based on the input information and stores it in a database on the server.

[1689] User-character interaction

[1690] How the user initiates the interaction

[1691] When a user opens a dialogue screen in the application, the device retrieves and displays past conversation history from the server. The user then enters a new message and presses the send button, at which point the device sends the message to the server.

[1692] Server Message Processing

[1693] The server receives messages sent by users and passes them to the generation AI, instructing it to generate a reply. The generation AI generates a reply to the user's message, taking into account the character's profile and answer patterns. The generated reply is returned to the server, and then sent from the server to the device. The device displays the reply to the user.

[1694] Introducing the Emotion Engine

[1695] Emotion analysis using an emotion engine

[1696] Furthermore, by using an emotion engine, emotions can be analyzed from user input information (e.g., text messages, voice input, etc.). The emotion engine analyzes the user's emotional state (e.g., happy, sad, angry, etc.) in real time and passes that emotional information to the generation AI.

[1697] Response generation that reflects emotional information

[1698] The server passes the emotion information obtained from the emotion engine to the generation AI, which then generates a response that takes the user's emotions into consideration. For example, if a user enters "I'm really tired today," the emotion engine identifies the emotion "tired," and the generation AI generates a corresponding response (e.g., "Thank you for your hard work today. Please take a short rest.").

[1699] Specific examples

[1700] Specifically, when a factory worker says through their smart glasses, "Machine maintenance is tough today," the smart glasses send a voice message to the server. The server uses an emotion engine to analyze "stress" from this message and passes the results to the generation AI. The generation AI takes the emotional information into consideration and generates a response such as, "That's tough. If you look tired, please take a break," which the server then displays on the smart glasses.

[1701] Example prompt for a generative AI model:

[1702] "If an employee says, 'Machine maintenance is hard today,' the emotion engine detects stress and generates an appropriate response."

[1703] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1704] Step 1:

[1705] Input: The user enters character information (such as name, personality, hobbies, and favorite phrases) into a smartphone app.

[1706] Processing: The device receives input information from the user and sends it to the server.

[1707] Output: User input is passed to the server.

[1708] Step 2:

[1709] Input: User's character information received by the server.

[1710] Processing: The server issues commands to the generation AI based on the information received, generating the character's personality profile and response patterns.

[1711] Output: The generation AI generates character profiles and answer patterns, which the server stores in a database.

[1712] Step 3:

[1713] Input: The user types a new message through the smart glasses.

[1714] Processing: The device records the user's voice message and sends it to the server.

[1715] Output: The server receives the user's voice message.

[1716] Step 4:

[1717] Input: The user's voice message received by the server.

[1718] Processing: The server passes the voice message to the emotion engine to analyze the emotional state. The emotion engine extracts emotion data from the voice message.

[1719] Output: The emotion information analyzed by the emotion engine is returned to the server.

[1720] Step 5:

[1721] Input: Emotion information received by the server from the emotion engine and the user's message.

[1722] Processing: The server passes the emotion information and the user's message to the generation AI, instructing it to generate a response that reflects the emotion. The generation AI generates a response based on the emotion information.

[1723] Output: The generated response is returned to the server.

[1724] Step 6:

[1725] Input: The response received by the server from the generation AI.

[1726] Processing: The server generates a response and sends it to the terminal, which displays it to the user.

[1727] Output: The generated response is displayed on the user's smart glasses.

[1728] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1729] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1730] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1731] [Fourth embodiment]

[1732] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1733] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1734] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1735] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1736] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1737] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1738] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1739] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1740] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1741] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1742] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1743] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1744] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1745] ---

[1746] The present invention is a system that allows users to enjoy natural conversations with characters. This system uses a generation AI to generate characters based on user input information, and allows users to interact with the characters in real time. Specific embodiments of the system are described below.

[1747] 1. The user enters character information

[1748] How users enter information

[1749] Users launch the application using a device such as a smartphone or tablet. The application provides an interface for entering character profile information, such as name, personality, hobbies, and favorite phrases. When the user enters this information and presses the send button, the device sends the entered information to the server.

[1750] 2. Character Generation

[1751] Server-based character generation

[1752] The server receives the user's input information sent from the device and passes it to the generation AI. The generation AI generates a character's personality profile and response patterns based on the provided information. The generated character profile includes the name, personality, hobbies, and typical response style. This information is stored in a database by the server.

[1753] 3. User-character interaction

[1754] How the user initiates the interaction

[1755] The user opens a dialogue screen within the application and enters a new message while past conversation history is displayed. For example, when the user enters "Sakura, how was your day?" and presses the send button, the device sends the message to the server.

[1756] Server Message Processing

[1757] The server receives user messages sent from the device and passes them to the generation AI, which generates natural responses based on the message and the character's personality profile. The responses generated by the generation AI are received by the server and sent to the device.

[1758] 4. Displaying replies

[1759] Display of response by terminal

[1760] The device receives the response sent back from the server and displays it to the user. For example, a response such as "Today was a good day. How was it for you?" is displayed. This process allows the user to enjoy natural dialogue with the character.

[1761] Specific examples

[1762] As a concrete example, consider a case where a user wants to create a character named "Sakura" who has a bright and kind personality. The user uses a device application to enter the following information:

[1763] Name: Sakura

[1764] Personality: Cheerful and kind

[1765] Hobbies: Listening to music and cooking

[1766] Favorite phrase: "Let's do our best today!"

[1767] When a user enters information and presses the send button, the device sends this information to the server, which then invokes the AI ​​generator to generate Sakura's personality profile and response patterns based on this information, and stores the generated information in a database.

[1768] Then, when the user sends a message like "Sakura, how was your day?", the server passes this message to the AI ​​generator, which generates a response. For example, "It was a great day today. How was your day?" This response is generated, sent to the device, and displayed to the user.

[1769] In this way, the system of the present invention allows the user to have natural conversations with a specific character of their choice, thereby reducing feelings of loneliness and achieving mental stability.

[1770] The processing flow will be explained below.

[1771] ---

[1772] Entering character information

[1773] Step 1:

[1774] The user launches the app on their device, which provides the user with an interface for entering character profile information.

[1775] Step 2:

[1776] The device receives information entered by the user, such as name, personality, hobbies, and favorite phrases.

[1777] Step 3:

[1778] The user enters various information into the input form and presses the "Submit" button.

[1779] Step 4:

[1780] The terminal converts the input information into JSON format.

[1781] Step 5:

[1782] The device sends JSON format data to the server as an HTTP POST request.

[1783] Character Generation

[1784] Step 6:

[1785] The server receives the POST request sent from the terminal and parses the user input information from the payload.

[1786] Step 7:

[1787] The server passes the analyzed information to the generation AI, instructing it to generate the character's personality profile and response patterns.

[1788] Step 8:

[1789] The generative AI generates a character's personality profile and answer patterns based on the information provided.

[1790] Step 9:

[1791] The server stores the generated character information in a database.

[1792] User-character interaction

[1793] Step 10:

[1794] The user opens a dialogue screen within the application. The device retrieves and displays the past conversation history from the server.

[1795] Step 11:

[1796] The user enters a new message in the interactive screen and presses the send button.

[1797] Step 12:

[1798] The terminal converts the input message into JSON format.

[1799] Step 13:

[1800] The device sends an HTTP POST request containing the user message to the server.

[1801] Step 14:

[1802] The server receives and analyzes the message sent by the user.

[1803] Step 15:

[1804] The server passes the parsed message to the generation AI, instructing it to generate a response for the character.

[1805] Step 16:

[1806] Generative AI generates responses to user messages based on the character's personality profile.

[1807] Step 17:

[1808] The server receives the generated response message and converts it to JSON format.

[1809] Step 18:

[1810] The server sends an HTTP POST request containing a response message to the terminal.

[1811] Step 19:

[1812] The terminal receives the response message sent from the server, analyzes it, and displays it.

[1813] Step 20:

[1814] The user checks the response from the character displayed on the terminal and enters the next message.

[1815] ---

[1816] The above is a concrete explanation of the processing of the system program.

[1817] Example 1

[1818] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1819] Existing character dialogue systems have difficulty generating a character based on user-input information and engaging in natural dialogue with that character. Furthermore, the generated character may not meet the user's needs or may not be able to respond naturally in certain situations. Furthermore, there is a need for a system that can efficiently process user-input information and respond quickly.

[1820] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1821] In this invention, the server includes interface means for the user to input character information, means for the terminal to receive input information from the user and transmit the information to the server, means for the server to generate a character's personality profile and answer patterns using the generation AI based on the received information, means for the server to store the generated character information in a database, means for the terminal to transmit a message from the user to the server, means for the server to pass the received message to the generation AI and generate a response, means for the server to transmit the generated response to the terminal and display the response, means for the server to generate a request to the generation AI as a prompt sentence and pass it to the generation AI, and means for the terminal to receive the response from the server and display it on an interactive screen. This enables the user to have natural conversations with the character quickly and efficiently.

[1822] "Interface means" refers to the means by which a user inputs character information, and includes fields and buttons for inputting information on the application screen.

[1823] "Terminal" refers to a device that is directly operated by a user, including devices such as smartphones, tablets, and computers.

[1824] A "server" refers to a computer system that receives, processes, generates, and transmits data, and is the main device that performs various processes.

[1825] "Generative AI" refers to an artificial intelligence model that generates a character's personality profile and response patterns, such as an AI model that performs natural language processing.

[1826] A "personality profile" is a collection of data that includes information such as a character's name, personality, hobbies, and typical response style.

[1827] "Answer pattern" refers to a group of information that serves as a standard or template when a character responds to a message from a user.

[1828] A "database" is a system for systematically storing and managing generated character information and other related data.

[1829] "Message" refers to information such as text or voice that a user sends to a character.

[1830] "Prompt text" refers to the words or data input to the generating AI to obtain a specific output, including the user's message and the contents of the character profile.

[1831] "Dialogue screen" refers to the screen within the application where the user and the character exchange messages, and is an area for displaying past conversation history and new messages.

[1832] The present invention is a system that allows users to enjoy natural conversations with characters. This system uses a generation AI to generate characters based on user input information, and allows users to interact with the characters in real time. Specific embodiments of the system are described below.

[1833] Entering character information

[1834] 1. How users enter character information

[1835] Users launch the application using a device such as a smartphone or tablet. The application provides an interface for entering character profile information, such as name, personality, hobbies, and favorite phrases. When the user enters this information and presses the send button, the device sends the entered information to the server.

[1836] Character Generation

[1837] 2. Character generation using generative AI

[1838] The server receives the user's input information sent from the device and passes it to the generation AI. The generation AI generates a character's personality profile and response patterns based on the provided information. The generated character profile includes the name, personality, hobbies, and typical response style. This information is stored in a database by the server.

[1839] User-character interaction

[1840] 3. How users initiate interactions

[1841] The user opens a dialogue screen within the application and enters a new message while past conversation history is displayed. For example, when the user enters "Sakura, how was your day?" and presses the send button, the device sends the message to the server.

[1842] 4. Message Processing by the Server

[1843] The server receives user messages sent from the device and passes them to the generation AI, which generates natural responses based on the message and the character's personality profile. The generated responses are received by the server and sent to the device.

[1844] View Responses

[1845] 5. Displaying Responses on the Device

[1846] The device receives the response sent back from the server and displays it to the user. For example, a response such as "Today was a good day. How was it for you?" is displayed. This allows the user to enjoy natural dialogue with the character.

[1847] Examples of concrete examples and prompts

[1848] Specific scenarios

[1849] Let's say a user creates a character named "Sakura" and sets her personality as "cheerful and kind" and her hobbies as "listening to music and cooking."

[1850] User Input: "Sakura, how was your day?"

[1851] Server Action:

[1852] 1. Pass the user's message to the generation AI.

[1853] 2. The generative AI generates a response: "Today was a good day. How was it for you?"

[1854] Display on terminal: The response is displayed to the user.

[1855] Prompt Sentence Examples

[1856] "Generate a response based on the following character information: The character's name is Sakura, her personality is cheerful and kind, and her hobbies are listening to music and cooking. The user's message is 'Sakura, how was your day?'"

[1857] In this way, the system of the present invention allows the user to have natural conversations with specific characters of their choice, thereby reducing feelings of loneliness and achieving mental stability.

[1858] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1859] Step 1:

[1860] User Action:

[1861] A user launches an application on their smartphone or tablet.

[1862] Input: The user taps the application icon to launch it.

[1863] Specific behavior:

[1864] Tap the application icon to launch it.

[1865] Output: The application starts and the character information input screen is displayed.

[1866] Step 2:

[1867] User Action:

[1868] The user enters character information through the application interface.

[1869] Input: Name, personality, hobbies, favorite phrases

[1870] Specific behavior:

[1871] Enter "Sakura" in the name field, "cheerful and kind" in the personality field, "listening to music and cooking" in the hobby field, and "Let's do our best today too!" in the favorite phrase field, then press the send button.

[1872] Output: The device receives the user's input information and generates data to send to the server.

[1873] Step 3:

[1874] Terminal operations:

[1875] The device sends the user's input information to the server.

[1876] Input: Character information entered by the user

[1877] Specific behavior:

[1878] After completing the input, press the send button to send an HTTP request to the server.

[1879] Output: The server receives the user's character information.

[1880] Step 4:

[1881] Server operations:

[1882] The server receives the user's input information sent from the terminal.

[1883] Input: Character information sent by the device

[1884] Specific behavior:

[1885] The server receives the HTTP request at the API endpoint and stores it in a database.

[1886] Output: The input information is saved on the server.

[1887] Step 5:

[1888] Server operations:

[1889] The server passes the received input information to the generation AI.

[1890] Input: Received character information

[1891] Specific behavior:

[1892] The server creates a prompt for the generation AI based on the input information and sends a request to the generation AI API.

[1893] Output: Character profile and answer patterns generated by the generation AI.

[1894] Step 6:

[1895] Generative AI operations:

[1896] Generative AI generates a character's personality profile and answer patterns based on the information provided.

[1897] Input: Character information formatted as a prompt sentence

[1898] Specific behavior:

[1899] The AI ​​generates a personality based on the name "Sakura," personality type "cheerful and kind," hobbies "listening to music and cooking," and favorite phrase "Let's do our best today too!" and returns that information.

[1900] Output: Generated character profile and answer patterns.

[1901] Step 7:

[1902] Server operations:

[1903] The server stores the generated character profile information in a database.

[1904] Input: Character profile information returned by the generated AI

[1905] Specific behavior:

[1906] The profile information returned from the generation AI is stored in a database.

[1907] Output: Character profile saved in database.

[1908] Step 8:

[1909] User Action:

[1910] The user opens a dialog box and enters a new message.

[1911] Input: User message "Sakura, how was your day?"

[1912] Specific behavior:

[1913] Open the dialogue screen, enter "Sakura, how was your day?" in the input field, and press the send button.

[1914] Output: The device generates data to send the user's message.

[1915] Step 9:

[1916] Terminal operations:

[1917] The device sends the user's message to the server.

[1918] Input: The message entered by the user

[1919] Specific behavior:

[1920] After entering the message, press the send button and an HTTP request will be sent to the server.

[1921] Output: The server receives the user's message.

[1922] Step 10:

[1923] Server operations:

[1924] The server receives the message sent from the terminal.

[1925] Input: User message sent by the terminal

[1926] Specific behavior:

[1927] The server receives a user message at an API endpoint.

[1928] Output: The message is saved on the server.

[1929] Step 11:

[1930] Server operations:

[1931] The server passes the received message to the generation AI, prompting it to generate a response.

[1932] Input: Received message and character profile

[1933] Specific behavior:

[1934] The server creates a prompt based on the user message and saved character profile information and sends a request to the generation AI API.

[1935] Output: A response is generated from the generation AI.

[1936] Step 12:

[1937] Generative AI operations:

[1938] Generative AI generates natural responses based on the user message and character profile.

[1939] Input: User message formatted as a prompt and character profile information

[1940] Specific behavior:

[1941] The generation AI generates a response based on the prompt and returns it to the server.

[1942] Output: The generated response.

[1943] Step 13:

[1944] Server operations:

[1945] The server receives the generated response and sends it to the terminal.

[1946] Input: The response returned by the generation AI

[1947] Specific behavior:

[1948] Receive the response from the generation AI and return it to the terminal as an HTTP response.

[1949] Output: The device receives the reply.

[1950] Step 14:

[1951] Terminal operations:

[1952] The device receives the response sent back from the server and displays it to the user.

[1953] Input: The response sent by the server

[1954] Specific behavior:

[1955] The device receives the response and displays it on the dialogue screen, for example, "Today was a good day. How was it for you?"

[1956] Output: User confirms response.

[1957] (Application example 1)

[1958] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1959] Food delivery services have become extremely popular in modern society, but conventional systems have a monotonous user interface and a lack of enjoyment in the ordering process. Furthermore, in order for users to make accurate menu selections, the system must provide appropriate recommendations to the user. However, conventional systems have difficulty making flexible suggestions based on user preferences. There is a need to provide a system that can solve these issues and enable users to order food delivery efficiently while still enjoying the process.

[1960] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1961] In this invention, the server includes an interface means for a user to input character information, a means for a terminal to receive input information from a user and transmit the information to the server, a means for the server to generate a character's personality profile and answer patterns using a generation AI based on the received information, a means for the server to store the generated character information in a database, a means for the terminal to transmit a message from the user to the server, a means for the server to pass the received message to the generation AI and generate a response, a means for the server to transmit the generated response to the terminal and the terminal to display the response, and a means for the user to receive recommendations through dialogue and place a desired delivery order. This enables the user to enjoy natural dialogue while receiving efficient and appropriate suggestions and placing a food delivery order.

[1962] "User" refers to a person who uses the system to interact with characters and order food delivery.

[1963] "Character information" refers to the character's profile information entered by the user, such as name, personality, hobbies, and favorite phrases.

[1964] "Interface" refers to the means by which a user inputs character information and messages.

[1965] "Terminal" refers to an electronic device such as a smartphone or tablet that transmits input information and messages from the user to the server.

[1966] "Server" refers to the central processing unit that receives user input information, uses generative AI to generate character profiles and responses, and stores them in a database.

[1967] "Generative AI" refers to artificial intelligence that generates characters based on user input and engages in natural conversations.

[1968] A "personality profile" is information created by the generative AI that compiles characteristics such as a character's personality, hobbies, and response style.

[1969] "Answer pattern" refers to a set of response mechanisms that the generative AI uses to generate dialogue between a character and a user.

[1970] "Database" refers to a storage device that stores generated character information and allows searching and retrieval as needed.

[1971] "Reply" refers to a response from a character that the generation AI generates in response to a user's message.

[1972] "Recommendations" refers to menu suggestions and ordering advice provided to users by the generative AI.

[1973] "Food delivery order" refers to a request for food delivery made by a user through interaction with a character.

[1974] MODE FOR CARRYING OUT THE INVENTION

[1975] The present invention is a food delivery system that allows users to place orders through natural interactions with a character. This system utilizes a generative AI model to generate a character based on user input and allows users to interact with the character in real time. Specific embodiments of the system are described below.

[1976] 1. The user enters character information

[1977] Users launch the application using a device such as a smartphone. The application provides an interface for entering profile information such as the character's name, personality, hobbies, and catchphrases. The information entered by the user is sent from the device to the server.

[1978] 2. Character Generation

[1979] The server receives the information sent by the user and passes it to the generation AI. The generation AI generates the character's personality profile and answer patterns based on the provided information. The generated information is saved in a database. This allows the created character information to be used when the user accesses the game again.

[1980] 3. User-character interaction

[1981] The user opens a dialogue screen within the application, enters a message, and sends it. For example, when the user enters "What's your recommendation today?" and presses the send button, the device sends the message to the server. The server passes the received message to the generation AI, which generates a natural response based on the character's personality profile.

[1982] 4. Displaying replies

[1983] The server sends the response generated by the AI ​​to the device, which then displays the response to the user. For example, the device may display a response such as, "Seafood pasta is recommended today." This process allows users to enjoy natural conversations with the character while ordering food delivery.

[1984] 5. Food delivery advisories

[1985] Through dialogue between the user and the character, the generative AI can suggest menu items based on the user's preferences. For example, if the user says, "I want to try something new," the generative AI can suggest, "How about a new vegan menu item?" This allows users to make the best choice while enjoying dialogue with the character, rather than simply choosing a menu item.

[1986] Hardware and software used

[1987] The system's main hardware is the smartphones and tablets used by users. The server is equipped with a high-performance processing unit and a large-capacity database. The software used is the Flask framework for server-side processing, and OpenAI's GPT-3 is used as the generative AI model.

[1988] Examples of concrete examples and prompts

[1989] As a concrete example, let's say a user wants to create a character called "Delivery Assistant." The user enters the following information:

[1990] Name: Delivery Assistant

[1991] Personality: Kind and efficient

[1992] Hobbies: Proposing new dishes

[1993] Favorite phrase: "If you're hungry, leave it to me!"

[1994] When a user asks a character generated based on this information, "What's your recommended menu for dinner tonight?", the character responds, "Seafood pasta is delicious today." This response was generated by the AI ​​based on the character's personality profile selected by the user.

[1995] Example prompt sentence:

[1996] The delivery assistant is friendly and efficient, and his hobby is suggesting new dishes. Below is a chat with him / her.

[1997] User: What's your recommendation for dinner tonight?

[1998] Delivery Assistant:

[1999] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2000] Step 1:

[2001] The user launches the application using a device. The user enters character information (name, personality, hobbies, and catchphrases). This information is sent from the device to the server.

[2002] input:

[2003] Character information entered by the user through the interface.

[2004] output:

[2005] The terminal sends the input information to the server.

[2006] Operation:

[2007] When the user presses the "Submit" button, the input information is sent to the server via the Internet.

[2008] Step 2:

[2009] The server passes the received character information to the generation AI, which generates the character's personality profile and answer patterns based on the user's input.

[2010] input:

[2011] Character information sent from the device.

[2012] output:

[2013] Personality profile and answer patterns of characters generated by the generative AI.

[2014] Operation:

[2015] The server sends the information to the generation AI, which then generates a profile and stores that information in the server's database.

[2016] Step 3:

[2017] The user opens an interactive screen using a terminal, enters a message, and sends it. The message is then sent from the terminal to the server.

[2018] input:

[2019] A message entered by the user.

[2020] output:

[2021] The device sends a user message to the server.

[2022] Operation:

[2023] When the user presses the "send" button, the message is sent to the server.

[2024] Step 4:

[2025] The server passes the received message to a generation AI, which generates natural responses based on the character's personality profile.

[2026] input:

[2027] User messages and character personality profiles.

[2028] output:

[2029] A response generated by the generation AI.

[2030] Operation:

[2031] The generative AI uses prompt text to combine the user's message with the character's information to generate an appropriate response.

[2032] Step 5:

[2033] The server sends the response generated by the generation AI to the terminal, which displays the response.

[2034] input:

[2035] A response generated by the generation AI.

[2036] output:

[2037] The character's response will be displayed on the device.

[2038] Operation:

[2039] The server sends the generated response to the terminal, which displays the response on its screen.

[2040] Step 6:

[2041] Users can order food delivery through conversations with the character, who will then provide recommendations and suggestions to the user.

[2042] input:

[2043] An additional message that the user enters during the interaction.

[2044] output:

[2045] Additional suggestions and final ordering information.

[2046] Operation:

[2047] The user and the character continue to interact, with the generative AI providing successive replies and suggestions, until the user finally confirms the order.

[2048] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2049] ---

[2050] This invention is a system that allows users to enjoy natural conversations with specific characters, and further combines it with an emotion engine that recognizes the user's emotions and reflects them in responses. This system is designed so that a generation AI generates a character based on user input information and can provide advanced responses using the emotion engine.

[2051] Entering character information

[2052] How users enter information

[2053] Users launch a dedicated application on their smartphone, tablet, or other device. This application provides an interface for entering information such as the character's name, personality, hobbies, and favorite phrases. After entering this information, the user presses the send button, which causes the device to send the information to the server.

[2054] Character Generation

[2055] Server-based character generation

[2056] The server receives the input information sent by the user. Based on this information, the server issues commands to the generation AI to generate a character's personality profile and answer patterns. The generation AI creates a character profile based on the input information and stores it in a database on the server.

[2057] User-character interaction

[2058] How the user initiates the interaction

[2059] When a user opens a dialogue screen in the application, the device retrieves and displays past conversation history from the server. The user then enters a new message and presses the send button, at which point the device sends the message to the server.

[2060] Server Message Processing

[2061] The server receives messages sent by users and passes them to the generation AI, instructing it to generate a reply. The generation AI generates a reply to the user's message, taking into account the character's profile and answer patterns. The generated reply is returned to the server, and then sent from the server to the device. The device displays the reply to the user.

[2062] Introducing the Emotion Engine

[2063] Emotion analysis using an emotion engine

[2064] Furthermore, by using an emotion engine, emotions can be analyzed from user input information (e.g., text messages, voice input, etc.). The emotion engine analyzes the user's emotional state (e.g., happy, sad, angry, etc.) in real time and passes that emotional information to the generation AI.

[2065] Response generation that reflects emotional information

[2066] The server passes the emotion information obtained from the emotion engine to the generation AI, which then generates a response that takes the user's emotions into consideration. For example, if a user enters "I'm really tired today," the emotion engine identifies the emotion "tired," and the generation AI generates a corresponding response (e.g., "Thank you for your hard work today. Please take a short rest.").

[2067] Specific examples

[2068] For example, consider the process when a user sends a message saying, "Work was hard today." The user enters the message and presses the send button. The device sends the message to the server, and the server receives the message.

[2069] The server sends the received message to the emotion engine to analyze the user's emotions before passing it on to the generation AI. The emotion engine analyzes the "feeling of fatigue" from the user's text, "It was tough," and returns that emotional information to the server. The server then passes that emotional information to the generation AI, which then generates a response that takes the "feeling of fatigue" into consideration.

[2070] The generated response (for example, "Thank you for your hard work. Take a good rest today.") is sent to the terminal by the server, and the terminal displays the response to the user. In this way, the user can enjoy natural conversation with the character.

[2071] The system of the present invention allows users to enjoy natural, emotional dialogue with specific characters, thereby reducing feelings of loneliness and achieving mental stability.

[2072] ---

[2073] The processing flow will be explained below.

[2074] ---

[2075] Entering character information

[2076] Step 1:

[2077] The user launches the app on their device, which displays an interface for the user to enter character information.

[2078] Step 2:

[2079] The user enters information into the interface, such as the character's name, personality, hobbies, and favorite phrases, and presses the "Submit" button.

[2080] Step 3:

[2081] The device converts the information entered by the user into JSON format.

[2082] Step 4:

[2083] The terminal sends an HTTP POST request to the server and transmits the input information.

[2084] Character Generation

[2085] Step 5:

[2086] The server receives the POST request sent from the terminal and parses the user input information from the payload.

[2087] Step 6:

[2088] The server passes the analyzed information to the generation AI, instructing it to generate the character's personality profile and response patterns.

[2089] Step 7:

[2090] The generative AI generates a character's personality profile and answer patterns based on the information provided.

[2091] Step 8:

[2092] The server stores the generated character information in a database.

[2093] User-character interaction

[2094] Step 9:

[2095] The user opens a dialogue screen within the application. The device retrieves and displays the conversation history from the server.

[2096] Step 10:

[2097] The user enters a new message into the interactive screen and presses the send button.

[2098] Step 11:

[2099] The terminal converts the input message into JSON format.

[2100] Step 12:

[2101] The device sends an HTTP POST request containing the user message to the server.

[2102] Step 13:

[2103] The server receives and analyzes the message sent by the user.

[2104] Step 14:

[2105] The server sends the received message to the emotion engine and instructs it to perform emotion analysis.

[2106] Step 15:

[2107] The emotion engine analyzes the content of the message, identifies the user's emotional state, and sends the emotion information back to the server.

[2108] Step 16:

[2109] The server passes emotional information to the generation AI, instructing it to generate a response that takes the user's emotions into account.

[2110] Step 17:

[2111] Generative AI generates responses to user messages based on the character's personality profile and emotional information.

[2112] Step 18:

[2113] The server receives the generated response message and converts it to JSON format.

[2114] Step 19:

[2115] The server sends an HTTP POST request containing a response message to the terminal.

[2116] Step 20:

[2117] The terminal receives the response message sent from the server, analyzes it, and displays it.

[2118] Step 21:

[2119] The user checks the response from the character displayed on the terminal and enters the next message.

[2120] ---

[2121] The above is a specific flow of processing of the invention that uses an emotion engine.

[2122] Example 2

[2123] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2124] Conventional dialogue systems have made it difficult for users to enjoy natural conversations with characters. Furthermore, they lacked a system that could recognize the user's emotions and automatically generate appropriate responses. As a result, users often felt lonely or responses were unnatural.

[2125] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for passing the user's message to an emotion analysis engine to acquire emotion information, a means for passing the emotion information to a generative AI model and generating a response that takes emotion into consideration, and a means for sending the generated response to the terminal and for the terminal to display the response. This enables natural dialogue according to the user's emotion.

[2126] 1. "Interface means" refers to the function used by the user to input character information.

[2127] 2. "Terminal" refers to a device used by a User to input and transmit information.

[2128] 3. "Generative AI Model" refers to artificial intelligence software that generates a character's personality profile and response patterns based on information received from the user.

[2129] 4. "Database" refers to the storage area within the system for storing generated character information.

[2130] 5. "Sentiment Analysis Engine" means software used to analyze and extract emotional information from users' messages.

[2131] 6. "Reply" refers to a response generated by a server or a generative AI model in response to a user's message.

[2132] 7. "Natural dialogue" refers to dialogue that is natural to the user, fluent, and takes place in an appropriate context.

[2133] This invention is a system that allows users to enjoy natural conversations with specific characters, and further combines it with an emotion analysis engine that recognizes the user's emotions and reflects them in responses. This system is designed so that a generative AI model generates a character based on user input information and can provide advanced responses using emotion analysis.

[2134] Entering character information

[2135] How users enter information

[2136] Users launch a dedicated application on their smartphone, tablet, or other device. This application provides an interface for entering information such as the character's name, personality, hobbies, and favorite phrases. After entering this information, the user presses the send button, which causes the device to send the information to the server.

[2137] Examples:

[2138] The user enters the following information into the app's form: "Name: Akane," "Personality: Cheerful," "Hobbies: Music," and "Phrase: Good morning!"

[2139] When the user taps the send button, the device sends the information in JSON format to the server.

[2140] Character Generation

[2141] Server-based character generation

[2142] The server receives the input information sent by the user. Based on the received information, the server issues commands to the generative AI model to generate the character's personality profile and response patterns. The generative AI model used is, for example, OpenAI's GPT-4. The generated profile is stored in a database on the server.

[2143] Examples:

[2144] The server sends a prompt to the generative AI model saying, "Create a character's personality profile and response patterns from this information."

[2145] The generative AI generates a profile and stores it in a database on the server.

[2146] User-character interaction

[2147] How the user initiates the interaction

[2148] When a user opens a dialogue screen in the application, the device retrieves and displays the past conversation history from the server. The user then enters a new message and presses the send button. At this time, the device sends the message to the server.

[2149] Examples:

[2150] The user types "Happy birthday!" and taps the send button.

[2151] The device sends a message to the server.

[2152] Server Message Processing

[2153] The server receives messages sent by users and passes them to a generative AI model to generate a reply. The generative AI generates a reply to the user message while taking into account the character's profile and answer patterns. The generated reply is sent from the server to the device, and the device displays the reply to the user.

[2154] Examples:

[2155] The server sends a prompt to the generated AI model saying, "You have received a message from the user. Please create a reply to this message taking into account the character's profile."

[2156] The generation AI generates a reply saying "Nice to meet you!" and returns it to the server.

[2157] Introducing a sentiment analysis engine

[2158] Emotion analysis using an emotion analysis engine

[2159] Furthermore, by using a sentiment analysis engine, emotions can be analyzed from user input information (e.g., text messages, voice input, etc.). The sentiment analysis engine uses, for example, IBM Watson's sentiment analysis API. The sentiment analysis engine analyzes the user's emotional state in real time and passes that emotional information to the generative AI model.

[2160] Examples:

[2161] The server sends the message "Thank you for your continued support today!" to the emotion analysis engine, and obtains "positive" emotion as the analysis result.

[2162] Response generation that reflects emotional information

[2163] The server passes the acquired emotional information to the generative AI model and instructs it to generate a response that takes the user's emotions into account. The generative AI then takes the emotional information into account and generates an appropriate response.

[2164] Examples:

[2165] The server sends the generative AI model a prompt message: "The user sent the message 'Have a great day!' with positive emotions. Generate a response to this."

[2166] The generation AI generates a reply saying "Nice to meet you!" and returns it to the server.

[2167] In this way, it is possible to realize natural conversations between the user and the character with high accuracy. This system allows the user to enjoy natural conversations with specific characters that are accompanied by emotions, which in turn reduces feelings of loneliness and improves mental stability.

[2168] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2169] Step 1:

[2170] User enters and submits character information

[2171] The user launches a dedicated application and inputs information such as the character's name, personality, hobbies, phrases, etc. When the user presses the send button, the device sends this information to the server.

[2172] Input: Character information entered by the user into the app (e.g., "Name: Akane," "Personality: Cheerful," "Hobbies: Music," "Phrase: Good morning!")

[2173] Data processing: The device converts the input information into pseudo-structured data (e.g., JSON).

[2174] Output: The submitted pseudo-structured data arrives at the server.

[2175] Specific behavior: The user enters information into the app's form and taps the submit button. The device converts the information into JSON format and sends it to the server.

[2176] Step 2:

[2177] The server receives and formats character information

[2178] The server receives character information submitted by the user and formats it into the appropriate form to be passed to the generative AI model.

[2179] Input: Pseudo-structured data (e.g. JSON) sent from the device

[2180] Data processing: The server formats the received data into the required format (e.g., converting it back to plain text)

[2181] Output: Formatted data (e.g. character information in text format)

[2182] Specific operation: The server parses the JSON format data, extracts the necessary information, and formats it.

[2183] Step 3:

[2184] The server instructs the generation AI to generate a character.

[2185] The server passes the formatted character information to a generative AI model, instructing it to generate the character's personality profile and response patterns.

[2186] Input: Formatted character information (e.g., text format)

[2187] Data computation: Generative AI models generate character profiles and response patterns

[2188] Output: Generated character profile and answer patterns (e.g., returned in JSON format)

[2189] Specific operation: The server issues a command to the generative AI model to "create a character's personality profile and response patterns from this information." The generative AI generates a profile and stores it in the server's database.

[2190] Step 4:

[2191] User initiates interaction

[2192] When a user opens the application's interactive screen, the device retrieves and displays past conversation history from the server, and the user enters a new message and presses the send button.

[2193] Input: The user's new message (e.g., "Happy birthday!")

[2194] Data processing: The device converts the message into pseudo-structured data (e.g., JSON)

[2195] Output: The sent message arrives at the server

[2196] Specific behavior: The user types "Have a nice day!" and taps the send button. The device converts the message into JSON format and sends it to the server.

[2197] Step 5:

[2198] The server receives and processes the user's message.

[2199] The server receives messages sent by users and performs any necessary pre-processing (e.g. text cleaning) before passing them to the sentiment analysis engine.

[2200] Input: Pseudo-structured data sent by the user (e.g., a message in JSON format)

[2201] Data processing: The server cleans the message and prepares it for the sentiment analysis engine

[2202] Output: Cleaned text data

[2203] What happens: The server receives the user's message ("Happy New Year!") and removes any unnecessary characters or data.

[2204] Step 6:

[2205] The server sends the user's message to the sentiment analysis engine

[2206] The server sends the cleaned message to a sentiment analysis engine to obtain sentiment information.

[2207] Input: Cleaned text data (e.g., "Happy Birthday!")

[2208] Data calculation: The emotion analysis engine analyzes emotions and generates emotion information

[2209] Output: Emotion information (e.g., "positive")

[2210] Specific operation: The server sends the message "Thank you for your continued support today!" to the sentiment analysis engine, and obtains "positive" sentiment as the analysis result.

[2211] Step 7:

[2212] Server generates response using AI

[2213] The server passes the acquired emotional information and message to the generative AI model, instructing it to generate a response that takes the user's emotions into account.

[2214] Input: Emotion information (e.g., "Positive") and message (e.g., "Have a great day!")

[2215] Data computation: Generative AI models generate responses based on emotional information

[2216] Output: The generated response (e.g. "Nice to meet you!")

[2217] Specific operation: The server sends the command to the generative AI model: "A user sends a message with positive emotions saying, 'Have a nice day!' Generate a response to this." The generative AI generates a response saying, "Thank you very much!" and returns it to the server.

[2218] Step 8:

[2219] The server sends a response to the device

[2220] The server receives the response returned by the generation AI and sends it to the user's device.

[2221] Input: Generated response (e.g. "Nice to meet you!")

[2222] Data processing: Convert the response into pseudo-structured data (e.g., JSON format)

[2223] Output: Response data arrives at the terminal

[2224] Specific behavior: The server converts the generated response into JSON format and sends it to the user's device.

[2225] Step 9:

[2226] The device displays the response to the user

[2227] The device receives the response sent by the server and displays it to the user within the application.

[2228] Input: Pseudo-structured data sent by the server (e.g., a JSON response)

[2229] Data processing: Convert responses into display format

[2230] Output: Response displayed on screen (e.g. "Character: Nice to meet you!")

[2231] Specific behavior: The device displays the response it receives on the screen so that the user can review it.

[2232] The above is a detailed description of the specific processing steps of the system program and their respective operations.

[2233] (Application example 2)

[2234] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2235] While conventional factory robots are useful for improving production work and efficiency, they do not address the mental health and communication needs of employees. As a result, employees do not receive appropriate feedback on emotions such as stress and fatigue they feel while working, which can lead to a decline in work efficiency. In addition, the lack of communication between employees and robots makes it difficult for the robots to provide detailed support.

[2236] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for recording the user's voice message and sending it to the server, means for the server to pass the voice message to an emotion engine and analyze the emotional state, and means for the generation AI to generate a response based on the emotion information analyzed by the server. This generates a response that corresponds to the user's emotion, making it possible to have a natural conversation while taking into consideration the mental health of employees.

[2237] "Users" refer to factory employees and human operators.

[2238] "Interface means" refers to devices such as smartphones, tablets, and smart glasses, and their applications, which employees use to input character information and messages.

[2239] "Device" refers to a hardware device used by a user to input and receive information, such as a smartphone, smart glasses, or head-mounted display.

[2240] "Server" refers to the computer system on the network that is required to receive input information and messages from users, store them in a database, and process them using generative AI and emotion engines.

[2241] "Generative AI" refers to artificial intelligence that automatically generates a character's personality profile and answer patterns based on information entered by the user.

[2242] A "character personality profile" refers to information about a character's characteristics and personality that is created by the AI ​​based on information entered by the user, such as the character's name, personality, hobbies, and favorite phrases.

[2243] "Answer pattern" refers to the response pattern to a user's message that the generation AI generates based on the character's personality profile.

[2244] The "database" refers to a system that stores the personality profiles and conversation histories of characters created by the generative AI.

[2245] "Message" refers to text or voice information entered by a user when interacting with a device.

[2246] "Emotion engine" refers to software that analyzes user input and identifies the user's emotional state (e.g., joy, sadness, anger, fatigue, etc.).

[2247] "Emotional information" refers to data regarding the user's emotional state analyzed by the emotion engine.

[2248] "Reply" refers to a response from a character that the generation AI generates based on the user's message and emotional information.

[2249] System Overview

[2250] This invention is a system that allows users to enjoy natural conversations with specific characters. It also combines an emotion engine that recognizes the user's emotions and reflects them in responses. This system is designed so that a generative AI generates a character based on user input information and can provide sophisticated responses using the emotion engine. In a factory environment, natural conversations between workers and robots are realized.

[2251] Entering character information

[2252] How users enter information

[2253] Users launch a dedicated application using a device such as a smartphone, smart glasses, or head-mounted display. This application provides an interface for inputting information such as the character's name, personality, hobbies, and favorite phrases. After entering this information, the user presses the send button, and the device sends the input information to the server.

[2254] Character Generation

[2255] Server-based character generation

[2256] The server receives input information sent by the user. Based on this information, it issues commands to the generation AI to generate a character's personality profile and response patterns. The generation AI creates a character profile based on the input information and stores it in a database on the server.

[2257] User-character interaction

[2258] How the user initiates the interaction

[2259] When a user opens a dialogue screen in the application, the device retrieves and displays past conversation history from the server. The user then enters a new message and presses the send button, at which point the device sends the message to the server.

[2260] Server Message Processing

[2261] The server receives messages sent by users and passes them to the generation AI, instructing it to generate a reply. The generation AI generates a reply to the user's message, taking into account the character's profile and answer patterns. The generated reply is returned to the server, and then sent from the server to the device. The device displays the reply to the user.

[2262] Introducing the Emotion Engine

[2263] Emotion analysis using an emotion engine

[2264] Furthermore, by using an emotion engine, emotions can be analyzed from user input information (e.g., text messages, voice input, etc.). The emotion engine analyzes the user's emotional state (e.g., happy, sad, angry, etc.) in real time and passes that emotional information to the generation AI.

[2265] Response generation that reflects emotional information

[2266] The server passes the emotion information obtained from the emotion engine to the generation AI, which then generates a response that takes the user's emotions into consideration. For example, if a user enters "I'm really tired today," the emotion engine identifies the emotion "tired," and the generation AI generates a corresponding response (e.g., "Thank you for your hard work today. Please take a short rest.").

[2267] Specific examples

[2268] Specifically, when a factory worker says through their smart glasses, "Machine maintenance is tough today," the smart glasses send a voice message to the server. The server uses an emotion engine to analyze "stress" from this message and passes the results to the generation AI. The generation AI takes the emotional information into consideration and generates a response such as, "That's tough. If you look tired, please take a break," which the server then displays on the smart glasses.

[2269] Example prompt for a generative AI model:

[2270] "If an employee says, 'Machine maintenance is hard today,' the emotion engine detects stress and generates an appropriate response."

[2271] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2272] Step 1:

[2273] Input: The user enters character information (such as name, personality, hobbies, and favorite phrases) into a smartphone app.

[2274] Processing: The device receives input information from the user and sends it to the server.

[2275] Output: User input is passed to the server.

[2276] Step 2:

[2277] Input: User's character information received by the server.

[2278] Processing: The server issues commands to the generation AI based on the information received, generating the character's personality profile and response patterns.

[2279] Output: The generation AI generates character profiles and answer patterns, which the server stores in a database.

[2280] Step 3:

[2281] Input: The user types a new message through the smart glasses.

[2282] Processing: The device records the user's voice message and sends it to the server.

[2283] Output: The server receives the user's voice message.

[2284] Step 4:

[2285] Input: The user's voice message received by the server.

[2286] Processing: The server passes the voice message to the emotion engine to analyze the emotional state. The emotion engine extracts emotion data from the voice message.

[2287] Output: The emotion information analyzed by the emotion engine is returned to the server.

[2288] Step 5:

[2289] Input: Emotion information received by the server from the emotion engine and the user's message.

[2290] Processing: The server passes the emotion information and the user's message to the generation AI, instructing it to generate a response that reflects the emotion. The generation AI generates a response based on the emotion information.

[2291] Output: The generated response is returned to the server.

[2292] Step 6:

[2293] Input: The response received by the server from the generation AI.

[2294] Processing: The server generates a response and sends it to the terminal, which displays it to the user.

[2295] Output: The generated response is displayed on the user's smart glasses.

[2296] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2297] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2298] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2299] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2300] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2301] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2302] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2303] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2304] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2305] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2306] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2307] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2308] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2309] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2310] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2311] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2312] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2313] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2314] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2315] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2316] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2317] The following is further disclosed regarding the above embodiment.

[2318] (Claim 1)

[2319] an interface means for a user to input information about the character;

[2320] A means for the terminal to receive input information from a user and transmit the information to a server;

[2321] A means for generating a character's personality profile and answer patterns using a generation AI based on the information received by the server;

[2322] A means for the server to store the generated character information in a database;

[2323] a means for the terminal to send a message from the user to the server;

[2324] A means for the server to pass the received message to the generation AI and generate a response;

[2325] means for the server to send the generated response to the terminal and for the terminal to display the response;

[2326] A system including:

[2327] (Claim 2)

[2328] 2. The system of claim 1, wherein the generating AI comprises means for generating natural dialogue based on the character's personality profile.

[2329] (Claim 3)

[2330] 2. The system according to claim 1, further comprising means for allowing a user to input character information by voice and converting the information into character data using voice recognition means.

[2331] "Example 1"

[2332] (Claim 1)

[2333] an interface means for a user to input information about the character;

[2334] A means for the terminal to receive input information from a user and transmit the information to a server;

[2335] A means for generating a character's personality profile and answer patterns using a generation AI based on the information received by the server;

[2336] A means for the server to store the generated character information in a database;

[2337] a means for the terminal to send a message from the user to the server;

[2338] A means for the server to pass the received message to the generation AI and generate a response;

[2339] means for the server to send the generated response to the terminal and for the terminal to display the response;

[2340] A means for the server to generate a prompt for the request to the AI ​​generation and pass it to the AI ​​generation;

[2341] a means for the terminal to receive a response from the server and display it on an interactive screen;

[2342] A system including:

[2343] (Claim 2)

[2344] 2. The system of claim 1, wherein the generating AI comprises means for generating natural dialogue based on the character's personality profile.

[2345] (Claim 3)

[2346] 2. The system according to claim 1, further comprising means for allowing a user to input character information by voice and converting the information into character data using voice recognition means.

[2347] "Application Example 1"

[2348] (Claim 1)

[2349] an interface means for a user to input information about the character;

[2350] A means for the terminal to receive input information from a user and transmit the information to a server;

[2351] A means for generating a character's personality profile and answer patterns using a generation AI based on the information received by the server;

[2352] A means for the server to store the generated character information in a database;

[2353] a means for the terminal to send a message from the user to the server;

[2354] A means for the server to pass the received message to the generation AI and generate a response;

[2355] means for the server to send the generated response to the terminal and for the terminal to display the response;

[2356] means by which the user can interactively receive recommendations and place desired delivery orders;

[2357] A system including:

[2358] (Claim 2)

[2359] 2. The system of claim 1, wherein the generating AI comprises means for generating natural dialogue based on the character's personality profile.

[2360] (Claim 3)

[2361] 2. The system according to claim 1, further comprising means for allowing a user to input character information by voice and converting the information into character data using voice recognition means.

[2362] "Example 2: Combining Emotion Engines"

[2363] (Claim 1)

[2364] an interface means for a user to input information about the character;

[2365] A means for the terminal to receive input information from a user and transmit the information to a server;

[2366] a means for generating a character's personality profile and answer patterns using a generative AI model based on the information received by the server;

[2367] A means for the server to store the generated character information in a database;

[2368] a means for the terminal to send a message from the user to the server;

[2369] A means for the server to pass the received message to the AI ​​model to generate a response;

[2370] A means for the server to pass the user's message to an emotion analysis engine to obtain emotion information;

[2371] A means for the server to pass emotion information to the generative AI model and generate a response that takes emotion into account;

[2372] means for the server to send the generated response to the terminal and for the terminal to display the response;

[2373] A system including:

[2374] (Claim 2)

[2375] 10. The system of claim 1, wherein the generative AI model comprises means for generating natural-looking dialogue based on a character's personality profile.

[2376] (Claim 3)

[2377] 2. The system according to claim 1, further comprising means for allowing a user to input character information by voice and converting the information into character data using voice recognition means.

[2378] "Application example 2 when combining emotion engines"

[2379] (Claim 1)

[2380] an interface means for a user to input information about the character;

[2381] A means for the terminal to receive input information from a user and transmit the information to a server;

[2382] A means for generating a character's personality profile and answer patterns using a generation AI based on the information received by the server;

[2383] A means for the server to store the generated character information in a database;

[2384] a means for the terminal to send a message from the user to the server;

[2385] A means for the server to pass the received message to the generation AI and generate a response;

[2386] means for the server to send the generated response to the terminal and for the terminal to display the response;

[2387] a means for the terminal to record a voice message of the user and transmit the voice message to the server;

[2388] a means for the server to pass the voice message to an emotion engine for analyzing the emotional state;

[2389] A means for the AI ​​to generate a response based on the emotional information analyzed by the server,

[2390] A system including:

[2391] (Claim 2)

[2392] 2. The system of claim 1, wherein the generating AI comprises means for generating natural dialogue based on the character's personality profile.

[2393] (Claim 3)

[2394] 2. The system according to claim 1, further comprising means for allowing a user to input character information by voice and converting the information into character data using voice recognition means. [Explanation of symbols]

[2395] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. an interface means for a user to input information about the character; A means for the terminal to receive input information from a user and transmit the information to a server; A means for generating a character's personality profile and answer patterns using a generation AI based on the information received by the server; A means for the server to store the generated character information in a database; a means for the terminal to send a message from the user to the server; A means for the server to pass the received message to the generation AI and generate a response; means for the server to send the generated response to the terminal and for the terminal to display the response; A system including:

2. 2. The system of claim 1, wherein the generating AI comprises means for generating natural dialogue based on the character's personality profile.

3. 2. The system according to claim 1, further comprising means for allowing a user to input character information by voice and converting the information into character data using voice recognition means.

Images