system

Abstract

To provide a dialogue system using a dialogue generation engine in order to reduce the sense of loneliness felt by elderly people and provide a fulfilling dialogue experience. [Solution] A system including: a means for receiving login information from a user and performing authentication; a means for displaying a dialogue start screen to an authenticated user; a means for receiving a user's dialogue start request and starting a dialogue generation engine; a means for displaying an initial greeting message generated by the dialogue generation engine to the user; a means for receiving a message from the user and having the dialogue generation engine generate an appropriate reply based on the message; and a means for displaying the generated reply to the user.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, elderly people often feel lonely. Furthermore, as the aging population continues, the fact that elderly people are spending more time alone has become a social problem. Feeling loneliness among the elderly has a negative impact on not only their mental health but also their physical health. However, many elderly people find it difficult to find someone to talk to due to physical distance and time constraints. Current technology is not able to adequately address these issues. [Means for solving the problem]

[0005] The present invention provides a dialogue system that uses chat generation AI to reduce the sense of loneliness of elderly people and provide a fulfilling dialogue experience. Specifically, the present invention includes the following means:

[0006] The system includes a means for receiving login information from a user and performing authentication, a means for displaying a dialogue start screen to the authenticated user, a means for receiving a dialogue start request from the user and activating a chat generation system AI, a means for displaying an initial greeting message generated by the chat generation system AI to the user, a means for receiving a message from the user and generating an appropriate reply based on the message by the chat generation system AI, and a means for displaying the generated reply to the user.

[0007] It also includes a means for passing a request to chat generation AI when a user requests to talk about a specific topic and generating information and questions related to that topic, and a means for passing a request to chat generation AI when a user requests humor or a fun story and generating a message that includes humorous elements. This makes it possible to flexibly respond to topics that interest seniors and provide a fun conversation experience.

[0008] "User" refers to an individual who interacts with the system.

[0009] "Login information" refers to authentication information such as ID and password entered by a user when accessing the system.

[0010] "Authentication" refers to the process of verifying a user's login information and determining whether the user has legitimate access rights.

[0011] The "interaction start screen" refers to the screen that is displayed to the user after successful authentication, and that provides an interface for starting an interaction.

[0012] "Interaction initiation request" refers to a request sent by a user to begin an interaction.

[0013] "Dialogue generation engine" refers to software or algorithms that generate appropriate dialogue based on input from a user.

[0014] A "greeting message" is the first message generated by the dialogue generation engine, and includes words of welcome to the user and an opening question.

[0015] A "message" refers to text entered by a user or text generated by a dialogue generation engine, and is the basic unit of dialogue.

[0016] A "topic" refers to a specific topic or theme, and refers to content that interests users.

[0017] "Humor" refers to content that includes elements that provoke fun interactions and laughter in the dialogue.

[0018] A "story" refers to a series of events or a narrative generated by a dialogue generation engine, intended to provide a fun experience for the user.

[0019] "Request" means a request sent by a User to a System for specific information or action.

[0020] "Generating" refers to the dialogue generation engine using an algorithm to create a text message.

[0021] "Displaying" refers to presenting the generated message or information in a visible form on the user's terminal screen. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0023] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0024] First, the terms used in the following description will be explained.

[0025] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0026] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0027] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0028] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0030] [First embodiment]

[0031] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0032] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0033] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0034] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0035] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0036] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0037] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0038] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0039] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0040] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0041] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0042] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0043] The present invention aims to alleviate the sense of loneliness felt by elderly people and provide them with a fulfilling dialogue experience. This system utilizes a dialogue generation engine to generate dialogue based on user input and to facilitate natural communication. Specific embodiments for implementing the present invention will be described below.

[0044] System configuration

[0045] The system mainly consists of the following elements:

[0046] 1. Server: Mainly responsible for user authentication, managing the dialogue generation engine, and storing dialogue data.

[0047] 2. Terminal: A device (e.g., smartphone, tablet, or PC) that is directly operated by the user and provides the user interface.

[0048] 3. User: An individual who interacts with the system, primarily targeted at elderly people.

[0049] 4. Dialogue generation engine: Consists of algorithms and software that generate appropriate dialogue in response to user input.

[0050] Program processing

[0051] The program does the following:

[0052] 1. User Registration and Login:

[0053] The user accesses the system login screen and enters their ID and password.

[0054] The terminal sends the entered login information to the server.

[0055] The server checks the login information and authenticates the user. If successful, it sends an authentication success message to the terminal.

[0056] 2. Start a conversation:

[0057] The user clicks the Start Interaction button.

[0058] The terminal sends this request to the server.

[0059] The server starts the dialogue generation engine and generates an initial greeting message.

[0060] The server sends the generated greeting message to the terminal, which displays it to the user.

[0061] 3. Continuing the dialogue:

[0062] When the user replies to the AI's message, the device sends the message to the server.

[0063] The server passes the received message to the dialogue generation engine, which generates an appropriate reply.

[0064] The server sends the generated reply to the terminal, which displays it to the user.

[0065] 4. Conversations about topics that interest you:

[0066] A user requests to talk about a specific topic (e.g., "I want to talk about travel").

[0067] The device sends the request to the server.

[0068] The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[0069] The server sends the generated message to the terminal, which displays it to the user.

[0070] 5. Providing stories and humor:

[0071] The user requests, "Tell me an interesting story."

[0072] The device sends the request to the server.

[0073] The server causes the dialogue generation engine to generate messages containing story and humorous elements.

[0074] The server sends the generated message to the terminal, which displays it to the user.

[0075] 6. Ending the conversation:

[0076] If the user wishes to end the conversation, he or she clicks the "End conversation" button.

[0077] The terminal notifies the server of the request.

[0078] The server terminates the session with the dialogue generation engine and sends a session termination message to the terminal.

[0079] The terminal displays a session termination message to the user.

[0080] Specific examples

[0081] Example 1: Logging in and starting a conversation

[0082] 1. The user enters their ID and password on the login screen.

[0083] 2. The server checks the input information and performs authentication.

[0084] 3. If authentication is successful, the terminal displays a greeting message from the dialogue generation engine to the user: "Hello, what would you like to talk about today?"

[0085] Example 2: Travel topics

[0086] 1. User types, "I want to talk about travel."

[0087] 2. The server passes the request to the dialogue generation engine.

[0088] 3. The dialogue generation engine generates a message related to the topic, such as "Where have you traveled recently and where would you like to go?", and the server sends the message to the device.

[0089] 4. The device displays the message to the user, and the user enjoys talking about their travel memories and plans.

[0090] Example 3: Providing humor

[0091] 1. The user requests, "Tell me an interesting story."

[0092] 2. The server sends the request to the dialogue generation engine.

[0093] 3. The dialogue generation engine generates a humorous story such as "One day, an elephant came into the restaurant..." and the server sends the message to the device.

[0094] 4. The device displays a fun story to the user, making them laugh and feel happy.

[0095] As described above, the present invention provides a specific system configuration and processing method for reducing the sense of loneliness felt by elderly people and providing them with a rich conversation experience.

[0096] The processing flow will be explained below.

[0097] Step 1:

[0098] A user accesses the system and enters their ID and password on the login screen.

[0099] Step 2:

[0100] The terminal sends the entered login information to the server.

[0101] Step 3:

[0102] The server receives the login information and authenticates the user against a database.

[0103] Step 4:

[0104] The server sends the authentication result to the terminal. If authentication is successful, it sends a success message and profile information. If authentication is unsuccessful, it sends an error message.

[0105] Step 5:

[0106] The terminal receives a message that authentication was successful and displays the start screen of the dialogue to the user. If authentication failed, an error message is displayed to the user.

[0107] Step 6:

[0108] The user clicks the Start Interaction button.

[0109] Step 7:

[0110] The terminal sends a dialogue initiation request to the server.

[0111] Step 8:

[0112] The server starts the dialogue generation engine and generates the initial greeting message.

[0113] Step 9:

[0114] The server sends the generated greeting message to the terminal.

[0115] Step 10:

[0116] The terminal displays a greeting message to the user.

[0117] Step 11:

[0118] The user types a reply to the greeting message.

[0119] Step 12:

[0120] The terminal sends the user's input to the server.

[0121] Step 13:

[0122] The server passes messages from the user to a dialogue generation engine, which generates appropriate replies.

[0123] Step 14:

[0124] The server sends the generated reply to the terminal.

[0125] Step 15:

[0126] The terminal displays the reply to the user.

[0127] Step 16:

[0128] A user submits a request to talk about a specific topic (e.g., "I want to talk about travel").

[0129] Step 17:

[0130] The device sends a topic request to the server.

[0131] Step 18:

[0132] The server passes the topic request to a dialogue generation engine, which generates information and questions related to the topic.

[0133] Step 19:

[0134] The server sends the generated topic-related message to the terminal.

[0135] Step 20:

[0136] The terminal displays topic-related messages to the user.

[0137] Step 21:

[0138] The user requests humorous or entertaining stories, such as "tell me a funny story."

[0139] Step 22:

[0140] The terminal sends this request to the server.

[0141] Step 23:

[0142] The server passes the request to a dialogue generation engine, which generates a message containing humorous elements.

[0143] Step 24:

[0144] The server sends the generated humor message to the terminal.

[0145] Step 25:

[0146] The terminal displays the humorous message to the user.

[0147] Step 26:

[0148] If the user wishes to end the conversation, he or she clicks the "End conversation" button.

[0149] Step 27:

[0150] The terminal notifies the server of a request to terminate the conversation.

[0151] Step 28:

[0152] The server terminates the session with the dialogue generation engine and sends a session termination message to the terminal.

[0153] Step 29:

[0154] The terminal displays a session termination message to the user.

[0155] Example 1

[0156] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0157] Elderly people are prone to feelings of social isolation and loneliness, which can have a negative impact on their mental health. Elderly people who live alone, in particular, tend to lack opportunities for daily communication. Therefore, it is necessary to resolve these issues and help elderly people reduce their loneliness through fulfilling conversational experiences, thereby improving the quality of their daily lives.

[0158] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0159] In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen for the authenticated user, means for receiving a dialogue start request from the user and starting a dialogue generation engine, means for displaying an initial greeting message generated by the dialogue generation engine to the user, means for receiving a message from the user and generating an appropriate reply based on the message by the dialogue generation engine, means for displaying the generated reply to the user, means for inputting a prompt sentence on a specific topic to the dialogue generation engine and generating information or questions related to the topic, and means for inputting a prompt sentence of a humorous or fun story to the dialogue generation engine in response to a request from the user and generating a message containing an element of humor. This allows elderly people to reduce their sense of loneliness through everyday dialogue experiences and makes it easier to maintain their mental health.

[0160] "Login information" refers to authentication information such as ID and password that a user enters when accessing a system.

[0161] "Authentication" is the process by which a system verifies a user's login information and determines whether the user is legitimate.

[0162] The "interaction start screen" is a screen that provides an interface for the user to start an interaction.

[0163] A "dialogue start request" is an operation or input information that a user performs to notify the system that he or she wishes to start a dialogue.

[0164] A "dialogue generation engine" is a collection of algorithms and software that generates natural dialogue based on user input.

[0165] The "initial greeting message" is a greeting message generated by the dialogue generation engine for the first time user.

[0166] A "message" is a conversation that a user inputs into the system and a conversation that is sent from the system to the user.

[0167] An "appropriate reply" is a response that the dialogue generation engine generates based on the user's message.

[0168] A "generated reply" is a response to a user's message that is generated by the dialogue generation engine.

[0169] A "specific topic" is a specific topic or theme that a user wishes to discuss with the system.

[0170] A "prompt sentence" is text that is input to a dialogue generation engine and contains instructions or guidance to generate something.

[0171] "Information and questions" are data and questions generated by the dialogue generation engine related to a specific topic.

[0172] "Humor elements" are elements of humor or humor contained in messages generated by the dialogue generation engine.

[0173] A "fun story" is an interesting and entertaining story that the dialogue generation engine generates in response to a user request.

[0174] The present invention is a system for reducing the sense of loneliness felt by elderly people and providing them with a fulfilling dialogue experience. This system includes a server that performs user authentication, manages a dialogue generation engine, and stores dialogue data, a terminal that is directly operated by the user, and a dialogue generation engine that generates dialogue based on input from the user. Specific embodiments for implementing this system are described below.

[0175] Components

[0176] 1. Server:

[0177] It performs user authentication and manages the dialogue in cooperation with the dialogue generation engine.

[0178] The software used includes database management systems (MySQL (registered trademark) and PostgreSQL) and generative AI models (e.g., GPT-3 (registered trademark)).

[0179] 2. Terminal:

[0180] A device (smartphone, tablet, PC) that allows users to interact directly.

[0181] It provides a user interface, sends user input to the server, and displays replies from the server to the user.

[0182] 3. Dialogue generation engine:

[0183] Use a generative AI model (e.g., GPT-3) to generate natural-looking dialogue based on user input.

[0184] Operational Overview

[0185] The system works as follows:

[0186] User Registration and Login

[0187] 1. The user enters their ID and password on the login screen.

[0188] 2. The device sends this information to the server, which then authenticates the user.

[0189] 3. If the authentication is successful, the server sends an authentication success message to the terminal, and the terminal displays "Login successful" to the user.

[0190] Start a dialogue

[0191] 1. The user clicks the "Start conversation" button.

[0192] 2. The device sends this request to the server.

[0193] 3. The server starts the dialogue generation engine and generates the initial greeting message.

[0194] 4. The server sends the generated greeting message to the terminal, which displays it to the user.

[0195] Continuing the dialogue

[0196] 1. When the user replies to the AI's message, the device sends the message to the server.

[0197] 2. The server passes this message to the dialogue generation engine, which generates an appropriate reply.

[0198] 3. The server generates a reply and sends it to the device, which displays it to the user.

[0199] Conversations about topics that interest you

[0200] 1. A user requests to "talk about travel."

[0201] 2. The device sends the request to the server.

[0202] 3. The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[0203] 4. The server sends the generated message to the terminal, which displays it to the user.

[0204] Providing stories and humor

[0205] 1. The user requests, "Tell me an interesting story."

[0206] 2. The device sends the request to the server.

[0207] 3. The server instructs the dialogue generation engine to generate messages that include story and humorous elements.

[0208] 4. The server sends the generated message to the terminal, which displays it to the user.

[0209] Examples of prompt statements

[0210] The following is an example of a prompt that may be entered into the system:

[0211] 1. Login prompt:

[0212] Please enter your user ID and password.

[0213] 2. Prompt at the beginning of the dialogue:

[0214] Start a dialogue: What do you want to talk about?

[0215] 3. Travel topic request prompt:

[0216] I want to talk about travel.

[0217] 4. Humor requests prompt:

[0218] Please tell me an interesting story.

[0219] Through the above-mentioned components and operations, the system is designed to enable elderly people to enjoy everyday interactive experiences and reduce feelings of loneliness.

[0220] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0221] Program processing steps

[0222] Step 1: User Registration and Login

[0223] 1. The user enters their ID and password on the login screen.

[0224] Input: The user enters their ID and password into the login form.

[0225] Output: Login information is sent to the terminal.

[0226] 2. The device sends the entered login information to the server.

[0227] Input: The login information entered by the user.

[0228] Output: The input information is encrypted and sent to the server.

[0229] 3. The server verifies the login information and authenticates the user.

[0230] Input: The login information received by the server.

[0231] Processing: Authenticate the user by checking against the user information in the database.

[0232] Output: Generates a message indicating authentication success or failure.

[0233] 4. The server sends an authentication success message to the terminal.

[0234] Input: Authentication success message.

[0235] Output: A successful authentication message is sent to the terminal.

[0236] 5. The terminal receives the authentication success message and displays a "Login successful" notification to the user.

[0237] Input: Authentication success message.

[0238] Output: A successful login notification is displayed to the user.

[0239] Step 2: Start a conversation

[0240] 1. The user clicks the "Start conversation" button.

[0241] Input: User action (clicking a button).

[0242] Output: A conversation initiation request is generated on the terminal.

[0243] 2. The device sends this request to the server.

[0244] Input: A conversation-initiating request.

[0245] Output: The request is sent to the server.

[0246] 3. The server starts the dialogue generation engine and generates the initial greeting message.

[0247] Input: A conversation-initiating request.

[0248] Processing: The dialogue generation engine generates an initial greeting message based on the prompt sentence.

[0249] Output: Initial greeting message.

[0250] 4. The server sends the generated greeting message to the terminal.

[0251] Input: Initial greeting message.

[0252] Output: A greeting message is sent to the terminal.

[0253] 5. The terminal displays a greeting message to the user.

[0254] Input: A greeting message.

[0255] Output: A greeting message is displayed to the user.

[0256] Step 3: Continue the conversation

[0257] 1. When the user replies to the AI's message, the device sends the message to the server.

[0258] Input: The user's reply message.

[0259] Output: A reply message is sent from the device to the server.

[0260] 2. The server passes the received message to the dialogue generation engine.

[0261] Input: The user's reply message.

[0262] Output: The message is passed to the dialogue generation engine.

[0263] 3. The dialogue generation engine generates an appropriate reply.

[0264] Input: The user's reply message.

[0265] Processing: The dialogue generation engine generates an appropriate reply.

[0266] Output: The generated reply message.

[0267] 4. The server generates a reply and sends it to the terminal, which displays it to the user.

[0268] Input: The generated reply message.

[0269] Output: The reply message is sent to the terminal and displayed to the user.

[0270] Step 4: Talk about topics that interest you

[0271] 1. A user requests to "talk about travel."

[0272] Input: User's request on the topic.

[0273] Output: The request is sent to the device.

[0274] 2. The device sends the request to the server.

[0275] Input: The user request.

[0276] Output: The request is sent to the server.

[0277] 3. The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[0278] Input: The user request.

[0279] Processing: The dialogue generation engine generates information and questions related to the topic.

[0280] Output: The information or question generated.

[0281] 4. The server sends the generated message to the terminal, which displays it to the user.

[0282] Input: Generated information or question.

[0283] Output: Messages are sent to the terminal and displayed to the user.

[0284] Step 5: Provide a story and humor

[0285] 1. The user requests, "Tell me an interesting story."

[0286] Input: The user request.

[0287] Output: The request is sent to the device.

[0288] 2. The device sends the request to the server.

[0289] Input: The user request.

[0290] Output: The request is sent to the server.

[0291] 3. The server instructs the dialogue generation engine to generate messages that include story and humorous elements.

[0292] Input: The user request.

[0293] Processing: The dialogue generation engine generates messages that include story and humorous elements.

[0294] Output: The generated story message.

[0295] 4. The server sends the generated message to the terminal, which displays it to the user.

[0296] Input: The generated story message.

[0297] Output: Messages are sent to the terminal and displayed to the user.

[0298] Step 6: Ending the conversation

[0299] 1. If the user wants to end the conversation, he clicks the "End conversation" button.

[0300] Input: User action (clicking a button).

[0301] Output: A termination request is generated on the terminal.

[0302] 2. The device notifies the server of the request.

[0303] Input: The conversation termination request.

[0304] Output: The request is sent to the server.

[0305] 3. The server ends the session with the dialogue generation engine.

[0306] Input: The conversation termination request.

[0307] Action: Ends the session with the dialogue generation engine.

[0308] Output: Session termination message.

[0309] 4. The server sends a session termination message to the terminal, which displays it to the user.

[0310] Input: Session termination message.

[0311] Output: Messages are sent to the terminal and displayed to the user.

[0312] (Application example 1)

[0313] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0314] In order to reduce the sense of loneliness felt by the elderly and to help them live their daily lives more safely and comfortably, a wide range of support is required, including not only simple dialogue but also assistance in emergencies and the management of daily tasks. However, conventional dialogue systems lack the functionality to comprehensively address these diverse needs. Therefore, there is a need for a system that not only alleviates the sense of loneliness for the elderly but also provides integrated support for assistance in emergencies and the management of daily tasks.

[0315] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0316] In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen to the authenticated user, means for receiving a dialogue start request from the user and activating a dialogue generation engine, means for displaying an initial greeting message generated by the dialogue generation engine to the user, means for receiving a message from the user and for the dialogue generation engine to generate an appropriate reply based on the message, means for displaying the generated reply to the user, means for the user to send a request for assistance in an emergency and make an emergency call, means for the user to send a request to set a reminder for a specific task and set the reminder, and means for conducting daily health checks and recording the results. This makes it possible to reduce the elderly's sense of loneliness while providing centralized support for emergency assistance and managing daily tasks.

[0317] 1. "Elderly" generally refers to the population aged 65 and over who require special care and support due to physical and mental changes that occur with aging.

[0318] 2. "Loneliness" refers to the loneliness and anxiety that arise from being alone due to a weakening of social connections with others.

[0319] 3. "Dialogue generation engine" refers to a system consisting of algorithms and software for conducting natural conversations based on user input.

[0320] 4. "System" refers to a technical configuration in which multiple means or elements work together to achieve a specific purpose.

[0321] 5. "User" means an individual who uses the System and enjoys its interaction and other features.

[0322] 6. "Login Information" means the authentication information required for a user to access the system, and usually consists of an ID and password.

[0323] 7. "Authentication" means the process of verifying that the login information provided belongs to the registered user.

[0324] 8. "Screen" refers to the interface displayed on a terminal, enabling interaction and operation between the user and the system.

[0325] 9. "Message" means text data exchanged during a conversation.

[0326] 10. A "request" is an action taken by a user to request a specific action or information from a system.

[0327] 11. "Emergency Call" refers to a means of communication to request assistance in an emergency.

[0328] 12. "Reminder" is a function that notifies users of tasks or events that they have set.

[0329] 13. "Health Check" is the process of checking the user's daily health status and recording the results.

[0330] 14. "Multi-faceted support" refers to a wide range of assistance to address different types of needs and requirements.

[0331] The present invention is a system that reduces feelings of loneliness among elderly people and provides integrated support for emergency assistance and daily task management. This system uses a dialogue generation engine to provide natural dialogue with the user, and also combines emergency call functions, reminder setting, and health check functions. Specific embodiments for implementing the present invention are described below.

[0332] System configuration

[0333] The system mainly consists of the following elements:

[0334] 1. Server: Responsible for user authentication, managing the dialogue generation engine, and storing dialogue data.

[0335] 2. Terminal: A device (e.g., smartphone, tablet, or PC) that is directly operated by the user and provides the user interface.

[0336] 3. User: An individual who interacts with the system, primarily targeted at elderly people.

[0337] 4. Dialogue generation engine: Consists of algorithms and software that generate appropriate dialogue in response to user input.

[0338] Detailed System Operation

[0339] 1. User Registration and Login

[0340] The user accesses the system's login screen and enters their ID and password. The terminal sends the entered login information to the server, which then verifies and authenticates the login information. If authentication is successful, an authentication success message is sent to the terminal.

[0341] 2. Start a dialogue

[0342] When the user clicks the dialogue start button, the terminal sends this request to the server. The server starts the dialogue generation engine and generates the initial greeting message. This message is sent to the terminal and displayed to the user.

[0343] 3. Continuing the dialogue

[0344] When a user replies to a message from the AI, the device sends the message to the server, which passes the message to the dialogue generation engine, which generates an appropriate reply. The reply is then sent to the device and displayed to the user.

[0345] 4. Emergency call function

[0346] When a user needs assistance in an emergency, they send an emergency call request, which the device sends to the server, which then makes the emergency call.

[0347] 5. Reminder Settings

[0348] A user can send a request to set a reminder for a particular task, and the device will send the request to the server, which will set the reminder.

[0349] 6. Health Check

[0350] The user is asked questions to check their health condition every day. The user's answers are sent from the device to the server, and the results are recorded.

[0351] Technology used

[0352] Hardware: Using a smartphone or robot as the primary device.

[0353] Software: Dialogue generation is performed using OpenAI's (registered trademark) GPT-3 model. Server-side programs are often implemented in Python.

[0354] Specific examples

[0355] Examples of everyday conversations:

[0356] User: "What's the weather like these days?"

[0357] System response: "I want to talk about the weather."

[0358] Example of a story:

[0359] User: "Tell me a funny story."

[0360] System response: "Tell us a funny story."

[0361] This system will enable elderly people to reduce their sense of loneliness while providing centralized support for emergency assistance and managing daily tasks.

[0362] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0363] Step 1:

[0364] The user accesses the system's login screen and enters their ID and password. The entered login information is sent by the terminal to the server. The server receives the user's login information (ID and password) and performs authentication by checking it against a database. If authentication is successful, the server generates an authentication success message and sends it to the terminal. The terminal displays the received authentication success message to the user.

[0365] Step 2:

[0366] The user clicks the dialogue start button. The terminal sends this request to the server. The server starts the dialogue generation engine and generates the first greeting message. The generated greeting message is sent to the terminal, which displays it to the user. Based on the user's input (dialogue start instruction), the system starts the dialogue process.

[0367] Step 3:

[0368] When the user replies to the AI's message, the device sends the message to the server. The server passes the received message to the dialogue generation engine, which generates an appropriate reply. The generated reply message is sent from the server to the device, which displays it to the user.

[0369] Step 4:

[0370] When a user needs assistance in an emergency, they input an emergency call request. The device sends the request to the server. The server receives the emergency call request and notifies the pre-configured emergency contacts. The server generates a call completion message and sends it to the device. The device displays this message to the user.

[0371] Step 5:

[0372] The user sends a request to set a reminder for a specific task. The device sends this request to the server. The server receives the request and sets the reminder for the specified date and time. A message indicating the completion of the setting is sent from the server to the device and displayed to the user.

[0373] Step 6:

[0374] Questions for daily health checks are sent from the server to the terminal. The terminal displays the questions to the user, who answers them. The terminal sends the answers to the server, which records the answers in a database. The server generates a recording completion message and sends it to the terminal. The terminal displays this message to the user.

[0375] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0376] The present invention provides a system that combines a dialogue generation engine with an emotion engine that recognizes the user's emotions in order to reduce the sense of loneliness felt by elderly people and provide a fulfilling dialogue experience. Specific embodiments for carrying out the present invention will be described below.

[0377] System configuration

[0378] The system mainly consists of the following elements:

[0379] 1. Server: Responsible for user authentication, managing the dialogue generation engine and emotion engine, and storing dialogue data.

[0380] 2. Terminal: A device (e.g., smartphone, tablet, or PC) that is directly operated by the user and provides the user interface.

[0381] 3. Users: Individuals who interact with the system, primarily elderly people, are the main target.

[0382] 4. Dialogue generation engine: Consists of algorithms and software that generate appropriate dialogue based on user input.

[0383] 5. Emotion Engine: Consists of algorithms and software for recognizing emotions from user input and responses and adjusting the output of the dialogue generation engine based on those emotions.

[0384] Program processing

[0385] The program does the following:

[0386] 1. User Registration and Login:

[0387] A user accesses the system and enters their ID and password on the login screen.

[0388] The device sends the login information to the server.

[0389] The server checks the login information and authenticates the user. If authentication is successful, it sends a message of authentication success and the user's profile information to the terminal.

[0390] 2. Start a conversation:

[0391] The user clicks the Start Interaction button.

[0392] The terminal sends a dialogue initiation request to the server.

[0393] The server starts the dialogue generation engine and generates the initial greeting message.

[0394] The server sends the generated greeting message to the terminal, which displays it to the user.

[0395] 3. Continuing the dialogue:

[0396] The user types a reply to the greeting message.

[0397] The terminal sends the user's input message to the server.

[0398] The server passes the message from the user to the emotion engine, which analyzes the user's emotions.

[0399] The emotion engine sends the analysis results to the server.

[0400] The server passes the emotion engine's analysis results and the user's message to the dialogue generation engine, which then generates an appropriate reply.

[0401] The server sends the generated reply to the terminal, which displays it to the user.

[0402] 4. Conversations about topics that interest you:

[0403] A user requests to talk about a specific topic, such as "I want to talk about travel."

[0404] The device sends a request to the server.

[0405] The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[0406] The server sends the generated topic-related messages to the terminal, which displays them to the user.

[0407] 5. Providing stories and humor:

[0408] A user sends a request such as "Tell me a funny story."

[0409] The device sends a request to the server.

[0410] The server passes the request to a dialogue generation engine, which generates messages containing story and humorous elements.

[0411] The server sends the generated message to the terminal, which displays it to the user.

[0412] 6. Ending the conversation:

[0413] The user clicks the "End conversation" button to end the conversation.

[0414] The terminal notifies the server of the request.

[0415] The server terminates the session with the dialogue generation engine and emotion engine, and sends a session termination message to the terminal.

[0416] The terminal displays a session termination message to the user.

[0417] Specific examples

[0418] Example 1: Logging in and starting a conversation

[0419] 1. The user enters their ID and password on the login screen.

[0420] 2. The server checks the entered information and performs authentication. If authentication is successful, an authentication success message and profile information are sent to the device.

[0421] 3. The terminal displays the dialogue start screen and displays a greeting message from the dialogue generation engine to the user, such as "Hello, what would you like to talk about today?"

[0422] Example 2: Travel topics

[0423] 1. User types, "I want to talk about travel."

[0424] 2. The server passes the request to the dialogue generation engine.

[0425] 3. The dialogue generation engine generates a message related to the topic, such as "Where have you traveled recently and where would you like to go?" and sends it to the device via the server.

[0426] 4. The device displays the message to the user, and the user enjoys talking about their travel memories and plans.

[0427] Example 3: Providing humor and sentiment analysis

[0428] 1. The user requests, "Tell me an interesting story."

[0429] 2. The server sends the request to the dialogue generation engine.

[0430] 3. The dialogue generation engine generates a humorous story such as "One day, an elephant came into the restaurant..." and sends it to the device via the server.

[0431] 4. The server passes the humor message to the emotion engine, which analyzes the user's reaction.

[0432] 5. The emotion engine notifies the dialogue generation engine and the server of the analysis results, which are reflected in the next message.

[0433] 6. The user reads an entertaining story and the next dialogue is tailored based on their emotions.

[0434] As described above, the present invention specifically shows a system configuration and processing method for reducing the sense of loneliness felt by elderly people and providing them with a rich conversation experience.

[0435] The processing flow will be explained below.

[0436] Step 1:

[0437] A user accesses the system and enters their ID and password on the login screen.

[0438] Step 2:

[0439] The terminal sends the entered login information to the server.

[0440] Step 3:

[0441] The server receives the login information and authenticates the user against a database.

[0442] Step 4:

[0443] The server sends the authentication result to the terminal. If authentication is successful, it sends a success message and profile information. If authentication is unsuccessful, it sends an error message.

[0444] Step 5:

[0445] The terminal receives a message that authentication was successful and displays the start screen of the dialogue to the user. If authentication failed, an error message is displayed to the user.

[0446] Step 6:

[0447] The user clicks the Start Interaction button.

[0448] Step 7:

[0449] The terminal sends a dialogue initiation request to the server.

[0450] Step 8:

[0451] The server starts the dialogue generation engine and generates the initial greeting message.

[0452] Step 9:

[0453] The server sends the generated greeting message to the terminal.

[0454] Step 10:

[0455] The terminal displays a greeting message to the user.

[0456] Step 11:

[0457] The user types a reply to the greeting message.

[0458] Step 12:

[0459] The terminal sends the user's input to the server.

[0460] Step 13:

[0461] The server passes a message from the user to the emotion engine, which then recognizes the user's emotion.

[0462] Step 14:

[0463] The emotion engine transmits the recognized emotion information to the server.

[0464] Step 15:

[0465] The server passes the emotion information and the user's message to the dialogue generation engine, which then generates an appropriate reply.

[0466] Step 16:

[0467] The server sends the generated reply to the terminal.

[0468] Step 17:

[0469] The terminal displays the reply to the user.

[0470] Step 18:

[0471] A user submits a request to talk about a specific topic (e.g., they want to talk about travel).

[0472] Step 19:

[0473] The device sends a topic request to the server.

[0474] Step 20:

[0475] The server passes the topic request to a dialogue generation engine, which generates information and questions related to the topic.

[0476] Step 21:

[0477] The server sends the generated topic-related message to the terminal.

[0478] Step 22:

[0479] The terminal displays topic-related messages to the user.

[0480] Step 23:

[0481] The user requests humorous or entertaining stories, such as "tell me a funny story."

[0482] Step 24:

[0483] The terminal sends this request to the server.

[0484] Step 25:

[0485] The server passes the request to a dialogue generation engine, which generates a message containing humorous elements.

[0486] Step 26:

[0487] The server sends the generated humor message to the terminal.

[0488] Step 27:

[0489] The terminal displays the humorous message to the user.

[0490] Step 28:

[0491] The server passes the humor message to an emotion engine, which analyzes the user's reaction.

[0492] Step 29:

[0493] The emotion engine sends the analysis results to the server and the dialogue generation engine.

[0494] Step 30:

[0495] The dialogue generation engine adjusts the next reply based on the emotional information from the emotion engine.

[0496] Step 31:

[0497] The user clicks the "End conversation" button to end the conversation.

[0498] Step 32:

[0499] The terminal notifies the server of a request to terminate the conversation.

[0500] Step 33:

[0501] The server terminates the session with the dialogue generation engine and emotion engine, and sends a session termination message to the terminal.

[0502] Step 34:

[0503] The terminal displays a session termination message to the user.

[0504] Example 2

[0505] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0506] Elderly people often feel lonely in their daily lives, and this can be a serious problem, especially if they spend a lot of time alone. Current technology does not provide sufficient methods to alleviate this loneliness and provide a richer interactive experience. Therefore, new systems are needed to help seniors avoid feeling lonely.

[0507] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0508] In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen to the authenticated user, and means for displaying an initial greeting message generated by the dialogue generation engine to the user. This allows elderly people to use the system easily and provides a dialogue experience that begins naturally from the very beginning.

[0509] The server further includes means for receiving a message from the user and for the dialogue generation engine to generate an appropriate reply based on the message, means for analyzing the user's emotions using the emotion engine, and means for the dialogue generation engine to generate an appropriate response based on the analysis result of the emotion engine. This enables a highly personalized dialogue according to the user's emotions, thereby improving the effect of reducing loneliness among the elderly.

[0510] "User" refers to an individual who interacts with the system, and is primarily targeted at elderly people.

[0511] "Login information" refers to authentication information such as ID and password entered by a user when accessing the system.

[0512] "Authentication" refers to the process of verifying the login information entered by a user and granting access to a system.

[0513] The "interaction start screen" is the first screen that is displayed after a user has been authenticated by the system, and provides an interface for starting an interaction.

[0514] "Dialogue generation engine" refers to algorithms and software that automatically generate appropriate dialogue messages based on input from a user.

[0515] The "initial greeting message" refers to the first message generated by the dialogue generation engine and displayed to the user at the start of a dialogue.

[0516] "Emotion Engine" refers to algorithms and software for recognizing emotions from user input and responses and adjusting the output of the dialogue generation engine based on those emotions.

[0517] "Analysis results" refers to the emotional information that the emotion engine obtains from the user's input, and affects the output of the dialogue generation engine.

[0518] An "appropriate reply" refers to a response message generated by the dialogue generation engine based on the user's input and the analysis results of the emotion engine.

[0519] "System" refers to the entire dialogue system, including the above elements, designed to reduce loneliness among the elderly.

[0520] This invention is a dialogue system designed to alleviate loneliness, especially among the elderly, and provide a rich dialogue experience. The system mainly consists of a server, a terminal, a generative AI model (a dialogue generation engine and an emotion engine), and a user.

[0521] System configuration

[0522] The system includes the following elements:

[0523] 1. Server: Responsible for user authentication, managing the dialogue generation engine and emotion engine, and storing dialogue data.

[0524] 2. Terminal: A device (smartphone, tablet, PC) that is directly operated by the user and provides the user interface.

[0525] 3. Users: Individuals who interact with the system, primarily elderly people, are the main target.

[0526] 4. Dialogue Generation Engine: Algorithms and software that generate appropriate dialogue based on input from the user.

[0527] 5. Emotion Engine: Algorithms and software for recognizing emotions from user input and responses and adjusting the output of the dialogue generation engine based on those emotions.

[0528] Hardware and Software Used

[0529] Server: Uses major cloud service providers (e.g., AWS (registered trademark), Google (registered trademark) Cloud).

[0530] Devices: General iOS devices, ANDROID (registered trademark) devices, Windows PCs, and macOS (registered trademark) PCs.

[0531] Dialogue generation engine: Natural language processing algorithm (e.g., GPT-3, GPT-4 (registered trademark)).

[0532] Emotion engine: An emotion analysis algorithm (e.g., IBM Watson® Tone Analyzer, Microsoft® Azure® Emotion API).

[0533] Explanation of program processing

[0534] This system performs a series of processes from user login to starting a dialogue, continuing the conversation, analyzing emotions, conducting a conversation based on a theme, and providing humor.

[0535] 1. User Registration and Login:

[0536] A user accesses the system and enters their ID and password on the login screen.

[0537] The device sends this information to the server for authentication. If authentication is successful, the device displays the following screen and the user's profile information.

[0538] 2. Start a conversation:

[0539] The user clicks the Start Interaction button.

[0540] The terminal sends a dialogue start request to the server.

[0541] The server starts a dialogue generation engine, generates an initial greeting message, and sends it to the terminal.

[0542] The terminal displays a greeting message to the user.

[0543] 3. Continuing the dialogue:

[0544] The user enters a message and sends it to the terminal.

[0545] The device sends the message to the server, where the emotion engine analyzes the emotion.

[0546] The server passes the analysis results of the emotion engine to the dialogue generation engine, which generates an appropriate response.

[0547] The terminal displays the generated response message to the user.

[0548] 4. Conversations about topics that interest you:

[0549] A user enters a request such as "I want to talk about travel."

[0550] The terminal sends a request to the server, which passes it to the dialogue generation engine.

[0551] The dialogue generation engine generates relevant information and questions and sends them to the terminal via the server.

[0552] The terminal displays this message to the user.

[0553] 5. Providing stories and humor:

[0554] The user requests, "Tell me an interesting story."

[0555] The device sends the request to the server.

[0556] The server passes the request to a dialogue generation engine, which generates a message containing humorous elements.

[0557] The emotion engine analyzes the user's reaction and generates the next message based on the results.

[0558] The terminal displays the generated message to the user.

[0559] Specific examples

[0560] Example 1: Logging in and starting a conversation

[0561] 1. The user enters their ID and password to log in.

[0562] 2. The server performs authentication, and if successful, an authentication success message is sent to the terminal.

[0563] 3. The device displays a greeting message such as "Hello, what would you like to talk about today?"

[0564] Example 2: Travel topics

[0565] 1. User types, "I want to talk about travel."

[0566] 2. The server passes the request to a dialogue generation engine, which generates a message related to the topic, such as, "Where have you traveled recently and where would you like to go?"

[0567] 3. The device displays it to the user, enabling an enjoyable conversation.

[0568] Example 3: Providing humor and sentiment analysis

[0569] 1. The user requests, "Tell me an interesting story."

[0570] 2. The server sends the request to the dialogue generation engine.

[0571] 3. The dialogue generation engine generates humorous stories such as "One day, an elephant walked into a restaurant..."

[0572] 4. The emotion engine analyzes the user's reaction and provides the results to the dialogue generation engine.

[0573] 5. The device displays the generated message to the user, and the subsequent dialogue is adjusted based on the emotion.

[0574] Prompt Sentence Examples

[0575] "I want to talk about travel."

[0576] "Tell me an interesting story."

[0577] In this way, the present invention provides an effective dialogue system for enriching the lives of elderly people and reducing their sense of loneliness.

[0578] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0579] Step 1:

[0580] A user accesses the system and enters their ID and password on the login screen.

[0581] Input: User ID, Password

[0582] Specific actions: Access the login screen using a smartphone or computer and enter your ID and password in the input fields.

[0583] Output: Login information is sent to the terminal.

[0584] Step 2:

[0585] The device sends the login information to the server.

[0586] Input: Login information (user ID, password)

[0587] Specific operation: When you click the login button, the device sends your ID and password to the server as an HTTP POST request.

[0588] Output: Login information is sent to the server.

[0589] Step 3:

[0590] The server checks the login information and authenticates the user. If authentication is successful, it sends a message of authentication success and the user's profile information to the device.

[0591] Input: Login information sent to the server

[0592] Specific operation: Compares the input information with the user information stored in the database to see if they match. If they match, sends the user's profile information in JSON format to the terminal along with an authentication success message.

[0593] Output: Authentication success message and profile information

[0594] Step 4:

[0595] The terminal displays a dialogue start screen and displays a greeting message from the dialogue generation engine to the user, such as "Hello, what would you like to talk about today?"

[0596] Input: Authentication success message received from the server and profile information

[0597] Specific operation: The terminal parses the received data and displays the dialogue start screen. It also displays a greeting message from the dialogue generation engine on the screen.

[0598] Output: Display of the opening screen and greeting message

[0599] Step 5:

[0600] The user clicks the Start Interaction button.

[0601] Input: User clicks

[0602] Specific operation: Click the "Start conversation" button that appears on the home screen after logging in.

[0603] Output: Initiating request

[0604] Step 6:

[0605] The terminal sends a dialogue initiation request to the server.

[0606] Input: Dialogue-initiating request

[0607] Specific operation: When the dialogue start button is clicked, the terminal sends dialogue start information to the server via an HTTP POST request.

[0608] Output: Request sent to server

[0609] Step 7:

[0610] The server starts the dialogue generation engine and generates the initial greeting message.

[0611] Input: Dialogue-initiating request

[0612] Specific operation: Start the dialogue generation engine and generate the initial message "Hello, what would you like to talk about today?"

[0613] Output: Initial greeting message

[0614] Step 8:

[0615] The server sends the generated greeting message to the terminal, which displays it to the user.

[0616] Input: Initial greeting message

[0617] Specific operation: The server sends the generated greeting message in JSON format to the terminal, which parses it and displays it on the screen.

[0618] Output: Display greeting message

[0619] Step 9:

[0620] The user inputs a reply to the greeting message and sends it to the terminal.

[0621] Input: User's reply message

[0622] Specific actions: Enter a message in the text box on the screen and click the send button.

[0623] Output: User input message

[0624] Step 10:

[0625] The terminal sends the user's input message to the server.

[0626] Input: User input message

[0627] Specific behavior: The message entered in the text box is sent to the server via an HTTP POST request.

[0628] Output: Sending the user message to the server

[0629] Step 11:

[0630] The server passes the message from the user to the emotion engine, which analyzes the user's emotions.

[0631] Input: User input message

[0632] Specific operation: Sends a message to the emotion engine and obtains emotion information such as "positive" or "negative."

[0633] Output: Analysis results by the emotion engine

[0634] Step 12:

[0635] The emotion engine sends the analysis results to the server.

[0636] Input: Data analyzed by the emotion engine

[0637] Specific operation: The sentiment analysis results are returned to the server in JSON format.

[0638] Output: Sending the analysis results

[0639] Step 13:

[0640] The server passes the emotion engine's analysis results and the user's message to the dialogue generation engine, which then generates an appropriate reply.

[0641] Input: Analysis results of the emotion engine, user input message

[0642] Specific operation: The dialogue generation engine utilizes emotional information to generate messages that include empathy and encouragement.

[0643] Output: Appropriate reply message

[0644] Step 14:

[0645] The server sends the generated reply to the terminal, which displays it to the user.

[0646] Input: Appropriate reply message

[0647] Specific operation: Display a message from the dialogue generation engine on the screen.

[0648] Output: Display of reply message

[0649] Step 15:

[0650] The user types, "I want to talk about travel."

[0651] Input: User request message

[0652] Specific action: Enter a specific topic such as "travel" in the topic input field and click the send button.

[0653] Output: Topic request message

[0654] Step 16:

[0655] The device sends a request to the server.

[0656] Input: User's topic request message

[0657] Specific behavior: Sends topic information to the server using an HTTP POST request.

[0658] Output: Request sent to server

[0659] Step 17:

[0660] The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[0661] Input: Topic request message

[0662] Specific operation: Notify the dialogue generation engine of the topic and generate related conversation messages.

[0663] Output: Messages related to the topic

[0664] Step 18:

[0665] The server sends the generated topic-related messages to the terminal, which displays them to the user.

[0666] Input: Topic-related messages

[0667] Specific operation: The relevant message is sent in JSON format to the device, which parses it and displays it on the screen.

[0668] Output: Show messages related to the topic

[0669] Step 19:

[0670] The user requests, "Tell me an interesting story."

[0671] Input: User request message

[0672] Specific action: Type "Tell me a funny story" in the text box and click the send button.

[0673] Output: Humor request message

[0674] Step 20:

[0675] The device sends a request to the server.

[0676] Input: Humor request message

[0677] Specific operation: Sends a request to the server as an HTTP POST request.

[0678] Output: Request sent to server

[0679] Step 21:

[0680] The server passes the request to a dialogue generation engine, which generates messages containing story and humorous elements.

[0681] Input: Humor request message

[0682] Specific operation: Notifies the dialogue generation engine and generates a message containing humorous elements.

[0683] Output: Humorous message

[0684] Step 22:

[0685] The server passes the generated humor message to an emotion engine for analyzing the user's reaction.

[0686] Input: Humorous message

[0687] Specific operation: The humorous message and the user's response are sent to the emotion engine for sentiment analysis.

[0688] Output: Analysis results

[0689] Step 23:

[0690] The analysis results obtained by the emotion engine are notified to the server, which then transmits them to the terminal.

[0691] Input: Analysis results

[0692] Specific operation: The emotion engine returns the results in JSON format to the dialogue generation engine and server, and generates a new message based on them.

[0693] Output: Next message

[0694] Step 24:

[0695] The terminal displays the generated story message to the user.

[0696] Input: Story message

[0697] Specific operation: A story message is displayed on the screen and updated according to the user's response.

[0698] Output: Display story message

[0699] Step 25:

[0700] The user clicks the "End conversation" button to end the conversation.

[0701] Input: User clicks

[0702] Specific actions: Click the "End conversation" button displayed on the screen.

[0703] Output: End of conversation request

[0704] Step 26:

[0705] The terminal notifies the server of the request.

[0706] Input: Dialogue termination request

[0707] Specific operation: Sends a request to end the conversation to the server using an HTTP POST request.

[0708] Output: Sends a request to the server to terminate the conversation

[0709] Step 27:

[0710] The server terminates the session with the dialogue generation engine and emotion engine, and sends a session termination message to the terminal.

[0711] Input: Dialogue termination request

[0712] Specific operation: Clears session data and sends a termination message in JSON format to the terminal.

[0713] Output: Session termination message

[0714] Step 28:

[0715] The terminal displays a session termination message to the user.

[0716] Input: Session termination message

[0717] Specific operation: A termination message is displayed on the screen to notify the user that the conversation has ended.

[0718] Output: Display of the completion message

[0719] (Application example 2)

[0720] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0721] There is a need to reduce feelings of loneliness and mental stress among elderly people and workers in workplaces such as factories. In particular, interactive support systems are necessary to improve work efficiency while maintaining overall well-being in the workplace. However, conventional dialogue systems lack the ability to recognize emotions and adjust dialogue content accordingly, resulting in an inconsistent dialogue experience.

[0722] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen for the authenticated user, means for receiving a dialogue start request from the user and starting the dialogue generation engine, means for displaying an initial greeting message generated by the dialogue generation engine to the user, means for receiving a message from the user and for the dialogue generation engine to generate an appropriate reply based on the message, means for displaying the generated reply to the user, means for recognizing the user's voice and analyzing emotions, means for adjusting the output of the dialogue generation engine based on the recognized emotion, and means for displaying a dialogue and outputting audio to the user via the smart glasses. This provides an appropriate dialogue experience according to the user's emotional state, making it possible to reduce feelings of loneliness and mental stress.

[0723] "User" refers to an individual who interacts with the system.

[0724] "Login information" refers to the information (such as ID and password) that a user enters when accessing the system.

[0725] "Authentication" refers to the process of verifying a user's identity based on the login information entered and granting them access to a system.

[0726] "Dialogue generation engine" refers to algorithms and software that generate appropriate dialogue based on input from a user.

[0727] An "emotion recognition engine" refers to algorithms and software that recognize and analyze emotions from a user's voice and facial expressions.

[0728] The "interaction start screen" refers to a screen that guides the user through the preparation state for starting an interaction after the user logs in to the system.

[0729] A "dialogue initiation request" refers to a request by a user to inform the system that he or she wishes to start a dialogue.

[0730] The "initial greeting message" refers to the first message generated by the dialogue generation engine at the start of a dialogue.

[0731] "User message" refers to a message containing the content of a dialogue that a user inputs into the system.

[0732] An "appropriate reply" refers to a response generated by the dialogue generation engine based on a user message.

[0733] "Smart glasses" refers to a wearable device equipped with a display, camera, and microphone that displays information and outputs audio.

[0734] "Speech recognition" refers to the process of converting a user's speech into text.

[0735] "Sentiment analysis" refers to the process of identifying a user's emotional state from their voice and facial expressions.

[0736] The system that realizes this application example is designed to provide interactive support to elderly people and factory workers. Below, we will explain how this system works, including the hardware and software used, their roles, and the data processing procedures.

[0737] System configuration

[0738] The system mainly consists of the following components:

[0739] Server: Manages the dialogue generation engine, emotion recognition engine, and database.

[0740] Terminal: Smart glasses for direct user manipulation and interaction.

[0741] User: An elderly person or a factory worker who interacts.

[0742] Hardware and software used

[0743] Smart glasses: Equipped with a camera, microphone, and display, they display dialogue content and allow voice input.

[0744] OpenAI GPT-3: Used as a dialogue generation engine, it generates appropriate dialogue based on user input.

[0745] Facial Recognition Library: Used to analyze user emotions from images captured by the camera.

[0746] Speech Recognition Library: Used to convert the user's speech into text.

[0747] Data processing and calculation

[0748] 1. Speech Recognition: The device (smart glasses) captures the user's speech and converts it into text using the Speech Recognition Library.

[0749] 2. Emotion Recognition: Analyze the user's facial image captured by the camera using the Facial Recognition Library to identify their emotions.

[0750] 3. Dialogue generation: The acquired voice data (converted to text) and emotion data are input into a dialogue generation engine (OpenAI GPT-3) to generate an appropriate dialogue.

[0751] 4. Display and output: The generated dialogue is displayed on the smart glasses display and output as voice if necessary.

[0752] Specific examples

[0753] For example, if a factory worker is feeling stressed after working all day, the system will work as follows:

[0754] 1. Voice Input and Emotion Recognition:

[0755] A worker talks to his smart glasses and says, "I'm tired today."

[0756] The glasses' camera captures the worker's face, and an emotion recognition engine verifies that they are "tired."

[0757] 2. Dialogue generation and output:

[0758] Send the following prompt to the OpenAI GPT-3 generative AI model:

[0759] User said: "I'm tired today.", User emotion: "I'm tired"

[0760] Generate a suitable response.

[0761] The dialogue generation engine generates an appropriate response: "You seem tired today. Would you like to take a break and refresh yourself?"

[0762] This message will be displayed on the smart glasses' display and spoken aloud.

[0763] As described above, this system provides a dialogue experience that is tailored to the user's emotional state, and can reduce mental stress and feelings of loneliness.

[0764] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0765] Program processing steps

[0766] Step 1:

[0767] The device captures the user's voice. The microphone in the smart glasses picks up what the user is saying and collects it as voice data. The voice data is input into the Speech Recognition Library and converted into text data. This conversion process puts the voice content into a format that can be understood.

[0768] Input: User's voice data

[0769] Data processing: converting voice to text

[0770] Output: Text data (e.g. "I'm tired today")

[0771] Step 2:

[0772] The device captures the user's face and analyzes their emotions. The camera in the smart glasses takes a picture of the user's face and inputs the image data into the Facial Recognition Library. The library analyzes facial expressions from the image data and identifies the user's emotional state. This step generates emotion data.

[0773] Input: User's face image data

[0774] Data Computing: Emotion Recognition through Facial Expression Analysis

[0775] Output: Emotion data (e.g. "Tired")

[0776] Step 3:

[0777] The server sends a prompt to the dialogue generation engine. The device sends the collected text and emotion data to the server. The server uses this data to generate a prompt for the generative AI model (OpenAI GPT-3) and requests an appropriate dialogue.

[0778] Input: Text data, emotion data

[0779] Data processing: Prompt generation and sending

[0780] Output: Prompt sentence (e.g., "User said: 'I'm tired today.', User emotion: 'I'm tired.' Generate a suitable response.")

[0781] Step 4:

[0782] The server receives the response from the dialogue generation engine. The generative AI model generates an appropriate dialogue response based on the prompt sentence and sends it back to the server. The server receives this response data and proceeds to the next step.

[0783] Input: prompt statement

[0784] Data Computation: Generating Interactive Responses

[0785] Output: Dialogue response data (e.g., "You seem tired today. Would you like to take a short break to refresh yourself?")

[0786] Step 5:

[0787] The server sends the response to the terminal. The generated dialogue response data is sent to the smart glasses, which prepares for display and audio output. The terminal displays the received data on the display.

[0788] Input: Dialogue response data

[0789] Data processing: Preparing response data for display

[0790] Output: Dialogue displayed on the smart glasses (e.g., "You seem tired today. Would you like to take a short break to refresh yourself?")

[0791] Step 6:

[0792] The device displays and outputs the dialogue response to the user. The response message is displayed on the smart glasses' display and output as audio through the built-in speaker, allowing the user to receive visual and auditory feedback.

[0793] Input: Dialogue response data

[0794] Data calculation: Display and voice output of response messages

[0795] Output: Feedback to the user (visual and auditory)

[0796] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0797] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0798] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0799] [Second embodiment]

[0800] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0801] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0802] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0803] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0804] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0805] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0806] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0807] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0808] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0809] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0810] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0811] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0812] The present invention aims to alleviate the sense of loneliness felt by elderly people and provide them with a fulfilling dialogue experience. This system utilizes a dialogue generation engine to generate dialogue based on user input and to facilitate natural communication. Specific embodiments for implementing the present invention will be described below.

[0813] System configuration

[0814] The system mainly consists of the following elements:

[0815] 1. Server: Mainly responsible for user authentication, managing the dialogue generation engine, and storing dialogue data.

[0816] 2. Terminal: A device (e.g., smartphone, tablet, or PC) that is directly operated by the user and provides the user interface.

[0817] 3. User: An individual who interacts with the system, primarily targeted at elderly people.

[0818] 4. Dialogue generation engine: Consists of algorithms and software that generate appropriate dialogue in response to user input.

[0819] Program processing

[0820] The program does the following:

[0821] 1. User Registration and Login:

[0822] The user accesses the system login screen and enters their ID and password.

[0823] The terminal sends the entered login information to the server.

[0824] The server checks the login information and authenticates the user. If successful, it sends an authentication success message to the terminal.

[0825] 2. Start a conversation:

[0826] The user clicks the Start Interaction button.

[0827] The terminal sends this request to the server.

[0828] The server starts the dialogue generation engine and generates an initial greeting message.

[0829] The server sends the generated greeting message to the terminal, which displays it to the user.

[0830] 3. Continuing the dialogue:

[0831] When the user replies to the AI's message, the device sends the message to the server.

[0832] The server passes the received message to the dialogue generation engine, which generates an appropriate reply.

[0833] The server sends the generated reply to the terminal, which displays it to the user.

[0834] 4. Conversations about topics that interest you:

[0835] A user requests to talk about a specific topic (e.g., "I want to talk about travel").

[0836] The device sends the request to the server.

[0837] The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[0838] The server sends the generated message to the terminal, which displays it to the user.

[0839] 5. Providing stories and humor:

[0840] The user requests, "Tell me an interesting story."

[0841] The device sends the request to the server.

[0842] The server causes the dialogue generation engine to generate messages containing story and humorous elements.

[0843] The server sends the generated message to the terminal, which displays it to the user.

[0844] 6. Ending the conversation:

[0845] If the user wishes to end the conversation, he or she clicks the "End conversation" button.

[0846] The terminal notifies the server of the request.

[0847] The server terminates the session with the dialogue generation engine and sends a session termination message to the terminal.

[0848] The terminal displays a session termination message to the user.

[0849] Specific examples

[0850] Example 1: Logging in and starting a conversation

[0851] 1. The user enters their ID and password on the login screen.

[0852] 2. The server checks the input information and performs authentication.

[0853] 3. If authentication is successful, the terminal displays a greeting message from the dialogue generation engine to the user: "Hello, what would you like to talk about today?"

[0854] Example 2: Travel topics

[0855] 1. User types, "I want to talk about travel."

[0856] 2. The server passes the request to the dialogue generation engine.

[0857] 3. The dialogue generation engine generates a message related to the topic, such as "Where have you traveled recently and where would you like to go?", and the server sends the message to the device.

[0858] 4. The device displays the message to the user, and the user enjoys talking about their travel memories and plans.

[0859] Example 3: Providing humor

[0860] 1. The user requests, "Tell me an interesting story."

[0861] 2. The server sends the request to the dialogue generation engine.

[0862] 3. The dialogue generation engine generates a humorous story such as "One day, an elephant came into the restaurant..." and the server sends the message to the device.

[0863] 4. The device displays a fun story to the user, making them laugh and feel happy.

[0864] As described above, the present invention provides a specific system configuration and processing method for reducing the sense of loneliness felt by elderly people and providing them with a rich conversation experience.

[0865] The processing flow will be explained below.

[0866] Step 1:

[0867] A user accesses the system and enters their ID and password on the login screen.

[0868] Step 2:

[0869] The terminal sends the entered login information to the server.

[0870] Step 3:

[0871] The server receives the login information and authenticates the user against a database.

[0872] Step 4:

[0873] The server sends the authentication result to the terminal. If authentication is successful, it sends a success message and profile information. If authentication is unsuccessful, it sends an error message.

[0874] Step 5:

[0875] The terminal receives a message that authentication was successful and displays the start screen of the dialogue to the user. If authentication failed, an error message is displayed to the user.

[0876] Step 6:

[0877] The user clicks the Start Interaction button.

[0878] Step 7:

[0879] The terminal sends a dialogue initiation request to the server.

[0880] Step 8:

[0881] The server starts the dialogue generation engine and generates the initial greeting message.

[0882] Step 9:

[0883] The server sends the generated greeting message to the terminal.

[0884] Step 10:

[0885] The terminal displays a greeting message to the user.

[0886] Step 11:

[0887] The user types a reply to the greeting message.

[0888] Step 12:

[0889] The terminal sends the user's input to the server.

[0890] Step 13:

[0891] The server passes messages from the user to a dialogue generation engine, which generates appropriate replies.

[0892] Step 14:

[0893] The server sends the generated reply to the terminal.

[0894] Step 15:

[0895] The terminal displays the reply to the user.

[0896] Step 16:

[0897] A user submits a request to talk about a specific topic (e.g., "I want to talk about travel").

[0898] Step 17:

[0899] The device sends a topic request to the server.

[0900] Step 18:

[0901] The server passes the topic request to a dialogue generation engine, which generates information and questions related to the topic.

[0902] Step 19:

[0903] The server sends the generated topic-related message to the terminal.

[0904] Step 20:

[0905] The terminal displays topic-related messages to the user.

[0906] Step 21:

[0907] The user requests humorous or entertaining stories, such as "tell me a funny story."

[0908] Step 22:

[0909] The terminal sends this request to the server.

[0910] Step 23:

[0911] The server passes the request to a dialogue generation engine, which generates a message containing humorous elements.

[0912] Step 24:

[0913] The server sends the generated humor message to the terminal.

[0914] Step 25:

[0915] The terminal displays the humorous message to the user.

[0916] Step 26:

[0917] If the user wishes to end the conversation, he or she clicks the "End conversation" button.

[0918] Step 27:

[0919] The terminal notifies the server of a request to terminate the conversation.

[0920] Step 28:

[0921] The server terminates the session with the dialogue generation engine and sends a session termination message to the terminal.

[0922] Step 29:

[0923] The terminal displays a session termination message to the user.

[0924] Example 1

[0925] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0926] Elderly people are prone to feelings of social isolation and loneliness, which can have a negative impact on their mental health. Elderly people who live alone, in particular, tend to lack opportunities for daily communication. Therefore, it is necessary to resolve these issues and help elderly people reduce their loneliness through fulfilling conversational experiences, thereby improving the quality of their daily lives.

[0927] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0928] In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen for the authenticated user, means for receiving a dialogue start request from the user and starting a dialogue generation engine, means for displaying an initial greeting message generated by the dialogue generation engine to the user, means for receiving a message from the user and generating an appropriate reply based on the message by the dialogue generation engine, means for displaying the generated reply to the user, means for inputting a prompt sentence on a specific topic to the dialogue generation engine and generating information or questions related to the topic, and means for inputting a prompt sentence of a humorous or fun story to the dialogue generation engine in response to a request from the user and generating a message containing an element of humor. This allows elderly people to reduce their sense of loneliness through everyday dialogue experiences and makes it easier to maintain their mental health.

[0929] "Login information" refers to authentication information such as ID and password that a user enters when accessing a system.

[0930] "Authentication" is the process by which a system verifies a user's login information and determines whether the user is legitimate.

[0931] The "interaction start screen" is a screen that provides an interface for the user to start an interaction.

[0932] A "dialogue start request" is an operation or input information that a user performs to notify the system that he or she wishes to start a dialogue.

[0933] A "dialogue generation engine" is a collection of algorithms and software that generates natural dialogue based on user input.

[0934] The "initial greeting message" is a greeting message generated by the dialogue generation engine for the first time user.

[0935] A "message" is a conversation that a user inputs into the system and a conversation that is sent from the system to the user.

[0936] An "appropriate reply" is a response that the dialogue generation engine generates based on the user's message.

[0937] A "generated reply" is a response to a user's message that is generated by the dialogue generation engine.

[0938] A "specific topic" is a specific topic or theme that a user wishes to discuss with the system.

[0939] A "prompt sentence" is text that is input to a dialogue generation engine and contains instructions or guidance to generate something.

[0940] "Information and questions" are data and questions generated by the dialogue generation engine related to a specific topic.

[0941] "Humor elements" are elements of humor or humor contained in messages generated by the dialogue generation engine.

[0942] A "fun story" is an interesting and entertaining story that the dialogue generation engine generates in response to a user request.

[0943] The present invention is a system for reducing the sense of loneliness felt by elderly people and providing them with a fulfilling dialogue experience. This system includes a server that performs user authentication, manages a dialogue generation engine, and stores dialogue data, a terminal that is directly operated by the user, and a dialogue generation engine that generates dialogue based on input from the user. Specific embodiments for implementing this system are described below.

[0944] Components

[0945] 1. Server:

[0946] It performs user authentication and manages the dialogue in cooperation with the dialogue generation engine.

[0947] The software used includes database management systems (MySQL and PostgreSQL) and generative AI models (e.g., GPT-3).

[0948] 2. Terminal:

[0949] A device (smartphone, tablet, PC) that allows users to interact directly.

[0950] It provides a user interface, sends user input to the server, and displays replies from the server to the user.

[0951] 3. Dialogue generation engine:

[0952] Use a generative AI model (e.g., GPT-3) to generate natural-looking dialogue based on user input.

[0953] Operational Overview

[0954] The system works as follows:

[0955] User Registration and Login

[0956] 1. The user enters their ID and password on the login screen.

[0957] 2. The device sends this information to the server, which then authenticates the user.

[0958] 3. If the authentication is successful, the server sends an authentication success message to the terminal, and the terminal displays "Login successful" to the user.

[0959] Start a dialogue

[0960] 1. The user clicks the "Start conversation" button.

[0961] 2. The device sends this request to the server.

[0962] 3. The server starts the dialogue generation engine and generates the initial greeting message.

[0963] 4. The server sends the generated greeting message to the terminal, which displays it to the user.

[0964] Continuing the dialogue

[0965] 1. When the user replies to the AI's message, the device sends the message to the server.

[0966] 2. The server passes this message to the dialogue generation engine, which generates an appropriate reply.

[0967] 3. The server generates a reply and sends it to the device, which displays it to the user.

[0968] Conversations about topics that interest you

[0969] 1. A user requests to "talk about travel."

[0970] 2. The device sends the request to the server.

[0971] 3. The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[0972] 4. The server sends the generated message to the terminal, which displays it to the user.

[0973] Providing stories and humor

[0974] 1. The user requests, "Tell me an interesting story."

[0975] 2. The device sends the request to the server.

[0976] 3. The server instructs the dialogue generation engine to generate messages that include story and humorous elements.

[0977] 4. The server sends the generated message to the terminal, which displays it to the user.

[0978] Examples of prompt statements

[0979] The following is an example of a prompt that may be entered into the system:

[0980] 1. Login prompt:

[0981] Please enter your user ID and password.

[0982] 2. Prompt at the beginning of the dialogue:

[0983] Start a dialogue: What do you want to talk about?

[0984] 3. Travel topic request prompt:

[0985] I want to talk about travel.

[0986] 4. Humor requests prompt:

[0987] Please tell me an interesting story.

[0988] Through the above-mentioned components and operations, the system is designed to enable elderly people to enjoy everyday interactive experiences and reduce feelings of loneliness.

[0989] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0990] Program processing steps

[0991] Step 1: User Registration and Login

[0992] 1. The user enters their ID and password on the login screen.

[0993] Input: The user enters their ID and password into the login form.

[0994] Output: Login information is sent to the terminal.

[0995] 2. The device sends the entered login information to the server.

[0996] Input: The login information entered by the user.

[0997] Output: The input information is encrypted and sent to the server.

[0998] 3. The server verifies the login information and authenticates the user.

[0999] Input: The login information received by the server.

[1000] Processing: Authenticate the user by checking against the user information in the database.

[1001] Output: Generates a message indicating authentication success or failure.

[1002] 4. The server sends an authentication success message to the terminal.

[1003] Input: Authentication success message.

[1004] Output: A successful authentication message is sent to the terminal.

[1005] 5. The terminal receives the authentication success message and displays a "Login successful" notification to the user.

[1006] Input: Authentication success message.

[1007] Output: A successful login notification is displayed to the user.

[1008] Step 2: Start a conversation

[1009] 1. The user clicks the "Start conversation" button.

[1010] Input: User action (clicking a button).

[1011] Output: A conversation initiation request is generated on the terminal.

[1012] 2. The device sends this request to the server.

[1013] Input: A conversation-initiating request.

[1014] Output: The request is sent to the server.

[1015] 3. The server starts the dialogue generation engine and generates the initial greeting message.

[1016] Input: A conversation-initiating request.

[1017] Processing: The dialogue generation engine generates an initial greeting message based on the prompt sentence.

[1018] Output: Initial greeting message.

[1019] 4. The server sends the generated greeting message to the terminal.

[1020] Input: Initial greeting message.

[1021] Output: A greeting message is sent to the terminal.

[1022] 5. The terminal displays a greeting message to the user.

[1023] Input: A greeting message.

[1024] Output: A greeting message is displayed to the user.

[1025] Step 3: Continue the conversation

[1026] 1. When the user replies to the AI's message, the device sends the message to the server.

[1027] Input: The user's reply message.

[1028] Output: A reply message is sent from the device to the server.

[1029] 2. The server passes the received message to the dialogue generation engine.

[1030] Input: The user's reply message.

[1031] Output: The message is passed to the dialogue generation engine.

[1032] 3. The dialogue generation engine generates an appropriate reply.

[1033] Input: The user's reply message.

[1034] Processing: The dialogue generation engine generates an appropriate reply.

[1035] Output: The generated reply message.

[1036] 4. The server generates a reply and sends it to the terminal, which displays it to the user.

[1037] Input: The generated reply message.

[1038] Output: The reply message is sent to the terminal and displayed to the user.

[1039] Step 4: Talk about topics that interest you

[1040] 1. A user requests to "talk about travel."

[1041] Input: User's request on the topic.

[1042] Output: The request is sent to the device.

[1043] 2. The device sends the request to the server.

[1044] Input: The user request.

[1045] Output: The request is sent to the server.

[1046] 3. The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[1047] Input: The user request.

[1048] Processing: The dialogue generation engine generates information and questions related to the topic.

[1049] Output: The information or question generated.

[1050] 4. The server sends the generated message to the terminal, which displays it to the user.

[1051] Input: Generated information or question.

[1052] Output: Messages are sent to the terminal and displayed to the user.

[1053] Step 5: Provide a story and humor

[1054] 1. The user requests, "Tell me an interesting story."

[1055] Input: The user request.

[1056] Output: The request is sent to the device.

[1057] 2. The device sends the request to the server.

[1058] Input: The user request.

[1059] Output: The request is sent to the server.

[1060] 3. The server instructs the dialogue generation engine to generate messages that include story and humorous elements.

[1061] Input: The user request.

[1062] Processing: The dialogue generation engine generates messages that include story and humorous elements.

[1063] Output: The generated story message.

[1064] 4. The server sends the generated message to the terminal, which displays it to the user.

[1065] Input: The generated story message.

[1066] Output: Messages are sent to the terminal and displayed to the user.

[1067] Step 6: Ending the conversation

[1068] 1. If the user wants to end the conversation, he clicks the "End conversation" button.

[1069] Input: User action (clicking a button).

[1070] Output: A termination request is generated on the terminal.

[1071] 2. The device notifies the server of the request.

[1072] Input: The conversation termination request.

[1073] Output: The request is sent to the server.

[1074] 3. The server ends the session with the dialogue generation engine.

[1075] Input: The conversation termination request.

[1076] Action: Ends the session with the dialogue generation engine.

[1077] Output: Session termination message.

[1078] 4. The server sends a session termination message to the terminal, which displays it to the user.

[1079] Input: Session termination message.

[1080] Output: Messages are sent to the terminal and displayed to the user.

[1081] (Application example 1)

[1082] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1083] In order to reduce the sense of loneliness felt by the elderly and to help them live their daily lives more safely and comfortably, a wide range of support is required, including not only simple dialogue but also assistance in emergencies and the management of daily tasks. However, conventional dialogue systems lack the functionality to comprehensively address these diverse needs. Therefore, there is a need for a system that not only alleviates the sense of loneliness for the elderly but also provides integrated support for assistance in emergencies and the management of daily tasks.

[1084] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1085] In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen to the authenticated user, means for receiving a dialogue start request from the user and activating a dialogue generation engine, means for displaying an initial greeting message generated by the dialogue generation engine to the user, means for receiving a message from the user and for the dialogue generation engine to generate an appropriate reply based on the message, means for displaying the generated reply to the user, means for the user to send a request for assistance in an emergency and make an emergency call, means for the user to send a request to set a reminder for a specific task and set the reminder, and means for conducting daily health checks and recording the results. This makes it possible to reduce the elderly's sense of loneliness while providing centralized support for emergency assistance and managing daily tasks.

[1086] 1. "Elderly" generally refers to the population aged 65 and over who require special care and support due to physical and mental changes that occur with aging.

[1087] 2. "Loneliness" refers to the loneliness and anxiety that arise from being alone due to a weakening of social connections with others.

[1088] 3. "Dialogue generation engine" refers to a system consisting of algorithms and software for conducting natural conversations based on user input.

[1089] 4. "System" refers to a technical configuration in which multiple means or elements work together to achieve a specific purpose.

[1090] 5. "User" means an individual who uses the System and enjoys its interaction and other features.

[1091] 6. "Login Information" means the authentication information required for a user to access the system, and usually consists of an ID and password.

[1092] 7. "Authentication" means the process of verifying that the login information provided belongs to the registered user.

[1093] 8. "Screen" refers to the interface displayed on a terminal, enabling interaction and operation between the user and the system.

[1094] 9. "Message" means text data exchanged during a conversation.

[1095] 10. A "request" is an action taken by a user to request a specific action or information from a system.

[1096] 11. "Emergency Call" refers to a means of communication to request assistance in an emergency.

[1097] 12. "Reminder" is a function that notifies users of tasks or events that they have set.

[1098] 13. "Health Check" is the process of checking the user's daily health status and recording the results.

[1099] 14. "Multi-faceted support" refers to a wide range of assistance to address different types of needs and requirements.

[1100] The present invention is a system that reduces feelings of loneliness among elderly people and provides integrated support for emergency assistance and daily task management. This system uses a dialogue generation engine to provide natural dialogue with the user, and also combines emergency call functions, reminder setting, and health check functions. Specific embodiments for implementing the present invention are described below.

[1101] System configuration

[1102] The system mainly consists of the following elements:

[1103] 1. Server: Responsible for user authentication, managing the dialogue generation engine, and storing dialogue data.

[1104] 2. Terminal: A device (e.g., smartphone, tablet, or PC) that is directly operated by the user and provides the user interface.

[1105] 3. User: An individual who interacts with the system, primarily targeted at elderly people.

[1106] 4. Dialogue generation engine: Consists of algorithms and software that generate appropriate dialogue in response to user input.

[1107] Detailed System Operation

[1108] 1. User Registration and Login

[1109] The user accesses the system's login screen and enters their ID and password. The terminal sends the entered login information to the server, which then verifies and authenticates the login information. If authentication is successful, an authentication success message is sent to the terminal.

[1110] 2. Start a dialogue

[1111] When the user clicks the dialogue start button, the terminal sends this request to the server. The server starts the dialogue generation engine and generates the initial greeting message. This message is sent to the terminal and displayed to the user.

[1112] 3. Continuing the dialogue

[1113] When a user replies to a message from the AI, the device sends the message to the server, which passes the message to the dialogue generation engine, which generates an appropriate reply. The reply is then sent to the device and displayed to the user.

[1114] 4. Emergency call function

[1115] When a user needs assistance in an emergency, they send an emergency call request, which the device sends to the server, which then makes the emergency call.

[1116] 5. Reminder Settings

[1117] A user can send a request to set a reminder for a particular task, and the device will send the request to the server, which will set the reminder.

[1118] 6. Health Check

[1119] The user is asked questions to check their health condition every day. The user's answers are sent from the device to the server, and the results are recorded.

[1120] Technology used

[1121] Hardware: Using a smartphone or robot as the primary device.

[1122] Software: Dialogue generation is performed using OpenAI's GPT-3 model. Server-side programs are often implemented in Python.

[1123] Specific examples

[1124] Examples of everyday conversations:

[1125] User: "What's the weather like these days?"

[1126] System response: "I want to talk about the weather."

[1127] Example of a story:

[1128] User: "Tell me a funny story."

[1129] System response: "Tell us a funny story."

[1130] This system will enable elderly people to reduce their sense of loneliness while providing centralized support for emergency assistance and managing daily tasks.

[1131] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1132] Step 1:

[1133] The user accesses the system's login screen and enters their ID and password. The entered login information is sent by the terminal to the server. The server receives the user's login information (ID and password) and performs authentication by checking it against a database. If authentication is successful, the server generates an authentication success message and sends it to the terminal. The terminal displays the received authentication success message to the user.

[1134] Step 2:

[1135] The user clicks the dialogue start button. The terminal sends this request to the server. The server starts the dialogue generation engine and generates the first greeting message. The generated greeting message is sent to the terminal, which displays it to the user. Based on the user's input (dialogue start instruction), the system starts the dialogue process.

[1136] Step 3:

[1137] When the user replies to the AI's message, the device sends the message to the server. The server passes the received message to the dialogue generation engine, which generates an appropriate reply. The generated reply message is sent from the server to the device, which displays it to the user.

[1138] Step 4:

[1139] When a user needs assistance in an emergency, they input an emergency call request. The device sends the request to the server. The server receives the emergency call request and notifies the pre-configured emergency contacts. The server generates a call completion message and sends it to the device. The device displays this message to the user.

[1140] Step 5:

[1141] The user sends a request to set a reminder for a specific task. The device sends this request to the server. The server receives the request and sets the reminder for the specified date and time. A message indicating the completion of the setting is sent from the server to the device and displayed to the user.

[1142] Step 6:

[1143] Questions for daily health checks are sent from the server to the terminal. The terminal displays the questions to the user, who answers them. The terminal sends the answers to the server, which records the answers in a database. The server generates a recording completion message and sends it to the terminal. The terminal displays this message to the user.

[1144] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1145] The present invention provides a system that combines a dialogue generation engine with an emotion engine that recognizes the user's emotions in order to reduce the sense of loneliness felt by elderly people and provide a fulfilling dialogue experience. Specific embodiments for carrying out the present invention will be described below.

[1146] System configuration

[1147] The system mainly consists of the following elements:

[1148] 1. Server: Responsible for user authentication, managing the dialogue generation engine and emotion engine, and storing dialogue data.

[1149] 2. Terminal: A device (e.g., smartphone, tablet, or PC) that is directly operated by the user and provides the user interface.

[1150] 3. Users: Individuals who interact with the system, primarily elderly people, are the main target.

[1151] 4. Dialogue generation engine: Consists of algorithms and software that generate appropriate dialogue based on user input.

[1152] 5. Emotion Engine: Consists of algorithms and software for recognizing emotions from user input and responses and adjusting the output of the dialogue generation engine based on those emotions.

[1153] Program processing

[1154] The program does the following:

[1155] 1. User Registration and Login:

[1156] A user accesses the system and enters their ID and password on the login screen.

[1157] The device sends the login information to the server.

[1158] The server checks the login information and authenticates the user. If authentication is successful, it sends a message of authentication success and the user's profile information to the terminal.

[1159] 2. Start a conversation:

[1160] The user clicks the Start Interaction button.

[1161] The terminal sends a dialogue initiation request to the server.

[1162] The server starts the dialogue generation engine and generates the initial greeting message.

[1163] The server sends the generated greeting message to the terminal, which displays it to the user.

[1164] 3. Continuing the dialogue:

[1165] The user types a reply to the greeting message.

[1166] The terminal sends the user's input message to the server.

[1167] The server passes the message from the user to the emotion engine, which analyzes the user's emotions.

[1168] The emotion engine sends the analysis results to the server.

[1169] The server passes the emotion engine's analysis results and the user's message to the dialogue generation engine, which then generates an appropriate reply.

[1170] The server sends the generated reply to the terminal, which displays it to the user.

[1171] 4. Conversations about topics that interest you:

[1172] A user requests to talk about a specific topic, such as "I want to talk about travel."

[1173] The device sends a request to the server.

[1174] The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[1175] The server sends the generated topic-related messages to the terminal, which displays them to the user.

[1176] 5. Providing stories and humor:

[1177] A user sends a request such as "Tell me a funny story."

[1178] The device sends a request to the server.

[1179] The server passes the request to a dialogue generation engine, which generates messages containing story and humorous elements.

[1180] The server sends the generated message to the terminal, which displays it to the user.

[1181] 6. Ending the conversation:

[1182] The user clicks the "End conversation" button to end the conversation.

[1183] The terminal notifies the server of the request.

[1184] The server terminates the session with the dialogue generation engine and emotion engine, and sends a session termination message to the terminal.

[1185] The terminal displays a session termination message to the user.

[1186] Specific examples

[1187] Example 1: Logging in and starting a conversation

[1188] 1. The user enters their ID and password on the login screen.

[1189] 2. The server checks the entered information and performs authentication. If authentication is successful, an authentication success message and profile information are sent to the device.

[1190] 3. The terminal displays the dialogue start screen and displays a greeting message from the dialogue generation engine to the user, such as "Hello, what would you like to talk about today?"

[1191] Example 2: Travel topics

[1192] 1. User types, "I want to talk about travel."

[1193] 2. The server passes the request to the dialogue generation engine.

[1194] 3. The dialogue generation engine generates a message related to the topic, such as "Where have you traveled recently and where would you like to go?" and sends it to the device via the server.

[1195] 4. The device displays the message to the user, and the user enjoys talking about their travel memories and plans.

[1196] Example 3: Providing humor and sentiment analysis

[1197] 1. The user requests, "Tell me an interesting story."

[1198] 2. The server sends the request to the dialogue generation engine.

[1199] 3. The dialogue generation engine generates a humorous story such as "One day, an elephant came into the restaurant..." and sends it to the device via the server.

[1200] 4. The server passes the humor message to the emotion engine, which analyzes the user's reaction.

[1201] 5. The emotion engine notifies the dialogue generation engine and the server of the analysis results, which are reflected in the next message.

[1202] 6. The user reads an entertaining story and the next dialogue is tailored based on their emotions.

[1203] As described above, the present invention specifically shows a system configuration and processing method for reducing the sense of loneliness felt by elderly people and providing them with a rich conversation experience.

[1204] The processing flow will be explained below.

[1205] Step 1:

[1206] A user accesses the system and enters their ID and password on the login screen.

[1207] Step 2:

[1208] The terminal sends the entered login information to the server.

[1209] Step 3:

[1210] The server receives the login information and authenticates the user against a database.

[1211] Step 4:

[1212] The server sends the authentication result to the terminal. If authentication is successful, it sends a success message and profile information. If authentication is unsuccessful, it sends an error message.

[1213] Step 5:

[1214] The terminal receives a message that authentication was successful and displays the start screen of the dialogue to the user. If authentication failed, an error message is displayed to the user.

[1215] Step 6:

[1216] The user clicks the Start Interaction button.

[1217] Step 7:

[1218] The terminal sends a dialogue initiation request to the server.

[1219] Step 8:

[1220] The server starts the dialogue generation engine and generates the initial greeting message.

[1221] Step 9:

[1222] The server sends the generated greeting message to the terminal.

[1223] Step 10:

[1224] The terminal displays a greeting message to the user.

[1225] Step 11:

[1226] The user types a reply to the greeting message.

[1227] Step 12:

[1228] The terminal sends the user's input to the server.

[1229] Step 13:

[1230] The server passes a message from the user to the emotion engine, which then recognizes the user's emotion.

[1231] Step 14:

[1232] The emotion engine transmits the recognized emotion information to the server.

[1233] Step 15:

[1234] The server passes the emotion information and the user's message to the dialogue generation engine, which then generates an appropriate reply.

[1235] Step 16:

[1236] The server sends the generated reply to the terminal.

[1237] Step 17:

[1238] The terminal displays the reply to the user.

[1239] Step 18:

[1240] A user submits a request to talk about a specific topic (e.g., they want to talk about travel).

[1241] Step 19:

[1242] The device sends a topic request to the server.

[1243] Step 20:

[1244] The server passes the topic request to a dialogue generation engine, which generates information and questions related to the topic.

[1245] Step 21:

[1246] The server sends the generated topic-related message to the terminal.

[1247] Step 22:

[1248] The terminal displays topic-related messages to the user.

[1249] Step 23:

[1250] The user requests humorous or entertaining stories, such as "tell me a funny story."

[1251] Step 24:

[1252] The terminal sends this request to the server.

[1253] Step 25:

[1254] The server passes the request to a dialogue generation engine, which generates a message containing humorous elements.

[1255] Step 26:

[1256] The server sends the generated humor message to the terminal.

[1257] Step 27:

[1258] The terminal displays the humorous message to the user.

[1259] Step 28:

[1260] The server passes the humor message to an emotion engine, which analyzes the user's reaction.

[1261] Step 29:

[1262] The emotion engine sends the analysis results to the server and the dialogue generation engine.

[1263] Step 30:

[1264] The dialogue generation engine adjusts the next reply based on the emotional information from the emotion engine.

[1265] Step 31:

[1266] The user clicks the "End conversation" button to end the conversation.

[1267] Step 32:

[1268] The terminal notifies the server of a request to terminate the conversation.

[1269] Step 33:

[1270] The server terminates the session with the dialogue generation engine and emotion engine, and sends a session termination message to the terminal.

[1271] Step 34:

[1272] The terminal displays a session termination message to the user.

[1273] Example 2

[1274] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1275] Elderly people often feel lonely in their daily lives, and this can be a serious problem, especially if they spend a lot of time alone. Current technology does not provide sufficient methods to alleviate this loneliness and provide a richer interactive experience. Therefore, new systems are needed to help seniors avoid feeling lonely.

[1276] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1277] In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen to the authenticated user, and means for displaying an initial greeting message generated by the dialogue generation engine to the user. This allows elderly people to use the system easily and provides a dialogue experience that begins naturally from the very beginning.

[1278] The server further includes means for receiving a message from the user and for the dialogue generation engine to generate an appropriate reply based on the message, means for analyzing the user's emotions using the emotion engine, and means for the dialogue generation engine to generate an appropriate response based on the analysis result of the emotion engine. This enables a highly personalized dialogue according to the user's emotions, thereby improving the effect of reducing loneliness among the elderly.

[1279] "User" refers to an individual who interacts with the system, and is primarily targeted at elderly people.

[1280] "Login information" refers to authentication information such as ID and password entered by a user when accessing the system.

[1281] "Authentication" refers to the process of verifying the login information entered by a user and granting access to a system.

[1282] The "interaction start screen" is the first screen that is displayed after a user has been authenticated by the system, and provides an interface for starting an interaction.

[1283] "Dialogue generation engine" refers to algorithms and software that automatically generate appropriate dialogue messages based on input from a user.

[1284] The "initial greeting message" refers to the first message generated by the dialogue generation engine and displayed to the user at the start of a dialogue.

[1285] "Emotion Engine" refers to algorithms and software for recognizing emotions from user input and responses and adjusting the output of the dialogue generation engine based on those emotions.

[1286] "Analysis results" refers to the emotional information that the emotion engine obtains from the user's input, and affects the output of the dialogue generation engine.

[1287] An "appropriate reply" refers to a response message generated by the dialogue generation engine based on the user's input and the analysis results of the emotion engine.

[1288] "System" refers to the entire dialogue system, including the above elements, designed to reduce loneliness among the elderly.

[1289] This invention is a dialogue system designed to alleviate loneliness, especially among the elderly, and provide a rich dialogue experience. The system mainly consists of a server, a terminal, a generative AI model (a dialogue generation engine and an emotion engine), and a user.

[1290] System configuration

[1291] The system includes the following elements:

[1292] 1. Server: Responsible for user authentication, managing the dialogue generation engine and emotion engine, and storing dialogue data.

[1293] 2. Terminal: A device (smartphone, tablet, PC) that is directly operated by the user and provides the user interface.

[1294] 3. Users: Individuals who interact with the system, primarily elderly people, are the main target.

[1295] 4. Dialogue Generation Engine: Algorithms and software that generate appropriate dialogue based on input from the user.

[1296] 5. Emotion Engine: Algorithms and software for recognizing emotions from user input and responses and adjusting the output of the dialogue generation engine based on those emotions.

[1297] Hardware and Software Used

[1298] Server: Uses major cloud service providers (e.g. AWS, Google Cloud).

[1299] Devices: Common iOS devices, Android devices, Windows PCs, and macOS PCs.

[1300] Dialogue generation engine: Natural language processing algorithms (e.g. GPT-3, GPT-4).

[1301] Sentiment engine: Sentiment analysis algorithms (e.g., IBM Watson Tone Analyzer, Microsoft Azure Emotion API).

[1302] Explanation of program processing

[1303] This system performs a series of processes from user login to starting a dialogue, continuing the conversation, analyzing emotions, conducting a conversation based on a theme, and providing humor.

[1304] 1. User Registration and Login:

[1305] A user accesses the system and enters their ID and password on the login screen.

[1306] The device sends this information to the server for authentication. If authentication is successful, the device displays the following screen and the user's profile information.

[1307] 2. Start a conversation:

[1308] The user clicks the Start Interaction button.

[1309] The terminal sends a dialogue start request to the server.

[1310] The server starts a dialogue generation engine, generates an initial greeting message, and sends it to the terminal.

[1311] The terminal displays a greeting message to the user.

[1312] 3. Continuing the dialogue:

[1313] The user enters a message and sends it to the terminal.

[1314] The device sends the message to the server, where the emotion engine analyzes the emotion.

[1315] The server passes the analysis results of the emotion engine to the dialogue generation engine, which generates an appropriate response.

[1316] The terminal displays the generated response message to the user.

[1317] 4. Conversations about topics that interest you:

[1318] A user enters a request such as "I want to talk about travel."

[1319] The terminal sends a request to the server, which passes it to the dialogue generation engine.

[1320] The dialogue generation engine generates relevant information and questions and sends them to the terminal via the server.

[1321] The terminal displays this message to the user.

[1322] 5. Providing stories and humor:

[1323] The user requests, "Tell me an interesting story."

[1324] The device sends the request to the server.

[1325] The server passes the request to a dialogue generation engine, which generates a message containing humorous elements.

[1326] The emotion engine analyzes the user's reaction and generates the next message based on the results.

[1327] The terminal displays the generated message to the user.

[1328] Specific examples

[1329] Example 1: Logging in and starting a conversation

[1330] 1. The user enters their ID and password to log in.

[1331] 2. The server performs authentication, and if successful, an authentication success message is sent to the terminal.

[1332] 3. The device displays a greeting message such as "Hello, what would you like to talk about today?"

[1333] Example 2: Travel topics

[1334] 1. User types, "I want to talk about travel."

[1335] 2. The server passes the request to a dialogue generation engine, which generates a message related to the topic, such as, "Where have you traveled recently and where would you like to go?"

[1336] 3. The device displays it to the user, enabling an enjoyable conversation.

[1337] Example 3: Providing humor and sentiment analysis

[1338] 1. The user requests, "Tell me an interesting story."

[1339] 2. The server sends the request to the dialogue generation engine.

[1340] 3. The dialogue generation engine generates humorous stories such as "One day, an elephant walked into a restaurant..."

[1341] 4. The emotion engine analyzes the user's reaction and provides the results to the dialogue generation engine.

[1342] 5. The device displays the generated message to the user, and the subsequent dialogue is adjusted based on the emotion.

[1343] Prompt Sentence Examples

[1344] "I want to talk about travel."

[1345] "Tell me an interesting story."

[1346] In this way, the present invention provides an effective dialogue system for enriching the lives of elderly people and reducing their sense of loneliness.

[1347] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1348] Step 1:

[1349] A user accesses the system and enters their ID and password on the login screen.

[1350] Input: User ID, Password

[1351] Specific actions: Access the login screen using a smartphone or computer and enter your ID and password in the input fields.

[1352] Output: Login information is sent to the terminal.

[1353] Step 2:

[1354] The device sends the login information to the server.

[1355] Input: Login information (user ID, password)

[1356] Specific operation: When you click the login button, the device sends your ID and password to the server as an HTTP POST request.

[1357] Output: Login information is sent to the server.

[1358] Step 3:

[1359] The server checks the login information and authenticates the user. If authentication is successful, it sends a message of authentication success and the user's profile information to the device.

[1360] Input: Login information sent to the server

[1361] Specific operation: Compares the input information with the user information stored in the database to see if they match. If they match, sends the user's profile information in JSON format to the terminal along with an authentication success message.

[1362] Output: Authentication success message and profile information

[1363] Step 4:

[1364] The terminal displays a dialogue start screen and displays a greeting message from the dialogue generation engine to the user, such as "Hello, what would you like to talk about today?"

[1365] Input: Authentication success message received from the server and profile information

[1366] Specific operation: The terminal parses the received data and displays the dialogue start screen. It also displays a greeting message from the dialogue generation engine on the screen.

[1367] Output: Display of the opening screen and greeting message

[1368] Step 5:

[1369] The user clicks the Start Interaction button.

[1370] Input: User clicks

[1371] Specific operation: Click the "Start conversation" button that appears on the home screen after logging in.

[1372] Output: Initiating request

[1373] Step 6:

[1374] The terminal sends a dialogue initiation request to the server.

[1375] Input: Dialogue-initiating request

[1376] Specific operation: When the dialogue start button is clicked, the terminal sends dialogue start information to the server via an HTTP POST request.

[1377] Output: Request sent to server

[1378] Step 7:

[1379] The server starts the dialogue generation engine and generates the initial greeting message.

[1380] Input: Dialogue-initiating request

[1381] Specific operation: Start the dialogue generation engine and generate the initial message "Hello, what would you like to talk about today?"

[1382] Output: Initial greeting message

[1383] Step 8:

[1384] The server sends the generated greeting message to the terminal, which displays it to the user.

[1385] Input: Initial greeting message

[1386] Specific operation: The server sends the generated greeting message in JSON format to the terminal, which parses it and displays it on the screen.

[1387] Output: Display greeting message

[1388] Step 9:

[1389] The user inputs a reply to the greeting message and sends it to the terminal.

[1390] Input: User's reply message

[1391] Specific actions: Enter a message in the text box on the screen and click the send button.

[1392] Output: User input message

[1393] Step 10:

[1394] The terminal sends the user's input message to the server.

[1395] Input: User input message

[1396] Specific behavior: The message entered in the text box is sent to the server via an HTTP POST request.

[1397] Output: Sending the user message to the server

[1398] Step 11:

[1399] The server passes the message from the user to the emotion engine, which analyzes the user's emotions.

[1400] Input: User input message

[1401] Specific operation: Sends a message to the emotion engine and obtains emotion information such as "positive" or "negative."

[1402] Output: Analysis results by the emotion engine

[1403] Step 12:

[1404] The emotion engine sends the analysis results to the server.

[1405] Input: Data analyzed by the emotion engine

[1406] Specific operation: The sentiment analysis results are returned to the server in JSON format.

[1407] Output: Sending the analysis results

[1408] Step 13:

[1409] The server passes the emotion engine's analysis results and the user's message to the dialogue generation engine, which then generates an appropriate reply.

[1410] Input: Analysis results of the emotion engine, user input message

[1411] Specific operation: The dialogue generation engine utilizes emotional information to generate messages that include empathy and encouragement.

[1412] Output: Appropriate reply message

[1413] Step 14:

[1414] The server sends the generated reply to the terminal, which displays it to the user.

[1415] Input: Appropriate reply message

[1416] Specific operation: Display a message from the dialogue generation engine on the screen.

[1417] Output: Display of reply message

[1418] Step 15:

[1419] The user types, "I want to talk about travel."

[1420] Input: User request message

[1421] Specific action: Enter a specific topic such as "travel" in the topic input field and click the send button.

[1422] Output: Topic request message

[1423] Step 16:

[1424] The device sends a request to the server.

[1425] Input: User's topic request message

[1426] Specific behavior: Sends topic information to the server using an HTTP POST request.

[1427] Output: Request sent to server

[1428] Step 17:

[1429] The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[1430] Input: Topic request message

[1431] Specific operation: Notify the dialogue generation engine of the topic and generate related conversation messages.

[1432] Output: Messages related to the topic

[1433] Step 18:

[1434] The server sends the generated topic-related messages to the terminal, which displays them to the user.

[1435] Input: Topic-related messages

[1436] Specific operation: The relevant message is sent in JSON format to the device, which parses it and displays it on the screen.

[1437] Output: Show messages related to the topic

[1438] Step 19:

[1439] The user requests, "Tell me an interesting story."

[1440] Input: User request message

[1441] Specific action: Type "Tell me a funny story" in the text box and click the send button.

[1442] Output: Humor request message

[1443] Step 20:

[1444] The device sends a request to the server.

[1445] Input: Humor request message

[1446] Specific operation: Sends a request to the server as an HTTP POST request.

[1447] Output: Request sent to server

[1448] Step 21:

[1449] The server passes the request to a dialogue generation engine, which generates messages containing story and humorous elements.

[1450] Input: Humor request message

[1451] Specific operation: Notifies the dialogue generation engine and generates a message containing humorous elements.

[1452] Output: Humorous message

[1453] Step 22:

[1454] The server passes the generated humor message to an emotion engine for analyzing the user's reaction.

[1455] Input: Humorous message

[1456] Specific operation: The humorous message and the user's response are sent to the emotion engine for sentiment analysis.

[1457] Output: Analysis results

[1458] Step 23:

[1459] The analysis results obtained by the emotion engine are notified to the server, which then transmits them to the terminal.

[1460] Input: Analysis results

[1461] Specific operation: The emotion engine returns the results in JSON format to the dialogue generation engine and server, and generates a new message based on them.

[1462] Output: Next message

[1463] Step 24:

[1464] The terminal displays the generated story message to the user.

[1465] Input: Story message

[1466] Specific operation: A story message is displayed on the screen and updated according to the user's response.

[1467] Output: Display story message

[1468] Step 25:

[1469] The user clicks the "End conversation" button to end the conversation.

[1470] Input: User clicks

[1471] Specific actions: Click the "End conversation" button displayed on the screen.

[1472] Output: End of conversation request

[1473] Step 26:

[1474] The terminal notifies the server of the request.

[1475] Input: Dialogue termination request

[1476] Specific operation: Sends a request to end the conversation to the server using an HTTP POST request.

[1477] Output: Sends a request to the server to terminate the conversation

[1478] Step 27:

[1479] The server terminates the session with the dialogue generation engine and emotion engine, and sends a session termination message to the terminal.

[1480] Input: Dialogue termination request

[1481] Specific operation: Clears session data and sends a termination message in JSON format to the terminal.

[1482] Output: Session termination message

[1483] Step 28:

[1484] The terminal displays a session termination message to the user.

[1485] Input: Session termination message

[1486] Specific operation: A termination message is displayed on the screen to notify the user that the conversation has ended.

[1487] Output: Display of the completion message

[1488] (Application example 2)

[1489] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1490] There is a need to reduce feelings of loneliness and mental stress among elderly people and workers in workplaces such as factories. In particular, interactive support systems are necessary to improve work efficiency while maintaining overall well-being in the workplace. However, conventional dialogue systems lack the ability to recognize emotions and adjust dialogue content accordingly, resulting in an inconsistent dialogue experience.

[1491] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen for the authenticated user, means for receiving a dialogue start request from the user and starting the dialogue generation engine, means for displaying an initial greeting message generated by the dialogue generation engine to the user, means for receiving a message from the user and for the dialogue generation engine to generate an appropriate reply based on the message, means for displaying the generated reply to the user, means for recognizing the user's voice and analyzing emotions, means for adjusting the output of the dialogue generation engine based on the recognized emotion, and means for displaying a dialogue and outputting audio to the user via the smart glasses. This provides an appropriate dialogue experience according to the user's emotional state, making it possible to reduce feelings of loneliness and mental stress.

[1492] "User" refers to an individual who interacts with the system.

[1493] "Login information" refers to the information (such as ID and password) that a user enters when accessing the system.

[1494] "Authentication" refers to the process of verifying a user's identity based on the login information entered and granting them access to a system.

[1495] "Dialogue generation engine" refers to algorithms and software that generate appropriate dialogue based on input from a user.

[1496] An "emotion recognition engine" refers to algorithms and software that recognize and analyze emotions from a user's voice and facial expressions.

[1497] The "interaction start screen" refers to a screen that guides the user through the preparation state for starting an interaction after the user logs in to the system.

[1498] A "dialogue initiation request" refers to a request by a user to inform the system that he or she wishes to start a dialogue.

[1499] The "initial greeting message" refers to the first message generated by the dialogue generation engine at the start of a dialogue.

[1500] "User message" refers to a message containing the content of a dialogue that a user inputs into the system.

[1501] An "appropriate reply" refers to a response generated by the dialogue generation engine based on a user message.

[1502] "Smart glasses" refers to a wearable device equipped with a display, camera, and microphone that displays information and outputs audio.

[1503] "Speech recognition" refers to the process of converting a user's speech into text.

[1504] "Sentiment analysis" refers to the process of identifying a user's emotional state from their voice and facial expressions.

[1505] The system that realizes this application example is designed to provide interactive support to elderly people and factory workers. Below, we will explain how this system works, including the hardware and software used, their roles, and the data processing procedures.

[1506] System configuration

[1507] The system mainly consists of the following components:

[1508] Server: Manages the dialogue generation engine, emotion recognition engine, and database.

[1509] Terminal: Smart glasses for direct user manipulation and interaction.

[1510] User: An elderly person or a factory worker who interacts.

[1511] Hardware and software used

[1512] Smart glasses: Equipped with a camera, microphone, and display, they display dialogue content and allow voice input.

[1513] OpenAI GPT-3: Used as a dialogue generation engine, it generates appropriate dialogue based on user input.

[1514] Facial Recognition Library: Used to analyze user emotions from images captured by the camera.

[1515] Speech Recognition Library: Used to convert the user's speech into text.

[1516] Data processing and calculation

[1517] 1. Speech Recognition: The device (smart glasses) captures the user's speech and converts it into text using the Speech Recognition Library.

[1518] 2. Emotion Recognition: Analyze the user's facial image captured by the camera using the Facial Recognition Library to identify their emotions.

[1519] 3. Dialogue generation: The acquired voice data (converted to text) and emotion data are input into a dialogue generation engine (OpenAI GPT-3) to generate an appropriate dialogue.

[1520] 4. Display and output: The generated dialogue is displayed on the smart glasses display and output as voice if necessary.

[1521] Specific examples

[1522] For example, if a factory worker is feeling stressed after working all day, the system will work as follows:

[1523] 1. Voice Input and Emotion Recognition:

[1524] A worker talks to his smart glasses and says, "I'm tired today."

[1525] The glasses' camera captures the worker's face, and an emotion recognition engine verifies that they are "tired."

[1526] 2. Dialogue generation and output:

[1527] Send the following prompt to the OpenAI GPT-3 generative AI model:

[1528] User said: "I'm tired today.", User emotion: "I'm tired"

[1529] Generate a suitable response.

[1530] The dialogue generation engine generates an appropriate response: "You seem tired today. Would you like to take a break and refresh yourself?"

[1531] This message will be displayed on the smart glasses' display and spoken aloud.

[1532] As described above, this system provides a dialogue experience that is tailored to the user's emotional state, and can reduce mental stress and feelings of loneliness.

[1533] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1534] Program processing steps

[1535] Step 1:

[1536] The device captures the user's voice. The microphone in the smart glasses picks up what the user is saying and collects it as voice data. The voice data is input into the Speech Recognition Library and converted into text data. This conversion process puts the voice content into a format that can be understood.

[1537] Input: User's voice data

[1538] Data processing: converting voice to text

[1539] Output: Text data (e.g. "I'm tired today")

[1540] Step 2:

[1541] The device captures the user's face and analyzes their emotions. The camera in the smart glasses takes a picture of the user's face and inputs the image data into the Facial Recognition Library. The library analyzes facial expressions from the image data and identifies the user's emotional state. This step generates emotion data.

[1542] Input: User's face image data

[1543] Data Computing: Emotion Recognition through Facial Expression Analysis

[1544] Output: Emotion data (e.g. "Tired")

[1545] Step 3:

[1546] The server sends a prompt to the dialogue generation engine. The device sends the collected text and emotion data to the server. The server uses this data to generate a prompt for the generative AI model (OpenAI GPT-3) and requests an appropriate dialogue.

[1547] Input: Text data, emotion data

[1548] Data processing: Prompt generation and sending

[1549] Output: Prompt sentence (e.g., "User said: 'I'm tired today.', User emotion: 'I'm tired.' Generate a suitable response.")

[1550] Step 4:

[1551] The server receives the response from the dialogue generation engine. The generative AI model generates an appropriate dialogue response based on the prompt sentence and sends it back to the server. The server receives this response data and proceeds to the next step.

[1552] Input: prompt statement

[1553] Data Computation: Generating Interactive Responses

[1554] Output: Dialogue response data (e.g., "You seem tired today. Would you like to take a short break to refresh yourself?")

[1555] Step 5:

[1556] The server sends the response to the terminal. The generated dialogue response data is sent to the smart glasses, which prepares for display and audio output. The terminal displays the received data on the display.

[1557] Input: Dialogue response data

[1558] Data processing: Preparing response data for display

[1559] Output: Dialogue displayed on the smart glasses (e.g., "You seem tired today. Would you like to take a short break to refresh yourself?")

[1560] Step 6:

[1561] The device displays and outputs the dialogue response to the user. The response message is displayed on the smart glasses' display and output as audio through the built-in speaker, allowing the user to receive visual and auditory feedback.

[1562] Input: Dialogue response data

[1563] Data calculation: Display and voice output of response messages

[1564] Output: Feedback to the user (visual and auditory)

[1565] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1566] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1567] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1568] [Third embodiment]

[1569] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1570] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1571] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1572] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1573] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1574] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1575] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1576] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1577] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1578] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1579] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1580] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1581] The present invention aims to alleviate the sense of loneliness felt by elderly people and provide them with a fulfilling dialogue experience. This system utilizes a dialogue generation engine to generate dialogue based on user input and to facilitate natural communication. Specific embodiments for implementing the present invention will be described below.

[1582] System configuration

[1583] The system mainly consists of the following elements:

[1584] 1. Server: Mainly responsible for user authentication, managing the dialogue generation engine, and storing dialogue data.

[1585] 2. Terminal: A device (e.g., smartphone, tablet, or PC) that is directly operated by the user and provides the user interface.

[1586] 3. User: An individual who interacts with the system, primarily targeted at elderly people.

[1587] 4. Dialogue generation engine: Consists of algorithms and software that generate appropriate dialogue in response to user input.

[1588] Program processing

[1589] The program does the following:

[1590] 1. User Registration and Login:

[1591] The user accesses the system login screen and enters their ID and password.

[1592] The terminal sends the entered login information to the server.

[1593] The server checks the login information and authenticates the user. If successful, it sends an authentication success message to the terminal.

[1594] 2. Start a conversation:

[1595] The user clicks the Start Interaction button.

[1596] The terminal sends this request to the server.

[1597] The server starts the dialogue generation engine and generates an initial greeting message.

[1598] The server sends the generated greeting message to the terminal, which displays it to the user.

[1599] 3. Continuing the dialogue:

[1600] When the user replies to the AI's message, the device sends the message to the server.

[1601] The server passes the received message to the dialogue generation engine, which generates an appropriate reply.

[1602] The server sends the generated reply to the terminal, which displays it to the user.

[1603] 4. Conversations about topics that interest you:

[1604] A user requests to talk about a specific topic (e.g., "I want to talk about travel").

[1605] The device sends the request to the server.

[1606] The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[1607] The server sends the generated message to the terminal, which displays it to the user.

[1608] 5. Providing stories and humor:

[1609] The user requests, "Tell me an interesting story."

[1610] The device sends the request to the server.

[1611] The server causes the dialogue generation engine to generate messages containing story and humorous elements.

[1612] The server sends the generated message to the terminal, which displays it to the user.

[1613] 6. Ending the conversation:

[1614] If the user wishes to end the conversation, he or she clicks the "End conversation" button.

[1615] The terminal notifies the server of the request.

[1616] The server terminates the session with the dialogue generation engine and sends a session termination message to the terminal.

[1617] The terminal displays a session termination message to the user.

[1618] Specific examples

[1619] Example 1: Logging in and starting a conversation

[1620] 1. The user enters their ID and password on the login screen.

[1621] 2. The server checks the input information and performs authentication.

[1622] 3. If authentication is successful, the terminal displays a greeting message from the dialogue generation engine to the user: "Hello, what would you like to talk about today?"

[1623] Example 2: Travel topics

[1624] 1. User types, "I want to talk about travel."

[1625] 2. The server passes the request to the dialogue generation engine.

[1626] 3. The dialogue generation engine generates a message related to the topic, such as "Where have you traveled recently and where would you like to go?", and the server sends the message to the device.

[1627] 4. The device displays the message to the user, and the user enjoys talking about their travel memories and plans.

[1628] Example 3: Providing humor

[1629] 1. The user requests, "Tell me an interesting story."

[1630] 2. The server sends the request to the dialogue generation engine.

[1631] 3. The dialogue generation engine generates a humorous story such as "One day, an elephant came into the restaurant..." and the server sends the message to the device.

[1632] 4. The device displays a fun story to the user, making them laugh and feel happy.

[1633] As described above, the present invention provides a specific system configuration and processing method for reducing the sense of loneliness felt by elderly people and providing them with a rich conversation experience.

[1634] The processing flow will be explained below.

[1635] Step 1:

[1636] A user accesses the system and enters their ID and password on the login screen.

[1637] Step 2:

[1638] The terminal sends the entered login information to the server.

[1639] Step 3:

[1640] The server receives the login information and authenticates the user against a database.

[1641] Step 4:

[1642] The server sends the authentication result to the terminal. If authentication is successful, it sends a success message and profile information. If authentication is unsuccessful, it sends an error message.

[1643] Step 5:

[1644] The terminal receives a message that authentication was successful and displays the start screen of the dialogue to the user. If authentication failed, an error message is displayed to the user.

[1645] Step 6:

[1646] The user clicks the Start Interaction button.

[1647] Step 7:

[1648] The terminal sends a dialogue initiation request to the server.

[1649] Step 8:

[1650] The server starts the dialogue generation engine and generates the initial greeting message.

[1651] Step 9:

[1652] The server sends the generated greeting message to the terminal.

[1653] Step 10:

[1654] The terminal displays a greeting message to the user.

[1655] Step 11:

[1656] The user types a reply to the greeting message.

[1657] Step 12:

[1658] The terminal sends the user's input to the server.

[1659] Step 13:

[1660] The server passes messages from the user to a dialogue generation engine, which generates appropriate replies.

[1661] Step 14:

[1662] The server sends the generated reply to the terminal.

[1663] Step 15:

[1664] The terminal displays the reply to the user.

[1665] Step 16:

[1666] A user submits a request to talk about a specific topic (e.g., "I want to talk about travel").

[1667] Step 17:

[1668] The device sends a topic request to the server.

[1669] Step 18:

[1670] The server passes the topic request to a dialogue generation engine, which generates information and questions related to the topic.

[1671] Step 19:

[1672] The server sends the generated topic-related message to the terminal.

[1673] Step 20:

[1674] The terminal displays topic-related messages to the user.

[1675] Step 21:

[1676] The user requests humorous or entertaining stories, such as "tell me a funny story."

[1677] Step 22:

[1678] The terminal sends this request to the server.

[1679] Step 23:

[1680] The server passes the request to a dialogue generation engine, which generates a message containing humorous elements.

[1681] Step 24:

[1682] The server sends the generated humor message to the terminal.

[1683] Step 25:

[1684] The terminal displays the humorous message to the user.

[1685] Step 26:

[1686] If the user wishes to end the conversation, he or she clicks the "End conversation" button.

[1687] Step 27:

[1688] The terminal notifies the server of a request to terminate the conversation.

[1689] Step 28:

[1690] The server terminates the session with the dialogue generation engine and sends a session termination message to the terminal.

[1691] Step 29:

[1692] The terminal displays a session termination message to the user.

[1693] Example 1

[1694] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1695] Elderly people are prone to feelings of social isolation and loneliness, which can have a negative impact on their mental health. Elderly people who live alone, in particular, tend to lack opportunities for daily communication. Therefore, it is necessary to resolve these issues and help elderly people reduce their loneliness through fulfilling conversational experiences, thereby improving the quality of their daily lives.

[1696] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1697] In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen for the authenticated user, means for receiving a dialogue start request from the user and starting a dialogue generation engine, means for displaying an initial greeting message generated by the dialogue generation engine to the user, means for receiving a message from the user and generating an appropriate reply based on the message by the dialogue generation engine, means for displaying the generated reply to the user, means for inputting a prompt sentence on a specific topic to the dialogue generation engine and generating information or questions related to the topic, and means for inputting a prompt sentence of a humorous or fun story to the dialogue generation engine in response to a request from the user and generating a message containing an element of humor. This allows elderly people to reduce their sense of loneliness through everyday dialogue experiences and makes it easier to maintain their mental health.

[1698] "Login information" refers to authentication information such as ID and password that a user enters when accessing a system.

[1699] "Authentication" is the process by which a system verifies a user's login information and determines whether the user is legitimate.

[1700] The "interaction start screen" is a screen that provides an interface for the user to start an interaction.

[1701] A "dialogue start request" is an operation or input information that a user performs to notify the system that he or she wishes to start a dialogue.

[1702] A "dialogue generation engine" is a collection of algorithms and software that generates natural dialogue based on user input.

[1703] The "initial greeting message" is a greeting message generated by the dialogue generation engine for the first time user.

[1704] A "message" is a conversation that a user inputs into the system and a conversation that is sent from the system to the user.

[1705] An "appropriate reply" is a response that the dialogue generation engine generates based on the user's message.

[1706] A "generated reply" is a response to a user's message that is generated by the dialogue generation engine.

[1707] A "specific topic" is a specific topic or theme that a user wishes to discuss with the system.

[1708] A "prompt sentence" is text that is input to a dialogue generation engine and contains instructions or guidance to generate something.

[1709] "Information and questions" are data and questions generated by the dialogue generation engine related to a specific topic.

[1710] "Humor elements" are elements of humor or humor contained in messages generated by the dialogue generation engine.

[1711] A "fun story" is an interesting and entertaining story that the dialogue generation engine generates in response to a user request.

[1712] The present invention is a system for reducing the sense of loneliness felt by elderly people and providing them with a fulfilling dialogue experience. This system includes a server that performs user authentication, manages a dialogue generation engine, and stores dialogue data, a terminal that is directly operated by the user, and a dialogue generation engine that generates dialogue based on input from the user. Specific embodiments for implementing this system are described below.

[1713] Components

[1714] 1. Server:

[1715] It performs user authentication and manages the dialogue in cooperation with the dialogue generation engine.

[1716] The software used includes database management systems (MySQL and PostgreSQL) and generative AI models (e.g., GPT-3).

[1717] 2. Terminal:

[1718] A device (smartphone, tablet, PC) that allows users to interact directly.

[1719] It provides a user interface, sends user input to the server, and displays replies from the server to the user.

[1720] 3. Dialogue generation engine:

[1721] Use a generative AI model (e.g., GPT-3) to generate natural-looking dialogue based on user input.

[1722] Operational Overview

[1723] The system works as follows:

[1724] User Registration and Login

[1725] 1. The user enters their ID and password on the login screen.

[1726] 2. The device sends this information to the server, which then authenticates the user.

[1727] 3. If the authentication is successful, the server sends an authentication success message to the terminal, and the terminal displays "Login successful" to the user.

[1728] Start a dialogue

[1729] 1. The user clicks the "Start conversation" button.

[1730] 2. The device sends this request to the server.

[1731] 3. The server starts the dialogue generation engine and generates the initial greeting message.

[1732] 4. The server sends the generated greeting message to the terminal, which displays it to the user.

[1733] Continuing the dialogue

[1734] 1. When the user replies to the AI's message, the device sends the message to the server.

[1735] 2. The server passes this message to the dialogue generation engine, which generates an appropriate reply.

[1736] 3. The server generates a reply and sends it to the device, which displays it to the user.

[1737] Conversations about topics that interest you

[1738] 1. A user requests to "talk about travel."

[1739] 2. The device sends the request to the server.

[1740] 3. The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[1741] 4. The server sends the generated message to the terminal, which displays it to the user.

[1742] Providing stories and humor

[1743] 1. The user requests, "Tell me an interesting story."

[1744] 2. The device sends the request to the server.

[1745] 3. The server instructs the dialogue generation engine to generate messages that include story and humorous elements.

[1746] 4. The server sends the generated message to the terminal, which displays it to the user.

[1747] Examples of prompt statements

[1748] The following is an example of a prompt that may be entered into the system:

[1749] 1. Login prompt:

[1750] Please enter your user ID and password.

[1751] 2. Prompt at the beginning of the dialogue:

[1752] Start a dialogue: What do you want to talk about?

[1753] 3. Travel topic request prompt:

[1754] I want to talk about travel.

[1755] 4. Humor requests prompt:

[1756] Please tell me an interesting story.

[1757] Through the above-mentioned components and operations, the system is designed to enable elderly people to enjoy everyday interactive experiences and reduce feelings of loneliness.

[1758] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1759] Program processing steps

[1760] Step 1: User Registration and Login

[1761] 1. The user enters their ID and password on the login screen.

[1762] Input: The user enters their ID and password into the login form.

[1763] Output: Login information is sent to the terminal.

[1764] 2. The device sends the entered login information to the server.

[1765] Input: The login information entered by the user.

[1766] Output: The input information is encrypted and sent to the server.

[1767] 3. The server verifies the login information and authenticates the user.

[1768] Input: The login information received by the server.

[1769] Processing: Authenticate the user by checking against the user information in the database.

[1770] Output: Generates a message indicating authentication success or failure.

[1771] 4. The server sends an authentication success message to the terminal.

[1772] Input: Authentication success message.

[1773] Output: A successful authentication message is sent to the terminal.

[1774] 5. The terminal receives the authentication success message and displays a "Login successful" notification to the user.

[1775] Input: Authentication success message.

[1776] Output: A successful login notification is displayed to the user.

[1777] Step 2: Start a conversation

[1778] 1. The user clicks the "Start conversation" button.

[1779] Input: User action (clicking a button).

[1780] Output: A conversation initiation request is generated on the terminal.

[1781] 2. The device sends this request to the server.

[1782] Input: A conversation-initiating request.

[1783] Output: The request is sent to the server.

[1784] 3. The server starts the dialogue generation engine and generates the initial greeting message.

[1785] Input: A conversation-initiating request.

[1786] Processing: The dialogue generation engine generates an initial greeting message based on the prompt sentence.

[1787] Output: Initial greeting message.

[1788] 4. The server sends the generated greeting message to the terminal.

[1789] Input: Initial greeting message.

[1790] Output: A greeting message is sent to the terminal.

[1791] 5. The terminal displays a greeting message to the user.

[1792] Input: A greeting message.

[1793] Output: A greeting message is displayed to the user.

[1794] Step 3: Continue the conversation

[1795] 1. When the user replies to the AI's message, the device sends the message to the server.

[1796] Input: The user's reply message.

[1797] Output: A reply message is sent from the device to the server.

[1798] 2. The server passes the received message to the dialogue generation engine.

[1799] Input: The user's reply message.

[1800] Output: The message is passed to the dialogue generation engine.

[1801] 3. The dialogue generation engine generates an appropriate reply.

[1802] Input: The user's reply message.

[1803] Processing: The dialogue generation engine generates an appropriate reply.

[1804] Output: The generated reply message.

[1805] 4. The server generates a reply and sends it to the terminal, which displays it to the user.

[1806] Input: The generated reply message.

[1807] Output: The reply message is sent to the terminal and displayed to the user.

[1808] Step 4: Talk about topics that interest you

[1809] 1. A user requests to "talk about travel."

[1810] Input: User's request on the topic.

[1811] Output: The request is sent to the device.

[1812] 2. The device sends the request to the server.

[1813] Input: The user request.

[1814] Output: The request is sent to the server.

[1815] 3. The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[1816] Input: The user request.

[1817] Processing: The dialogue generation engine generates information and questions related to the topic.

[1818] Output: The information or question generated.

[1819] 4. The server sends the generated message to the terminal, which displays it to the user.

[1820] Input: Generated information or question.

[1821] Output: Messages are sent to the terminal and displayed to the user.

[1822] Step 5: Provide a story and humor

[1823] 1. The user requests, "Tell me an interesting story."

[1824] Input: The user request.

[1825] Output: The request is sent to the device.

[1826] 2. The device sends the request to the server.

[1827] Input: The user request.

[1828] Output: The request is sent to the server.

[1829] 3. The server instructs the dialogue generation engine to generate messages that include story and humorous elements.

[1830] Input: The user request.

[1831] Processing: The dialogue generation engine generates messages that include story and humorous elements.

[1832] Output: The generated story message.

[1833] 4. The server sends the generated message to the terminal, which displays it to the user.

[1834] Input: The generated story message.

[1835] Output: Messages are sent to the terminal and displayed to the user.

[1836] Step 6: Ending the conversation

[1837] 1. If the user wants to end the conversation, he clicks the "End conversation" button.

[1838] Input: User action (clicking a button).

[1839] Output: A termination request is generated on the terminal.

[1840] 2. The device notifies the server of the request.

[1841] Input: The conversation termination request.

[1842] Output: The request is sent to the server.

[1843] 3. The server ends the session with the dialogue generation engine.

[1844] Input: The conversation termination request.

[1845] Action: Ends the session with the dialogue generation engine.

[1846] Output: Session termination message.

[1847] 4. The server sends a session termination message to the terminal, which displays it to the user.

[1848] Input: Session termination message.

[1849] Output: Messages are sent to the terminal and displayed to the user.

[1850] (Application example 1)

[1851] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1852] In order to reduce the sense of loneliness felt by the elderly and to help them live their daily lives more safely and comfortably, a wide range of support is required, including not only simple dialogue but also assistance in emergencies and the management of daily tasks. However, conventional dialogue systems lack the functionality to comprehensively address these diverse needs. Therefore, there is a need for a system that not only alleviates the sense of loneliness for the elderly but also provides integrated support for assistance in emergencies and the management of daily tasks.

[1853] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1854] In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen to the authenticated user, means for receiving a dialogue start request from the user and activating a dialogue generation engine, means for displaying an initial greeting message generated by the dialogue generation engine to the user, means for receiving a message from the user and for the dialogue generation engine to generate an appropriate reply based on the message, means for displaying the generated reply to the user, means for the user to send a request for assistance in an emergency and make an emergency call, means for the user to send a request to set a reminder for a specific task and set the reminder, and means for conducting daily health checks and recording the results. This makes it possible to reduce the elderly's sense of loneliness while providing centralized support for emergency assistance and managing daily tasks.

[1855] 1. "Elderly" generally refers to the population aged 65 and over who require special care and support due to physical and mental changes that occur with aging.

[1856] 2. "Loneliness" refers to the loneliness and anxiety that arise from being alone due to a weakening of social connections with others.

[1857] 3. "Dialogue generation engine" refers to a system consisting of algorithms and software for conducting natural conversations based on user input.

[1858] 4. "System" refers to a technical configuration in which multiple means or elements work together to achieve a specific purpose.

[1859] 5. "User" means an individual who uses the System and enjoys its interaction and other features.

[1860] 6. "Login Information" means the authentication information required for a user to access the system, and usually consists of an ID and password.

[1861] 7. "Authentication" means the process of verifying that the login information provided belongs to the registered user.

[1862] 8. "Screen" refers to the interface displayed on a terminal, enabling interaction and operation between the user and the system.

[1863] 9. "Message" means text data exchanged during a conversation.

[1864] 10. A "request" is an action taken by a user to request a specific action or information from a system.

[1865] 11. "Emergency Call" refers to a means of communication to request assistance in an emergency.

[1866] 12. "Reminder" is a function that notifies users of tasks or events that they have set.

[1867] 13. "Health Check" is the process of checking the user's daily health status and recording the results.

[1868] 14. "Multi-faceted support" refers to a wide range of assistance to address different types of needs and requirements.

[1869] The present invention is a system that reduces feelings of loneliness among elderly people and provides integrated support for emergency assistance and daily task management. This system uses a dialogue generation engine to provide natural dialogue with the user, and also combines emergency call functions, reminder setting, and health check functions. Specific embodiments for implementing the present invention are described below.

[1870] System configuration

[1871] The system mainly consists of the following elements:

[1872] 1. Server: Responsible for user authentication, managing the dialogue generation engine, and storing dialogue data.

[1873] 2. Terminal: A device (e.g., smartphone, tablet, or PC) that is directly operated by the user and provides the user interface.

[1874] 3. User: An individual who interacts with the system, primarily targeted at elderly people.

[1875] 4. Dialogue generation engine: Consists of algorithms and software that generate appropriate dialogue in response to user input.

[1876] Detailed System Operation

[1877] 1. User Registration and Login

[1878] The user accesses the system's login screen and enters their ID and password. The terminal sends the entered login information to the server, which then verifies and authenticates the login information. If authentication is successful, an authentication success message is sent to the terminal.

[1879] 2. Start a dialogue

[1880] When the user clicks the dialogue start button, the terminal sends this request to the server. The server starts the dialogue generation engine and generates the initial greeting message. This message is sent to the terminal and displayed to the user.

[1881] 3. Continuing the dialogue

[1882] When a user replies to a message from the AI, the device sends the message to the server, which passes the message to the dialogue generation engine, which generates an appropriate reply. The reply is then sent to the device and displayed to the user.

[1883] 4. Emergency call function

[1884] When a user needs assistance in an emergency, they send an emergency call request, which the device sends to the server, which then makes the emergency call.

[1885] 5. Reminder Settings

[1886] A user can send a request to set a reminder for a particular task, and the device will send the request to the server, which will set the reminder.

[1887] 6. Health Check

[1888] The user is asked questions to check their health condition every day. The user's answers are sent from the device to the server, and the results are recorded.

[1889] Technology used

[1890] Hardware: Using a smartphone or robot as the primary device.

[1891] Software: Dialogue generation is performed using OpenAI's GPT-3 model. Server-side programs are often implemented in Python.

[1892] Specific examples

[1893] Examples of everyday conversations:

[1894] User: "What's the weather like these days?"

[1895] System response: "I want to talk about the weather."

[1896] Example of a story:

[1897] User: "Tell me a funny story."

[1898] System response: "Tell us a funny story."

[1899] This system will enable elderly people to reduce their sense of loneliness while providing centralized support for emergency assistance and managing daily tasks.

[1900] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1901] Step 1:

[1902] The user accesses the system's login screen and enters their ID and password. The entered login information is sent by the terminal to the server. The server receives the user's login information (ID and password) and performs authentication by checking it against a database. If authentication is successful, the server generates an authentication success message and sends it to the terminal. The terminal displays the received authentication success message to the user.

[1903] Step 2:

[1904] The user clicks the dialogue start button. The terminal sends this request to the server. The server starts the dialogue generation engine and generates the first greeting message. The generated greeting message is sent to the terminal, which displays it to the user. Based on the user's input (dialogue start instruction), the system starts the dialogue process.

[1905] Step 3:

[1906] When the user replies to the AI's message, the device sends the message to the server. The server passes the received message to the dialogue generation engine, which generates an appropriate reply. The generated reply message is sent from the server to the device, which displays it to the user.

[1907] Step 4:

[1908] When a user needs assistance in an emergency, they input an emergency call request. The device sends the request to the server. The server receives the emergency call request and notifies the pre-configured emergency contacts. The server generates a call completion message and sends it to the device. The device displays this message to the user.

[1909] Step 5:

[1910] The user sends a request to set a reminder for a specific task. The device sends this request to the server. The server receives the request and sets the reminder for the specified date and time. A message indicating the completion of the setting is sent from the server to the device and displayed to the user.

[1911] Step 6:

[1912] Questions for daily health checks are sent from the server to the terminal. The terminal displays the questions to the user, who answers them. The terminal sends the answers to the server, which records the answers in a database. The server generates a recording completion message and sends it to the terminal. The terminal displays this message to the user.

[1913] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1914] The present invention provides a system that combines a dialogue generation engine with an emotion engine that recognizes the user's emotions in order to reduce the sense of loneliness felt by elderly people and provide a fulfilling dialogue experience. Specific embodiments for carrying out the present invention will be described below.

[1915] System configuration

[1916] The system mainly consists of the following elements:

[1917] 1. Server: Responsible for user authentication, managing the dialogue generation engine and emotion engine, and storing dialogue data.

[1918] 2. Terminal: A device (e.g., smartphone, tablet, or PC) that is directly operated by the user and provides the user interface.

[1919] 3. Users: Individuals who interact with the system, primarily elderly people, are the main target.

[1920] 4. Dialogue generation engine: Consists of algorithms and software that generate appropriate dialogue based on user input.

[1921] 5. Emotion Engine: Consists of algorithms and software for recognizing emotions from user input and responses and adjusting the output of the dialogue generation engine based on those emotions.

[1922] Program processing

[1923] The program does the following:

[1924] 1. User Registration and Login:

[1925] A user accesses the system and enters their ID and password on the login screen.

[1926] The device sends the login information to the server.

[1927] The server checks the login information and authenticates the user. If authentication is successful, it sends a message of authentication success and the user's profile information to the terminal.

[1928] 2. Start a conversation:

[1929] The user clicks the Start Interaction button.

[1930] The terminal sends a dialogue initiation request to the server.

[1931] The server starts the dialogue generation engine and generates the initial greeting message.

[1932] The server sends the generated greeting message to the terminal, which displays it to the user.

[1933] 3. Continuing the dialogue:

[1934] The user types a reply to the greeting message.

[1935] The terminal sends the user's input message to the server.

[1936] The server passes the message from the user to the emotion engine, which analyzes the user's emotions.

[1937] The emotion engine sends the analysis results to the server.

[1938] The server passes the emotion engine's analysis results and the user's message to the dialogue generation engine, which then generates an appropriate reply.

[1939] The server sends the generated reply to the terminal, which displays it to the user.

[1940] 4. Conversations about topics that interest you:

[1941] A user requests to talk about a specific topic, such as "I want to talk about travel."

[1942] The device sends a request to the server.

[1943] The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[1944] The server sends the generated topic-related messages to the terminal, which displays them to the user.

[1945] 5. Providing stories and humor:

[1946] A user sends a request such as "Tell me a funny story."

[1947] The device sends a request to the server.

[1948] The server passes the request to a dialogue generation engine, which generates messages containing story and humorous elements.

[1949] The server sends the generated message to the terminal, which displays it to the user.

[1950] 6. Ending the conversation:

[1951] The user clicks the "End conversation" button to end the conversation.

[1952] The terminal notifies the server of the request.

[1953] The server terminates the session with the dialogue generation engine and emotion engine, and sends a session termination message to the terminal.

[1954] The terminal displays a session termination message to the user.

[1955] Specific examples

[1956] Example 1: Logging in and starting a conversation

[1957] 1. The user enters their ID and password on the login screen.

[1958] 2. The server checks the entered information and performs authentication. If authentication is successful, an authentication success message and profile information are sent to the device.

[1959] 3. The terminal displays the dialogue start screen and displays a greeting message from the dialogue generation engine to the user, such as "Hello, what would you like to talk about today?"

[1960] Example 2: Travel topics

[1961] 1. User types, "I want to talk about travel."

[1962] 2. The server passes the request to the dialogue generation engine.

[1963] 3. The dialogue generation engine generates a message related to the topic, such as "Where have you traveled recently and where would you like to go?" and sends it to the device via the server.

[1964] 4. The device displays the message to the user, and the user enjoys talking about their travel memories and plans.

[1965] Example 3: Providing humor and sentiment analysis

[1966] 1. The user requests, "Tell me an interesting story."

[1967] 2. The server sends the request to the dialogue generation engine.

[1968] 3. The dialogue generation engine generates a humorous story such as "One day, an elephant came into the restaurant..." and sends it to the device via the server.

[1969] 4. The server passes the humor message to the emotion engine, which analyzes the user's reaction.

[1970] 5. The emotion engine notifies the dialogue generation engine and the server of the analysis results, which are reflected in the next message.

[1971] 6. The user reads an entertaining story and the next dialogue is tailored based on their emotions.

[1972] As described above, the present invention specifically shows a system configuration and processing method for reducing the sense of loneliness felt by elderly people and providing them with a rich conversation experience.

[1973] The processing flow will be explained below.

[1974] Step 1:

[1975] A user accesses the system and enters their ID and password on the login screen.

[1976] Step 2:

[1977] The terminal sends the entered login information to the server.

[1978] Step 3:

[1979] The server receives the login information and authenticates the user against a database.

[1980] Step 4:

[1981] The server sends the authentication result to the terminal. If authentication is successful, it sends a success message and profile information. If authentication is unsuccessful, it sends an error message.

[1982] Step 5:

[1983] The terminal receives a message that authentication was successful and displays the start screen of the dialogue to the user. If authentication failed, an error message is displayed to the user.

[1984] Step 6:

[1985] The user clicks the Start Interaction button.

[1986] Step 7:

[1987] The terminal sends a dialogue initiation request to the server.

[1988] Step 8:

[1989] The server starts the dialogue generation engine and generates the initial greeting message.

[1990] Step 9:

[1991] The server sends the generated greeting message to the terminal.

[1992] Step 10:

[1993] The terminal displays a greeting message to the user.

[1994] Step 11:

[1995] The user types a reply to the greeting message.

[1996] Step 12:

[1997] The terminal sends the user's input to the server.

[1998] Step 13:

[1999] The server passes a message from the user to the emotion engine, which then recognizes the user's emotion.

[2000] Step 14:

[2001] The emotion engine transmits the recognized emotion information to the server.

[2002] Step 15:

[2003] The server passes the emotion information and the user's message to the dialogue generation engine, which then generates an appropriate reply.

[2004] Step 16:

[2005] The server sends the generated reply to the terminal.

[2006] Step 17:

[2007] The terminal displays the reply to the user.

[2008] Step 18:

[2009] A user submits a request to talk about a specific topic (e.g., they want to talk about travel).

[2010] Step 19:

[2011] The device sends a topic request to the server.

[2012] Step 20:

[2013] The server passes the topic request to a dialogue generation engine, which generates information and questions related to the topic.

[2014] Step 21:

[2015] The server sends the generated topic-related message to the terminal.

[2016] Step 22:

[2017] The terminal displays topic-related messages to the user.

[2018] Step 23:

[2019] The user requests humorous or entertaining stories, such as "tell me a funny story."

[2020] Step 24:

[2021] The terminal sends this request to the server.

[2022] Step 25:

[2023] The server passes the request to a dialogue generation engine, which generates a message containing humorous elements.

[2024] Step 26:

[2025] The server sends the generated humor message to the terminal.

[2026] Step 27:

[2027] The terminal displays the humorous message to the user.

[2028] Step 28:

[2029] The server passes the humor message to an emotion engine, which analyzes the user's reaction.

[2030] Step 29:

[2031] The emotion engine sends the analysis results to the server and the dialogue generation engine.

[2032] Step 30:

[2033] The dialogue generation engine adjusts the next reply based on the emotional information from the emotion engine.

[2034] Step 31:

[2035] The user clicks the "End conversation" button to end the conversation.

[2036] Step 32:

[2037] The terminal notifies the server of a request to terminate the conversation.

[2038] Step 33:

[2039] The server terminates the session with the dialogue generation engine and emotion engine, and sends a session termination message to the terminal.

[2040] Step 34:

[2041] The terminal displays a session termination message to the user.

[2042] Example 2

[2043] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2044] Elderly people often feel lonely in their daily lives, and this can be a serious problem, especially if they spend a lot of time alone. Current technology does not provide sufficient methods to alleviate this loneliness and provide a richer interactive experience. Therefore, new systems are needed to help seniors avoid feeling lonely.

[2045] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2046] In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen to the authenticated user, and means for displaying an initial greeting message generated by the dialogue generation engine to the user. This allows elderly people to use the system easily and provides a dialogue experience that begins naturally from the very beginning.

[2047] The server further includes means for receiving a message from the user and for the dialogue generation engine to generate an appropriate reply based on the message, means for analyzing the user's emotions using the emotion engine, and means for the dialogue generation engine to generate an appropriate response based on the analysis result of the emotion engine. This enables a highly personalized dialogue according to the user's emotions, thereby improving the effect of reducing loneliness among the elderly.

[2048] "User" refers to an individual who interacts with the system, and is primarily targeted at elderly people.

[2049] "Login information" refers to authentication information such as ID and password entered by a user when accessing the system.

[2050] "Authentication" refers to the process of verifying the login information entered by a user and granting access to a system.

[2051] The "interaction start screen" is the first screen that is displayed after a user has been authenticated by the system, and provides an interface for starting an interaction.

[2052] "Dialogue generation engine" refers to algorithms and software that automatically generate appropriate dialogue messages based on input from a user.

[2053] The "initial greeting message" refers to the first message generated by the dialogue generation engine and displayed to the user at the start of a dialogue.

[2054] "Emotion Engine" refers to algorithms and software for recognizing emotions from user input and responses and adjusting the output of the dialogue generation engine based on those emotions.

[2055] "Analysis results" refers to the emotional information that the emotion engine obtains from the user's input, and affects the output of the dialogue generation engine.

[2056] An "appropriate reply" refers to a response message generated by the dialogue generation engine based on the user's input and the analysis results of the emotion engine.

[2057] "System" refers to the entire dialogue system, including the above elements, designed to reduce loneliness among the elderly.

[2058] This invention is a dialogue system designed to alleviate loneliness, especially among the elderly, and provide a rich dialogue experience. The system mainly consists of a server, a terminal, a generative AI model (a dialogue generation engine and an emotion engine), and a user.

[2059] System configuration

[2060] The system includes the following elements:

[2061] 1. Server: Responsible for user authentication, managing the dialogue generation engine and emotion engine, and storing dialogue data.

[2062] 2. Terminal: A device (smartphone, tablet, PC) that is directly operated by the user and provides the user interface.

[2063] 3. Users: Individuals who interact with the system, primarily elderly people, are the main target.

[2064] 4. Dialogue Generation Engine: Algorithms and software that generate appropriate dialogue based on input from the user.

[2065] 5. Emotion Engine: Algorithms and software for recognizing emotions from user input and responses and adjusting the output of the dialogue generation engine based on those emotions.

[2066] Hardware and Software Used

[2067] Server: Uses major cloud service providers (e.g. AWS, Google Cloud).

[2068] Devices: Common iOS devices, Android devices, Windows PCs, and macOS PCs.

[2069] Dialogue generation engine: Natural language processing algorithms (e.g. GPT-3, GPT-4).

[2070] Sentiment engine: Sentiment analysis algorithms (e.g., IBM Watson Tone Analyzer, Microsoft Azure Emotion API).

[2071] Explanation of program processing

[2072] This system performs a series of processes from user login to starting a dialogue, continuing the conversation, analyzing emotions, conducting a conversation based on a theme, and providing humor.

[2073] 1. User Registration and Login:

[2074] A user accesses the system and enters their ID and password on the login screen.

[2075] The device sends this information to the server for authentication. If authentication is successful, the device displays the following screen and the user's profile information.

[2076] 2. Start a conversation:

[2077] The user clicks the Start Interaction button.

[2078] The terminal sends a dialogue start request to the server.

[2079] The server starts a dialogue generation engine, generates an initial greeting message, and sends it to the terminal.

[2080] The terminal displays a greeting message to the user.

[2081] 3. Continuing the dialogue:

[2082] The user enters a message and sends it to the terminal.

[2083] The device sends the message to the server, where the emotion engine analyzes the emotion.

[2084] The server passes the analysis results of the emotion engine to the dialogue generation engine, which generates an appropriate response.

[2085] The terminal displays the generated response message to the user.

[2086] 4. Conversations about topics that interest you:

[2087] A user enters a request such as "I want to talk about travel."

[2088] The terminal sends a request to the server, which passes it to the dialogue generation engine.

[2089] The dialogue generation engine generates relevant information and questions and sends them to the terminal via the server.

[2090] The terminal displays this message to the user.

[2091] 5. Providing stories and humor:

[2092] The user requests, "Tell me an interesting story."

[2093] The device sends the request to the server.

[2094] The server passes the request to a dialogue generation engine, which generates a message containing humorous elements.

[2095] The emotion engine analyzes the user's reaction and generates the next message based on the results.

[2096] The terminal displays the generated message to the user.

[2097] Specific examples

[2098] Example 1: Logging in and starting a conversation

[2099] 1. The user enters their ID and password to log in.

[2100] 2. The server performs authentication, and if successful, an authentication success message is sent to the terminal.

[2101] 3. The device displays a greeting message such as "Hello, what would you like to talk about today?"

[2102] Example 2: Travel topics

[2103] 1. User types, "I want to talk about travel."

[2104] 2. The server passes the request to a dialogue generation engine, which generates a message related to the topic, such as, "Where have you traveled recently and where would you like to go?"

[2105] 3. The device displays it to the user, enabling an enjoyable conversation.

[2106] Example 3: Providing humor and sentiment analysis

[2107] 1. The user requests, "Tell me an interesting story."

[2108] 2. The server sends the request to the dialogue generation engine.

[2109] 3. The dialogue generation engine generates humorous stories such as "One day, an elephant walked into a restaurant..."

[2110] 4. The emotion engine analyzes the user's reaction and provides the results to the dialogue generation engine.

[2111] 5. The device displays the generated message to the user, and the subsequent dialogue is adjusted based on the emotion.

[2112] Prompt Sentence Examples

[2113] "I want to talk about travel."

[2114] "Tell me an interesting story."

[2115] In this way, the present invention provides an effective dialogue system for enriching the lives of elderly people and reducing their sense of loneliness.

[2116] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2117] Step 1:

[2118] A user accesses the system and enters their ID and password on the login screen.

[2119] Input: User ID, Password

[2120] Specific actions: Access the login screen using a smartphone or computer and enter your ID and password in the input fields.

[2121] Output: Login information is sent to the terminal.

[2122] Step 2:

[2123] The device sends the login information to the server.

[2124] Input: Login information (user ID, password)

[2125] Specific operation: When you click the login button, the device sends your ID and password to the server as an HTTP POST request.

[2126] Output: Login information is sent to the server.

[2127] Step 3:

[2128] The server checks the login information and authenticates the user. If authentication is successful, it sends a message of authentication success and the user's profile information to the device.

[2129] Input: Login information sent to the server

[2130] Specific operation: Compares the input information with the user information stored in the database to see if they match. If they match, sends the user's profile information in JSON format to the terminal along with an authentication success message.

[2131] Output: Authentication success message and profile information

[2132] Step 4:

[2133] The terminal displays a dialogue start screen and displays a greeting message from the dialogue generation engine to the user, such as "Hello, what would you like to talk about today?"

[2134] Input: Authentication success message received from the server and profile information

[2135] Specific operation: The terminal parses the received data and displays the dialogue start screen. It also displays a greeting message from the dialogue generation engine on the screen.

[2136] Output: Display of the opening screen and greeting message

[2137] Step 5:

[2138] The user clicks the Start Interaction button.

[2139] Input: User clicks

[2140] Specific operation: Click the "Start conversation" button that appears on the home screen after logging in.

[2141] Output: Initiating request

[2142] Step 6:

[2143] The terminal sends a dialogue initiation request to the server.

[2144] Input: Dialogue-initiating request

[2145] Specific operation: When the dialogue start button is clicked, the terminal sends dialogue start information to the server via an HTTP POST request.

[2146] Output: Request sent to server

[2147] Step 7:

[2148] The server starts the dialogue generation engine and generates the initial greeting message.

[2149] Input: Dialogue-initiating request

[2150] Specific operation: Start the dialogue generation engine and generate the initial message "Hello, what would you like to talk about today?"

[2151] Output: Initial greeting message

[2152] Step 8:

[2153] The server sends the generated greeting message to the terminal, which displays it to the user.

[2154] Input: Initial greeting message

[2155] Specific operation: The server sends the generated greeting message in JSON format to the terminal, which parses it and displays it on the screen.

[2156] Output: Display greeting message

[2157] Step 9:

[2158] The user inputs a reply to the greeting message and sends it to the terminal.

[2159] Input: User's reply message

[2160] Specific actions: Enter a message in the text box on the screen and click the send button.

[2161] Output: User input message

[2162] Step 10:

[2163] The terminal sends the user's input message to the server.

[2164] Input: User input message

[2165] Specific behavior: The message entered in the text box is sent to the server via an HTTP POST request.

[2166] Output: Sending the user message to the server

[2167] Step 11:

[2168] The server passes the message from the user to the emotion engine, which analyzes the user's emotions.

[2169] Input: User input message

[2170] Specific operation: Sends a message to the emotion engine and obtains emotion information such as "positive" or "negative."

[2171] Output: Analysis results by the emotion engine

[2172] Step 12:

[2173] The emotion engine sends the analysis results to the server.

[2174] Input: Data analyzed by the emotion engine

[2175] Specific operation: The sentiment analysis results are returned to the server in JSON format.

[2176] Output: Sending the analysis results

[2177] Step 13:

[2178] The server passes the emotion engine's analysis results and the user's message to the dialogue generation engine, which then generates an appropriate reply.

[2179] Input: Analysis results of the emotion engine, user input message

[2180] Specific operation: The dialogue generation engine utilizes emotional information to generate messages that include empathy and encouragement.

[2181] Output: Appropriate reply message

[2182] Step 14:

[2183] The server sends the generated reply to the terminal, which displays it to the user.

[2184] Input: Appropriate reply message

[2185] Specific operation: Display a message from the dialogue generation engine on the screen.

[2186] Output: Display of reply message

[2187] Step 15:

[2188] The user types, "I want to talk about travel."

[2189] Input: User request message

[2190] Specific action: Enter a specific topic such as "travel" in the topic input field and click the send button.

[2191] Output: Topic request message

[2192] Step 16:

[2193] The device sends a request to the server.

[2194] Input: User's topic request message

[2195] Specific behavior: Sends topic information to the server using an HTTP POST request.

[2196] Output: Request sent to server

[2197] Step 17:

[2198] The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[2199] Input: Topic request message

[2200] Specific operation: Notify the dialogue generation engine of the topic and generate related conversation messages.

[2201] Output: Messages related to the topic

[2202] Step 18:

[2203] The server sends the generated topic-related messages to the terminal, which displays them to the user.

[2204] Input: Topic-related messages

[2205] Specific operation: The relevant message is sent in JSON format to the device, which parses it and displays it on the screen.

[2206] Output: Show messages related to the topic

[2207] Step 19:

[2208] The user requests, "Tell me an interesting story."

[2209] Input: User request message

[2210] Specific action: Type "Tell me a funny story" in the text box and click the send button.

[2211] Output: Humor request message

[2212] Step 20:

[2213] The device sends a request to the server.

[2214] Input: Humor request message

[2215] Specific operation: Sends a request to the server as an HTTP POST request.

[2216] Output: Request sent to server

[2217] Step 21:

[2218] The server passes the request to a dialogue generation engine, which generates messages containing story and humorous elements.

[2219] Input: Humor request message

[2220] Specific operation: Notifies the dialogue generation engine and generates a message containing humorous elements.

[2221] Output: Humorous message

[2222] Step 22:

[2223] The server passes the generated humor message to an emotion engine for analyzing the user's reaction.

[2224] Input: Humorous message

[2225] Specific operation: The humorous message and the user's response are sent to the emotion engine for sentiment analysis.

[2226] Output: Analysis results

[2227] Step 23:

[2228] The analysis results obtained by the emotion engine are notified to the server, which then transmits them to the terminal.

[2229] Input: Analysis results

[2230] Specific operation: The emotion engine returns the results in JSON format to the dialogue generation engine and server, and generates a new message based on them.

[2231] Output: Next message

[2232] Step 24:

[2233] The terminal displays the generated story message to the user.

[2234] Input: Story message

[2235] Specific operation: A story message is displayed on the screen and updated according to the user's response.

[2236] Output: Display story message

[2237] Step 25:

[2238] The user clicks the "End conversation" button to end the conversation.

[2239] Input: User clicks

[2240] Specific actions: Click the "End conversation" button displayed on the screen.

[2241] Output: End of conversation request

[2242] Step 26:

[2243] The terminal notifies the server of the request.

[2244] Input: Dialogue termination request

[2245] Specific operation: Sends a request to end the conversation to the server using an HTTP POST request.

[2246] Output: Sends a request to the server to terminate the conversation

[2247] Step 27:

[2248] The server terminates the session with the dialogue generation engine and emotion engine, and sends a session termination message to the terminal.

[2249] Input: Dialogue termination request

[2250] Specific operation: Clears session data and sends a termination message in JSON format to the terminal.

[2251] Output: Session termination message

[2252] Step 28:

[2253] The terminal displays a session termination message to the user.

[2254] Input: Session termination message

[2255] Specific operation: A termination message is displayed on the screen to notify the user that the conversation has ended.

[2256] Output: Display of the completion message

[2257] (Application example 2)

[2258] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2259] There is a need to reduce feelings of loneliness and mental stress among elderly people and workers in workplaces such as factories. In particular, interactive support systems are necessary to improve work efficiency while maintaining overall well-being in the workplace. However, conventional dialogue systems lack the ability to recognize emotions and adjust dialogue content accordingly, resulting in an inconsistent dialogue experience.

[2260] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen for the authenticated user, means for receiving a dialogue start request from the user and starting the dialogue generation engine, means for displaying an initial greeting message generated by the dialogue generation engine to the user, means for receiving a message from the user and for the dialogue generation engine to generate an appropriate reply based on the message, means for displaying the generated reply to the user, means for recognizing the user's voice and analyzing emotions, means for adjusting the output of the dialogue generation engine based on the recognized emotion, and means for displaying a dialogue and outputting audio to the user via the smart glasses. This provides an appropriate dialogue experience according to the user's emotional state, making it possible to reduce feelings of loneliness and mental stress.

[2261] "User" refers to an individual who interacts with the system.

[2262] "Login information" refers to the information (such as ID and password) that a user enters when accessing the system.

[2263] "Authentication" refers to the process of verifying a user's identity based on the login information entered and granting them access to a system.

[2264] "Dialogue generation engine" refers to algorithms and software that generate appropriate dialogue based on input from a user.

[2265] An "emotion recognition engine" refers to algorithms and software that recognize and analyze emotions from a user's voice and facial expressions.

[2266] The "interaction start screen" refers to a screen that guides the user through the preparation state for starting an interaction after the user logs in to the system.

[2267] A "dialogue initiation request" refers to a request by a user to inform the system that he or she wishes to start a dialogue.

[2268] The "initial greeting message" refers to the first message generated by the dialogue generation engine at the start of a dialogue.

[2269] "User message" refers to a message containing the content of a dialogue that a user inputs into the system.

[2270] An "appropriate reply" refers to a response generated by the dialogue generation engine based on a user message.

[2271] "Smart glasses" refers to a wearable device equipped with a display, camera, and microphone that displays information and outputs audio.

[2272] "Speech recognition" refers to the process of converting a user's speech into text.

[2273] "Sentiment analysis" refers to the process of identifying a user's emotional state from their voice and facial expressions.

[2274] The system that realizes this application example is designed to provide interactive support to elderly people and factory workers. Below, we will explain how this system works, including the hardware and software used, their roles, and the data processing procedures.

[2275] System configuration

[2276] The system mainly consists of the following components:

[2277] Server: Manages the dialogue generation engine, emotion recognition engine, and database.

[2278] Terminal: Smart glasses for direct user manipulation and interaction.

[2279] User: An elderly person or a factory worker who interacts.

[2280] Hardware and software used

[2281] Smart glasses: Equipped with a camera, microphone, and display, they display dialogue content and allow voice input.

[2282] OpenAI GPT-3: Used as a dialogue generation engine, it generates appropriate dialogue based on user input.

[2283] Facial Recognition Library: Used to analyze user emotions from images captured by the camera.

[2284] Speech Recognition Library: Used to convert the user's speech into text.

[2285] Data processing and calculation

[2286] 1. Speech Recognition: The device (smart glasses) captures the user's speech and converts it into text using the Speech Recognition Library.

[2287] 2. Emotion Recognition: Analyze the user's facial image captured by the camera using the Facial Recognition Library to identify their emotions.

[2288] 3. Dialogue generation: The acquired voice data (converted to text) and emotion data are input into a dialogue generation engine (OpenAI GPT-3) to generate an appropriate dialogue.

[2289] 4. Display and output: The generated dialogue is displayed on the smart glasses display and output as voice if necessary.

[2290] Specific examples

[2291] For example, if a factory worker is feeling stressed after working all day, the system will work as follows:

[2292] 1. Voice Input and Emotion Recognition:

[2293] A worker talks to his smart glasses and says, "I'm tired today."

[2294] The glasses' camera captures the worker's face, and an emotion recognition engine verifies that they are "tired."

[2295] 2. Dialogue generation and output:

[2296] Send the following prompt to the OpenAI GPT-3 generative AI model:

[2297] User said: "I'm tired today.", User emotion: "I'm tired"

[2298] Generate a suitable response.

[2299] The dialogue generation engine generates an appropriate response: "You seem tired today. Would you like to take a break and refresh yourself?"

[2300] This message will be displayed on the smart glasses' display and spoken aloud.

[2301] As described above, this system provides a dialogue experience that is tailored to the user's emotional state, and can reduce mental stress and feelings of loneliness.

[2302] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2303] Program processing steps

[2304] Step 1:

[2305] The device captures the user's voice. The microphone in the smart glasses picks up what the user is saying and collects it as voice data. The voice data is input into the Speech Recognition Library and converted into text data. This conversion process puts the voice content into a format that can be understood.

[2306] Input: User's voice data

[2307] Data processing: converting voice to text

[2308] Output: Text data (e.g. "I'm tired today")

[2309] Step 2:

[2310] The device captures the user's face and analyzes their emotions. The camera in the smart glasses takes a picture of the user's face and inputs the image data into the Facial Recognition Library. The library analyzes facial expressions from the image data and identifies the user's emotional state. This step generates emotion data.

[2311] Input: User's face image data

[2312] Data Computing: Emotion Recognition through Facial Expression Analysis

[2313] Output: Emotion data (e.g. "Tired")

[2314] Step 3:

[2315] The server sends a prompt to the dialogue generation engine. The device sends the collected text and emotion data to the server. The server uses this data to generate a prompt for the generative AI model (OpenAI GPT-3) and requests an appropriate dialogue.

[2316] Input: Text data, emotion data

[2317] Data processing: Prompt generation and sending

[2318] Output: Prompt sentence (e.g., "User said: 'I'm tired today.', User emotion: 'I'm tired.' Generate a suitable response.")

[2319] Step 4:

[2320] The server receives the response from the dialogue generation engine. The generative AI model generates an appropriate dialogue response based on the prompt sentence and sends it back to the server. The server receives this response data and proceeds to the next step.

[2321] Input: prompt statement

[2322] Data Computation: Generating Interactive Responses

[2323] Output: Dialogue response data (e.g., "You seem tired today. Would you like to take a short break to refresh yourself?")

[2324] Step 5:

[2325] The server sends the response to the terminal. The generated dialogue response data is sent to the smart glasses, which prepares for display and audio output. The terminal displays the received data on the display.

[2326] Input: Dialogue response data

[2327] Data processing: Preparing response data for display

[2328] Output: Dialogue displayed on the smart glasses (e.g., "You seem tired today. Would you like to take a short break to refresh yourself?")

[2329] Step 6:

[2330] The device displays and outputs the dialogue response to the user. The response message is displayed on the smart glasses' display and output as audio through the built-in speaker, allowing the user to receive visual and auditory feedback.

[2331] Input: Dialogue response data

[2332] Data calculation: Display and voice output of response messages

[2333] Output: Feedback to the user (visual and auditory)

[2334] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2335] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2336] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2337] [Fourth embodiment]

[2338] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2339] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2340] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2341] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2342] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2343] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2344] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2345] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2346] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2347] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2348] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2349] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2350] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2351] The present invention aims to alleviate the sense of loneliness felt by elderly people and provide them with a fulfilling dialogue experience. This system utilizes a dialogue generation engine to generate dialogue based on user input and to facilitate natural communication. Specific embodiments for implementing the present invention will be described below.

[2352] System configuration

[2353] The system mainly consists of the following elements:

[2354] 1. Server: Mainly responsible for user authentication, managing the dialogue generation engine, and storing dialogue data.

[2355] 2. Terminal: A device (e.g., smartphone, tablet, or PC) that is directly operated by the user and provides the user interface.

[2356] 3. User: An individual who interacts with the system, primarily targeted at elderly people.

[2357] 4. Dialogue generation engine: Consists of algorithms and software that generate appropriate dialogue in response to user input.

[2358] Program processing

[2359] The program does the following:

[2360] 1. User Registration and Login:

[2361] The user accesses the system login screen and enters their ID and password.

[2362] The terminal sends the entered login information to the server.

[2363] The server checks the login information and authenticates the user. If successful, it sends an authentication success message to the terminal.

[2364] 2. Start a conversation:

[2365] The user clicks the Start Interaction button.

[2366] The terminal sends this request to the server.

[2367] The server starts the dialogue generation engine and generates an initial greeting message.

[2368] The server sends the generated greeting message to the terminal, which displays it to the user.

[2369] 3. Continuing the dialogue:

[2370] When the user replies to the AI's message, the device sends the message to the server.

[2371] The server passes the received message to the dialogue generation engine, which generates an appropriate reply.

[2372] The server sends the generated reply to the terminal, which displays it to the user.

[2373] 4. Conversations about topics that interest you:

[2374] A user requests to talk about a specific topic (e.g., "I want to talk about travel").

[2375] The device sends the request to the server.

[2376] The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[2377] The server sends the generated message to the terminal, which displays it to the user.

[2378] 5. Providing stories and humor:

[2379] The user requests, "Tell me an interesting story."

[2380] The device sends the request to the server.

[2381] The server causes the dialogue generation engine to generate messages containing story and humorous elements.

[2382] The server sends the generated message to the terminal, which displays it to the user.

[2383] 6. Ending the conversation:

[2384] If the user wishes to end the conversation, he or she clicks the "End conversation" button.

[2385] The terminal notifies the server of the request.

[2386] The server terminates the session with the dialogue generation engine and sends a session termination message to the terminal.

[2387] The terminal displays a session termination message to the user.

[2388] Specific examples

[2389] Example 1: Logging in and starting a conversation

[2390] 1. The user enters their ID and password on the login screen.

[2391] 2. The server checks the input information and performs authentication.

[2392] 3. If authentication is successful, the terminal displays a greeting message from the dialogue generation engine to the user: "Hello, what would you like to talk about today?"

[2393] Example 2: Travel topics

[2394] 1. User types, "I want to talk about travel."

[2395] 2. The server passes the request to the dialogue generation engine.

[2396] 3. The dialogue generation engine generates a message related to the topic, such as "Where have you traveled recently and where would you like to go?", and the server sends the message to the device.

[2397] 4. The device displays the message to the user, and the user enjoys talking about their travel memories and plans.

[2398] Example 3: Providing humor

[2399] 1. The user requests, "Tell me an interesting story."

[2400] 2. The server sends the request to the dialogue generation engine.

[2401] 3. The dialogue generation engine generates a humorous story such as "One day, an elephant came into the restaurant..." and the server sends the message to the device.

[2402] 4. The device displays a fun story to the user, making them laugh and feel happy.

[2403] As described above, the present invention provides a specific system configuration and processing method for reducing the sense of loneliness felt by elderly people and providing them with a rich conversation experience.

[2404] The processing flow will be explained below.

[2405] Step 1:

[2406] A user accesses the system and enters their ID and password on the login screen.

[2407] Step 2:

[2408] The terminal sends the entered login information to the server.

[2409] Step 3:

[2410] The server receives the login information and authenticates the user against a database.

[2411] Step 4:

[2412] The server sends the authentication result to the terminal. If authentication is successful, it sends a success message and profile information. If authentication is unsuccessful, it sends an error message.

[2413] Step 5:

[2414] The terminal receives a message that authentication was successful and displays the start screen of the dialogue to the user. If authentication failed, an error message is displayed to the user.

[2415] Step 6:

[2416] The user clicks the Start Interaction button.

[2417] Step 7:

[2418] The terminal sends a dialogue initiation request to the server.

[2419] Step 8:

[2420] The server starts the dialogue generation engine and generates the initial greeting message.

[2421] Step 9:

[2422] The server sends the generated greeting message to the terminal.

[2423] Step 10:

[2424] The terminal displays a greeting message to the user.

[2425] Step 11:

[2426] The user types a reply to the greeting message.

[2427] Step 12:

[2428] The terminal sends the user's input to the server.

[2429] Step 13:

[2430] The server passes messages from the user to a dialogue generation engine, which generates appropriate replies.

[2431] Step 14:

[2432] The server sends the generated reply to the terminal.

[2433] Step 15:

[2434] The terminal displays the reply to the user.

[2435] Step 16:

[2436] A user submits a request to talk about a specific topic (e.g., "I want to talk about travel").

[2437] Step 17:

[2438] The device sends a topic request to the server.

[2439] Step 18:

[2440] The server passes the topic request to a dialogue generation engine, which generates information and questions related to the topic.

[2441] Step 19:

[2442] The server sends the generated topic-related message to the terminal.

[2443] Step 20:

[2444] The terminal displays topic-related messages to the user.

[2445] Step 21:

[2446] The user requests humorous or entertaining stories, such as "tell me a funny story."

[2447] Step 22:

[2448] The terminal sends this request to the server.

[2449] Step 23:

[2450] The server passes the request to a dialogue generation engine, which generates a message containing humorous elements.

[2451] Step 24:

[2452] The server sends the generated humor message to the terminal.

[2453] Step 25:

[2454] The terminal displays the humorous message to the user.

[2455] Step 26:

[2456] If the user wishes to end the conversation, he or she clicks the "End conversation" button.

[2457] Step 27:

[2458] The terminal notifies the server of a request to terminate the conversation.

[2459] Step 28:

[2460] The server terminates the session with the dialogue generation engine and sends a session termination message to the terminal.

[2461] Step 29:

[2462] The terminal displays a session termination message to the user.

[2463] Example 1

[2464] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2465] Elderly people are prone to feelings of social isolation and loneliness, which can have a negative impact on their mental health. Elderly people who live alone, in particular, tend to lack opportunities for daily communication. Therefore, it is necessary to resolve these issues and help elderly people reduce their loneliness through fulfilling conversational experiences, thereby improving the quality of their daily lives.

[2466] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2467] In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen for the authenticated user, means for receiving a dialogue start request from the user and starting a dialogue generation engine, means for displaying an initial greeting message generated by the dialogue generation engine to the user, means for receiving a message from the user and generating an appropriate reply based on the message by the dialogue generation engine, means for displaying the generated reply to the user, means for inputting a prompt sentence on a specific topic to the dialogue generation engine and generating information or questions related to the topic, and means for inputting a prompt sentence of a humorous or fun story to the dialogue generation engine in response to a request from the user and generating a message containing an element of humor. This allows elderly people to reduce their sense of loneliness through everyday dialogue experiences and makes it easier to maintain their mental health.

[2468] "Login information" refers to authentication information such as ID and password that a user enters when accessing a system.

[2469] "Authentication" is the process by which a system verifies a user's login information and determines whether the user is legitimate.

[2470] The "interaction start screen" is a screen that provides an interface for the user to start an interaction.

[2471] A "dialogue start request" is an operation or input information that a user performs to notify the system that he or she wishes to start a dialogue.

[2472] A "dialogue generation engine" is a collection of algorithms and software that generates natural dialogue based on user input.

[2473] The "initial greeting message" is a greeting message generated by the dialogue generation engine for the first time user.

[2474] A "message" is a conversation that a user inputs into the system and a conversation that is sent from the system to the user.

[2475] An "appropriate reply" is a response that the dialogue generation engine generates based on the user's message.

[2476] A "generated reply" is a response to a user's message that is generated by the dialogue generation engine.

[2477] A "specific topic" is a specific topic or theme that a user wishes to discuss with the system.

[2478] A "prompt sentence" is text that is input to a dialogue generation engine and contains instructions or guidance to generate something.

[2479] "Information and questions" are data and questions generated by the dialogue generation engine related to a specific topic.

[2480] "Humor elements" are elements of humor or humor contained in messages generated by the dialogue generation engine.

[2481] A "fun story" is an interesting and entertaining story that the dialogue generation engine generates in response to a user request.

[2482] The present invention is a system for reducing the sense of loneliness felt by elderly people and providing them with a fulfilling dialogue experience. This system includes a server that performs user authentication, manages a dialogue generation engine, and stores dialogue data, a terminal that is directly operated by the user, and a dialogue generation engine that generates dialogue based on input from the user. Specific embodiments for implementing this system are described below.

[2483] Components

[2484] 1. Server:

[2485] It performs user authentication and manages the dialogue in cooperation with the dialogue generation engine.

[2486] The software used includes database management systems (MySQL and PostgreSQL) and generative AI models (e.g., GPT-3).

[2487] 2. Terminal:

[2488] A device (smartphone, tablet, PC) that allows users to interact directly.

[2489] It provides a user interface, sends user input to the server, and displays replies from the server to the user.

[2490] 3. Dialogue generation engine:

[2491] Use a generative AI model (e.g., GPT-3) to generate natural-looking dialogue based on user input.

[2492] Operational Overview

[2493] The system works as follows:

[2494] User Registration and Login

[2495] 1. The user enters their ID and password on the login screen.

[2496] 2. The device sends this information to the server, which then authenticates the user.

[2497] 3. If the authentication is successful, the server sends an authentication success message to the terminal, and the terminal displays "Login successful" to the user.

[2498] Start a dialogue

[2499] 1. The user clicks the "Start conversation" button.

[2500] 2. The device sends this request to the server.

[2501] 3. The server starts the dialogue generation engine and generates the initial greeting message.

[2502] 4. The server sends the generated greeting message to the terminal, which displays it to the user.

[2503] Continuing the dialogue

[2504] 1. When the user replies to the AI's message, the device sends the message to the server.

[2505] 2. The server passes this message to the dialogue generation engine, which generates an appropriate reply.

[2506] 3. The server generates a reply and sends it to the device, which displays it to the user.

[2507] Conversations about topics that interest you

[2508] 1. A user requests to "talk about travel."

[2509] 2. The device sends the request to the server.

[2510] 3. The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[2511] 4. The server sends the generated message to the terminal, which displays it to the user.

[2512] Providing stories and humor

[2513] 1. The user requests, "Tell me an interesting story."

[2514] 2. The device sends the request to the server.

[2515] 3. The server instructs the dialogue generation engine to generate messages that include story and humorous elements.

[2516] 4. The server sends the generated message to the terminal, which displays it to the user.

[2517] Examples of prompt statements

[2518] The following is an example of a prompt that may be entered into the system:

[2519] 1. Login prompt:

[2520] Please enter your user ID and password.

[2521] 2. Prompt at the beginning of the dialogue:

[2522] Start a dialogue: What do you want to talk about?

[2523] 3. Travel topic request prompt:

[2524] I want to talk about travel.

[2525] 4. Humor requests prompt:

[2526] Please tell me an interesting story.

[2527] Through the above-mentioned components and operations, the system is designed to enable elderly people to enjoy everyday interactive experiences and reduce feelings of loneliness.

[2528] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2529] Program processing steps

[2530] Step 1: User Registration and Login

[2531] 1. The user enters their ID and password on the login screen.

[2532] Input: The user enters their ID and password into the login form.

[2533] Output: Login information is sent to the terminal.

[2534] 2. The device sends the entered login information to the server.

[2535] Input: The login information entered by the user.

[2536] Output: The input information is encrypted and sent to the server.

[2537] 3. The server verifies the login information and authenticates the user.

[2538] Input: The login information received by the server.

[2539] Processing: Authenticate the user by checking against the user information in the database.

[2540] Output: Generates a message indicating authentication success or failure.

[2541] 4. The server sends an authentication success message to the terminal.

[2542] Input: Authentication success message.

[2543] Output: A successful authentication message is sent to the terminal.

[2544] 5. The terminal receives the authentication success message and displays a "Login successful" notification to the user.

[2545] Input: Authentication success message.

[2546] Output: A successful login notification is displayed to the user.

[2547] Step 2: Start a conversation

[2548] 1. The user clicks the "Start conversation" button.

[2549] Input: User action (clicking a button).

[2550] Output: A conversation initiation request is generated on the terminal.

[2551] 2. The device sends this request to the server.

[2552] Input: A conversation-initiating request.

[2553] Output: The request is sent to the server.

[2554] 3. The server starts the dialogue generation engine and generates the initial greeting message.

[2555] Input: A conversation-initiating request.

[2556] Processing: The dialogue generation engine generates an initial greeting message based on the prompt sentence.

[2557] Output: Initial greeting message.

[2558] 4. The server sends the generated greeting message to the terminal.

[2559] Input: Initial greeting message.

[2560] Output: A greeting message is sent to the terminal.

[2561] 5. The terminal displays a greeting message to the user.

[2562] Input: A greeting message.

[2563] Output: A greeting message is displayed to the user.

[2564] Step 3: Continue the conversation

[2565] 1. When the user replies to the AI's message, the device sends the message to the server.

[2566] Input: The user's reply message.

[2567] Output: A reply message is sent from the device to the server.

[2568] 2. The server passes the received message to the dialogue generation engine.

[2569] Input: The user's reply message.

[2570] Output: The message is passed to the dialogue generation engine.

[2571] 3. The dialogue generation engine generates an appropriate reply.

[2572] Input: The user's reply message.

[2573] Processing: The dialogue generation engine generates an appropriate reply.

[2574] Output: The generated reply message.

[2575] 4. The server generates a reply and sends it to the terminal, which displays it to the user.

[2576] Input: The generated reply message.

[2577] Output: The reply message is sent to the terminal and displayed to the user.

[2578] Step 4: Talk about topics that interest you

[2579] 1. A user requests to "talk about travel."

[2580] Input: User's request on the topic.

[2581] Output: The request is sent to the device.

[2582] 2. The device sends the request to the server.

[2583] Input: The user request.

[2584] Output: The request is sent to the server.

[2585] 3. The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[2586] Input: The user request.

[2587] Processing: The dialogue generation engine generates information and questions related to the topic.

[2588] Output: The information or question generated.

[2589] 4. The server sends the generated message to the terminal, which displays it to the user.

[2590] Input: Generated information or question.

[2591] Output: Messages are sent to the terminal and displayed to the user.

[2592] Step 5: Provide a story and humor

[2593] 1. The user requests, "Tell me an interesting story."

[2594] Input: The user request.

[2595] Output: The request is sent to the device.

[2596] 2. The device sends the request to the server.

[2597] Input: The user request.

[2598] Output: The request is sent to the server.

[2599] 3. The server instructs the dialogue generation engine to generate messages that include story and humorous elements.

[2600] Input: The user request.

[2601] Processing: The dialogue generation engine generates messages that include story and humorous elements.

[2602] Output: The generated story message.

[2603] 4. The server sends the generated message to the terminal, which displays it to the user.

[2604] Input: The generated story message.

[2605] Output: Messages are sent to the terminal and displayed to the user.

[2606] Step 6: Ending the conversation

[2607] 1. If the user wants to end the conversation, he clicks the "End conversation" button.

[2608] Input: User action (clicking a button).

[2609] Output: A termination request is generated on the terminal.

[2610] 2. The device notifies the server of the request.

[2611] Input: The conversation termination request.

[2612] Output: The request is sent to the server.

[2613] 3. The server ends the session with the dialogue generation engine.

[2614] Input: The conversation termination request.

[2615] Action: Ends the session with the dialogue generation engine.

[2616] Output: Session termination message.

[2617] 4. The server sends a session termination message to the terminal, which displays it to the user.

[2618] Input: Session termination message.

[2619] Output: Messages are sent to the terminal and displayed to the user.

[2620] (Application example 1)

[2621] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2622] In order to reduce the sense of loneliness felt by the elderly and to help them live their daily lives more safely and comfortably, a wide range of support is required, including not only simple dialogue but also assistance in emergencies and the management of daily tasks. However, conventional dialogue systems lack the functionality to comprehensively address these diverse needs. Therefore, there is a need for a system that not only alleviates the sense of loneliness for the elderly but also provides integrated support for assistance in emergencies and the management of daily tasks.

[2623] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2624] In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen to the authenticated user, means for receiving a dialogue start request from the user and activating a dialogue generation engine, means for displaying an initial greeting message generated by the dialogue generation engine to the user, means for receiving a message from the user and for the dialogue generation engine to generate an appropriate reply based on the message, means for displaying the generated reply to the user, means for the user to send a request for assistance in an emergency and make an emergency call, means for the user to send a request to set a reminder for a specific task and set the reminder, and means for conducting daily health checks and recording the results. This makes it possible to reduce the elderly's sense of loneliness while providing centralized support for emergency assistance and managing daily tasks.

[2625] 1. "Elderly" generally refers to the population aged 65 and over who require special care and support due to physical and mental changes that occur with aging.

[2626] 2. "Loneliness" refers to the loneliness and anxiety that arise from being alone due to a weakening of social connections with others.

[2627] 3. "Dialogue generation engine" refers to a system consisting of algorithms and software for conducting natural conversations based on user input.

[2628] 4. "System" refers to a technical configuration in which multiple means or elements work together to achieve a specific purpose.

[2629] 5. "User" means an individual who uses the System and enjoys its interaction and other features.

[2630] 6. "Login Information" means the authentication information required for a user to access the system, and usually consists of an ID and password.

[2631] 7. "Authentication" means the process of verifying that the login information provided belongs to the registered user.

[2632] 8. "Screen" refers to the interface displayed on a terminal, enabling interaction and operation between the user and the system.

[2633] 9. "Message" means text data exchanged during a conversation.

[2634] 10. A "request" is an action taken by a user to request a specific action or information from a system.

[2635] 11. "Emergency Call" refers to a means of communication to request assistance in an emergency.

[2636] 12. "Reminder" is a function that notifies users of tasks or events that they have set.

[2637] 13. "Health Check" is the process of checking the user's daily health status and recording the results.

[2638] 14. "Multi-faceted support" refers to a wide range of assistance to address different types of needs and requirements.

[2639] The present invention is a system that reduces feelings of loneliness among elderly people and provides integrated support for emergency assistance and daily task management. This system uses a dialogue generation engine to provide natural dialogue with the user, and also combines emergency call functions, reminder setting, and health check functions. Specific embodiments for implementing the present invention are described below.

[2640] System configuration

[2641] The system mainly consists of the following elements:

[2642] 1. Server: Responsible for user authentication, managing the dialogue generation engine, and storing dialogue data.

[2643] 2. Terminal: A device (e.g., smartphone, tablet, or PC) that is directly operated by the user and provides the user interface.

[2644] 3. User: An individual who interacts with the system, primarily targeted at elderly people.

[2645] 4. Dialogue generation engine: Consists of algorithms and software that generate appropriate dialogue in response to user input.

[2646] Detailed System Operation

[2647] 1. User Registration and Login

[2648] The user accesses the system's login screen and enters their ID and password. The terminal sends the entered login information to the server, which then verifies and authenticates the login information. If authentication is successful, an authentication success message is sent to the terminal.

[2649] 2. Start a dialogue

[2650] When the user clicks the dialogue start button, the terminal sends this request to the server. The server starts the dialogue generation engine and generates the initial greeting message. This message is sent to the terminal and displayed to the user.

[2651] 3. Continuing the dialogue

[2652] When a user replies to a message from the AI, the device sends the message to the server, which passes the message to the dialogue generation engine, which generates an appropriate reply. The reply is then sent to the device and displayed to the user.

[2653] 4. Emergency call function

[2654] When a user needs assistance in an emergency, they send an emergency call request, which the device sends to the server, which then makes the emergency call.

[2655] 5. Reminder Settings

[2656] A user can send a request to set a reminder for a particular task, and the device will send the request to the server, which will set the reminder.

[2657] 6. Health Check

[2658] The user is asked questions to check their health condition every day. The user's answers are sent from the device to the server, and the results are recorded.

[2659] Technology used

[2660] Hardware: Using a smartphone or robot as the primary device.

[2661] Software: Dialogue generation is performed using OpenAI's GPT-3 model. Server-side programs are often implemented in Python.

[2662] Specific examples

[2663] Examples of everyday conversations:

[2664] User: "What's the weather like these days?"

[2665] System response: "I want to talk about the weather."

[2666] Example of a story:

[2667] User: "Tell me a funny story."

[2668] System response: "Tell us a funny story."

[2669] This system will enable elderly people to reduce their sense of loneliness while providing centralized support for emergency assistance and managing daily tasks.

[2670] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2671] Step 1:

[2672] The user accesses the system's login screen and enters their ID and password. The entered login information is sent by the terminal to the server. The server receives the user's login information (ID and password) and performs authentication by checking it against a database. If authentication is successful, the server generates an authentication success message and sends it to the terminal. The terminal displays the received authentication success message to the user.

[2673] Step 2:

[2674] The user clicks the dialogue start button. The terminal sends this request to the server. The server starts the dialogue generation engine and generates the first greeting message. The generated greeting message is sent to the terminal, which displays it to the user. Based on the user's input (dialogue start instruction), the system starts the dialogue process.

[2675] Step 3:

[2676] When the user replies to the AI's message, the device sends the message to the server. The server passes the received message to the dialogue generation engine, which generates an appropriate reply. The generated reply message is sent from the server to the device, which displays it to the user.

[2677] Step 4:

[2678] When a user needs assistance in an emergency, they input an emergency call request. The device sends the request to the server. The server receives the emergency call request and notifies the pre-configured emergency contacts. The server generates a call completion message and sends it to the device. The device displays this message to the user.

[2679] Step 5:

[2680] The user sends a request to set a reminder for a specific task. The device sends this request to the server. The server receives the request and sets the reminder for the specified date and time. A message indicating the completion of the setting is sent from the server to the device and displayed to the user.

[2681] Step 6:

[2682] Questions for daily health checks are sent from the server to the terminal. The terminal displays the questions to the user, who answers them. The terminal sends the answers to the server, which records the answers in a database. The server generates a recording completion message and sends it to the terminal. The terminal displays this message to the user.

[2683] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2684] The present invention provides a system that combines a dialogue generation engine with an emotion engine that recognizes the user's emotions in order to reduce the sense of loneliness felt by elderly people and provide a fulfilling dialogue experience. Specific embodiments for carrying out the present invention will be described below.

[2685] System configuration

[2686] The system mainly consists of the following elements:

[2687] 1. Server: Responsible for user authentication, managing the dialogue generation engine and emotion engine, and storing dialogue data.

[2688] 2. Terminal: A device (e.g., smartphone, tablet, or PC) that is directly operated by the user and provides the user interface.

[2689] 3. Users: Individuals who interact with the system, primarily elderly people, are the main target.

[2690] 4. Dialogue generation engine: Consists of algorithms and software that generate appropriate dialogue based on user input.

[2691] 5. Emotion Engine: Consists of algorithms and software for recognizing emotions from user input and responses and adjusting the output of the dialogue generation engine based on those emotions.

[2692] Program processing

[2693] The program does the following:

[2694] 1. User Registration and Login:

[2695] A user accesses the system and enters their ID and password on the login screen.

[2696] The device sends the login information to the server.

[2697] The server checks the login information and authenticates the user. If authentication is successful, it sends a message of authentication success and the user's profile information to the terminal.

[2698] 2. Start a conversation:

[2699] The user clicks the Start Interaction button.

[2700] The terminal sends a dialogue initiation request to the server.

[2701] The server starts the dialogue generation engine and generates the initial greeting message.

[2702] The server sends the generated greeting message to the terminal, which displays it to the user.

[2703] 3. Continuing the dialogue:

[2704] The user types a reply to the greeting message.

[2705] The terminal sends the user's input message to the server.

[2706] The server passes the message from the user to the emotion engine, which analyzes the user's emotions.

[2707] The emotion engine sends the analysis results to the server.

[2708] The server passes the emotion engine's analysis results and the user's message to the dialogue generation engine, which then generates an appropriate reply.

[2709] The server sends the generated reply to the terminal, which displays it to the user.

[2710] 4. Conversations about topics that interest you:

[2711] A user requests to talk about a specific topic, such as "I want to talk about travel."

[2712] The device sends a request to the server.

[2713] The server passes the request to a dialogue generation engine, which generates information and questions related to the topic.

[2714] The server sends the generated topic-related messages to the terminal, which displays them to the user.

[2715] 5. Providing stories and humor:

[2716] A user sends a request such as "Tell me a funny story."

[2717] The device sends a request to the server.

[2718] The server passes the request to a dialogue generation engine, which generates messages containing story and humorous elements.

[2719] The server sends the generated message to the terminal, which displays it to the user.

[2720] 6. Ending the conversation:

[2721] The user clicks the "End conversation" button to end the conversation.

[2722] The terminal notifies the server of the request.

[2723] The server terminates the session with the dialogue generation engine and emotion engine, and sends a session termination message to the terminal.

[2724] The terminal displays a session termination message to the user.

[2725] Specific examples

[2726] Example 1: Logging in and starting a conversation

[2727] 1. The user enters their ID and password on the login screen.

[2728] 2. The server checks the entered information and performs authentication. If authentication is successful, an authentication success message and profile information are sent to the device.

[2729] 3. The terminal displays the dialogue start screen and displays a greeting message from the dialogue generation engine to the user, such as "Hello, what would you like to talk about today?"

[2730] Example 2: Travel topics

[2731] 1. User types, "I want to talk about travel."

[2732] 2. The server passes the request to the dialogue generation engine.

[2733] 3. The dialogue generation engine generates a message related to the topic, such as "Where have you traveled recently and where would you like to go?" and sends it to the device via the server.

[2734] 4. The device displays the message to the user, and the user enjoys talking about their travel memories and plans.

[2735] Example 3: Providing humor and sentiment analysis

[2736] 1. The user requests, "Tell me an interesting story."

[2737] 2. The server sends the request to the dialogue generation engine.

[2738] 3. The dialogue generation engine generates a humorous story such as "One day, an elephant came into the restaurant..." and sends it to the device via the server.

[2739] 4. The server passes the humor message to the emotion engine, which analyzes the user's reaction.

[2740] 5. The emotion engine notifies the dialogue generation engine and the server of the analysis results, which are reflected in the next message.

[2741] 6. The user reads an entertaining story and the next dialogue is tailored based on their emotions.

[2742] As described above, the present invention specifically shows a system configuration and processing method for reducing the sense of loneliness felt by elderly people and providing them with a rich conversation experience.

[2743] The processing flow will be explained below.

[2744] Step 1:

[2745] A user accesses the system and enters their ID and password on the login screen.

[2746] Step 2:

[2747] The terminal sends the entered login information to the server.

[2748] Step 3:

[2749] The server receives the login information and authenticates the user against a database.

[2750] Step 4:

[2751] The server sends the authentication result to the terminal. If authentication is successful, it sends a success message and profile information. If authentication is unsuccessful, it sends an error message.

[2752] Step 5:

[2753] The terminal receives a message that authentication was successful and displays the start screen of the dialogue to the user. If authentication failed, an error message is displayed to the user.

[2754] Step 6:

[2755] The user clicks the Start Interaction button.

[2756] Step 7:

[2757] The terminal sends a dialogue initiation request to the server.

[2758] Step 8:

[2759] The server starts the dialogue generation engine and generates the initial greeting message.

[2760] Step 9:

[2761] The server sends the generated greeting message to the terminal.

[2762] Step 10:

[2763] The terminal displays a greeting message to the user.

[2764] Step 11:

[2765] The user types a reply to the greeting message.

[2766] Step 12:

[2767] The terminal sends the user's input to the server.

[2768] Step 13:

[2769] The server passes a message from the user to the emotion engine, which then recognizes the user's emotion.

[2770] Step 14:

[2771] The emotion engine transmits the recognized emotion information to the server.

[2772] Step 15:

[2773] The server passes the emotion information and the user's message to the dialogue generation engine, which then generates an appropriate reply.

[2774] Step 16:

[2775] The server sends the generated reply to the terminal.

[2776] Step 17:

[2777] The terminal displays the reply to the user.

[2778] Step 18:

[2779] A user submits a request to talk about a specific topic (e.g., they want to talk about travel).

[2780] Step 19:

[2781] The device sends a topic request to the server.

[2782] Step 20:

[2783] The server passes the topic request to a dialogue generation engine, which generates information and questions related to the topic.

[2784] Step 21:

[2785] The server sends the generated topic-related message to the terminal.

[2786] Step 22:

[2787] The terminal displays topic-related messages to the user.

[2788] Step 23:

[2789] The user requests humorous or entertaining stories, such as "tell me a funny story."

[2790] Step 24:

[2791] The terminal sends this request to the server.

[2792] Step 25:

[2793] The server passes the request to a dialogue generation engine, which generates a message containing humorous elements.

[2794] Step 26:

[2795] The server sends the generated humor message to the terminal.

[2796] Step 27:

[2797] The terminal displays the humorous message to the user.

[2798] Step 28:

[2799] The server passes the humor message to an emotion engine, which analyzes the user's reaction.

[2800] Step 29:

[2801] The emotion engine sends the analysis results to the server and the dialogue generation engine.

[2802] Step 30:

[2803] The dialogue generation engine adjusts the next reply based on the emotional information from the emotion engine.

[2804] Step 31:

[2805] The user clicks the "End conversation" button to end the conversation.

[2806] Step 32:

[2807] The terminal notifies the server of a request to terminate the conversation.

[2808] Step 33:

[2809] The server terminates the session with the dialogue generation engine and emotion engine, and sends a session termination message to the terminal.

[2810] Step 34:

[2811] The terminal displays a session termination message to the user.

[2812] Example 2

[2813] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2814] Elderly people often feel lonely in their daily lives, and this can be a serious problem, especially if they spend a lot of time alone. Current technology does not provide sufficient methods to alleviate this loneliness and provide a richer interactive experience. Therefore, new systems are needed to help seniors avoid feeling lonely.

[2815] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2816] In this invention, the server includes means for receiving login information from a user and performing authentication, means for displaying a dialogue start screen to the authenticated user, and means for displaying an initial greeting message generated by the dialogue generation engine to the user. This allows elderly people to use the system easily and provides a dialogue experience that begins naturally from the very beginning.

[2817] The server further includes means for receiving a message from the user and for the dialogue generation engine to generate an appropriate reply based on the message, means for analyzing the user's emotions using the emotion engine, and means for the dialogue generation engine to generate an appropriate response based on the analysis result of the emotion engine. This enables a highly personalized dialogue according to the user's emotions, thereby improving the effect of reducing loneliness among the elderly.

[2818] "User" refers to an individual who interacts with the system, and is primarily targeted at elderly people.

[2819] "Login information" refers to authentication information such as ID and password entered by a user when accessing the system.

[2820] "Authentication" refers to the process of verifying the login information entered by a user and granting access to a system.

[2821] The "interaction start screen" is the first screen that is displayed after a user has been authenticated by the system, and provides an interface for starting an interaction.

[2822] "Dialogue generation engine" refers to algorithms and software that automatically generate appropriate dialogue messages based on input from a user.

[2823] The "initial greeting message" refers to the first message generated by the dialogue generation engine and displayed to the user at the start of a dialogue.

[2824] "Emotion Engine" refers to algorithms and software for recognizing emotions from user input and responses and adjusting the output of the dialogue generation engine based on those emotions.

[2825] "Analysis results" refers to the emotional information that the emotion engine obtains from the user's input, and affects the output of the dialogue generation engine.

[2826] An "appropriate reply" refers to a response message generated by the dialogue generation engine based on the user's input and the analysis results of the emotion engine.

[2827] "System" refers to the entire dialogue system, including the above elements, designed to reduce loneliness among the elderly.

[2828] This invention is a dialogue system designed to alleviate loneliness, especially among the elderly, and provide a rich dialogue experience. The system mainly consists of a server, a terminal, a generative AI model (a dialogue generation engine and an emotion engine), and a user.

[2829] System configuration

[2830] The system includes the following elements:

[2831] 1. Server: Responsible for user authentication, managing the dialogue generation engine and emotion engine, and storing dialogue data.

[2832] 2. Terminal: A device (smartphone, tablet, PC) that is directly operated by the user and provides the user interface.

[2833] 3. Users: Individuals who interact with the system, primarily elderly people, are the main target.

[2834] 4. Dialogue Generation Engine: Algorithms and software that generate appropriate dialogue based on input from the user.

[2835] 5. Emotion Engine: Algorithms and software for recognizing emotions from user input and responses and adjusting the output of the dialogue generation engine based on those emotions.

[2836] Hardware and Software Used

[2837] Server: Uses major cloud service providers (e.g. AWS, Google Cloud).

[2838] Devices: Common iOS devices, Android devices, Windows PCs, and macOS PCs.

[2839] Dialogue generation engine: Natural language processing algorithms (e.g. GPT-3, GPT-4).

[2840] Sentiment engine: Sentiment analysis algorithms (e.g., IBM Watson Tone Analyzer, Microsoft Azure Emotion API).

[2841] Explanation of program processing

[2842] This system performs a series of processes from user login to starting a dialogue, continuing the conversation, analyzing emotions, conducting a conversation based on a theme, and providing humor.

[2843] 1. User Registration and Login:

[2844] A user accesses the system and enters their ID and password on the login screen.

[2845] The device sends this information to the server for authentication. If authentication is successful, the device displays the following screen and the user's profile information.

[2846] 2. Start a conversation:

[2847] The user clicks the Start Interaction button.

[2848] The terminal sends a dialogue start request to the server.

[2849] The server starts a dialogue generation engine, generates an initial greeting message, and sends it to the terminal.

[2850] The terminal displays a greeting message to the user.

[2851] 3. Continuing the dialogue:

[2852] The user enters a message and sends it to the terminal.

[2853] The device sends t...

Claims

1. A system that uses a dialogue generation engine to reduce loneliness among elderly people, means for receiving and authenticating login information from a user; means for displaying a dialogue start screen to an authenticated user; means for receiving a user's request to start a dialogue and launching a dialogue generation engine; means for displaying to the user an initial greeting message generated by the dialogue generation engine; a means for receiving a message from a user and for a dialogue generation engine to generate an appropriate reply based on the message; and means for displaying the generated reply to the user.

2. The system of claim 1 , further comprising means for, when a user requests to discuss a particular topic, passing the request to a dialogue generation engine to generate information and questions related to the topic.

3. The system of claim 1 , further comprising means for, when a user requests humor or a fun story, passing the request to a dialogue generation engine to generate a message containing humorous elements.

Images