system

Abstract

We provide an AI chatbot system that acts as a conversation partner for the elderly and is useful for preventing dementia and assessing risk. [Solution] A system including: a means for inputting user information and creating a user profile based on the user information; a means for displaying virtual characters with various patterns selected by the user and allowing the user to select the virtual character; a means for conducting voice or text-based conversation between the user and the virtual character; a means for analyzing the content of the conversation and evaluating changes in language patterns and themes to determine dementia risk; a means for issuing a warning to the user and displaying a message urging them to seek medical attention if the dementia risk is high; a means for periodically holding conversation events in which multiple users participate and monitoring for slanderous or inappropriate remarks during the events; and a means for notifying caregivers and specialists of important dementia risk data if the user agrees.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Although conversation is known to be effective in preventing dementia in the elderly, elderly people who live alone often lack someone to talk to, making it difficult to prevent or detect dementia early. There is also a lack of methods for early assessment of dementia risk and appropriate response. Furthermore, it is necessary to provide an environment where elderly people can enjoy conversation safely and with ease, and to develop a system for determining the optimal time for consultation. [Means for solving the problem]

[0005] The present invention creates a user profile based on information entered by the user and displays a virtual character with various patterns selected by the user. It also has a function to conduct voice or text-based conversations between the user and the virtual character, analyze the content of the conversation, and evaluate changes in language patterns and themes to determine dementia risk. If the risk is high, a warning is issued to the user and a message urging them to seek medical attention is displayed. Furthermore, the system provides a function to periodically hold conversation events in which multiple users participate, monitor for inappropriate remarks, and, with consent, notify caregivers and specialists of dementia risk data.

[0006] "User information" refers to information about a user, such as the individual's name, age, gender, hobbies, and preferences.

[0007] "User Profile" refers to a collection of information specific to an individual user that is created based on User Information.

[0008] "Virtual character" refers to a character that appears in a digital environment and converses with the user.

[0009] "Voice or text-based conversation" refers to a form of communication that takes place through voice input or text input.

[0010] "Language patterns" refer to the consistency and characteristics of vocabulary and expressions used during conversation.

[0011] A "change in topic" refers to a shift in conversation from one topic to another.

[0012] "Dementia risk" refers to the likelihood that a user will develop dementia.

[0013] "Messages that warn and encourage medical attention" refers to messages that alert users and encourage them to seek a diagnosis from a specialist.

[0014] A "conversation event" refers to an opportunity for multiple users to participate in a group conversation conducted through virtual characters.

[0015] "Monitoring inappropriate comments" refers to the act of monitoring whether or not abusive or offensive comments occur in conversations.

[0016] "Caregiver" refers to a person who is responsible for supporting the life and well-being of a client.

[0017] "Specialist" refers to a physician with medical knowledge and specialized skills. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11]FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] This invention is an AI chatbot system that acts as a conversation partner for elderly people and is useful for preventing dementia and assessing their risk. Specifically, the system aims to prevent dementia by creating a profile based on user information and engaging in conversations through a virtual character selected by the user. The system also analyzes conversation content to assess dementia risk, and if the risk is high, issues a warning and encourages the user to see a specialist. Furthermore, it provides a mechanism for hosting conversation events with multiple users and monitoring inappropriate comments.

[0040] System configuration

[0041] This system mainly consists of a server and a terminal (user device). The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback.

[0042] Program processing flow and specific examples

[0043] 1. User Registration

[0044] Users access the system through their terminals and perform initial registration. They enter information such as their name, age, gender, and hobbies and preferences. This information is sent from the terminal to the server, which then stores it in a database to create a user profile. For example, if a user enters "Taro Tanaka, 70 years old, male, likes music," the server stores this information in the database.

[0045] 2. AI avatar selection

[0046] The user accesses the AI ​​avatar selection screen using the device. The server provides various AI avatar patterns (age, gender, hobbies, etc.) to the device, and the user selects the desired avatar. For example, if the user selects a "female, 50-year-old, music-loving avatar," the server associates that avatar with the user profile.

[0047] 3. Starting everyday conversations

[0048] The user speaks to the AI ​​avatar through the device. The server receives the user's voice or text input, analyzes it, and generates an appropriate response. The server then sends the response to the device, which then relays it to the user via voice or text. For example, if the user asks, "What's the weather like today?" the server retrieves the weather information and responds, "It's sunny today, and the temperature is 25 degrees."

[0049] 4. Dementia risk assessment

[0050] The server periodically analyzes the user's conversation data and assesses their dementia risk based on changes in language patterns and themes. If the risk is determined to be high, the server sends a warning to the device and displays a notification urging them to see a specialist. For example, if a user has recently been repeating the same topics with little change in themes, the server will notify them, "Your risk of dementia may be increasing. We recommend that you see a specialist."

[0051] 5. Hosting community events

[0052] The server periodically plans and holds conversation events with other users. The device notifies the user of the event information, and the user can participate if they wish. During the event, the server monitors the conversation content and checks for slanderous or inappropriate comments. For example, a "music lovers' gathering" event can be held, providing a forum for discussing various music topics.

[0053] 6. Notification to family and specialists

[0054] The server will be configured to notify important dementia risk data to family members and specialists only if the user agrees. If the risk assessment is high, the server will automatically generate a notification message, which will be displayed to the user on their device and will also be sent to family members and specialists. For example, if a user is judged to be at "high risk," the server will send a notification stating, "Taro Tanaka's dementia risk is increasing."

[0055] In this way, this system provides an environment where elderly people can prevent dementia and manage their risk while enjoying everyday conversations.

[0056] The processing flow will be explained below.

[0057] User Registration

[0058] Step 1:

[0059] The user accesses the system's registration screen using a terminal and enters personal information such as name, age, sex, hobbies and preferences.

[0060] Step 2:

[0061] The terminal transmits the input information to the server.

[0062] Step 3:

[0063] The server stores the received information in a database and creates a user profile.

[0064] Step 4:

[0065] The server sends a notification to the terminal indicating that the user registration is complete.

[0066] Step 5:

[0067] The terminal displays a registration completion notice to the user.

[0068] AI avatar selection

[0069] Step 1:

[0070] The user uses the device to access the AI ​​avatar selection screen.

[0071] Step 2:

[0072] The server sends available AI avatar information from the database to the terminal.

[0073] Step 3:

[0074] The terminal displays the AI ​​avatar information received from the server to the user.

[0075] Step 4:

[0076] The user selects the desired AI avatar.

[0077] Step 5:

[0078] The terminal transmits the selected AI avatar information to the server.

[0079] Step 6:

[0080] The server associates the selected avatar with a user profile and stores the associated information in a database.

[0081] Starting everyday conversations

[0082] Step 1:

[0083] Users speak to an AI avatar through their device.

[0084] Step 2:

[0085] The terminal converts the user's voice input into text and sends the text to the server.

[0086] Step 3:

[0087] The server analyzes the received text and retrieves information from a database to generate an appropriate response.

[0088] Step 4:

[0089] The server sends the generated response in text format to the terminal.

[0090] Step 5:

[0091] The terminal synthesizes the text into speech and conveys the response to the user.

[0092] Dementia risk assessment

[0093] Step 1:

[0094] The server periodically scans the user's past conversation data and runs algorithms that detect specific language patterns.

[0095] Step 2:

[0096] The server assesses dementia risk by assessing changes in language patterns and themes.

[0097] Step 3:

[0098] If the server determines that the risk is high, it generates a warning message based on the evaluation results.

[0099] Step 4:

[0100] The server sends a warning message to the terminal and displays a notice urging the user to see a specialist.

[0101] Step 5:

[0102] The terminal displays a warning message to the user.

[0103] Hosting community events

[0104] Step 1:

[0105] The server periodically plans conversation events with other users and generates detailed information about them.

[0106] Step 2:

[0107] The server transmits detailed information about the event to the terminal.

[0108] Step 3:

[0109] The terminal notifies the user of the event information and confirms whether the user wishes to participate.

[0110] Step 4:

[0111] The user notifies the server of his / her intention to participate through the terminal.

[0112] Step 5:

[0113] The server assigns participating users to chat rooms for the event and generates link information therefor.

[0114] Step 6:

[0115] The terminal connects the user to the chat room through a link at the start of the event.

[0116] Step 7:

[0117] The server monitors the conversations during the event to check for any abusive or inappropriate comments.

[0118] Notification to family and specialists

[0119] Step 1:

[0120] If the user has given their consent, the server will configure the system to notify family members and specialists of important dementia risk data.

[0121] Step 2:

[0122] The server automatically generates a notification message if the risk assessment is high.

[0123] Step 3:

[0124] The server transmits the generated notification message to the terminal and sets it so that the notification is also sent to the user.

[0125] Step 4:

[0126] The terminal displays a notification to the user and simultaneously sends notifications to family members and specialists.

[0127] These are the specific processing steps. This will enable elderly people to enjoy daily conversations with AI avatars while also helping to prevent dementia and manage their risk.

[0128] Example 1

[0129] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0130] The elderly population is increasing in modern society, making the prevention and early detection of dementia an important issue. However, many elderly people tend to be isolated from their daily lives, and opportunities for conversation decrease, which may increase their risk of dementia. In addition, there are limited means to assess the risk of dementia early and take appropriate measures, so detection is often delayed. Furthermore, a system is needed to facilitate communication between elderly people and to prevent inappropriate remarks.

[0131] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0132] In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select a virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for analyzing the content of the conversation and evaluating changes in language patterns and themes to determine dementia risk; means for issuing a warning to the user and displaying a message urging the user to seek medical attention if the dementia risk is high; means for periodically holding conversation events in which multiple users participate and monitoring for slanderous or inappropriate comments during the events; means for notifying caregivers and specialists of important dementia risk data if the user consents; means for converting the user's voice input into text data, generating appropriate response data using natural language processing technology, and transmitting the response data to the user; and means for monitoring the content of the conversations in real time during conversation events and detecting slanderous or inappropriate comments using specific keywords as triggers. This enables elderly people to prevent dementia and manage their risk while enjoying daily conversations.

[0133] "User information" refers to personal data such as name, age, gender, hobbies and preferences that users enter into the system.

[0134] "User Profile" means a database record about an individual user that the system creates based on user information.

[0135] A "virtual character" is a digital character that the system displays and that has a variety of patterns that the user can select.

[0136] "Voice or text-based conversation" refers to a dialogue between a user and a virtual character using voice or text input.

[0137] "Conversation content" refers to the content of the audio or text exchanges that take place between the user and the virtual character.

[0138] A "language pattern" is a specific pattern of words and expressions used in conversational content.

[0139] A "change in topic" is a change in how the topic shifts in the content of a conversation.

[0140] "Dementia risk" is an index that evaluates the possibility that a user will develop dementia.

[0141] "Slander" is the act of insulting or speaking ill of others.

[0142] "Inappropriate remarks" are remarks that are socially unacceptable or that offend others.

[0143] "Natural language processing technology" is a technology that allows computers to understand and analyze human language.

[0144] A "generative AI model" is a model for automatically generating text data using artificial intelligence.

[0145] This invention is an AI chatbot system that acts as a conversation partner for elderly people and is useful for preventing dementia and assessing their risk. Specifically, the system aims to prevent dementia by creating a profile based on user information and engaging in conversations through a virtual character selected by the user. The system also analyzes conversation content to assess dementia risk, and if the risk is high, issues a warning and encourages the user to see a specialist. Furthermore, it provides a mechanism for hosting conversation events with multiple users and monitoring inappropriate comments.

[0146] The system primarily consists of a server and a terminal (user device). The terminal receives user input, and the server analyzes and stores that information and provides appropriate feedback. The server uses a high-performance database system and natural language processing (NLP) technology, utilizing generative AI models (such as GPT-4 (registered trademark)). The server also analyzes conversation data and runs algorithms to detect language patterns and thematic shifts.

[0147] As a specific example of operation, consider a scenario in which a user initially registers with the system. First, the user enters information such as name, age, gender, and hobbies and preferences. This information is sent from the device to the server, which stores it in a database and creates a user profile. The user then accesses a virtual character selection screen and selects the desired avatar. The server associates that avatar with the user profile.

[0148] Next, an everyday conversation takes place between the user and the virtual character. When the user asks, "What's the weather like today?", the server converts the voice data into text and analyzes it using NLP technology. The generative AI model then generates a response, and the server sends the appropriate response, "It's sunny today, and the temperature is 25 degrees," to the device and tells the user.

[0149] Furthermore, the server periodically analyzes conversation data to detect changes in language patterns and themes to assess dementia risk. If the risk increases, a warning will be issued on the device, displaying a message saying, "You may be at increased risk of dementia. We recommend that you seek medical advice from a specialist."

[0150] The server also periodically plans and holds conversation events with other users. The device notifies the user of the event information, and the user can participate if they wish. During the event, the server monitors the conversation in real time to check for slanderous or inappropriate comments.

[0151] Finally, if the user agrees, the server configures the system to notify family members and specialists of important dementia risk data. If the risk assessment is high, the server sends an automatically generated notification message to family members and specialists.

[0152] Examples of prompts include:

[0153] "Register as Taro Tanaka, 70 years old, male, and music lover, and select a 50-year-old female avatar who also loves music. Talk to that avatar and ask, 'How's the weather today?'"

[0154] "Use the conversation to determine dementia risk and find out how you will be notified if you are at high risk."

[0155] "Attend community events and see what conversations happen."

[0156] As described above, this system provides an environment where elderly people can prevent dementia and manage their risk while enjoying everyday conversations.

[0157] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0158] Step 1: User Registration

[0159] 1.1 Users access the system through a terminal. Users input personal information such as name, age, gender, hobbies, and preferences into a form.

[0160] 1.2 The device sends the information entered by the user to the server. The information is sent to the server as an HTTP POST request.

[0161] 1.3 The server validates the received input data and stores it in the database. Specifically, the server creates a new user profile in the database and stores the input data.

[0162] 1.4 The server returns a confirmation message to the terminal indicating that the save was completed successfully. The terminal displays this message on the screen to notify the user that the registration has been completed.

[0163] Step 2: Select an AI avatar

[0164] 2.1 The user uses a device to access the AI ​​avatar selection screen, which displays a list of various virtual characters.

[0165] 2.2 The server provides the terminal with an avatar list, which includes various pre-designed character attributes (e.g., age, gender, hobbies, etc.).

[0166] 2.3 The user selects the desired avatar, and the device sends the selection information to the server as an HTTP POST request.

[0167] 2.4 The server associates the received avatar information with the user profile and stores it in a database. The server then sends a confirmation message back to the device indicating that the association is complete.

[0168] 2.5 The device will display a confirmation message on the screen to notify the user that the avatar selection is complete.

[0169] Step 3: Starting everyday conversations

[0170] 3.1 The user speaks to the AI ​​avatar through the device, and questions and conversation content are entered into the device as voice input or text input.

[0171] 3.2 The device converts the voice input into text data and sends it to the server. The voice data is converted into text data using voice recognition technology.

[0172] 3.3 The server analyzes the received text data using natural language processing (NLP) technology. Specifically, the server uses a generative AI model (e.g., GPT-4) to understand the user's intent and generate an appropriate response.

[0173] 3.4 The server sends the generated response data to the device, which then displays the received data as text or outputs it as voice using speech synthesis technology.

[0174] 3.5 The device will then relay the response to the user, allowing them to continue the conversation. If the user says, "What's the weather like today?", the device will display the response, "It's sunny today, and the temperature is 25 degrees."

[0175] Step 4: Dementia risk assessment

[0176] 4.1 The server periodically collects and stores user conversation data, which is then stored in a database.

[0177] 4.2 The server analyzes the collected conversation data to detect shifts in language patterns and themes. It uses a generative AI model to identify shifts in language patterns and repetition of the same topics.

[0178] 4.3 The server evaluates dementia risk based on the analysis results and calculates a risk score. If the risk score is high, a warning flag is raised.

[0179] 4.4 If the risk assessment is high, the server sends a warning message to the device, which displays the message "You may be at increased risk of dementia. We recommend that you consult a specialist."

[0180] Step 5: Host a community event

[0181] 5.1 The server periodically plans and schedules conversation events, and the event information is stored in a database.

[0182] 5.2 The device notifies the user of event information. Notifications are provided as push messages.

[0183] 5.3 If the user wishes to participate, the device sends a notification to the server, and the user taps the "Join" button on the screen.

[0184] 5.4 During the event, the server will monitor conversations in real time, using generative AI models to detect abusive or inappropriate language.

[0185] 5.5 If the server detects inappropriate comments, it will send a warning message to the device, which will be displayed to all event participants.

[0186] Step 6: Notify family and specialists

[0187] 6.1 If the user agrees, the server will configure the notification of risk data to family members and specialists. The configuration information will be stored in the database.

[0188] 6.2 If the server determines that the person is at high risk, it automatically generates a notification message, such as "Taro Tanaka's risk of dementia is increasing."

[0189] 6.3 The server sends the generated notification message to the user's family or specialist. The notification is sent as an email or push notification.

[0190] 6.4 The device will display and allow the user to acknowledge that a notification has been sent. The screen will display the message "Notification sent."

[0191] (Application example 1)

[0192] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0193] In addition to preventing dementia and assessing risk in the elderly, there is a need for a system that integrates safety confirmation and work progress confirmation for elderly workers in factories. However, currently these functions are independent, and there is no system in place for elderly workers to receive dementia risk assessments or psychological support through conversations during their daily work. This could lead to a decrease in the work efficiency of elderly workers in factories and an increase in safety risks.

[0194] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0195] In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select the virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for analyzing the content of the conversation and evaluating changes in language patterns and themes to determine dementia risk; means for issuing a warning to the user and displaying a message urging the user to seek medical attention if the dementia risk is high; means for periodically hosting conversation events in which multiple users participate and monitoring for defamatory or inappropriate comments during the events; means for notifying caregivers or specialists of important dementia risk data if the user consents; and interface means for conducting conversations with elderly workers in factories and supporting safety and work progress checks. This enables elderly workers to enjoy daily conversations while preventing dementia and managing risks, and further improves the safety and efficiency of work in factories.

[0196] "User information" refers to basic personal attribute information about system users (e.g., name, age, gender, hobbies and preferences).

[0197] A "user profile" is an individual information record created based on user information, including conversation content and system usage.

[0198] A "virtual character" is a purposefully created digital persona or avatar with which a user chooses to interact.

[0199] "Voice or text-based conversation" means a method of communication between a user and a virtual character, including both voice and text input.

[0200] "Changes in language patterns and themes" refers to the patterns of words used and changes in topics during conversation, and are indicators for assessing dementia risk.

[0201] "Dementia risk" is a numerical value or assessment result used to evaluate the likelihood that a user will develop dementia.

[0202] A "warning message urging a visit to a doctor" is a notification sent to users when they are at high risk of dementia, and includes content urging them to visit a specialist.

[0203] A "conversation event" is a gathering of multiple users to discuss a specific topic, and is a regularly held online or offline event.

[0204] "Means for monitoring abusive and inappropriate comments" refers to technology for monitoring comments made by users during conversation events and detecting abusive and inappropriate comments.

[0205] "Important dementia risk data" refers to important information obtained as a result of dementia risk assessment, which is used to manage the user's health status by informing caregivers and specialists.

[0206] "Caregivers and specialists" are professionals who are responsible for managing the health of users and providing medical care.

[0207] An "interface means" is a physical or digital medium through which a user directly interacts with a system.

[0208] An "interface means for communicating with elderly workers in a factory and assisting in checking safety or the progress of work" is a device or software that is placed in a factory and allows communication with elderly workers to check the safety and progress of work.

[0209] This invention can be specifically implemented as an AI chatbot system aimed at preventing dementia and supporting work in the elderly. This system consists of a server and a terminal (user device). The terminal receives user input, and the server analyzes and stores that information and provides appropriate feedback.

[0210] Entering user information and creating a profile

[0211] When a user inputs personal information such as name, age, gender, and hobbies and preferences through a terminal, the server creates a user profile based on that information, and then provides a virtual character and conversation content that is suited to each individual user.

[0212] Selecting a virtual character

[0213] The server displays various patterns of virtual characters on the terminal, and the user can select a virtual character based on age, gender, hobbies, and preferences, thereby providing the user with a friendly conversation partner.

[0214] Starting and continuing a conversation

[0215] Users can initiate voice or text-based conversations with selected virtual characters through their devices. The server receives the user's input, generates appropriate responses, and sends them to the device, allowing for the conversation to continue as normal.

[0216] Dementia risk assessment

[0217] The server analyzes the conversation and evaluates language patterns and changes in themes to determine dementia risk. If the risk is high, the server generates a warning message and displays a notification on the device urging the user to seek medical attention.

[0218] Holding a conversation event

[0219] The server periodically holds conversation events in which multiple users participate. The terminal notifies users of the event information, and those who wish to participate gather. During the event, the server monitors the conversation content and checks for slanderous or inappropriate comments.

[0220] Supporting elderly workers

[0221] The server communicates with elderly workers through an interface to help them work safely in the factory, confirming their safety and progress, thereby improving both the work efficiency and safety of elderly workers.

[0222] Notification to family and specialists

[0223] Only with the user's consent will the server notify caregivers and specialists of important dementia risk data, allowing them to more accurately manage the user's health condition.

[0224] Hardware and Software Use

[0225] The system uses the following hardware and software:

[0226] Hardware: Factory robots (with microphones and speakers), central server (consisting of cloud servers)

[0227] Software: Python 3, natural language processing libraries (e.g., NLTK), data analysis libraries (e.g., Pandas)

[0228] Prompt Sentence Examples

[0229] For example, the following prompt sentences are used:

[0230] User registration begins. Please enter your unique user information.

[0231] Hello, User Name! How are you spending your day?

[0232] User Input: Today I sorted parts.

[0233] AI Response Generation: That's interesting. What are you working on next?

[0234] Dementia risk assessment initiated. ....Risk result: normal.

[0235] This system provides an environment where elderly people can enjoy daily conversations while preventing dementia and managing risks, and also improves the safety and efficiency of elderly workers in factories.

[0236] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0237] Step 1:

[0238] The user accesses the system through a terminal and performs initial registration. Specifically, they enter information such as their name, age, gender, hobbies, and preferences. The entered user information is sent to the server and stored in a database. This creates a user profile.

[0239] Step 2:

[0240] The user accesses a virtual character selection screen displayed on the terminal. The server displays a variety of patterns of virtual characters on the terminal. The user selects the desired virtual character based on age, gender, and hobbies and preferences, and the information is sent to the server and associated with the user profile.

[0241] Step 3:

[0242] The user speaks to the virtual character through the device. The server receives the user's voice or text input, analyzes the input using natural language processing techniques, and generates an appropriate response. The response is generated using a generative AI model and sent to the device in text or voice format.

[0243] Step 4:

[0244] The server periodically analyzes the user's conversation data, assessing changes in language patterns and themes in the conversation and determining dementia risk. Using a data analysis library, it evaluates changes in language patterns and consistency of themes and stores the results in a database.

[0245] Step 5:

[0246] If the risk is determined to be high, the server generates a warning message and sends a notification to the device urging the user to see a specialist.

[0247] Step 6:

[0248] The server plans and periodically holds conversation events in which multiple users participate. The terminal notifies users of the event information and gathers those who wish to participate. During the conversation event, the server monitors the content of the conversation and checks for slanderous or inappropriate comments. If inappropriate comments are detected, a warning is issued in real time.

[0249] Step 7:

[0250] The server notifies caregivers and specialists of important dementia risk data only if the user consents. The data is automatically generated and sent to caregivers and specialists via email or notification, facilitating the user's health management.

[0251] Step 8:

[0252] The server communicates with elderly workers through an interface to ensure they can work safely in the factory. It checks work safety and progress and supports the worker's condition. The server monitors the situation in real time through the terminal and robot interface and checks safety.

[0253] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0254] This invention is an AI chatbot system that serves as a conversation partner for elderly people, helping to prevent dementia and assess risk. It also incorporates an emotion engine that recognizes the user's emotions, enabling more personalized responses. Specifically, it creates a profile based on user information and engages in conversation through a virtual character selected by the user. It analyzes the content of the conversation to assess dementia risk, and if the risk is high, issues a warning and encourages the user to see a specialist. It also recognizes the user's emotions and generates responses appropriate to their emotional state. It also provides a mechanism for hosting conversation events with multiple users and monitoring for inappropriate comments.

[0255] System configuration

[0256] This system is mainly composed of a server and a terminal (user device) and is integrated with an emotion engine. The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback.

[0257] Program processing flow and specific examples

[0258] 1. User Registration

[0259] Users access the system through their terminals and perform initial registration. They enter information such as their name, age, gender, and hobbies and interests. This information is sent from the terminal to the server, which then stores it in a database to create a user profile. For example, if a user enters "Yamada Hanako, 75 years old, female, loves reading," the server stores this information in the database.

[0260] 2. AI avatar selection

[0261] The user accesses the AI ​​avatar selection screen using the device. The server provides various AI avatar patterns (age, gender, hobbies, etc.) to the device, and the user selects the desired avatar. For example, if the user selects a "male, 60-year-old, reading-loving avatar," the server associates that avatar with the user profile.

[0262] 3. Starting everyday conversations

[0263] The user speaks to the AI ​​avatar through the device. The server receives the user's voice or text input, analyzes it, and generates an appropriate response. The server then sends the response to the device, which then relays it to the user via voice or text. For example, if the user says, "How are you doing these days?" the server responds, "I'm doing well. How about you?"

[0264] 4. Emotion Recognition by Emotion Engine

[0265] When a user expresses a specific emotion to the AI ​​avatar, the device sends the voice or text to the emotion engine, which analyzes the emotion and assigns an emotion label such as joy, sadness, or anger. For example, if a user says, "I was so happy today!", the emotion engine will recognize the emotion of "joy" from the voice.

[0266] 5. Emotion-based response generation

[0267] The server generates an appropriate response based on the emotional information recognized by the emotion engine. It changes the response expression to the user based on the emotion label. For example, if the emotion engine recognizes "joy," the server generates a response such as "That's good! I'm happy too."

[0268] 6. Dementia risk assessment

[0269] The server periodically analyzes the user's conversation data, assessing language patterns, changes in themes, and emotional consistency to determine dementia risk. If a high risk is determined, the server sends a warning to the device and displays a notification urging the user to consult a specialist. For example, if the user has recently been repeating the same topics, with little change in themes and little emotional expression, the server will generate a warning message.

[0270] 7. Hosting community events

[0271] The server periodically plans and hosts conversation events with other users. The device notifies the user of the event information and the user can participate if they wish. During the event, the server monitors the conversation content and identifies inappropriate comments and negative emotions using an emotion engine. For example, a "gathering of book lovers" event can be held, providing a forum for discussing various books.

[0272] 8. Notification to family and specialists

[0273] If the user agrees, the server provides settings to notify important dementia risk data and negative emotion data generated by the emotion engine to family members and specialists. If the risk assessment is high, the server automatically generates a notification message and displays it to the user via their device, while also sending notifications to family members and specialists. For example, if a user is determined to be at "high risk" and shows a lot of "negative emotions," the server generates and sends a notification.

[0274] As described above, by incorporating an emotion engine, elderly people can enjoy daily conversations with an AI avatar while preventing dementia and managing their risk. In addition, because responses can be made according to emotional states, more personalized care can be provided.

[0275] The processing flow will be explained below.

[0276] User Registration

[0277] Step 1:

[0278] The user accesses the system's registration screen using a terminal and enters personal information such as name, age, sex, hobbies and preferences.

[0279] Step 2:

[0280] The terminal transmits the input information to the server.

[0281] Step 3:

[0282] The server stores the received information in a database and creates a user profile.

[0283] Step 4:

[0284] The server generates a message notifying the terminal that user registration has been completed and sends it to the terminal.

[0285] Step 5:

[0286] The terminal displays a registration completion notice to the user.

[0287] AI avatar selection

[0288] Step 1:

[0289] The user uses the device to access the AI ​​avatar selection screen.

[0290] Step 2:

[0291] The server retrieves available AI avatar information from the database and sends it to the terminal.

[0292] Step 3:

[0293] The terminal displays the AI ​​avatar information received from the server to the user.

[0294] Step 4:

[0295] The user selects the desired AI avatar.

[0296] Step 5:

[0297] The terminal transmits the selected AI avatar information to the server.

[0298] Step 6:

[0299] The server associates the selected avatar with a user profile and stores the associated information in a database.

[0300] Starting everyday conversations

[0301] Step 1:

[0302] Users speak to an AI avatar through their device.

[0303] Step 2:

[0304] The terminal converts the user's voice input into text and sends the text to the server.

[0305] Step 3:

[0306] The server analyzes the received text and retrieves information from a database to generate an appropriate response.

[0307] Step 4:

[0308] The server sends the generated response in text format to the terminal.

[0309] Step 5:

[0310] The terminal synthesizes the text into speech and conveys the response to the user.

[0311] Emotion recognition by emotion engine

[0312] Step 1:

[0313] When a user speaks to an AI avatar, the device sends the voice or text to the emotion engine.

[0314] Step 2:

[0315] The emotion engine analyzes the emotion and assigns an emotion label such as joy, sadness, or anger.

[0316] Step 3:

[0317] The emotion engine sends the assigned emotion label to the server.

[0318] Emotion-based response generation

[0319] Step 1:

[0320] The server receives the emotion information recognized by the emotion engine and generates an appropriate response based thereon.

[0321] Step 2:

[0322] The response expression to the user is changed based on the emotion label.

[0323] Step 3:

[0324] The server transmits the generated response to the terminal, and provides the user with a response according to the emotion.

[0325] Step 4:

[0326] The terminal displays or outputs the response sent from the server to the user as audio.

[0327] Dementia risk assessment

[0328] Step 1:

[0329] The server periodically scans the user's past conversation data and runs algorithms that detect specific language patterns.

[0330] Step 2:

[0331] The server assesses dementia risk by assessing language patterns, thematic shifts, and emotional consistency.

[0332] Step 3:

[0333] If the server determines that the risk is high, it generates a warning message based on the evaluation results.

[0334] Step 4:

[0335] The server sends a warning message to the terminal and displays a notice urging the user to see a specialist.

[0336] Step 5:

[0337] The terminal displays a warning message to the user.

[0338] Hosting community events

[0339] Step 1:

[0340] The server periodically plans conversation events with other users and generates detailed information about them.

[0341] Step 2:

[0342] The server transmits detailed information about the event to the terminal.

[0343] Step 3:

[0344] The terminal notifies the user of the event information and confirms whether the user wishes to participate.

[0345] Step 4:

[0346] The user notifies the server of his / her intention to participate through the terminal.

[0347] Step 5:

[0348] The server assigns participating users to chat rooms for the event and generates link information therefor.

[0349] Step 6:

[0350] The terminal connects the user to the chat room through a link at the start of the event.

[0351] Step 7:

[0352] The server monitors the conversations during the event to check for any abusive or inappropriate comments.

[0353] Notification to family and specialists

[0354] Step 1:

[0355] If the user agrees, the server will set up the system to notify family members or specialists of important dementia risk data and negative emotional data generated by the emotion engine.

[0356] Step 2:

[0357] The server automatically generates a notification message if the risk assessment is high.

[0358] Step 3:

[0359] The server transmits the generated notification message to the terminal and sets it so that the notification is also sent to the user.

[0360] Step 4:

[0361] The terminal displays a notification to the user and simultaneously sends notifications to family members and specialists.

[0362] These are the specific processing steps of a system incorporating an emotion engine that helps prevent dementia and manage risk while allowing elderly people to enjoy daily conversations with an AI avatar. In addition, the system's ability to respond according to emotional states allows for more personalized care.

[0363] Example 2

[0364] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0365] In an aging society, dementia prevention and risk assessment are important issues. However, conventional systems were unable to provide individualized responses and had difficulty accurately capturing users' emotional states. Furthermore, in conversation events involving multiple users, monitoring for inappropriate remarks was insufficient, and the sharing of dementia risk data and emotional data was limited. This made it difficult to enrich users' daily experiences and assist specialists in early diagnosis.

[0366] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select the virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for recognizing the user's emotions and generating responses corresponding to the emotions; means for analyzing the content of the conversation and evaluating language patterns, changes in themes, and emotional consistency to determine dementia risk; means for issuing a warning to the user and displaying a message encouraging the user to seek medical attention if the dementia risk is high; means for periodically hosting conversation events in which multiple users participate and monitoring for slander, inappropriate comments, and negative emotions during the events; and means for notifying caregivers and specialists of important dementia risk data and emotional data if the user consents. This enables personalized responses that accurately reflect the user's emotional state, facilitating early detection of dementia risk and prompt notification to specialists. Furthermore, a rich communication experience can be provided while maintaining user safety.

[0367] "User information" refers to personal information such as name, age, gender, hobbies and preferences that is entered into the system.

[0368] A "user profile" is detailed user information that is created and stored by the server based on user information.

[0369] A "virtual character" is a virtual character that a user can select to interact with within the system.

[0370] "Voice or text-based conversation" refers to a dialogue between a user and a virtual character, either through voice or text.

[0371] An "emotion engine" is software that analyzes a user's voice and text and assigns emotional labels.

[0372] "Emotion recognition" is the process in which the emotion engine analyzes the user's emotions and distinguishes between emotions such as joy, sadness, and anger.

[0373] "Response generation" is the process by which the server creates an appropriate response based on input from the user and the perceived sentiment.

[0374] "Dementia risk assessment" involves the server analyzing a user's conversation data and evaluating language patterns, changes in themes, and emotional consistency to determine the risk of dementia.

[0375] A "warning" is a message generated by the server and displayed on the device when the risk of dementia is high, encouraging a medical examination.

[0376] A "conversation event" is a place for dialogue in which multiple users can participate on a regular basis.

[0377] "Abusive and inappropriate comment monitoring" refers to monitoring activities performed by the server during conversation events to identify inappropriate comments and negative sentiment.

[0378] "Important dementia risk data" is specific data that indicates that a user is at high risk of dementia.

[0379] "Emotion data" is the user's emotional information recognized by the emotion engine.

[0380] "Caregivers" is a general term for family members and facility staff who are responsible for caring for users.

[0381] A "specialist" is a doctor who specializes in diagnosing and treating dementia.

[0382] This invention is an AI chatbot system that acts as a conversation partner for elderly people, helping them prevent dementia and assess their risk. Specifically, it creates a profile based on user information and engages in conversation through a virtual character selected by the user. It analyzes the content of the conversation to assess dementia risk, and if the risk is high, it issues a warning and encourages the user to see a specialist. It also recognizes the user's emotions and generates responses appropriate to their emotional state. It also provides a mechanism for hosting conversation events with multiple users and monitoring for inappropriate comments.

[0383] System configuration

[0384] This system is mainly composed of a server and a terminal (user device) and is integrated with an emotion engine. The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback.

[0385] User Registration

[0386] Users access the system through their terminals and perform initial registration. They enter information such as their name, age, gender, and hobbies and interests. This information is sent from the terminal to the server, which then stores it in a database to create a user profile. For example, if a user enters "Yamada Hanako, 75 years old, female, loves reading," the server stores this information in the database.

[0387] AI avatar selection

[0388] The user accesses the AI ​​avatar selection screen using the device. The server provides various AI avatar patterns (age, gender, hobbies, etc.) to the device, and the user selects the desired avatar. For example, if the user selects a "male, 60-year-old, reading-loving avatar," the server associates that avatar with the user profile.

[0389] Starting everyday conversations

[0390] The user speaks to the AI ​​avatar through the device. The server receives the user's voice or text input, analyzes it, and generates an appropriate response. The server then sends the response to the device, which then relays it to the user via voice or text. For example, if the user says, "How are you doing these days?" the server responds, "I'm doing well. How about you?"

[0391] Emotion recognition by emotion engine

[0392] When a user expresses a specific emotion to the AI ​​avatar, the device sends the voice or text to the emotion engine, which analyzes the emotion and assigns an emotion label such as joy, sadness, or anger. For example, if a user says, "I was so happy today!", the emotion engine will recognize the emotion of "joy" from the voice.

[0393] Emotion-based response generation

[0394] The server generates an appropriate response based on the emotional information recognized by the emotion engine. It changes the response expression to the user based on the emotion label. For example, if the emotion engine recognizes "joy," the server generates a response such as "That's good! I'm happy too."

[0395] Dementia risk assessment

[0396] The server periodically analyzes the user's conversation data, assessing language patterns, changes in themes, and emotional consistency to determine dementia risk. If a high risk is determined, the server sends a warning to the device and displays a notification urging the user to consult a specialist. For example, if the user has recently been repeating the same topics, with little change in themes and little emotional expression, the server will generate a warning message.

[0397] Hosting community events

[0398] The server periodically plans and hosts conversation events with other users. The device notifies the user of the event information and the user can participate if they wish. During the event, the server monitors the conversation content and identifies inappropriate comments and negative emotions using an emotion engine. For example, a "gathering of book lovers" event can be held, providing a forum for discussing various books.

[0399] Notification to family and specialists

[0400] If the user agrees, the server provides settings to notify important dementia risk data and negative emotion data generated by the emotion engine to family members and specialists. If the risk assessment is high, the server automatically generates a notification message and displays it to the user via their device, while also sending notifications to family members and specialists. For example, if a user is determined to be at "high risk" and shows a lot of "negative emotions," the server generates and sends a notification.

[0401] Example prompt

[0402] Prompt when user says "How are you doing?"

[0403] You: How are you doing lately?

[0404] AI Avatar: I'm fine. How about you?

[0405] Prompts for users to express their feelings

[0406] You: Something very exciting happened today!

[0407] AI Avatar: That's great! I'm happy too.

[0408] By incorporating an emotion engine, elderly people can enjoy daily conversations with an AI avatar, which can help prevent dementia and manage the risk of dementia. In addition, the system can respond according to emotional states, allowing for more personalized care.

[0409] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0410] Step 1: User Registration

[0411] User actions: The user accesses the system through a terminal and proceeds to the initial registration screen.

[0412] Input: The user enters information such as name, age, gender, hobbies, and preferences.

[0413] Terminal operation: The terminal sends the entered information to the server.

[0414] Server Action: The server stores the received information in a database and creates a user profile.

[0415] Output: The completed user profile is saved in the database.

[0416] Specific example of operation: The user enters "Yamada Hanako, 75 years old, female, likes reading," and the terminal sends this to the server, which then saves the profile in the database.

[0417] Step 2: Select an AI avatar

[0418] User Action: The user uses the device to access the AI ​​avatar selection screen.

[0419] Input: The server displays various AI avatar patterns on the terminal.

[0420] Terminal operation: The terminal receives an operation to select the desired avatar from the user.

[0421] Server Action: The server receives the selected avatar information and associates it with the user profile.

[0422] Output: The user profile is updated with the selected avatar information.

[0423] Example of specific operation: The user selects an avatar of "male, 60 years old, who likes reading," and the device sends this information to the server, which then registers the information in the user profile.

[0424] Step 3: Starting everyday conversations

[0425] User action: The user speaks to the AI ​​avatar through the device.

[0426] Input: The user types a question or message by voice or text.

[0427] Terminal operation: The terminal sends the user's input to the server.

[0428] Server operation: The server analyzes the received data using a generative AI model and generates an appropriate response.

[0429] Output: The generated reply is sent to the terminal.

[0430] Terminal behavior: The terminal displays the response to the user as voice or text.

[0431] A specific example of how it works: The user asks, "How are you doing these days?", the server generates a response, "I'm doing well. How about you?", and the device conveys this aloud.

[0432] Step 4: Emotion Recognition with the Emotion Engine

[0433] User action: The user makes an emotional statement to the AI ​​avatar.

[0434] Input: User voice or text input.

[0435] Device operation: The device sends the input voice or text to the emotion engine.

[0436] How the Emotion Engine Works: The emotion engine analyzes input and assigns emotion labels.

[0437] Output: Emotion labels are generated and sent to the server.

[0438] A concrete example of how it works: A user types, "Something very happy happened today!", and the emotion engine assigns the label "joy."

[0439] Step 5: Emotion-based response generation

[0440] Server operation: The server generates an appropriate response based on the emotion labels received from the emotion engine.

[0441] Output: The generated reply is sent to the terminal.

[0442] Terminal action: The terminal relays the response to the user.

[0443] Specific example of operation: The emotion engine recognizes "joy," and the server generates a response saying, "That's great! I'm happy too," which is conveyed to the user via the device.

[0444] Step 6: Dementia risk assessment

[0445] Server operation: The server periodically collects and analyzes user conversation data.

[0446] Input: Conversation data, language patterns, thematic shifts, and emotional consistency.

[0447] Data processing: The server analyzes the collected data using statistical methods and AI models to determine the risk of dementia.

[0448] Output: Risk assessment results are generated and warnings are created if necessary.

[0449] Terminal behavior: The terminal displays a warning message to the user.

[0450] Specific example of operation: If a user repeatedly talks about the same topic and there is little change in the topic, the server determines that the user has a high risk of dementia and sends a warning to the device saying, "We recommend that you see a specialist."

[0451] Step 7: Host a community event

[0452] What the server does: Plan and host conversation events with other users.

[0453] Input: Event information, participation application.

[0454] Device operation: Notifies the user of event information and accepts requests to participate.

[0455] Server Actions: Monitor conversations during the event to identify inappropriate language and negative sentiment.

[0456] Output: Warnings and notices are sent to the user as needed.

[0457] Example of how it works: The server plans a "gathering of book lovers" event, and the user wants to participate. The server monitors the conversation and detects inappropriate comments.

[0458] Step 8: Notify family and specialists

[0459] User behavior: If the user consents.

[0460] Input: Dementia risk data, emotion data.

[0461] Server operation: Stores important dementia risk data and emotion data.

[0462] Data processing: The server automatically generates a notification message if the risk assessment is high.

[0463] Output: A notification message is generated and displayed to the user via the terminal, as well as sent to family members and specialists.

[0464] Specific example of operation: If a user is judged to be "high risk" and shows negative emotions, the server generates a notification saying "We recommend you see a specialist" and sends it to the device, family, and specialist.

[0465] (Application example 2)

[0466] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0467] It is difficult to efficiently provide dementia prevention and mental care for elderly people when they shop in physical stores. It is also necessary to provide more satisfying customer service by responding to the emotional state of the elderly. Furthermore, there is a lack of a system for early detection of dementia risk in elderly people and encouraging them to consult an appropriate specialist.

[0468] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0469] In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select the virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for analyzing the content of the conversation and evaluating changes in language patterns and themes to determine dementia risk; means for issuing a warning to the user and displaying a message urging the user to seek medical attention if the dementia risk is high; means for periodically hosting conversation events in which multiple users participate and monitoring the events for defamatory and inappropriate comments; means for notifying a caregiver or specialist of important dementia risk data if the user consents; means for supporting the user's conversation and generating responses according to the user's emotional state via a terminal installed in a physical store; and means including an emotion engine for recognizing the user's emotions and responding accordingly. This allows elderly people to enjoy comfortable shopping in physical stores while also enabling early detection of dementia risk and appropriate mental care.

[0470] "User information" refers to personal information such as the user's name, age, gender, hobbies, and preferences.

[0471] A "user profile" is data that compiles the characteristics and attributes of each user, generated based on user information.

[0472] A "virtual character" is a computer-generated digital character with a variety of patterns that can be selected by the user.

[0473] "Voice or text-based conversation" refers to interaction between a user and a virtual character through speech recognition or text input.

[0474] "Analyzing conversation content" refers to analyzing the content of the dialogue between the user and the virtual character to evaluate changes in language patterns and themes.

[0475] "Dementia risk" refers to the risk of a user's cognitive decline, and is determined from changes in language patterns and themes.

[0476] "Means of issuing a warning and displaying a message encouraging medical attention" is a function that sends a notification to the user recommending that they see a specialist if they are determined to be at high risk of dementia.

[0477] A "conversation event" is an opportunity for multiple users to participate in a group conversation through virtual characters.

[0478] "Means for monitoring slanderous or inappropriate comments" is a function for monitoring content to prevent inappropriate comments from being made during conversation events.

[0479] "Means for notifying caregivers and medical specialists" refers to a mechanism for notifying dementia risk data to caregivers and medical professionals if the user consents.

[0480] A "terminal installed in a physical store" is a digital device that is placed in a physical store and with which users can interact.

[0481] The "means for generating a response according to the emotional state" is a function for recognizing the user's emotions and generating a response appropriate to those emotions.

[0482] The "emotion engine" is a system that analyzes a user's emotions from conversation content and voice data and assigns specific emotion labels.

[0483] This invention is an AI assistant system that uses a terminal installed in a physical store to help elderly people prevent dementia and receive mental care. Specific embodiments for carrying out the invention are described below.

[0484] System configuration and program processing

[0485] Hardware Configuration

[0486] The system of the present invention is mainly composed of the following hardware.

[0487] 1. In-store devices: Smartphones, tablets, interactive digital devices, such as tablets and in-store display devices.

[0488] 2. Server: A cloud-based or in-store server that stores and analyzes data.

[0489] 3. Microphone and speaker: A device with audio input and output capabilities.

[0490] Software Configuration

[0491] The system uses the following software:

[0492] 1. Python: Used as the primary programming language.

[0493] 2. TENSORFLOW (registered trademark): A deep learning framework for building emotion engines.

[0494] 3. SQLite: Used as a database to store user information and conversation data.

[0495] Specific processing contents of the program

[0496] 1. User Registration

[0497] Users enter basic information such as their name, age, gender, hobbies, and preferences through their terminals. This information is sent from the terminal to the server and stored in a database as a user profile.

[0498] For example: "Please enter your registration information."

[0499] 2. AI avatar selection

[0500] Users select their desired character from a variety of AI avatars displayed on their device, and this selection information is also stored on the server and associated with the user profile.

[0501] For example: "Please select an avatar that is male, 60 years old, and enjoys reading."

[0502] 3. Starting everyday conversations

[0503] Users speak to an AI avatar through their device, and their voice or text input is sent to a server, where it is analyzed and an appropriate response is generated.

[0504] Example: A user types "Hi, how are you?" and the server generates a response "Hi, I'm fine. How are you?"

[0505] 4. Emotion Recognition by Emotion Engine

[0506] Emotions are recognized from the user's voice or text and an emotion label is assigned. For example, emotions such as joy, sadness, and anger are analyzed.

[0507] Example: If a user says, "I'm so happy today!", the emotion engine will recognize "joy."

[0508] 5. Emotion-based response generation

[0509] Based on the emotional information recognized by the emotion engine, an appropriate response is generated. For example, if the emotion of "joy" is recognized, the response will be "That's wonderful!"

[0510] Example: If the emotion engine recognizes "joy," it will respond with "That's great!"

[0511] 6. Dementia risk assessment

[0512] The server periodically analyzes the user's conversations to assess their dementia risk. If the risk is determined to be high, the server generates a warning message and urges the user to seek medical attention.

[0513] Example: If a user is analyzed as having "been talking about the same topic a lot lately," the server will notify them that "we recommend that you see a specialist."

[0514] 7. Hosting conversation events

[0515] The server periodically schedules conversation events in which multiple users participate, notifies users of the event information, and monitors the conversation content during the event to identify inappropriate comments.

[0516] Example: Announcing a "Book Lovers Gathering" event and encouraging users to join.

[0517] 8. Notification to family and specialists

[0518] If the user consents, the server will notify caregivers and specialists of important dementia risk data and emotional information.

[0519] Example: If a user is judged to be at "high" risk of dementia and shows a lot of "negative emotions," the server generates and sends a notification.

[0520] This configuration allows elderly people to enjoy shopping comfortably in brick-and-mortar stores, while also enabling early detection of dementia risk and appropriate mental care. Furthermore, by responding to their emotional state, it is possible to provide more satisfying customer service.

[0521] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0522] Step 1:

[0523] User Registration

[0524] Users input basic information such as name, age, gender, hobbies and interests through their terminals. This input data is sent from the terminal to the server, which stores the information in a database and generates a user profile. Specifically, if a user enters "Yamada Hanako, 75 years old, female, loves reading," the server receives the information and stores it in the database as the profile for "Yamada Hanako."

[0525] Step 2:

[0526] AI avatar selection

[0527] Users select their desired character from a variety of AI avatars displayed on their device. The user's selection is sent from the device to the server, and the server adds the selection information to the user profile. For example, if a user selects an avatar that is "male, 60 years old, and likes reading," the server associates that information with the profile and saves it.

[0528] Step 3:

[0529] Starting everyday conversations

[0530] The user speaks to the AI ​​avatar through the device. This is done in the form of voice input or text input. The device sends this input information to the server, which analyzes the input data and generates an appropriate response. The server then sends the generated response to the device, which then conveys it to the user in voice or text. When the user inputs "Hello, how are you doing?", the server analyzes the input and generates and returns the response "Hello, I'm fine. How are you?"

[0531] Step 4:

[0532] Emotion recognition by emotion engine

[0533] When a user expresses a specific emotion to an AI avatar, the voice or text is sent from the device to the emotion engine. The emotion engine analyzes the input data and assigns an emotion label such as joy, sadness, or anger. For example, if a user says, "I'm so happy today!", the emotion engine analyzes the voice data and assigns the emotion label "joy."

[0534] Step 5:

[0535] Emotion-based response generation

[0536] The server generates an appropriate response based on the emotional information recognized by the emotion engine. The expression of this response changes depending on the emotion. For example, if the emotion engine recognizes "joy," the server generates a response according to the emotion, such as "That's wonderful!", and sends it to the device. The device then conveys this response to the user.

[0537] Step 6:

[0538] Dementia risk assessment

[0539] The server periodically analyzes the user's conversations, assessing language patterns, changes in themes, and emotional consistency to determine dementia risk. If a high risk is determined, the server generates a warning message and sends it to the device, urging the user to seek medical advice. For example, if the server determines that a user has been repeatedly talking about the same topics recently, it will notify the user by saying, "We recommend that you see a specialist."

[0540] Step 7:

[0541] Holding a conversation event

[0542] The server plans conversation events in which multiple users will participate and notifies users of the event information via their devices. Users can participate if they wish. During the event, the server monitors the conversation content and identifies inappropriate comments and negative emotions using an emotion engine. For example, a "gathering of book lovers" event is planned, the server notifies the device of the information, and users can participate.

[0543] Step 8:

[0544] Notification to family and specialists

[0545] If the user agrees, the server will notify caregivers and specialists of important dementia risk data and negative emotion data generated by the emotion engine. For example, if a user is judged to be at "high" dementia risk and shows a lot of "negative emotions," the server will pass that information to the notification generation system, which will then generate and send a notification.

[0546] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0547] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0548] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0549] [Second embodiment]

[0550] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0551] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0552] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0553] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0554] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0555] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0556] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0557] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0558] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0559] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0560] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0561] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0562] This invention is an AI chatbot system that acts as a conversation partner for elderly people and is useful for preventing dementia and assessing their risk. Specifically, the system aims to prevent dementia by creating a profile based on user information and engaging in conversations through a virtual character selected by the user. The system also analyzes conversation content to assess dementia risk, and if the risk is high, issues a warning and encourages the user to see a specialist. Furthermore, it provides a mechanism for hosting conversation events with multiple users and monitoring inappropriate comments.

[0563] System configuration

[0564] This system mainly consists of a server and a terminal (user device). The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback.

[0565] Program processing flow and specific examples

[0566] 1. User Registration

[0567] Users access the system through their terminals and perform initial registration. They enter information such as their name, age, gender, and hobbies and preferences. This information is sent from the terminal to the server, which then stores it in a database to create a user profile. For example, if a user enters "Taro Tanaka, 70 years old, male, likes music," the server stores this information in the database.

[0568] 2. AI avatar selection

[0569] The user accesses the AI ​​avatar selection screen using the device. The server provides various AI avatar patterns (age, gender, hobbies, etc.) to the device, and the user selects the desired avatar. For example, if the user selects a "female, 50-year-old, music-loving avatar," the server associates that avatar with the user profile.

[0570] 3. Starting everyday conversations

[0571] The user speaks to the AI ​​avatar through the device. The server receives the user's voice or text input, analyzes it, and generates an appropriate response. The server then sends the response to the device, which then relays it to the user via voice or text. For example, if the user asks, "What's the weather like today?" the server retrieves the weather information and responds, "It's sunny today, and the temperature is 25 degrees."

[0572] 4. Dementia risk assessment

[0573] The server periodically analyzes the user's conversation data and assesses their dementia risk based on changes in language patterns and themes. If the risk is determined to be high, the server sends a warning to the device and displays a notification urging them to see a specialist. For example, if a user has recently been repeating the same topics with little change in themes, the server will notify them, "Your risk of dementia may be increasing. We recommend that you see a specialist."

[0574] 5. Hosting community events

[0575] The server periodically plans and holds conversation events with other users. The device notifies the user of the event information, and the user can participate if they wish. During the event, the server monitors the conversation content and checks for slanderous or inappropriate comments. For example, a "music lovers' gathering" event can be held, providing a forum for discussing various music topics.

[0576] 6. Notification to family and specialists

[0577] The server will be configured to notify important dementia risk data to family members and specialists only if the user agrees. If the risk assessment is high, the server will automatically generate a notification message, which will be displayed to the user on their device and will also be sent to family members and specialists. For example, if a user is judged to be at "high risk," the server will send a notification stating, "Taro Tanaka's dementia risk is increasing."

[0578] In this way, this system provides an environment where elderly people can prevent dementia and manage their risk while enjoying everyday conversations.

[0579] The processing flow will be explained below.

[0580] User Registration

[0581] Step 1:

[0582] The user accesses the system's registration screen using a terminal and enters personal information such as name, age, sex, hobbies and preferences.

[0583] Step 2:

[0584] The terminal transmits the input information to the server.

[0585] Step 3:

[0586] The server stores the received information in a database and creates a user profile.

[0587] Step 4:

[0588] The server sends a notification to the terminal indicating that the user registration is complete.

[0589] Step 5:

[0590] The terminal displays a registration completion notice to the user.

[0591] AI avatar selection

[0592] Step 1:

[0593] The user uses the device to access the AI ​​avatar selection screen.

[0594] Step 2:

[0595] The server sends available AI avatar information from the database to the terminal.

[0596] Step 3:

[0597] The terminal displays the AI ​​avatar information received from the server to the user.

[0598] Step 4:

[0599] The user selects the desired AI avatar.

[0600] Step 5:

[0601] The terminal transmits the selected AI avatar information to the server.

[0602] Step 6:

[0603] The server associates the selected avatar with a user profile and stores the associated information in a database.

[0604] Starting everyday conversations

[0605] Step 1:

[0606] Users speak to an AI avatar through their device.

[0607] Step 2:

[0608] The terminal converts the user's voice input into text and sends the text to the server.

[0609] Step 3:

[0610] The server analyzes the received text and retrieves information from a database to generate an appropriate response.

[0611] Step 4:

[0612] The server sends the generated response in text format to the terminal.

[0613] Step 5:

[0614] The terminal synthesizes the text into speech and conveys the response to the user.

[0615] Dementia risk assessment

[0616] Step 1:

[0617] The server periodically scans the user's past conversation data and runs algorithms that detect specific language patterns.

[0618] Step 2:

[0619] The server assesses dementia risk by assessing changes in language patterns and themes.

[0620] Step 3:

[0621] If the server determines that the risk is high, it generates a warning message based on the evaluation results.

[0622] Step 4:

[0623] The server sends a warning message to the terminal and displays a notice urging the user to see a specialist.

[0624] Step 5:

[0625] The terminal displays a warning message to the user.

[0626] Hosting community events

[0627] Step 1:

[0628] The server periodically plans conversation events with other users and generates detailed information about them.

[0629] Step 2:

[0630] The server transmits detailed information about the event to the terminal.

[0631] Step 3:

[0632] The terminal notifies the user of the event information and confirms whether the user wishes to participate.

[0633] Step 4:

[0634] The user notifies the server of his / her intention to participate through the terminal.

[0635] Step 5:

[0636] The server assigns participating users to chat rooms for the event and generates link information therefor.

[0637] Step 6:

[0638] The terminal connects the user to the chat room through a link at the start of the event.

[0639] Step 7:

[0640] The server monitors the conversations during the event to check for any abusive or inappropriate comments.

[0641] Notification to family and specialists

[0642] Step 1:

[0643] If the user has given their consent, the server will configure the system to notify family members and specialists of important dementia risk data.

[0644] Step 2:

[0645] The server automatically generates a notification message if the risk assessment is high.

[0646] Step 3:

[0647] The server transmits the generated notification message to the terminal and sets it so that the notification is also sent to the user.

[0648] Step 4:

[0649] The terminal displays a notification to the user and simultaneously sends notifications to family members and specialists.

[0650] These are the specific processing steps. This will enable elderly people to enjoy daily conversations with AI avatars while also helping to prevent dementia and manage their risk.

[0651] Example 1

[0652] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0653] The elderly population is increasing in modern society, making the prevention and early detection of dementia an important issue. However, many elderly people tend to be isolated from their daily lives, and opportunities for conversation decrease, which may increase their risk of dementia. In addition, there are limited means to assess the risk of dementia early and take appropriate measures, so detection is often delayed. Furthermore, a system is needed to facilitate communication between elderly people and to prevent inappropriate remarks.

[0654] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0655] In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select a virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for analyzing the content of the conversation and evaluating changes in language patterns and themes to determine dementia risk; means for issuing a warning to the user and displaying a message urging the user to seek medical attention if the dementia risk is high; means for periodically holding conversation events in which multiple users participate and monitoring for slanderous or inappropriate comments during the events; means for notifying caregivers and specialists of important dementia risk data if the user consents; means for converting the user's voice input into text data, generating appropriate response data using natural language processing technology, and transmitting the response data to the user; and means for monitoring the content of the conversations in real time during conversation events and detecting slanderous or inappropriate comments using specific keywords as triggers. This enables elderly people to prevent dementia and manage their risk while enjoying daily conversations.

[0656] "User information" refers to personal data such as name, age, gender, hobbies and preferences that users enter into the system.

[0657] "User Profile" means a database record about an individual user that the system creates based on user information.

[0658] A "virtual character" is a digital character that the system displays and that has a variety of patterns that the user can select.

[0659] "Voice or text-based conversation" refers to a dialogue between a user and a virtual character using voice or text input.

[0660] "Conversation content" refers to the content of the audio or text exchanges that take place between the user and the virtual character.

[0661] A "language pattern" is a specific pattern of words and expressions used in conversational content.

[0662] A "change in topic" is a change in how the topic shifts in the content of a conversation.

[0663] "Dementia risk" is an index that evaluates the possibility that a user will develop dementia.

[0664] "Slander" is the act of insulting or speaking ill of others.

[0665] "Inappropriate remarks" are remarks that are socially unacceptable or that offend others.

[0666] "Natural language processing technology" is a technology that allows computers to understand and analyze human language.

[0667] A "generative AI model" is a model for automatically generating text data using artificial intelligence.

[0668] This invention is an AI chatbot system that acts as a conversation partner for elderly people and is useful for preventing dementia and assessing their risk. Specifically, the system aims to prevent dementia by creating a profile based on user information and engaging in conversations through a virtual character selected by the user. The system also analyzes conversation content to assess dementia risk, and if the risk is high, issues a warning and encourages the user to see a specialist. Furthermore, it provides a mechanism for hosting conversation events with multiple users and monitoring inappropriate comments.

[0669] The system primarily consists of a server and a terminal (user device). The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback. The server uses a high-performance database system and natural language processing (NLP) technology, utilizing generative AI models (such as GPT-4). The server also analyzes conversation data and runs algorithms to detect language patterns and thematic shifts.

[0670] As a specific example of operation, consider a scenario in which a user initially registers with the system. First, the user enters information such as name, age, gender, and hobbies and preferences. This information is sent from the device to the server, which stores it in a database and creates a user profile. The user then accesses a virtual character selection screen and selects the desired avatar. The server associates that avatar with the user profile.

[0671] Next, an everyday conversation takes place between the user and the virtual character. When the user asks, "What's the weather like today?", the server converts the voice data into text and analyzes it using NLP technology. The generative AI model then generates a response, and the server sends the appropriate response, "It's sunny today, and the temperature is 25 degrees," to the device and tells the user.

[0672] Furthermore, the server periodically analyzes conversation data to detect changes in language patterns and themes to assess dementia risk. If the risk increases, a warning will be issued on the device, displaying a message saying, "You may be at increased risk of dementia. We recommend that you seek medical advice from a specialist."

[0673] The server also periodically plans and holds conversation events with other users. The device notifies the user of the event information, and the user can participate if they wish. During the event, the server monitors the conversation in real time to check for slanderous or inappropriate comments.

[0674] Finally, if the user agrees, the server configures the system to notify family members and specialists of important dementia risk data. If the risk assessment is high, the server sends an automatically generated notification message to family members and specialists.

[0675] Examples of prompts include:

[0676] "Register as Taro Tanaka, 70 years old, male, and music lover, and select a 50-year-old female avatar who also loves music. Talk to that avatar and ask, 'How's the weather today?'"

[0677] "Use the conversation to determine dementia risk and find out how you will be notified if you are at high risk."

[0678] "Attend community events and see what conversations happen."

[0679] As described above, this system provides an environment where elderly people can prevent dementia and manage their risk while enjoying everyday conversations.

[0680] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0681] Step 1: User Registration

[0682] 1.1 Users access the system through a terminal. Users input personal information such as name, age, gender, hobbies, and preferences into a form.

[0683] 1.2 The device sends the information entered by the user to the server. The information is sent to the server as an HTTP POST request.

[0684] 1.3 The server validates the received input data and stores it in the database. Specifically, the server creates a new user profile in the database and stores the input data.

[0685] 1.4 The server returns a confirmation message to the terminal indicating that the save was completed successfully. The terminal displays this message on the screen to notify the user that the registration has been completed.

[0686] Step 2: Select an AI avatar

[0687] 2.1 The user uses a device to access the AI ​​avatar selection screen, which displays a list of various virtual characters.

[0688] 2.2 The server provides the terminal with an avatar list, which includes various pre-designed character attributes (e.g., age, gender, hobbies, etc.).

[0689] 2.3 The user selects the desired avatar, and the device sends the selection information to the server as an HTTP POST request.

[0690] 2.4 The server associates the received avatar information with the user profile and stores it in a database. The server then sends a confirmation message back to the device indicating that the association is complete.

[0691] 2.5 The device will display a confirmation message on the screen to notify the user that the avatar selection is complete.

[0692] Step 3: Starting everyday conversations

[0693] 3.1 The user speaks to the AI ​​avatar through the device, and questions and conversation content are entered into the device as voice input or text input.

[0694] 3.2 The device converts the voice input into text data and sends it to the server. The voice data is converted into text data using voice recognition technology.

[0695] 3.3 The server analyzes the received text data using natural language processing (NLP) technology. Specifically, the server uses a generative AI model (e.g., GPT-4) to understand the user's intent and generate an appropriate response.

[0696] 3.4 The server sends the generated response data to the device, which then displays the received data as text or outputs it as voice using speech synthesis technology.

[0697] 3.5 The device will then relay the response to the user, allowing them to continue the conversation. If the user says, "What's the weather like today?", the device will display the response, "It's sunny today, and the temperature is 25 degrees."

[0698] Step 4: Dementia risk assessment

[0699] 4.1 The server periodically collects and stores user conversation data, which is then stored in a database.

[0700] 4.2 The server analyzes the collected conversation data to detect shifts in language patterns and themes. It uses a generative AI model to identify shifts in language patterns and repetition of the same topics.

[0701] 4.3 The server evaluates dementia risk based on the analysis results and calculates a risk score. If the risk score is high, a warning flag is raised.

[0702] 4.4 If the risk assessment is high, the server sends a warning message to the device, which displays the message "You may be at increased risk of dementia. We recommend that you consult a specialist."

[0703] Step 5: Host a community event

[0704] 5.1 The server periodically plans and schedules conversation events, and the event information is stored in a database.

[0705] 5.2 The device notifies the user of event information. Notifications are provided as push messages.

[0706] 5.3 If the user wishes to participate, the device sends a notification to the server, and the user taps the "Join" button on the screen.

[0707] 5.4 During the event, the server will monitor conversations in real time, using generative AI models to detect abusive or inappropriate language.

[0708] 5.5 If the server detects inappropriate comments, it will send a warning message to the device, which will be displayed to all event participants.

[0709] Step 6: Notify family and specialists

[0710] 6.1 If the user agrees, the server will configure the notification of risk data to family members and specialists. The configuration information will be stored in the database.

[0711] 6.2 If the server determines that the person is at high risk, it automatically generates a notification message, such as "Taro Tanaka's risk of dementia is increasing."

[0712] 6.3 The server sends the generated notification message to the user's family or specialist. The notification is sent as an email or push notification.

[0713] 6.4 The device will display and allow the user to acknowledge that a notification has been sent. The screen will display the message "Notification sent."

[0714] (Application example 1)

[0715] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0716] In addition to preventing dementia and assessing risk in the elderly, there is a need for a system that integrates safety confirmation and work progress confirmation for elderly workers in factories. However, currently these functions are independent, and there is no system in place for elderly workers to receive dementia risk assessments or psychological support through conversations during their daily work. This could lead to a decrease in the work efficiency of elderly workers in factories and an increase in safety risks.

[0717] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0718] In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select the virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for analyzing the content of the conversation and evaluating changes in language patterns and themes to determine dementia risk; means for issuing a warning to the user and displaying a message urging the user to seek medical attention if the dementia risk is high; means for periodically hosting conversation events in which multiple users participate and monitoring for defamatory or inappropriate comments during the events; means for notifying caregivers or specialists of important dementia risk data if the user consents; and interface means for conducting conversations with elderly workers in factories and supporting safety and work progress checks. This enables elderly workers to enjoy daily conversations while preventing dementia and managing risks, and further improves the safety and efficiency of work in factories.

[0719] "User information" refers to basic personal attribute information about system users (e.g., name, age, gender, hobbies and preferences).

[0720] A "user profile" is an individual information record created based on user information, including conversation content and system usage.

[0721] A "virtual character" is a purposefully created digital persona or avatar with which a user chooses to interact.

[0722] "Voice or text-based conversation" means a method of communication between a user and a virtual character, including both voice and text input.

[0723] "Changes in language patterns and themes" refers to the patterns of words used and changes in topics during conversation, and are indicators for assessing dementia risk.

[0724] "Dementia risk" is a numerical value or assessment result used to evaluate the likelihood that a user will develop dementia.

[0725] A "warning message urging a visit to a doctor" is a notification sent to users when they are at high risk of dementia, and includes content urging them to visit a specialist.

[0726] A "conversation event" is a gathering of multiple users to discuss a specific topic, and is a regularly held online or offline event.

[0727] "Means for monitoring abusive and inappropriate comments" refers to technology for monitoring comments made by users during conversation events and detecting abusive and inappropriate comments.

[0728] "Important dementia risk data" refers to important information obtained as a result of dementia risk assessment, which is used to manage the user's health status by informing caregivers and specialists.

[0729] "Caregivers and specialists" are professionals who are responsible for managing the health of users and providing medical care.

[0730] An "interface means" is a physical or digital medium through which a user directly interacts with a system.

[0731] An "interface means for communicating with elderly workers in a factory and assisting in checking safety or the progress of work" is a device or software that is placed in a factory and allows communication with elderly workers to check the safety and progress of work.

[0732] This invention can be specifically implemented as an AI chatbot system aimed at preventing dementia and supporting work in the elderly. This system consists of a server and a terminal (user device). The terminal receives user input, and the server analyzes and stores that information and provides appropriate feedback.

[0733] Entering user information and creating a profile

[0734] When a user inputs personal information such as name, age, gender, and hobbies and preferences through a terminal, the server creates a user profile based on that information, and then provides a virtual character and conversation content that is suited to each individual user.

[0735] Selecting a virtual character

[0736] The server displays various patterns of virtual characters on the terminal, and the user can select a virtual character based on age, gender, hobbies, and preferences, thereby providing the user with a friendly conversation partner.

[0737] Starting and continuing a conversation

[0738] Users can initiate voice or text-based conversations with selected virtual characters through their devices. The server receives the user's input, generates appropriate responses, and sends them to the device, allowing for the conversation to continue as normal.

[0739] Dementia risk assessment

[0740] The server analyzes the conversation and evaluates language patterns and changes in themes to determine dementia risk. If the risk is high, the server generates a warning message and displays a notification on the device urging the user to seek medical attention.

[0741] Holding a conversation event

[0742] The server periodically holds conversation events in which multiple users participate. The terminal notifies users of the event information, and those who wish to participate gather. During the event, the server monitors the conversation content and checks for slanderous or inappropriate comments.

[0743] Supporting elderly workers

[0744] The server communicates with elderly workers through an interface to help them work safely in the factory, confirming their safety and progress, thereby improving both the work efficiency and safety of elderly workers.

[0745] Notification to family and specialists

[0746] Only with the user's consent will the server notify caregivers and specialists of important dementia risk data, allowing them to more accurately manage the user's health condition.

[0747] Hardware and Software Use

[0748] The system uses the following hardware and software:

[0749] Hardware: Factory robots (with microphones and speakers), central server (consisting of cloud servers)

[0750] Software: Python 3, natural language processing libraries (e.g., NLTK), data analysis libraries (e.g., Pandas)

[0751] Prompt Sentence Examples

[0752] For example, the following prompt sentences are used:

[0753] User registration begins. Please enter your unique user information.

[0754] Hello, User Name! How are you spending your day?

[0755] User Input: Today I sorted parts.

[0756] AI Response Generation: That's interesting. What are you working on next?

[0757] Dementia risk assessment initiated. ....Risk result: normal.

[0758] This system provides an environment where elderly people can enjoy daily conversations while preventing dementia and managing risks, and also improves the safety and efficiency of elderly workers in factories.

[0759] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0760] Step 1:

[0761] The user accesses the system through a terminal and performs initial registration. Specifically, they enter information such as their name, age, gender, hobbies, and preferences. The entered user information is sent to the server and stored in a database. This creates a user profile.

[0762] Step 2:

[0763] The user accesses a virtual character selection screen displayed on the terminal. The server displays a variety of patterns of virtual characters on the terminal. The user selects the desired virtual character based on age, gender, and hobbies and preferences, and the information is sent to the server and associated with the user profile.

[0764] Step 3:

[0765] The user speaks to the virtual character through the device. The server receives the user's voice or text input, analyzes the input using natural language processing techniques, and generates an appropriate response. The response is generated using a generative AI model and sent to the device in text or voice format.

[0766] Step 4:

[0767] The server periodically analyzes the user's conversation data, assessing changes in language patterns and themes in the conversation and determining dementia risk. Using a data analysis library, it evaluates changes in language patterns and consistency of themes and stores the results in a database.

[0768] Step 5:

[0769] If the risk is determined to be high, the server generates a warning message and sends a notification to the device urging the user to see a specialist.

[0770] Step 6:

[0771] The server plans and periodically holds conversation events in which multiple users participate. The terminal notifies users of the event information and gathers those who wish to participate. During the conversation event, the server monitors the content of the conversation and checks for slanderous or inappropriate comments. If inappropriate comments are detected, a warning is issued in real time.

[0772] Step 7:

[0773] The server notifies caregivers and specialists of important dementia risk data only if the user consents. The data is automatically generated and sent to caregivers and specialists via email or notification, facilitating the user's health management.

[0774] Step 8:

[0775] The server communicates with elderly workers through an interface to ensure they can work safely in the factory. It checks work safety and progress and supports the worker's condition. The server monitors the situation in real time through the terminal and robot interface and checks safety.

[0776] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0777] This invention is an AI chatbot system that serves as a conversation partner for elderly people, helping to prevent dementia and assess risk. It also incorporates an emotion engine that recognizes the user's emotions, enabling more personalized responses. Specifically, it creates a profile based on user information and engages in conversation through a virtual character selected by the user. It analyzes the content of the conversation to assess dementia risk, and if the risk is high, issues a warning and encourages the user to see a specialist. It also recognizes the user's emotions and generates responses appropriate to their emotional state. It also provides a mechanism for hosting conversation events with multiple users and monitoring for inappropriate comments.

[0778] System configuration

[0779] This system is mainly composed of a server and a terminal (user device) and is integrated with an emotion engine. The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback.

[0780] Program processing flow and specific examples

[0781] 1. User Registration

[0782] Users access the system through their terminals and perform initial registration. They enter information such as their name, age, gender, and hobbies and interests. This information is sent from the terminal to the server, which then stores it in a database to create a user profile. For example, if a user enters "Yamada Hanako, 75 years old, female, loves reading," the server stores this information in the database.

[0783] 2. AI avatar selection

[0784] The user accesses the AI ​​avatar selection screen using the device. The server provides various AI avatar patterns (age, gender, hobbies, etc.) to the device, and the user selects the desired avatar. For example, if the user selects a "male, 60-year-old, reading-loving avatar," the server associates that avatar with the user profile.

[0785] 3. Starting everyday conversations

[0786] The user speaks to the AI ​​avatar through the device. The server receives the user's voice or text input, analyzes it, and generates an appropriate response. The server then sends the response to the device, which then relays it to the user via voice or text. For example, if the user says, "How are you doing these days?" the server responds, "I'm doing well. How about you?"

[0787] 4. Emotion Recognition by Emotion Engine

[0788] When a user expresses a specific emotion to the AI ​​avatar, the device sends the voice or text to the emotion engine, which analyzes the emotion and assigns an emotion label such as joy, sadness, or anger. For example, if a user says, "I was so happy today!", the emotion engine will recognize the emotion of "joy" from the voice.

[0789] 5. Emotion-based response generation

[0790] The server generates an appropriate response based on the emotional information recognized by the emotion engine. It changes the response expression to the user based on the emotion label. For example, if the emotion engine recognizes "joy," the server generates a response such as "That's good! I'm happy too."

[0791] 6. Dementia risk assessment

[0792] The server periodically analyzes the user's conversation data, assessing language patterns, changes in themes, and emotional consistency to determine dementia risk. If a high risk is determined, the server sends a warning to the device and displays a notification urging the user to consult a specialist. For example, if the user has recently been repeating the same topics, with little change in themes and little emotional expression, the server will generate a warning message.

[0793] 7. Hosting community events

[0794] The server periodically plans and hosts conversation events with other users. The device notifies the user of the event information and the user can participate if they wish. During the event, the server monitors the conversation content and identifies inappropriate comments and negative emotions using an emotion engine. For example, a "gathering of book lovers" event can be held, providing a forum for discussing various books.

[0795] 8. Notification to family and specialists

[0796] If the user agrees, the server provides settings to notify important dementia risk data and negative emotion data generated by the emotion engine to family members and specialists. If the risk assessment is high, the server automatically generates a notification message and displays it to the user via their device, while also sending notifications to family members and specialists. For example, if a user is determined to be at "high risk" and shows a lot of "negative emotions," the server generates and sends a notification.

[0797] As described above, by incorporating an emotion engine, elderly people can enjoy daily conversations with an AI avatar while preventing dementia and managing their risk. In addition, because responses can be made according to emotional states, more personalized care can be provided.

[0798] The processing flow will be explained below.

[0799] User Registration

[0800] Step 1:

[0801] The user accesses the system's registration screen using a terminal and enters personal information such as name, age, sex, hobbies and preferences.

[0802] Step 2:

[0803] The terminal transmits the input information to the server.

[0804] Step 3:

[0805] The server stores the received information in a database and creates a user profile.

[0806] Step 4:

[0807] The server generates a message notifying the terminal that user registration has been completed and sends it to the terminal.

[0808] Step 5:

[0809] The terminal displays a registration completion notice to the user.

[0810] AI avatar selection

[0811] Step 1:

[0812] The user uses the device to access the AI ​​avatar selection screen.

[0813] Step 2:

[0814] The server retrieves available AI avatar information from the database and sends it to the terminal.

[0815] Step 3:

[0816] The terminal displays the AI ​​avatar information received from the server to the user.

[0817] Step 4:

[0818] The user selects the desired AI avatar.

[0819] Step 5:

[0820] The terminal transmits the selected AI avatar information to the server.

[0821] Step 6:

[0822] The server associates the selected avatar with a user profile and stores the associated information in a database.

[0823] Starting everyday conversations

[0824] Step 1:

[0825] Users speak to an AI avatar through their device.

[0826] Step 2:

[0827] The terminal converts the user's voice input into text and sends the text to the server.

[0828] Step 3:

[0829] The server analyzes the received text and retrieves information from a database to generate an appropriate response.

[0830] Step 4:

[0831] The server sends the generated response in text format to the terminal.

[0832] Step 5:

[0833] The terminal synthesizes the text into speech and conveys the response to the user.

[0834] Emotion recognition by emotion engine

[0835] Step 1:

[0836] When a user speaks to an AI avatar, the device sends the voice or text to the emotion engine.

[0837] Step 2:

[0838] The emotion engine analyzes the emotion and assigns an emotion label such as joy, sadness, or anger.

[0839] Step 3:

[0840] The emotion engine sends the assigned emotion label to the server.

[0841] Emotion-based response generation

[0842] Step 1:

[0843] The server receives the emotion information recognized by the emotion engine and generates an appropriate response based thereon.

[0844] Step 2:

[0845] The response expression to the user is changed based on the emotion label.

[0846] Step 3:

[0847] The server transmits the generated response to the terminal, and provides the user with a response according to the emotion.

[0848] Step 4:

[0849] The terminal displays or outputs the response sent from the server to the user as audio.

[0850] Dementia risk assessment

[0851] Step 1:

[0852] The server periodically scans the user's past conversation data and runs algorithms that detect specific language patterns.

[0853] Step 2:

[0854] The server assesses dementia risk by assessing language patterns, thematic shifts, and emotional consistency.

[0855] Step 3:

[0856] If the server determines that the risk is high, it generates a warning message based on the evaluation results.

[0857] Step 4:

[0858] The server sends a warning message to the terminal and displays a notice urging the user to see a specialist.

[0859] Step 5:

[0860] The terminal displays a warning message to the user.

[0861] Hosting community events

[0862] Step 1:

[0863] The server periodically plans conversation events with other users and generates detailed information about them.

[0864] Step 2:

[0865] The server transmits detailed information about the event to the terminal.

[0866] Step 3:

[0867] The terminal notifies the user of the event information and confirms whether the user wishes to participate.

[0868] Step 4:

[0869] The user notifies the server of his / her intention to participate through the terminal.

[0870] Step 5:

[0871] The server assigns participating users to chat rooms for the event and generates link information therefor.

[0872] Step 6:

[0873] The terminal connects the user to the chat room through a link at the start of the event.

[0874] Step 7:

[0875] The server monitors the conversations during the event to check for any abusive or inappropriate comments.

[0876] Notification to family and specialists

[0877] Step 1:

[0878] If the user agrees, the server will set up the system to notify family members or specialists of important dementia risk data and negative emotional data generated by the emotion engine.

[0879] Step 2:

[0880] The server automatically generates a notification message if the risk assessment is high.

[0881] Step 3:

[0882] The server transmits the generated notification message to the terminal and sets it so that the notification is also sent to the user.

[0883] Step 4:

[0884] The terminal displays a notification to the user and simultaneously sends notifications to family members and specialists.

[0885] These are the specific processing steps of a system incorporating an emotion engine that helps prevent dementia and manage risk while allowing elderly people to enjoy daily conversations with an AI avatar. In addition, the system's ability to respond according to emotional states allows for more personalized care.

[0886] Example 2

[0887] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0888] In an aging society, dementia prevention and risk assessment are important issues. However, conventional systems were unable to provide individualized responses and had difficulty accurately capturing users' emotional states. Furthermore, in conversation events involving multiple users, monitoring for inappropriate remarks was insufficient, and the sharing of dementia risk data and emotional data was limited. This made it difficult to enrich users' daily experiences and assist specialists in early diagnosis.

[0889] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select the virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for recognizing the user's emotions and generating responses corresponding to the emotions; means for analyzing the content of the conversation and evaluating language patterns, changes in themes, and emotional consistency to determine dementia risk; means for issuing a warning to the user and displaying a message encouraging the user to seek medical attention if the dementia risk is high; means for periodically hosting conversation events in which multiple users participate and monitoring for slander, inappropriate comments, and negative emotions during the events; and means for notifying caregivers and specialists of important dementia risk data and emotional data if the user consents. This enables personalized responses that accurately reflect the user's emotional state, facilitating early detection of dementia risk and prompt notification to specialists. Furthermore, a rich communication experience can be provided while maintaining user safety.

[0890] "User information" refers to personal information such as name, age, gender, hobbies and preferences that is entered into the system.

[0891] A "user profile" is detailed user information that is created and stored by the server based on user information.

[0892] A "virtual character" is a virtual character that a user can select to interact with within the system.

[0893] "Voice or text-based conversation" refers to a dialogue between a user and a virtual character, either through voice or text.

[0894] An "emotion engine" is software that analyzes a user's voice and text and assigns emotional labels.

[0895] "Emotion recognition" is the process in which the emotion engine analyzes the user's emotions and distinguishes between emotions such as joy, sadness, and anger.

[0896] "Response generation" is the process by which the server creates an appropriate response based on input from the user and the perceived sentiment.

[0897] "Dementia risk assessment" involves the server analyzing a user's conversation data and evaluating language patterns, changes in themes, and emotional consistency to determine the risk of dementia.

[0898] A "warning" is a message generated by the server and displayed on the device when the risk of dementia is high, encouraging a medical examination.

[0899] A "conversation event" is a place for dialogue in which multiple users can participate on a regular basis.

[0900] "Abusive and inappropriate comment monitoring" refers to monitoring activities performed by the server during conversation events to identify inappropriate comments and negative sentiment.

[0901] "Important dementia risk data" is specific data that indicates that a user is at high risk of dementia.

[0902] "Emotion data" is the user's emotional information recognized by the emotion engine.

[0903] "Caregivers" is a general term for family members and facility staff who are responsible for caring for users.

[0904] A "specialist" is a doctor who specializes in diagnosing and treating dementia.

[0905] This invention is an AI chatbot system that acts as a conversation partner for elderly people, helping them prevent dementia and assess their risk. Specifically, it creates a profile based on user information and engages in conversation through a virtual character selected by the user. It analyzes the content of the conversation to assess dementia risk, and if the risk is high, it issues a warning and encourages the user to see a specialist. It also recognizes the user's emotions and generates responses appropriate to their emotional state. It also provides a mechanism for hosting conversation events with multiple users and monitoring for inappropriate comments.

[0906] System configuration

[0907] This system is mainly composed of a server and a terminal (user device) and is integrated with an emotion engine. The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback.

[0908] User Registration

[0909] Users access the system through their terminals and perform initial registration. They enter information such as their name, age, gender, and hobbies and interests. This information is sent from the terminal to the server, which then stores it in a database to create a user profile. For example, if a user enters "Yamada Hanako, 75 years old, female, loves reading," the server stores this information in the database.

[0910] AI avatar selection

[0911] The user accesses the AI ​​avatar selection screen using the device. The server provides various AI avatar patterns (age, gender, hobbies, etc.) to the device, and the user selects the desired avatar. For example, if the user selects a "male, 60-year-old, reading-loving avatar," the server associates that avatar with the user profile.

[0912] Starting everyday conversations

[0913] The user speaks to the AI ​​avatar through the device. The server receives the user's voice or text input, analyzes it, and generates an appropriate response. The server then sends the response to the device, which then relays it to the user via voice or text. For example, if the user says, "How are you doing these days?" the server responds, "I'm doing well. How about you?"

[0914] Emotion recognition by emotion engine

[0915] When a user expresses a specific emotion to the AI ​​avatar, the device sends the voice or text to the emotion engine, which analyzes the emotion and assigns an emotion label such as joy, sadness, or anger. For example, if a user says, "I was so happy today!", the emotion engine will recognize the emotion of "joy" from the voice.

[0916] Emotion-based response generation

[0917] The server generates an appropriate response based on the emotional information recognized by the emotion engine. It changes the response expression to the user based on the emotion label. For example, if the emotion engine recognizes "joy," the server generates a response such as "That's good! I'm happy too."

[0918] Dementia risk assessment

[0919] The server periodically analyzes the user's conversation data, assessing language patterns, changes in themes, and emotional consistency to determine dementia risk. If a high risk is determined, the server sends a warning to the device and displays a notification urging the user to consult a specialist. For example, if the user has recently been repeating the same topics, with little change in themes and little emotional expression, the server will generate a warning message.

[0920] Hosting community events

[0921] The server periodically plans and hosts conversation events with other users. The device notifies the user of the event information and the user can participate if they wish. During the event, the server monitors the conversation content and identifies inappropriate comments and negative emotions using an emotion engine. For example, a "gathering of book lovers" event can be held, providing a forum for discussing various books.

[0922] Notification to family and specialists

[0923] If the user agrees, the server provides settings to notify important dementia risk data and negative emotion data generated by the emotion engine to family members and specialists. If the risk assessment is high, the server automatically generates a notification message and displays it to the user via their device, while also sending notifications to family members and specialists. For example, if a user is determined to be at "high risk" and shows a lot of "negative emotions," the server generates and sends a notification.

[0924] Example prompt

[0925] Prompt when user says "How are you doing?"

[0926] You: How are you doing lately?

[0927] AI Avatar: I'm fine. How about you?

[0928] Prompts for users to express their feelings

[0929] You: Something very exciting happened today!

[0930] AI Avatar: That's great! I'm happy too.

[0931] By incorporating an emotion engine, elderly people can enjoy daily conversations with an AI avatar, which can help prevent dementia and manage the risk of dementia. In addition, the system can respond according to emotional states, allowing for more personalized care.

[0932] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0933] Step 1: User Registration

[0934] User actions: The user accesses the system through a terminal and proceeds to the initial registration screen.

[0935] Input: The user enters information such as name, age, gender, hobbies, and preferences.

[0936] Terminal operation: The terminal sends the entered information to the server.

[0937] Server Action: The server stores the received information in a database and creates a user profile.

[0938] Output: The completed user profile is saved in the database.

[0939] Specific example of operation: The user enters "Yamada Hanako, 75 years old, female, likes reading," and the terminal sends this to the server, which then saves the profile in the database.

[0940] Step 2: Select an AI avatar

[0941] User Action: The user uses the device to access the AI ​​avatar selection screen.

[0942] Input: The server displays various AI avatar patterns on the terminal.

[0943] Terminal operation: The terminal receives an operation to select the desired avatar from the user.

[0944] Server Action: The server receives the selected avatar information and associates it with the user profile.

[0945] Output: The user profile is updated with the selected avatar information.

[0946] Example of specific operation: The user selects an avatar of "male, 60 years old, who likes reading," and the device sends this information to the server, which then registers the information in the user profile.

[0947] Step 3: Starting everyday conversations

[0948] User action: The user speaks to the AI ​​avatar through the device.

[0949] Input: The user types a question or message by voice or text.

[0950] Terminal operation: The terminal sends the user's input to the server.

[0951] Server operation: The server analyzes the received data using a generative AI model and generates an appropriate response.

[0952] Output: The generated reply is sent to the terminal.

[0953] Terminal behavior: The terminal displays the response to the user as voice or text.

[0954] A specific example of how it works: The user asks, "How are you doing these days?", the server generates a response, "I'm doing well. How about you?", and the device conveys this aloud.

[0955] Step 4: Emotion Recognition with the Emotion Engine

[0956] User action: The user makes an emotional statement to the AI ​​avatar.

[0957] Input: User voice or text input.

[0958] Device operation: The device sends the input voice or text to the emotion engine.

[0959] How the Emotion Engine Works: The emotion engine analyzes input and assigns emotion labels.

[0960] Output: Emotion labels are generated and sent to the server.

[0961] A concrete example of how it works: A user types, "Something very happy happened today!", and the emotion engine assigns the label "joy."

[0962] Step 5: Emotion-based response generation

[0963] Server operation: The server generates an appropriate response based on the emotion labels received from the emotion engine.

[0964] Output: The generated reply is sent to the terminal.

[0965] Terminal action: The terminal relays the response to the user.

[0966] Specific example of operation: The emotion engine recognizes "joy," and the server generates a response saying, "That's great! I'm happy too," which is conveyed to the user via the device.

[0967] Step 6: Dementia risk assessment

[0968] Server operation: The server periodically collects and analyzes user conversation data.

[0969] Input: Conversation data, language patterns, thematic shifts, and emotional consistency.

[0970] Data processing: The server analyzes the collected data using statistical methods and AI models to determine the risk of dementia.

[0971] Output: Risk assessment results are generated and warnings are created if necessary.

[0972] Terminal behavior: The terminal displays a warning message to the user.

[0973] Specific example of operation: If a user repeatedly talks about the same topic and there is little change in the topic, the server determines that the user has a high risk of dementia and sends a warning to the device saying, "We recommend that you see a specialist."

[0974] Step 7: Host a community event

[0975] What the server does: Plan and host conversation events with other users.

[0976] Input: Event information, participation application.

[0977] Device operation: Notifies the user of event information and accepts requests to participate.

[0978] Server Actions: Monitor conversations during the event to identify inappropriate language and negative sentiment.

[0979] Output: Warnings and notices are sent to the user as needed.

[0980] Example of how it works: The server plans a "gathering of book lovers" event, and the user wants to participate. The server monitors the conversation and detects inappropriate comments.

[0981] Step 8: Notify family and specialists

[0982] User behavior: If the user consents.

[0983] Input: Dementia risk data, emotion data.

[0984] Server operation: Stores important dementia risk data and emotion data.

[0985] Data processing: The server automatically generates a notification message if the risk assessment is high.

[0986] Output: A notification message is generated and displayed to the user via the terminal, as well as sent to family members and specialists.

[0987] Specific example of operation: If a user is judged to be "high risk" and shows negative emotions, the server generates a notification saying "We recommend you see a specialist" and sends it to the device, family, and specialist.

[0988] (Application example 2)

[0989] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0990] It is difficult to efficiently provide dementia prevention and mental care for elderly people when they shop in physical stores. It is also necessary to provide more satisfying customer service by responding to the emotional state of the elderly. Furthermore, there is a lack of a system for early detection of dementia risk in elderly people and encouraging them to consult an appropriate specialist.

[0991] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0992] In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select the virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for analyzing the content of the conversation and evaluating changes in language patterns and themes to determine dementia risk; means for issuing a warning to the user and displaying a message urging the user to seek medical attention if the dementia risk is high; means for periodically hosting conversation events in which multiple users participate and monitoring the events for defamatory and inappropriate comments; means for notifying a caregiver or specialist of important dementia risk data if the user consents; means for supporting the user's conversation and generating responses according to the user's emotional state via a terminal installed in a physical store; and means including an emotion engine for recognizing the user's emotions and responding accordingly. This allows elderly people to enjoy comfortable shopping in physical stores while also enabling early detection of dementia risk and appropriate mental care.

[0993] "User information" refers to personal information such as the user's name, age, gender, hobbies, and preferences.

[0994] A "user profile" is data that compiles the characteristics and attributes of each user, generated based on user information.

[0995] A "virtual character" is a computer-generated digital character with a variety of patterns that can be selected by the user.

[0996] "Voice or text-based conversation" refers to interaction between a user and a virtual character through speech recognition or text input.

[0997] "Analyzing conversation content" refers to analyzing the content of the dialogue between the user and the virtual character to evaluate changes in language patterns and themes.

[0998] "Dementia risk" refers to the risk of a user's cognitive decline, and is determined from changes in language patterns and themes.

[0999] "Means of issuing a warning and displaying a message encouraging medical attention" is a function that sends a notification to the user recommending that they see a specialist if they are determined to be at high risk of dementia.

[1000] A "conversation event" is an opportunity for multiple users to participate in a group conversation through virtual characters.

[1001] "Means for monitoring slanderous or inappropriate comments" is a function for monitoring content to prevent inappropriate comments from being made during conversation events.

[1002] "Means for notifying caregivers and medical specialists" refers to a mechanism for notifying dementia risk data to caregivers and medical professionals if the user consents.

[1003] A "terminal installed in a physical store" is a digital device that is placed in a physical store and with which users can interact.

[1004] The "means for generating a response according to the emotional state" is a function for recognizing the user's emotions and generating a response appropriate to those emotions.

[1005] The "emotion engine" is a system that analyzes a user's emotions from conversation content and voice data and assigns specific emotion labels.

[1006] This invention is an AI assistant system that uses a terminal installed in a physical store to help elderly people prevent dementia and receive mental care. Specific embodiments for carrying out the invention are described below.

[1007] System configuration and program processing

[1008] Hardware Configuration

[1009] The system of the present invention is mainly composed of the following hardware.

[1010] 1. In-store devices: Smartphones, tablets, interactive digital devices, such as tablets and in-store display devices.

[1011] 2. Server: A cloud-based or in-store server that stores and analyzes data.

[1012] 3. Microphone and speaker: A device with audio input and output capabilities.

[1013] Software Configuration

[1014] The system uses the following software:

[1015] 1. Python: Used as the primary programming language.

[1016] 2. TensorFlow: A deep learning framework for building emotion engines.

[1017] 3. SQLite: Used as a database to store user information and conversation data.

[1018] Specific processing contents of the program

[1019] 1. User Registration

[1020] Users enter basic information such as their name, age, gender, hobbies, and preferences through their terminals. This information is sent from the terminal to the server and stored in a database as a user profile.

[1021] For example: "Please enter your registration information."

[1022] 2. AI avatar selection

[1023] Users select their desired character from a variety of AI avatars displayed on their device, and this selection information is also stored on the server and associated with the user profile.

[1024] For example: "Please select an avatar that is male, 60 years old, and enjoys reading."

[1025] 3. Starting everyday conversations

[1026] Users speak to an AI avatar through their device, and their voice or text input is sent to a server, where it is analyzed and an appropriate response is generated.

[1027] Example: A user types "Hi, how are you?" and the server generates a response "Hi, I'm fine. How are you?"

[1028] 4. Emotion Recognition by Emotion Engine

[1029] Emotions are recognized from the user's voice or text and an emotion label is assigned. For example, emotions such as joy, sadness, and anger are analyzed.

[1030] Example: If a user says, "I'm so happy today!", the emotion engine will recognize "joy."

[1031] 5. Emotion-based response generation

[1032] Based on the emotional information recognized by the emotion engine, an appropriate response is generated. For example, if the emotion of "joy" is recognized, the response will be "That's wonderful!"

[1033] Example: If the emotion engine recognizes "joy," it will respond with "That's great!"

[1034] 6. Dementia risk assessment

[1035] The server periodically analyzes the user's conversations to assess their dementia risk. If the risk is determined to be high, the server generates a warning message and urges the user to seek medical attention.

[1036] Example: If a user is analyzed as having "been talking about the same topic a lot lately," the server will notify them that "we recommend that you see a specialist."

[1037] 7. Hosting conversation events

[1038] The server periodically schedules conversation events in which multiple users participate, notifies users of the event information, and monitors the conversation content during the event to identify inappropriate comments.

[1039] Example: Announcing a "Book Lovers Gathering" event and encouraging users to join.

[1040] 8. Notification to family and specialists

[1041] If the user consents, the server will notify caregivers and specialists of important dementia risk data and emotional information.

[1042] Example: If a user is judged to be at "high" risk of dementia and shows a lot of "negative emotions," the server generates and sends a notification.

[1043] This configuration allows elderly people to enjoy shopping comfortably in brick-and-mortar stores, while also enabling early detection of dementia risk and appropriate mental care. Furthermore, by responding to their emotional state, it is possible to provide more satisfying customer service.

[1044] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1045] Step 1:

[1046] User Registration

[1047] Users input basic information such as name, age, gender, hobbies and interests through their terminals. This input data is sent from the terminal to the server, which stores the information in a database and generates a user profile. Specifically, if a user enters "Yamada Hanako, 75 years old, female, loves reading," the server receives the information and stores it in the database as the profile for "Yamada Hanako."

[1048] Step 2:

[1049] AI avatar selection

[1050] Users select their desired character from a variety of AI avatars displayed on their device. The user's selection is sent from the device to the server, and the server adds the selection information to the user profile. For example, if a user selects an avatar that is "male, 60 years old, and likes reading," the server associates that information with the profile and saves it.

[1051] Step 3:

[1052] Starting everyday conversations

[1053] The user speaks to the AI ​​avatar through the device. This is done in the form of voice input or text input. The device sends this input information to the server, which analyzes the input data and generates an appropriate response. The server then sends the generated response to the device, which then conveys it to the user in voice or text. When the user inputs "Hello, how are you doing?", the server analyzes the input and generates and returns the response "Hello, I'm fine. How are you?"

[1054] Step 4:

[1055] Emotion recognition by emotion engine

[1056] When a user expresses a specific emotion to an AI avatar, the voice or text is sent from the device to the emotion engine. The emotion engine analyzes the input data and assigns an emotion label such as joy, sadness, or anger. For example, if a user says, "I'm so happy today!", the emotion engine analyzes the voice data and assigns the emotion label "joy."

[1057] Step 5:

[1058] Emotion-based response generation

[1059] The server generates an appropriate response based on the emotional information recognized by the emotion engine. The expression of this response changes depending on the emotion. For example, if the emotion engine recognizes "joy," the server generates a response according to the emotion, such as "That's wonderful!", and sends it to the device. The device then conveys this response to the user.

[1060] Step 6:

[1061] Dementia risk assessment

[1062] The server periodically analyzes the user's conversations, assessing language patterns, changes in themes, and emotional consistency to determine dementia risk. If a high risk is determined, the server generates a warning message and sends it to the device, urging the user to seek medical advice. For example, if the server determines that a user has been repeatedly talking about the same topics recently, it will notify the user by saying, "We recommend that you see a specialist."

[1063] Step 7:

[1064] Holding a conversation event

[1065] The server plans conversation events in which multiple users will participate and notifies users of the event information via their devices. Users can participate if they wish. During the event, the server monitors the conversation content and identifies inappropriate comments and negative emotions using an emotion engine. For example, a "gathering of book lovers" event is planned, the server notifies the device of the information, and users can participate.

[1066] Step 8:

[1067] Notification to family and specialists

[1068] If the user agrees, the server will notify caregivers and specialists of important dementia risk data and negative emotion data generated by the emotion engine. For example, if a user is judged to be at "high" dementia risk and shows a lot of "negative emotions," the server will pass that information to the notification generation system, which will then generate and send a notification.

[1069] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1070] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1071] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1072] [Third embodiment]

[1073] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1074] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1075] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1076] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1077] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1078] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1079] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1080] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1081] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1082] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1083] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1084] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1085] This invention is an AI chatbot system that acts as a conversation partner for elderly people and is useful for preventing dementia and assessing their risk. Specifically, the system aims to prevent dementia by creating a profile based on user information and engaging in conversations through a virtual character selected by the user. The system also analyzes conversation content to assess dementia risk, and if the risk is high, issues a warning and encourages the user to see a specialist. Furthermore, it provides a mechanism for hosting conversation events with multiple users and monitoring inappropriate comments.

[1086] System configuration

[1087] This system mainly consists of a server and a terminal (user device). The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback.

[1088] Program processing flow and specific examples

[1089] 1. User Registration

[1090] Users access the system through their terminals and perform initial registration. They enter information such as their name, age, gender, and hobbies and preferences. This information is sent from the terminal to the server, which then stores it in a database to create a user profile. For example, if a user enters "Taro Tanaka, 70 years old, male, likes music," the server stores this information in the database.

[1091] 2. AI avatar selection

[1092] The user accesses the AI ​​avatar selection screen using the device. The server provides various AI avatar patterns (age, gender, hobbies, etc.) to the device, and the user selects the desired avatar. For example, if the user selects a "female, 50-year-old, music-loving avatar," the server associates that avatar with the user profile.

[1093] 3. Starting everyday conversations

[1094] The user speaks to the AI ​​avatar through the device. The server receives the user's voice or text input, analyzes it, and generates an appropriate response. The server then sends the response to the device, which then relays it to the user via voice or text. For example, if the user asks, "What's the weather like today?" the server retrieves the weather information and responds, "It's sunny today, and the temperature is 25 degrees."

[1095] 4. Dementia risk assessment

[1096] The server periodically analyzes the user's conversation data and assesses their dementia risk based on changes in language patterns and themes. If the risk is determined to be high, the server sends a warning to the device and displays a notification urging them to see a specialist. For example, if a user has recently been repeating the same topics with little change in themes, the server will notify them, "Your risk of dementia may be increasing. We recommend that you see a specialist."

[1097] 5. Hosting community events

[1098] The server periodically plans and holds conversation events with other users. The device notifies the user of the event information, and the user can participate if they wish. During the event, the server monitors the conversation content and checks for slanderous or inappropriate comments. For example, a "music lovers' gathering" event can be held, providing a forum for discussing various music topics.

[1099] 6. Notification to family and specialists

[1100] The server will be configured to notify important dementia risk data to family members and specialists only if the user agrees. If the risk assessment is high, the server will automatically generate a notification message, which will be displayed to the user on their device and will also be sent to family members and specialists. For example, if a user is judged to be at "high risk," the server will send a notification stating, "Taro Tanaka's dementia risk is increasing."

[1101] In this way, this system provides an environment where elderly people can prevent dementia and manage their risk while enjoying everyday conversations.

[1102] The processing flow will be explained below.

[1103] User Registration

[1104] Step 1:

[1105] The user accesses the system's registration screen using a terminal and enters personal information such as name, age, sex, hobbies and preferences.

[1106] Step 2:

[1107] The terminal transmits the input information to the server.

[1108] Step 3:

[1109] The server stores the received information in a database and creates a user profile.

[1110] Step 4:

[1111] The server sends a notification to the terminal indicating that the user registration is complete.

[1112] Step 5:

[1113] The terminal displays a registration completion notice to the user.

[1114] AI avatar selection

[1115] Step 1:

[1116] The user uses the device to access the AI ​​avatar selection screen.

[1117] Step 2:

[1118] The server sends available AI avatar information from the database to the terminal.

[1119] Step 3:

[1120] The terminal displays the AI ​​avatar information received from the server to the user.

[1121] Step 4:

[1122] The user selects the desired AI avatar.

[1123] Step 5:

[1124] The terminal transmits the selected AI avatar information to the server.

[1125] Step 6:

[1126] The server associates the selected avatar with a user profile and stores the associated information in a database.

[1127] Starting everyday conversations

[1128] Step 1:

[1129] Users speak to an AI avatar through their device.

[1130] Step 2:

[1131] The terminal converts the user's voice input into text and sends the text to the server.

[1132] Step 3:

[1133] The server analyzes the received text and retrieves information from a database to generate an appropriate response.

[1134] Step 4:

[1135] The server sends the generated response in text format to the terminal.

[1136] Step 5:

[1137] The terminal synthesizes the text into speech and conveys the response to the user.

[1138] Dementia risk assessment

[1139] Step 1:

[1140] The server periodically scans the user's past conversation data and runs algorithms that detect specific language patterns.

[1141] Step 2:

[1142] The server assesses dementia risk by assessing changes in language patterns and themes.

[1143] Step 3:

[1144] If the server determines that the risk is high, it generates a warning message based on the evaluation results.

[1145] Step 4:

[1146] The server sends a warning message to the terminal and displays a notice urging the user to see a specialist.

[1147] Step 5:

[1148] The terminal displays a warning message to the user.

[1149] Hosting community events

[1150] Step 1:

[1151] The server periodically plans conversation events with other users and generates detailed information about them.

[1152] Step 2:

[1153] The server transmits detailed information about the event to the terminal.

[1154] Step 3:

[1155] The terminal notifies the user of the event information and confirms whether the user wishes to participate.

[1156] Step 4:

[1157] The user notifies the server of his / her intention to participate through the terminal.

[1158] Step 5:

[1159] The server assigns participating users to chat rooms for the event and generates link information therefor.

[1160] Step 6:

[1161] The terminal connects the user to the chat room through a link at the start of the event.

[1162] Step 7:

[1163] The server monitors the conversations during the event to check for any abusive or inappropriate comments.

[1164] Notification to family and specialists

[1165] Step 1:

[1166] If the user has given their consent, the server will configure the system to notify family members and specialists of important dementia risk data.

[1167] Step 2:

[1168] The server automatically generates a notification message if the risk assessment is high.

[1169] Step 3:

[1170] The server transmits the generated notification message to the terminal and sets it so that the notification is also sent to the user.

[1171] Step 4:

[1172] The terminal displays a notification to the user and simultaneously sends notifications to family members and specialists.

[1173] These are the specific processing steps. This will enable elderly people to enjoy daily conversations with AI avatars while also helping to prevent dementia and manage their risk.

[1174] Example 1

[1175] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1176] The elderly population is increasing in modern society, making the prevention and early detection of dementia an important issue. However, many elderly people tend to be isolated from their daily lives, and opportunities for conversation decrease, which may increase their risk of dementia. In addition, there are limited means to assess the risk of dementia early and take appropriate measures, so detection is often delayed. Furthermore, a system is needed to facilitate communication between elderly people and to prevent inappropriate remarks.

[1177] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1178] In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select a virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for analyzing the content of the conversation and evaluating changes in language patterns and themes to determine dementia risk; means for issuing a warning to the user and displaying a message urging the user to seek medical attention if the dementia risk is high; means for periodically holding conversation events in which multiple users participate and monitoring for slanderous or inappropriate comments during the events; means for notifying caregivers and specialists of important dementia risk data if the user consents; means for converting the user's voice input into text data, generating appropriate response data using natural language processing technology, and transmitting the response data to the user; and means for monitoring the content of the conversations in real time during conversation events and detecting slanderous or inappropriate comments using specific keywords as triggers. This enables elderly people to prevent dementia and manage their risk while enjoying daily conversations.

[1179] "User information" refers to personal data such as name, age, gender, hobbies and preferences that users enter into the system.

[1180] "User Profile" means a database record about an individual user that the system creates based on user information.

[1181] A "virtual character" is a digital character that the system displays and that has a variety of patterns that the user can select.

[1182] "Voice or text-based conversation" refers to a dialogue between a user and a virtual character using voice or text input.

[1183] "Conversation content" refers to the content of the audio or text exchanges that take place between the user and the virtual character.

[1184] A "language pattern" is a specific pattern of words and expressions used in conversational content.

[1185] A "change in topic" is a change in how the topic shifts in the content of a conversation.

[1186] "Dementia risk" is an index that evaluates the possibility that a user will develop dementia.

[1187] "Slander" is the act of insulting or speaking ill of others.

[1188] "Inappropriate remarks" are remarks that are socially unacceptable or that offend others.

[1189] "Natural language processing technology" is a technology that allows computers to understand and analyze human language.

[1190] A "generative AI model" is a model for automatically generating text data using artificial intelligence.

[1191] This invention is an AI chatbot system that acts as a conversation partner for elderly people and is useful for preventing dementia and assessing their risk. Specifically, the system aims to prevent dementia by creating a profile based on user information and engaging in conversations through a virtual character selected by the user. The system also analyzes conversation content to assess dementia risk, and if the risk is high, issues a warning and encourages the user to see a specialist. Furthermore, it provides a mechanism for hosting conversation events with multiple users and monitoring inappropriate comments.

[1192] The system primarily consists of a server and a terminal (user device). The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback. The server uses a high-performance database system and natural language processing (NLP) technology, utilizing generative AI models (such as GPT-4). The server also analyzes conversation data and runs algorithms to detect language patterns and thematic shifts.

[1193] As a specific example of operation, consider a scenario in which a user initially registers with the system. First, the user enters information such as name, age, gender, and hobbies and preferences. This information is sent from the device to the server, which stores it in a database and creates a user profile. The user then accesses a virtual character selection screen and selects the desired avatar. The server associates that avatar with the user profile.

[1194] Next, an everyday conversation takes place between the user and the virtual character. When the user asks, "What's the weather like today?", the server converts the voice data into text and analyzes it using NLP technology. The generative AI model then generates a response, and the server sends the appropriate response, "It's sunny today, and the temperature is 25 degrees," to the device and tells the user.

[1195] Furthermore, the server periodically analyzes conversation data to detect changes in language patterns and themes to assess dementia risk. If the risk increases, a warning will be issued on the device, displaying a message saying, "You may be at increased risk of dementia. We recommend that you seek medical advice from a specialist."

[1196] The server also periodically plans and holds conversation events with other users. The device notifies the user of the event information, and the user can participate if they wish. During the event, the server monitors the conversation in real time to check for slanderous or inappropriate comments.

[1197] Finally, if the user agrees, the server configures the system to notify family members and specialists of important dementia risk data. If the risk assessment is high, the server sends an automatically generated notification message to family members and specialists.

[1198] Examples of prompts include:

[1199] "Register as Taro Tanaka, 70 years old, male, and music lover, and select a 50-year-old female avatar who also loves music. Talk to that avatar and ask, 'How's the weather today?'"

[1200] "Use the conversation to determine dementia risk and find out how you will be notified if you are at high risk."

[1201] "Attend community events and see what conversations happen."

[1202] As described above, this system provides an environment where elderly people can prevent dementia and manage their risk while enjoying everyday conversations.

[1203] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1204] Step 1: User Registration

[1205] 1.1 Users access the system through a terminal. Users input personal information such as name, age, gender, hobbies, and preferences into a form.

[1206] 1.2 The device sends the information entered by the user to the server. The information is sent to the server as an HTTP POST request.

[1207] 1.3 The server validates the received input data and stores it in the database. Specifically, the server creates a new user profile in the database and stores the input data.

[1208] 1.4 The server returns a confirmation message to the terminal indicating that the save was completed successfully. The terminal displays this message on the screen to notify the user that the registration has been completed.

[1209] Step 2: Select an AI avatar

[1210] 2.1 The user uses a device to access the AI ​​avatar selection screen, which displays a list of various virtual characters.

[1211] 2.2 The server provides the terminal with an avatar list, which includes various pre-designed character attributes (e.g., age, gender, hobbies, etc.).

[1212] 2.3 The user selects the desired avatar, and the device sends the selection information to the server as an HTTP POST request.

[1213] 2.4 The server associates the received avatar information with the user profile and stores it in a database. The server then sends a confirmation message back to the device indicating that the association is complete.

[1214] 2.5 The device will display a confirmation message on the screen to notify the user that the avatar selection is complete.

[1215] Step 3: Starting everyday conversations

[1216] 3.1 The user speaks to the AI ​​avatar through the device, and questions and conversation content are entered into the device as voice input or text input.

[1217] 3.2 The device converts the voice input into text data and sends it to the server. The voice data is converted into text data using voice recognition technology.

[1218] 3.3 The server analyzes the received text data using natural language processing (NLP) technology. Specifically, the server uses a generative AI model (e.g., GPT-4) to understand the user's intent and generate an appropriate response.

[1219] 3.4 The server sends the generated response data to the device, which then displays the received data as text or outputs it as voice using speech synthesis technology.

[1220] 3.5 The device will then relay the response to the user, allowing them to continue the conversation. If the user says, "What's the weather like today?", the device will display the response, "It's sunny today, and the temperature is 25 degrees."

[1221] Step 4: Dementia risk assessment

[1222] 4.1 The server periodically collects and stores user conversation data, which is then stored in a database.

[1223] 4.2 The server analyzes the collected conversation data to detect shifts in language patterns and themes. It uses a generative AI model to identify shifts in language patterns and repetition of the same topics.

[1224] 4.3 The server evaluates dementia risk based on the analysis results and calculates a risk score. If the risk score is high, a warning flag is raised.

[1225] 4.4 If the risk assessment is high, the server sends a warning message to the device, which displays the message "You may be at increased risk of dementia. We recommend that you consult a specialist."

[1226] Step 5: Host a community event

[1227] 5.1 The server periodically plans and schedules conversation events, and the event information is stored in a database.

[1228] 5.2 The device notifies the user of event information. Notifications are provided as push messages.

[1229] 5.3 If the user wishes to participate, the device sends a notification to the server, and the user taps the "Join" button on the screen.

[1230] 5.4 During the event, the server will monitor conversations in real time, using generative AI models to detect abusive or inappropriate language.

[1231] 5.5 If the server detects inappropriate comments, it will send a warning message to the device, which will be displayed to all event participants.

[1232] Step 6: Notify family and specialists

[1233] 6.1 If the user agrees, the server will configure the notification of risk data to family members and specialists. The configuration information will be stored in the database.

[1234] 6.2 If the server determines that the person is at high risk, it automatically generates a notification message, such as "Taro Tanaka's risk of dementia is increasing."

[1235] 6.3 The server sends the generated notification message to the user's family or specialist. The notification is sent as an email or push notification.

[1236] 6.4 The device will display and allow the user to acknowledge that a notification has been sent. The screen will display the message "Notification sent."

[1237] (Application example 1)

[1238] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1239] In addition to preventing dementia and assessing risk in the elderly, there is a need for a system that integrates safety confirmation and work progress confirmation for elderly workers in factories. However, currently these functions are independent, and there is no system in place for elderly workers to receive dementia risk assessments or psychological support through conversations during their daily work. This could lead to a decrease in the work efficiency of elderly workers in factories and an increase in safety risks.

[1240] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1241] In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select the virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for analyzing the content of the conversation and evaluating changes in language patterns and themes to determine dementia risk; means for issuing a warning to the user and displaying a message urging the user to seek medical attention if the dementia risk is high; means for periodically hosting conversation events in which multiple users participate and monitoring for defamatory or inappropriate comments during the events; means for notifying caregivers or specialists of important dementia risk data if the user consents; and interface means for conducting conversations with elderly workers in factories and supporting safety and work progress checks. This enables elderly workers to enjoy daily conversations while preventing dementia and managing risks, and further improves the safety and efficiency of work in factories.

[1242] "User information" refers to basic personal attribute information about system users (e.g., name, age, gender, hobbies and preferences).

[1243] A "user profile" is an individual information record created based on user information, including conversation content and system usage.

[1244] A "virtual character" is a purposefully created digital persona or avatar with which a user chooses to interact.

[1245] "Voice or text-based conversation" means a method of communication between a user and a virtual character, including both voice and text input.

[1246] "Changes in language patterns and themes" refers to the patterns of words used and changes in topics during conversation, and are indicators for assessing dementia risk.

[1247] "Dementia risk" is a numerical value or assessment result used to evaluate the likelihood that a user will develop dementia.

[1248] A "warning message urging a visit to a doctor" is a notification sent to users when they are at high risk of dementia, and includes content urging them to visit a specialist.

[1249] A "conversation event" is a gathering of multiple users to discuss a specific topic, and is a regularly held online or offline event.

[1250] "Means for monitoring abusive and inappropriate comments" refers to technology for monitoring comments made by users during conversation events and detecting abusive and inappropriate comments.

[1251] "Important dementia risk data" refers to important information obtained as a result of dementia risk assessment, which is used to manage the user's health status by informing caregivers and specialists.

[1252] "Caregivers and specialists" are professionals who are responsible for managing the health of users and providing medical care.

[1253] An "interface means" is a physical or digital medium through which a user directly interacts with a system.

[1254] An "interface means for communicating with elderly workers in a factory and assisting in checking safety or the progress of work" is a device or software that is placed in a factory and allows communication with elderly workers to check the safety and progress of work.

[1255] This invention can be specifically implemented as an AI chatbot system aimed at preventing dementia and supporting work in the elderly. This system consists of a server and a terminal (user device). The terminal receives user input, and the server analyzes and stores that information and provides appropriate feedback.

[1256] Entering user information and creating a profile

[1257] When a user inputs personal information such as name, age, gender, and hobbies and preferences through a terminal, the server creates a user profile based on that information, and then provides a virtual character and conversation content that is suited to each individual user.

[1258] Selecting a virtual character

[1259] The server displays various patterns of virtual characters on the terminal, and the user can select a virtual character based on age, gender, hobbies, and preferences, thereby providing the user with a friendly conversation partner.

[1260] Starting and continuing a conversation

[1261] Users can initiate voice or text-based conversations with selected virtual characters through their devices. The server receives the user's input, generates appropriate responses, and sends them to the device, allowing for the conversation to continue as normal.

[1262] Dementia risk assessment

[1263] The server analyzes the conversation and evaluates language patterns and changes in themes to determine dementia risk. If the risk is high, the server generates a warning message and displays a notification on the device urging the user to seek medical attention.

[1264] Holding a conversation event

[1265] The server periodically holds conversation events in which multiple users participate. The terminal notifies users of the event information, and those who wish to participate gather. During the event, the server monitors the conversation content and checks for slanderous or inappropriate comments.

[1266] Supporting elderly workers

[1267] The server communicates with elderly workers through an interface to help them work safely in the factory, confirming their safety and progress, thereby improving both the work efficiency and safety of elderly workers.

[1268] Notification to family and specialists

[1269] Only with the user's consent will the server notify caregivers and specialists of important dementia risk data, allowing them to more accurately manage the user's health condition.

[1270] Hardware and Software Use

[1271] The system uses the following hardware and software:

[1272] Hardware: Factory robots (with microphones and speakers), central server (consisting of cloud servers)

[1273] Software: Python 3, natural language processing libraries (e.g., NLTK), data analysis libraries (e.g., Pandas)

[1274] Prompt Sentence Examples

[1275] For example, the following prompt sentences are used:

[1276] User registration begins. Please enter your unique user information.

[1277] Hello, User Name! How are you spending your day?

[1278] User Input: Today I sorted parts.

[1279] AI Response Generation: That's interesting. What are you working on next?

[1280] Dementia risk assessment initiated. ....Risk result: normal.

[1281] This system provides an environment where elderly people can enjoy daily conversations while preventing dementia and managing risks, and also improves the safety and efficiency of elderly workers in factories.

[1282] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1283] Step 1:

[1284] The user accesses the system through a terminal and performs initial registration. Specifically, they enter information such as their name, age, gender, hobbies, and preferences. The entered user information is sent to the server and stored in a database. This creates a user profile.

[1285] Step 2:

[1286] The user accesses a virtual character selection screen displayed on the terminal. The server displays a variety of patterns of virtual characters on the terminal. The user selects the desired virtual character based on age, gender, and hobbies and preferences, and the information is sent to the server and associated with the user profile.

[1287] Step 3:

[1288] The user speaks to the virtual character through the device. The server receives the user's voice or text input, analyzes the input using natural language processing techniques, and generates an appropriate response. The response is generated using a generative AI model and sent to the device in text or voice format.

[1289] Step 4:

[1290] The server periodically analyzes the user's conversation data, assessing changes in language patterns and themes in the conversation and determining dementia risk. Using a data analysis library, it evaluates changes in language patterns and consistency of themes and stores the results in a database.

[1291] Step 5:

[1292] If the risk is determined to be high, the server generates a warning message and sends a notification to the device urging the user to see a specialist.

[1293] Step 6:

[1294] The server plans and periodically holds conversation events in which multiple users participate. The terminal notifies users of the event information and gathers those who wish to participate. During the conversation event, the server monitors the content of the conversation and checks for slanderous or inappropriate comments. If inappropriate comments are detected, a warning is issued in real time.

[1295] Step 7:

[1296] The server notifies caregivers and specialists of important dementia risk data only if the user consents. The data is automatically generated and sent to caregivers and specialists via email or notification, facilitating the user's health management.

[1297] Step 8:

[1298] The server communicates with elderly workers through an interface to ensure they can work safely in the factory. It checks work safety and progress and supports the worker's condition. The server monitors the situation in real time through the terminal and robot interface and checks safety.

[1299] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1300] This invention is an AI chatbot system that serves as a conversation partner for elderly people, helping to prevent dementia and assess risk. It also incorporates an emotion engine that recognizes the user's emotions, enabling more personalized responses. Specifically, it creates a profile based on user information and engages in conversation through a virtual character selected by the user. It analyzes the content of the conversation to assess dementia risk, and if the risk is high, issues a warning and encourages the user to see a specialist. It also recognizes the user's emotions and generates responses appropriate to their emotional state. It also provides a mechanism for hosting conversation events with multiple users and monitoring for inappropriate comments.

[1301] System configuration

[1302] This system is mainly composed of a server and a terminal (user device) and is integrated with an emotion engine. The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback.

[1303] Program processing flow and specific examples

[1304] 1. User Registration

[1305] Users access the system through their terminals and perform initial registration. They enter information such as their name, age, gender, and hobbies and interests. This information is sent from the terminal to the server, which then stores it in a database to create a user profile. For example, if a user enters "Yamada Hanako, 75 years old, female, loves reading," the server stores this information in the database.

[1306] 2. AI avatar selection

[1307] The user accesses the AI ​​avatar selection screen using the device. The server provides various AI avatar patterns (age, gender, hobbies, etc.) to the device, and the user selects the desired avatar. For example, if the user selects a "male, 60-year-old, reading-loving avatar," the server associates that avatar with the user profile.

[1308] 3. Starting everyday conversations

[1309] The user speaks to the AI ​​avatar through the device. The server receives the user's voice or text input, analyzes it, and generates an appropriate response. The server then sends the response to the device, which then relays it to the user via voice or text. For example, if the user says, "How are you doing these days?" the server responds, "I'm doing well. How about you?"

[1310] 4. Emotion Recognition by Emotion Engine

[1311] When a user expresses a specific emotion to the AI ​​avatar, the device sends the voice or text to the emotion engine, which analyzes the emotion and assigns an emotion label such as joy, sadness, or anger. For example, if a user says, "I was so happy today!", the emotion engine will recognize the emotion of "joy" from the voice.

[1312] 5. Emotion-based response generation

[1313] The server generates an appropriate response based on the emotional information recognized by the emotion engine. It changes the response expression to the user based on the emotion label. For example, if the emotion engine recognizes "joy," the server generates a response such as "That's good! I'm happy too."

[1314] 6. Dementia risk assessment

[1315] The server periodically analyzes the user's conversation data, assessing language patterns, changes in themes, and emotional consistency to determine dementia risk. If a high risk is determined, the server sends a warning to the device and displays a notification urging the user to consult a specialist. For example, if the user has recently been repeating the same topics, with little change in themes and little emotional expression, the server will generate a warning message.

[1316] 7. Hosting community events

[1317] The server periodically plans and hosts conversation events with other users. The device notifies the user of the event information and the user can participate if they wish. During the event, the server monitors the conversation content and identifies inappropriate comments and negative emotions using an emotion engine. For example, a "gathering of book lovers" event can be held, providing a forum for discussing various books.

[1318] 8. Notification to family and specialists

[1319] If the user agrees, the server provides settings to notify important dementia risk data and negative emotion data generated by the emotion engine to family members and specialists. If the risk assessment is high, the server automatically generates a notification message and displays it to the user via their device, while also sending notifications to family members and specialists. For example, if a user is determined to be at "high risk" and shows a lot of "negative emotions," the server generates and sends a notification.

[1320] As described above, by incorporating an emotion engine, elderly people can enjoy daily conversations with an AI avatar while preventing dementia and managing their risk. In addition, because responses can be made according to emotional states, more personalized care can be provided.

[1321] The processing flow will be explained below.

[1322] User Registration

[1323] Step 1:

[1324] The user accesses the system's registration screen using a terminal and enters personal information such as name, age, sex, hobbies and preferences.

[1325] Step 2:

[1326] The terminal transmits the input information to the server.

[1327] Step 3:

[1328] The server stores the received information in a database and creates a user profile.

[1329] Step 4:

[1330] The server generates a message notifying the terminal that user registration has been completed and sends it to the terminal.

[1331] Step 5:

[1332] The terminal displays a registration completion notice to the user.

[1333] AI avatar selection

[1334] Step 1:

[1335] The user uses the device to access the AI ​​avatar selection screen.

[1336] Step 2:

[1337] The server retrieves available AI avatar information from the database and sends it to the terminal.

[1338] Step 3:

[1339] The terminal displays the AI ​​avatar information received from the server to the user.

[1340] Step 4:

[1341] The user selects the desired AI avatar.

[1342] Step 5:

[1343] The terminal transmits the selected AI avatar information to the server.

[1344] Step 6:

[1345] The server associates the selected avatar with a user profile and stores the associated information in a database.

[1346] Starting everyday conversations

[1347] Step 1:

[1348] Users speak to an AI avatar through their device.

[1349] Step 2:

[1350] The terminal converts the user's voice input into text and sends the text to the server.

[1351] Step 3:

[1352] The server analyzes the received text and retrieves information from a database to generate an appropriate response.

[1353] Step 4:

[1354] The server sends the generated response in text format to the terminal.

[1355] Step 5:

[1356] The terminal synthesizes the text into speech and conveys the response to the user.

[1357] Emotion recognition by emotion engine

[1358] Step 1:

[1359] When a user speaks to an AI avatar, the device sends the voice or text to the emotion engine.

[1360] Step 2:

[1361] The emotion engine analyzes the emotion and assigns an emotion label such as joy, sadness, or anger.

[1362] Step 3:

[1363] The emotion engine sends the assigned emotion label to the server.

[1364] Emotion-based response generation

[1365] Step 1:

[1366] The server receives the emotion information recognized by the emotion engine and generates an appropriate response based thereon.

[1367] Step 2:

[1368] The response expression to the user is changed based on the emotion label.

[1369] Step 3:

[1370] The server transmits the generated response to the terminal, and provides the user with a response according to the emotion.

[1371] Step 4:

[1372] The terminal displays or outputs the response sent from the server to the user as audio.

[1373] Dementia risk assessment

[1374] Step 1:

[1375] The server periodically scans the user's past conversation data and runs algorithms that detect specific language patterns.

[1376] Step 2:

[1377] The server assesses dementia risk by assessing language patterns, thematic shifts, and emotional consistency.

[1378] Step 3:

[1379] If the server determines that the risk is high, it generates a warning message based on the evaluation results.

[1380] Step 4:

[1381] The server sends a warning message to the terminal and displays a notice urging the user to see a specialist.

[1382] Step 5:

[1383] The terminal displays a warning message to the user.

[1384] Hosting community events

[1385] Step 1:

[1386] The server periodically plans conversation events with other users and generates detailed information about them.

[1387] Step 2:

[1388] The server transmits detailed information about the event to the terminal.

[1389] Step 3:

[1390] The terminal notifies the user of the event information and confirms whether the user wishes to participate.

[1391] Step 4:

[1392] The user notifies the server of his / her intention to participate through the terminal.

[1393] Step 5:

[1394] The server assigns participating users to chat rooms for the event and generates link information therefor.

[1395] Step 6:

[1396] The terminal connects the user to the chat room through a link at the start of the event.

[1397] Step 7:

[1398] The server monitors the conversations during the event to check for any abusive or inappropriate comments.

[1399] Notification to family and specialists

[1400] Step 1:

[1401] If the user agrees, the server will set up the system to notify family members or specialists of important dementia risk data and negative emotional data generated by the emotion engine.

[1402] Step 2:

[1403] The server automatically generates a notification message if the risk assessment is high.

[1404] Step 3:

[1405] The server transmits the generated notification message to the terminal and sets it so that the notification is also sent to the user.

[1406] Step 4:

[1407] The terminal displays a notification to the user and simultaneously sends notifications to family members and specialists.

[1408] These are the specific processing steps of a system incorporating an emotion engine that helps prevent dementia and manage risk while allowing elderly people to enjoy daily conversations with an AI avatar. In addition, the system's ability to respond according to emotional states allows for more personalized care.

[1409] Example 2

[1410] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1411] In an aging society, dementia prevention and risk assessment are important issues. However, conventional systems were unable to provide individualized responses and had difficulty accurately capturing users' emotional states. Furthermore, in conversation events involving multiple users, monitoring for inappropriate remarks was insufficient, and the sharing of dementia risk data and emotional data was limited. This made it difficult to enrich users' daily experiences and assist specialists in early diagnosis.

[1412] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select the virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for recognizing the user's emotions and generating responses corresponding to the emotions; means for analyzing the content of the conversation and evaluating language patterns, changes in themes, and emotional consistency to determine dementia risk; means for issuing a warning to the user and displaying a message encouraging the user to seek medical attention if the dementia risk is high; means for periodically hosting conversation events in which multiple users participate and monitoring for slander, inappropriate comments, and negative emotions during the events; and means for notifying caregivers and specialists of important dementia risk data and emotional data if the user consents. This enables personalized responses that accurately reflect the user's emotional state, facilitating early detection of dementia risk and prompt notification to specialists. Furthermore, a rich communication experience can be provided while maintaining user safety.

[1413] "User information" refers to personal information such as name, age, gender, hobbies and preferences that is entered into the system.

[1414] A "user profile" is detailed user information that is created and stored by the server based on user information.

[1415] A "virtual character" is a virtual character that a user can select to interact with within the system.

[1416] "Voice or text-based conversation" refers to a dialogue between a user and a virtual character, either through voice or text.

[1417] An "emotion engine" is software that analyzes a user's voice and text and assigns emotional labels.

[1418] "Emotion recognition" is the process in which the emotion engine analyzes the user's emotions and distinguishes between emotions such as joy, sadness, and anger.

[1419] "Response generation" is the process by which the server creates an appropriate response based on input from the user and the perceived sentiment.

[1420] "Dementia risk assessment" involves the server analyzing a user's conversation data and evaluating language patterns, changes in themes, and emotional consistency to determine the risk of dementia.

[1421] A "warning" is a message generated by the server and displayed on the device when the risk of dementia is high, encouraging a medical examination.

[1422] A "conversation event" is a place for dialogue in which multiple users can participate on a regular basis.

[1423] "Abusive and inappropriate comment monitoring" refers to monitoring activities performed by the server during conversation events to identify inappropriate comments and negative sentiment.

[1424] "Important dementia risk data" is specific data that indicates that a user is at high risk of dementia.

[1425] "Emotion data" is the user's emotional information recognized by the emotion engine.

[1426] "Caregivers" is a general term for family members and facility staff who are responsible for caring for users.

[1427] A "specialist" is a doctor who specializes in diagnosing and treating dementia.

[1428] This invention is an AI chatbot system that acts as a conversation partner for elderly people, helping them prevent dementia and assess their risk. Specifically, it creates a profile based on user information and engages in conversation through a virtual character selected by the user. It analyzes the content of the conversation to assess dementia risk, and if the risk is high, it issues a warning and encourages the user to see a specialist. It also recognizes the user's emotions and generates responses appropriate to their emotional state. It also provides a mechanism for hosting conversation events with multiple users and monitoring for inappropriate comments.

[1429] System configuration

[1430] This system is mainly composed of a server and a terminal (user device) and is integrated with an emotion engine. The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback.

[1431] User Registration

[1432] Users access the system through their terminals and perform initial registration. They enter information such as their name, age, gender, and hobbies and interests. This information is sent from the terminal to the server, which then stores it in a database to create a user profile. For example, if a user enters "Yamada Hanako, 75 years old, female, loves reading," the server stores this information in the database.

[1433] AI avatar selection

[1434] The user accesses the AI ​​avatar selection screen using the device. The server provides various AI avatar patterns (age, gender, hobbies, etc.) to the device, and the user selects the desired avatar. For example, if the user selects a "male, 60-year-old, reading-loving avatar," the server associates that avatar with the user profile.

[1435] Starting everyday conversations

[1436] The user speaks to the AI ​​avatar through the device. The server receives the user's voice or text input, analyzes it, and generates an appropriate response. The server then sends the response to the device, which then relays it to the user via voice or text. For example, if the user says, "How are you doing these days?" the server responds, "I'm doing well. How about you?"

[1437] Emotion recognition by emotion engine

[1438] When a user expresses a specific emotion to the AI ​​avatar, the device sends the voice or text to the emotion engine, which analyzes the emotion and assigns an emotion label such as joy, sadness, or anger. For example, if a user says, "I was so happy today!", the emotion engine will recognize the emotion of "joy" from the voice.

[1439] Emotion-based response generation

[1440] The server generates an appropriate response based on the emotional information recognized by the emotion engine. It changes the response expression to the user based on the emotion label. For example, if the emotion engine recognizes "joy," the server generates a response such as "That's good! I'm happy too."

[1441] Dementia risk assessment

[1442] The server periodically analyzes the user's conversation data, assessing language patterns, changes in themes, and emotional consistency to determine dementia risk. If a high risk is determined, the server sends a warning to the device and displays a notification urging the user to consult a specialist. For example, if the user has recently been repeating the same topics, with little change in themes and little emotional expression, the server will generate a warning message.

[1443] Hosting community events

[1444] The server periodically plans and hosts conversation events with other users. The device notifies the user of the event information and the user can participate if they wish. During the event, the server monitors the conversation content and identifies inappropriate comments and negative emotions using an emotion engine. For example, a "gathering of book lovers" event can be held, providing a forum for discussing various books.

[1445] Notification to family and specialists

[1446] If the user agrees, the server provides settings to notify important dementia risk data and negative emotion data generated by the emotion engine to family members and specialists. If the risk assessment is high, the server automatically generates a notification message and displays it to the user via their device, while also sending notifications to family members and specialists. For example, if a user is determined to be at "high risk" and shows a lot of "negative emotions," the server generates and sends a notification.

[1447] Example prompt

[1448] Prompt when user says "How are you doing?"

[1449] You: How are you doing lately?

[1450] AI Avatar: I'm fine. How about you?

[1451] Prompts for users to express their feelings

[1452] You: Something very exciting happened today!

[1453] AI Avatar: That's great! I'm happy too.

[1454] By incorporating an emotion engine, elderly people can enjoy daily conversations with an AI avatar, which can help prevent dementia and manage the risk of dementia. In addition, the system can respond according to emotional states, allowing for more personalized care.

[1455] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1456] Step 1: User Registration

[1457] User actions: The user accesses the system through a terminal and proceeds to the initial registration screen.

[1458] Input: The user enters information such as name, age, gender, hobbies, and preferences.

[1459] Terminal operation: The terminal sends the entered information to the server.

[1460] Server Action: The server stores the received information in a database and creates a user profile.

[1461] Output: The completed user profile is saved in the database.

[1462] Specific example of operation: The user enters "Yamada Hanako, 75 years old, female, likes reading," and the terminal sends this to the server, which then saves the profile in the database.

[1463] Step 2: Select an AI avatar

[1464] User Action: The user uses the device to access the AI ​​avatar selection screen.

[1465] Input: The server displays various AI avatar patterns on the terminal.

[1466] Terminal operation: The terminal receives an operation to select the desired avatar from the user.

[1467] Server Action: The server receives the selected avatar information and associates it with the user profile.

[1468] Output: The user profile is updated with the selected avatar information.

[1469] Example of specific operation: The user selects an avatar of "male, 60 years old, who likes reading," and the device sends this information to the server, which then registers the information in the user profile.

[1470] Step 3: Starting everyday conversations

[1471] User action: The user speaks to the AI ​​avatar through the device.

[1472] Input: The user types a question or message by voice or text.

[1473] Terminal operation: The terminal sends the user's input to the server.

[1474] Server operation: The server analyzes the received data using a generative AI model and generates an appropriate response.

[1475] Output: The generated reply is sent to the terminal.

[1476] Terminal behavior: The terminal displays the response to the user as voice or text.

[1477] A specific example of how it works: The user asks, "How are you doing these days?", the server generates a response, "I'm doing well. How about you?", and the device conveys this aloud.

[1478] Step 4: Emotion Recognition with the Emotion Engine

[1479] User action: The user makes an emotional statement to the AI ​​avatar.

[1480] Input: User voice or text input.

[1481] Device operation: The device sends the input voice or text to the emotion engine.

[1482] How the Emotion Engine Works: The emotion engine analyzes input and assigns emotion labels.

[1483] Output: Emotion labels are generated and sent to the server.

[1484] A concrete example of how it works: A user types, "Something very happy happened today!", and the emotion engine assigns the label "joy."

[1485] Step 5: Emotion-based response generation

[1486] Server operation: The server generates an appropriate response based on the emotion labels received from the emotion engine.

[1487] Output: The generated reply is sent to the terminal.

[1488] Terminal action: The terminal relays the response to the user.

[1489] Specific example of operation: The emotion engine recognizes "joy," and the server generates a response saying, "That's great! I'm happy too," which is conveyed to the user via the device.

[1490] Step 6: Dementia risk assessment

[1491] Server operation: The server periodically collects and analyzes user conversation data.

[1492] Input: Conversation data, language patterns, thematic shifts, and emotional consistency.

[1493] Data processing: The server analyzes the collected data using statistical methods and AI models to determine the risk of dementia.

[1494] Output: Risk assessment results are generated and warnings are created if necessary.

[1495] Terminal behavior: The terminal displays a warning message to the user.

[1496] Specific example of operation: If a user repeatedly talks about the same topic and there is little change in the topic, the server determines that the user has a high risk of dementia and sends a warning to the device saying, "We recommend that you see a specialist."

[1497] Step 7: Host a community event

[1498] What the server does: Plan and host conversation events with other users.

[1499] Input: Event information, participation application.

[1500] Device operation: Notifies the user of event information and accepts requests to participate.

[1501] Server Actions: Monitor conversations during the event to identify inappropriate language and negative sentiment.

[1502] Output: Warnings and notices are sent to the user as needed.

[1503] Example of how it works: The server plans a "gathering of book lovers" event, and the user wants to participate. The server monitors the conversation and detects inappropriate comments.

[1504] Step 8: Notify family and specialists

[1505] User behavior: If the user consents.

[1506] Input: Dementia risk data, emotion data.

[1507] Server operation: Stores important dementia risk data and emotion data.

[1508] Data processing: The server automatically generates a notification message if the risk assessment is high.

[1509] Output: A notification message is generated and displayed to the user via the terminal, as well as sent to family members and specialists.

[1510] Specific example of operation: If a user is judged to be "high risk" and shows negative emotions, the server generates a notification saying "We recommend you see a specialist" and sends it to the device, family, and specialist.

[1511] (Application example 2)

[1512] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1513] It is difficult to efficiently provide dementia prevention and mental care for elderly people when they shop in physical stores. It is also necessary to provide more satisfying customer service by responding to the emotional state of the elderly. Furthermore, there is a lack of a system for early detection of dementia risk in elderly people and encouraging them to consult an appropriate specialist.

[1514] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1515] In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select the virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for analyzing the content of the conversation and evaluating changes in language patterns and themes to determine dementia risk; means for issuing a warning to the user and displaying a message urging the user to seek medical attention if the dementia risk is high; means for periodically hosting conversation events in which multiple users participate and monitoring the events for defamatory and inappropriate comments; means for notifying a caregiver or specialist of important dementia risk data if the user consents; means for supporting the user's conversation and generating responses according to the user's emotional state via a terminal installed in a physical store; and means including an emotion engine for recognizing the user's emotions and responding accordingly. This allows elderly people to enjoy comfortable shopping in physical stores while also enabling early detection of dementia risk and appropriate mental care.

[1516] "User information" refers to personal information such as the user's name, age, gender, hobbies, and preferences.

[1517] A "user profile" is data that compiles the characteristics and attributes of each user, generated based on user information.

[1518] A "virtual character" is a computer-generated digital character with a variety of patterns that can be selected by the user.

[1519] "Voice or text-based conversation" refers to interaction between a user and a virtual character through speech recognition or text input.

[1520] "Analyzing conversation content" refers to analyzing the content of the dialogue between the user and the virtual character to evaluate changes in language patterns and themes.

[1521] "Dementia risk" refers to the risk of a user's cognitive decline, and is determined from changes in language patterns and themes.

[1522] "Means of issuing a warning and displaying a message encouraging medical attention" is a function that sends a notification to the user recommending that they see a specialist if they are determined to be at high risk of dementia.

[1523] A "conversation event" is an opportunity for multiple users to participate in a group conversation through virtual characters.

[1524] "Means for monitoring slanderous or inappropriate comments" is a function for monitoring content to prevent inappropriate comments from being made during conversation events.

[1525] "Means for notifying caregivers and medical specialists" refers to a mechanism for notifying dementia risk data to caregivers and medical professionals if the user consents.

[1526] A "terminal installed in a physical store" is a digital device that is placed in a physical store and with which users can interact.

[1527] The "means for generating a response according to the emotional state" is a function for recognizing the user's emotions and generating a response appropriate to those emotions.

[1528] The "emotion engine" is a system that analyzes a user's emotions from conversation content and voice data and assigns specific emotion labels.

[1529] This invention is an AI assistant system that uses a terminal installed in a physical store to help elderly people prevent dementia and receive mental care. Specific embodiments for carrying out the invention are described below.

[1530] System configuration and program processing

[1531] Hardware Configuration

[1532] The system of the present invention is mainly composed of the following hardware.

[1533] 1. In-store devices: Smartphones, tablets, interactive digital devices, such as tablets and in-store display devices.

[1534] 2. Server: A cloud-based or in-store server that stores and analyzes data.

[1535] 3. Microphone and speaker: A device with audio input and output capabilities.

[1536] Software Configuration

[1537] The system uses the following software:

[1538] 1. Python: Used as the primary programming language.

[1539] 2. TensorFlow: A deep learning framework for building emotion engines.

[1540] 3. SQLite: Used as a database to store user information and conversation data.

[1541] Specific processing contents of the program

[1542] 1. User Registration

[1543] Users enter basic information such as their name, age, gender, hobbies, and preferences through their terminals. This information is sent from the terminal to the server and stored in a database as a user profile.

[1544] For example: "Please enter your registration information."

[1545] 2. AI avatar selection

[1546] Users select their desired character from a variety of AI avatars displayed on their device, and this selection information is also stored on the server and associated with the user profile.

[1547] For example: "Please select an avatar that is male, 60 years old, and enjoys reading."

[1548] 3. Starting everyday conversations

[1549] Users speak to an AI avatar through their device, and their voice or text input is sent to a server, where it is analyzed and an appropriate response is generated.

[1550] Example: A user types "Hi, how are you?" and the server generates a response "Hi, I'm fine. How are you?"

[1551] 4. Emotion Recognition by Emotion Engine

[1552] Emotions are recognized from the user's voice or text and an emotion label is assigned. For example, emotions such as joy, sadness, and anger are analyzed.

[1553] Example: If a user says, "I'm so happy today!", the emotion engine will recognize "joy."

[1554] 5. Emotion-based response generation

[1555] Based on the emotional information recognized by the emotion engine, an appropriate response is generated. For example, if the emotion of "joy" is recognized, the response will be "That's wonderful!"

[1556] Example: If the emotion engine recognizes "joy," it will respond with "That's great!"

[1557] 6. Dementia risk assessment

[1558] The server periodically analyzes the user's conversations to assess their dementia risk. If the risk is determined to be high, the server generates a warning message and urges the user to seek medical attention.

[1559] Example: If a user is analyzed as having "been talking about the same topic a lot lately," the server will notify them that "we recommend that you see a specialist."

[1560] 7. Hosting conversation events

[1561] The server periodically schedules conversation events in which multiple users participate, notifies users of the event information, and monitors the conversation content during the event to identify inappropriate comments.

[1562] Example: Announcing a "Book Lovers Gathering" event and encouraging users to join.

[1563] 8. Notification to family and specialists

[1564] If the user consents, the server will notify caregivers and specialists of important dementia risk data and emotional information.

[1565] Example: If a user is judged to be at "high" risk of dementia and shows a lot of "negative emotions," the server generates and sends a notification.

[1566] This configuration allows elderly people to enjoy shopping comfortably in brick-and-mortar stores, while also enabling early detection of dementia risk and appropriate mental care. Furthermore, by responding to their emotional state, it is possible to provide more satisfying customer service.

[1567] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1568] Step 1:

[1569] User Registration

[1570] Users input basic information such as name, age, gender, hobbies and interests through their terminals. This input data is sent from the terminal to the server, which stores the information in a database and generates a user profile. Specifically, if a user enters "Yamada Hanako, 75 years old, female, loves reading," the server receives the information and stores it in the database as the profile for "Yamada Hanako."

[1571] Step 2:

[1572] AI avatar selection

[1573] Users select their desired character from a variety of AI avatars displayed on their device. The user's selection is sent from the device to the server, and the server adds the selection information to the user profile. For example, if a user selects an avatar that is "male, 60 years old, and likes reading," the server associates that information with the profile and saves it.

[1574] Step 3:

[1575] Starting everyday conversations

[1576] The user speaks to the AI ​​avatar through the device. This is done in the form of voice input or text input. The device sends this input information to the server, which analyzes the input data and generates an appropriate response. The server then sends the generated response to the device, which then conveys it to the user in voice or text. When the user inputs "Hello, how are you doing?", the server analyzes the input and generates and returns the response "Hello, I'm fine. How are you?"

[1577] Step 4:

[1578] Emotion recognition by emotion engine

[1579] When a user expresses a specific emotion to an AI avatar, the voice or text is sent from the device to the emotion engine. The emotion engine analyzes the input data and assigns an emotion label such as joy, sadness, or anger. For example, if a user says, "I'm so happy today!", the emotion engine analyzes the voice data and assigns the emotion label "joy."

[1580] Step 5:

[1581] Emotion-based response generation

[1582] The server generates an appropriate response based on the emotional information recognized by the emotion engine. The expression of this response changes depending on the emotion. For example, if the emotion engine recognizes "joy," the server generates a response according to the emotion, such as "That's wonderful!", and sends it to the device. The device then conveys this response to the user.

[1583] Step 6:

[1584] Dementia risk assessment

[1585] The server periodically analyzes the user's conversations, assessing language patterns, changes in themes, and emotional consistency to determine dementia risk. If a high risk is determined, the server generates a warning message and sends it to the device, urging the user to seek medical advice. For example, if the server determines that a user has been repeatedly talking about the same topics recently, it will notify the user by saying, "We recommend that you see a specialist."

[1586] Step 7:

[1587] Holding a conversation event

[1588] The server plans conversation events in which multiple users will participate and notifies users of the event information via their devices. Users can participate if they wish. During the event, the server monitors the conversation content and identifies inappropriate comments and negative emotions using an emotion engine. For example, a "gathering of book lovers" event is planned, the server notifies the device of the information, and users can participate.

[1589] Step 8:

[1590] Notification to family and specialists

[1591] If the user agrees, the server will notify caregivers and specialists of important dementia risk data and negative emotion data generated by the emotion engine. For example, if a user is judged to be at "high" dementia risk and shows a lot of "negative emotions," the server will pass that information to the notification generation system, which will then generate and send a notification.

[1592] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1593] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1594] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1595] [Fourth embodiment]

[1596] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1597] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1598] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1599] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1600] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1601] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1602] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1603] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1604] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1605] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1606] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1607] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1608] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1609] This invention is an AI chatbot system that acts as a conversation partner for elderly people and is useful for preventing dementia and assessing their risk. Specifically, the system aims to prevent dementia by creating a profile based on user information and engaging in conversations through a virtual character selected by the user. The system also analyzes conversation content to assess dementia risk, and if the risk is high, issues a warning and encourages the user to see a specialist. Furthermore, it provides a mechanism for hosting conversation events with multiple users and monitoring inappropriate comments.

[1610] System configuration

[1611] This system mainly consists of a server and a terminal (user device). The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback.

[1612] Program processing flow and specific examples

[1613] 1. User Registration

[1614] Users access the system through their terminals and perform initial registration. They enter information such as their name, age, gender, and hobbies and preferences. This information is sent from the terminal to the server, which then stores it in a database to create a user profile. For example, if a user enters "Taro Tanaka, 70 years old, male, likes music," the server stores this information in the database.

[1615] 2. AI avatar selection

[1616] The user accesses the AI ​​avatar selection screen using the device. The server provides various AI avatar patterns (age, gender, hobbies, etc.) to the device, and the user selects the desired avatar. For example, if the user selects a "female, 50-year-old, music-loving avatar," the server associates that avatar with the user profile.

[1617] 3. Starting everyday conversations

[1618] The user speaks to the AI ​​avatar through the device. The server receives the user's voice or text input, analyzes it, and generates an appropriate response. The server then sends the response to the device, which then relays it to the user via voice or text. For example, if the user asks, "What's the weather like today?" the server retrieves the weather information and responds, "It's sunny today, and the temperature is 25 degrees."

[1619] 4. Dementia risk assessment

[1620] The server periodically analyzes the user's conversation data and assesses their dementia risk based on changes in language patterns and themes. If the risk is determined to be high, the server sends a warning to the device and displays a notification urging them to see a specialist. For example, if a user has recently been repeating the same topics with little change in themes, the server will notify them, "Your risk of dementia may be increasing. We recommend that you see a specialist."

[1621] 5. Hosting community events

[1622] The server periodically plans and holds conversation events with other users. The device notifies the user of the event information, and the user can participate if they wish. During the event, the server monitors the conversation content and checks for slanderous or inappropriate comments. For example, a "music lovers' gathering" event can be held, providing a forum for discussing various music topics.

[1623] 6. Notification to family and specialists

[1624] The server will be configured to notify important dementia risk data to family members and specialists only if the user agrees. If the risk assessment is high, the server will automatically generate a notification message, which will be displayed to the user on their device and will also be sent to family members and specialists. For example, if a user is judged to be at "high risk," the server will send a notification stating, "Taro Tanaka's dementia risk is increasing."

[1625] In this way, this system provides an environment where elderly people can prevent dementia and manage their risk while enjoying everyday conversations.

[1626] The processing flow will be explained below.

[1627] User Registration

[1628] Step 1:

[1629] The user accesses the system's registration screen using a terminal and enters personal information such as name, age, sex, hobbies and preferences.

[1630] Step 2:

[1631] The terminal transmits the input information to the server.

[1632] Step 3:

[1633] The server stores the received information in a database and creates a user profile.

[1634] Step 4:

[1635] The server sends a notification to the terminal indicating that the user registration is complete.

[1636] Step 5:

[1637] The terminal displays a registration completion notice to the user.

[1638] AI avatar selection

[1639] Step 1:

[1640] The user uses the device to access the AI ​​avatar selection screen.

[1641] Step 2:

[1642] The server sends available AI avatar information from the database to the terminal.

[1643] Step 3:

[1644] The terminal displays the AI ​​avatar information received from the server to the user.

[1645] Step 4:

[1646] The user selects the desired AI avatar.

[1647] Step 5:

[1648] The terminal transmits the selected AI avatar information to the server.

[1649] Step 6:

[1650] The server associates the selected avatar with a user profile and stores the associated information in a database.

[1651] Starting everyday conversations

[1652] Step 1:

[1653] Users speak to an AI avatar through their device.

[1654] Step 2:

[1655] The terminal converts the user's voice input into text and sends the text to the server.

[1656] Step 3:

[1657] The server analyzes the received text and retrieves information from a database to generate an appropriate response.

[1658] Step 4:

[1659] The server sends the generated response in text format to the terminal.

[1660] Step 5:

[1661] The terminal synthesizes the text into speech and conveys the response to the user.

[1662] Dementia risk assessment

[1663] Step 1:

[1664] The server periodically scans the user's past conversation data and runs algorithms that detect specific language patterns.

[1665] Step 2:

[1666] The server assesses dementia risk by assessing changes in language patterns and themes.

[1667] Step 3:

[1668] If the server determines that the risk is high, it generates a warning message based on the evaluation results.

[1669] Step 4:

[1670] The server sends a warning message to the terminal and displays a notice urging the user to see a specialist.

[1671] Step 5:

[1672] The terminal displays a warning message to the user.

[1673] Hosting community events

[1674] Step 1:

[1675] The server periodically plans conversation events with other users and generates detailed information about them.

[1676] Step 2:

[1677] The server transmits detailed information about the event to the terminal.

[1678] Step 3:

[1679] The terminal notifies the user of the event information and confirms whether the user wishes to participate.

[1680] Step 4:

[1681] The user notifies the server of his / her intention to participate through the terminal.

[1682] Step 5:

[1683] The server assigns participating users to chat rooms for the event and generates link information therefor.

[1684] Step 6:

[1685] The terminal connects the user to the chat room through a link at the start of the event.

[1686] Step 7:

[1687] The server monitors the conversations during the event to check for any abusive or inappropriate comments.

[1688] Notification to family and specialists

[1689] Step 1:

[1690] If the user has given their consent, the server will configure the system to notify family members and specialists of important dementia risk data.

[1691] Step 2:

[1692] The server automatically generates a notification message if the risk assessment is high.

[1693] Step 3:

[1694] The server transmits the generated notification message to the terminal and sets it so that the notification is also sent to the user.

[1695] Step 4:

[1696] The terminal displays a notification to the user and simultaneously sends notifications to family members and specialists.

[1697] These are the specific processing steps. This will enable elderly people to enjoy daily conversations with AI avatars while also helping to prevent dementia and manage their risk.

[1698] Example 1

[1699] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1700] The elderly population is increasing in modern society, making the prevention and early detection of dementia an important issue. However, many elderly people tend to be isolated from their daily lives, and opportunities for conversation decrease, which may increase their risk of dementia. In addition, there are limited means to assess the risk of dementia early and take appropriate measures, so detection is often delayed. Furthermore, a system is needed to facilitate communication between elderly people and to prevent inappropriate remarks.

[1701] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1702] In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select a virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for analyzing the content of the conversation and evaluating changes in language patterns and themes to determine dementia risk; means for issuing a warning to the user and displaying a message urging the user to seek medical attention if the dementia risk is high; means for periodically holding conversation events in which multiple users participate and monitoring for slanderous or inappropriate comments during the events; means for notifying caregivers and specialists of important dementia risk data if the user consents; means for converting the user's voice input into text data, generating appropriate response data using natural language processing technology, and transmitting the response data to the user; and means for monitoring the content of the conversations in real time during conversation events and detecting slanderous or inappropriate comments using specific keywords as triggers. This enables elderly people to prevent dementia and manage their risk while enjoying daily conversations.

[1703] "User information" refers to personal data such as name, age, gender, hobbies and preferences that users enter into the system.

[1704] "User Profile" means a database record about an individual user that the system creates based on user information.

[1705] A "virtual character" is a digital character that the system displays and that has a variety of patterns that the user can select.

[1706] "Voice or text-based conversation" refers to a dialogue between a user and a virtual character using voice or text input.

[1707] "Conversation content" refers to the content of the audio or text exchanges that take place between the user and the virtual character.

[1708] A "language pattern" is a specific pattern of words and expressions used in conversational content.

[1709] A "change in topic" is a change in how the topic shifts in the content of a conversation.

[1710] "Dementia risk" is an index that evaluates the possibility that a user will develop dementia.

[1711] "Slander" is the act of insulting or speaking ill of others.

[1712] "Inappropriate remarks" are remarks that are socially unacceptable or that offend others.

[1713] "Natural language processing technology" is a technology that allows computers to understand and analyze human language.

[1714] A "generative AI model" is a model for automatically generating text data using artificial intelligence.

[1715] This invention is an AI chatbot system that acts as a conversation partner for elderly people and is useful for preventing dementia and assessing their risk. Specifically, the system aims to prevent dementia by creating a profile based on user information and engaging in conversations through a virtual character selected by the user. The system also analyzes conversation content to assess dementia risk, and if the risk is high, issues a warning and encourages the user to see a specialist. Furthermore, it provides a mechanism for hosting conversation events with multiple users and monitoring inappropriate comments.

[1716] The system primarily consists of a server and a terminal (user device). The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback. The server uses a high-performance database system and natural language processing (NLP) technology, utilizing generative AI models (such as GPT-4). The server also analyzes conversation data and runs algorithms to detect language patterns and thematic shifts.

[1717] As a specific example of operation, consider a scenario in which a user initially registers with the system. First, the user enters information such as name, age, gender, and hobbies and preferences. This information is sent from the device to the server, which stores it in a database and creates a user profile. The user then accesses a virtual character selection screen and selects the desired avatar. The server associates that avatar with the user profile.

[1718] Next, an everyday conversation takes place between the user and the virtual character. When the user asks, "What's the weather like today?", the server converts the voice data into text and analyzes it using NLP technology. The generative AI model then generates a response, and the server sends the appropriate response, "It's sunny today, and the temperature is 25 degrees," to the device and tells the user.

[1719] Furthermore, the server periodically analyzes conversation data to detect changes in language patterns and themes to assess dementia risk. If the risk increases, a warning will be issued on the device, displaying a message saying, "You may be at increased risk of dementia. We recommend that you seek medical advice from a specialist."

[1720] The server also periodically plans and holds conversation events with other users. The device notifies the user of the event information, and the user can participate if they wish. During the event, the server monitors the conversation in real time to check for slanderous or inappropriate comments.

[1721] Finally, if the user agrees, the server configures the system to notify family members and specialists of important dementia risk data. If the risk assessment is high, the server sends an automatically generated notification message to family members and specialists.

[1722] Examples of prompts include:

[1723] "Register as Taro Tanaka, 70 years old, male, and music lover, and select a 50-year-old female avatar who also loves music. Talk to that avatar and ask, 'How's the weather today?'"

[1724] "Use the conversation to determine dementia risk and find out how you will be notified if you are at high risk."

[1725] "Attend community events and see what conversations happen."

[1726] As described above, this system provides an environment where elderly people can prevent dementia and manage their risk while enjoying everyday conversations.

[1727] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1728] Step 1: User Registration

[1729] 1.1 Users access the system through a terminal. Users input personal information such as name, age, gender, hobbies, and preferences into a form.

[1730] 1.2 The device sends the information entered by the user to the server. The information is sent to the server as an HTTP POST request.

[1731] 1.3 The server validates the received input data and stores it in the database. Specifically, the server creates a new user profile in the database and stores the input data.

[1732] 1.4 The server returns a confirmation message to the terminal indicating that the save was completed successfully. The terminal displays this message on the screen to notify the user that the registration has been completed.

[1733] Step 2: Select an AI avatar

[1734] 2.1 The user uses a device to access the AI ​​avatar selection screen, which displays a list of various virtual characters.

[1735] 2.2 The server provides the terminal with an avatar list, which includes various pre-designed character attributes (e.g., age, gender, hobbies, etc.).

[1736] 2.3 The user selects the desired avatar, and the device sends the selection information to the server as an HTTP POST request.

[1737] 2.4 The server associates the received avatar information with the user profile and stores it in a database. The server then sends a confirmation message back to the device indicating that the association is complete.

[1738] 2.5 The device will display a confirmation message on the screen to notify the user that the avatar selection is complete.

[1739] Step 3: Starting everyday conversations

[1740] 3.1 The user speaks to the AI ​​avatar through the device, and questions and conversation content are entered into the device as voice input or text input.

[1741] 3.2 The device converts the voice input into text data and sends it to the server. The voice data is converted into text data using voice recognition technology.

[1742] 3.3 The server analyzes the received text data using natural language processing (NLP) technology. Specifically, the server uses a generative AI model (e.g., GPT-4) to understand the user's intent and generate an appropriate response.

[1743] 3.4 The server sends the generated response data to the device, which then displays the received data as text or outputs it as voice using speech synthesis technology.

[1744] 3.5 The device will then relay the response to the user, allowing them to continue the conversation. If the user says, "What's the weather like today?", the device will display the response, "It's sunny today, and the temperature is 25 degrees."

[1745] Step 4: Dementia risk assessment

[1746] 4.1 The server periodically collects and stores user conversation data, which is then stored in a database.

[1747] 4.2 The server analyzes the collected conversation data to detect shifts in language patterns and themes. It uses a generative AI model to identify shifts in language patterns and repetition of the same topics.

[1748] 4.3 The server evaluates dementia risk based on the analysis results and calculates a risk score. If the risk score is high, a warning flag is raised.

[1749] 4.4 If the risk assessment is high, the server sends a warning message to the device, which displays the message "You may be at increased risk of dementia. We recommend that you consult a specialist."

[1750] Step 5: Host a community event

[1751] 5.1 The server periodically plans and schedules conversation events, and the event information is stored in a database.

[1752] 5.2 The device notifies the user of event information. Notifications are provided as push messages.

[1753] 5.3 If the user wishes to participate, the device sends a notification to the server, and the user taps the "Join" button on the screen.

[1754] 5.4 During the event, the server will monitor conversations in real time, using generative AI models to detect abusive or inappropriate language.

[1755] 5.5 If the server detects inappropriate comments, it will send a warning message to the device, which will be displayed to all event participants.

[1756] Step 6: Notify family and specialists

[1757] 6.1 If the user agrees, the server will configure the notification of risk data to family members and specialists. The configuration information will be stored in the database.

[1758] 6.2 If the server determines that the person is at high risk, it automatically generates a notification message, such as "Taro Tanaka's risk of dementia is increasing."

[1759] 6.3 The server sends the generated notification message to the user's family or specialist. The notification is sent as an email or push notification.

[1760] 6.4 The device will display and allow the user to acknowledge that a notification has been sent. The screen will display the message "Notification sent."

[1761] (Application example 1)

[1762] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1763] In addition to preventing dementia and assessing risk in the elderly, there is a need for a system that integrates safety confirmation and work progress confirmation for elderly workers in factories. However, currently these functions are independent, and there is no system in place for elderly workers to receive dementia risk assessments or psychological support through conversations during their daily work. This could lead to a decrease in the work efficiency of elderly workers in factories and an increase in safety risks.

[1764] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1765] In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select the virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for analyzing the content of the conversation and evaluating changes in language patterns and themes to determine dementia risk; means for issuing a warning to the user and displaying a message urging the user to seek medical attention if the dementia risk is high; means for periodically hosting conversation events in which multiple users participate and monitoring for defamatory or inappropriate comments during the events; means for notifying caregivers or specialists of important dementia risk data if the user consents; and interface means for conducting conversations with elderly workers in factories and supporting safety and work progress checks. This enables elderly workers to enjoy daily conversations while preventing dementia and managing risks, and further improves the safety and efficiency of work in factories.

[1766] "User information" refers to basic personal attribute information about system users (e.g., name, age, gender, hobbies and preferences).

[1767] A "user profile" is an individual information record created based on user information, including conversation content and system usage.

[1768] A "virtual character" is a purposefully created digital persona or avatar with which a user chooses to interact.

[1769] "Voice or text-based conversation" means a method of communication between a user and a virtual character, including both voice and text input.

[1770] "Changes in language patterns and themes" refers to the patterns of words used and changes in topics during conversation, and are indicators for assessing dementia risk.

[1771] "Dementia risk" is a numerical value or assessment result used to evaluate the likelihood that a user will develop dementia.

[1772] A "warning message urging a visit to a doctor" is a notification sent to users when they are at high risk of dementia, and includes content urging them to visit a specialist.

[1773] A "conversation event" is a gathering of multiple users to discuss a specific topic, and is a regularly held online or offline event.

[1774] "Means for monitoring abusive and inappropriate comments" refers to technology for monitoring comments made by users during conversation events and detecting abusive and inappropriate comments.

[1775] "Important dementia risk data" refers to important information obtained as a result of dementia risk assessment, which is used to manage the user's health status by informing caregivers and specialists.

[1776] "Caregivers and specialists" are professionals who are responsible for managing the health of users and providing medical care.

[1777] An "interface means" is a physical or digital medium through which a user directly interacts with a system.

[1778] An "interface means for communicating with elderly workers in a factory and assisting in checking safety or the progress of work" is a device or software that is placed in a factory and allows communication with elderly workers to check the safety and progress of work.

[1779] This invention can be specifically implemented as an AI chatbot system aimed at preventing dementia and supporting work in the elderly. This system consists of a server and a terminal (user device). The terminal receives user input, and the server analyzes and stores that information and provides appropriate feedback.

[1780] Entering user information and creating a profile

[1781] When a user inputs personal information such as name, age, gender, and hobbies and preferences through a terminal, the server creates a user profile based on that information, and then provides a virtual character and conversation content that is suited to each individual user.

[1782] Selecting a virtual character

[1783] The server displays various patterns of virtual characters on the terminal, and the user can select a virtual character based on age, gender, hobbies, and preferences, thereby providing the user with a friendly conversation partner.

[1784] Starting and continuing a conversation

[1785] Users can initiate voice or text-based conversations with selected virtual characters through their devices. The server receives the user's input, generates appropriate responses, and sends them to the device, allowing for the conversation to continue as normal.

[1786] Dementia risk assessment

[1787] The server analyzes the conversation and evaluates language patterns and changes in themes to determine dementia risk. If the risk is high, the server generates a warning message and displays a notification on the device urging the user to seek medical attention.

[1788] Holding a conversation event

[1789] The server periodically holds conversation events in which multiple users participate. The terminal notifies users of the event information, and those who wish to participate gather. During the event, the server monitors the conversation content and checks for slanderous or inappropriate comments.

[1790] Supporting elderly workers

[1791] The server communicates with elderly workers through an interface to help them work safely in the factory, confirming their safety and progress, thereby improving both the work efficiency and safety of elderly workers.

[1792] Notification to family and specialists

[1793] Only with the user's consent will the server notify caregivers and specialists of important dementia risk data, allowing them to more accurately manage the user's health condition.

[1794] Hardware and Software Use

[1795] The system uses the following hardware and software:

[1796] Hardware: Factory robots (with microphones and speakers), central server (consisting of cloud servers)

[1797] Software: Python 3, natural language processing libraries (e.g., NLTK), data analysis libraries (e.g., Pandas)

[1798] Prompt Sentence Examples

[1799] For example, the following prompt sentences are used:

[1800] User registration begins. Please enter your unique user information.

[1801] Hello, User Name! How are you spending your day?

[1802] User Input: Today I sorted parts.

[1803] AI Response Generation: That's interesting. What are you working on next?

[1804] Dementia risk assessment initiated. ....Risk result: normal.

[1805] This system provides an environment where elderly people can enjoy daily conversations while preventing dementia and managing risks, and also improves the safety and efficiency of elderly workers in factories.

[1806] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1807] Step 1:

[1808] The user accesses the system through a terminal and performs initial registration. Specifically, they enter information such as their name, age, gender, hobbies, and preferences. The entered user information is sent to the server and stored in a database. This creates a user profile.

[1809] Step 2:

[1810] The user accesses a virtual character selection screen displayed on the terminal. The server displays a variety of patterns of virtual characters on the terminal. The user selects the desired virtual character based on age, gender, and hobbies and preferences, and the information is sent to the server and associated with the user profile.

[1811] Step 3:

[1812] The user speaks to the virtual character through the device. The server receives the user's voice or text input, analyzes the input using natural language processing techniques, and generates an appropriate response. The response is generated using a generative AI model and sent to the device in text or voice format.

[1813] Step 4:

[1814] The server periodically analyzes the user's conversation data, assessing changes in language patterns and themes in the conversation and determining dementia risk. Using a data analysis library, it evaluates changes in language patterns and consistency of themes and stores the results in a database.

[1815] Step 5:

[1816] If the risk is determined to be high, the server generates a warning message and sends a notification to the device urging the user to see a specialist.

[1817] Step 6:

[1818] The server plans and periodically holds conversation events in which multiple users participate. The terminal notifies users of the event information and gathers those who wish to participate. During the conversation event, the server monitors the content of the conversation and checks for slanderous or inappropriate comments. If inappropriate comments are detected, a warning is issued in real time.

[1819] Step 7:

[1820] The server notifies caregivers and specialists of important dementia risk data only if the user consents. The data is automatically generated and sent to caregivers and specialists via email or notification, facilitating the user's health management.

[1821] Step 8:

[1822] The server communicates with elderly workers through an interface to ensure they can work safely in the factory. It checks work safety and progress and supports the worker's condition. The server monitors the situation in real time through the terminal and robot interface and checks safety.

[1823] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1824] This invention is an AI chatbot system that serves as a conversation partner for elderly people, helping to prevent dementia and assess risk. It also incorporates an emotion engine that recognizes the user's emotions, enabling more personalized responses. Specifically, it creates a profile based on user information and engages in conversation through a virtual character selected by the user. It analyzes the content of the conversation to assess dementia risk, and if the risk is high, issues a warning and encourages the user to see a specialist. It also recognizes the user's emotions and generates responses appropriate to their emotional state. It also provides a mechanism for hosting conversation events with multiple users and monitoring for inappropriate comments.

[1825] System configuration

[1826] This system is mainly composed of a server and a terminal (user device) and is integrated with an emotion engine. The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback.

[1827] Program processing flow and specific examples

[1828] 1. User Registration

[1829] Users access the system through their terminals and perform initial registration. They enter information such as their name, age, gender, and hobbies and interests. This information is sent from the terminal to the server, which then stores it in a database to create a user profile. For example, if a user enters "Yamada Hanako, 75 years old, female, loves reading," the server stores this information in the database.

[1830] 2. AI avatar selection

[1831] The user accesses the AI ​​avatar selection screen using the device. The server provides various AI avatar patterns (age, gender, hobbies, etc.) to the device, and the user selects the desired avatar. For example, if the user selects a "male, 60-year-old, reading-loving avatar," the server associates that avatar with the user profile.

[1832] 3. Starting everyday conversations

[1833] The user speaks to the AI ​​avatar through the device. The server receives the user's voice or text input, analyzes it, and generates an appropriate response. The server then sends the response to the device, which then relays it to the user via voice or text. For example, if the user says, "How are you doing these days?" the server responds, "I'm doing well. How about you?"

[1834] 4. Emotion Recognition by Emotion Engine

[1835] When a user expresses a specific emotion to the AI ​​avatar, the device sends the voice or text to the emotion engine, which analyzes the emotion and assigns an emotion label such as joy, sadness, or anger. For example, if a user says, "I was so happy today!", the emotion engine will recognize the emotion of "joy" from the voice.

[1836] 5. Emotion-based response generation

[1837] The server generates an appropriate response based on the emotional information recognized by the emotion engine. It changes the response expression to the user based on the emotion label. For example, if the emotion engine recognizes "joy," the server generates a response such as "That's good! I'm happy too."

[1838] 6. Dementia risk assessment

[1839] The server periodically analyzes the user's conversation data, assessing language patterns, changes in themes, and emotional consistency to determine dementia risk. If a high risk is determined, the server sends a warning to the device and displays a notification urging the user to consult a specialist. For example, if the user has recently been repeating the same topics, with little change in themes and little emotional expression, the server will generate a warning message.

[1840] 7. Hosting community events

[1841] The server periodically plans and hosts conversation events with other users. The device notifies the user of the event information and the user can participate if they wish. During the event, the server monitors the conversation content and identifies inappropriate comments and negative emotions using an emotion engine. For example, a "gathering of book lovers" event can be held, providing a forum for discussing various books.

[1842] 8. Notification to family and specialists

[1843] If the user agrees, the server provides settings to notify important dementia risk data and negative emotion data generated by the emotion engine to family members and specialists. If the risk assessment is high, the server automatically generates a notification message and displays it to the user via their device, while also sending notifications to family members and specialists. For example, if a user is determined to be at "high risk" and shows a lot of "negative emotions," the server generates and sends a notification.

[1844] As described above, by incorporating an emotion engine, elderly people can enjoy daily conversations with an AI avatar while preventing dementia and managing their risk. In addition, because responses can be made according to emotional states, more personalized care can be provided.

[1845] The processing flow will be explained below.

[1846] User Registration

[1847] Step 1:

[1848] The user accesses the system's registration screen using a terminal and enters personal information such as name, age, sex, hobbies and preferences.

[1849] Step 2:

[1850] The terminal transmits the input information to the server.

[1851] Step 3:

[1852] The server stores the received information in a database and creates a user profile.

[1853] Step 4:

[1854] The server generates a message notifying the terminal that user registration has been completed and sends it to the terminal.

[1855] Step 5:

[1856] The terminal displays a registration completion notice to the user.

[1857] AI avatar selection

[1858] Step 1:

[1859] The user uses the device to access the AI ​​avatar selection screen.

[1860] Step 2:

[1861] The server retrieves available AI avatar information from the database and sends it to the terminal.

[1862] Step 3:

[1863] The terminal displays the AI ​​avatar information received from the server to the user.

[1864] Step 4:

[1865] The user selects the desired AI avatar.

[1866] Step 5:

[1867] The terminal transmits the selected AI avatar information to the server.

[1868] Step 6:

[1869] The server associates the selected avatar with a user profile and stores the associated information in a database.

[1870] Starting everyday conversations

[1871] Step 1:

[1872] Users speak to an AI avatar through their device.

[1873] Step 2:

[1874] The terminal converts the user's voice input into text and sends the text to the server.

[1875] Step 3:

[1876] The server analyzes the received text and retrieves information from a database to generate an appropriate response.

[1877] Step 4:

[1878] The server sends the generated response in text format to the terminal.

[1879] Step 5:

[1880] The terminal synthesizes the text into speech and conveys the response to the user.

[1881] Emotion recognition by emotion engine

[1882] Step 1:

[1883] When a user speaks to an AI avatar, the device sends the voice or text to the emotion engine.

[1884] Step 2:

[1885] The emotion engine analyzes the emotion and assigns an emotion label such as joy, sadness, or anger.

[1886] Step 3:

[1887] The emotion engine sends the assigned emotion label to the server.

[1888] Emotion-based response generation

[1889] Step 1:

[1890] The server receives the emotion information recognized by the emotion engine and generates an appropriate response based thereon.

[1891] Step 2:

[1892] The response expression to the user is changed based on the emotion label.

[1893] Step 3:

[1894] The server transmits the generated response to the terminal, and provides the user with a response according to the emotion.

[1895] Step 4:

[1896] The terminal displays or outputs the response sent from the server to the user as audio.

[1897] Dementia risk assessment

[1898] Step 1:

[1899] The server periodically scans the user's past conversation data and runs algorithms that detect specific language patterns.

[1900] Step 2:

[1901] The server assesses dementia risk by assessing language patterns, thematic shifts, and emotional consistency.

[1902] Step 3:

[1903] If the server determines that the risk is high, it generates a warning message based on the evaluation results.

[1904] Step 4:

[1905] The server sends a warning message to the terminal and displays a notice urging the user to see a specialist.

[1906] Step 5:

[1907] The terminal displays a warning message to the user.

[1908] Hosting community events

[1909] Step 1:

[1910] The server periodically plans conversation events with other users and generates detailed information about them.

[1911] Step 2:

[1912] The server transmits detailed information about the event to the terminal.

[1913] Step 3:

[1914] The terminal notifies the user of the event information and confirms whether the user wishes to participate.

[1915] Step 4:

[1916] The user notifies the server of his / her intention to participate through the terminal.

[1917] Step 5:

[1918] The server assigns participating users to chat rooms for the event and generates link information therefor.

[1919] Step 6:

[1920] The terminal connects the user to the chat room through a link at the start of the event.

[1921] Step 7:

[1922] The server monitors the conversations during the event to check for any abusive or inappropriate comments.

[1923] Notification to family and specialists

[1924] Step 1:

[1925] If the user agrees, the server will set up the system to notify family members or specialists of important dementia risk data and negative emotional data generated by the emotion engine.

[1926] Step 2:

[1927] The server automatically generates a notification message if the risk assessment is high.

[1928] Step 3:

[1929] The server transmits the generated notification message to the terminal and sets it so that the notification is also sent to the user.

[1930] Step 4:

[1931] The terminal displays a notification to the user and simultaneously sends notifications to family members and specialists.

[1932] These are the specific processing steps of a system incorporating an emotion engine that helps prevent dementia and manage risk while allowing elderly people to enjoy daily conversations with an AI avatar. In addition, the system's ability to respond according to emotional states allows for more personalized care.

[1933] Example 2

[1934] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1935] In an aging society, dementia prevention and risk assessment are important issues. However, conventional systems were unable to provide individualized responses and had difficulty accurately capturing users' emotional states. Furthermore, in conversation events involving multiple users, monitoring for inappropriate remarks was insufficient, and the sharing of dementia risk data and emotional data was limited. This made it difficult to enrich users' daily experiences and assist specialists in early diagnosis.

[1936] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for inputting user information and creating a user profile based on the user information; means for displaying virtual characters with various patterns selected by the user and allowing the user to select the virtual character; means for conducting voice or text-based conversations between the user and the virtual characters; means for recognizing the user's emotions and generating responses corresponding to the emotions; means for analyzing the content of the conversation and evaluating language patterns, changes in themes, and emotional consistency to determine dementia risk; means for issuing a warning to the user and displaying a message encouraging the user to seek medical attention if the dementia risk is high; means for periodically hosting conversation events in which multiple users participate and monitoring for slander, inappropriate comments, and negative emotions during the events; and means for notifying caregivers and specialists of important dementia risk data and emotional data if the user consents. This enables personalized responses that accurately reflect the user's emotional state, facilitating early detection of dementia risk and prompt notification to specialists. Furthermore, a rich communication experience can be provided while maintaining user safety.

[1937] "User information" refers to personal information such as name, age, gender, hobbies and preferences that is entered into the system.

[1938] A "user profile" is detailed user information that is created and stored by the server based on user information.

[1939] A "virtual character" is a virtual character that a user can select to interact with within the system.

[1940] "Voice or text-based conversation" refers to a dialogue between a user and a virtual character, either through voice or text.

[1941] An "emotion engine" is software that analyzes a user's voice and text and assigns emotional labels.

[1942] "Emotion recognition" is the process in which the emotion engine analyzes the user's emotions and distinguishes between emotions such as joy, sadness, and anger.

[1943] "Response generation" is the process by which the server creates an appropriate response based on input from the user and the perceived sentiment.

[1944] "Dementia risk assessment" involves the server analyzing a user's conversation data and evaluating language patterns, changes in themes, and emotional consistency to determine the risk of dementia.

[1945] A "warning" is a message generated by the server and displayed on the device when the risk of dementia is high, encouraging a medical examination.

[1946] A "conversation event" is a place for dialogue in which multiple users can participate on a regular basis.

[1947] "Abusive and inappropriate comment monitoring" refers to monitoring activities performed by the server during conversation events to identify inappropriate comments and negative sentiment.

[1948] "Important dementia risk data" is specific data that indicates that a user is at high risk of dementia.

[1949] "Emotion data" is the user's emotional information recognized by the emotion engine.

[1950] "Caregivers" is a general term for family members and facility staff who are responsible for caring for users.

[1951] A "specialist" is a doctor who specializes in diagnosing and treating dementia.

[1952] This invention is an AI chatbot system that acts as a conversation partner for elderly people, helping them prevent dementia and assess their risk. Specifically, it creates a profile based on user information and engages in conversation through a virtual character selected by the user. It analyzes the content of the conversation to assess dementia risk, and if the risk is high, it issues a warning and encourages the user to see a specialist. It also recognizes the user's emotions and generates responses appropriate to their emotional state. It also provides a mechanism for hosting conversation events with multiple users and monitoring for inappropriate comments.

[1953] System configuration

[1954] This system is mainly composed of a server and a terminal (user device) and is integrated with an emotion engine. The terminal receives user input, and the server analyzes and stores the information and provides appropriate feedback.

[1955] User Registration

[1956] Users access the system through their terminals and perform initial registration. They enter information such as their name, age, gender, and hobbies and interests. This information is sent from the terminal to the server, which then stores it in a database to create a user profile. For example, if a user enters "Yamada Hanako, 75 years old, female, loves reading," the server stores this information in the database.

[1957] AI avatar selection

[1958] The user accesses the AI ​​avatar selection screen using the device. The server provides various AI avatar patterns (age, gender, hobbies, etc.) to the device, and the user selects the desired avatar. For example, if the user selects a "male, 60-year-old, reading-loving avatar," the server associates that avatar with the user profile.

[1959] Starting everyday conversations

[1960] The user speaks to the AI ​​avatar through the device. The server receives the user's voice or text input, analyzes it, and generates an appropriate response. The server then sends the response to the device, which then relays it to the user via voice or text. For example, if the user says, "How are you doing these days?" the server responds, "I'm doing well. How about you?"

[1961] Emotion recognition by emotion engine

[1962] When a user expresses a specific emotion to the AI ​​avatar, the device sends the voice or text to the emotion engine, which analyzes the emotion and assigns an emotion label such as joy, sadness, or anger. For example, if a user says, "I was so happy today!", the emotion engine will recognize the emotion of "joy" from the voice.

[1963] Emotion-based response generation

[1964] The server generates an appropriate response based on the emotional information recognized by the emotion engine. It changes the response expression to the user based on the emotion label. For example, if the emotion engine recognizes "joy," the server generates a response such as "That's good! I'm happy too."

[1965] Dementia risk assessment

[1966] The server periodically analyzes the user's conversation data, assessing language patterns, changes in themes, and emotional consistency to determine dementia risk. If a high risk is determined, the server sends a warning to the device and displays a notification urging the user to consult a specialist. For example, if the user has recently been repeating the same topics, with little change in themes and little emotional expression, the server will generate a warning message.

[1967] Hosting community events

[1968] The server periodically plans and hosts conversation events with other users. The device notifies the user of the event information and the user can participate if they wish. During the event, the server monitors the conversation content and identifies inappropriate comments and negative emotions using an emotion engine. For example, a "gathering of book lovers" event can be held, providing a forum for discussing various books.

[1969] Notification to family and specialists

[1970] If the user agrees, the server provides settings to notify important dementia risk data and negative emotion data generated by the emotion engine to family members and specialists. If the risk assessment is high, the server automatically generates a notification message and displays it to the user via their device, while also sending notifications to family members and specialists. For example, if a user is determined to be at "high risk" and shows a lot of "negative emotions," the server generates and sends a notification.

[1971] Example prompt

[1972] Prompt when user says "How are you doing?"

[1973] You: How are you doing lately?

[1974] AI Avatar: I'm fine. How about you?

[1975] Prompts for users to express their feelings

[1976] You: Something very exciting happened today!

[1977] AI Avatar: That's great! I'm happy too.

[1978] By incorporating an emotion engine, elderly people can enjoy daily conversations with an AI avatar, which can help prevent dementia and manage the risk of dementia. In addition, the system can respond according to emotional states, allowing for more personalized care.

[1979] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1980] Step 1: User Registration

[1981] User actions: The user accesses the system through a terminal and proceeds to the initial registration screen.

[1982] Input: The user enters information such as name, age, gender, hobbies, ...

Claims

1. a means for inputting user information and creating a user profile based on the user information; a means for displaying virtual characters having various patterns selected by a user and allowing the user to select the virtual character; means for conducting voice or text-based conversations between the user and the virtual character; A means of assessing dementia risk by analyzing conversation content and evaluating changes in language patterns and themes. A means to warn users and display a message urging them to seek medical attention if they are at high risk of dementia; A means for periodically holding conversation events in which a plurality of users participate and monitoring for slanderous or inappropriate comments during the events; A means to communicate important dementia risk data to caregivers and specialists, if the user consents; A system including:

2. 10. The system of claim 1, further comprising means for automatically generating fresh conversation topics to store conversation content and provide ongoing conversation topics.

3. The system of claim 1 , further comprising a setting for notifying family members or experts when dementia risk is determined.

Images