System

Abstract

To provide a system.SOLUTION: A system for providing a companion service which utilizes a generative AI and speech synthesis technique comprises: means for improving a user's cognitive function through sharing of at least one of a conversation and memory; means for setting a cognitive level and a taste of the user, for individually customizing the generative AI; means for collecting feeling data of the user, and tracking a change of the feeling data with time course; means for adjusting a conversation content generated by the generative AI, on the basis of the tracked feeling data; and means for outputting the generated conversation content as speech, by the speech synthesis technique.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Services aimed at maintaining and improving cognitive function in the elderly face challenges in their initial implementation and continued use, particularly due to the elderly's reluctance to learn how to operate new devices and the lack of service adaptation to the individual cognitive levels and preferences of the elderly. [Means for solving the problem]

[0005] We developed a system that provides a conversation partner service for the elderly using generative AI and text-to-speech technology. This system was easy to implement initially by utilizing smartphone classrooms and government mobile services, and we realized a system that only requires voice conversation without the need for device operation. Furthermore, by checking the elderly's cognitive level and preferences at the time of implementation and customizing the generative AI individually, we were able to ensure that the elderly could continue to use the service without stress. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. 0 are connected to the bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] One embodiment of the present invention is a system that uses generative AI and text-to-speech technology to provide a conversation partner service for the elderly. This system can be easily implemented by seniors using smartphone classes and government mobile services, and realizes a system that requires no device operation and only requires voice conversation. Specifically, seniors access the system using the operation methods they learned in the smartphone classes. Furthermore, by using government mobile services, they can use the system while on the move.

[0029] "Example 2"

[0030] Furthermore, by checking the cognitive level and preferences of the elderly at the time of implementation and customizing the generating AI individually, the elderly can continue to use the service without stress. Specifically, a questionnaire is conducted with the elderly at the time of implementation, and the parameters of the generating AI are adjusted based on the answers. For example, it is possible to customize topics preferred by the elderly, easy-to-understand language, speaking speed, etc.

[0031] "Example 3"

[0032] In addition, generative AI generates conversation content according to the elderly person's cognitive level and preferences, and text-to-speech technology outputs the generated conversation content as audio. Specifically, generative AI generates topics that match the elderly person's preferences and cognitive level, and then text-to-speech technology converts the content into audio. This allows elderly people to enjoy conversations that match their preferences and cognitive level.

[0033] The processing flow of each embodiment will be described below.

[0034] "Example 1"

[0035] Step 1: The elderly access the system using the operation methods they learned in the smartphone class.

[0036] Step 2: The system displays a questionnaire to ascertain the elderly person's cognitive level and preferences.

[0037] Step 3: The elderly respond to the questionnaire.

[0038] Step 4: The system adjusts the parameters of the generation AI based on the answers to generate individually customized conversation content.

[0039] Step 5: The generated conversation content is converted into audio using text-to-speech technology and output to the elderly.

[0040] "Example 2"

[0041] Step 1: When an elderly person uses a government transportation service, they access the system.

[0042] Step 2: The system displays a questionnaire to ascertain the elderly person's cognitive level and preferences.

[0043] Step 3: The elderly respond to the questionnaire.

[0044] Step 4: The system adjusts the parameters of the generation AI based on the answers to generate individually customized conversation content.

[0045] Step 5: The generated conversation content is converted into audio using text-to-speech technology and output to the elderly.

[0046] Example 1

[0047] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0048] Elderly people often feel lonely in their daily lives, and there are concerns about declining cognitive function. Furthermore, for elderly people who are not good at using technology, operating complex devices can be a significant burden. There is a need to solve these problems and provide a conversation partner service that seniors can use without stress.

[0049] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0050] In this invention, the server includes means for the terminal to capture the user's voice input and send it to the server, means for the server to convert the voice data into text data, means for the server to analyze the text data using a generative AI model and generate an appropriate response, means for the server to convert the generated text response into voice data and send it to the terminal, and means for the terminal to play back the voice data.This enables elderly people to reduce their sense of loneliness through natural conversation without the need for complex operations, and to maintain and improve their cognitive function.

[0051] "Users" refer to elderly people who use the system.

[0052] A "terminal" is a device that allows a user to input voice, and includes a smartphone, tablet, etc.

[0053] "Server" refers to a central processing unit that processes voice data, generates text data, generates responses, and converts voice data.

[0054] "Voice input" refers to voice data generated by a user speaking into a terminal.

[0055] "Voice data" refers to a digital representation of a user's voice input.

[0056] "Text data" refers to data obtained by converting voice data into character information.

[0057] A "generative AI model" refers to an artificial intelligence model that analyzes input text data and generates an appropriate response.

[0058] "Response" refers to the reply generated by a generative AI model based on text data.

[0059] "Speech recognition software" refers to software for converting voice data into text data.

[0060] "Text to Speech technology" refers to technology that converts text data into voice data.

[0061] "Audio playback" refers to the device outputting audio data through a speaker.

[0062] This invention is a system that provides a conversation partner service for elderly people by utilizing a generative AI model and text-to-speech technology. Specific embodiments of this system are described below.

[0063] System configuration

[0064] server

[0065] The server is a central processing unit that processes voice data, generates text data, generates responses, and converts voice data. The server uses the following software:

[0066] Speech recognition software: Google® Cloud Speech-to-Text API

[0067] Generative AI model: GPT-4 (registered trademark) by OpenAI (registered trademark)

[0068] Text to Speech technology: Amazon (registered trademark) Polly

[0069] Terminal

[0070] A terminal is a device that allows a user to input voice information, such as a smartphone or tablet. A terminal has the following functions:

[0071] Microphone: Captures the user's voice

[0072] Network module: Sending audio data to the server

[0073] Speaker: Plays audio data received from the server

[0074] User

[0075] The users are elderly people who use the system to communicate by voice. They access the system using the operation methods they learned in the smartphone class.

[0076] System Operation

[0077] Voice input and transmission

[0078] The user inputs voice by speaking into the device. For example, they can input a question such as "What's the weather like today?" The device captures this voice with a microphone and generates voice data. The generated voice data is sent to the server via the device's network module.

[0079] Converting audio data to text

[0080] The server sends the received voice data to the Google Cloud Speech-to-Text API, which converts the voice data into text data. The converted text will be "What's the weather like today?"

[0081] Text data analysis and response generation

[0082] The server analyzes the converted text data using a generative AI model (GPT-4). Based on the analysis results, it generates a response such as "It's sunny today."

[0083] Text-to-speech response

[0084] The server sends the generated text response to Amazon Polly, which converts it into speech, which then says, "It's a sunny day today."

[0085] Sending and playing audio data

[0086] The server transmits the converted voice data to the terminal, which then plays the received voice data through a speaker, allowing the user to hear the voice saying "It's sunny today."

[0087] Specific examples

[0088] Example 1

[0089] The user speaks to the device, "What's the weather like today?" The device sends this speech to a server, which converts it into text. A generative AI model generates a response such as "It's sunny today," which is then converted into speech using TTS technology. Finally, the device's speaker plays back the message, "It's sunny today."

[0090] Example 2

[0091] The user speaks to the device, saying, "What are my plans for tomorrow?" The device sends the speech to the server, which converts it into text. The generative AI model generates a response such as, "I have a doctor's appointment tomorrow at 10:00 AM," which is then converted into speech using TTS technology. The device's speaker plays back the message, "I have a doctor's appointment tomorrow at 10:00 AM."

[0092] Prompt Sentence Examples

[0093] "Please explain the system that allows seniors to access the system using the operations they learned in the smartphone class and provides a companion service that can be used simply by having a voice conversation. This system utilizes generative AI models and text-to-speech technology."

[0094] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0095] Step 1:

[0096] The user speaks to the device. For example, they may ask a question such as "What's the weather like today?" The input is the user's voice, and the output is the voice data captured by the device's microphone. Specifically, the user presses the microphone button on their smartphone to speak.

[0097] Step 2:

[0098] The terminal captures the user's voice with a microphone and generates voice data. The generated voice data is sent to the server through the terminal's network module. The input is the captured voice data, and the output is digital voice data sent to the server. In specific operations, the terminal sends the voice data to the server in real time.

[0099] Step 3:

[0100] The server sends the received voice data to the Google Cloud Speech-to-Text API, which converts the voice into text data. The input is the voice data sent to the server, and the output is the converted text data. Specifically, the server calls the voice recognition software to convert the voice data into text.

[0101] Step 4:

[0102] The server uses a generative AI model (GPT-4) to analyze the converted text data and generate an appropriate response. The input is the converted text data, and the output is the generated text response. Specifically, the server inputs a prompt sentence into the generative AI model and generates a response.

[0103] Step 5:

[0104] The server sends the generated text response to Amazon Polly, which converts it to speech. The input is the generated text response, and the output is the converted speech. Specifically, the server invokes Text to Speech technology to convert the text response to speech.

[0105] Step 6:

[0106] The server transmits the converted voice data to the terminal. The input is the converted voice data, and the output is the voice data transmitted to the terminal. In a specific operation, the server transmits the voice data to the terminal.

[0107] Step 7:

[0108] The terminal plays the received voice data through the speaker. The input is the voice data sent from the server, and the output is the voice that the user can hear. In concrete terms, the terminal's speaker plays the voice data, and the user hears the voice saying, "It's sunny today."

[0109] (Application example 1)

[0110] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0111] Elderly people often feel lonely in their daily lives, and there are concerns about a decline in cognitive function. In addition, many elderly people find it difficult to operate smartphones or tablets when using food delivery services. This makes it difficult to order meals, leading to a decline in their quality of life.

[0112] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0113] In this invention, the server includes: a means for providing a conversation partner service for the elderly using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and sharing of memories; a means for initially utilizing smartphone classes and government transportation services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and expected continuity; a means for the elderly to order food delivery by voice; and a means for the generative AI to generate a response based on the elderly's order and respond by voice using text-to-speech technology. This makes it possible for the elderly to easily use food delivery services without feeling lonely and while maintaining their cognitive function.

[0114] "Generative AI" is a type of artificial intelligence technology, a system that has the ability to generate new data and information based on input data.

[0115] "Text to Speech technology" is a technology that converts text data into audio data, enabling a computer to read the text aloud in a natural voice.

[0116] The "conversation companion service for the elderly" is a service that helps the elderly maintain and promote cognitive function through conversation without feeling lonely.

[0117] A "smartphone class" is a class where elderly people can learn the basic operation methods of smartphones.

[0118] "Government transportation services" are public transportation support services that enable elderly people to use necessary services while on the move.

[0119] "Cognitive level" is an indicator that shows the state and ability of an individual's cognitive function.

[0120] "Personalization" refers to the adjustment and optimization of systems and services to meet the specific needs and preferences of users.

[0121] "Food delivery" is a service that allows you to order meals and have them delivered to a specified location.

[0122] "Responding with voice" means that the system responds with voice to the user's voice input.

[0123] The system for implementing this invention provides a conversation partner service for the elderly using generative AI and text-to-speech technology. The system uses the following hardware and software:

[0124] Hardware

[0125] Smartphone

[0126] microphone

[0127] software

[0128] OpenAI API

[0129] Text to Speech Engine

[0130] Speech Recognition Library

[0131] System action

[0132] The server first converts the user's speech into text using a speech recognition library, then uses generative AI to generate a response based on the user's input, which is then converted into audio using a text-to-speech engine and sent back to the user.

[0133] Specifically, when a user speaks into the smartphone's microphone, the speech is converted into text by a speech recognition library. For example, if a user asks, "What's today's recommendation?", the text is sent to the generative AI. The generative AI generates an appropriate response based on the prompt, and the response is converted into speech by the text-to-speech engine. Finally, the smartphone speaker responds to the user, saying, "Today's recommendation is curry rice and salad set. Would you like to order?"

[0134] Prompt Sentence Examples

[0135] Sample conversation for a senior citizen who wants to order food delivery: What are your recommendations today?

[0136] This system allows elderly people to easily order food delivery using only their voice, reducing feelings of loneliness and improving their quality of life while maintaining their cognitive function.

[0137] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0138] Step 1:

[0139] The user speaks into the smartphone microphone. The input is the user's voice, for example, "What's your recommendation today?" The output is voice data.

[0140] Step 2:

[0141] The device uses a speech recognition library to convert the user's speech into text. The input is speech data and the output is text data. Specifically, the speech recognition library analyzes the speech data and generates the text "What's your recommendation today?"

[0142] Step 3:

[0143] The device sends text data to the generative AI. The input is text data, and the output is a response text from the generative AI. Specifically, the generative AI generates an appropriate response based on the prompt. For example, it generates a response text such as, "Today's recommendation is curry rice and salad set. Would you like to order?"

[0144] Step 4:

[0145] The terminal sends the generated response text to the Text to Speech engine. The input is the response text and the output is audio data. Specifically, the Text to Speech engine converts the response text into audio.

[0146] Step 5:

[0147] The device responds to the user with the generated voice data through the smartphone's speaker. The input is voice data, and the output is the voice the user hears. Specifically, the smartphone's speaker plays the following voice: "Today's recommendation is curry rice and salad set. Would you like to order?"

[0148] This series of processes allows users to order food delivery using only their voice.

[0149] Example 2

[0150] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0151] To provide a conversation partner service that can be used continuously and without stress by the elderly, it is necessary to customize the service according to the cognitive level and preferences of each individual elderly person. However, conventional systems do not provide sufficient individual customization, and elderly people often feel stressed when using the service. In addition, for elderly people who have difficulty operating devices, there was a need for a system that allows them to communicate using only voice without the need for operation.

[0152] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0153] In this invention, the server includes means for conducting a questionnaire and adjusting the parameters of the generative AI based on the responses, means for downloading the customized generative AI model to a terminal and using it to provide services, and means for receiving input from a user and generating a response in response to that input using the generative AI model. This enables individual customization according to the cognitive level and preferences of the elderly, allowing them to continue using the service without stress.

[0154] "Generative AI" is an artificial intelligence technology that generates natural language responses based on user input.

[0155] "Speech synthesis technology" is a technology that converts text data into voice data.

[0156] The "conversation partner service for the elderly" is a service that allows elderly people to enjoy conversations via voice, with the aim of promoting cognitive function and reducing stress.

[0157] "Methods for promoting cognitive function" are methods for improving cognitive function in the elderly through conversation and sharing memories.

[0158] A "mobile information terminal classroom" is a classroom where elderly people can learn how to use mobile information terminals.

[0159] "Public services" are services provided by government agencies and public organizations, including transportation assistance and life support.

[0160] A "questionnaire" is a survey instrument that includes questions to ascertain a user's awareness level and preferences.

[0161] "Means for adjusting parameters" refers to a method for changing the settings of generative artificial intelligence based on the responses to a questionnaire.

[0162] A "customized generative artificial intelligence model" is a generative artificial intelligence model that is adjusted according to the user's cognitive level and preferences.

[0163] "User input" refers to voice or text instructions or questions that a user gives to the system.

[0164] A "means for generating a response" is a method for generating an appropriate response based on input from a user.

[0165] This invention is a system that provides a conversation partner service that can be used continuously and without stress by the elderly. The system utilizes generative artificial intelligence and speech synthesis technology to customize the service to suit the elderly's cognitive level and preferences.

[0166] First, the server conducts a survey of elderly people when the system is introduced. The survey includes questions to confirm the user's cognitive level and preferences. For example, it includes questions such as, "What are your favorite topics?" and "Do you prefer someone to speak faster?" The survey response data is collected and stored on the server.

[0167] The server then analyzes the collected survey data and adjusts the parameters of the generative AI model, including topics preferred by seniors, easy-to-understand language, speaking speed, etc. Specifically, by updating the parameter setting file of the generative AI model, an individually customized generative AI model is created.

[0168] The terminal uses a customized generative artificial intelligence model to provide services to the elderly. The terminal receives input from the user and generates a response based on that input using the generative artificial intelligence model. This response is tailored to the elderly's preferences and cognitive level, allowing the user to use the service without stress.

[0169] As a specific example, if an elderly person answers a questionnaire by saying, "I like talking about history and prefer to speak slowly," the server will adjust the parameters of the generative artificial intelligence model to generate responses that include more history-related topics and set the speaking speed to be slower.

[0170] Example prompt sentence:

[0171] "Please speak slowly on topics related to history."

[0172] When this prompt is fed into a generative AI model, the model generates a response tailored to the topic and speaking speed preferred by the elderly person, such as, "Let me tell you about the culture of the Edo period. The Edo period lasted from 1603 to 1868..."

[0173] In this way, the system provides customized services according to the cognitive level and preferences of the elderly, allowing them to continue using the service without stress.

[0174] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0175] Step 1:

[0176] The server will conduct a questionnaire for the elderly when the system is introduced, which includes questions to confirm the user's cognitive level and preferences.

[0177] Input: User's survey response

[0178] Output: Survey response data

[0179] Specific operation: The server generates a questionnaire form and sends it to the terminal. The terminal displays the questionnaire form and the user enters their answers.

[0180] Step 2:

[0181] The terminal transmits the questionnaire responses entered by the user to the server.

[0182] Input: User's survey response

[0183] Output: Survey data sent to the server

[0184] Specific operation: The terminal sends the user's input in real time to the server, which stores it in a database.

[0185] Step 3:

[0186] The server analyzes the collected survey data and adjusts the parameters of the generative artificial intelligence model.

[0187] Input: Survey data

[0188] Output: Adjusted parameters of the generative artificial intelligence model

[0189] How it works: The server uses data analysis algorithms to identify the user's preferences and cognitive level, and updates the configuration files of the generative artificial intelligence model accordingly.

[0190] Step 4:

[0191] The terminal downloads the customized generative artificial intelligence model and uses it to provide services.

[0192] Input: Adjusted parameters of the generative artificial intelligence model

[0193] Output: A customized generative artificial intelligence model

[0194] Specific operation: The server sends the customized generative artificial intelligence model to the terminal, which receives and installs it.

[0195] Step 5:

[0196] The terminal receives input from the user and generates a response in response to the input using a generative artificial intelligence model.

[0197] Input: Voice input from the user

[0198] Output: The generated response

[0199] Specific operation: When a user speaks to the device, the device sends the input to the generative artificial intelligence model, which then generates an appropriate response and returns it to the device, which then displays or speaks the response to the user.

[0200] (Application example 2)

[0201] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0202] When seniors shop in brick-and-mortar stores, they need easy-to-understand information for product explanations and selection. However, it is difficult for general store staff and standard guidance systems to provide personalized service according to the cognitive level and preferences of seniors. As a result, seniors may feel stressed and their shopping experience may be unsatisfactory. To solve this problem, a system that can be individually customized according to the cognitive level and preferences of seniors is needed.

[0203] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0204] In this invention, the server includes: a means for providing a conversation partner service for seniors using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and memory sharing; a means for initially utilizing smartphone classes and government mobility services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and ensure continued use; a means for providing a personalized shopping assistant for seniors in physical stores; and a means for adjusting parameters of the generative AI based on survey results and generating individually customized responses. This makes it possible to provide personalized information according to cognitive level and preferences when seniors shop in physical stores, enabling a stress-free and satisfying shopping experience.

[0205] "Generative AI" is an artificial intelligence technology that generates responses in natural language based on user input.

[0206] "Text to Speech technology" is a technology that converts text data into voice data.

[0207] The "conversation partner service for the elderly" is a service that promotes cognitive function through conversation and allows elderly people to enjoy stress-free communication.

[0208] A "smartphone class" is a class where elderly people can learn the basic operations and how to use smartphones.

[0209] "Government transportation services" are transportation support services for the elderly provided by government agencies.

[0210] A "personalized shopping assistant" is an assistant that supports shopping based on the user's individual preferences and needs.

[0211] "Survey results" are the results of questions answered by users, and are data used to understand individual preferences and awareness levels.

[0212] "Adjusting parameters" means changing the settings of the generating AI according to the user's individual preferences and cognitive level.

[0213] A "personalized response" is a specific response generated based on a user's individual preferences and cognitive level.

[0214] The system for implementing this invention provides a conversation partner service for the elderly using generative AI and text-to-speech technology. The system operates among three parties: a server, a terminal, and a user.

[0215] The server uses generative AI to generate natural language responses based on user input. The generative AI adjusts parameters based on the results of the user's questionnaire and generates individually customized responses. This makes it possible to provide personalized information according to the elderly person's cognitive level and preferences.

[0216] The terminal is a device such as a smartphone or tablet that provides an interface for users to answer the questionnaire. The generated responses are output as audio using text-to-speech technology, allowing elderly people to converse by voice without having to operate the terminal.

[0217] Users use a terminal in a physical store to answer a survey. The survey results are sent to a server, and the generative AI generates an individually customized response. For example, if a user asks, "I'm looking for healthy foods," the generative AI will respond as follows:

[0218] Example prompt sentence:

[0219] Hello, user! What products are you looking for today?

[0220] Your topics of interest are health and travel.

[0221] The speaking speed is set to slow.

[0222] User Input: Looking for healthy foods

[0223] Example of a response from the generating AI:

[0224] User, you're looking for healthy foods. Some recommendations include organic vegetables and fruits, whole wheat bread, and low-fat yogurt. These are great for maintaining good health. We can also recommend some healthy snacks that are easy to carry when traveling.

[0225] In this way, the server uses generative AI to generate responses based on the user's individual preferences and cognitive level, and the device outputs the responses as voice, making it possible to provide elderly people with a stress-free and satisfying shopping experience when shopping in physical stores.

[0226] The hardware used is a smartphone or tablet, and the software uses Python (registered trademark) and OpenAI's API. The generative AI is accessed through OpenAI's API, and the text-to-speech technology uses the device's built-in voice synthesis engine.

[0227] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0228] Step 1:

[0229] The user answers the questionnaire using the terminal.

[0230] Input: User's survey responses (name, age, favorite topics, speaking speed, etc.)

[0231] Output: Survey result data

[0232] Specific operation: The user answers the questionnaire through the device interface. The device collects the answers as data and sends them to the server.

[0233] Step 2:

[0234] The server receives the survey results and adjusts the parameters of the generative AI.

[0235] Input: Survey result data

[0236] Output: Adjusted generative AI parameters

[0237] Specific operation: The server analyzes the survey results and adjusts the parameters of the generative AI according to the user's cognitive level and preferences, such as the speaking speed and the language used.

[0238] Step 3:

[0239] The user uses the terminal to enter a question.

[0240] Input: User's question (in text format)

[0241] Output: User question data

[0242] Specific operation: The user inputs a question through the terminal interface, and the terminal collects this question as data and sends it to the server.

[0243] Step 4:

[0244] The server uses generative AI to generate responses to users' questions.

[0245] Input: User question data, adjusted generative AI parameters

[0246] Output: Generated response (in text format)

[0247] Specific operation: The server uses generative AI to generate a natural language response based on the user's question and adjusted parameters. For example, if a user asks, "I'm looking for healthy foods," the generative AI will generate an appropriate response.

[0248] Step 5:

[0249] The server sends the generated response to the terminal.

[0250] Input: Generated response (in text format)

[0251] Output: Response data sent to the terminal

[0252] Specific operation: The server sends the generated response to the terminal, which receives the data.

[0253] Step 6:

[0254] The device will output the response as audio using Text to Speech technology.

[0255] Input: Generated response data (text format)

[0256] Output: Audio output

[0257] Specific operation: The device converts the received response data into audio using text-to-speech technology and provides a voice response to the user, such as "Recommended products include organic vegetables and fruits, whole wheat bread, and low-fat yogurt."

[0258] Through these steps, when elderly people shop in physical stores, it will be possible to provide them with personalized information according to their level of awareness and preferences, providing them with a stress-free and satisfying shopping experience.

[0259] Example 3

[0260] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0261] There is a demand for a system that allows elderly people to enjoy conversations that suit their cognitive level and preferences. However, with conventional systems, it is difficult to generate conversation content that suits the cognitive level and preferences of the elderly, and the operation is complicated, making it difficult for elderly people to use without stress. Furthermore, there is a lack of technology to output the conversation content as audio, which has been a problem in that elderly people cannot actually enjoy the conversation.

[0262] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0263] In this invention, the server includes a means for a user to input information about the elderly person, a means for the server to collect and store the input information, a means for the server to send a prompt to the generative AI model, a means for the generative AI model to generate conversation content, a means for the server to send the generated conversation content to TTS technology, a means for the TTS technology to convert the conversation content into speech, and a means for the terminal to play back the generated speech, thereby enabling the elderly person to enjoy conversations tailored to their cognitive level and preferences without stress.

[0264] "User" refers to a person who uses the system to input information about an elderly person.

[0265] "Server" refers to a device or system that collects and stores information entered by users and sends prompts to the generative AI model.

[0266] "Generative AI model" refers to an artificial intelligence model that generates conversation content based on prompt text.

[0267] A "prompt" is a piece of text that contains instructions for a generative AI model to generate conversational content.

[0268] "TTS technology" is an abbreviation for Text to Speech technology, and refers to the technology of converting text-based conversation content into voice.

[0269] "Terminal" refers to a device or system that plays back the generated audio.

[0270] "Elderly" refers to older people who can enjoy conversations through the system.

[0271] "Cognitive level" refers to an indicator that shows the state of cognitive function in the elderly.

[0272] "Preferences" refers to topics and concerns that interest older people.

[0273] "Conversational content" refers to the textual information generated by the generative AI model based on the prompt.

[0274] This invention is a system that utilizes generative AI and Text to Speech (TTS) technology to generate conversation content tailored to the cognitive level and preferences of elderly people and output it as voice. Specific embodiments of this system are described below.

[0275] Hardware and software used

[0276] This system uses the following hardware and software:

[0277] Server: A central processing unit for collecting and storing information about seniors and sending prompts to the generative AI model.

[0278] Device: A device used by an older adult to play back the generated audio, such as a smartphone or tablet.

[0279] Generative AI model: An artificial intelligence model that generates conversational content based on a prompt. Examples include OpenAI's GPT-4.

[0280] TTS technology: Text to speech technology that converts text-based conversation content into audio. Specifically, Google Cloud Text-to-Speech is one example.

[0281] Data processing and calculation

[0282] The server collects the elderly person's information entered by the user and stores it in a database. The server then generates prompt text based on the stored information and sends it to the generative AI model. The generative AI model generates conversation content based on the prompt text and returns the content to the server. The server then sends the generated conversation content to the TTS technology, which converts it into speech. Finally, the device plays the generated speech to the elderly person.

[0283] Specific examples

[0284] The user opens the application and enters the elderly person's information: "Name: Tanaka, Interests: Music, History, Cognitive Level: Medium." The server stores this information in a database and sends a prompt, "Tanaka is interested in music and history. Please talk to him about recent music trends and historical events." to the generative AI model. The generative AI model generates conversation content such as "Talk about artists popular among young people as recent music trends, and famous battles from the Warring States period as historical events." The server sends this content to the TTS technology, which converts it into speech. Finally, the device plays the generated speech to Tanaka, who can enjoy an interesting conversation.

[0285] In this way, the system provides an appropriate conversation experience for elderly people through cooperation between the server, the terminal, and the user. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0286] Step 1:

[0287] The user enters the senior's information.

[0288] Users input the elderly person's cognitive level and preferences (e.g., topics of interest, favorite music genres, etc.) through a dedicated application or web interface. This input data becomes the basis for the system to generate conversation content appropriate for the elderly. The input information is sent to the server in the form of name, interests, cognitive level, etc.

[0289] Step 2:

[0290] The server collects and stores the information you enter.

[0291] The server receives the information of the elderly sent by the user and stores it in the database. This data will be used in subsequent processing. Specifically, the server performs an INSERT operation on the database to store the entered information. The input is information from the user, and the output is the information stored in the database.

[0292] Step 3:

[0293] The server sends a prompt to the generative AI model.

[0294] The server generates a prompt based on the stored information about the elderly person. For example, it generates a prompt such as, "Mr. Tanaka is interested in music and history. Please talk to him about recent music trends and historical events." This prompt is sent to a generative AI model. The input is the elderly person's information obtained from the database, and the output is the generated prompt.

[0295] Step 4:

[0296] A generative AI model generates the conversation content.

[0297] A generative AI model (e.g., OpenAI's GPT-4) generates appropriate conversational content based on the received prompt. The generated conversational content is returned to the server in text format. The input is the prompt, and the output is the generated conversational content.

[0298] Step 5:

[0299] The server sends the generated conversation to the TTS technology.

[0300] The server receives the speech returned by the generative AI model and sends it to a Text to Speech (TTS) technology (e.g., Google Cloud Text-to-Speech). The input is the generated speech, and the output is the text data sent to the TTS technology.

[0301] Step 6:

[0302] TTS technology converts conversations into audio.

[0303] TTS technology converts received text-based conversation content into voice data, which is then returned to the server. The input is text-based conversation content, and the output is voice data.

[0304] Step 7:

[0305] The device plays the generated audio.

[0306] The device plays back the voice data received from the server. Through this voice, elderly people can enjoy conversations tailored to their preferences and cognitive level. The input is voice data, and the output is the played-back voice.

[0307] (Application example 3)

[0308] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0309] When elderly people shop or use services at physical stores, they often experience stress and inconvenience due to a lack of appropriate guidance and support tailored to their cognitive level and preferences. Communication with store staff can also be difficult, making it difficult for elderly people to comfortably use the store. Furthermore, services are not customized to meet individual needs, making it difficult for them to continue using the service.

[0310] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0311] In this invention, the server includes: a means for providing a conversation partner service for the elderly using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and sharing of memories; a means for initially utilizing smartphone classes and government transportation services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and expected continuity; a means for providing guidance and product explanations to enable the elderly to comfortably shop and use services in physical stores; and a means for generating conversation content based on the elderly's preferences and cognitive level and supporting communication with store staff, thereby enabling the elderly to comfortably shop and use services in physical stores.

[0312] "Generative AI" is an artificial intelligence technology that generates conversation content based on the cognitive level and preferences of elderly people.

[0313] "Text to Speech technology" is a technology that converts generated text data into voice data.

[0314] The "Elderly Conversation Partner Service" utilizes generative AI and text-to-speech technology to promote cognitive function for the elderly through conversation and sharing of memories.

[0315] A "smartphone class" is a class where elderly people can learn the basic operations of smartphones.

[0316] "Government transportation services" are means of transportation provided to elderly people when they use government services.

[0317] "Individual customization" means adjusting the settings of generative AI according to the cognitive level and preferences of the elderly person.

[0318] A "physical store" is a store that exists in a physical location and where customers visit in person to purchase products or services.

[0319] "Guidelines and product descriptions" are information provided to seniors to help them shop and use services comfortably in physical stores.

[0320] "Communication support with store staff" is support for elderly people to communicate smoothly with staff in physical stores.

[0321] This invention is a system that uses generative AI and text-to-speech technology to provide a conversation partner service for the elderly. The system provides guidance and product explanations to help seniors shop and use services in brick-and-mortar stores more comfortably, and supports communication with store staff.

[0322] System configuration

[0323] The system consists of the following main components:

[0324] 1. Generative AI: Artificial intelligence technology that generates conversation content based on the cognitive level and preferences of the elderly.

[0325] 2. Text to Speech technology: Technology that converts generated text data into voice data.

[0326] 3. Smartphone: A device held by the elderly that runs generative AI and text-to-speech technology.

[0327] 4. Server: Hosts the generative AI model and generates conversation content based on prompts.

[0328] Program processing

[0329] The server performs the following steps:

[0330] 1. Prompt generation: Generate prompts based on the elderly person's preferences and cognitive level. For example, generate a prompt such as "Generate a conversation based on the elderly person's preferences: music and cooking, and cognitive level: moderate."

[0331] 2. Conversation generation: Use generative AI (e.g., OpenAI's GPT-3®) to generate conversational content based on the prompt.

[0332] 3. Audio generation: The generated conversation is converted into an audio file using the Google Cloud Text-to-Speech API.

[0333] 4. Play audio: Play the generated audio file on your smartphone.

[0334] Hardware and software used

[0335] Hardware: Smartphone

[0336] Software: OpenAI GPT-3 API, Google Cloud Text-to-Speech API, Python

[0337] Specific examples

[0338] For example, when shopping in a brick-and-mortar store, seniors generate prompts like:

[0339] Generate conversational content based on the preferences of an elderly person: music and cooking, cognitive level: moderate.

[0340] This prompt is sent to the server, and the generative AI generates the conversation content. For example, the generated conversation content might be, "A new music album has arrived today. I can also introduce you to some cooking recipes." This text is converted into audio using the Google Cloud Text-to-Speech API and played on the smartphone.

[0341] This will enable elderly people to comfortably shop and use services in physical stores, and will also enable smooth communication with store staff.

[0342] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0343] Step 1:

[0344] The user starts up the smartphone, opens the application, and enters information about the user's preferences and cognitive level, which is then sent to the server.

[0345] Input: User preferences (e.g., music and cooking), cognitive level (e.g., intermediate)

[0346] Output: Data needed to generate the prompt sent to the server

[0347] Step 2:

[0348] The server generates prompts based on the received user preferences and cognitive level, and sends the generated prompts to the generative AI.

[0349] Input: Data about user preferences and cognitive level

[0350] Output: A prompt sent to the generative AI (e.g., "Generate a conversation based on an elderly person's preferences for music and cooking and their cognitive level: moderate.")

[0351] Step 3:

[0352] The generative AI generates conversation content based on the prompt sentence, and the generated conversation content is returned to the server.

[0353] Input: prompt statement

[0354] Output: Generated conversation (e.g., "A new music album arrived today. I can also share some cooking recipes with you.")

[0355] Step 4:

[0356] The server sends the generated conversation content to the Google Cloud Text-to-Speech API to generate audio data, which is then returned to the server.

[0357] Input: Generated conversation

[0358] Output: Audio data (e.g. audio file)

[0359] Step 5:

[0360] The server transmits the generated voice data to the smartphone, which then plays the received voice data.

[0361] Input: Audio data

[0362] Output: Audio played on smartphone

[0363] Step 6:

[0364] Users listen to the audio played on their smartphones, shop in stores, use services, and request additional information or support if needed.

[0365] Input: Audio played from smartphone

[0366] Output: User behavior (e.g., searching for a product, asking a store staff member a question)

[0367] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0368] "Example 1"

[0369] One embodiment of the present invention is a system that incorporates an emotion engine. This system recognizes a user's emotions and adjusts the conversation content of the generative AI and the voice output of the text-to-speech technology according to those emotions. Specifically, when the user is feeling happy, the generative AI provides cheerful topics and the text-to-speech technology outputs voice in a bright tone. Conversely, when the user is feeling sad, the generative AI provides comforting words and the text-to-speech technology outputs voice in a gentle tone. This improves adaptability to the user's emotions and enables a more natural conversation experience.

[0370] "Example 2"

[0371] The emotion engine can also track changes in a user's emotions over time. This allows it to understand the user's emotional patterns and optimize the generative AI's conversational content and text-to-speech technology's voice output accordingly. For example, if a user tends to feel sad in the evening each day, the system can adjust the generative AI to provide comforting words at that time of day.

[0372] "Example 3"

[0373] Furthermore, the emotion engine can learn and improve the system's response to the user's emotions. This is achieved by analyzing how the user's emotions change depending on the system's response and adjusting the system's response based on the results. For example, if the system responds to a user's sadness in a specific way and the user's sadness is reduced, the system learns that the response was effective. This allows the system to learn more appropriate responses to the user's emotions over time, improving the user experience.

[0374] The processing flow of each embodiment will be described below.

[0375] "Example 1"

[0376] Step 1: The emotion engine recognizes the user's emotions through conversation with the user.

[0377] Step 2: Generative AI adjusts the conversation content based on the emotions recognized by the emotion engine.

[0378] Step 3: At the same time, the Text to Speech technology adjusts the tone of the voice output based on the emotion recognized by the emotion engine.

[0379] "Example 2"

[0380] Step 1: Through conversation with the user, the emotion engine recognizes the user's emotions and tracks changes in those emotions over time.

[0381] Step 2: The emotion engine analyzes the tracked emotion patterns and optimizes the generative AI conversation content and the voice output of the text-to-speech technology accordingly.

[0382] "Example 3"

[0383] Step 1: The emotion engine recognizes the user's emotions through conversation with the user.

[0384] Step 2: The system responds to the user's emotions, and the emotion engine analyzes how the response affected the user's emotions.

[0385] Step 3: Based on the analysis results of the emotion engine, the system adjusts its responses and learns.

[0386] Example 1

[0387] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0388] Elderly people often feel lonely in their daily lives, which can lead to cognitive decline and increased mental stress. Furthermore, digital devices are often difficult to use due to technical difficulties. Furthermore, it is difficult to respond to the emotions and preferences of individual elderly people, and general conversation systems cannot provide satisfactory services.

[0389] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0390] In this invention, the server includes: a means for providing a conversation partner service for seniors using generative AI and speech synthesis technology; a means for promoting cognitive function through conversation and memory sharing; a means for initial use using mobile information terminal classrooms and public services, whereby conversations can be conducted simply by voice without the need for device operation; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to ensure stress-free use and ensure continued use; and a means for recognizing the user's emotions and adjusting the conversation content of the generative AI and the voice output of the speech synthesis technology according to those emotions. This prevents seniors from feeling lonely, prevents cognitive decline, and reduces mental stress. Furthermore, no technical operation is required, and responses can be made to each senior's emotions and preferences.

[0391] "Generative AI" is an artificial intelligence technology that generates responses in natural language based on user input.

[0392] "Speech synthesis technology" is a technology that converts text data into voice data and outputs it as natural voice.

[0393] The "Elderly Conversation Service" is a service that promotes cognitive function and provides mental support through conversation, so that elderly people do not feel lonely.

[0394] A "Mobile Information Device Classroom" is a classroom where students learn how to operate mobile information devices such as smartphones and tablets.

[0395] "Public services" are services such as transportation assistance and life support provided by government agencies and public organizations.

[0396] The "cognitive level" is an index that indicates the state of the user's cognitive function.

[0397] "Individual customization" refers to adjusting system settings and responses based on the user's cognitive level and preferences.

[0398] "Emotion recognition" is a technology that analyzes a user's emotions from their voice, facial expressions, etc., and identifies their state.

[0399] "Conversation content" is text data generated by generative AI for dialogue with the user.

[0400] "Audio output" refers to the reproduction of audio data generated using speech synthesis technology through speakers or the like.

[0401] MODE FOR CARRYING OUT THE INVENTION

[0402] This invention is a system that provides a conversation partner service for the elderly, utilizing generative AI and voice synthesis technology. This system can be easily implemented by users using smartphone classes and public services, and realizes a system that only requires voice communication without the need for device operation. In addition, by combining it with emotion recognition technology, the content of the conversation and voice output can be adjusted according to the user's emotions.

[0403] Hardware and software used

[0404] Hardware: smartphones, tablets, microphones, speakers

[0405] Software: Generative AI (e.g., natural language processing models), speech synthesis technology (e.g., speech synthesis engines), emotion recognition technology (e.g., emotion analysis engines)

[0406] Specific operation of the system

[0407] 1. Initial Setup and Access

[0408] Users access the system using the operation method they learned in the smartphone class, specifically by launching the smartphone app and entering their login information.

[0409] The device receives user input and connects to a server over the internet, where the device uses Wi-Fi or mobile data.

[0410] 2. Emotion recognition

[0411] The user speaks to the device, for example, saying, "I'm a little tired today."

[0412] The device records the user's voice and transmits the data to the server in real time. The device uses a microphone to capture the voice.

[0413] The server passes the received voice data to the emotion analysis engine, which analyzes the voice data and identifies the user's emotion. For example, it determines that the user is feeling tired from the word "tired."

[0414] 3. Conversation content generation

[0415] The server sends prompts to the generative AI based on the emotional information obtained from the emotion analysis engine. The prompts include instructions for generating conversational content according to the user's emotions. For example, the server sends a prompt such as, "If the user is tired, please offer words of encouragement."

[0416] Generative AI generates appropriate conversational content based on the prompt text, such as "Today was tough, but let's take a break and refresh ourselves."

[0417] 4. Audio Output

[0418] The server passes the generated text to a speech synthesis engine to generate voice data. The speech synthesis engine converts the generated text into speech and outputs it in an appropriate tone. For example, it generates a voice in a gentle tone saying, "Today was tough, wasn't it? But let's take a break and refresh yourself."

[0419] The device receives the audio data sent from the server and plays it through the speaker, allowing the user to listen to the audio coming from the device.

[0420] Specific examples

[0421] Example prompt: "If the user is tired, offer words of encouragement."

[0422] Generative AI output: "You've had a tough day. Let's take a break and refresh yourself."

[0423] Text-to-speech technology output: "Today has been tough, but it's time to take a break and refresh yourself" in a gentle tone.

[0424] In this way, appropriate conversation content and voice output are provided according to the user's emotions, resulting in a more natural and friendly conversation experience.

[0425] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0426] Step 1:

[0427] Initial Setup and Access

[0428] Users access the system using the operation method they learned in the smartphone class. Specifically, they launch the smartphone app and enter their login information.

[0429] The device receives user input and connects to a server over the internet, where the device uses Wi-Fi or mobile data.

[0430] Input: User login information

[0431] Output: Connection established to server

[0432] Step 2:

[0433] emotion recognition

[0434] The user speaks to the device, for example, saying, "I'm a little tired today."

[0435] The device records the user's voice and transmits the data to the server in real time. The device uses a microphone to capture the voice.

[0436] The server passes the received voice data to the emotion analysis engine, which analyzes the voice data and identifies the user's emotion. For example, it determines that the user is feeling tired from the word "tired."

[0437] Input: User's voice data

[0438] Output: User's emotional state (e.g., fatigue)

[0439] Step 3:

[0440] Conversation generation

[0441] The server sends prompts to the generative AI based on the emotional information obtained from the emotion analysis engine. The prompts include instructions for generating conversational content according to the user's emotions. For example, the server sends a prompt such as, "If the user is tired, please offer words of encouragement."

[0442] Generative AI generates appropriate conversational content based on the prompt text, such as "Today was tough, but let's take a break and refresh ourselves."

[0443] Input: User's emotion information, prompt sentence

[0444] Output: Generated conversation (e.g., words of encouragement)

[0445] Step 4:

[0446] Audio Output

[0447] The server passes the generated text to a speech synthesis engine to generate voice data. The speech synthesis engine converts the generated text into speech and outputs it in an appropriate tone. For example, it generates a voice in a gentle tone saying, "Today was tough, wasn't it? But let's take a break and refresh yourself."

[0448] The device receives the audio data sent from the server and plays it through the speaker, allowing the user to listen to the audio coming from the device.

[0449] Input: Generated conversation

[0450] Output: Audio data (e.g., encouraging words in a gentle tone)

[0451] In this way, appropriate conversation content and voice output are provided according to the user's emotions, resulting in a more natural and friendly conversation experience.

[0452] (Application example 1)

[0453] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0454] There is a problem that it is difficult to provide appropriate support to elderly people when they are in a physical store and want product information or guidance within the store. There is also a problem that it is not possible to provide appropriate conversation content that reflects the emotions of the elderly, which does not improve the user experience. Furthermore, there is a lack of systems that promote cognitive function and enable stress-free use.

[0455] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0456] In this invention, the server includes: a means for providing a conversation partner service for the elderly using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and sharing of memories; a means for initially utilizing smartphone classes and government transportation services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and ensure continued use; a means for providing support to the elderly when receiving product information or in-store guidance in physical stores; and a means for recognizing user emotions using an emotion engine and having the generative AI provide appropriate conversation content. This enables the elderly to enjoy shopping comfortably in physical stores, improves the user experience, promotes cognitive function, and realizes stress-free use.

[0457] "Generative AI" is an artificial intelligence technology that generates appropriate responses based on user input.

[0458] "Text to Speech technology" is a technology that converts text data into voice data.

[0459] The "Elderly People's Conversation Partner Service" is a service that allows elderly people to enjoy conversations via voice.

[0460] "Sharing conversations and memories" refers to the user and the system discussing past events and topics of interest.

[0461] A "means for enhancing cognitive function" is a method or technology for improving a user's cognitive abilities.

[0462] A "smartphone class" is a class where students learn how to operate a smartphone.

[0463] "Government transportation services" refers to transportation services provided by the government.

[0464] "Means for communicating by voice without operating the terminal" refers to a method that allows a user to communicate with the system using only voice without operating the device.

[0465] "Means for ascertaining cognitive level and preferences" are methods for assessing a user's cognitive abilities and personal preferences.

[0466] "Means for individually customizing generative AI" refers to a method for adjusting the behavior of generative AI according to the characteristics of the user.

[0467] "Means for providing support to elderly people when they receive product information or directions within the store in a physical store" refers to a method of providing support to elderly people when they receive product information or directions within the store in a physical store.

[0468] An "emotion engine" is a technology that recognizes the user's emotions and adjusts the system's behavior according to those emotions.

[0469] The "means for recognizing the user's emotions" is a method for detecting the user's emotional state.

[0470] "Means for providing appropriate conversation content" refers to a method for generating appropriate conversation according to the user's situation and emotions.

[0471] The system for implementing this invention utilizes generative AI and text-to-speech technology to provide a conversation partner service for the elderly. The system is configured using the following hardware and software.

[0472] Hardware

[0473] Smartphone

[0474] Smart Glasses

[0475] server

[0476] software

[0477] OpenAI API (generative AI)

[0478] Text to Speech Engine

[0479] Emotion Recognition Engine

[0480] System configuration

[0481] 1. Getting User Input

[0482] Users input their voice via a smartphone or smart glasses, which is converted into text data and sent to the server.

[0483] 2. Emotion recognition

[0484] The server uses an emotion recognition engine to recognize emotions from the user's input, which analyzes the user's voice and text data to identify emotions such as joy, sadness, and anger.

[0485] 3. Response Generation

[0486] The server uses the OpenAI API to generate appropriate responses based on the user's emotions and input. Generative AI creates prompts based on the user's emotional state and provides optimal conversational content.

[0487] 4. Audio Output

[0488] The server converts the generated response into voice data using a Text to Speech engine and sends it to the user's device. The Text to Speech engine outputs voice in a tone that corresponds to the user's emotion.

[0489] Specific examples

[0490] For example, if a user asks "Where is this item?" in a physical store, the system works as follows:

[0491] User Input: "Where is this item located?"

[0492] User Emotion: Delight

[0493] Generated response: "That item is in aisle 3. Can I show you?"

[0494] Prompt Sentence Examples

[0495] User Emotion: Delight

[0496] User Input: Where is this item located?

[0497] Generate an appropriate response.

[0498] In this way, a system can be realized that provides support for elderly people to enjoy shopping comfortably in physical stores. The system provides appropriate conversation content according to the user's emotions, promoting cognitive function and realizing stress-free use.

[0499] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0500] Step 1:

[0501] The user provides voice input via a smartphone or smart glasses.

[0502] Input: User's voice data

[0503] Output: Text data

[0504] Specific operation: The device uses voice recognition software to convert the user's speech into text and sends the text data to the server.

[0505] Step 2:

[0506] The server uses an emotion recognition engine to recognize emotions from the user's input.

[0507] Input: Text data

[0508] Output: Emotion data (happiness, sadness, anger, etc.)

[0509] Specific operation: The server inputs the text data into the emotion recognition engine and applies the emotion recognition algorithm to identify the user's emotion.

[0510] Step 3:

[0511] The server uses the OpenAI API to generate appropriate responses based on the user's emotions and inputs.

[0512] Input: Text data, emotion data

[0513] Output: Response text

[0514] Specific operation: The server sends emotion data and text data as a prompt to the OpenAI API, and the generative AI model generates an appropriate response text.

[0515] Step 4:

[0516] The server converts the generated response into audio data using a Text to Speech engine and sends it to the user's device.

[0517] Input: Response text

[0518] Output: Audio data

[0519] Specific operation: The server inputs the response text into the Text to Speech engine, which then generates voice data, which is then sent to the user's device.

[0520] Step 5:

[0521] The terminal plays the received audio data and provides a response to the user.

[0522] Input: Audio data

[0523] Output: Audio output

[0524] Specific operation: The terminal plays the received voice data through the speaker and provides a response to the user.

[0525] Example 2

[0526] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0527] There is a need to provide a conversation partner service that can be used continuously by the elderly without stress. In particular, it is necessary to customize the service to suit the elderly's cognitive level and preferences, and it is also important to track changes in the user's emotions and optimize the content of the conversation based on that. However, conventional systems have difficulty meeting these requirements, making it difficult for the elderly to continue using the service.

[0528] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0529] In this invention, the server includes: a means for providing a conversation partner service for the elderly using generative AI and voice synthesis technology; a means for promoting cognitive function through conversation and sharing of memories; a means for initially utilizing educational programs and public services and simply conversing by voice without the need to operate a device; a means for confirming the user's cognitive level and preferences at the time of installation and individually customizing the generative AI; a means for collecting user emotional data and tracking changes in emotion over time; and a means for optimizing the conversation content of the generative AI based on the emotional data. This enables the elderly to continue using the service without stress.

[0530] "Generative AI" is an artificial intelligence technology that dynamically generates conversation content based on user input and environmental data.

[0531] "Speech synthesis technology" is a technology that converts text data into voice data and outputs it as natural voice.

[0532] The "conversation partner service for the elderly" is a service that allows elderly people to enjoy conversations through voice, with the aim of promoting cognitive function and reducing feelings of loneliness.

[0533] "Methods for promoting cognitive function" are methods and techniques for improving cognitive function in the elderly through conversation and sharing memories.

[0534] An "educational program" is a program that provides educational content to help users understand and use the system effectively.

[0535] "Public services" are services provided by government agencies and public organizations, and are used to initially launch a system.

[0536] "Individual customization" refers to adjusting system settings and generative AI parameters according to the user's cognitive level and preferences.

[0537] "Emotion data" is data that indicates the user's emotional state, and is collected from facial expressions, tone of voice, and the like.

[0538] "Emotional change tracking means" means a method or technique that continuously monitors and records changes in a user's emotional state over time.

[0539] "Means for optimizing conversation content" refers to methods and technologies that adjust the conversation content of generative AI based on collected emotional data to provide the most optimal conversation for the user.

[0540] MODE FOR CARRYING OUT THE INVENTION

[0541] This invention is a system that provides a conversation partner service for elderly people by utilizing generative AI and voice synthesis technology. Specific embodiments of this system are described below.

[0542] System configuration

[0543] The system consists of three main elements: a server, a terminal, and a user. The server contains software for running generative AI and speech synthesis technology. The terminal is a device that users use to converse via voice, such as a smartphone or tablet. The users are elderly people who use the system to enjoy conversations.

[0544] Program processing

[0545] The server first conducts a questionnaire for the user. This questionnaire is designed to confirm the user's cognitive level and preferences, and specifically includes questions such as "What topics do you like to talk about?" and "What is your preferred speaking speed?" The user answers the questionnaire via their terminal.

[0546] The device sends the user's answers to the server, which analyzes the received data and identifies the user's preferences and cognitive level. For example, if the user answers, "I like the topic of history," the server records that information.

[0547] Next, the server adjusts the parameters of the generative AI. Specifically, it sets the user's preferred topics, easy-to-understand language, speaking speed, etc. For example, if the user responds that "speaking slowly makes it easier to understand," the server will set the generative AI's speaking speed to be slower.

[0548] The device also collects the user's emotional data in real time and sends it to a server, which uses an emotion engine to track changes in the user's emotions over time. For example, if the user tends to feel sad in the evening, the server will record that data.

[0549] The server optimizes the AI's conversation content based on the collected emotional data. For example, if a user tends to feel sad in the evening, the server adjusts the AI ​​to provide comforting words at that time of day. Specifically, it generates comforting words such as, "How was your day? Did anything fun happen?"

[0550] Examples of specific examples and prompts

[0551] For example, the following prompts could be fed into a generative AI model:

[0552] Prompt statement example 1:

[0553] "Users say they enjoy talking about history and find it easier to understand if you speak slowly. Start the conversation with a history-related topic at a slower pace."

[0554] Prompt statement example 2:

[0555] "Users tend to feel sad in the evenings every day. Try to offer comforting words during those times."

[0556] This allows the generative AI to provide optimal conversation content tailored to the user's preferences and emotions. For example, in the evening, it can soothe the user's feelings by offering comforting words such as, "How was your day? Did anything fun happen?"

[0557] In this way, the system can provide a conversation partner service that can be used continuously by the elderly without stress.

[0558] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0559] Step 1:

[0560] The user answers a questionnaire through the terminal. The questionnaire contains questions to confirm the user's cognitive level and preferences. For example, questions include "What topics do you like to talk about?" and "What is your preferred speaking speed?" The input is the user's response data, and the output is the questionnaire data stored on the terminal.

[0561] Step 2:

[0562] The device sends the user's response data to the server. The server analyzes the received survey data and identifies the user's preferences and cognitive level. For example, if the user answers "I like the topic of history," the server records that information. The input is the survey data sent from the device, and the output is the analyzed data on the user's preferences and cognitive level.

[0563] Step 3:

[0564] The server adjusts the parameters of the generating AI based on the analyzed data. Specifically, it sets the user's preferred topics, easy-to-understand language, speaking speed, etc. For example, if the user responds that "speaking slowly makes it easier to understand," the generating AI's speaking speed is set to slower. The input is the analyzed user's preferences and cognitive level data, and the output is the adjusted parameters of the generating AI.

[0565] Step 4:

[0566] The device collects the user's emotional data in real time and sends it to the server. The emotional data is collected from the user's facial expressions, tone of voice, etc. The input is the user's emotional data, and the output is the emotional data stored in the device.

[0567] Step 5:

[0568] The server analyzes the received emotion data and tracks changes in the user's emotions over time. For example, if a user tends to feel sad in the evening, it records that data. The input is the emotion data sent from the device, and the output is the analyzed user's emotion pattern.

[0569] Step 6:

[0570] The server optimizes the conversation content of the generation AI based on the collected emotional data. For example, if a user tends to feel sad in the evening, the server adjusts the generation AI to provide comforting words at that time of day. Specifically, it generates comforting words such as, "How was your day? Did anything fun happen?" The input is the analyzed user's emotional patterns, and the output is optimized conversation content.

[0571] Step 7:

[0572] The device outputs the optimized conversation content as voice using speech synthesis technology. The user can enjoy the conversation through the voice output from the device. The input is the optimized conversation content, and the output is the conversation content as voice.

[0573] (Application example 2)

[0574] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0575] When elderly people use food delivery services, they often feel stressed due to the complexity of the operation and emotional changes. This makes it difficult for them to continue using the service. In addition, the lack of customization according to the cognitive level and preferences of elderly people makes it difficult to provide a service that satisfies users.

[0576] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0577] In this invention, the server includes: a means for providing a companion service for the elderly using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and sharing of memories; a means for initially utilizing smartphone classes and government transportation services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and thus anticipate continued use; and a means for tracking changes in the user's emotions in a food delivery service for the elderly and providing words of comfort and encouragement at appropriate times, thereby enabling the elderly to continue using food delivery services without stress.

[0578] "Generative AI" is an artificial intelligence technology that generates natural language text based on user input.

[0579] "Text to Speech technology" is a technology that converts text data into speech.

[0580] The "Elderly Conversation Service" is a service that promotes cognitive function through conversation and reduces feelings of loneliness for the elderly.

[0581] "Methods for promoting cognitive function" are ways to improve the cognitive function of the elderly through conversation and sharing memories.

[0582] A "smartphone class" is a class where elderly people can learn the basic operations of smartphones.

[0583] "Government transportation services" are services that provide transportation for elderly people to access government services.

[0584] The "means for having a conversation by voice without operating a terminal" is a method for a user to have a conversation by voice only without operating a terminal.

[0585] "Means to confirm cognitive level and preferences" refers to methods for understanding the cognitive level and individual preferences of elderly people.

[0586] "Means for individually customizing the generating AI" refers to a method for adjusting the parameters of the generating AI according to the user's cognitive level and preferences.

[0587] A "means for tracking changes in a user's emotions" is a method for monitoring changes in a user's emotions over time.

[0588] "Means for providing words of comfort and encouragement at the appropriate time" refers to a method for providing appropriate words according to the user's emotional state.

[0589] A "food delivery service" is a service that allows users to order meals and have them delivered to their homes.

[0590] The system for implementing this invention provides a conversation partner service for elderly people by utilizing generative AI and text-to-speech technology. Specific embodiments of this system are described below.

[0591] System configuration

[0592] 1. Server

[0593] The server provides a platform that integrates generative AI and text-to-speech technology. The server manages user profile data and adjusts the parameters of the generative AI according to the user's cognitive level and preferences. It also has an emotion engine that tracks changes in the user's emotions and provides words of comfort and encouragement at the appropriate time.

[0594] 2. Terminal

[0595] The terminal is a device such as a smartphone or smart glasses that provides an interface for users to converse by voice. The terminal outputs the conversation content of the generated AI sent from the server as voice using text-to-speech technology.

[0596] 3. Users

[0597] The user is an elderly person who uses a food delivery service and can order meals by speaking via a terminal.

[0598] Program processing

[0599] The server adjusts the parameters of the generative AI based on the user's profile data and generates conversation content that matches the user's cognitive level and preferences. The generated conversation content is output as audio using text-to-speech technology. In addition, the server tracks changes in the user's emotions and provides words of comfort and encouragement at the appropriate time.

[0600] Hardware and software used

[0601] Generative AI: Generate natural language text using OpenAI's API.

[0602] Text to Speech Technology: Converts text to speech using the Google Cloud Text-to-Speech API.

[0603] Emotion Engine: Equipped with an algorithm to track changes in user emotions.

[0604] Specific examples

[0605] For example, if a user uses a food delivery service in the evening, the server might generate a prompt like this:

[0606] "Hello. What kind of food would you like to have today? The evening may be a little dull, so let's cheer you up with some delicious food."

[0607] The prompts are adjusted according to the user's emotional state and output as voice using text-to-speech technology, enabling elderly people to continue using food delivery services without stress.

[0608] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0609] Step 1:

[0610] The server obtains the user's profile data. As input, it receives profile data including information such as the user's name, age, preferences, cognitive level, and emotional patterns. Based on this, it processes the data to adjust the parameters of the generative AI. As output, it generates the adjusted parameters.

[0611] Step 2:

[0612] The server obtains the current time zone and sets the current emotional state based on the user's emotional pattern. As input, it receives the current time and the user's emotional pattern. Based on this, the emotion engine estimates the user's current emotional state. As output, it generates the estimated emotional state.

[0613] Step 3:

[0614] The server generates prompt sentences based on the user's profile data and current emotional state. As input, it receives the adjusted parameters and estimated emotional state. Based on this, the generative AI generates a prompt sentence appropriate for the user. As output, it generates the generated prompt sentence.

[0615] Step 4:

[0616] The server converts the generated prompt sentence into audio data using Text to Speech technology. As input, it receives the generated prompt sentence. Based on this, the Google Cloud Text-to-Speech API converts the text into audio data. As output, it generates the generated audio data.

[0617] Step 5:

[0618] The terminal receives the voice data sent from the server and outputs it as voice to the user. As input, the terminal receives the voice data sent from the server. Based on this, the terminal's speaker plays the voice data. As output, the terminal provides voice to the user.

[0619] Step 6:

[0620] A user orders food by speaking through a terminal. As input, the terminal receives a voice output. Based on this, the user responds with a voice to convey the order. As output, the user's voice input is generated.

[0621] Step 7:

[0622] The terminal transmits the user's voice input to the server. As input, the terminal receives the user's voice input. Based on this, the terminal transmits voice data to the server. As output, the terminal generates the voice data that is transmitted to the server.

[0623] Step 8:

[0624] The server analyzes the user's voice input and confirms the order details. As input, it receives the user's voice data. Based on this, speech recognition technology converts the voice data into text and analyzes the order details. As output, it generates the analyzed order details.

[0625] Step 9:

[0626] The server arranges for food delivery service based on the parsed order details. As input, it receives the parsed order details. Based on this, it arranges for food delivery service. As output, it generates order confirmation information.

[0627] Step 10:

[0628] The server sends the order confirmation information to the terminal and notifies the user. As input, it receives the order confirmation information. Based on this, the server sends the order confirmation information to the terminal. As output, it generates the order confirmation information that is sent to the terminal.

[0629] Step 11:

[0630] The terminal receives the order confirmation information sent from the server and notifies the user. As input, the terminal receives the order confirmation information sent from the server. Based on this, the terminal displays or plays a notification by voice. As output, the terminal provides the order confirmation information to the user.

[0631] Example 3

[0632] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0633] Appropriate conversations and sharing of memories are important for elderly people to maintain and improve their cognitive functions. However, conventional systems have difficulty in individual customization according to the user's cognitive level and preferences, and lack the ability to learn and improve appropriate responses to the user's emotions, making continuous use difficult. Furthermore, the device operation is complicated, making it difficult for elderly people to use.

[0634] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0635] In this invention, the server includes means for generating conversation content according to the cognitive level and preferences of the elderly person using generative AI, means for outputting the generated conversation content as audio using text-to-speech technology, and means for collecting user emotion data and learning and improving the system's response using an emotion engine. This provides an individually customized conversation service that the elderly can use without stress, and by learning and improving appropriate responses according to the user's emotions, continuous use is possible.

[0636] "Generative AI" is an artificial intelligence technology that generates conversation content based on the user's cognitive level and preferences.

[0637] "Text to Speech technology" is a technology that converts generated text data into voice data.

[0638] An "emotion engine" is a technology that analyzes user emotional data to learn and improve the system's response.

[0639] The "cognitive level" is an index that indicates the state of the user's cognitive function.

[0640] "Preferences" is information that indicates topics of interest or hobbies of a user.

[0641] "Conversation content" is text data generated by generative AI based on the user's cognitive level and preferences.

[0642] "Audio Data" means audio files generated by Text to Speech technology.

[0643] "User emotion data" is data indicating the user's emotional state obtained from the user's facial expression, tone of voice, and the like.

[0644] "Individual customization" refers to adjusting system settings and conversation content according to the user's cognitive level and preferences.

[0645] "Continuous use" refers to a user continuing to use the system for an extended period of time.

[0646] This invention is a system that generates conversation content according to the cognitive level and preferences of elderly people and outputs it as voice. The system is composed of generative AI, text-to-speech technology, and an emotion engine.

[0647] First, the user uses the device to input information about their cognitive level and preferences. The device then sends this information to the server. The server uses a generative AI model (e.g., GPT-4) to generate conversation content based on the user's cognitive level and preferences. Specifically, the server inputs the following prompt sentences into the generative AI model:

[0648] "An elderly person has a medium cognitive level and enjoys gardening. Generate conversation content based on this."

[0649] The generative AI generates conversation content such as, "The weather these days is perfect for gardening. What kind of flowers are you growing?"

[0650] Next, the server converts the generated conversation content into audio data using Text to Speech (TTS) technology (e.g., Google Text-to-Speech API). Specifically, the server inputs the generated text into a TTS engine to generate an audio file (e.g., MP3 format). The server then sends the generated audio data to the device. The device then plays the received audio data and provides it to the user. Specifically, a voice saying, "The weather has been perfect for gardening lately. What kind of flowers are you growing?" is played from the device's speaker.

[0651] In addition, the device uses a camera and microphone to acquire emotional data to collect the user's reactions. Specifically, the device's camera recognizes the user's facial expressions, and the microphone analyzes the user's vocal tone. The device then sends the collected emotional data to the server. The server uses an emotion engine to analyze how the user's emotions have changed due to the system's reactions. Specifically, the server analyzes the user's facial expression data and vocal tone to identify the user's emotional state (e.g., joy, sadness). The server uses this learning result to adjust the system's response from the next time onwards. For example, if the user feels sad, the system will adjust the system to generate more positive conversation content next time.

[0652] In this way, the system can provide conversations that are tailored to the preferences and cognitive levels of the elderly, improving the user experience. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0653] Step 1:

[0654] Entering user information

[0655] The user uses the terminal to input information about their cognitive level and preferences.

[0656] Input: The user enters information such as "cognitive level: medium" and "hobby: gardening" into a form on the device screen.

[0657] Output: The terminal sends the entered user information to the server.

[0658] Step 2:

[0659] Conversation generation

[0660] The server uses a generative AI model (e.g., GPT-4) to generate conversational content based on the user's cognitive level and preferences.

[0661] Input: User information sent from the device.

[0662] Data processing: The server inputs the following prompt sentence into the generative AI model:

[0663] "An elderly person has a medium cognitive level and enjoys gardening. Generate conversation content based on this."

[0664] Output: The generative AI generates the following conversation: "The weather these days is perfect for gardening. What flowers are you growing?"

[0665] Step 3:

[0666] Voice

[0667] The server converts the generated conversation into audio data using Text to Speech (TTS) technology (e.g., Google Text-to-Speech API).

[0668] Input: The text data of the generated conversation.

[0669] Data processing: The server inputs the generated text into the TTS engine and generates an audio file (e.g., MP3 format).

[0670] Output: The generated audio data.

[0671] Step 4:

[0672] Playing audio

[0673] The server transmits the generated voice data to the terminal.

[0674] The terminal plays back the received audio data and provides it to the user.

[0675] Input: Audio data sent from the server.

[0676] Output: A voice will play from the device's speaker saying, "The weather has been perfect for gardening lately. What flowers are you growing?"

[0677] Step 5:

[0678] Collecting Emotional Data

[0679] The device uses a camera and microphone to capture emotional data to gather user reactions.

[0680] Input: The user's facial expression and tone of voice.

[0681] Data processing: The device's camera recognizes the user's facial expressions, and the microphone analyzes the tone of the user's voice.

[0682] Output: Collected emotion data.

[0683] Step 6:

[0684] Improving emotional learning and response

[0685] The device transmits the collected emotion data to a server.

[0686] The server uses an emotion engine to analyze how the user's emotions have changed due to the system's response.

[0687] Input: Collected emotion data.

[0688] Data processing: The server analyzes the user's facial expression data and voice tone to identify the user's emotional state (e.g., joy, sadness).

[0689] Output: Learning results to adjust the system's response in future.

[0690] In this way, the system can provide conversations tailored to the elderly's preferences and cognitive level, improving the user experience.

[0691] (Application example 3)

[0692] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0693] There is a need for methods to help elderly people maintain and improve their cognitive functions without feeling lonely in their daily lives. Food delivery services also need support to help elderly people select menus that suit their preferences and cognitive levels. Furthermore, improving service satisfaction by responding appropriately to users' emotions is a challenge.

[0694] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0695] In this invention, the server includes: a means for providing a conversation partner service for seniors using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and memory sharing; a means for initial use utilizing smartphone classes and government transportation services, whereby users can simply converse by voice without having to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to ensure stress-free use and ensure continued use; a means for suggesting menus based on the user's preferences and past history; and a means for analyzing the user's emotions using an emotion engine and providing appropriate responses. This enables seniors to maintain and improve their cognitive function without feeling lonely, and also makes it easier for seniors to select menus that suit their preferences and cognitive level in food delivery services. Furthermore, providing appropriate responses based on the user's emotions can improve service satisfaction.

[0696] "Generative AI" is an artificial intelligence technology that automatically generates appropriate conversation content and suggestions based on user input and past data.

[0697] "Text to Speech technology" is a technology that converts text data into audio data and outputs it as audio.

[0698] The "Elderly Conversation Service" is a service that allows elderly people to enjoy conversations on a daily basis without feeling lonely.

[0699] "Methods for promoting cognitive function" are methods for maintaining and improving cognitive function in the elderly through conversation and sharing memories.

[0700] A "smartphone class" is a class where elderly people can learn the basic operations of smartphones.

[0701] "Government transportation services" are services that assist elderly people in traveling when using government services.

[0702] The "means for having a conversation by voice without operating a terminal" is a method by which a user can have a conversation by voice only, without operating a terminal.

[0703] "Means to confirm awareness level and preferences" refers to a method for understanding the user's awareness level and preferences at the time of implementation.

[0704] "Means for individual customization" refers to a method for adjusting generative AI according to the user's cognitive level and preferences.

[0705] The "means for suggesting menus" is a method for suggesting appropriate menus based on the user's preferences and past history.

[0706] An "emotion engine" is a technology that analyzes a user's emotions and responds appropriately based on the results.

[0707] "Means for analyzing user emotions" refers to a method for reading and analyzing emotions from users' statements and actions.

[0708] "Means for taking appropriate action" refers to a method for reacting or taking appropriate action depending on the user's emotions.

[0709] The system for implementing this invention utilizes generative AI and text-to-speech technology to provide a conversation partner service for the elderly. The system generates conversation content based on the user's preferences and cognitive level and outputs it as voice. It also uses an emotion engine to analyze the user's emotions and respond appropriately.

[0710] Hardware and software used

[0711] Hardware: Smartphones, smart speakers

[0712] Software: Python, OpenAI API, Text to Speech engine, Emotion recognition engine

[0713] Data processing and calculation

[0714] 1. Data Input: User preferences and past order history are used as input data, which allows the generative AI to suggest optimal conversation topics and menus for the user.

[0715] 2. Data processing: Using a generative AI model (OpenAI API), we generate conversation content and menus based on user preferences.

[0716] 3. Data calculation: The emotion recognition engine analyzes the user's emotions, allowing the system to respond appropriately based on the user's emotions.

[0717] 4. Data output: Using text-to-speech technology, the generated conversation content and menus are output as audio.

[0718] Specific examples

[0719] Specific examples of menu suggestions

[0720] Based on the user's preferences and past history, the generative AI will suggest an appropriate menu. For example, if the user likes Japanese food but does not like spicy food, the generative AI will suggest the following menu items:

[0721] Eel bowl

[0722] Tempura set meal

[0723] Sushi set

[0724] Examples of emotional responses

[0725] If the user is unsure about the proposed menu, the emotion engine analyzes the user's emotions and responds appropriately. For example, if the user says, "I'm not sure which one to choose," the system responds as follows:

[0726] "You seem confused. Shall I explain a bit more?"

[0727] Prompt Sentence Examples

[0728] Below are some examples of prompts that generative AI might use to suggest menus:

[0729] Suggest menu items based on user preferences: I like Japanese food, but I don't like spicy food.

[0730] In this way, the system can help elderly people maintain and improve their cognitive function without feeling lonely. It also makes it easier for elderly people to select menus that suit their preferences and cognitive level in food delivery services. Furthermore, by responding appropriately to the user's emotions, it is possible to improve satisfaction with the service.

[0731] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0732] Step 1:

[0733] A user accesses the system and enters their preferences and past history.

[0734] Input: User preferences (e.g., likes Japanese food, doesn't like spicy food), past order history

[0735] How it works: A user uses a smartphone or smart speaker to enter their preferences and past order history into the system via voice or text.

[0736] Output: User preferences and past history are stored in a database.

[0737] Step 2:

[0738] The server uses a generative AI model to generate a menu based on the user's preferences.

[0739] Input: User preferences and past history

[0740] How it works: The server calls the OpenAI API and sends a prompt to the generative AI model. An example prompt is "Please suggest a menu based on the user's preferences: I like Japanese food, but I don't like spicy food."

[0741] Output: Menu suggestions from the generative AI model (e.g., eel bowl, tempura set meal, sushi set)

[0742] Step 3:

[0743] The server uses text-to-speech technology to output the generated menu as audio.

[0744] Input: Menu suggestions from a generative AI model

[0745] How it works: The server uses a Text to Speech engine library to convert the generated menu into audio data.

[0746] Output: The audio data is played back to the user via a smartphone or smart speaker.

[0747] Step 4:

[0748] The user provides feedback on the proposed menu.

[0749] Input: User feedback (e.g., "I'm not sure which one to choose")

[0750] How it works: The user uses their smartphone or smart speaker to provide feedback or comments about the suggested menu items via voice or text.

[0751] Output: User feedback is sent to the server.

[0752] Step 5:

[0753] The server uses an emotion engine to analyze the user's emotions.

[0754] Input: User feedback

[0755] How it works: The server uses an emotion recognition engine library to analyze emotions from user feedback.

[0756] Output: User's emotion data (e.g., confused, happy)

[0757] Step 6:

[0758] The server responds appropriately according to the user's emotions.

[0759] Input: User emotion data

[0760] How it works: The server generates an appropriate response based on the emotion data. For example, if the user is confused, it might respond with, "It seems you're confused. Shall I explain in more detail?"

[0761] Output: The response message is output as audio using Text to Speech technology.

[0762] Step 7:

[0763] The user receives the response from the system and makes the final selection.

[0764] Input: Response message from the system

[0765] How it works: The user receives a voice response from the system via their smartphone or smart speaker and makes the final menu selection.

[0766] Output: The user's final selection is sent to the server and the order is confirmed.

[0767] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0768] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0769] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0770] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0771] [Second embodiment]

[0772] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0773] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0774] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0775] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0776] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0777] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0778] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0779] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0780] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0781] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0782] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0783] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0784] "Example 1"

[0785] One embodiment of the present invention is a system that uses generative AI and text-to-speech technology to provide a conversation partner service for the elderly. This system can be easily implemented by seniors using smartphone classes and government mobile services, and realizes a system that requires no device operation and only requires voice conversation. Specifically, seniors access the system using the operation methods they learned in the smartphone classes. Furthermore, by using government mobile services, they can use the system while on the move.

[0786] "Example 2"

[0787] Furthermore, by checking the cognitive level and preferences of the elderly at the time of implementation and customizing the generating AI individually, the elderly can continue to use the service without stress. Specifically, a questionnaire is conducted with the elderly at the time of implementation, and the parameters of the generating AI are adjusted based on the answers. For example, it is possible to customize topics preferred by the elderly, easy-to-understand language, speaking speed, etc.

[0788] "Example 3"

[0789] In addition, generative AI generates conversation content based on the cognitive level and preferences of the elderly, and then uses Text t Speech technology outputs the generated conversation content as audio. Specifically, generative AI generates topics tailored to the elderly person's preferences and cognitive level, and converts the content into audio using text-to-speech technology. This allows the elderly person to enjoy conversations tailored to their preferences and cognitive level.

[0790] The processing flow of each embodiment will be described below.

[0791] "Example 1"

[0792] Step 1: The elderly access the system using the operation methods they learned in the smartphone class.

[0793] Step 2: The system displays a questionnaire to ascertain the elderly person's cognitive level and preferences.

[0794] Step 3: The elderly respond to the questionnaire.

[0795] Step 4: The system adjusts the parameters of the generation AI based on the answers to generate individually customized conversation content.

[0796] Step 5: The generated conversation is converted into audio using Text to Speech technology. and output to the elderly.

[0797] "Example 2"

[0798] Step 1: When an elderly person uses a government transportation service, they access the system.

[0799] Step 2: The system displays a questionnaire to ascertain the elderly person's cognitive level and preferences.

[0800] Step 3: The elderly respond to the questionnaire.

[0801] Step 4: The system adjusts the parameters of the generation AI based on the answers to generate individually customized conversation content.

[0802] Step 5: The generated conversation content is converted into audio using text-to-speech technology and output to the elderly.

[0803] Example 1

[0804] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0805] Elderly people often feel lonely in their daily lives, and there are concerns about declining cognitive function. Furthermore, for elderly people who are not good at using technology, operating complex devices can be a significant burden. There is a need to solve these problems and provide a conversation partner service that seniors can use without stress.

[0806] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0807] In this invention, the server includes means for the terminal to capture the user's voice input and send it to the server, means for the server to convert the voice data into text data, means for the server to analyze the text data using a generative AI model and generate an appropriate response, means for the server to convert the generated text response into voice data and send it to the terminal, and means for the terminal to play back the voice data.This enables elderly people to reduce their sense of loneliness through natural conversation without the need for complex operations, and to maintain and improve their cognitive function.

[0808] "Users" refer to elderly people who use the system.

[0809] A "terminal" is a device that allows a user to input voice, and includes a smartphone, tablet, etc.

[0810] "Server" refers to a central processing unit that processes voice data, generates text data, generates responses, and converts voice data.

[0811] "Voice input" refers to voice data generated by a user speaking into a terminal.

[0812] "Voice data" refers to a digital representation of a user's voice input.

[0813] "Text data" refers to data obtained by converting voice data into character information.

[0814] A "generative AI model" refers to an artificial intelligence model that analyzes input text data and generates an appropriate response.

[0815] "Response" refers to the reply generated by a generative AI model based on text data.

[0816] "Speech recognition software" refers to software for converting voice data into text data.

[0817] "Text to Speech technology" refers to technology that converts text data into voice data.

[0818] "Audio playback" refers to the device outputting audio data through a speaker.

[0819] This invention is a system that provides a conversation partner service for elderly people by utilizing a generative AI model and text-to-speech technology. Specific embodiments of this system are described below.

[0820] System configuration

[0821] server

[0822] The server is a central processing unit that processes voice data, generates text data, generates responses, and converts voice data. The server uses the following software:

[0823] Speech recognition software: Google Cloud Speech-to-Text API

[0824] Generative AI model: OpenAI's GPT-4

[0825] Text to Speech Technology: Amazon Polly

[0826] Terminal

[0827] A terminal is a device that allows a user to input voice information, such as a smartphone or tablet. A terminal has the following functions:

[0828] Microphone: Captures the user's voice

[0829] Network module: Sending audio data to the server

[0830] Speaker: Plays audio data received from the server

[0831] User

[0832] The users are elderly people who use the system to communicate by voice. They access the system using the operation methods they learned in the smartphone class.

[0833] System Operation

[0834] Voice input and transmission

[0835] The user inputs voice by speaking into the device. For example, they can input a question such as "What's the weather like today?" The device captures this voice with a microphone and generates voice data. The generated voice data is sent to the server via the device's network module.

[0836] Converting audio data to text

[0837] The server sends the received voice data to the Google Cloud Speech-to-Text API, which converts the voice data into text data. The converted text will be "What's the weather like today?"

[0838] Text data analysis and response generation

[0839] The server analyzes the converted text data using a generative AI model (GPT-4). Based on the analysis results, it generates a response such as "It's sunny today."

[0840] Text-to-speech response

[0841] The server sends the generated text response to Amazon Polly, which converts it into speech, which then says, "It's a sunny day today."

[0842] Sending and playing audio data

[0843] The server transmits the converted voice data to the terminal, which then plays the received voice data through a speaker, allowing the user to hear the voice saying "It's sunny today."

[0844] Specific examples

[0845] Example 1

[0846] The user speaks to the device, "What's the weather like today?" The device sends this speech to a server, which converts it into text. A generative AI model generates a response such as "It's sunny today," which is then converted into speech using TTS technology. Finally, the device's speaker plays back the message, "It's sunny today."

[0847] Example 2

[0848] The user speaks to the device, saying, "What are my plans for tomorrow?" The device sends the speech to the server, which converts it into text. The generative AI model generates a response such as, "I have a doctor's appointment tomorrow at 10:00 AM," which is then converted into speech using TTS technology. The device's speaker plays back the message, "I have a doctor's appointment tomorrow at 10:00 AM."

[0849] Prompt Sentence Examples

[0850] "Please explain the system that allows seniors to access the system using the operations they learned in the smartphone class and provides a companion service that can be used simply by having a voice conversation. This system utilizes generative AI models and text-to-speech technology."

[0851] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0852] Step 1:

[0853] The user speaks to the device. For example, they may ask a question such as "What's the weather like today?" The input is the user's voice, and the output is the voice data captured by the device's microphone. Specifically, the user presses the microphone button on their smartphone to speak.

[0854] Step 2:

[0855] The terminal captures the user's voice with a microphone and generates voice data. The generated voice data is sent to the server through the terminal's network module. The input is the captured voice data, and the output is digital voice data sent to the server. In specific operations, the terminal sends the voice data to the server in real time.

[0856] Step 3:

[0857] The server sends the received voice data to the Google Cloud Speech-to-Text API, which converts the voice into text data. The input is the voice data sent to the server, and the output is the converted text data. Specifically, the server calls the voice recognition software to convert the voice data into text.

[0858] Step 4:

[0859] The server uses a generative AI model (GPT-4) to analyze the converted text data and generate an appropriate response. The input is the converted text data, and the output is the generated text response. Specifically, the server inputs a prompt sentence into the generative AI model and generates a response.

[0860] Step 5:

[0861] The server sends the generated text response to Amazon Polly, which converts it to speech. The input is the generated text response, and the output is the converted speech. Specifically, the server invokes Text to Speech technology to convert the text response to speech.

[0862] Step 6:

[0863] The server transmits the converted voice data to the terminal. The input is the converted voice data, and the output is the voice data transmitted to the terminal. In a specific operation, the server transmits the voice data to the terminal.

[0864] Step 7:

[0865] The terminal plays the received voice data through the speaker. The input is the voice data sent from the server, and the output is the voice that the user can hear. In concrete terms, the terminal's speaker plays the voice data, and the user hears the voice saying, "It's sunny today."

[0866] (Application example 1)

[0867] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0868] Elderly people often feel lonely in their daily lives, and there are concerns about a decline in cognitive function. In addition, many elderly people find it difficult to operate smartphones or tablets when using food delivery services. This makes it difficult to order meals, leading to a decline in their quality of life.

[0869] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0870] In this invention, the server includes: a means for providing a conversation partner service for the elderly using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and sharing of memories; a means for initially utilizing smartphone classes and government transportation services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and expected continuity; a means for the elderly to order food delivery by voice; and a means for the generative AI to generate a response based on the elderly's order and respond by voice using text-to-speech technology. This makes it possible for the elderly to easily use food delivery services without feeling lonely and while maintaining their cognitive function.

[0871] "Generative AI" is a type of artificial intelligence technology, a system that has the ability to generate new data and information based on input data.

[0872] "Text to Speech technology" is a technology that converts text data into audio data, enabling a computer to read the text aloud in a natural voice.

[0873] The "conversation companion service for the elderly" is a service that helps the elderly maintain and promote cognitive function through conversation without feeling lonely.

[0874] A "smartphone class" is a class where elderly people can learn the basic operation methods of smartphones.

[0875] "Government transportation services" are public transportation support services that enable elderly people to use necessary services while on the move.

[0876] "Cognitive level" is an indicator that shows the state and ability of an individual's cognitive function.

[0877] "Personalization" refers to the adjustment and optimization of systems and services to meet the specific needs and preferences of users.

[0878] "Food delivery" is a service that allows you to order meals and have them delivered to a specified location.

[0879] "Responding with voice" means that the system responds with voice to the user's voice input.

[0880] The system for implementing this invention provides a conversation partner service for the elderly using generative AI and text-to-speech technology. The system uses the following hardware and software:

[0881] Hardware

[0882] Smartphone

[0883] microphone

[0884] software

[0885] OpenAI API

[0886] Text to Speech Engine

[0887] Speech Recognition Library

[0888] System action

[0889] The server first converts the user's speech into text using a speech recognition library, then uses generative AI to generate a response based on the user's input, which is then converted into audio using a text-to-speech engine and sent back to the user.

[0890] Specifically, when a user speaks into the smartphone's microphone, the speech is converted into text by a speech recognition library. For example, if a user asks, "What's today's recommendation?", the text is sent to the generative AI. The generative AI generates an appropriate response based on the prompt, and the response is converted into speech by the text-to-speech engine. Finally, the smartphone speaker responds to the user, saying, "Today's recommendation is curry rice and salad set. Would you like to order?"

[0891] Prompt Sentence Examples

[0892] Sample conversation for a senior citizen who wants to order food delivery: What are your recommendations today?

[0893] This system allows elderly people to easily order food delivery using only their voice, reducing feelings of loneliness and improving their quality of life while maintaining their cognitive function.

[0894] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0895] Step 1:

[0896] The user speaks into the smartphone microphone. The input is the user's voice, for example, "What's your recommendation today?" The output is voice data.

[0897] Step 2:

[0898] The device uses a speech recognition library to convert the user's speech into text. The input is speech data and the output is text data. Specifically, the speech recognition library analyzes the speech data and generates the text "What's your recommendation today?"

[0899] Step 3:

[0900] The device sends text data to the generative AI. The input is text data, and the output is a response text from the generative AI. Specifically, the generative AI generates an appropriate response based on the prompt. For example, it generates a response text such as, "Today's recommendation is curry rice and salad set. Would you like to order?"

[0901] Step 4:

[0902] The terminal sends the generated response text to the Text to Speech engine. The input is the response text and the output is audio data. Specifically, the Text to Speech engine converts the response text into audio.

[0903] Step 5:

[0904] The device responds to the user with the generated voice data through the smartphone's speaker. The input is voice data, and the output is the voice the user hears. Specifically, the smartphone's speaker plays the following voice: "Today's recommendation is curry rice and salad set. Would you like to order?"

[0905] This series of processes allows users to order food delivery using only their voice.

[0906] Example 2

[0907] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0908] To provide a conversation partner service that can be used continuously and without stress by the elderly, it is necessary to customize the service according to the cognitive level and preferences of each individual elderly person. However, conventional systems do not provide sufficient individual customization, and elderly people often feel stressed when using the service. In addition, for elderly people who have difficulty operating devices, there was a need for a system that allows them to communicate using only voice without the need for operation.

[0909] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0910] In this invention, the server includes means for conducting a questionnaire and adjusting the parameters of the generative AI based on the responses, means for downloading the customized generative AI model to a terminal and using it to provide services, and means for receiving input from a user and generating a response in response to that input using the generative AI model. This enables individual customization according to the cognitive level and preferences of the elderly, allowing them to continue using the service without stress.

[0911] "Generative AI" is an artificial intelligence technology that generates natural language responses based on user input.

[0912] "Speech synthesis technology" is a technology that converts text data into voice data.

[0913] The "conversation partner service for the elderly" is a service that allows elderly people to enjoy conversations via voice, with the aim of promoting cognitive function and reducing stress.

[0914] "Methods for promoting cognitive function" are methods for improving cognitive function in the elderly through conversation and sharing memories.

[0915] A "mobile information terminal classroom" is a classroom where elderly people can learn how to use mobile information terminals.

[0916] "Public services" are services provided by government agencies and public organizations, including transportation assistance and life support.

[0917] A "questionnaire" is a survey instrument that includes questions to ascertain a user's awareness level and preferences.

[0918] "Means for adjusting parameters" refers to a method for changing the settings of generative artificial intelligence based on the responses to a questionnaire.

[0919] A "customized generative artificial intelligence model" is a generative artificial intelligence model that is adjusted according to the user's cognitive level and preferences.

[0920] "User input" refers to voice or text instructions or questions that a user gives to the system.

[0921] A "means for generating a response" is a method for generating an appropriate response based on input from a user.

[0922] This invention is a system that provides a conversation partner service that can be used continuously and without stress by the elderly. The system utilizes generative artificial intelligence and speech synthesis technology to customize the service to suit the elderly's cognitive level and preferences.

[0923] First, the server conducts a survey of elderly people when the system is introduced. The survey includes questions to confirm the user's cognitive level and preferences. For example, it includes questions such as, "What are your favorite topics?" and "Do you prefer someone to speak faster?" The survey response data is collected and stored on the server.

[0924] The server then analyzes the collected survey data and adjusts the parameters of the generative AI model, including topics preferred by seniors, easy-to-understand language, speaking speed, etc. Specifically, by updating the parameter setting file of the generative AI model, an individually customized generative AI model is created.

[0925] The terminal uses a customized generative artificial intelligence model to provide services to the elderly. The terminal receives input from the user and generates a response based on that input using the generative artificial intelligence model. This response is tailored to the elderly's preferences and cognitive level, allowing the user to use the service without stress.

[0926] As a specific example, if an elderly person answers a questionnaire by saying, "I like talking about history and prefer to speak slowly," the server will adjust the parameters of the generative artificial intelligence model to generate responses that include more history-related topics and set the speaking speed to be slower.

[0927] Example prompt sentence:

[0928] "Please speak slowly on topics related to history."

[0929] When this prompt is fed into a generative AI model, the model generates a response tailored to the topic and speaking speed preferred by the elderly person, such as, "Let me tell you about the culture of the Edo period. The Edo period lasted from 1603 to 1868..."

[0930] In this way, the system provides customized services according to the elderly's cognitive level and preferences, allowing them to continue using the service without stress.

[0931] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0932] Step 1:

[0933] The server will conduct a questionnaire for the elderly when the system is introduced, which includes questions to confirm the user's cognitive level and preferences.

[0934] Input: User's survey response

[0935] Output: Survey response data

[0936] Specific operation: The server generates a questionnaire form and sends it to the terminal. The terminal displays the questionnaire form and the user enters their answers.

[0937] Step 2:

[0938] The terminal transmits the questionnaire responses entered by the user to the server.

[0939] Input: User's survey response

[0940] Output: Survey data sent to the server

[0941] Specific operation: The terminal sends the user's input in real time to the server, which stores it in a database.

[0942] Step 3:

[0943] The server analyzes the collected survey data and adjusts the parameters of the generative artificial intelligence model.

[0944] Input: Survey data

[0945] Output: Adjusted parameters of the generative artificial intelligence model

[0946] How it works: The server uses data analysis algorithms to identify the user's preferences and cognitive level, and updates the configuration files of the generative artificial intelligence model accordingly.

[0947] Step 4:

[0948] The terminal downloads the customized generative artificial intelligence model and uses it to provide services.

[0949] Input: Adjusted parameters of the generative artificial intelligence model

[0950] Output: A customized generative artificial intelligence model

[0951] Specific operation: The server sends the customized generative artificial intelligence model to the terminal, which receives and installs it.

[0952] Step 5:

[0953] The terminal receives input from the user and generates a response in response to the input using a generative artificial intelligence model.

[0954] Input: Voice input from the user

[0955] Output: The generated response

[0956] Specific operation: When a user speaks to the device, the device sends the input to the generative artificial intelligence model, which then generates an appropriate response and returns it to the device, which then displays or speaks the response to the user.

[0957] (Application example 2)

[0958] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0959] When seniors shop in brick-and-mortar stores, they need easy-to-understand information for product explanations and selection. However, it is difficult for general store staff and standard guidance systems to provide personalized service according to the cognitive level and preferences of seniors. As a result, seniors may feel stressed and their shopping experience may be unsatisfactory. To solve this problem, a system that can be individually customized according to the cognitive level and preferences of seniors is needed.

[0960] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0961] In this invention, the server includes: a means for providing a conversation partner service for seniors using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and memory sharing; a means for initially utilizing smartphone classes and government mobility services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and ensure continued use; a means for providing a personalized shopping assistant for seniors in physical stores; and a means for adjusting parameters of the generative AI based on survey results and generating individually customized responses. This makes it possible to provide personalized information according to cognitive level and preferences when seniors shop in physical stores, enabling a stress-free and satisfying shopping experience.

[0962] "Generative AI" is an artificial intelligence technology that generates responses in natural language based on user input.

[0963] "Text to Speech technology" is a technology that converts text data into voice data.

[0964] The "conversation partner service for the elderly" is a service that promotes cognitive function through conversation and allows elderly people to enjoy stress-free communication.

[0965] A "smartphone class" is a class where elderly people can learn the basic operations and how to use smartphones.

[0966] "Government transportation services" are transportation support services for the elderly provided by government agencies.

[0967] A "personalized shopping assistant" is an assistant that supports shopping based on the user's individual preferences and needs.

[0968] "Survey results" are the results of questions answered by users, and are data used to understand individual preferences and awareness levels.

[0969] "Adjusting parameters" means changing the settings of the generating AI according to the user's individual preferences and cognitive level.

[0970] A "personalized response" is a specific response generated based on a user's individual preferences and cognitive level.

[0971] The system for implementing this invention provides a conversation partner service for the elderly using generative AI and text-to-speech technology. The system operates among three parties: a server, a terminal, and a user.

[0972] The server uses generative AI to generate natural language responses based on user input. The generative AI adjusts parameters based on the results of the user's questionnaire and generates individually customized responses. This makes it possible to provide personalized information according to the elderly person's cognitive level and preferences.

[0973] The terminal is a device such as a smartphone or tablet that provides an interface for users to answer the questionnaire. The generated responses are output as audio using text-to-speech technology, allowing elderly people to converse by voice without having to operate the terminal.

[0974] Users use a terminal in a physical store to answer a survey. The survey results are sent to a server, and the generative AI generates an individually customized response. For example, if a user asks, "I'm looking for healthy foods," the generative AI will respond as follows:

[0975] Example prompt sentence:

[0976] Hello, user! What products are you looking for today?

[0977] Your topics of interest are health and travel.

[0978] The speaking speed is set to slow.

[0979] User Input: Looking for healthy foods

[0980] Example of a response from the generating AI:

[0981] User, you're looking for healthy foods. Some recommendations include organic vegetables and fruits, whole wheat bread, and low-fat yogurt, which are great for maintaining good health. We can also recommend some healthy snacks that are easy to carry when traveling.

[0982] In this way, the server uses generative AI to generate responses based on the user's individual preferences and cognitive level, and the device outputs the responses as voice, making it possible to provide elderly people with a stress-free and satisfying shopping experience when shopping in physical stores.

[0983] The hardware used is a smartphone or tablet, and the software uses Python and the OpenAI API. The generative AI is accessed through the OpenAI API, and the text-to-speech technology uses the device's on-board voice synthesis engine.

[0984] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0985] Step 1:

[0986] The user answers the questionnaire using the terminal.

[0987] Input: User's survey responses (name, age, favorite topics, speaking speed, etc.)

[0988] Output: Survey result data

[0989] Specific operation: The user answers the questionnaire through the device interface. The device collects the answers as data and sends them to the server.

[0990] Step 2:

[0991] The server receives the survey results and adjusts the parameters of the generative AI.

[0992] Input: Survey result data

[0993] Output: Adjusted generative AI parameters

[0994] Specific operation: The server analyzes the survey results and adjusts the parameters of the generative AI according to the user's cognitive level and preferences, such as the speaking speed and the language used.

[0995] Step 3:

[0996] The user uses the terminal to enter a question.

[0997] Input: User's question (in text format)

[0998] Output: User question data

[0999] Specific operation: The user inputs a question through the terminal interface, and the terminal collects this question as data and sends it to the server.

[1000] Step 4:

[1001] The server uses generative AI to generate responses to users' questions.

[1002] Input: User question data, adjusted generative AI parameters

[1003] Output: Generated response (in text format)

[1004] Specific operation: The server uses generative AI to generate a natural language response based on the user's question and adjusted parameters. For example, if a user asks, "I'm looking for healthy foods," the generative AI will generate an appropriate response.

[1005] Step 5:

[1006] The server sends the generated response to the terminal.

[1007] Input: Generated response (in text format)

[1008] Output: Response data sent to the terminal

[1009] Specific operation: The server sends the generated response to the terminal, which receives the data.

[1010] Step 6:

[1011] The device will output the response as audio using Text to Speech technology.

[1012] Input: Generated response data (text format)

[1013] Output: Audio output

[1014] Specific operation: The device converts the received response data into audio using text-to-speech technology and provides a voice response to the user, such as "Recommended products include organic vegetables and fruits, whole wheat bread, and low-fat yogurt."

[1015] Through these steps, when elderly people shop in physical stores, it will be possible to provide them with personalized information according to their level of awareness and preferences, providing them with a stress-free and satisfying shopping experience.

[1016] Example 3

[1017] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1018] There is a demand for a system that allows elderly people to enjoy conversations that suit their cognitive level and preferences. However, with conventional systems, it is difficult to generate conversation content that suits the cognitive level and preferences of the elderly, and the operation is complicated, making it difficult for elderly people to use without stress. Furthermore, there is a lack of technology to output the conversation content as audio, which has been a problem in that elderly people cannot actually enjoy the conversation.

[1019] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1020] In this invention, the server includes a means for a user to input information about the elderly person, a means for the server to collect and store the input information, a means for the server to send a prompt to the generative AI model, a means for the generative AI model to generate conversation content, a means for the server to send the generated conversation content to TTS technology, a means for the TTS technology to convert the conversation content into speech, and a means for the terminal to play back the generated speech, thereby enabling the elderly person to enjoy conversations tailored to their cognitive level and preferences without stress.

[1021] "User" refers to a person who uses the system to input information about an elderly person.

[1022] "Server" refers to a device or system that collects and stores information entered by users and sends prompts to the generative AI model.

[1023] "Generative AI model" refers to an artificial intelligence model that generates conversation content based on prompt text.

[1024] A "prompt" is a piece of text that contains instructions for a generative AI model to generate conversational content.

[1025] "TTS technology" is an abbreviation for Text to Speech technology, and refers to the technology of converting text-based conversation content into voice.

[1026] "Terminal" refers to a device or system that plays back the generated audio.

[1027] "Elderly" refers to older people who can enjoy conversations through the system.

[1028] "Cognitive level" refers to an indicator that shows the state of cognitive function in the elderly.

[1029] "Preferences" refers to topics and concerns that interest older people.

[1030] "Conversational content" refers to the textual information generated by the generative AI model based on the prompt.

[1031] This invention is a system that utilizes generative AI and Text to Speech (TTS) technology to generate conversation content tailored to the cognitive level and preferences of elderly people and output it as voice. Specific embodiments of this system are described below.

[1032] Hardware and software used

[1033] This system uses the following hardware and software:

[1034] Server: A central processing unit for collecting and storing information about seniors and sending prompts to the generative AI model.

[1035] Device: A device used by an older adult to play back the generated audio, such as a smartphone or tablet.

[1036] Generative AI model: An artificial intelligence model that generates conversational content based on a prompt. Examples include OpenAI's GPT-4.

[1037] TTS technology: Text to speech technology that converts text-based conversation content into audio. Specifically, Google Cloud Text-to-Speech is one example.

[1038] Data processing and calculation

[1039] The server collects the elderly person's information entered by the user and stores it in a database. The server then generates prompt text based on the stored information and sends it to the generative AI model. The generative AI model generates conversation content based on the prompt text and returns the content to the server. The server then sends the generated conversation content to the TTS technology, which converts it into speech. Finally, the device plays the generated speech to the elderly person.

[1040] Specific examples

[1041] The user opens the application and enters the elderly person's information: "Name: Tanaka, Interests: Music, History, Cognitive Level: Medium." The server stores this information in a database and sends a prompt, "Tanaka is interested in music and history. Please talk to him about recent music trends and historical events." to the generative AI model. The generative AI model generates conversation content such as "Talk about artists popular among young people as recent music trends, and famous battles from the Warring States period as historical events." The server sends this content to the TTS technology, which converts it into speech. Finally, the device plays the generated speech to Tanaka, who can enjoy an interesting conversation.

[1042] In this way, the system provides an appropriate conversation experience for elderly people through cooperation between the server, the terminal, and the user. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1043] Step 1:

[1044] The user enters the senior's information.

[1045] Users input the elderly person's cognitive level and preferences (e.g., topics of interest, favorite music genres, etc.) through a dedicated application or web interface. This input data becomes the basis for the system to generate conversation content appropriate for the elderly. The input information is sent to the server in the form of name, interests, cognitive level, etc.

[1046] Step 2:

[1047] The server collects and stores the information you enter.

[1048] The server receives the information of the elderly sent by the user and stores it in the database. This data will be used in subsequent processing. Specifically, the server performs an INSERT operation on the database to store the entered information. The input is information from the user, and the output is the information stored in the database.

[1049] Step 3:

[1050] The server sends a prompt to the generative AI model.

[1051] The server generates a prompt based on the stored information about the elderly person. For example, it generates a prompt such as, "Mr. Tanaka is interested in music and history. Please talk to him about recent music trends and historical events." This prompt is sent to a generative AI model. The input is the elderly person's information obtained from the database, and the output is the generated prompt.

[1052] Step 4:

[1053] A generative AI model generates the conversation content.

[1054] A generative AI model (e.g., OpenAI's GPT-4) generates appropriate conversational content based on the received prompt. The generated conversational content is returned to the server in text format. The input is the prompt, and the output is the generated conversational content.

[1055] Step 5:

[1056] The server sends the generated conversation to the TTS technology.

[1057] The server receives the speech returned by the generative AI model and sends it to a Text to Speech (TTS) technology (e.g., Google Cloud Text-to-Speech). The input is the generated speech, and the output is the text data sent to the TTS technology.

[1058] Step 6:

[1059] TTS technology converts conversations into audio.

[1060] TTS technology converts received text-based conversation content into voice data, which is then returned to the server. The input is text-based conversation content, and the output is voice data.

[1061] Step 7:

[1062] The device plays the generated audio.

[1063] The device plays back the voice data received from the server. Through this voice, elderly people can enjoy conversations tailored to their preferences and cognitive level. The input is voice data, and the output is the played-back voice.

[1064] (Application example 3)

[1065] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1066] When elderly people shop or use services at physical stores, they often experience stress and inconvenience due to a lack of appropriate guidance and support tailored to their cognitive level and preferences. Communication with store staff can also be difficult, making it difficult for elderly people to comfortably use the store. Furthermore, services are not customized to meet individual needs, making it difficult for them to continue using the service.

[1067] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1068] In this invention, the server includes: a means for providing a conversation partner service for the elderly using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and sharing of memories; a means for initially utilizing smartphone classes and government transportation services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and expected continuity; a means for providing guidance and product explanations to enable the elderly to comfortably shop and use services in physical stores; and a means for generating conversation content based on the elderly's preferences and cognitive level and supporting communication with store staff, thereby enabling the elderly to comfortably shop and use services in physical stores.

[1069] "Generative AI" is an artificial intelligence technology that generates conversation content based on the cognitive level and preferences of elderly people.

[1070] "Text to Speech technology" is a technology that converts generated text data into voice data.

[1071] The "Elderly Conversation Partner Service" utilizes generative AI and text-to-speech technology to promote cognitive function for the elderly through conversation and sharing of memories.

[1072] A "smartphone class" is a class where elderly people can learn the basic operations of smartphones.

[1073] "Government transportation services" are means of transportation provided to elderly people when they use government services.

[1074] "Individual customization" means adjusting the settings of generative AI according to the cognitive level and preferences of the elderly person.

[1075] A "physical store" is a store that exists in a physical location and where customers visit in person to purchase products or services.

[1076] "Guidelines and product descriptions" are information provided to seniors to help them shop and use services comfortably in physical stores.

[1077] "Communication support with store staff" is support for elderly people to communicate smoothly with staff in physical stores.

[1078] This invention is a system that uses generative AI and text-to-speech technology to provide a conversation partner service for the elderly. The system provides guidance and product explanations to help seniors shop and use services in brick-and-mortar stores more comfortably, and supports communication with store staff.

[1079] System configuration

[1080] The system consists of the following main components:

[1081] 1. Generative AI: Artificial intelligence technology that generates conversation content based on the cognitive level and preferences of the elderly.

[1082] 2. Text to Speech technology: Technology that converts generated text data into voice data.

[1083] 3. Smartphone: A device held by the elderly that runs generative AI and text-to-speech technology.

[1084] 4. Server: Hosts the generative AI model and generates conversation content based on prompts.

[1085] Program processing

[1086] The server performs the following steps:

[1087] 1. Prompt generation: Generate prompts based on the elderly person's preferences and cognitive level. For example, generate a prompt such as "Generate a conversation based on the elderly person's preferences: music and cooking, and cognitive level: moderate."

[1088] 2. Conversation generation: Use generative AI (e.g., OpenAI's GPT-3) to generate conversation content based on the prompt.

[1089] 3. Audio generation: The generated conversation is converted into an audio file using the Google Cloud Text-to-Speech API.

[1090] 4. Play audio: Play the generated audio file on your smartphone.

[1091] Hardware and software used

[1092] Hardware: Smartphone

[1093] Software: OpenAI GPT-3 API, Google Cloud Text-to-Speech API, Python

[1094] Specific examples

[1095] For example, when shopping in a brick-and-mortar store, seniors generate prompts like:

[1096] Generate conversational content based on the preferences of an elderly person: music and cooking, cognitive level: moderate.

[1097] This prompt is sent to the server, and the generative AI generates the conversation content. For example, the generated conversation content might be, "A new music album has arrived today. I can also introduce you to some cooking recipes." This text is converted into audio using the Google Cloud Text-to-Speech API and played on the smartphone.

[1098] This will enable elderly people to comfortably shop and use services in physical stores, and will also enable smooth communication with store staff.

[1099] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1100] Step 1:

[1101] The user starts up the smartphone, opens the application, and enters information about the user's preferences and cognitive level, which is then sent to the server.

[1102] Input: User preferences (e.g., music and cooking), cognitive level (e.g., intermediate)

[1103] Output: Data needed to generate the prompt sent to the server

[1104] Step 2:

[1105] The server generates prompts based on the received user preferences and cognitive level, and sends the generated prompts to the generative AI.

[1106] Input: Data about user preferences and cognitive level

[1107] Output: A prompt sent to the generative AI (e.g., "Generate a conversation based on an elderly person's preferences for music and cooking and their cognitive level: moderate.")

[1108] Step 3:

[1109] The generative AI generates conversation content based on the prompt sentence, and the generated conversation content is returned to the server.

[1110] Input: prompt statement

[1111] Output: Generated conversation (e.g., "A new music album arrived today. I can also share some cooking recipes with you.")

[1112] Step 4:

[1113] The server sends the generated conversation content to the Google Cloud Text-to-Speech API to generate audio data, which is then returned to the server.

[1114] Input: Generated conversation

[1115] Output: Audio data (e.g. audio file)

[1116] Step 5:

[1117] The server transmits the generated voice data to the smartphone, which then plays the received voice data.

[1118] Input: Audio data

[1119] Output: Audio played on smartphone

[1120] Step 6:

[1121] Users listen to the audio played on their smartphones, shop in stores, use services, and request additional information or support if needed.

[1122] Input: Audio played from smartphone

[1123] Output: User behavior (e.g., searching for a product, asking a store staff member a question)

[1124] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1125] "Example 1"

[1126] One embodiment of the present invention is a system that incorporates an emotion engine. This system recognizes a user's emotions and adjusts the conversation content of the generative AI and the voice output of the text-to-speech technology according to those emotions. Specifically, when the user is feeling happy, the generative AI provides cheerful topics and the text-to-speech technology outputs voice in a bright tone. Conversely, when the user is feeling sad, the generative AI provides comforting words and the text-to-speech technology outputs voice in a gentle tone. This improves adaptability to the user's emotions and enables a more natural conversation experience.

[1127] "Example 2"

[1128] The emotion engine can also track changes in a user's emotions over time. This allows it to understand the user's emotional patterns and optimize the generative AI's conversational content and text-to-speech technology's voice output accordingly. For example, if a user tends to feel sad in the evening each day, the system can adjust the generative AI to provide comforting words at that time of day.

[1129] "Example 3"

[1130] Furthermore, the emotion engine can learn and improve the system's response to the user's emotions. This is achieved by analyzing how the user's emotions change depending on the system's response and adjusting the system's response based on the results. For example, if the system responds to a user's sadness in a specific way and the user's sadness is reduced, the system learns that the response was effective. This allows the system to learn more appropriate responses to the user's emotions over time, improving the user experience.

[1131] The processing flow of each embodiment will be described below.

[1132] "Example 1"

[1133] Step 1: The emotion engine recognizes the user's emotions through conversation with the user.

[1134] Step 2: Generative AI adjusts the conversation content based on the emotions recognized by the emotion engine.

[1135] Step 3: At the same time, the Text to Speech technology adjusts the tone of the voice output based on the emotion recognized by the emotion engine.

[1136] "Example 2"

[1137] Step 1: Through conversation with the user, the emotion engine recognizes the user's emotions and tracks changes in those emotions over time.

[1138] Step 2: The emotion engine analyzes the tracked emotion patterns and optimizes the generative AI conversation content and the voice output of the text-to-speech technology accordingly.

[1139] "Example 3"

[1140] Step 1: The emotion engine recognizes the user's emotions through conversation with the user.

[1141] Step 2: The system responds to the user's emotions, and the emotion engine analyzes how the response affected the user's emotions.

[1142] Step 3: Based on the analysis results of the emotion engine, the system adjusts its responses and learns.

[1143] Example 1

[1144] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1145] Elderly people often feel lonely in their daily lives, which can lead to cognitive decline and increased mental stress. Furthermore, digital devices are often difficult to use due to technical difficulties. Furthermore, it is difficult to respond to the emotions and preferences of individual elderly people, and general conversation systems cannot provide satisfactory services.

[1146] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1147] In this invention, the server includes: a means for providing a conversation partner service for seniors using generative AI and speech synthesis technology; a means for promoting cognitive function through conversation and memory sharing; a means for initial use using mobile information terminal classrooms and public services, whereby conversations can be conducted simply by voice without the need for device operation; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to ensure stress-free use and ensure continued use; and a means for recognizing the user's emotions and adjusting the conversation content of the generative AI and the voice output of the speech synthesis technology according to those emotions. This prevents seniors from feeling lonely, prevents cognitive decline, and reduces mental stress. Furthermore, no technical operation is required, and responses can be made to each senior's emotions and preferences.

[1148] "Generative AI" is an artificial intelligence technology that generates responses in natural language based on user input.

[1149] "Speech synthesis technology" is a technology that converts text data into voice data and outputs it as natural voice.

[1150] The "Elderly Conversation Service" is a service that promotes cognitive function and provides mental support through conversation, so that elderly people do not feel lonely.

[1151] A "Mobile Information Device Classroom" is a classroom where students learn how to operate mobile information devices such as smartphones and tablets.

[1152] "Public services" are services such as transportation assistance and life support provided by government agencies and public organizations.

[1153] The "cognitive level" is an index that indicates the state of the user's cognitive function.

[1154] "Individual customization" refers to adjusting system settings and responses based on the user's cognitive level and preferences.

[1155] "Emotion recognition" is a technology that analyzes a user's emotions from their voice, facial expressions, etc., and identifies their state.

[1156] "Conversation content" is text data generated by generative AI for dialogue with the user.

[1157] "Audio output" refers to the reproduction of audio data generated using speech synthesis technology through speakers or the like.

[1158] MODE FOR CARRYING OUT THE INVENTION

[1159] This invention is a system that provides a conversation partner service for the elderly, utilizing generative AI and voice synthesis technology. This system can be easily implemented by users using smartphone classes and public services, and realizes a system that only requires voice communication without the need for device operation. In addition, by combining it with emotion recognition technology, the content of the conversation and voice output can be adjusted according to the user's emotions.

[1160] Hardware and software used

[1161] Hardware: smartphones, tablets, microphones, speakers

[1162] Software: Generative AI (e.g., natural language processing models), speech synthesis technology (e.g., speech synthesis engines), emotion recognition technology (e.g., emotion analysis engines)

[1163] Specific operation of the system

[1164] 1. Initial Setup and Access

[1165] Users access the system using the operation method they learned in the smartphone class, specifically by launching the smartphone app and entering their login information.

[1166] The device receives user input and connects to a server over the internet, where the device uses Wi-Fi or mobile data.

[1167] 2. Emotion recognition

[1168] The user speaks to the device, for example, saying, "I'm a little tired today."

[1169] The device records the user's voice and transmits the data to the server in real time. The device uses a microphone to capture the voice.

[1170] The server passes the received voice data to the emotion analysis engine, which analyzes the voice data and identifies the user's emotion. For example, it determines that the user is feeling tired from the word "tired."

[1171] 3. Conversation content generation

[1172] The server sends prompts to the generative AI based on the emotional information obtained from the emotion analysis engine. The prompts include instructions for generating conversational content according to the user's emotions. For example, the server sends a prompt such as, "If the user is tired, please offer words of encouragement."

[1173] Generative AI generates appropriate conversational content based on the prompt text, such as "Today was tough, but let's take a break and refresh ourselves."

[1174] 4. Audio Output

[1175] The server passes the generated text to a speech synthesis engine to generate voice data. The speech synthesis engine converts the generated text into speech and outputs it in an appropriate tone. For example, it generates a voice in a gentle tone saying, "Today was tough, wasn't it? But let's take a break and refresh yourself."

[1176] The device receives the audio data sent from the server and plays it through the speaker, allowing the user to listen to the audio coming from the device.

[1177] Specific examples

[1178] Example prompt: "If the user is tired, offer words of encouragement."

[1179] Generative AI output: "You've had a tough day. Let's take a break and refresh yourself."

[1180] Text-to-speech technology output: "Today has been tough, but it's time to take a break and refresh yourself" in a gentle tone.

[1181] In this way, appropriate conversation content and voice output are provided according to the user's emotions, resulting in a more natural and friendly conversation experience.

[1182] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1183] Step 1:

[1184] Initial Setup and Access

[1185] Users access the system using the operation method they learned in the smartphone class. Specifically, they launch the smartphone app and enter their login information.

[1186] The device receives user input and connects to a server over the internet, where the device uses Wi-Fi or mobile data.

[1187] Input: User login information

[1188] Output: Connection established to server

[1189] Step 2:

[1190] emotion recognition

[1191] The user speaks to the device, for example, saying, "I'm a little tired today."

[1192] The device records the user's voice and transmits the data to the server in real time. The device uses a microphone to capture the voice.

[1193] The server passes the received voice data to the emotion analysis engine, which analyzes the voice data and identifies the user's emotion. For example, it determines that the user is feeling tired from the word "tired."

[1194] Input: User's voice data

[1195] Output: User's emotional state (e.g., fatigue)

[1196] Step 3:

[1197] Conversation generation

[1198] The server sends prompts to the generative AI based on the emotional information obtained from the emotion analysis engine. The prompts include instructions for generating conversational content according to the user's emotions. For example, the server sends a prompt such as, "If the user is tired, please offer words of encouragement."

[1199] Generative AI generates appropriate conversational content based on the prompt text, such as "Today was tough, but let's take a break and refresh ourselves."

[1200] Input: User's emotion information, prompt sentence

[1201] Output: Generated conversation (e.g., words of encouragement)

[1202] Step 4:

[1203] Audio Output

[1204] The server passes the generated text to a speech synthesis engine to generate voice data. The speech synthesis engine converts the generated text into speech and outputs it in an appropriate tone. For example, it generates a voice in a gentle tone saying, "Today was tough, wasn't it? But let's take a break and refresh yourself."

[1205] The device receives the audio data sent from the server and plays it through the speaker, allowing the user to listen to the audio coming from the device.

[1206] Input: Generated conversation

[1207] Output: Audio data (e.g., encouraging words in a gentle tone)

[1208] In this way, appropriate conversation content and voice output are provided according to the user's emotions, resulting in a more natural and friendly conversation experience.

[1209] (Application example 1)

[1210] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1211] There is a problem that it is difficult to provide appropriate support to elderly people when they are in a physical store and want product information or guidance within the store. There is also a problem that it is not possible to provide appropriate conversation content that reflects the emotions of the elderly, which does not improve the user experience. Furthermore, there is a lack of systems that promote cognitive function and enable stress-free use.

[1212] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1213] In this invention, the server includes: a means for providing a conversation partner service for the elderly using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and sharing of memories; a means for initially utilizing smartphone classes and government transportation services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and ensure continued use; a means for providing support to the elderly when receiving product information or in-store guidance in physical stores; and a means for recognizing user emotions using an emotion engine and having the generative AI provide appropriate conversation content. This enables the elderly to enjoy shopping comfortably in physical stores, improves the user experience, promotes cognitive function, and realizes stress-free use.

[1214] "Generative AI" is an artificial intelligence technology that generates appropriate responses based on user input.

[1215] "Text to Speech technology" is a technology that converts text data into voice data.

[1216] The "Elderly People's Conversation Partner Service" is a service that allows elderly people to enjoy conversations via voice.

[1217] "Sharing conversations and memories" refers to the user and the system discussing past events and topics of interest.

[1218] A "means for enhancing cognitive function" is a method or technology for improving a user's cognitive abilities.

[1219] A "smartphone class" is a class where students learn how to operate a smartphone.

[1220] "Government transportation services" refers to transportation services provided by the government.

[1221] "Means for communicating by voice without operating the terminal" refers to a method that allows a user to communicate with the system using only voice without operating the device.

[1222] "Means for ascertaining cognitive level and preferences" are methods for assessing a user's cognitive abilities and personal preferences.

[1223] "Means for individually customizing generative AI" refers to a method for adjusting the behavior of generative AI according to the characteristics of the user.

[1224] "Means for providing support to elderly people when they receive product information or directions within the store in a physical store" refers to a method of providing support to elderly people when they receive product information or directions within the store in a physical store.

[1225] An "emotion engine" is a technology that recognizes the user's emotions and adjusts the system's behavior according to those emotions.

[1226] The "means for recognizing the user's emotions" is a method for detecting the user's emotional state.

[1227] "Means for providing appropriate conversation content" refers to a method for generating appropriate conversation according to the user's situation and emotions.

[1228] The system for implementing this invention utilizes generative AI and text-to-speech technology to provide a conversation partner service for the elderly. The system is configured using the following hardware and software:

[1229] Hardware

[1230] Smartphone

[1231] Smart Glasses

[1232] server

[1233] software

[1234] OpenAI API (generative AI)

[1235] Text to Speech Engine

[1236] Emotion Recognition Engine

[1237] System configuration

[1238] 1. Getting User Input

[1239] Users input their voice via a smartphone or smart glasses, which is converted into text data and sent to the server.

[1240] 2. Emotion recognition

[1241] The server uses an emotion recognition engine to recognize emotions from the user's input, which analyzes the user's voice and text data to identify emotions such as joy, sadness, and anger.

[1242] 3. Response Generation

[1243] The server uses the OpenAI API to generate appropriate responses based on the user's emotions and input. Generative AI creates prompts based on the user's emotional state and provides optimal conversational content.

[1244] 4. Audio Output

[1245] The server converts the generated response into voice data using a Text to Speech engine and sends it to the user's device. The Text to Speech engine outputs voice in a tone that corresponds to the user's emotion.

[1246] Specific examples

[1247] For example, if a user asks "Where is this item?" in a physical store, the system works as follows:

[1248] User Input: "Where is this item located?"

[1249] User Emotion: Delight

[1250] Generated response: "That item is in aisle 3. Can I show you?"

[1251] Prompt Sentence Examples

[1252] User Emotion: Delight

[1253] User Input: Where is this item located?

[1254] Generate an appropriate response.

[1255] In this way, a system can be realized that provides support for elderly people to enjoy shopping comfortably in physical stores. The system provides appropriate conversation content according to the user's emotions, promoting cognitive function and realizing stress-free use.

[1256] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1257] Step 1:

[1258] The user provides voice input via a smartphone or smart glasses.

[1259] Input: User's voice data

[1260] Output: Text data

[1261] Specific operation: The device uses voice recognition software to convert the user's speech into text and sends the text data to the server.

[1262] Step 2:

[1263] The server uses an emotion recognition engine to recognize emotions from the user's input.

[1264] Input: Text data

[1265] Output: Emotion data (happiness, sadness, anger, etc.)

[1266] Specific operation: The server inputs the text data into the emotion recognition engine and applies the emotion recognition algorithm to identify the user's emotion.

[1267] Step 3:

[1268] The server uses the OpenAI API to generate appropriate responses based on the user's emotions and inputs.

[1269] Input: Text data, emotion data

[1270] Output: Response text

[1271] Specific operation: The server sends emotion data and text data as a prompt to the OpenAI API, and the generative AI model generates an appropriate response text.

[1272] Step 4:

[1273] The server converts the generated response into audio data using a Text to Speech engine and sends it to the user's device.

[1274] Input: Response text

[1275] Output: Audio data

[1276] Specific operation: The server inputs the response text into the Text to Speech engine, which then generates voice data, which is then sent to the user's device.

[1277] Step 5:

[1278] The terminal plays the received audio data and provides a response to the user.

[1279] Input: Audio data

[1280] Output: Audio output

[1281] Specific operation: The terminal plays the received voice data through the speaker and provides a response to the user.

[1282] Example 2

[1283] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1284] There is a need to provide a conversation partner service that can be used continuously by the elderly without stress. In particular, it is necessary to customize the service to suit the elderly's cognitive level and preferences, and it is also important to track changes in the user's emotions and optimize the content of the conversation based on that. However, conventional systems have difficulty meeting these requirements, making it difficult for the elderly to continue using the service.

[1285] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1286] In this invention, the server includes: a means for providing a conversation partner service for the elderly using generative AI and voice synthesis technology; a means for promoting cognitive function through conversation and sharing of memories; a means for initially utilizing educational programs and public services and simply conversing by voice without the need to operate a device; a means for confirming the user's cognitive level and preferences at the time of installation and individually customizing the generative AI; a means for collecting user emotional data and tracking changes in emotion over time; and a means for optimizing the conversation content of the generative AI based on the emotional data. This enables the elderly to continue using the service without stress.

[1287] "Generative AI" is an artificial intelligence technology that dynamically generates conversation content based on user input and environmental data.

[1288] "Speech synthesis technology" is a technology that converts text data into voice data and outputs it as natural voice.

[1289] The "conversation partner service for the elderly" is a service that allows elderly people to enjoy conversations through voice, with the aim of promoting cognitive function and reducing feelings of loneliness.

[1290] "Methods for promoting cognitive function" are methods and techniques for improving cognitive function in the elderly through conversation and sharing memories.

[1291] An "educational program" is a program that provides educational content to help users understand and use the system effectively.

[1292] "Public services" are services provided by government agencies and public organizations, and are used to initially launch a system.

[1293] "Individual customization" refers to adjusting system settings and generative AI parameters according to the user's cognitive level and preferences.

[1294] "Emotion data" is data that indicates the user's emotional state, and is collected from facial expressions, tone of voice, and the like.

[1295] "Emotional change tracking means" means a method or technique that continuously monitors and records changes in a user's emotional state over time.

[1296] "Means for optimizing conversation content" refers to methods and technologies that adjust the conversation content of generative AI based on collected emotional data to provide the most optimal conversation for the user.

[1297] MODE FOR CARRYING OUT THE INVENTION

[1298] This invention is a system that provides a conversation partner service for elderly people by utilizing generative AI and voice synthesis technology. Specific embodiments of this system are described below.

[1299] System configuration

[1300] The system consists of three main elements: a server, a terminal, and a user. The server contains software for running generative AI and speech synthesis technology. The terminal is a device that users use to converse via voice, such as a smartphone or tablet. The users are elderly people who use the system to enjoy conversations.

[1301] Program processing

[1302] The server first conducts a questionnaire for the user. This questionnaire is designed to confirm the user's cognitive level and preferences, and specifically includes questions such as "What topics do you like to talk about?" and "What is your preferred speaking speed?" The user answers the questionnaire via their terminal.

[1303] The device sends the user's answers to the server, which analyzes the received data and identifies the user's preferences and cognitive level. For example, if the user answers, "I like the topic of history," the server records that information.

[1304] Next, the server adjusts the parameters of the generative AI. Specifically, it sets the user's preferred topics, easy-to-understand language, speaking speed, etc. For example, if the user responds that "speaking slowly makes it easier to understand," the server will set the generative AI's speaking speed to be slower.

[1305] The device also collects the user's emotional data in real time and sends it to a server, which uses an emotion engine to track changes in the user's emotions over time. For example, if the user tends to feel sad in the evening, the server will record that data.

[1306] The server optimizes the AI's conversation content based on the collected emotional data. For example, if a user tends to feel sad in the evening, the server adjusts the AI ​​to provide comforting words at that time of day. Specifically, it generates comforting words such as, "How was your day? Did anything fun happen?"

[1307] Examples of specific examples and prompts

[1308] For example, the following prompts could be fed into a generative AI model:

[1309] Prompt statement example 1:

[1310] "Users say they enjoy talking about history and find it easier to understand if you speak slowly. Start the conversation with a history-related topic at a slower pace."

[1311] Prompt statement example 2:

[1312] "Users tend to feel sad in the evenings every day. Try to offer comforting words during those times."

[1313] This allows the generative AI to provide optimal conversation content tailored to the user's preferences and emotions. For example, in the evening, it can soothe the user's feelings by offering comforting words such as, "How was your day? Did anything fun happen?"

[1314] In this way, the system can provide a conversation partner service that can be used continuously by the elderly without stress.

[1315] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1316] Step 1:

[1317] The user answers a questionnaire through the terminal. The questionnaire contains questions to confirm the user's cognitive level and preferences. For example, questions include "What topics do you like to talk about?" and "What is your preferred speaking speed?" The input is the user's response data, and the output is the questionnaire data stored on the terminal.

[1318] Step 2:

[1319] The device sends the user's response data to the server. The server analyzes the received survey data and identifies the user's preferences and cognitive level. For example, if the user answers "I like the topic of history," the server records that information. The input is the survey data sent from the device, and the output is the analyzed data on the user's preferences and cognitive level.

[1320] Step 3:

[1321] The server adjusts the parameters of the generating AI based on the analyzed data. Specifically, it sets the user's preferred topics, easy-to-understand language, speaking speed, etc. For example, if the user responds that "speaking slowly makes it easier to understand," the generating AI's speaking speed is set to slower. The input is the analyzed user's preferences and cognitive level data, and the output is the adjusted parameters of the generating AI.

[1322] Step 4:

[1323] The device collects the user's emotional data in real time and sends it to the server. The emotional data is collected from the user's facial expressions, tone of voice, etc. The input is the user's emotional data, and the output is the emotional data stored in the device.

[1324] Step 5:

[1325] The server analyzes the received emotion data and tracks changes in the user's emotions over time. For example, if a user tends to feel sad in the evening, it records that data. The input is the emotion data sent from the device, and the output is the analyzed user's emotion pattern.

[1326] Step 6:

[1327] The server optimizes the conversation content of the generation AI based on the collected emotional data. For example, if a user tends to feel sad in the evening, the server adjusts the generation AI to provide comforting words at that time of day. Specifically, it generates comforting words such as, "How was your day? Did anything fun happen?" The input is the analyzed user's emotional patterns, and the output is optimized conversation content.

[1328] Step 7:

[1329] The device outputs the optimized conversation content as voice using speech synthesis technology. The user can enjoy the conversation through the voice output from the device. The input is the optimized conversation content, and the output is the conversation content as voice.

[1330] (Application example 2)

[1331] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1332] When elderly people use food delivery services, they often feel stressed due to the complexity of the operation and emotional changes. This makes it difficult for them to continue using the service. In addition, the lack of customization according to the cognitive level and preferences of elderly people makes it difficult to provide a service that satisfies users.

[1333] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1334] In this invention, the server includes: a means for providing a companion service for the elderly using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and sharing of memories; a means for initially utilizing smartphone classes and government transportation services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and thus anticipate continued use; and a means for tracking changes in the user's emotions in a food delivery service for the elderly and providing words of comfort and encouragement at appropriate times, thereby enabling the elderly to continue using food delivery services without stress.

[1335] "Generative AI" is an artificial intelligence technology that generates natural language text based on user input.

[1336] "Text to Speech technology" is a technology that converts text data into speech.

[1337] The "Elderly Conversation Service" is a service that promotes cognitive function through conversation and reduces feelings of loneliness for the elderly.

[1338] "Methods for promoting cognitive function" are ways to improve the cognitive function of the elderly through conversation and sharing memories.

[1339] A "smartphone class" is a class where elderly people can learn the basic operations of smartphones.

[1340] "Government transportation services" are services that provide transportation for elderly people to access government services.

[1341] The "means for having a conversation by voice without operating a terminal" is a method for a user to have a conversation by voice only without operating a terminal.

[1342] "Means to confirm cognitive level and preferences" refers to methods for understanding the cognitive level and individual preferences of elderly people.

[1343] "Means for individually customizing the generating AI" refers to a method for adjusting the parameters of the generating AI according to the user's cognitive level and preferences.

[1344] A "means for tracking changes in a user's emotions" is a method for monitoring changes in a user's emotions over time.

[1345] "Means for providing words of comfort and encouragement at the appropriate time" refers to a method for providing appropriate words according to the user's emotional state.

[1346] A "food delivery service" is a service that allows users to order meals and have them delivered to their homes.

[1347] The system for implementing this invention provides a conversation partner service for elderly people by utilizing generative AI and text-to-speech technology. Specific embodiments of this system are described below.

[1348] System configuration

[1349] 1. Server

[1350] The server provides a platform that integrates generative AI and text-to-speech technology. The server manages user profile data and adjusts the parameters of the generative AI according to the user's cognitive level and preferences. It also has an emotion engine that tracks changes in the user's emotions and provides words of comfort and encouragement at the appropriate time.

[1351] 2. Terminal

[1352] The terminal is a device such as a smartphone or smart glasses that provides an interface for users to converse by voice. The terminal outputs the conversation content of the generated AI sent from the server as voice using text-to-speech technology.

[1353] 3. Users

[1354] The user is an elderly person who uses a food delivery service and can order meals by speaking via a terminal.

[1355] Program processing

[1356] The server adjusts the parameters of the generative AI based on the user's profile data and generates conversation content that matches the user's cognitive level and preferences. The generated conversation content is output as audio using text-to-speech technology. In addition, the server tracks changes in the user's emotions and provides words of comfort and encouragement at the appropriate time.

[1357] Hardware and software used

[1358] Generative AI: Generate natural language text using OpenAI's API.

[1359] Text to Speech Technology: Converts text to speech using the Google Cloud Text-to-Speech API.

[1360] Emotion Engine: Equipped with an algorithm to track changes in user emotions.

[1361] Specific examples

[1362] For example, if a user uses a food delivery service in the evening, the server might generate a prompt like this:

[1363] "Hello. What kind of food would you like to have today? The evening may be a little dull, so let's cheer you up with some delicious food."

[1364] The prompts are adjusted according to the user's emotional state and output as voice using text-to-speech technology, enabling elderly people to continue using food delivery services without stress.

[1365] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1366] Step 1:

[1367] The server obtains the user's profile data. As input, it receives profile data including information such as the user's name, age, preferences, cognitive level, and emotional patterns. Based on this, it processes the data to adjust the parameters of the generative AI. As output, it generates the adjusted parameters.

[1368] Step 2:

[1369] The server obtains the current time zone and sets the current emotional state based on the user's emotional pattern. As input, it receives the current time and the user's emotional pattern. Based on this, the emotion engine estimates the user's current emotional state. As output, it generates the estimated emotional state.

[1370] Step 3:

[1371] The server generates prompt sentences based on the user's profile data and current emotional state. As input, it receives the adjusted parameters and estimated emotional state. Based on this, the generative AI generates a prompt sentence appropriate for the user. As output, it generates the generated prompt sentence.

[1372] Step 4:

[1373] The server converts the generated prompt sentence into audio data using Text to Speech technology. As input, it receives the generated prompt sentence. Based on this, the Google Cloud Text-to-Speech API converts the text into audio data. As output, it generates the generated audio data.

[1374] Step 5:

[1375] The terminal receives the voice data sent from the server and outputs it as voice to the user. As input, the terminal receives the voice data sent from the server. Based on this, the terminal's speaker plays the voice data. As output, the terminal provides voice to the user.

[1376] Step 6:

[1377] A user orders food by speaking through a terminal. As input, the terminal receives a voice output. Based on this, the user responds with a voice to convey the order. As output, the user's voice input is generated.

[1378] Step 7:

[1379] The terminal transmits the user's voice input to the server. As input, the terminal receives the user's voice input. Based on this, the terminal transmits voice data to the server. As output, the terminal generates the voice data that is transmitted to the server.

[1380] Step 8:

[1381] The server analyzes the user's voice input and confirms the order details. As input, it receives the user's voice data. Based on this, speech recognition technology converts the voice data into text and analyzes the order details. As output, it generates the analyzed order details.

[1382] Step 9:

[1383] The server arranges for food delivery services based on the parsed order details. As input, it receives the parsed order details. Based on this, it arranges for food delivery services. As output, it generates order confirmation information.

[1384] Step 10:

[1385] The server sends the order confirmation information to the terminal and notifies the user. As input, it receives the order confirmation information. Based on this, the server sends the order confirmation information to the terminal. As output, it generates the order confirmation information that is sent to the terminal.

[1386] Step 11:

[1387] The terminal receives the order confirmation information sent from the server and notifies the user. As input, the terminal receives the order confirmation information sent from the server. Based on this, the terminal displays or plays a notification by voice. As output, the terminal provides the order confirmation information to the user.

[1388] Example 3

[1389] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1390] Appropriate conversations and sharing of memories are important for elderly people to maintain and improve their cognitive functions. However, conventional systems have difficulty in individual customization according to the user's cognitive level and preferences, and lack the ability to learn and improve appropriate responses to the user's emotions, making continuous use difficult. Furthermore, the device operation is complicated, making it difficult for elderly people to use.

[1391] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1392] In this invention, the server includes means for generating conversation content according to the cognitive level and preferences of the elderly person using generative AI, means for outputting the generated conversation content as audio using text-to-speech technology, and means for collecting user emotion data and learning and improving the system's response using an emotion engine. This provides an individually customized conversation service that the elderly can use without stress, and by learning and improving appropriate responses according to the user's emotions, continuous use is possible.

[1393] "Generative AI" is an artificial intelligence technology that generates conversation content based on the user's cognitive level and preferences.

[1394] "Text to Speech technology" is a technology that converts generated text data into voice data.

[1395] An "emotion engine" is a technology that analyzes user emotional data to learn and improve the system's response.

[1396] The "cognitive level" is an index that indicates the state of the user's cognitive function.

[1397] "Preferences" is information that indicates topics of interest or hobbies of a user.

[1398] "Conversation content" is text data generated by generative AI based on the user's cognitive level and preferences.

[1399] "Audio Data" means audio files generated by Text to Speech technology.

[1400] "User emotion data" is data indicating the user's emotional state obtained from the user's facial expression, tone of voice, and the like.

[1401] "Individual customization" refers to adjusting system settings and conversation content according to the user's cognitive level and preferences.

[1402] "Continuous use" refers to a user continuing to use the system for an extended period of time.

[1403] This invention is a system that generates conversation content according to the cognitive level and preferences of elderly people and outputs it as voice. The system is composed of generative AI, text-to-speech technology, and an emotion engine.

[1404] First, the user uses the device to input information about their cognitive level and preferences. The device then sends this information to the server. The server uses a generative AI model (e.g., GPT-4) to generate conversation content based on the user's cognitive level and preferences. Specifically, the server inputs the following prompt sentences into the generative AI model:

[1405] "An elderly person has a medium cognitive level and enjoys gardening. Generate conversation content based on this."

[1406] The generative AI generates conversation content such as, "The weather these days is perfect for gardening. What kind of flowers are you growing?"

[1407] Next, the server converts the generated conversation content into audio data using Text to Speech (TTS) technology (e.g., Google Text-to-Speech API). Specifically, the server inputs the generated text into a TTS engine to generate an audio file (e.g., MP3 format). The server then sends the generated audio data to the device. The device then plays the received audio data and provides it to the user. Specifically, a voice saying, "The weather has been perfect for gardening lately. What kind of flowers are you growing?" is played from the device's speaker.

[1408] In addition, the device uses a camera and microphone to acquire emotional data to collect the user's reactions. Specifically, the device's camera recognizes the user's facial expressions, and the microphone analyzes the user's vocal tone. The device then sends the collected emotional data to the server. The server uses an emotion engine to analyze how the user's emotions have changed due to the system's reactions. Specifically, the server analyzes the user's facial expression data and vocal tone to identify the user's emotional state (e.g., joy, sadness). The server uses this learning result to adjust the system's response from the next time onwards. For example, if the user feels sad, the system will adjust the system to generate more positive conversation content next time.

[1409] In this way, the system can provide conversations that are tailored to the preferences and cognitive levels of the elderly, improving the user experience. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1410] Step 1:

[1411] Entering user information

[1412] The user uses the terminal to input information about their cognitive level and preferences.

[1413] Input: The user enters information such as "cognitive level: medium" and "hobby: gardening" into a form on the device screen.

[1414] Output: The terminal sends the entered user information to the server.

[1415] Step 2:

[1416] Conversation generation

[1417] The server uses a generative AI model (e.g., GPT-4) to generate conversational content based on the user's cognitive level and preferences.

[1418] Input: User information sent from the device.

[1419] Data processing: The server inputs the following prompt sentence into the generative AI model:

[1420] "An elderly person has a medium cognitive level and enjoys gardening. Generate conversation content based on this."

[1421] Output: The generative AI generates the following conversation: "The weather these days is perfect for gardening. What flowers are you growing?"

[1422] Step 3:

[1423] Voice

[1424] The server converts the generated conversation into audio data using Text to Speech (TTS) technology (e.g., Google Text-to-Speech API).

[1425] Input: The text data of the generated conversation.

[1426] Data processing: The server inputs the generated text into the TTS engine and generates an audio file (e.g., MP3 format).

[1427] Output: The generated audio data.

[1428] Step 4:

[1429] Playing audio

[1430] The server transmits the generated voice data to the terminal.

[1431] The terminal plays back the received audio data and provides it to the user.

[1432] Input: Audio data sent from the server.

[1433] Output: A voice will play from the device's speaker saying, "The weather has been perfect for gardening lately. What flowers are you growing?"

[1434] Step 5:

[1435] Collecting Emotional Data

[1436] The device uses a camera and microphone to capture emotional data to gather user reactions.

[1437] Input: The user's facial expression and tone of voice.

[1438] Data processing: The device's camera recognizes the user's facial expressions, and the microphone analyzes the tone of the user's voice.

[1439] Output: Collected emotion data.

[1440] Step 6:

[1441] Improving emotional learning and response

[1442] The device transmits the collected emotion data to a server.

[1443] The server uses an emotion engine to analyze how the user's emotions have changed due to the system's response.

[1444] Input: Collected emotion data.

[1445] Data processing: The server analyzes the user's facial expression data and voice tone to identify the user's emotional state (e.g., joy, sadness).

[1446] Output: Learning results to adjust the system's response in future.

[1447] In this way, the system can provide conversations tailored to the elderly's preferences and cognitive level, improving the user experience.

[1448] (Application example 3)

[1449] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1450] There is a need for methods to help elderly people maintain and improve their cognitive functions without feeling lonely in their daily lives. Food delivery services also need support to help elderly people select menus that suit their preferences and cognitive levels. Furthermore, improving service satisfaction by responding appropriately to users' emotions is a challenge.

[1451] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1452] In this invention, the server includes: a means for providing a conversation partner service for seniors using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and memory sharing; a means for initial use utilizing smartphone classes and government transportation services, whereby users can simply converse by voice without having to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to ensure stress-free use and ensure continued use; a means for suggesting menus based on the user's preferences and past history; and a means for analyzing the user's emotions using an emotion engine and providing appropriate responses. This enables seniors to maintain and improve their cognitive function without feeling lonely, and also makes it easier for seniors to select menus that suit their preferences and cognitive level in food delivery services. Furthermore, providing appropriate responses based on the user's emotions can improve service satisfaction.

[1453] "Generative AI" is an artificial intelligence technology that automatically generates appropriate conversation content and suggestions based on user input and past data.

[1454] "Text to Speech technology" is a technology that converts text data into audio data and outputs it as audio.

[1455] The "Elderly Conversation Service" is a service that allows elderly people to enjoy conversations on a daily basis without feeling lonely.

[1456] "Methods for promoting cognitive function" are methods for maintaining and improving cognitive function in the elderly through conversation and sharing memories.

[1457] A "smartphone class" is a class where elderly people can learn the basic operations of smartphones.

[1458] "Government transportation services" are services that assist elderly people in traveling when using government services.

[1459] The "means for having a conversation by voice without operating a terminal" is a method by which a user can have a conversation by voice only, without operating a terminal.

[1460] "Means to confirm awareness level and preferences" refers to a method for understanding the user's awareness level and preferences at the time of implementation.

[1461] "Means for individual customization" refers to a method for adjusting generative AI according to the user's cognitive level and preferences.

[1462] The "means for suggesting menus" is a method for suggesting appropriate menus based on the user's preferences and past history.

[1463] An "emotion engine" is a technology that analyzes a user's emotions and responds appropriately based on the results.

[1464] "Means for analyzing user emotions" refers to a method for reading and analyzing emotions from users' statements and actions.

[1465] "Means for taking appropriate action" refers to a method for reacting or taking appropriate action depending on the user's emotions.

[1466] The system for implementing this invention utilizes generative AI and text-to-speech technology to provide a conversation partner service for the elderly. The system generates conversation content based on the user's preferences and cognitive level and outputs it as voice. It also uses an emotion engine to analyze the user's emotions and respond appropriately.

[1467] Hardware and software used

[1468] Hardware: Smartphones, smart speakers

[1469] Software: Python, OpenAI API, Text to Speech engine, Emotion recognition engine

[1470] Data processing and calculation

[1471] 1. Data Input: User preferences and past order history are used as input data, which allows the generative AI to suggest optimal conversation topics and menus for the user.

[1472] 2. Data processing: Using a generative AI model (OpenAI API), we generate conversation content and menus based on user preferences.

[1473] 3. Data calculation: The emotion recognition engine analyzes the user's emotions, allowing the system to respond appropriately based on the user's emotions.

[1474] 4. Data output: Using text-to-speech technology, the generated conversation content and menus are output as audio.

[1475] Specific examples

[1476] Specific examples of menu suggestions

[1477] Based on the user's preferences and past history, the generative AI will suggest an appropriate menu. For example, if the user likes Japanese food but does not like spicy food, the generative AI will suggest the following menu items:

[1478] Eel bowl

[1479] Tempura set meal

[1480] Sushi set

[1481] Examples of emotional responses

[1482] If the user is unsure about the proposed menu, the emotion engine analyzes the user's emotions and responds appropriately. For example, if the user says, "I'm not sure which one to choose," the system responds as follows:

[1483] "You seem confused. Shall I explain a bit more?"

[1484] Prompt Sentence Examples

[1485] Below are some examples of prompts that generative AI might use to suggest menus:

[1486] Suggest menu items based on user preferences: I like Japanese food, but I don't like spicy food.

[1487] In this way, the system can help elderly people maintain and improve their cognitive function without feeling lonely. It also makes it easier for elderly people to select menus that suit their preferences and cognitive level in food delivery services. Furthermore, by responding appropriately to the user's emotions, it is possible to improve satisfaction with the service.

[1488] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1489] Step 1:

[1490] A user accesses the system and enters their preferences and past history.

[1491] Input: User preferences (e.g., likes Japanese food, doesn't like spicy food), past order history

[1492] How it works: A user uses a smartphone or smart speaker to enter their preferences and past order history into the system via voice or text.

[1493] Output: User preferences and past history are stored in a database.

[1494] Step 2:

[1495] The server uses a generative AI model to generate a menu based on the user's preferences.

[1496] Input: User preferences and past history

[1497] How it works: The server calls the OpenAI API and sends a prompt to the generative AI model. An example prompt is "Please suggest a menu based on the user's preferences: I like Japanese food, but I don't like spicy food."

[1498] Output: Menu suggestions from the generative AI model (e.g., eel bowl, tempura set meal, sushi set)

[1499] Step 3:

[1500] The server uses text-to-speech technology to output the generated menu as audio.

[1501] Input: Menu suggestions from a generative AI model

[1502] How it works: The server uses a Text to Speech engine library to convert the generated menu into audio data.

[1503] Output: The audio data is played back to the user via a smartphone or smart speaker.

[1504] Step 4:

[1505] The user provides feedback on the proposed menu.

[1506] Input: User feedback (e.g., "I'm not sure which one to choose")

[1507] How it works: The user uses their smartphone or smart speaker to provide feedback or comments about the suggested menu items via voice or text.

[1508] Output: User feedback is sent to the server.

[1509] Step 5:

[1510] The server uses an emotion engine to analyze the user's emotions.

[1511] Input: User feedback

[1512] How it works: The server uses an emotion recognition engine library to analyze emotions from user feedback.

[1513] Output: User's emotion data (e.g., confused, happy)

[1514] Step 6:

[1515] The server responds appropriately according to the user's emotions.

[1516] Input: User emotion data

[1517] How it works: The server generates an appropriate response based on the emotion data. For example, if the user is confused, it might respond with, "It seems you're confused. Shall I explain in more detail?"

[1518] Output: The response message is output as audio using Text to Speech technology.

[1519] Step 7:

[1520] The user receives the response from the system and makes the final selection.

[1521] Input: Response message from the system

[1522] How it works: The user receives a voice response from the system via their smartphone or smart speaker and makes the final menu selection.

[1523] Output: The user's final selection is sent to the server and the order is confirmed.

[1524] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1525] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1526] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1527] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1528] [Third embodiment]

[1529] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1530] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1531] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1532] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1533] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1534] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1535] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1536] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1537] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1538] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1539] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1540] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1541] "Example 1"

[1542] One embodiment of the present invention is a system that uses generative AI and text-to-speech technology to provide a conversation partner service for the elderly. This system can be easily implemented by seniors using smartphone classes and government mobile services, and realizes a system that requires no device operation and only requires voice conversation. Specifically, seniors access the system using the operation methods they learned in the smartphone classes. Furthermore, by using government mobile services, they can use the system while on the move.

[1543] "Example 2"

[1544] Furthermore, by checking the cognitive level and preferences of the elderly at the time of implementation and customizing the generating AI individually, the elderly can continue to use the service without stress. Specifically, a questionnaire is conducted with the elderly at the time of implementation, and the parameters of the generating AI are adjusted based on the answers. For example, it is possible to customize topics preferred by the elderly, easy-to-understand language, speaking speed, etc.

[1545] "Example 3"

[1546] In addition, generative AI generates conversation content according to the elderly person's cognitive level and preferences, and text-to-speech technology outputs the generated conversation content as audio. Specifically, generative AI generates topics that match the elderly person's preferences and cognitive level, and then text-to-speech technology converts the content into audio. This allows elderly people to enjoy conversations that match their preferences and cognitive level.

[1547] The processing flow of each embodiment will be described below.

[1548] "Example 1"

[1549] Step 1: The elderly access the system using the operation methods they learned in the smartphone class.

[1550] Step 2: The system displays a questionnaire to ascertain the elderly person's cognitive level and preferences.

[1551] Step 3: The elderly respond to the questionnaire.

[1552] Step 4: The system adjusts the parameters of the generation AI based on the answers to generate individually customized conversation content.

[1553] Step 5: The generated conversation content is converted into audio using text-to-speech technology and output to the elderly.

[1554] "Example 2"

[1555] Step 1: When an elderly person uses a government transportation service, they access the system.

[1556] Step 2: The system displays a questionnaire to ascertain the elderly person's cognitive level and preferences.

[1557] Step 3: The elderly respond to the questionnaire.

[1558] Step 4: The system adjusts the parameters of the generation AI based on the answers to generate individually customized conversation content.

[1559] Step 5: The generated conversation content is converted into audio using text-to-speech technology and output to the elderly.

[1560] Example 1

[1561] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1562] Elderly people often feel lonely in their daily lives, and there are concerns about declining cognitive function. Furthermore, for elderly people who are not good at using technology, operating complex devices can be a significant burden. There is a need to solve these problems and provide a conversation partner service that seniors can use without stress.

[1563] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1564] In this invention, the server includes means for the terminal to capture the user's voice input and send it to the server, means for the server to convert the voice data into text data, means for the server to analyze the text data using a generative AI model and generate an appropriate response, means for the server to convert the generated text response into voice data and send it to the terminal, and means for the terminal to play back the voice data.This enables elderly people to reduce their sense of loneliness through natural conversation without the need for complex operations, and to maintain and improve their cognitive function.

[1565] "Users" refer to elderly people who use the system.

[1566] A "terminal" is a device that allows a user to input voice, and includes a smartphone, tablet, etc.

[1567] "Server" refers to a central processing unit that processes voice data, generates text data, generates responses, and converts voice data.

[1568] "Voice input" refers to voice data generated by a user speaking into a terminal.

[1569] "Voice data" refers to a digital representation of a user's voice input.

[1570] "Text data" refers to data obtained by converting voice data into character information.

[1571] A "generative AI model" refers to an artificial intelligence model that analyzes input text data and generates an appropriate response.

[1572] "Response" refers to the reply generated by a generative AI model based on text data.

[1573] "Speech recognition software" refers to software for converting voice data into text data.

[1574] "Text to Speech technology" refers to technology that converts text data into voice data.

[1575] "Audio playback" refers to the device outputting audio data through a speaker.

[1576] This invention is a system that provides a conversation partner service for elderly people by utilizing a generative AI model and text-to-speech technology. Specific embodiments of this system are described below.

[1577] System configuration

[1578] server

[1579] The server is a central processing unit that processes voice data, generates text data, generates responses, and converts voice data. The server uses the following software:

[1580] Speech recognition software: Google Cloud Speech-to-Text API

[1581] Generative AI model: OpenAI's GPT-4

[1582] Text to Speech technology: Amazon Polly

[1583] Terminal

[1584] A terminal is a device that allows a user to input voice information, such as a smartphone or tablet. A terminal has the following functions:

[1585] Microphone: Captures the user's voice

[1586] Network module: Sending audio data to the server

[1587] Speaker: Plays audio data received from the server

[1588] User

[1589] The users are elderly people who use the system to communicate by voice. They access the system using the operation methods they learned in the smartphone class.

[1590] System Operation

[1591] Voice input and transmission

[1592] The user inputs voice by speaking into the device. For example, they can input a question such as "What's the weather like today?" The device captures this voice with a microphone and generates voice data. The generated voice data is sent to the server via the device's network module.

[1593] Converting audio data to text

[1594] The server sends the received voice data to the Google Cloud Speech-to-Text API, which converts the voice data into text data. The converted text will be "What's the weather like today?"

[1595] Text data analysis and response generation

[1596] The server analyzes the converted text data using a generative AI model (GPT-4). Based on the analysis results, it generates a response such as "It's sunny today."

[1597] Text-to-speech response

[1598] The server sends the generated text response to Amazon Polly, which converts it into speech, which then says, "It's a sunny day today."

[1599] Sending and playing audio data

[1600] The server transmits the converted voice data to the terminal, which then plays the received voice data through a speaker, allowing the user to hear the voice saying "It's sunny today."

[1601] Specific examples

[1602] Example 1

[1603] The user speaks to the device, "What's the weather like today?" The device sends this speech to a server, which converts it into text. A generative AI model generates a response such as "It's sunny today," which is then converted into speech using TTS technology. Finally, the device's speaker plays back the message, "It's sunny today."

[1604] Example 2

[1605] The user speaks to the device, saying, "What are my plans for tomorrow?" The device sends the speech to the server, which converts it into text. The generative AI model generates a response such as, "I have a doctor's appointment tomorrow at 10:00 AM," which is then converted into speech using TTS technology. The device's speaker plays back the message, "I have a doctor's appointment tomorrow at 10:00 AM."

[1606] Prompt Sentence Examples

[1607] "Please explain the system that allows seniors to access the system using the operations they learned in the smartphone class and provides a companion service that can be used simply by having a voice conversation. This system utilizes generative AI models and text-to-speech technology."

[1608] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1609] Step 1:

[1610] The user speaks to the device. For example, they may ask a question such as "What's the weather like today?" The input is the user's voice, and the output is the voice data captured by the device's microphone. Specifically, the user presses the microphone button on their smartphone to speak.

[1611] Step 2:

[1612] The terminal captures the user's voice with a microphone and generates voice data. The generated voice data is sent to the server through the terminal's network module. The input is the captured voice data, and the output is digital voice data sent to the server. In specific operations, the terminal sends the voice data to the server in real time.

[1613] Step 3:

[1614] The server sends the received voice data to the Google Cloud Speech-to-Text API, which converts the voice into text data. The input is the voice data sent to the server, and the output is the converted text data. Specifically, the server calls the voice recognition software to convert the voice data into text.

[1615] Step 4:

[1616] The server uses a generative AI model (GPT-4) to analyze the converted text data and generate an appropriate response. The input is the converted text data, and the output is the generated text response. Specifically, the server inputs a prompt sentence into the generative AI model and generates a response.

[1617] Step 5:

[1618] The server sends the generated text response to Amazon Polly, which converts it to speech. The input is the generated text response, and the output is the converted speech. Specifically, the server invokes Text to Speech technology to convert the text response to speech.

[1619] Step 6:

[1620] The server transmits the converted voice data to the terminal. The input is the converted voice data, and the output is the voice data transmitted to the terminal. In a specific operation, the server transmits the voice data to the terminal.

[1621] Step 7:

[1622] The terminal plays the received voice data through the speaker. The input is the voice data sent from the server, and the output is the voice that the user can hear. In concrete terms, the terminal's speaker plays the voice data, and the user hears the voice saying, "It's sunny today."

[1623] (Application example 1)

[1624] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1625] Elderly people often feel lonely in their daily lives, and there are concerns about a decline in cognitive function. In addition, many elderly people find it difficult to operate smartphones or tablets when using food delivery services. This makes it difficult to order meals, leading to a decline in quality of life.

[1626] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1627] In this invention, the server includes: a means for providing a conversation partner service for the elderly using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and sharing of memories; a means for initially utilizing smartphone classes and government transportation services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and expected continuity; a means for the elderly to order food delivery by voice; and a means for the generative AI to generate a response based on the elderly's order and respond by voice using text-to-speech technology. This makes it possible for the elderly to easily use food delivery services without feeling lonely and while maintaining their cognitive function.

[1628] "Generative AI" is a type of artificial intelligence technology, a system that has the ability to generate new data and information based on input data.

[1629] "Text to Speech technology" is a technology that converts text data into audio data, enabling a computer to read the text aloud in a natural voice.

[1630] The "conversation companion service for the elderly" is a service that helps the elderly maintain and promote cognitive function through conversation without feeling lonely.

[1631] A "smartphone class" is a class where elderly people can learn the basic operation methods of smartphones.

[1632] "Government transportation services" are public transportation support services that enable elderly people to use necessary services while on the move.

[1633] "Cognitive level" is an indicator that shows the state and ability of an individual's cognitive function.

[1634] "Personalization" refers to the adjustment and optimization of systems and services to meet the specific needs and preferences of users.

[1635] "Food delivery" is a service that allows you to order meals and have them delivered to a specified location.

[1636] "Responding with voice" means that the system responds with voice to the user's voice input.

[1637] The system for implementing this invention provides a conversation partner service for the elderly using generative AI and text-to-speech technology. The system uses the following hardware and software:

[1638] Hardware

[1639] Smartphone

[1640] microphone

[1641] software

[1642] OpenAI API

[1643] Text to Speech Engine

[1644] Speech Recognition Library

[1645] System action

[1646] The server first converts the user's speech into text using a speech recognition library, then uses generative AI to generate a response based on the user's input, which is then converted into audio using a text-to-speech engine and sent back to the user.

[1647] Specifically, when a user speaks into the smartphone's microphone, the speech is converted into text by a speech recognition library. For example, if a user asks, "What's today's recommendation?", the text is sent to the generative AI. The generative AI generates an appropriate response based on the prompt, and the response is converted into speech by the text-to-speech engine. Finally, the smartphone speaker responds to the user, saying, "Today's recommendation is curry rice and salad set. Would you like to order?"

[1648] Prompt Sentence Examples

[1649] Sample conversation for a senior citizen who wants to order food delivery: What are your recommendations today?

[1650] This system allows elderly people to easily order food delivery using only their voice, reducing feelings of loneliness and improving their quality of life while maintaining their cognitive function.

[1651] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1652] Step 1:

[1653] The user speaks into the smartphone microphone. The input is the user's voice, for example, "What's your recommendation today?" The output is voice data.

[1654] Step 2:

[1655] The device uses a speech recognition library to convert the user's speech into text. The input is speech data and the output is text data. Specifically, the speech recognition library analyzes the speech data and generates the text "What's your recommendation today?"

[1656] Step 3:

[1657] The device sends text data to the generative AI. The input is text data, and the output is a response text from the generative AI. Specifically, the generative AI generates an appropriate response based on the prompt. For example, it generates a response text such as, "Today's recommendation is curry rice and salad set. Would you like to order?"

[1658] Step 4:

[1659] The terminal sends the generated response text to the Text to Speech engine. The input is the response text and the output is audio data. Specifically, the Text to Speech engine converts the response text into audio.

[1660] Step 5:

[1661] The device responds to the user with the generated voice data through the smartphone's speaker. The input is voice data, and the output is the voice the user hears. Specifically, the smartphone's speaker plays the following voice: "Today's recommendation is curry rice and salad set. Would you like to order?"

[1662] This series of processes allows users to order food delivery using only their voice.

[1663] Example 2

[1664] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1665] To provide a conversation partner service that can be used continuously and without stress by the elderly, it is necessary to customize the service according to the cognitive level and preferences of each individual elderly person. However, conventional systems do not provide sufficient individual customization, and elderly people often feel stressed when using the service. In addition, for elderly people who have difficulty operating devices, there was a need for a system that allows them to communicate using only voice without the need for operation.

[1666] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1667] In this invention, the server includes means for conducting a questionnaire and adjusting the parameters of the generative AI based on the responses, means for downloading the customized generative AI model to a terminal and using it to provide services, and means for receiving input from a user and generating a response in response to that input using the generative AI model. This enables individual customization according to the cognitive level and preferences of the elderly, allowing them to continue using the service without stress.

[1668] "Generative AI" is an artificial intelligence technology that generates natural language responses based on user input.

[1669] "Speech synthesis technology" is a technology that converts text data into voice data.

[1670] The "conversation partner service for the elderly" is a service that allows elderly people to enjoy conversations via voice, with the aim of promoting cognitive function and reducing stress.

[1671] "Methods for promoting cognitive function" are methods for improving cognitive function in the elderly through conversation and sharing memories.

[1672] A "mobile information terminal classroom" is a classroom where elderly people can learn how to use mobile information terminals.

[1673] "Public services" are services provided by government agencies and public organizations, including transportation assistance and life support.

[1674] A "questionnaire" is a survey instrument that includes questions to ascertain a user's awareness level and preferences.

[1675] "Means for adjusting parameters" refers to a method for changing the settings of generative artificial intelligence based on the responses to a questionnaire.

[1676] A "customized generative artificial intelligence model" is a generative artificial intelligence model that is adjusted according to the user's cognitive level and preferences.

[1677] "User input" refers to voice or text instructions or questions that a user gives to the system.

[1678] A "means for generating a response" is a method for generating an appropriate response based on input from a user.

[1679] This invention is a system that provides a conversation partner service that can be used continuously and without stress by the elderly. The system utilizes generative artificial intelligence and speech synthesis technology to customize the service to suit the elderly's cognitive level and preferences.

[1680] First, the server conducts a survey of elderly people when the system is introduced. The survey includes questions to confirm the user's cognitive level and preferences. For example, it includes questions such as, "What are your favorite topics?" and "Do you prefer someone to speak faster?" The survey response data is collected and stored on the server.

[1681] The server then analyzes the collected survey data and adjusts the parameters of the generative AI model, including topics preferred by seniors, easy-to-understand language, speaking speed, etc. Specifically, by updating the parameter setting file of the generative AI model, an individually customized generative AI model is created.

[1682] The terminal uses a customized generative artificial intelligence model to provide services to the elderly. The terminal receives input from the user and generates a response based on that input using the generative artificial intelligence model. This response is tailored to the elderly's preferences and cognitive level, allowing the user to use the service without stress.

[1683] As a specific example, if an elderly person answers a questionnaire by saying, "I like talking about history and prefer to speak slowly," the server will adjust the parameters of the generative artificial intelligence model to generate responses that include more history-related topics and set the speaking speed to be slower.

[1684] Example prompt sentence:

[1685] "Please speak slowly on topics related to history."

[1686] When this prompt is fed into a generative AI model, the model generates a response tailored to the topic and speaking speed preferred by the elderly person, such as, "Let me tell you about the culture of the Edo period. The Edo period lasted from 1603 to 1868..."

[1687] In this way, the system provides customized services according to the elderly's cognitive level and preferences, allowing them to continue using the service without stress.

[1688] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1689] Step 1:

[1690] The server will conduct a questionnaire for the elderly when the system is introduced, which includes questions to confirm the user's cognitive level and preferences.

[1691] Input: User's survey response

[1692] Output: Survey response data

[1693] Specific operation: The server generates a questionnaire form and sends it to the terminal. The terminal displays the questionnaire form and the user enters their answers.

[1694] Step 2:

[1695] The terminal transmits the questionnaire responses entered by the user to the server.

[1696] Input: User's survey response

[1697] Output: Survey data sent to the server

[1698] Specific operation: The terminal sends the user's input in real time to the server, which stores it in a database.

[1699] Step 3:

[1700] The server analyzes the collected survey data and adjusts the parameters of the generative artificial intelligence model.

[1701] Input: Survey data

[1702] Output: Adjusted parameters of the generative artificial intelligence model

[1703] How it works: The server uses data analysis algorithms to identify the user's preferences and cognitive level, and updates the configuration files of the generative artificial intelligence model accordingly.

[1704] Step 4:

[1705] The terminal downloads the customized generative artificial intelligence model and uses it to provide services.

[1706] Input: Adjusted parameters of the generative artificial intelligence model

[1707] Output: A customized generative artificial intelligence model

[1708] Specific operation: The server sends the customized generative artificial intelligence model to the terminal, which receives and installs it.

[1709] Step 5:

[1710] The terminal receives input from the user and generates a response in response to the input using a generative artificial intelligence model.

[1711] Input: Voice input from the user

[1712] Output: The generated response

[1713] Specific operation: When a user speaks to the device, the device sends the input to the generative artificial intelligence model, which then generates an appropriate response and returns it to the device, which then displays or speaks the response to the user.

[1714] (Application example 2)

[1715] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1716] When seniors shop in brick-and-mortar stores, they need easy-to-understand information for product explanations and selection. However, it is difficult for general store staff and standard guidance systems to provide personalized service according to the cognitive level and preferences of seniors. As a result, seniors may feel stressed and their shopping experience may be unsatisfactory. To solve this problem, a system that can be individually customized according to the cognitive level and preferences of seniors is needed.

[1717] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1718] In this invention, the server includes: a means for providing a conversation partner service for seniors using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and memory sharing; a means for initially utilizing smartphone classes and government mobility services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and ensure continued use; a means for providing a personalized shopping assistant for seniors in physical stores; and a means for adjusting parameters of the generative AI based on survey results and generating individually customized responses. This makes it possible to provide personalized information according to cognitive level and preferences when seniors shop in physical stores, enabling a stress-free and satisfying shopping experience.

[1719] "Generative AI" is an artificial intelligence technology that generates responses in natural language based on user input.

[1720] "Text to Speech technology" is a technology that converts text data into voice data.

[1721] The "conversation partner service for the elderly" is a service that allows elderly people to promote cognitive function through conversation and enjoy stress-free communication.

[1722] A "smartphone class" is a class where elderly people can learn the basic operations and how to use smartphones.

[1723] "Government transportation services" are transportation support services for the elderly provided by government agencies.

[1724] A "personalized shopping assistant" is an assistant that supports shopping based on the user's individual preferences and needs.

[1725] "Survey results" are the results of questions answered by users, and are data used to understand individual preferences and awareness levels.

[1726] "Adjusting parameters" means changing the settings of the generating AI according to the user's individual preferences and cognitive level.

[1727] A "personalized response" is a specific response generated based on a user's individual preferences and cognitive level.

[1728] The system for implementing this invention provides a conversation partner service for the elderly using generative AI and text-to-speech technology. The system operates among three parties: a server, a terminal, and a user.

[1729] The server uses generative AI to generate natural language responses based on user input. The generative AI adjusts parameters based on the results of the user's questionnaire and generates individually customized responses. This makes it possible to provide personalized information according to the elderly person's cognitive level and preferences.

[1730] The terminal is a device such as a smartphone or tablet that provides an interface for users to answer the questionnaire. The generated responses are output as audio using text-to-speech technology, allowing elderly people to converse by voice without having to operate the terminal.

[1731] Users use a terminal in a physical store to answer a survey. The survey results are sent to a server, and the generative AI generates an individually customized response. For example, if a user asks, "I'm looking for healthy foods," the generative AI will respond as follows:

[1732] Example prompt sentence:

[1733] Hello, user! What products are you looking for today?

[1734] Your topics of interest are health and travel.

[1735] The speaking speed is set to slow.

[1736] User Input: Looking for healthy foods

[1737] Example of a response from the generating AI:

[1738] User, you're looking for healthy foods. Some recommendations include organic vegetables and fruits, whole wheat bread, and low-fat yogurt, which are great for maintaining good health. We can also recommend some healthy snacks that are easy to carry when traveling.

[1739] In this way, the server uses generative AI to generate responses based on the user's individual preferences and cognitive level, and the device outputs the responses as voice, making it possible to provide elderly people with a stress-free and satisfying shopping experience when shopping in physical stores.

[1740] The hardware used is a smartphone or tablet, and the software uses Python and the OpenAI API. The generative AI is accessed through the OpenAI API, and the text-to-speech technology uses the device's on-board voice synthesis engine.

[1741] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1742] Step 1:

[1743] The user answers the questionnaire using the terminal.

[1744] Input: User's survey responses (name, age, favorite topics, speaking speed, etc.)

[1745] Output: Survey result data

[1746] Specific operation: The user answers the questionnaire through the device interface. The device collects the answers as data and sends them to the server.

[1747] Step 2:

[1748] The server receives the survey results and adjusts the parameters of the generative AI.

[1749] Input: Survey result data

[1750] Output: Adjusted generative AI parameters

[1751] Specific operation: The server analyzes the survey results and adjusts the parameters of the generative AI according to the user's cognitive level and preferences, such as the speaking speed and the language used.

[1752] Step 3:

[1753] The user uses the terminal to enter a question.

[1754] Input: User's question (in text format)

[1755] Output: User question data

[1756] Specific operation: The user inputs a question through the terminal interface, and the terminal collects this question as data and sends it to the server.

[1757] Step 4:

[1758] The server uses generative AI to generate responses to users' questions.

[1759] Input: User question data, adjusted generative AI parameters

[1760] Output: Generated response (in text format)

[1761] Specific operation: The server uses generative AI to generate a natural language response based on the user's question and adjusted parameters. For example, if a user asks, "I'm looking for healthy foods," the generative AI will generate an appropriate response.

[1762] Step 5:

[1763] The server sends the generated response to the terminal.

[1764] Input: Generated response (in text format)

[1765] Output: Response data sent to the terminal

[1766] Specific operation: The server sends the generated response to the terminal, which receives the data.

[1767] Step 6:

[1768] The device will output the response as audio using Text to Speech technology.

[1769] Input: Generated response data (text format)

[1770] Output: Audio output

[1771] Specific operation: The device converts the received response data into audio using text-to-speech technology and provides a voice response to the user, such as "Recommended products include organic vegetables and fruits, whole wheat bread, and low-fat yogurt."

[1772] Through these steps, when elderly people shop in physical stores, it will be possible to provide them with personalized information according to their level of awareness and preferences, providing them with a stress-free and satisfying shopping experience.

[1773] Example 3

[1774] Next, a third embodiment of the third embodiment will be described. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1775] There is a demand for a system that allows elderly people to enjoy conversations that suit their cognitive level and preferences. However, with conventional systems, it is difficult to generate conversation content that suits the cognitive level and preferences of the elderly, and the operation is complicated, making it difficult for elderly people to use without stress. Furthermore, there is a lack of technology to output the conversation content as audio, which has been a problem in that elderly people cannot actually enjoy the conversation.

[1776] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1777] In this invention, the server includes a means for a user to input information about the elderly person, a means for the server to collect and store the input information, a means for the server to send a prompt to the generative AI model, a means for the generative AI model to generate conversation content, a means for the server to send the generated conversation content to TTS technology, a means for the TTS technology to convert the conversation content into speech, and a means for the terminal to play back the generated speech, thereby enabling the elderly person to enjoy conversations tailored to their cognitive level and preferences without stress.

[1778] "User" refers to a person who uses the system to input information about an elderly person.

[1779] "Server" refers to a device or system that collects and stores information entered by users and sends prompts to the generative AI model.

[1780] "Generative AI model" refers to an artificial intelligence model that generates conversation content based on prompt text.

[1781] A "prompt" is a piece of text that contains instructions for a generative AI model to generate conversational content.

[1782] "TTS technology" is an abbreviation for Text to Speech technology, and refers to the technology of converting text-based conversation content into voice.

[1783] "Terminal" refers to a device or system that plays back the generated audio.

[1784] "Elderly" refers to older people who can enjoy conversations through the system.

[1785] "Cognitive level" refers to an indicator that shows the state of cognitive function in the elderly.

[1786] "Preferences" refers to topics and concerns that interest older people.

[1787] "Conversational content" refers to the textual information generated by the generative AI model based on the prompt.

[1788] This invention is a system that uses generative AI and Text to Speech (TTS) technology to generate conversation content tailored to the cognitive level and preferences of elderly people and output it as voice. Specific embodiments of this system are described below.

[1789] Hardware and software used

[1790] This system uses the following hardware and software:

[1791] Server: A central processing unit for collecting and storing information about seniors and sending prompts to the generative AI model.

[1792] Device: A device used by an older adult to play back the generated audio, such as a smartphone or tablet.

[1793] Generative AI model: An artificial intelligence model that generates conversational content based on a prompt. Examples include OpenAI's GPT-4.

[1794] TTS technology: Text to speech technology that converts text-based conversation content into audio. Specifically, Google Cloud Text-to-Speech is one example.

[1795] Data processing and calculation

[1796] The server collects the elderly person's information entered by the user and stores it in a database. The server then generates prompt text based on the stored information and sends it to the generative AI model. The generative AI model generates conversation content based on the prompt text and returns the content to the server. The server then sends the generated conversation content to the TTS technology, which converts it into speech. Finally, the device plays the generated speech to the elderly person.

[1797] Specific examples

[1798] The user opens the application and enters the elderly person's information: "Name: Tanaka, Interests: Music, History, Cognitive Level: Medium." The server stores this information in a database and sends a prompt, "Tanaka is interested in music and history. Please talk to him about recent music trends and historical events." to the generative AI model. The generative AI model generates conversation content such as "Talk about artists popular among young people as recent music trends, and famous battles from the Warring States period as historical events." The server sends this content to the TTS technology, which converts it into speech. Finally, the device plays the generated speech to Tanaka, who can enjoy an interesting conversation.

[1799] In this way, the system provides an appropriate conversation experience for elderly people through cooperation between the server, the terminal, and the user. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1800] Step 1:

[1801] The user enters the senior's information.

[1802] Users input the elderly person's cognitive level and preferences (e.g., topics of interest, favorite music genres, etc.) through a dedicated application or web interface. This input data becomes the basis for the system to generate conversation content appropriate for the elderly. The input information is sent to the server in the form of name, interests, cognitive level, etc.

[1803] Step 2:

[1804] The server collects and stores the information you enter.

[1805] The server receives the information of the elderly sent by the user and stores it in the database. This data will be used in subsequent processing. Specifically, the server performs an INSERT operation on the database to store the entered information. The input is information from the user, and the output is the information stored in the database.

[1806] Step 3:

[1807] The server sends a prompt to the generative AI model.

[1808] The server generates a prompt based on the stored information about the elderly person. For example, it generates a prompt such as, "Mr. Tanaka is interested in music and history. Please talk to him about recent music trends and historical events." This prompt is sent to a generative AI model. The input is the elderly person's information obtained from the database, and the output is the generated prompt.

[1809] Step 4:

[1810] A generative AI model generates the conversation content.

[1811] A generative AI model (e.g., OpenAI's GPT-4) generates appropriate conversational content based on the received prompt. The generated conversational content is returned to the server in text format. The input is the prompt, and the output is the generated conversational content.

[1812] Step 5:

[1813] The server sends the generated conversation to the TTS technology.

[1814] The server receives the speech returned by the generative AI model and sends it to a Text to Speech (TTS) technology (e.g., Google Cloud Text-to-Speech). The input is the generated speech, and the output is the text data sent to the TTS technology.

[1815] Step 6:

[1816] TTS technology converts conversations into audio.

[1817] TTS technology converts received text-based conversation content into voice data, which is then returned to the server. The input is text-based conversation content, and the output is voice data.

[1818] Step 7:

[1819] The device plays the generated audio.

[1820] The device plays back the voice data received from the server. Through this voice, elderly people can enjoy conversations tailored to their preferences and cognitive level. The input is voice data, and the output is the played-back voice.

[1821] (Application example 3)

[1822] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1823] When elderly people shop or use services at physical stores, they often experience stress and inconvenience due to a lack of appropriate guidance and support tailored to their cognitive level and preferences. Communication with store staff can also be difficult, making it difficult for elderly people to comfortably use the store. Furthermore, services are not customized to meet individual needs, making it difficult for them to continue using the service.

[1824] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1825] In this invention, the server includes: a means for providing a conversation partner service for the elderly using generative AI and text-to-speech technology; a means for promoting cognitive function through conversation and sharing of memories; a means for initially utilizing smartphone classes and government transportation services to simply converse by voice without the need to operate a device; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to enable stress-free use and expected continuity; a means for providing guidance and product explanations to enable the elderly to comfortably shop and use services in physical stores; and a means for generating conversation content based on the elderly's preferences and cognitive level and supporting communication with store staff, thereby enabling the elderly to comfortably shop and use services in physical stores.

[1826] "Generative AI" is an artificial intelligence technology that generates conversation content based on the cognitive level and preferences of elderly people.

[1827] "Text to Speech technology" is a technology that converts generated text data into voice data.

[1828] The "Elderly Conversation Partner Service" utilizes generative AI and text-to-speech technology to promote cognitive function for the elderly through conversation and sharing of memories.

[1829] A "smartphone class" is a class where elderly people can learn the basic operations of smartphones.

[1830] "Government transportation services" are means of transportation provided to elderly people when they use government services.

[1831] "Individual customization" means adjusting the settings of generative AI according to the cognitive level and preferences of the elderly person.

[1832] A "physical store" is a store that exists in a physical location and where customers visit in person to purchase products or services.

[1833] "Guidelines and product descriptions" are information provided to seniors to help them shop and use services comfortably in physical stores.

[1834] "Communication support with store staff" is support for elderly people to communicate smoothly with staff in physical stores.

[1835] This invention is a system that uses generative AI and text-to-speech technology to provide a companion service for the elderly. The system provides guidance and product explanations to help seniors shop and use services in brick-and-mortar stores more comfortably, and supports communication with store staff.

[1836] System configuration

[1837] The system consists of the following main components:

[1838] 1. Generative AI: Artificial intelligence technology that generates conversation content based on the cognitive level and preferences of the elderly.

[1839] 2. Text to Speech technology: Technology that converts generated text data into voice data.

[1840] 3. Smartphone: A device held by the elderly that runs generative AI and text-to-speech technology.

[1841] 4. Server: Hosts the generative AI model and generates conversation content based on prompts.

[1842] Program processing

[1843] The server performs the following steps:

[1844] 1. Prompt generation: Generate prompts based on the elderly person's preferences and cognitive level. For example, generate a prompt such as "Generate a conversation based on the elderly person's preferences: music and cooking, and cognitive level: moderate."

[1845] 2. Conversation generation: Use generative AI (e.g., OpenAI's GPT-3) to generate conversation content based on the prompt.

[1846] 3. Audio generation: The generated conversation is converted into an audio file using the Google Cloud Text-to-Speech API.

[1847] 4. Play audio: Play the generated audio file on your smartphone.

[1848] Hardware and software used

[1849] Hardware: Smartphone

[1850] Software: OpenAI GPT-3 API, Google Cloud Text-to-Speech API, Python

[1851] Specific examples

[1852] For example, when shopping in a brick-and-mortar store, seniors generate prompts like:

[1853] Generate conversational content based on the preferences of an elderly person: music and cooking, cognitive level: moderate.

[1854] This prompt is sent to the server, and the generative AI generates the conversation content. For example, the generated conversation content might be, "A new music album has arrived today. I can also introduce you to some cooking recipes." This text is converted into audio using the Google Cloud Text-to-Speech API and played on the smartphone.

[1855] This will enable elderly people to comfortably shop and use services in physical stores, and will also enable smooth communication with store staff.

[1856] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1857] Step 1:

[1858] The user starts up the smartphone, opens the application, and enters information about the user's preferences and cognitive level, which is then sent to the server.

[1859] Input: User preferences (e.g., music and cooking), cognitive level (e.g., intermediate)

[1860] Output: Data needed to generate the prompt sent to the server

[1861] Step 2:

[1862] The server generates prompts based on the received user preferences and cognitive level, and sends the generated prompts to the generative AI.

[1863] Input: Data about user preferences and cognitive level

[1864] Output: A prompt sent to the generative AI (e.g., "Generate a conversation based on an elderly person's preferences for music and cooking and their cognitive level: moderate.")

[1865] Step 3:

[1866] The generative AI generates conversation content based on the prompt sentence, and the generated conversation content is returned to the server.

[1867] Input: prompt statement

[1868] Output: Generated conversation (e.g., "A new music album arrived today. I can also share some cooking recipes with you.")

[1869] Step 4:

[1870] The server sends the generated conversation content to the Google Cloud Text-to-Speech API to generate audio data, which is then returned to the server.

[1871] Input: Generated conversation

[1872] Output: Audio data (e.g. audio file)

[1873] Step 5:

[1874] The server transmits the generated voice data to the smartphone, which then plays the received voice data.

[1875] Input: Audio data

[1876] Output: Audio played on smartphone

[1877] Step 6:

[1878] Users listen to the audio played on their smartphones, shop in stores, use services, and request additional information or support if needed.

[1879] Input: Audio played from smartphone

[1880] Output: User behavior (e.g., searching for a product, asking a store staff member a question)

[1881] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1882] "Example 1"

[1883] One embodiment of the present invention is a system that incorporates an emotion engine. This system recognizes a user's emotions and adjusts the conversation content of the generative AI and the voice output of the text-to-speech technology according to those emotions. Specifically, when the user is feeling happy, the generative AI provides cheerful topics and the text-to-speech technology outputs voice in a bright tone. Conversely, when the user is feeling sad, the generative AI provides comforting words and the text-to-speech technology outputs voice in a gentle tone. This improves adaptability to the user's emotions and enables a more natural conversation experience.

[1884] "Example 2"

[1885] The emotion engine can also track changes in a user's emotions over time. This allows it to understand the user's emotional patterns and optimize the generative AI's conversational content and text-to-speech technology's voice output accordingly. For example, if a user tends to feel sad in the evening each day, the system can adjust the generative AI to provide comforting words at that time of day.

[1886] "Example 3"

[1887] Furthermore, the emotion engine can learn and improve the system's response to the user's emotions. This is achieved by analyzing how the user's emotions change depending on the system's response and adjusting the system's response based on the results. For example, if the system responds to a user's sadness in a specific way and the user's sadness is reduced, the system learns that the response was effective. This allows the system to learn more appropriate responses to the user's emotions over time, improving the user experience.

[1888] The processing flow of each embodiment will be described below.

[1889] "Example 1"

[1890] Step 1: The emotion engine recognizes the user's emotions through conversation with the user.

[1891] Step 2: Generative AI adjusts the conversation content based on the emotions recognized by the emotion engine.

[1892] Step 3: At the same time, the Text to Speech technology adjusts the tone of the voice output based on the emotion recognized by the emotion engine.

[1893] "Example 2"

[1894] Step 1: Through conversation with the user, the emotion engine recognizes the user's emotions and tracks changes in those emotions over time.

[1895] Step 2: The emotion engine analyzes the tracked emotion patterns and optimizes the generative AI conversation content and the voice output of the text-to-speech technology accordingly.

[1896] "Example 3"

[1897] Step 1: The emotion engine recognizes the user's emotions through conversation with the user.

[1898] Step 2: The system responds to the user's emotions, and the emotion engine analyzes how the response affected the user's emotions.

[1899] Step 3: Based on the analysis results of the emotion engine, the system adjusts its responses and learns.

[1900] Example 1

[1901] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1902] Elderly people often feel lonely in their daily lives, which can lead to cognitive decline and increased mental stress. Furthermore, digital devices are often difficult to use due to technical difficulties. Furthermore, it is difficult to respond to the emotions and preferences of individual elderly people, and general conversation systems cannot provide satisfactory services.

[1903] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1904] In this invention, the server includes: a means for providing a conversation partner service for seniors using generative AI and speech synthesis technology; a means for promoting cognitive function through conversation and memory sharing; a means for initial use using mobile information terminal classrooms and public services, whereby conversations can be conducted simply by voice without the need for device operation; a means for confirming cognitive level and preferences at the time of introduction and individually customizing the generative AI to ensure stress-free use and ensure continued use; and a means for recognizing the user's emotions and adjusting the conversation content of the generative AI and the voice output of the speech synthesis technology according to those emotions. This prevents seniors from feeling lonely, prevents cognitive decline, and reduces mental stress. Furthermore, no technical operation is required, and responses can be made to each senior's emotions and preferences.

[1905] "Generative AI" is an artificial intelligence technology that generates responses in natural language based on user input.

[1906] "Speech synthesis technology" is a technology that converts text data into voice data and outputs it as natural voice.

[1907] The "Elderly Conversation Service" is a service that promotes cognitive function and provides mental support through conversation, so that elderly people do not feel lonely.

[1908] A "Mobile Information Device Classroom" is a classroom where students learn how to operate mobile information devices such as smartphones and tablets.

[1909] "Public services" are services such as transportation assistance and life support provided by government agencies and public organizations.

[1910] The "cognitive level" is an index that indicates the state of the user's cognitive function.

[1911] "Individual customization" refers to adjusting system settings and responses based on the user's cognitive level and preferences.

[1912] "Emotion recognition" is a technology that analyzes a user's emotions from their voice, facial expressions, etc., and identifies their state.

[1913] "Conversation content" is text data generated by generative AI for dialogue with the user.

[1914] "Audio output" refers to the reproduction of audio data generated using speech synthesis technology through speakers or the like.

[1915] MODE FOR CARRYING OUT THE INVENTION

[1916] This invention is a system that provides a conversation partner service for the elderly, utilizing generative AI and voice synthesis technology. This system can be easily implemented by users using smartphone classes and public ...

Claims

1. A system for providing a conversation partner service utilizing generation AI and voice synthesis technology, A means for enhancing a user's cognitive function through sharing of conversations and / or memories; A means for individually customizing the generating AI by setting the user's cognitive level and preferences; means for collecting emotion data of the user and tracking changes in the emotion data over time; A means for adjusting the conversation content generated by the generation AI based on the tracked emotion data; A means for outputting the conversation content generated by the voice synthesis technology as voice; A system including:

2. The adjusting means adjusts the conversation content using the generation AI based on a prompt sentence corresponding to the emotion data. The system of claim 1 .

3. A means for providing at least one of a guide and a product description for the user to make a purchase; A means for supporting communication between the user and store staff, The system of claim 1 .

Images