system

Abstract

We provide the system. [Solution] A means of outputting notifications from a communication device based on a schedule, A method for generating natural language text using a generative model, The aforementioned communication device includes means for receiving information input from a user, A means of sharing the received information with a designated third party, A means of receiving information from a third party and displaying it to the user, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern society, due to the declining birthrate and aging population and people's busy lifestyles, interpersonal communication has become scarce, and as a result, the number of people suffering from loneliness is increasing. Since this problem also has an adverse effect on mental health, it is required that people be connected on a daily basis to improve their well-being. Conventional communication tools do not provide a sufficient solution to this problem, so a new system that can provide a natural and continuous connection is needed.

Means for Solving the Problems

[0005] This invention introduces a notification function based on a schedule from a communication device, prompting users to check their physical condition and mood on a daily basis. It utilizes a generative model to generate natural language text, creating a natural flow that prompts the user for input. Furthermore, it facilitates communication by securely sharing user input with third parties and receiving and displaying information from those third parties. Encryption is used during information sharing to ensure security and privacy. As a result, users can achieve mental well-being while maintaining daily connections with others.

[0006] A "communication device" is an electronic device equipped with the function of sending and receiving data and information, and is used to communicate with other devices over a network.

[0007] A "schedule" is a plan or management method for systematically executing related activities or processes by setting specific times or dates.

[0008] A "generative model" is an algorithm or system that uses artificial intelligence technology to generate natural language or make predictions based on specific conditions or data.

[0009] "Natural language" refers to the language that humans use on a daily basis, and is used to convey meaning in writing and conversation.

[0010] "Input" refers to the act or process by which a user provides information to a system, and is one of the means of collecting data.

[0011] The term "third party" refers to any person or group other than the main parties involved in a particular communication or data sharing context.

[0012] "Encryption" is a technology that transforms the content of data using a specific algorithm so that only those with legitimate authority can understand its contents.

[0013] "Privacy" is the right or state of protecting an individual's information and activities from unjust infringement by external forces, and is an important concept for protecting individual dignity. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined.

Embodiments for Carrying Out the Invention

[0015] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] This invention is a system that utilizes communication devices and generative models, providing users with a means to maintain connections with others on a daily basis. Therefore, it operates in cooperation with three parties: the server, the terminal, and the user.

[0036] Server Role

[0037] The server functions as a central system that comprehensively manages information across the entire system. Based on user configuration information, the server checks daily schedules and sends notifications to each user. It also uses generative models to generate messages constructed in natural language, asking users about their health and feelings. Furthermore, it manages the process of receiving user input data and sharing it appropriately with designated third parties. For example, at 8 AM, the server generates a message such as "How are you feeling today?" and sends a notification to the user's device.

[0038] Terminal role

[0039] The terminal is a device that provides an interface for users to receive notifications from a server and input their physical condition and feelings accordingly. The terminal is responsible for the communication function that sends user input to the server, and also plays a role in displaying shared information from others that has been sent from the server to the user. For example, if a user inputs "I'm feeling fine today," that information is sent to the server through the terminal, and that information is also delivered to the terminals of family members.

[0040] User behavior

[0041] Users receive daily notifications from their devices and input their feelings and physical condition with simple operations. Through this regular input, an environment is created where users can naturally share their status with each other. The aim is to promote communication among users and reduce feelings of loneliness. For example, when a friend sees what a user has entered and sends a reply, daily interaction is created.

[0042] This system prioritizes security, applying encryption technology when sharing data to protect user privacy. This allows it to function as a reliable communication tool.

[0043] The following describes the processing flow.

[0044] Step 1:

[0045] The server checks the user's configuration information and determines the time to send notifications according to the schedule. Based on each user's schedule information, it determines the appropriate notification time.

[0046] Step 2:

[0047] The server uses a generative model to generate natural language messages. For example, it constructs a message such as "How are you doing today?" and prepares it as a notification.

[0048] Step 3:

[0049] The server sends a notification containing the generated message to the user's device at the specified time. This notification is set to appear at the time specified by the user.

[0050] Step 4:

[0051] The device receives notifications from the server and displays the message and input interface on the user's screen. It also uses sound and vibration to notify the user.

[0052] Step 5:

[0053] The user uses the input interface displayed on the device to enter text about their physical condition and feelings for the day. For example, they might enter, "I'm a little tired today."

[0054] Step 6:

[0055] The terminal sends the data entered by the user to the server. This data transmission uses protocols to ensure reliable and fast communication.

[0056] Step 7:

[0057] The server shares the received user data with a specified list of third parties. The information is encrypted before being sent to the recipient devices.

[0058] Step 8:

[0059] A third-party device receives information sent from the server and displays it to the user. The received content is displayed naturally in a way that respects privacy.

[0060] Step 9:

[0061] Users can view information from other users and send replies or comments if necessary. This action is also sent to the server via the device and shared.

[0062] (Example 1)

[0063] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0064] The weakening of communication and the increase in feelings of loneliness in modern society are particularly pronounced among the elderly and individuals who work remotely. This invention aims to provide a means to naturally promote daily interaction and alleviate the weakening of communication and feelings of loneliness.

[0065] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0066] In this invention, the server includes means for using a computing device that outputs notifications based on a schedule, means for generating natural language text using a generative model, and means for receiving information input from a user to the computing device. This makes it possible for users to easily communicate with others on a daily basis and deepen their interactions naturally.

[0067] A "computing system" is a system of hardware and software components used for processing and managing data.

[0068] A "generative model" is a machine learning model that automatically generates natural language text and content based on input data.

[0069] "Natural language text" refers to text messages and documents written in the language that humans use on a daily basis.

[0070] "User" refers to a person who operates or uses this system.

[0071] A "notification" is information sent to inform a user of a specific event or message.

[0072] "Encryption" is a technical method used to protect information from being deciphered by third parties.

[0073] This invention is a system that utilizes a computing device and a generative model to facilitate communication between users. This system operates through the coordinated efforts of three parties: a server, a terminal, and the users.

[0074] The server plays a central role in integrating and managing information across the entire system. Based on user settings, the server checks the daily schedule and outputs notifications at specified times. For example, it generates the prompt message "How are you feeling today?" and sends it to the user. A generative AI model is used to create natural language sentences and provide appropriate messages to the user.

[0075] The terminal receives notifications from the server and functions as an interface for users to input their physical condition and feelings in response. The terminal is also important as a communication device that transmits user input to the server. Furthermore, the terminal displays shared information from other users received from the server.

[0076] Users receive daily notifications from their devices and can easily input their feelings and physical condition, allowing them to share their status with other users. This regular input is expected to naturally encourage information exchange and deepen interactions among users.

[0077] The system also encrypts information when it is shared, ensuring data protection. This allows users to exchange personal data with peace of mind. The server properly processes the input information and encrypts and transmits information that should be shared with others.

[0078] In this way, this system can support reliable communication among users, thereby reducing feelings of loneliness and promoting daily interaction.

[0079] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0080] Step 1:

[0081] The server receives the user's initial settings information. This input includes the user's schedule and notification time preferences. The server stores this information in a database for use in subsequent processes. Specifically, if a user sets their preferences to "receive notifications every morning at 8:00," that information is stored.

[0082] Step 2:

[0083] The server generates natural language messages using a generative AI model at a specified time. It is given schedule information and a prompt for the message to be generated as input. For example, it might generate a prompt such as "How are you feeling today?". The output is the message sent to the user.

[0084] Step 3:

[0085] The server sends the generated message to the user's device. The output is the message displayed as a notification on the device. The device receives this message and notifies the user by displaying an alert on the screen.

[0086] Step 4:

[0087] The user enters a response to a message through the terminal's interface. The input is a short text about feelings or physical condition. Specific input such as "I'm feeling good today" is expected. The terminal prepares this input for processing in the next step.

[0088] Step 5:

[0089] The terminal sends user input to the server. Ensuring that the input data is encoded before it reaches the server, the server analyzes this information to determine which data should be shared with others.

[0090] Step 6:

[0091] The server encrypts and transmits user input to third parties as needed. Information is only transmitted to others if the user has specified "share information." For example, if family members are specified, the input data is encrypted and sent to the family member's device, and then displayed after decryption.

[0092] Step 7:

[0093] The device receives information from others shared on the server. The device displays the received data, allowing the user to take additional actions accordingly. It is also expected that new conversations will be initiated by the display of comments from third parties.

[0094] (Application Example 1)

[0095] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0096] The challenge lies in providing a means for the elderly and those requiring health management to effectively manage their health information on a daily basis and to safely share it with relevant parties. Furthermore, it is necessary to promote the regular collection and communication of health information while protecting privacy.

[0097] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0098] In this invention, the server includes means for outputting schedule-based notifications from a communication device, means for generating natural language text using a generative model, and means for securely transmitting health information of the elderly to caregivers or family members. This makes it possible to easily manage and securely share the health information of the elderly with relevant parties.

[0099] A "communication device" is a device that outputs notifications to the user based on a schedule.

[0100] A "generative model" is an algorithm that uses natural language processing to generate the necessary text for user interaction.

[0101] A "user" refers to an individual who operates a system and inputs information.

[0102] A "third party" is someone who shares information received from the user, and in this context, this mainly includes caregivers and family members.

[0103] "Encryption" is a technology that transforms data according to specific procedures in order to ensure the confidentiality of information.

[0104] "Health information" refers to data about the physical and mental condition of elderly people and others who require health management.

[0105] This system efficiently collects and shares health information for the elderly and individuals requiring health management. It primarily consists of three components: a server, terminals, and users.

[0106] The server is the central management unit at the core of the system. Based on schedule information, it periodically sends notifications to user terminals. It also uses generative models to generate messages in natural language to check on the user's health and mood. These messages are sent, for example, every morning in the form of "Please tell us how you are feeling today." The server also plays a role in encrypting the information received from users and securely sharing it with third parties.

[0107] The device provides a user interface that allows users to receive notifications from the server and intuitively input health information. The data entered by the user is sent from the device to the server. The received information is then transmitted to a designated third party, and the device also has communication functions that allow it to display feedback from family members or caregivers to the user.

[0108] Through this system, users can easily manage their health status daily and communicate with others based on the information they enter. This helps reduce feelings of loneliness and enables quick responses in emergencies.

[0109] The entire system operates on communication devices such as smartphones and tablets, and uses programming languages ​​such as Python and Java (registered trademark) as its platform. Generative AI models and cryptography libraries are used for natural language processing and encryption, respectively.

[0110] A concrete example is a scenario where a server sends a notification to the user's terminal at 8 AM saying, "Good morning. How are you feeling today?" The system then receives user input, encrypts the response "I'm feeling fine today," and securely transmits it to the relevant parties.

[0111] Another example of sending prompt messages to a generative AI model is sending a notification to the user saying, "Please tell us how you are feeling today," allowing the AI ​​to autonomously check the user's health status.

[0112] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0113] Step 1:

[0114] The server sends notifications to terminals based on a pre-configured schedule. It receives schedule information as input and generates and sends a natural language message as output, such as "Good morning. How are you feeling today?", using a generative model. Here, a generative AI model is used to generate a message based on a prompt.

[0115] Step 2:

[0116] The device displays notifications received from the server to the user. It uses the received message as input and displays the message on the user interface as output. Specifically, a pop-up notification appears on the smartphone screen.

[0117] Step 3:

[0118] The user enters their health information on the device. The system receives health status messages, such as "I'm feeling well today," as input and prepares that data as output. Specifically, this involves the user entering information into the app's text field and pressing a submit button.

[0119] Step 4:

[0120] The terminal sends health information entered by the user to the server. It receives the user's health information as input, encrypts that information as output, and securely transfers it to the server. Here, the data is encrypted using a cryptography library.

[0121] Step 5:

[0122] The server decrypts encrypted health information received from the terminal and transmits it to a third party. It receives encrypted user health information as input and shares appropriately decrypted data with caregivers and family members as output. Specifically, it performs the operation of securely transmitting data based on the contact information of a designated third party.

[0123] Step 6:

[0124] The third-party terminal verifies the user's health information received from the server and prepares to send feedback to the user as needed. It receives decoded health information as input and prepares to generate a feedback message as output. Specifically, this involves the third party creating a message based on the verified information and sending it from the terminal.

[0125] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0126] This invention aims to improve the user's mental well-being in a communication system that incorporates emotion recognition technology. The emotion engine recognizes emotions from the user's input information and realizes natural language communication that reflects the results.

[0127] Server Role

[0128] The server manages the entire communication device network and sends messages to user terminals based on notification timing. In conjunction with the generative model, it generates specified messages, and the emotion engine analyzes user input. For example, if a user inputs "I'm a little tired today," the emotion engine detects the emotion "tired," and the generative model proposes a considerate response accordingly.

[0129] Terminal role

[0130] The terminal displays messages from the server to the user and provides an interface for the user to input emotions and states. Once the user has finished inputting, the information is sent to the server. The terminal displays the results of the emotion engine's analysis in a way that the user can visually confirm, and can, for example, provide support information if the user is feeling anxious.

[0131] User behavior

[0132] Users receive notifications via their devices throughout their daily lives and input their emotions and physical condition through the interface. The input information is analyzed by an emotion engine. Users can interact and share information based on the information they receive from others and the advice based on the emotion analysis results. For example, if a user writes "I'm very happy today," the emotion engine recognizes the emotion of joy and can send a positive message based on this to other users.

[0133] This system's processes include information encryption to protect users' emotions and privacy. Leveraging emotion recognition technology in digital communication enables deeper connections and promotes community health.

[0134] The following describes the processing flow.

[0135] Step 1:

[0136] The server schedules notification times based on the user's registration information. At the set time, it uses a generative model to create natural language messages and prepares messages that prompt for sentiment input.

[0137] Step 2:

[0138] The server sends a prepared message to the user's terminal. For example, it might display a message such as, "Good morning. How are you feeling today?"

[0139] Step 3:

[0140] The terminal notifies the user of a message sent from the server and displays an input interface on the screen. The user checks the notification and enters their current feelings or physical condition in text.

[0141] Step 4:

[0142] The user enters their feelings or state of mind into the input field on the device. For example, they might type "I feel a little anxious today" and then press the send button.

[0143] Step 5:

[0144] The terminal sends the data entered by the user to the server. The transmitted data is encrypted to securely protect its contents.

[0145] Step 6:

[0146] The server passes the received data to the emotion engine, which analyzes the user's emotions from the input text. Based on the analysis results, it assigns an emotion label.

[0147] Step 7:

[0148] The server processes data, including emotion labels, using a generative model to prepare appropriate responses and action suggestions tailored to the user's state. For example, if anxiety is detected, it generates an encouraging message.

[0149] Step 8:

[0150] The server shares the analyzed emotions and generated messages with a designated third party. For example, it might inform family members of the user's "anxiety" and send a message seeking their support.

[0151] Step 9:

[0152] The third-party terminal displays information received from the server to the user. The received information is displayed visually, allowing the user to take the necessary actions.

[0153] Step 10:

[0154] Users can facilitate smooth communication by reviewing replies and suggestions from third parties and taking additional responses or actions based on them.

[0155] (Example 2)

[0156] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0157] In today's information society, users need to appropriately express their emotions and states amidst a diverse flow of information, and seek support and communication that reflects these needs. However, current communication systems struggle to accurately analyze users' emotions and provide appropriate responses based on them. Furthermore, there is a need for technology that enables smooth communication while protecting user privacy.

[0158] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0159] In this invention, the server includes means for incorporating an emotion analysis engine for analyzing emotional states, means for sending instructions to a generative artificial intelligence model based on the analysis results and creating prompts for generating responses, means for dynamically adjusting natural language messages to facilitate user input, and means for protecting privacy through encryption. This enables smooth communication while protecting the privacy of information and providing responses that are adapted to the user's emotions.

[0160] "Communication equipment" refers to devices and systems for transmitting and receiving information, and plays a role in exchanging data between users.

[0161] "Generative artificial intelligence" is a technology that learns from large amounts of data and automatically generates documents and responses in natural language.

[0162] An "information processing device" refers to a device or system that receives input from a user, processes the data, and transmits it.

[0163] An "emotion analysis engine" is software that analyzes and recognizes emotions and psychological states from input data such as user text.

[0164] A "prompt" refers to a sentence or parameter used to instruct a generative artificial intelligence to generate a specific response.

[0165] "Encryption" is a technology that converts information into a format that cannot be understood by third parties in order to maintain the confidentiality of the data, and its purpose is to protect privacy.

[0166] "Privacy protection" refers to efforts to protect personal information from being disclosed without consent and to ensure that user data is processed securely.

[0167] The embodiments for carrying out this invention are shown below.

[0168] The server is equipped with an emotion analysis engine to analyze user input information received through communication devices. This engine uses natural language processing technology to detect user emotions from text data and has the ability to classify emotional states such as "joy," "sadness," "anxiety," and "anger." The analysis results are automatically sent to a generative AI model, which creates prompt sentences to generate an appropriate response. For example, if a user inputs "I'm a little tired today," an instruction such as "The user is feeling tired. Please generate an encouraging message" is sent to the generative AI model.

[0169] The terminal visually displays response messages from the server to the user. The terminal is equipped with an input interface, allowing users to easily input their emotions and state of mind. This enables users to express their feelings and receive support and dialogue based on those expressions. Furthermore, the terminal exchanges information via an encrypted communication channel, protecting user privacy.

[0170] Users can enrich their daily lives and improve their mental well-being by freely inputting their emotions and states through the device's interface. For example, if a user inputs "I had a lot of good things happen today," the system will generate a positive response such as "That's wonderful! Days like that are special," providing the user with an opportunity to share their joy.

[0171] This system utilizes a generated AI model and prompt text in daily interactions to enable communication that is tailored to the user's emotions, thereby fostering deeper relationships.

[0172] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0173] Step 1:

[0174] The user inputs their emotions and state of mind through the terminal's interface. This input is sent to the terminal as text data. The terminal receives this text data and prepares it to send the content directly to the server. The input can be a free-form text describing the emotions the user is feeling.

[0175] Step 2:

[0176] The terminal encrypts user input data and securely transmits it to the server. The terminal uses TLS (Transport Layer Security) to encrypt the data, protecting it from eavesdropping and tampering. The output is encrypted text data sent to the server.

[0177] Step 3:

[0178] The server decrypts the encrypted data received from the terminal and extracts the plaintext data. Next, the sentiment analysis engine installed on the server analyzes this text data to identify the emotions the user is experiencing. For data processing, natural language processing techniques are used to calculate sentiment scores for words and phrases, and then an overall emotional state is determined. The output is data indicating the user's emotional state.

[0179] Step 4:

[0180] The server sends a prompt to the generative AI model based on the sentiment analysis results. The prompt includes specific instructions such as, "The user is feeling tired. Generate an encouraging message." Based on this prompt, the generative AI model creates a response in natural language. The output is an appropriate response message corresponding to the user's emotion.

[0181] Step 5:

[0182] The generated message is sent from the server to the terminal. The terminal decodes the received data to display the message to the user. Next, the message is visually displayed on the terminal's interface to convey the information to the user. The output is a customized message displayed according to the user's mood.

[0183] Step 6:

[0184] Users can provide feedback on messages received on their device. This feedback creates a loop that returns to step 1 as further emotional input. This input can include responses to messages or descriptions of new emotions.

[0185] (Application Example 2)

[0186] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0187] In modern society, improving an individual's mental well-being requires accurately recognizing their emotions and communicating accordingly. Conventional technologies have limited means of fully understanding an individual's emotions and providing appropriate support information. Therefore, effectively realizing support based on emotion recognition is a challenge.

[0188] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0189] In this invention, the server includes a device that outputs notifications based on a timetable from a communication device, a device that generates natural language text using a generative model, a device that receives data input from an individual to the communication device, a device that analyzes the individual's emotions using environmental recognition units, and a device that provides support information based on the analyzed emotions. This enables effective communication and support tailored to the individual's emotions.

[0190] A "communication device" is a device that enables the transmission and reception of information. This device functions as an interface with the user and plays a role in managing digital information.

[0191] "Timetable-based notifications" is a function that delivers information to individual devices according to a pre-set schedule. This allows users to receive reminders and messages at the necessary times.

[0192] A "generative model" is an algorithm that automatically creates natural language text based on user input data. It generates appropriate documents and information according to user requests.

[0193] "Individual" refers to a person or animal that uses the system. It is the entity that performs emotion recognition and data input.

[0194] An "environmental recognition unit" is a technology that analyzes the surrounding environment of an individual and recognizes various states, including emotions. This makes it possible to determine the psychological state of an individual.

[0195] "Emotional analysis" is the process of identifying an individual's emotions from input data. This allows us to infer what kind of mood the individual is currently in.

[0196] "Support information" refers to advice and support information provided to individuals based on the results of emotion analysis. It is used to promote the well-being of individuals.

[0197] This invention is a communication system for improving the mental well-being of users. This system analyzes an individual's emotions using communication devices, generative models, and environmental recognition units, and provides supportive information based on that analysis.

[0198] The server manages time-based notifications from communication devices and generates natural language text using generative models. This allows for the delivery of reminders and messages to users at the appropriate time. This process uses emotion recognition AI models, such as Google® Cloud Natural Language API, to analyze user input data and identify emotions.

[0199] The terminal receives data entered by the user and analyzes it using environmental recognition units. Based on the analyzed emotional data, the terminal dynamically generates support information for the user. This enables the provision of advice and suggestions tailored to the user's psychological state.

[0200] As a concrete example, if a robot used in a home recognizes a child's statement, "I'm a little scared of school today," the robot analyzes the emotion of anxiety and immediately responds with a message like, "It's okay, do your best!" while also playing soothing music. In this way, the individual's mental well-being is improved.

[0201] An example of a prompt would be, "Recognize the emotion from the text entered by the user and generate a corresponding positive message." This prompt allows the generative model to automatically provide the optimal response.

[0202] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0203] Step 1:

[0204] The device receives voice input from the user. This input includes utterances and text data that indicate the user's emotions. The device performs initial processing on this data, converting it from speech to text, and then prepares it for emotion analysis.

[0205] Step 2:

[0206] The server receives text data sent from the terminal. The received text data is input into an emotion recognition AI model (e.g., Google Cloud Natural Language API) to analyze the individual's emotions. Using the modeled algorithm, labels such as "joy," "anxiety," and "fatigue" are output as emotion data.

[0207] Step 3:

[0208] Based on the analysis results, the server utilizes a generative AI model to generate appropriate natural language messages. For each input sentiment label, the AI ​​selects the optimal response message using prompts and prepares the resulting text message.

[0209] Step 4:

[0210] The server generates a message and sends it to the terminal. The terminal receives this message and displays it to the user as audio or text. In addition, based on the analyzed emotions, it outputs additional support information, such as relaxing music, as multimedia as needed.

[0211] Step 5:

[0212] Review messages and support information received from the user's device. This feedback may be used again as user input in subsequent interactions, helping to support the user's mental well-being.

[0213] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0214] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0215] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0216] [Second Embodiment]

[0217] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0218] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0219] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0220] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0221] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0222] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0223] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0224] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0225] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0226] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0227] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0228] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0229] This invention is a system that utilizes communication devices and generative models, providing users with a means to maintain connections with others on a daily basis. Therefore, it operates in cooperation with three parties: the server, the terminal, and the user.

[0230] Server Role

[0231] The server functions as a central system that comprehensively manages information across the entire system. Based on user configuration information, the server checks daily schedules and sends notifications to each user. It also uses generative models to generate messages constructed in natural language, asking users about their health and feelings. Furthermore, it manages the process of receiving user input data and sharing it appropriately with designated third parties. For example, at 8 AM, the server generates a message such as "How are you feeling today?" and sends a notification to the user's device.

[0232] Terminal role

[0233] The terminal is a device that provides an interface for users to receive notifications from a server and input their physical condition and feelings accordingly. The terminal is responsible for the communication function that sends user input to the server, and also plays a role in displaying shared information from others that has been sent from the server to the user. For example, if a user inputs "I'm feeling fine today," that information is sent to the server through the terminal, and that information is also delivered to the terminals of family members.

[0234] User behavior

[0235] Users receive daily notifications from their devices and input their feelings and physical condition with simple operations. Through this regular input, an environment is created where users can naturally share their status with each other. The aim is to promote communication among users and reduce feelings of loneliness. For example, when a friend sees what a user has entered and sends a reply, daily interaction is created.

[0236] This system prioritizes security, applying encryption technology when sharing data to protect user privacy. This allows it to function as a reliable communication tool.

[0237] The following describes the processing flow.

[0238] Step 1:

[0239] The server checks the user's configuration information and determines the time to send notifications according to the schedule. Based on each user's schedule information, it determines the appropriate notification time.

[0240] Step 2:

[0241] The server uses a generative model to generate natural language messages. For example, it constructs a message such as "How are you doing today?" and prepares it as a notification.

[0242] Step 3:

[0243] The server sends a notification containing the generated message to the user's device at the specified time. This notification is set to appear at the time specified by the user.

[0244] Step 4:

[0245] The device receives notifications from the server and displays the message and input interface on the user's screen. It also uses sound and vibration to notify the user.

[0246] Step 5:

[0247] The user uses the input interface displayed on the device to enter text about their physical condition and feelings for the day. For example, they might enter, "I'm a little tired today."

[0248] Step 6:

[0249] The terminal sends the data entered by the user to the server. This data transmission uses protocols to ensure reliable and fast communication.

[0250] Step 7:

[0251] The server shares the received user data with a specified list of third parties. The information is encrypted before being sent to the recipient devices.

[0252] Step 8:

[0253] A third-party device receives information sent from the server and displays it to the user. The received content is displayed naturally in a way that respects privacy.

[0254] Step 9:

[0255] Users can view information from other users and send replies or comments if necessary. This action is also sent to the server via the device and shared.

[0256] (Example 1)

[0257] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0258] The weakening of communication and the increase in feelings of loneliness in modern society are particularly pronounced among the elderly and individuals who work remotely. This invention aims to provide a means to naturally promote daily interaction and alleviate the weakening of communication and feelings of loneliness.

[0259] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0260] In this invention, the server includes means for using a computing device that outputs notifications based on a schedule, means for generating natural language text using a generative model, and means for receiving information input from a user to the computing device. This makes it possible for users to easily communicate with others on a daily basis and deepen their interactions naturally.

[0261] A "computing system" is a system of hardware and software components used for processing and managing data.

[0262] A "generative model" is a machine learning model that automatically generates natural language text and content based on input data.

[0263] "Natural language text" refers to text messages and documents written in the language that humans use on a daily basis.

[0264] "User" refers to a person who operates or uses this system.

[0265] A "notification" is information sent to inform a user of a specific event or message.

[0266] "Encryption" is a technical method used to protect information from being deciphered by third parties.

[0267] This invention is a system that utilizes a computing device and a generative model to facilitate communication between users. This system operates through the coordinated efforts of three parties: a server, a terminal, and the users.

[0268] The server plays a central role in integrating and managing information across the entire system. Based on user settings, the server checks the daily schedule and outputs notifications at specified times. For example, it generates the prompt message "How are you feeling today?" and sends it to the user. A generative AI model is used to create natural language sentences and provide appropriate messages to the user.

[0269] The terminal receives notifications from the server and functions as an interface for users to input their physical condition and feelings in response. The terminal is also important as a communication device that transmits user input to the server. Furthermore, the terminal displays shared information from other users received from the server.

[0270] Users receive daily notifications from their devices and can easily input their feelings and physical condition, allowing them to share their status with other users. This regular input is expected to naturally encourage information exchange and deepen interactions among users.

[0271] The system also encrypts information when it is shared, ensuring data protection. This allows users to exchange personal data with peace of mind. The server properly processes the input information and encrypts and transmits information that should be shared with others.

[0272] In this way, this system can support reliable communication among users, thereby reducing feelings of loneliness and promoting daily interaction.

[0273] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0274] Step 1:

[0275] The server receives the user's initial settings information. This input includes the user's schedule and notification time preferences. The server stores this information in a database for use in subsequent processes. Specifically, if a user sets their preferences to "receive notifications every morning at 8:00," that information is stored.

[0276] Step 2:

[0277] The server generates natural language messages using a generative AI model at a specified time. It is given schedule information and a prompt for the message to be generated as input. For example, it might generate a prompt such as "How are you feeling today?". The output is the message sent to the user.

[0278] Step 3:

[0279] The server sends the generated message to the user's terminal. The output is the message displayed as a notification on the terminal. The terminal receives this and performs an operation to notify the user of the message by issuing an alert on the screen.

[0280] Step 4:

[0281] The user inputs a response to the message through the terminal interface. The input is a short text regarding mood or physical condition. Specific inputs such as "I'm in a good mood today" are assumed. The terminal prepares this input for processing in the next step.

[0282] Step 5:

[0283] The terminal sends the user's input to the server. At this time, the encoded input data is made to reach the server. The server analyzes this information and determines which data should be shared with others.

[0284] Step 6:

[0285] The server encrypts and sends the input information from the user to a third party if necessary. The information is sent to others only when it is specified to "share the information". For example, if family is set, the input data is encrypted and sent to the family's terminal and is displayed after decryption.

[0286] Step 7:

[0287] The terminal receives the information of others shared from the server. The terminal displays the received data and enables the user to take additional actions accordingly. It is also expected that a new conversation will be started when comments from a third party are displayed.

[0288] (Application Example 1)

[0289] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0290] The challenge lies in providing a means for the elderly and those requiring health management to effectively manage their health information on a daily basis and to safely share it with relevant parties. Furthermore, it is necessary to promote the regular collection and communication of health information while protecting privacy.

[0291] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0292] In this invention, the server includes means for outputting schedule-based notifications from a communication device, means for generating natural language text using a generative model, and means for securely transmitting health information of the elderly to caregivers or family members. This makes it possible to easily manage and securely share the health information of the elderly with relevant parties.

[0293] A "communication device" is a device that outputs notifications to the user based on a schedule.

[0294] A "generative model" is an algorithm that uses natural language processing to generate the necessary text for user interaction.

[0295] A "user" refers to an individual who operates a system and inputs information.

[0296] A "third party" is someone who shares information received from the user, and in this context, this mainly includes caregivers and family members.

[0297] "Encryption" is a technology that transforms data according to specific procedures in order to ensure the confidentiality of information.

[0298] "Health information" refers to data about the physical and mental condition of elderly people and others who require health management.

[0299] This system efficiently collects and shares health information for the elderly and individuals requiring health management. It primarily consists of three components: a server, terminals, and users.

[0300] The server is the central management unit at the core of the system. Based on schedule information, it periodically sends notifications to user terminals. It also uses generative models to generate messages in natural language to check on the user's health and mood. These messages are sent, for example, every morning in the form of "Please tell us how you are feeling today." The server also plays a role in encrypting the information received from users and securely sharing it with third parties.

[0301] The device provides a user interface that allows users to receive notifications from the server and intuitively input health information. The data entered by the user is sent from the device to the server. The received information is then transmitted to a designated third party, and the device also has communication functions that allow it to display feedback from family members or caregivers to the user.

[0302] Through this system, users can easily manage their health status daily and communicate with others based on the information they enter. This helps reduce feelings of loneliness and enables quick responses in emergencies.

[0303] The entire system operates on communication devices such as smartphones and tablets, and uses programming languages ​​such as Python and Java as its platform. Generative AI models and cryptography libraries are used for natural language processing and encryption, respectively.

[0304] A concrete example is a scenario where a server sends a notification to the user's terminal at 8 AM saying, "Good morning. How are you feeling today?" The system then receives user input, encrypts the response "I'm feeling fine today," and securely transmits it to the relevant parties.

[0305] In addition, as an example of transmitting a prompt sentence to the generative AI model, there is a case where a notification such as "Please tell me about my condition today." is sent to the user to autonomously check the health status.

[0306] The flow of the specific process in Application Example 1 will be described using FIG. 12.

[0307] Step 1:

[0308] The server sends a notification to the terminal based on a preset schedule. It receives schedule information as input, and uses a generation model to create and send a natural language message such as "Good morning. How are you feeling today?" as output. Here, message generation based on the prompt sentence is performed using the generative AI model.

[0309] Step 2:

[0310] The terminal displays the notification received from the server to the user. It uses the received message as input and displays the message on the user interface as output. As a specific operation, a pop-up notification is displayed on the screen of the smartphone.

[0311] Step 3:

[0312] The user inputs their health information on the terminal. It receives a health status message such as "I'm feeling well today." as input and prepares the data as output. Specifically, it includes the operation where the user inputs information into the text field of the app and presses the send button.

[0313] Step 4:

[0314] The terminal sends health information entered by the user to the server. It receives the user's health information as input, encrypts that information as output, and securely transfers it to the server. Here, the data is encrypted using a cryptography library.

[0315] Step 5:

[0316] The server decrypts encrypted health information received from the terminal and transmits it to a third party. It receives encrypted user health information as input and shares appropriately decrypted data with caregivers and family members as output. Specifically, it performs the operation of securely transmitting data based on the contact information of a designated third party.

[0317] Step 6:

[0318] The third-party terminal verifies the user's health information received from the server and prepares to send feedback to the user as needed. It receives decoded health information as input and prepares to generate a feedback message as output. Specifically, this involves the third party creating a message based on the verified information and sending it from the terminal.

[0319] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0320] This invention aims to improve the user's mental well-being in a communication system that incorporates emotion recognition technology. The emotion engine recognizes emotions from the user's input information and realizes natural language communication that reflects the results.

[0321] Server Role

[0322] The server manages the entire communication device network and sends messages to user terminals based on notification timing. In conjunction with the generative model, it generates specified messages, and the emotion engine analyzes user input. For example, if a user inputs "I'm a little tired today," the emotion engine detects the emotion "tired," and the generative model proposes a considerate response accordingly.

[0323] Terminal role

[0324] The terminal displays messages from the server to the user and provides an interface for the user to input emotions and states. Once the user has finished inputting, the information is sent to the server. The terminal displays the results of the emotion engine's analysis in a way that the user can visually confirm, and can, for example, provide support information if the user is feeling anxious.

[0325] User behavior

[0326] Users receive notifications via their devices throughout their daily lives and input their emotions and physical condition through the interface. The input information is analyzed by an emotion engine. Users can interact and share information based on the information they receive from others and the advice based on the emotion analysis results. For example, if a user writes "I'm very happy today," the emotion engine recognizes the emotion of joy and can send a positive message based on this to other users.

[0327] This system's processes include information encryption to protect users' emotions and privacy. Leveraging emotion recognition technology in digital communication enables deeper connections and promotes community health.

[0328] The following describes the processing flow.

[0329] Step 1:

[0330] The server schedules notification times based on the user's registration information. At the set time, it uses a generative model to create natural language messages and prepares messages that prompt for sentiment input.

[0331] Step 2:

[0332] The server sends a prepared message to the user's terminal. For example, it might display a message such as, "Good morning. How are you feeling today?"

[0333] Step 3:

[0334] The terminal notifies the user of a message sent from the server and displays an input interface on the screen. The user checks the notification and enters their current feelings or physical condition in text.

[0335] Step 4:

[0336] The user enters their feelings or state of mind into the input field on the device. For example, they might type "I feel a little anxious today" and then press the send button.

[0337] Step 5:

[0338] The terminal sends the data entered by the user to the server. The transmitted data is encrypted to securely protect its contents.

[0339] Step 6:

[0340] The server passes the received data to the emotion engine, which analyzes the user's emotions from the input text. Based on the analysis results, it assigns an emotion label.

[0341] Step 7:

[0342] The server processes data, including emotion labels, using a generative model to prepare appropriate responses and action suggestions tailored to the user's state. For example, if anxiety is detected, it generates an encouraging message.

[0343] Step 8:

[0344] The server shares the analyzed emotions and generated messages with a designated third party. For example, it might inform family members of the user's "anxiety" and send a message seeking their support.

[0345] Step 9:

[0346] The third-party terminal displays information received from the server to the user. The received information is displayed visually, allowing the user to take the necessary actions.

[0347] Step 10:

[0348] Users can facilitate smooth communication by reviewing replies and suggestions from third parties and taking additional responses or actions based on them.

[0349] (Example 2)

[0350] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0351] In today's information society, users need to appropriately express their emotions and states amidst a diverse flow of information, and seek support and communication that reflects these needs. However, current communication systems struggle to accurately analyze users' emotions and provide appropriate responses based on them. Furthermore, there is a need for technology that enables smooth communication while protecting user privacy.

[0352] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0353] In this invention, the server includes means for incorporating an emotion analysis engine for analyzing emotional states, means for sending instructions to a generative artificial intelligence model based on the analysis results and creating prompts for generating responses, means for dynamically adjusting natural language messages to facilitate user input, and means for protecting privacy through encryption. This enables smooth communication while protecting the privacy of information and providing responses that are adapted to the user's emotions.

[0354] "Communication equipment" refers to devices and systems for transmitting and receiving information, and plays a role in exchanging data between users.

[0355] "Generative artificial intelligence" is a technology that learns from large amounts of data and automatically generates documents and responses in natural language.

[0356] An "information processing device" refers to a device or system that receives input from a user, processes the data, and transmits it.

[0357] An "emotion analysis engine" is software that analyzes and recognizes emotions and psychological states from input data such as user text.

[0358] A "prompt" refers to a sentence or parameter used to instruct a generative artificial intelligence to generate a specific response.

[0359] "Encryption" is a technology that converts information into a format that cannot be understood by third parties in order to maintain the confidentiality of the data, and its purpose is to protect privacy.

[0360] "Privacy protection" refers to efforts to protect personal information from being disclosed without consent and to ensure that user data is processed securely.

[0361] The embodiments for carrying out this invention are shown below.

[0362] The server is equipped with an emotion analysis engine to analyze user input information received through communication devices. This engine uses natural language processing technology to detect user emotions from text data and has the ability to classify emotional states such as "joy," "sadness," "anxiety," and "anger." The analysis results are automatically sent to a generative AI model, which creates prompt sentences to generate an appropriate response. For example, if a user inputs "I'm a little tired today," an instruction such as "The user is feeling tired. Please generate an encouraging message" is sent to the generative AI model.

[0363] The terminal visually displays response messages from the server to the user. The terminal is equipped with an input interface, allowing users to easily input their emotions and state of mind. This enables users to express their feelings and receive support and dialogue based on those expressions. Furthermore, the terminal exchanges information via an encrypted communication channel, protecting user privacy.

[0364] Users can enrich their daily lives and improve their mental well-being by freely inputting their emotions and states through the device's interface. For example, if a user inputs "I had a lot of good things happen today," the system will generate a positive response such as "That's wonderful! Days like that are special," providing the user with an opportunity to share their joy.

[0365] This system utilizes a generated AI model and prompt text in daily interactions to enable communication that is tailored to the user's emotions, thereby fostering deeper relationships.

[0366] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0367] Step 1:

[0368] The user inputs their emotions and state of mind through the terminal's interface. This input is sent to the terminal as text data. The terminal receives this text data and prepares it to send the content directly to the server. The input can be a free-form text describing the emotions the user is feeling.

[0369] Step 2:

[0370] The terminal encrypts user input data and securely transmits it to the server. The terminal uses TLS (Transport Layer Security) to encrypt the data, protecting it from eavesdropping and tampering. The output is encrypted text data sent to the server.

[0371] Step 3:

[0372] The server decrypts the encrypted data received from the terminal and extracts the plaintext data. Next, the sentiment analysis engine installed on the server analyzes this text data to identify the emotions the user is experiencing. For data processing, natural language processing techniques are used to calculate sentiment scores for words and phrases, and then an overall emotional state is determined. The output is data indicating the user's emotional state.

[0373] Step 4:

[0374] The server sends a prompt to the generative AI model based on the sentiment analysis results. The prompt includes specific instructions such as, "The user is feeling tired. Generate an encouraging message." Based on this prompt, the generative AI model creates a response in natural language. The output is an appropriate response message corresponding to the user's emotion.

[0375] Step 5:

[0376] The generated message is sent from the server to the terminal. The terminal decodes the received data to display the message to the user. Next, the message is visually displayed on the terminal's interface to convey the information to the user. The output is a customized message displayed according to the user's mood.

[0377] Step 6:

[0378] Users can provide feedback on messages received on their device. This feedback creates a loop that returns to step 1 as further emotional input. This input can include responses to messages or descriptions of new emotions.

[0379] (Application Example 2)

[0380] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0381] In modern society, improving an individual's mental well-being requires accurately recognizing their emotions and communicating accordingly. Conventional technologies have limited means of fully understanding an individual's emotions and providing appropriate support information. Therefore, effectively realizing support based on emotion recognition is a challenge.

[0382] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0383] In this invention, the server includes a device that outputs notifications based on a timetable from a communication device, a device that generates natural language text using a generative model, a device that receives data input from an individual to the communication device, a device that analyzes the individual's emotions using environmental recognition units, and a device that provides support information based on the analyzed emotions. This enables effective communication and support tailored to the individual's emotions.

[0384] A "communication device" is a device that enables the transmission and reception of information. This device functions as an interface with the user and plays a role in managing digital information.

[0385] "Timetable-based notifications" is a function that delivers information to individual devices according to a pre-set schedule. This allows users to receive reminders and messages at the necessary times.

[0386] A "generative model" is an algorithm that automatically creates natural language text based on user input data. It generates appropriate documents and information according to user requests.

[0387] "Individual" refers to a person or animal that uses the system. It is the entity that performs emotion recognition and data input.

[0388] An "environmental recognition unit" is a technology that analyzes the surrounding environment of an individual and recognizes various states, including emotions. This makes it possible to determine the psychological state of an individual.

[0389] "Emotional analysis" is the process of identifying an individual's emotions from input data. This allows us to infer what kind of mood the individual is currently in.

[0390] "Support information" refers to advice and support information provided to individuals based on the results of emotion analysis. It is used to promote the well-being of individuals.

[0391] This invention is a communication system for improving the mental well-being of users. This system analyzes an individual's emotions using communication devices, generative models, and environmental recognition units, and provides supportive information based on that analysis.

[0392] The server manages time-based notifications from communication devices and generates natural language text using generative models. This allows for the delivery of reminders and messages to users at the appropriate time. This process uses emotion recognition AI models, such as the Google Cloud Natural Language API, to analyze user input data and identify emotions.

[0393] The terminal receives data entered by the user and analyzes it using environmental recognition units. Based on the analyzed emotional data, the terminal dynamically generates support information for the user. This enables the provision of advice and suggestions tailored to the user's psychological state.

[0394] As a concrete example, if a robot used in a home recognizes a child's statement, "I'm a little scared of school today," the robot analyzes the emotion of anxiety and immediately responds with a message like, "It's okay, do your best!" while also playing soothing music. In this way, the individual's mental well-being is improved.

[0395] An example of a prompt would be, "Recognize the emotion from the text entered by the user and generate a corresponding positive message." This prompt allows the generative model to automatically provide the optimal response.

[0396] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0397] Step 1:

[0398] The device receives voice input from the user. This input includes utterances and text data that indicate the user's emotions. The device performs initial processing on this data, converting it from speech to text, and then prepares it for emotion analysis.

[0399] Step 2:

[0400] The server receives text data sent from the terminal. The received text data is input into an emotion recognition AI model (e.g., Google Cloud Natural Language API) to analyze the individual's emotions. Using the modeled algorithm, labels such as "joy," "anxiety," and "fatigue" are output as emotion data.

[0401] Step 3:

[0402] Based on the analysis results, the server utilizes a generative AI model to generate appropriate natural language messages. For each input sentiment label, the AI ​​selects the optimal response message using prompts and prepares the resulting text message.

[0403] Step 4:

[0404] The server generates a message and sends it to the terminal. The terminal receives this message and displays it to the user as audio or text. In addition, based on the analyzed emotions, it outputs additional support information, such as relaxing music, as multimedia as needed.

[0405] Step 5:

[0406] Review messages and support information received from the user's device. This feedback may be used again as user input in subsequent interactions, helping to support the user's mental well-being.

[0407] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0408] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0409] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0410] [Third Embodiment]

[0411] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0412] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0413] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0414] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0415] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0416] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0417] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0418] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0419] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0420] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0421] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0422] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0423] This invention is a system that utilizes communication devices and generative models, providing users with a means to maintain connections with others on a daily basis. Therefore, it operates in cooperation with three parties: the server, the terminal, and the user.

[0424] Server Role

[0425] The server functions as a central system that comprehensively manages information across the entire system. Based on user configuration information, the server checks daily schedules and sends notifications to each user. It also uses generative models to generate messages constructed in natural language, asking users about their health and feelings. Furthermore, it manages the process of receiving user input data and sharing it appropriately with designated third parties. For example, at 8 AM, the server generates a message such as "How are you feeling today?" and sends a notification to the user's device.

[0426] Terminal role

[0427] The terminal is a device that provides an interface for users to receive notifications from a server and input their physical condition and feelings accordingly. The terminal is responsible for the communication function that sends user input to the server, and also plays a role in displaying shared information from others that has been sent from the server to the user. For example, if a user inputs "I'm feeling fine today," that information is sent to the server through the terminal, and that information is also delivered to the terminals of family members.

[0428] User behavior

[0429] Users receive daily notifications from their devices and input their feelings and physical condition with simple operations. Through this regular input, an environment is created where users can naturally share their status with each other. The aim is to promote communication among users and reduce feelings of loneliness. For example, when a friend sees what a user has entered and sends a reply, daily interaction is created.

[0430] This system prioritizes security, applying encryption technology when sharing data to protect user privacy. This allows it to function as a reliable communication tool.

[0431] The following describes the processing flow.

[0432] Step 1:

[0433] The server checks the user's configuration information and determines the time to send notifications according to the schedule. Based on each user's schedule information, it determines the appropriate notification time.

[0434] Step 2:

[0435] The server uses a generative model to generate natural language messages. For example, it constructs a message such as "How are you doing today?" and prepares it as a notification.

[0436] Step 3:

[0437] The server sends a notification containing the generated message to the user's device at the specified time. This notification is set to appear at the time specified by the user.

[0438] Step 4:

[0439] The device receives notifications from the server and displays the message and input interface on the user's screen. It also uses sound and vibration to notify the user.

[0440] Step 5:

[0441] The user uses the input interface displayed on the device to enter text about their physical condition and feelings for the day. For example, they might enter, "I'm a little tired today."

[0442] Step 6:

[0443] The terminal sends the data entered by the user to the server. This data transmission uses protocols to ensure reliable and fast communication.

[0444] Step 7:

[0445] The server shares the received user data with a specified list of third parties. The information is encrypted before being sent to the recipient devices.

[0446] Step 8:

[0447] A third-party device receives information sent from the server and displays it to the user. The received content is displayed naturally in a way that respects privacy.

[0448] Step 9:

[0449] Users can view information from other users and send replies or comments if necessary. This action is also sent to the server via the device and shared.

[0450] (Example 1)

[0451] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0452] The weakening of communication and the increase in feelings of loneliness in modern society are particularly pronounced among the elderly and individuals who work remotely. This invention aims to provide a means to naturally promote daily interaction and alleviate the weakening of communication and feelings of loneliness.

[0453] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0454] In this invention, the server includes means for using a computing device that outputs notifications based on a schedule, means for generating natural language text using a generative model, and means for receiving information input from a user to the computing device. This makes it possible for users to easily communicate with others on a daily basis and deepen their interactions naturally.

[0455] A "computing system" is a system of hardware and software components used for processing and managing data.

[0456] A "generative model" is a machine learning model that automatically generates natural language text and content based on input data.

[0457] "Natural language text" refers to text messages and documents written in the language that humans use on a daily basis.

[0458] "User" refers to a person who operates or uses this system.

[0459] A "notification" is information sent to inform a user of a specific event or message.

[0460] "Encryption" is a technical method used to protect information from being deciphered by third parties.

[0461] This invention is a system that utilizes a computing device and a generative model to facilitate communication between users. This system operates through the coordinated efforts of three parties: a server, a terminal, and the users.

[0462] The server plays a central role in integrating and managing information across the entire system. Based on user settings, the server checks the daily schedule and outputs notifications at specified times. For example, it generates the prompt message "How are you feeling today?" and sends it to the user. A generative AI model is used to create natural language sentences and provide appropriate messages to the user.

[0463] The terminal receives notifications from the server and functions as an interface for users to input their physical condition and feelings in response. The terminal is also important as a communication device that transmits user input to the server. Furthermore, the terminal displays shared information from other users received from the server.

[0464] Users receive daily notifications from their devices and can easily input their feelings and physical condition, allowing them to share their status with other users. This regular input is expected to naturally encourage information exchange and deepen interactions among users.

[0465] The system also encrypts information when it is shared, ensuring data protection. This allows users to exchange personal data with peace of mind. The server properly processes the input information and encrypts and transmits information that should be shared with others.

[0466] In this way, this system can support reliable communication among users, thereby reducing feelings of loneliness and promoting daily interaction.

[0467] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0468] Step 1:

[0469] The server receives the user's initial settings information. This input includes the user's schedule and notification time preferences. The server stores this information in a database for use in subsequent processes. Specifically, if a user sets their preferences to "receive notifications every morning at 8:00," that information is stored.

[0470] Step 2:

[0471] The server generates natural language messages using a generative AI model at a specified time. It is given schedule information and a prompt for the message to be generated as input. For example, it might generate a prompt such as "How are you feeling today?". The output is the message sent to the user.

[0472] Step 3:

[0473] The server sends the generated message to the user's device. The output is the message displayed as a notification on the device. The device receives this message and notifies the user by displaying an alert on the screen.

[0474] Step 4:

[0475] The user enters a response to a message through the terminal's interface. The input is a short text about feelings or physical condition. Specific input such as "I'm feeling good today" is expected. The terminal prepares this input for processing in the next step.

[0476] Step 5:

[0477] The terminal sends user input to the server. Ensuring that the input data is encoded before it reaches the server, the server analyzes this information to determine which data should be shared with others.

[0478] Step 6:

[0479] The server encrypts and transmits user input to third parties as needed. Information is only transmitted to others if the user has specified "share information." For example, if family members are specified, the input data is encrypted and sent to the family member's device, and then displayed after decryption.

[0480] Step 7:

[0481] The device receives information from others shared on the server. The device displays the received data, allowing the user to take additional actions accordingly. It is also expected that new conversations will be initiated by the display of comments from third parties.

[0482] (Application Example 1)

[0483] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0484] The challenge lies in providing a means for the elderly and those requiring health management to effectively manage their health information on a daily basis and to safely share it with relevant parties. Furthermore, it is necessary to promote the regular collection and communication of health information while protecting privacy.

[0485] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0486] In this invention, the server includes means for outputting schedule-based notifications from a communication device, means for generating natural language text using a generative model, and means for securely transmitting health information of the elderly to caregivers or family members. This makes it possible to easily manage and securely share the health information of the elderly with relevant parties.

[0487] A "communication device" is a device that outputs notifications to the user based on a schedule.

[0488] A "generative model" is an algorithm that uses natural language processing to generate the necessary text for user interaction.

[0489] A "user" refers to an individual who operates a system and inputs information.

[0490] A "third party" is someone who shares information received from the user, and in this context, this mainly includes caregivers and family members.

[0491] "Encryption" is a technology that transforms data according to specific procedures in order to ensure the confidentiality of information.

[0492] "Health information" refers to data about the physical and mental condition of elderly people and others who require health management.

[0493] This system efficiently collects and shares health information for the elderly and individuals requiring health management. It primarily consists of three components: a server, terminals, and users.

[0494] The server is the central management unit at the core of the system. Based on schedule information, it periodically sends notifications to user terminals. It also uses generative models to generate messages in natural language to check on the user's health and mood. These messages are sent, for example, every morning in the form of "Please tell us how you are feeling today." The server also plays a role in encrypting the information received from users and securely sharing it with third parties.

[0495] The device provides a user interface that allows users to receive notifications from the server and intuitively input health information. The data entered by the user is sent from the device to the server. The received information is then transmitted to a designated third party, and the device also has communication functions that allow it to display feedback from family members or caregivers to the user.

[0496] Through this system, users can easily manage their health status daily and communicate with others based on the information they enter. This helps reduce feelings of loneliness and enables quick responses in emergencies.

[0497] The entire system operates on communication devices such as smartphones and tablets, and uses programming languages ​​such as Python and Java as its platform. Generative AI models and cryptography libraries are used for natural language processing and encryption, respectively.

[0498] A concrete example is a scenario where a server sends a notification to the user's terminal at 8 AM saying, "Good morning. How are you feeling today?" The system then receives user input, encrypts the response "I'm feeling fine today," and securely transmits it to the relevant parties.

[0499] Another example of sending prompt messages to a generative AI model is sending a notification to the user saying, "Please tell us how you are feeling today," allowing the AI ​​to autonomously check the user's health status.

[0500] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0501] Step 1:

[0502] The server sends notifications to terminals based on a pre-configured schedule. It receives schedule information as input and generates and sends a natural language message as output, such as "Good morning. How are you feeling today?", using a generative model. Here, a generative AI model is used to generate a message based on a prompt.

[0503] Step 2:

[0504] The device displays notifications received from the server to the user. It uses the received message as input and displays the message on the user interface as output. Specifically, a pop-up notification appears on the smartphone screen.

[0505] Step 3:

[0506] The user enters their health information on the device. The system receives health status messages, such as "I'm feeling well today," as input and prepares that data as output. Specifically, this involves the user entering information into the app's text field and pressing a submit button.

[0507] Step 4:

[0508] The terminal sends health information entered by the user to the server. It receives the user's health information as input, encrypts that information as output, and securely transfers it to the server. Here, the data is encrypted using a cryptography library.

[0509] Step 5:

[0510] The server decrypts encrypted health information received from the terminal and transmits it to a third party. It receives encrypted user health information as input and shares appropriately decrypted data with caregivers and family members as output. Specifically, it performs the operation of securely transmitting data based on the contact information of a designated third party.

[0511] Step 6:

[0512] The third-party terminal verifies the user's health information received from the server and prepares to send feedback to the user as needed. It receives decoded health information as input and prepares to generate a feedback message as output. Specifically, this involves the third party creating a message based on the verified information and sending it from the terminal.

[0513] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0514] This invention aims to improve the user's mental well-being in a communication system that incorporates emotion recognition technology. The emotion engine recognizes emotions from the user's input information and realizes natural language communication that reflects the results.

[0515] Server Role

[0516] The server manages the entire communication device network and sends messages to user terminals based on notification timing. In conjunction with the generative model, it generates specified messages, and the emotion engine analyzes user input. For example, if a user inputs "I'm a little tired today," the emotion engine detects the emotion "tired," and the generative model proposes a considerate response accordingly.

[0517] Terminal role

[0518] The terminal displays messages from the server to the user and provides an interface for the user to input emotions and states. Once the user has finished inputting, the information is sent to the server. The terminal displays the results of the emotion engine's analysis in a way that the user can visually confirm, and can, for example, provide support information if the user is feeling anxious.

[0519] User behavior

[0520] Users receive notifications via their devices throughout their daily lives and input their emotions and physical condition through the interface. The input information is analyzed by an emotion engine. Users can interact and share information based on the information they receive from others and the advice based on the emotion analysis results. For example, if a user writes "I'm very happy today," the emotion engine recognizes the emotion of joy and can send a positive message based on this to other users.

[0521] This system's processes include information encryption to protect users' emotions and privacy. Leveraging emotion recognition technology in digital communication enables deeper connections and promotes community health.

[0522] The following describes the processing flow.

[0523] Step 1:

[0524] The server schedules notification times based on the user's registration information. At the set time, it uses a generative model to create natural language messages and prepares messages that prompt for sentiment input.

[0525] Step 2:

[0526] The server sends a prepared message to the user's terminal. For example, it might display a message such as, "Good morning. How are you feeling today?"

[0527] Step 3:

[0528] The terminal notifies the user of a message sent from the server and displays an input interface on the screen. The user checks the notification and enters their current feelings or physical condition in text.

[0529] Step 4:

[0530] The user enters their feelings or state of mind into the input field on the device. For example, they might type "I feel a little anxious today" and then press the send button.

[0531] Step 5:

[0532] The terminal sends the data entered by the user to the server. The transmitted data is encrypted to securely protect its contents.

[0533] Step 6:

[0534] The server passes the received data to the emotion engine, which analyzes the user's emotions from the input text. Based on the analysis results, it assigns an emotion label.

[0535] Step 7:

[0536] The server processes data, including emotion labels, using a generative model to prepare appropriate responses and action suggestions tailored to the user's state. For example, if anxiety is detected, it generates an encouraging message.

[0537] Step 8:

[0538] The server shares the analyzed emotions and generated messages with a designated third party. For example, it might inform family members of the user's "anxiety" and send a message seeking their support.

[0539] Step 9:

[0540] The third-party terminal displays information received from the server to the user. The received information is displayed visually, allowing the user to take the necessary actions.

[0541] Step 10:

[0542] Users can facilitate smooth communication by reviewing replies and suggestions from third parties and taking additional responses or actions based on them.

[0543] (Example 2)

[0544] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0545] In today's information society, users need to appropriately express their emotions and states amidst a diverse flow of information, and seek support and communication that reflects these needs. However, current communication systems struggle to accurately analyze users' emotions and provide appropriate responses based on them. Furthermore, there is a need for technology that enables smooth communication while protecting user privacy.

[0546] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0547] In this invention, the server includes means for incorporating an emotion analysis engine for analyzing emotional states, means for sending instructions to a generative artificial intelligence model based on the analysis results and creating prompts for generating responses, means for dynamically adjusting natural language messages to facilitate user input, and means for protecting privacy through encryption. This enables smooth communication while protecting the privacy of information and providing responses that are adapted to the user's emotions.

[0548] "Communication equipment" refers to devices and systems for transmitting and receiving information, and plays a role in exchanging data between users.

[0549] "Generative artificial intelligence" is a technology that learns from large amounts of data and automatically generates documents and responses in natural language.

[0550] An "information processing device" refers to a device or system that receives input from a user, processes the data, and transmits it.

[0551] An "emotion analysis engine" is software that analyzes and recognizes emotions and psychological states from input data such as user text.

[0552] A "prompt" refers to a sentence or parameter used to instruct a generative artificial intelligence to generate a specific response.

[0553] "Encryption" is a technology that converts information into a format that cannot be understood by third parties in order to maintain the confidentiality of the data, and its purpose is to protect privacy.

[0554] "Privacy protection" refers to efforts to protect personal information from being disclosed without consent and to ensure that user data is processed securely.

[0555] The embodiments for carrying out this invention are shown below.

[0556] The server is equipped with an emotion analysis engine to analyze user input information received through communication devices. This engine uses natural language processing technology to detect user emotions from text data and has the ability to classify emotional states such as "joy," "sadness," "anxiety," and "anger." The analysis results are automatically sent to a generative AI model, which creates prompt sentences to generate an appropriate response. For example, if a user inputs "I'm a little tired today," an instruction such as "The user is feeling tired. Please generate an encouraging message" is sent to the generative AI model.

[0557] The terminal visually displays response messages from the server to the user. The terminal is equipped with an input interface, allowing users to easily input their emotions and state of mind. This enables users to express their feelings and receive support and dialogue based on those expressions. Furthermore, the terminal exchanges information via an encrypted communication channel, protecting user privacy.

[0558] Users can enrich their daily lives and improve their mental well-being by freely inputting their emotions and states through the device's interface. For example, if a user inputs "I had a lot of good things happen today," the system will generate a positive response such as "That's wonderful! Days like that are special," providing the user with an opportunity to share their joy.

[0559] This system utilizes a generated AI model and prompt text in daily interactions to enable communication that is tailored to the user's emotions, thereby fostering deeper relationships.

[0560] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0561] Step 1:

[0562] The user inputs their emotions and state of mind through the terminal's interface. This input is sent to the terminal as text data. The terminal receives this text data and prepares it to send the content directly to the server. The input can be a free-form text describing the emotions the user is feeling.

[0563] Step 2:

[0564] The terminal encrypts user input data and securely transmits it to the server. The terminal uses TLS (Transport Layer Security) to encrypt the data, protecting it from eavesdropping and tampering. The output is encrypted text data sent to the server.

[0565] Step 3:

[0566] The server decrypts the encrypted data received from the terminal and extracts the plaintext data. Next, the sentiment analysis engine installed on the server analyzes this text data to identify the emotions the user is experiencing. For data processing, natural language processing techniques are used to calculate sentiment scores for words and phrases, and then an overall emotional state is determined. The output is data indicating the user's emotional state.

[0567] Step 4:

[0568] The server sends a prompt to the generative AI model based on the sentiment analysis results. The prompt includes specific instructions such as, "The user is feeling tired. Generate an encouraging message." Based on this prompt, the generative AI model creates a response in natural language. The output is an appropriate response message corresponding to the user's emotion.

[0569] Step 5:

[0570] The generated message is sent from the server to the terminal. The terminal decodes the received data to display the message to the user. Next, the message is visually displayed on the terminal's interface to convey the information to the user. The output is a customized message displayed according to the user's mood.

[0571] Step 6:

[0572] Users can provide feedback on messages received on their device. This feedback creates a loop that returns to step 1 as further emotional input. This input can include responses to messages or descriptions of new emotions.

[0573] (Application Example 2)

[0574] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0575] In modern society, improving an individual's mental well-being requires accurately recognizing their emotions and communicating accordingly. Conventional technologies have limited means of fully understanding an individual's emotions and providing appropriate support information. Therefore, effectively realizing support based on emotion recognition is a challenge.

[0576] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0577] In this invention, the server includes a device that outputs notifications based on a timetable from a communication device, a device that generates natural language text using a generative model, a device that receives data input from an individual to the communication device, a device that analyzes the individual's emotions using environmental recognition units, and a device that provides support information based on the analyzed emotions. This enables effective communication and support tailored to the individual's emotions.

[0578] A "communication device" is a device that enables the transmission and reception of information. This device functions as an interface with the user and plays a role in managing digital information.

[0579] "Timetable-based notifications" is a function that delivers information to individual devices according to a pre-set schedule. This allows users to receive reminders and messages at the necessary times.

[0580] A "generative model" is an algorithm that automatically creates natural language text based on user input data. It generates appropriate documents and information according to user requests.

[0581] "Individual" refers to a person or animal that uses the system. It is the entity that performs emotion recognition and data input.

[0582] An "environmental recognition unit" is a technology that analyzes the surrounding environment of an individual and recognizes various states, including emotions. This makes it possible to determine the psychological state of an individual.

[0583] "Emotional analysis" is the process of identifying an individual's emotions from input data. This allows us to infer what kind of mood the individual is currently in.

[0584] "Support information" refers to advice and support information provided to individuals based on the results of emotion analysis. It is used to promote the well-being of individuals.

[0585] This invention is a communication system for improving the mental well-being of users. This system analyzes an individual's emotions using communication devices, generative models, and environmental recognition units, and provides supportive information based on that analysis.

[0586] The server manages time-based notifications from communication devices and generates natural language text using generative models. This allows for the delivery of reminders and messages to users at the appropriate time. This process uses emotion recognition AI models, such as the Google Cloud Natural Language API, to analyze user input data and identify emotions.

[0587] The terminal receives data entered by the user and analyzes it using environmental recognition units. Based on the analyzed emotional data, the terminal dynamically generates support information for the user. This enables the provision of advice and suggestions tailored to the user's psychological state.

[0588] As a concrete example, if a robot used in a home recognizes a child's statement, "I'm a little scared of school today," the robot analyzes the emotion of anxiety and immediately responds with a message like, "It's okay, do your best!" while also playing soothing music. In this way, the individual's mental well-being is improved.

[0589] An example of a prompt would be, "Recognize the emotion from the text entered by the user and generate a corresponding positive message." This prompt allows the generative model to automatically provide the optimal response.

[0590] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0591] Step 1:

[0592] The device receives voice input from the user. This input includes utterances and text data that indicate the user's emotions. The device performs initial processing on this data, converting it from speech to text, and then prepares it for emotion analysis.

[0593] Step 2:

[0594] The server receives text data sent from the terminal. The received text data is input into an emotion recognition AI model (e.g., Google Cloud Natural Language API) to analyze the individual's emotions. Using the modeled algorithm, labels such as "joy," "anxiety," and "fatigue" are output as emotion data.

[0595] Step 3:

[0596] Based on the analysis results, the server utilizes a generative AI model to generate appropriate natural language messages. For each input sentiment label, the AI ​​selects the optimal response message using prompts and prepares the resulting text message.

[0597] Step 4:

[0598] The server generates a message and sends it to the terminal. The terminal receives this message and displays it to the user as audio or text. In addition, based on the analyzed emotions, it outputs additional support information, such as relaxing music, as multimedia as needed.

[0599] Step 5:

[0600] Review messages and support information received from the user's device. This feedback may be used again as user input in subsequent interactions, helping to support the user's mental well-being.

[0601] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0602] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0603] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0604] [Fourth Embodiment]

[0605] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0606] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0607] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0608] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0609] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0610] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0611] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0612] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0613] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0614] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0615] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0616] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0617] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0618] This invention is a system that utilizes communication devices and generative models, providing users with a means to maintain connections with others on a daily basis. Therefore, it operates in cooperation with three parties: the server, the terminal, and the user.

[0619] Server Role

[0620] The server functions as a central system that comprehensively manages information across the entire system. Based on user configuration information, the server checks daily schedules and sends notifications to each user. It also uses generative models to generate messages constructed in natural language, asking users about their health and feelings. Furthermore, it manages the process of receiving user input data and sharing it appropriately with designated third parties. For example, at 8 AM, the server generates a message such as "How are you feeling today?" and sends a notification to the user's device.

[0621] Terminal role

[0622] The terminal is a device that provides an interface for users to receive notifications from a server and input their physical condition and feelings accordingly. The terminal is responsible for the communication function that sends user input to the server, and also plays a role in displaying shared information from others that has been sent from the server to the user. For example, if a user inputs "I'm feeling fine today," that information is sent to the server through the terminal, and that information is also delivered to the terminals of family members.

[0623] User behavior

[0624] Users receive daily notifications from their devices and input their feelings and physical condition with simple operations. Through this regular input, an environment is created where users can naturally share their status with each other. The aim is to promote communication among users and reduce feelings of loneliness. For example, when a friend sees what a user has entered and sends a reply, daily interaction is created.

[0625] This system prioritizes security, applying encryption technology when sharing data to protect user privacy. This allows it to function as a reliable communication tool.

[0626] The following describes the processing flow.

[0627] Step 1:

[0628] The server checks the user's configuration information and determines the time to send notifications according to the schedule. Based on each user's schedule information, it determines the appropriate notification time.

[0629] Step 2:

[0630] The server uses a generative model to generate natural language messages. For example, it constructs a message such as "How are you doing today?" and prepares it as a notification.

[0631] Step 3:

[0632] The server sends a notification containing the generated message to the user's device at the specified time. This notification is set to appear at the time specified by the user.

[0633] Step 4:

[0634] The device receives notifications from the server and displays the message and input interface on the user's screen. It also uses sound and vibration to notify the user.

[0635] Step 5:

[0636] The user uses the input interface displayed on the device to enter text about their physical condition and feelings for the day. For example, they might enter, "I'm a little tired today."

[0637] Step 6:

[0638] The terminal sends the data entered by the user to the server. This data transmission uses protocols to ensure reliable and fast communication.

[0639] Step 7:

[0640] The server shares the received user data with a specified list of third parties. The information is encrypted before being sent to the recipient devices.

[0641] Step 8:

[0642] A third-party device receives information sent from the server and displays it to the user. The received content is displayed naturally in a way that respects privacy.

[0643] Step 9:

[0644] Users can view information from other users and send replies or comments if necessary. This action is also sent to the server via the device and shared.

[0645] (Example 1)

[0646] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0647] The weakening of communication and the increase in feelings of loneliness in modern society are particularly pronounced among the elderly and individuals who work remotely. This invention aims to provide a means to naturally promote daily interaction and alleviate the weakening of communication and feelings of loneliness.

[0648] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0649] In this invention, the server includes means for using a computing device that outputs notifications based on a schedule, means for generating natural language text using a generative model, and means for receiving information input from a user to the computing device. This makes it possible for users to easily communicate with others on a daily basis and deepen their interactions naturally.

[0650] A "computing system" is a system of hardware and software components used for processing and managing data.

[0651] A "generative model" is a machine learning model that automatically generates natural language text and content based on input data.

[0652] "Natural language text" refers to text messages and documents written in the language that humans use on a daily basis.

[0653] "User" refers to a person who operates or uses this system.

[0654] A "notification" is information sent to inform a user of a specific event or message.

[0655] "Encryption" is a technical method used to protect information from being deciphered by third parties.

[0656] This invention is a system that utilizes a computing device and a generative model to facilitate communication between users. This system operates through the coordinated efforts of three parties: a server, a terminal, and the users.

[0657] The server plays a central role in integrating and managing information across the entire system. Based on user settings, the server checks the daily schedule and outputs notifications at specified times. For example, it generates the prompt message "How are you feeling today?" and sends it to the user. A generative AI model is used to create natural language sentences and provide appropriate messages to the user.

[0658] The terminal receives notifications from the server and functions as an interface for users to input their physical condition and feelings in response. The terminal is also important as a communication device that transmits user input to the server. Furthermore, the terminal displays shared information from other users received from the server.

[0659] Users receive daily notifications from their devices and can easily input their feelings and physical condition, allowing them to share their status with other users. This regular input is expected to naturally encourage information exchange and deepen interactions among users.

[0660] The system also encrypts information when it is shared, ensuring data protection. This allows users to exchange personal data with peace of mind. The server properly processes the input information and encrypts and transmits information that should be shared with others.

[0661] In this way, this system can support reliable communication among users, thereby reducing feelings of loneliness and promoting daily interaction.

[0662] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0663] Step 1:

[0664] The server receives the user's initial settings information. This input includes the user's schedule and notification time preferences. The server stores this information in a database for use in subsequent processes. Specifically, if a user sets their preferences to "receive notifications every morning at 8:00," that information is stored.

[0665] Step 2:

[0666] The server generates natural language messages using a generative AI model at a specified time. It is given schedule information and a prompt for the message to be generated as input. For example, it might generate a prompt such as "How are you feeling today?". The output is the message sent to the user.

[0667] Step 3:

[0668] The server sends the generated message to the user's device. The output is the message displayed as a notification on the device. The device receives this message and notifies the user by displaying an alert on the screen.

[0669] Step 4:

[0670] The user enters a response to a message through the terminal's interface. The input is a short text about feelings or physical condition. Specific input such as "I'm feeling good today" is expected. The terminal prepares this input for processing in the next step.

[0671] Step 5:

[0672] The terminal sends user input to the server. Ensuring that the input data is encoded before it reaches the server, the server analyzes this information to determine which data should be shared with others.

[0673] Step 6:

[0674] The server encrypts and transmits user input to third parties as needed. Information is only transmitted to others if the user has specified "share information." For example, if family members are specified, the input data is encrypted and sent to the family member's device, and then displayed after decryption.

[0675] Step 7:

[0676] The device receives information from others shared on the server. The device displays the received data, allowing the user to take additional actions accordingly. It is also expected that new conversations will be initiated by the display of comments from third parties.

[0677] (Application Example 1)

[0678] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0679] The challenge lies in providing a means for the elderly and those requiring health management to effectively manage their health information on a daily basis and to safely share it with relevant parties. Furthermore, it is necessary to promote the regular collection and communication of health information while protecting privacy.

[0680] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0681] In this invention, the server includes means for outputting schedule-based notifications from a communication device, means for generating natural language text using a generative model, and means for securely transmitting health information of the elderly to caregivers or family members. This makes it possible to easily manage and securely share the health information of the elderly with relevant parties.

[0682] A "communication device" is a device that outputs notifications to the user based on a schedule.

[0683] A "generative model" is an algorithm that uses natural language processing to generate the necessary text for user interaction.

[0684] A "user" refers to an individual who operates a system and inputs information.

[0685] A "third party" is someone who shares information received from the user, and in this context, this mainly includes caregivers and family members.

[0686] "Encryption" is a technology that transforms data according to specific procedures in order to ensure the confidentiality of information.

[0687] "Health information" refers to data about the physical and mental condition of elderly people and others who require health management.

[0688] This system efficiently collects and shares health information for the elderly and individuals requiring health management. It primarily consists of three components: a server, terminals, and users.

[0689] The server is the central management unit at the core of the system. Based on schedule information, it periodically sends notifications to user terminals. It also uses generative models to generate messages in natural language to check on the user's health and mood. These messages are sent, for example, every morning in the form of "Please tell us how you are feeling today." The server also plays a role in encrypting the information received from users and securely sharing it with third parties.

[0690] The device provides a user interface that allows users to receive notifications from the server and intuitively input health information. The data entered by the user is sent from the device to the server. The received information is then transmitted to a designated third party, and the device also has communication functions that allow it to display feedback from family members or caregivers to the user.

[0691] Through this system, users can easily manage their health status daily and communicate with others based on the information they enter. This helps reduce feelings of loneliness and enables quick responses in emergencies.

[0692] The entire system operates on communication devices such as smartphones and tablets, and uses programming languages ​​such as Python and Java as its platform. Generative AI models and cryptography libraries are used for natural language processing and encryption, respectively.

[0693] A concrete example is a scenario where a server sends a notification to the user's terminal at 8 AM saying, "Good morning. How are you feeling today?" The system then receives user input, encrypts the response "I'm feeling fine today," and securely transmits it to the relevant parties.

[0694] Another example of sending prompt messages to a generative AI model is sending a notification to the user saying, "Please tell us how you are feeling today," allowing the AI ​​to autonomously check the user's health status.

[0695] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0696] Step 1:

[0697] The server sends notifications to terminals based on a pre-configured schedule. It receives schedule information as input and generates and sends a natural language message as output, such as "Good morning. How are you feeling today?", using a generative model. Here, a generative AI model is used to generate a message based on a prompt.

[0698] Step 2:

[0699] The device displays notifications received from the server to the user. It uses the received message as input and displays the message on the user interface as output. Specifically, a pop-up notification appears on the smartphone screen.

[0700] Step 3:

[0701] The user enters their health information on the device. The system receives health status messages, such as "I'm feeling well today," as input and prepares that data as output. Specifically, this involves the user entering information into the app's text field and pressing a submit button.

[0702] Step 4:

[0703] The terminal sends health information entered by the user to the server. It receives the user's health information as input, encrypts that information as output, and securely transfers it to the server. Here, the data is encrypted using a cryptography library.

[0704] Step 5:

[0705] The server decrypts encrypted health information received from the terminal and transmits it to a third party. It receives encrypted user health information as input and shares appropriately decrypted data with caregivers and family members as output. Specifically, it performs the operation of securely transmitting data based on the contact information of a designated third party.

[0706] Step 6:

[0707] The third-party terminal verifies the user's health information received from the server and prepares to send feedback to the user as needed. It receives decoded health information as input and prepares to generate a feedback message as output. Specifically, this involves the third party creating a message based on the verified information and sending it from the terminal.

[0708] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0709] This invention aims to improve the user's mental well-being in a communication system that incorporates emotion recognition technology. The emotion engine recognizes emotions from the user's input information and realizes natural language communication that reflects the results.

[0710] Server Role

[0711] The server manages the entire communication device network and sends messages to user terminals based on notification timing. In conjunction with the generative model, it generates specified messages, and the emotion engine analyzes user input. For example, if a user inputs "I'm a little tired today," the emotion engine detects the emotion "tired," and the generative model proposes a considerate response accordingly.

[0712] Terminal role

[0713] The terminal displays messages from the server to the user and provides an interface for the user to input emotions and states. Once the user has finished inputting, the information is sent to the server. The terminal displays the results of the emotion engine's analysis in a way that the user can visually confirm, and can, for example, provide support information if the user is feeling anxious.

[0714] User behavior

[0715] Users receive notifications via their devices throughout their daily lives and input their emotions and physical condition through the interface. The input information is analyzed by an emotion engine. Users can interact and share information based on the information they receive from others and the advice based on the emotion analysis results. For example, if a user writes "I'm very happy today," the emotion engine recognizes the emotion of joy and can send a positive message based on this to other users.

[0716] This system's processes include information encryption to protect users' emotions and privacy. Leveraging emotion recognition technology in digital communication enables deeper connections and promotes community health.

[0717] The following describes the processing flow.

[0718] Step 1:

[0719] The server schedules notification times based on the user's registration information. At the set time, it uses a generative model to create natural language messages and prepares messages that prompt for sentiment input.

[0720] Step 2:

[0721] The server sends a prepared message to the user's terminal. For example, it might display a message such as, "Good morning. How are you feeling today?"

[0722] Step 3:

[0723] The terminal notifies the user of a message sent from the server and displays an input interface on the screen. The user checks the notification and enters their current feelings or physical condition in text.

[0724] Step 4:

[0725] The user enters their feelings or state of mind into the input field on the device. For example, they might type "I feel a little anxious today" and then press the send button.

[0726] Step 5:

[0727] The terminal sends the data entered by the user to the server. The transmitted data is encrypted to securely protect its contents.

[0728] Step 6:

[0729] The server passes the received data to the emotion engine, which analyzes the user's emotions from the input text. Based on the analysis results, it assigns an emotion label.

[0730] Step 7:

[0731] The server processes data, including emotion labels, using a generative model to prepare appropriate responses and action suggestions tailored to the user's state. For example, if anxiety is detected, it generates an encouraging message.

[0732] Step 8:

[0733] The server shares the analyzed emotions and generated messages with a designated third party. For example, it might inform family members of the user's "anxiety" and send a message seeking their support.

[0734] Step 9:

[0735] The third-party terminal displays information received from the server to the user. The received information is displayed visually, allowing the user to take the necessary actions.

[0736] Step 10:

[0737] Users can facilitate smooth communication by reviewing replies and suggestions from third parties and taking additional responses or actions based on them.

[0738] (Example 2)

[0739] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0740] In today's information society, users need to appropriately express their emotions and states amidst a diverse flow of information, and seek support and communication that reflects these needs. However, current communication systems struggle to accurately analyze users' emotions and provide appropriate responses based on them. Furthermore, there is a need for technology that enables smooth communication while protecting user privacy.

[0741] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0742] In this invention, the server includes means for incorporating an emotion analysis engine for analyzing emotional states, means for sending instructions to a generative artificial intelligence model based on the analysis results and creating prompts for generating responses, means for dynamically adjusting natural language messages to facilitate user input, and means for protecting privacy through encryption. This enables smooth communication while protecting the privacy of information and providing responses that are adapted to the user's emotions.

[0743] "Communication equipment" refers to devices and systems for transmitting and receiving information, and plays a role in exchanging data between users.

[0744] "Generative artificial intelligence" is a technology that learns from large amounts of data and automatically generates documents and responses in natural language.

[0745] An "information processing device" refers to a device or system that receives input from a user, processes the data, and transmits it.

[0746] An "emotion analysis engine" is software that analyzes and recognizes emotions and psychological states from input data such as user text.

[0747] A "prompt" refers to a sentence or parameter used to instruct a generative artificial intelligence to generate a specific response.

[0748] "Encryption" is a technology that converts information into a format that cannot be understood by third parties in order to maintain the confidentiality of the data, and its purpose is to protect privacy.

[0749] "Privacy protection" refers to efforts to protect personal information from being disclosed without consent and to ensure that user data is processed securely.

[0750] The embodiments for carrying out this invention are shown below.

[0751] The server is equipped with an emotion analysis engine to analyze user input information received through communication devices. This engine uses natural language processing technology to detect user emotions from text data and has the ability to classify emotional states such as "joy," "sadness," "anxiety," and "anger." The analysis results are automatically sent to a generative AI model, which creates prompt sentences to generate an appropriate response. For example, if a user inputs "I'm a little tired today," an instruction such as "The user is feeling tired. Please generate an encouraging message" is sent to the generative AI model.

[0752] The terminal visually displays response messages from the server to the user. The terminal is equipped with an input interface, allowing users to easily input their emotions and state of mind. This enables users to express their feelings and receive support and dialogue based on those expressions. Furthermore, the terminal exchanges information via an encrypted communication channel, protecting user privacy.

[0753] Users can enrich their daily lives and improve their mental well-being by freely inputting their emotions and states through the device's interface. For example, if a user inputs "I had a lot of good things happen today," the system will generate a positive response such as "That's wonderful! Days like that are special," providing the user with an opportunity to share their joy.

[0754] This system utilizes a generated AI model and prompt text in daily interactions to enable communication that is tailored to the user's emotions, thereby fostering deeper relationships.

[0755] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0756] Step 1:

[0757] The user inputs their emotions and state of mind through the terminal's interface. This input is sent to the terminal as text data. The terminal receives this text data and prepares it to send the content directly to the server. The input can be a free-form text describing the emotions the user is feeling.

[0758] Step 2:

[0759] The terminal encrypts user input data and securely transmits it to the server. The terminal uses TLS (Transport Layer Security) to encrypt the data, protecting it from eavesdropping and tampering. The output is encrypted text data sent to the server.

[0760] Step 3:

[0761] The server decrypts the encrypted data received from the terminal and extracts the plaintext data. Next, the sentiment analysis engine installed on the server analyzes this text data to identify the emotions the user is experiencing. For data processing, natural language processing techniques are used to calculate sentiment scores for words and phrases, and then an overall emotional state is determined. The output is data indicating the user's emotional state.

[0762] Step 4:

[0763] The server sends a prompt to the generative AI model based on the sentiment analysis results. The prompt includes specific instructions such as, "The user is feeling tired. Generate an encouraging message." Based on this prompt, the generative AI model creates a response in natural language. The output is an appropriate response message corresponding to the user's emotion.

[0764] Step 5:

[0765] The generated message is sent from the server to the terminal. The terminal decodes the received data to display the message to the user. Next, the message is visually displayed on the terminal's interface to convey the information to the user. The output is a customized message displayed according to the user's mood.

[0766] Step 6:

[0767] Users can provide feedback on messages received on their device. This feedback creates a loop that returns to step 1 as further emotional input. This input can include responses to messages or descriptions of new emotions.

[0768] (Application Example 2)

[0769] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0770] In modern society, improving an individual's mental well-being requires accurately recognizing their emotions and communicating accordingly. Conventional technologies have limited means of fully understanding an individual's emotions and providing appropriate support information. Therefore, effectively realizing support based on emotion recognition is a challenge.

[0771] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0772] In this invention, the server includes a device that outputs notifications based on a timetable from a communication device, a device that generates natural language text using a generative model, a device that receives data input from an individual to the communication device, a device that analyzes the individual's emotions using environmental recognition units, and a device that provides support information based on the analyzed emotions. This enables effective communication and support tailored to the individual's emotions.

[0773] A "communication device" is a device that enables the transmission and reception of information. This device functions as an interface with the user and plays a role in managing digital information.

[0774] "Timetable-based notifications" is a function that delivers information to individual devices according to a pre-set schedule. This allows users to receive reminders and messages at the necessary times.

[0775] A "generative model" is an algorithm that automatically creates natural language text based on user input data. It generates appropriate documents and information according to user requests.

[0776] "Individual" refers to a person or animal that uses the system. It is the entity that performs emotion recognition and data input.

[0777] An "environmental recognition unit" is a technology that analyzes the surrounding environment of an individual and recognizes various states, including emotions. This makes it possible to determine the psychological state of an individual.

[0778] "Emotional analysis" is the process of identifying an individual's emotions from input data. This allows us to infer what kind of mood the individual is currently in.

[0779] "Support information" refers to advice and support information provided to individuals based on the results of emotion analysis. It is used to promote the well-being of individuals.

[0780] This invention is a communication system for improving the mental well-being of users. This system analyzes an individual's emotions using communication devices, generative models, and environmental recognition units, and provides supportive information based on that analysis.

[0781] The server manages time-based notifications from communication devices and generates natural language text using generative models. This allows for the delivery of reminders and messages to users at the appropriate time. This process uses emotion recognition AI models, such as the Google Cloud Natural Language API, to analyze user input data and identify emotions.

[0782] The terminal receives data entered by the user and analyzes it using environmental recognition units. Based on the analyzed emotional data, the terminal dynamically generates support information for the user. This enables the provision of advice and suggestions tailored to the user's psychological state.

[0783] As a concrete example, if a robot used in a home recognizes a child's statement, "I'm a little scared of school today," the robot analyzes the emotion of anxiety and immediately responds with a message like, "It's okay, do your best!" while also playing soothing music. In this way, the individual's mental well-being is improved.

[0784] An example of a prompt would be, "Recognize the emotion from the text entered by the user and generate a corresponding positive message." This prompt allows the generative model to automatically provide the optimal response.

[0785] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0786] Step 1:

[0787] The device receives voice input from the user. This input includes utterances and text data that indicate the user's emotions. The device performs initial processing on this data, converting it from speech to text, and then prepares it for emotion analysis.

[0788] Step 2:

[0789] The server receives text data sent from the terminal. The received text data is input into an emotion recognition AI model (e.g., Google Cloud Natural Language API) to analyze the individual's emotions. Using the modeled algorithm, labels such as "joy," "anxiety," and "fatigue" are output as emotion data.

[0790] Step 3:

[0791] Based on the analysis results, the server utilizes a generative AI model to generate appropriate natural language messages. For each input sentiment label, the AI ​​selects the optimal response message using prompts and prepares the resulting text message.

[0792] Step 4:

[0793] The server generates a message and sends it to the terminal. The terminal receives this message and displays it to the user as audio or text. In addition, based on the analyzed emotions, it outputs additional support information, such as relaxing music, as multimedia as needed.

[0794] Step 5:

[0795] Review messages and support information received from the user's device. This feedback may be used again as user input in subsequent interactions, helping to support the user's mental well-being.

[0796] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0797] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0798] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0799] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0800] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0801] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0802] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0803] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0804] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0805] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0806] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0807] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0808] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0809] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0810] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0811] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0812] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0813] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0814] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0815] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0816] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0817] The following is further disclosed regarding the embodiments described above.

[0818] (Claim 1)

[0819] A means of outputting notifications from a communication device based on a schedule,

[0820] A method for generating natural language text using a generative model,

[0821] The aforementioned communication device includes means for receiving information input from a user,

[0822] A means of sharing the received information with a designated third party,

[0823] A means of receiving information from a third party and displaying it to the user,

[0824] A system that includes this.

[0825] (Claim 2)

[0826] The system according to claim 1, wherein the generative model includes means for adaptively adjusting natural language to prompt user input.

[0827] (Claim 3)

[0828] The system according to claim 1, further comprising means for performing encryption processing when sharing information.

[0829] "Example 1"

[0830] (Claim 1)

[0831] A means of using a computing device that outputs notifications based on a schedule,

[0832] A method for generating natural language text using a generative model,

[0833] The aforementioned computing device includes means for receiving information input from a user,

[0834] A means of sharing received information with a designated third party,

[0835] A means of receiving information from others and displaying it to the user,

[0836] A means by which users input information through a computing device,

[0837] A means for transmitting the generated text to the user's computer,

[0838] A system that includes this.

[0839] (Claim 2)

[0840] The system according to claim 1, wherein the generative model includes means for adaptively adjusting natural language to prompt user input.

[0841] (Claim 3)

[0842] The system according to claim 1, further comprising means for performing encryption processing when sharing information.

[0843] "Application Example 1"

[0844] (Claim 1)

[0845] A means of outputting notifications from a communication device based on a schedule,

[0846] A method for generating natural language text using a generative model,

[0847] The aforementioned communication device includes means for receiving information input from a user,

[0848] A means of sharing the received information with a designated third party,

[0849] A means of receiving information from a third party and displaying it to the user,

[0850] A means of securely transmitting health information of elderly people to their caregivers or family members,

[0851] A system that includes this.

[0852] (Claim 2)

[0853] The system according to claim 1, wherein the generative model includes means for adaptively adjusting natural language to prompt user input.

[0854] (Claim 3)

[0855] The system according to claim 1, further comprising means for performing encryption processing when sharing information.

[0856] "Example 2 of combining an emotion engine"

[0857] (Claim 1)

[0858] A means of sending notifications from communication devices based on a predetermined schedule,

[0859] A means of generating natural language messages using generative artificial intelligence,

[0860] A means of receiving input from a user in an information processing device,

[0861] A means of transmitting the received information to a designated third party,

[0862] A means of receiving information from others and displaying it to the user,

[0863] An emotion analysis engine for analyzing the emotional state of users,

[0864] A means for sending instructions to a generative artificial intelligence model based on the analysis results and creating prompts to generate a response,

[0865] A means of displaying messages to the user based on the analysis results and providing additional instructions or information,

[0866] A system that includes this.

[0867] (Claim 2)

[0868] The system according to claim 1, wherein the generating artificial intelligence includes means for dynamically adjusting natural language messages to facilitate user input.

[0869] (Claim 3)

[0870] The system according to claim 1, further comprising means for encrypting information during transmission to protect user privacy.

[0871] "Application example 2 when combining with an emotional engine"

[0872] (Claim 1)

[0873] A device that outputs notifications based on a timetable from a communication device,

[0874] A device that generates natural language text using a generative model,

[0875] The aforementioned communication device includes a device for receiving data input from an individual,

[0876] A device that delivers received data to a specific third party,

[0877] A device that receives data from a third party and displays it on the individual,

[0878] A device that analyzes an individual's emotions based on environmental perception units,

[0879] A device that provides support information based on analyzed emotions,

[0880] A system that includes this.

[0881] (Claim 2)

[0882] The system according to claim 1, wherein the generative model includes a device that dynamically adjusts natural language to prompt individual input.

[0883] (Claim 3)

[0884] The system according to claim 1, further comprising a device that performs encoding processing during data delivery. [Explanation of Symbols]

[0885] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of outputting notifications from a communication device based on a schedule, A method for generating natural language text using a generative model, The aforementioned communication device includes means for receiving information input from a user, A means of sharing the received information with a designated third party, A means of receiving information from a third party and displaying it to the user, A system that includes this.

2. The system according to claim 1, wherein the generative model includes means for adaptively adjusting natural language to prompt user input.

3. The system according to claim 1, further comprising means for performing encryption processing when sharing information.

Images