Data processing apparatus, data processing method, and program

Abstract

To provide a data processing apparatus, a data processing method, and a program capable of giving advice for relieving user's feeling.SOLUTION: A data processing apparatus includes: a state recognition unit which recognizes a user's state; a feeling recognition unit which recognizes user's feeling on the basis of the user's state when the user's state satisfies a trigger condition determined in advance; a processing unit which acquires advice to the user using output of a data generation model by inputting a prompt including a result of recognizing the user's feeling and an instruction text to obtain advice for relieving the user's feeling, to the data generation model that generates a sentence according to the input data; and an output unit which outputs the acquired advice.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The technology disclosed herein relates to a data processing device, a data processing method, and a program. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including a description and related instruction sentence regarding the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-180282 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the conventional techniques leave room for improvement in providing advice to a user to control his / her emotions. [Means for solving the problem]

[0005] A first aspect of the technology disclosed herein is a data processing device comprising: a state recognition unit that recognizes a user state; an emotion recognition unit that recognizes a user's emotion based on the user state when the user state satisfies a predetermined trigger condition; a processing unit that inputs a prompt including the recognition result of the user's emotion and an instruction sentence for obtaining advice for suppressing the user's emotion into a data generation model that generates a sentence according to input data, and obtains advice for the user using an output of the data generation model; and an output unit that outputs the obtained advice.

[0006] A second aspect of the technology disclosed herein is a data processing method including: a state recognition unit recognizing a user state; an emotion recognition unit recognizing a user's emotion based on the user state when the user state satisfies a predetermined trigger condition; a processing unit inputting a prompt including a recognition result of the user's emotion and an instruction sentence for obtaining advice for suppressing the user's emotion into a data generation model that generates a sentence according to input data, and obtaining advice for the user using an output of the data generation model; and an output unit outputting the obtained advice.

[0007] A third aspect of the technology disclosed herein is a program for causing a computer to execute a process including recognizing a user state, and if the user state satisfies a predetermined trigger condition, recognizing a user's emotion based on the user state, inputting a prompt including the recognition result of the user's emotion and an instruction sentence for obtaining advice for suppressing the user's emotion into a data generation model that generates sentences according to input data, obtaining advice for the user using the output of the data generation model, and outputting the obtained advice. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a conceptual diagram illustrating an example of a configuration of a data processing system. [Diagram 2]FIG. 2 is a conceptual diagram showing an example of main functions of a data processing device and a smart device. [Figure 3A] The outline of the specific process is shown below. [Figure 3B] The outline of the specific process is shown below. [Figure 4] 2 shows a schematic functional configuration of a specific processing unit of the data processing device. [Diagram 5] 13 illustrates an example of an operational flow of a specific process performed by a data processing device. [Figure 6A] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 6B] 1 shows an emotion map onto which multiple emotions are mapped. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, an example of an embodiment of a data processing device, a data processing method, and a program according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0010] First, the terms used in the following description will be explained.

[0011] In the following embodiments, a signed processor (hereinafter simply referred to as a "processor") may be one arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be one type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (Tensor Processing Unit).

[0012] In the following embodiments, a signed RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by the processor.

[0013] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0014] In the following embodiments, a communication I / F (Interface) with a code is an interface including a communication processor and an antenna. The communication I / F controls communication between multiple computers. An example of a communication standard applied to the communication I / F is a wireless communication standard including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0015] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same idea as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0016] FIG. 1 shows an example of the configuration of a data processing system 10 according to the embodiment.

[0017] 1, the data processing system 10 includes a data processing device 12 and smart glasses 14. An example of the data processing device 12 is a server. In this embodiment, the data processing device 12 is an example of a "data processing device" according to the technology of the present disclosure, and the smart glasses 14 are an example of a "communication terminal," a "wearable terminal," and a "smart glasses" according to the technology of the present disclosure.

[0018] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0019] The smart glasses 14 include a computer 36, a microphone 38, a speaker 40, a camera 42, a heart rate sensor 43, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 38, the speaker 40, and the camera 42 are also connected to the bus 52.

[0020] The microphone 38 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 38 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 40 outputs the voice according to instructions from the processor 46.

[0021] Camera 42 is a small digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (e.g., an imaging range defined by an angle of view equivalent to the width of the field of vision of an average healthy person).

[0022] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54. The transmission and reception of various types of information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is performed in a secure state.

[0023] Fig. 2 shows an example of main functions of the data processing device 12 and the smart glasses 14. As shown in Fig. 2, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0024] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32, and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0025] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0026] In the smart glasses 14, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0027] Next, the process of the specific processing unit 290 when the data processing device 12 performs specific processing for giving advice to the user to suppress his / her emotions will be described.

[0028] The specific processing in this embodiment illuminates the user from momentary light (impulsive emotions) like a camera strobe (which emits a very strong light for an instant to brightly illuminate the subject and enable detailed expression), helping to suppress the user's emotions.

[0029] This is for people who are unable to control their emotions and who speak and act impulsively. Such users are unable to suppress the negative emotions that arise in the moment, and as a result act impulsively, hurting those around them and causing bad results.

[0030] For example, as shown in Fig. 3A, suppose that a user becomes emotional in response to an emotional event and speaks and acts without being able to control their emotions. Although the user regrets their words and actions, they do not take any action and forget about it, so that the user will again become emotional in response to an emotional event and speak and act without being able to control their emotions.

[0031] In this embodiment, as shown in FIG. 3B, when the user becomes emotional about an emotional event, advice is given on what to say and what actions to take at that time through specific processing using a data generation model. Furthermore, fundamental improvement measures are presented by analyzing the data. Furthermore, the agent AI function allows the user to set the voice of a favorite character or celebrity. Furthermore, after recognizing emotions, natural language and emotions can be stored as a set in a database and output at a later date. This can greatly contribute to supporting the user's self-awareness and emotional suppression. The ability to set the type of voice the user likes makes it superior to counseling to support emotion regulation compared to a counselor.

[0032] Specifically, the moment when the user becomes emotional is detected by the user's voice volume or heart rate, and advice is given based on the situation at that time. The user acts based on that advice. Furthermore, the identification process may store the trigger that caused the user to become emotional, as well as the words and actions and emotions that the user made in response to that trigger, and learn and propose fundamental improvement measures. In this way, by storing emotions and words and actions in a database, the counselor can grow into one that is suited to the user.

[0033] As shown in FIG. 4, the specific processing unit 290 includes a state recognition unit 292, an emotion recognition unit 294, a processing unit 296, a memory control unit 298, and an output unit 299.

[0034] The state recognition unit 292 acquires user input, biometric information, and camera images acquired by the smart glasses 14, and recognizes the user state.

[0035] Specifically, the system acquires the user's voice input received by the microphone 38 of the smart glasses 14, and recognizes the content and volume of the user's speech. It also acquires the user's biometric information received by the heart rate sensor 43 of the smart glasses 14, and recognizes the heart rate. It also acquires camera images captured by the camera 42 of the smart glasses 14, and recognizes the user's behavior.

[0036] The emotion recognition unit 294 determines whether the user state satisfies a predetermined trigger condition, and if the user state satisfies the predetermined trigger condition, recognizes the emotion of the user based on the user state by using the emotion identification model 59. Here, the trigger condition is a condition related to the biometric information of the user.

[0037] Specifically, the emotion recognition unit 294 determines whether the user's voice volume or heart rate satisfies a predetermined trigger condition, and if the user's voice volume or heart rate satisfies the predetermined trigger condition, inputs the user's remarks and user behavior into the emotion identification model 59 to recognize the user's emotion.

[0038] The processing unit 296 performs a specific process using the data generation model 58. Specifically, a prompt including a recognition result of the user's state, a recognition result of the user's emotion, and an instruction sentence for obtaining advice for suppressing the user's emotion is input to the data generation model 58, which generates a sentence according to the input data, and the advice for the user is obtained using the output of the data generation model 58.

[0039] For example, the processing unit 296 generates a prompt such as "The user has said XXXX. The user's emotion value of 'happiness' is 0, the emotion value of 'anger' is 5, the emotion value of 'sadness' is 3, and the emotion value of 'happiness' is 0. In this case, what advice can you give to the user to suppress their emotions?", inputs this into the data generation model 58, and obtains advice for the user based on the output of the data generation model 58.

[0040] The storage control unit 298 stores in the database 24 pairs of the recognition result of the user's state and the recognition result of the user's emotion.

[0041] The output unit 299 transmits the acquired advice to the smart glasses 14 and instructs the smart glasses 14 to output the advice in the type of voice preset by the user. In the smart glasses 14, the control unit 46A causes the speaker 40 to output the advice in the type of voice preset by the user. For example, the control unit 46A causes the advice to be output in the voice of a character selected by the user from among a plurality of characters prepared in advance.

[0042] The output unit 299 further outputs a pair of the recognition result of the user's state stored in the database 24 and the recognition result of the user's emotion. Specifically, the output unit 299 transmits the pair of the recognition result of the user's state stored in the database 24 and the recognition result of the user's emotion to the smart glasses 14. In the smart glasses 14, the control unit 46A causes the speaker 40 to output the pair of the recognition result of the user's state and the recognition result of the user's emotion. At this time, a fundamental improvement measure may be acquired and output using the data generation model 58. Specifically, a prompt including a pair of the recognition result of the user's state and the recognition result of the user's emotion, and an instruction text inquiring about a fundamental improvement measure for the user to control the emotion is input to the data generation model 58, and advice serving as a fundamental improvement measure is acquired based on the output of the data generation model 58, and the smart glasses 14 is instructed to output the advice to the user. In the smart glasses 14, the control unit 46A causes the speaker 40 to output the advice serving as a fundamental improvement measure.

[0043] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0044] Next, the operation of the data processing system 10 will be described with reference to FIG.

[0045] First, an example of the flow of the identification process will be described with reference to FIG. 5. The flow of the identification process shown in FIG. 5 is an example of a "data processing method" according to the technology of the present disclosure. At this time, in the smart glasses 14, the reception output process sequentially transmits the user's voice input received by the microphone 38 to the data processing device 12, and sequentially transmits the user's biological information received by the heart rate sensor 43 to the data processing device 12. In addition, in the smart glasses 14, the reception output process sequentially transmits the camera images captured by the camera 42 to the data processing device 12. In addition, the identification process is repeatedly executed.

[0046] In the identification process shown in FIG. 5, first, in step S100, the state recognition unit 292 acquires a user input, biometric information, and a camera image acquired by the smart glasses 14, and recognizes the user state.

[0047] In step S102, the emotion recognition unit 294 determines whether the user state satisfies a predetermined trigger condition. If the user state satisfies the predetermined trigger condition, the process proceeds to step S104. On the other hand, if the user state does not satisfy the predetermined trigger condition, the identification process is terminated.

[0048] In step S104, the emotion recognition unit 294 uses the emotion identification model 59 to recognize the emotion of the user based on the user state.

[0049] In step S106, the processing unit 296 generates a prompt including the recognition result of the user's state, the recognition result of the user's emotion, and an instruction sentence for obtaining advice on suppressing the user's emotion.

[0050] In step S108, the processing unit 296 inputs the generated prompt to the data generation model 58, and obtains advice for the user based on the output of the data generation model 58.

[0051] In step S110, the output unit 299 transmits the acquired advice to the smart glasses 14 and instructs the smart glasses 14 to output the advice in the type of voice preset by the user. As a result, in the smart glasses 14, the control unit 46A causes the speaker 40 to output the advice in the type of voice preset by the user.

[0052] In step S112, the storage control unit 298 stores a pair of the recognition result of the user's state and the recognition result of the user's emotion in the database 24, and ends the identification process.

[0053] As described above, the data processing device 12 recognizes the user state, and when the user state satisfies a predetermined trigger condition, recognizes the user's emotion based on the user state, inputs the recognition result of the user's emotion and a prompt including an instruction sentence for obtaining advice to suppress the user's emotion into the data generation model, obtains advice for the user using the output of the data generation model, and outputs the obtained advice. This makes it possible to provide appropriate advice for suppressing the user's emotion at an appropriate time. Therefore, it is possible to support the user in controlling his / her emotions.

[0054] Although emotions are the most important function of humans, being dominated by emotions can have a negative impact on the mental health of individuals and society. By receiving support for self-awareness and emotion regulation through the data processing system of this embodiment, people can improve their emotional control and choose more constructive actions with fewer regrets. In addition to enriching the lives of individuals in this way, by allowing people to make calm judgments and choose constructive actions, friction and conflict in society can be reduced, contributing to the realization of social harmony and development.

[0055] The emotion identification model 59 may determine the emotion of the user according to a specific mapping. Specifically, the emotion identification model 59 may determine the emotion of the user according to an emotion map (see FIG. 6A), which is a specific mapping.

[0056] FIG. 6A is a diagram showing an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive emotions are arranged. The more outside the concentric circles, the more emotions that represent states and actions that arise from a state of mind are arranged. Emotions are a concept that includes emotions and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions that occur in the brain are arranged. On the right side of the concentric circles, emotions that are generally induced by situational judgment are arranged. On the upper and lower sides of the concentric circles, emotions that are generally generated from reactions that occur in the brain and are induced by situational judgment are arranged. In addition, on the upper side of the concentric circles, emotions of "pleasure" are arranged, and on the lower side, emotions of "discomfort" are arranged. In this way, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[0057] These emotions are distributed in the 3 o'clock direction of emotion map 400 and usually fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[0058] The inside of emotion map 400 represents what is going on inside one's mind, and the outside of emotion map 400 represents behavior, so the further out on emotion map 400 you go, the more visible the emotions become (the more they are expressed in behavior).

[0059] Here, human emotions are based on various balances such as posture and blood sugar level, and when these balances are far from the ideal, it indicates an unpleasant state, and when they are close to the ideal, it indicates a pleasant state. Emotions can also be created for robots, cars, motorcycles, etc., based on various balances such as posture and battery level, so that when these balances are far from the ideal, it indicates an unpleasant state, and when they are close to the ideal, it indicates a pleasant state. The emotion map may be generated, for example, based on the emotion map of Dr. Mitsuyoshi (Research on speech emotion recognition and emotion brain physiological signal analysis system, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). On the left half of the emotion map, emotions belonging to an area called "reaction" where sensation is dominant are lined up. On the right half of the emotion map, emotions belonging to an area called "situation" where situation recognition is dominant are lined up.

[0060] The emotion map defines two emotions that promote learning. The first is the negative emotion around the middle of "repentance" or "remorse" on the situation side. In other words, this is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the positive emotion around "desire" on the response side. In other words, this is when the robot has positive feelings such as "I want more" or "I want to know more."

[0061] The emotion identification model 59 inputs the user input to a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the emotion of the user. This neural network is pre-trained based on multiple learning data that are combinations of the user input and emotion values ​​indicating each emotion shown in the emotion map 400. In addition, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 6B. FIG. 6B shows an example in which multiple emotions, "relief," "calm," and "encouraging," have similar emotion values.

[0062] In the above embodiment, the smart glasses 14 are used as an example, but the present invention is not limited to this. A communication terminal other than smart glasses may be used, for example, a smartphone may be used.

[0063] In the above embodiment, an example was given in which a specific process is performed by one computer 22, but the technology disclosed herein is not limited to this, and distributed processing of the specific process may be performed by multiple computers, including computer 22.

[0064] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable computer-readable non-transitory storage medium such as a Universal Serial Bus (USB) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[0065] In addition, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 upon request from the data processing device 12.

[0066] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[0067] As the hardware resource for executing the specific process, various processors as shown below can be used. An example of the processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing the specific process by executing software, i.e., a program. Another example of the processor is a dedicated electric circuit, which is a processor having a circuit configuration designed exclusively for executing the specific process, such as a Field-Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), or an Application Specific Integrated Circuit (ASIC). Each processor has a built-in or connected memory, and each processor executes the specific process by using the memory.

[0068] The hardware resource that executes the specific process may be one of these various processors, or may be a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific process may be a single processor.

[0069] As an example of a configuration using one processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a configuration using a processor that realizes the functions of the entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[0070] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements. The specific processes described above are merely examples. It goes without saying that unnecessary steps may be deleted, new steps may be added, or the order of processes may be changed without departing from the spirit of the invention.

[0071] The above description and illustrations are detailed descriptions of the parts related to the technology of the present disclosure, and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, function, action, and effect is an example of the configuration, function, action, and effect of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above description and illustrations, within the scope of the gist of the technology of the present disclosure. In addition, in order to avoid confusion and to facilitate understanding of the parts related to the technology of the present disclosure, the above description and illustrations omit explanations of technical common sense that do not require explanation in order to enable the implementation of the technology of the present disclosure.

[0072] All publications, patent applications, and standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or standard was specifically and individually indicated to be incorporated by reference. [Explanation of symbols]

[0073] 10 Data Processing System 12 Data Processing Device 14 Smart Glasses 58 Data Generation Model 59 Emotion Identification Model 290 Specific Processing Department 292 State Recognition Unit 294 Emotion Recognition Department 296 Processing section 298 Memory control unit 299 Output section

Claims

1. a state recognition unit that recognizes a user state; an emotion recognition unit that recognizes an emotion of a user based on the user state when the user state satisfies a predetermined trigger condition; a processing unit that inputs a prompt including a result of the recognition of the user's emotion and an instruction sentence for obtaining advice for suppressing the user's emotion into a data generation model that generates a sentence according to input data, and obtains advice for the user using an output of the data generation model; an output unit that outputs the obtained advice; 2. A data processing device comprising:

2. The data processing device according to claim 1 , wherein the output unit outputs the advice in a voice type set by the user.

3. 2. The data processing apparatus according to claim 1, wherein the trigger condition is a condition related to biometric information of the user.

4. 2. The data processing device according to claim 1, wherein the processing unit inputs a prompt including the recognition result of the user's state, the recognition result of the user's emotion, and an instruction sentence for obtaining advice for suppressing the user's emotion into the data generation model, and obtains advice for the user using the output of the data generation model.

5. a storage control unit that stores a pair of the user state recognition result and the user emotion recognition result in a database, 2 . The data processing device according to claim 1 , wherein the output unit further outputs a pair of the recognition result of the user's state and the recognition result of the user's emotion stored in the database.

6. The user input is received by a communication terminal carried by the user.

2. A data processing apparatus according to claim 1.

7. The communication terminal is a wearable terminal.

7. A data processing apparatus according to claim 6.

8. The wearable device is a pair of smart glasses.

8. A data processing apparatus according to claim 7.

9. The state recognition unit recognizes a user state, the emotion recognition unit recognizes an emotion of the user based on the user state when the user state satisfies a predetermined trigger condition; a processing unit inputs a prompt including a result of the recognition of the user's emotion and an instruction sentence for obtaining advice for suppressing the user's emotion into a data generation model that generates a sentence according to input data, and obtains advice for the user using an output of the data generation model; The output unit outputs the obtained advice. Data processing methods.

10. Recognize user state, Recognizing a user's emotion based on the user state when the user state satisfies a predetermined trigger condition; inputting a prompt including the result of recognizing the emotion of the user and an instruction sentence for obtaining advice for suppressing the emotion of the user into a data generation model that generates a sentence according to input data, and obtaining advice for the user using an output of the data generation model; Outputting the obtained advice A program for causing a computer to execute a process including the above.

Images