Data processing device, data processing method, and data processing program

Abstract

To provide a data processing device, a data processing method, and a data processing program which use a data generation model.SOLUTION: In a data processing system 10 comprising a data processing device and a plurality of smart devices, a user input accepted by a microphone 38B is conversation data, and creates an interactive diary based on conversation. The user input may include information on user actions. An interactive diary may be created on the basis of data obtained by taking various user actions such as a handwritten diary, a picture diary, an illustration, a picture, GPS position information, a chat, a video camera, and a game. When image information such as an illustration is used as a user input, a known machine learning model which can verbalize an image may be used. In this case, the data verbalized by the machine learning model is input to a data generation mode.SELECTED DRAWING: Figure 1B

Description

[Technical field]

[0001] The technology disclosed herein relates to a data processing device, a data processing method, and a data processing program. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including a description and related instruction sentence regarding the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-180282 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the prior art leaves room for improvement. [Means for solving the problem]

[0005] A first aspect of the technology of the present disclosure is a data processing device. [Brief description of the drawings]

[0006] [Figure 1A] FIG. 1 is a conceptual diagram illustrating an example of a configuration of a data processing system. [Figure 1B] FIG. 1 is a conceptual diagram illustrating an example of a configuration of a data processing system. [Figure 1C] FIG. 1 is a conceptual diagram illustrating an example of a configuration of a data processing system. [Figure 2A] FIG. 2 is a conceptual diagram showing an example of main functions of a data processing device and a smart device. [Figure 2B] FIG. 2 is a conceptual diagram showing an example of main functions of a data processing device and a smart device. [Diagram 3] 2 shows a schematic functional configuration of a specific processing unit of the data processing device. [Figure 4] 13 illustrates an example of an operational flow of a specific process performed by a data processing device. [Diagram 5] The outline of the specific process is shown below. [Figure 6] The outline of the specific process is shown below. [Figure 7] The outline of the specific process is shown below. [Figure 8] The outline of the specific process is shown below. [Figure 9] The outline of the specific process is shown below. [Figure 10] FIG. 1 shows a diagram for explaining the creation of an interactive diary. [Figure 11] FIG. 1 is a diagram for explaining an outline of the present embodiment. [Figure 12] 1 illustrates an example of an interaction between a user and a data generation model. [Figure 13] 1 illustrates an example of an interaction between a user and a data generation model. [Figure 14] 1 illustrates an example of an interaction between a user and a data generation model. [Figure 15] 1 illustrates an example of an interaction between a user and a data generation model. [Figure 16] 1 shows an example of a mark for expressing an emotion. [Figure 17] 13 shows an example of emotion result information. [Figure 18] 11 shows an example of emotion result information. [Figure 19] An example of emotion reason information is shown below. [Figure 20] An example of event information is shown below. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, an example of an embodiment of a data processing device, a data processing method, and a program according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a signed processor (hereinafter simply referred to as a "processor") may be one arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be one type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (Tensor Processing Unit).

[0010] In the following embodiments, a signed RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a code is an interface including a communication processor and an antenna. The communication I / F controls communication between multiple computers. An example of a communication standard applied to the communication I / F is a wireless communication standard including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. In addition, in this specification, the same idea as "A and / or B" is also applied when three or more things are expressed by connecting them with "and / or."

[0014] 1A, 1B, and 1C show an example of a configuration of a data processing system 10 according to an embodiment.

[0015] As shown in FIG. 1A, the data processing system 10 includes a data processing device 12, a smart device 14, and a smart device 16. An example of the data processing device 12 is a server. An example of the smart device 14 and the smart device 16 is a smartphone. In this embodiment, the data processing device 12 is an example of a "data processing device" according to the technology of the present disclosure.

[0016] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a wide area network (WAN) and / or a local area network (LAN).

[0017] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0018] The reception device 38 includes a touch panel 38A and a microphone 38B, and receives user input. The touch panel 38A detects contact with a pointer (e.g., a pen or a finger) to receive user input by touch. The microphone 38B detects the user's voice to receive user input by voice. The processor 46 transmits data indicative of the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the processor 28 acquires the data indicative of the user input.

[0019] The output device 40 includes a display 40A and a speaker 40B, and presents data to a person by outputting the data in a form of expression that the person can perceive (e.g., voice and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs voice according to instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0020] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for transmitting and receiving various types of information between the processor 46 and the processor 28 via the network 54.

[0021] The smart device 16 includes a computer 66, a reception device 68, an output device 70, a camera 72, and a communication I / F 74. The computer 66 includes a processor 76, a RAM 78, and a storage 80. The processor 76, the RAM 78, and the storage 80 are connected to a bus 82. The reception device 68, the output device 70, and the camera 72 are also connected to the bus 82.

[0022] The reception device 68 includes a touch panel 68A and a microphone 68B, and receives user input. The touch panel 68A detects contact with a pointer (e.g., a pen or a finger) to receive user input by touch of the pointer. The microphone 68B detects the user's voice to receive user input by voice. The control unit 76A transmits data indicative of the user input received by the touch panel 68A and the microphone 68B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicative of the user input.

[0023] The output device 70 includes a display 70A and a speaker 70B, and presents data to a person by outputting the data in a form of expression that the person can perceive (e.g., voice and / or text). The display 70A displays visible information such as text and images according to instructions from the processor 76. The speaker 70B outputs voice according to instructions from the processor 76. The camera 72 is a compact digital camera equipped with an optical system including a lens, an aperture, and a shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0024] The communication I / F 74 is connected to a network. The communication I / Fs 74 and 26 control the transmission and reception of various types of information between the processor 76 and the processor 28 via the network.

[0025] 2A and 2B show examples of main functions of the data processing device 12, the smart device 14, and the smart device 16.

[0026] As shown in Fig. 2, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32. The specific process program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific process program 56 from the storage 32, and executes the read specific process program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific process program 56 executed on the RAM 30.

[0027] The storage 32 stores a data generation model 58. The data generation model 58 is used by the specific processing unit 290.

[0028] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores a reception output program 60. The reception output program 60 is used together with the specific processing program 56 by the data processing system 10. The processor 46 reads out the reception output program 60 from the storage 50, and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0029] In the smart device 16, the processor 76 performs the reception output processing. The storage 80 stores a reception output program 90. The reception output program 90 is used together with the specific processing program 56 by the data processing system 10. The processor 76 reads out the reception output program 90 from the storage 80, and executes the read reception output program 90 on the RAM 78. The reception output processing is realized by the processor 76 operating as the control unit 76A in accordance with the reception output program 90 executed on the RAM 78.

[0030] Next, the process of the identification processing unit 290 when the data processing device 12 performs an identification process for identifying the child's emotion will be described.

[0031] As shown in FIG. 3, the specific processing unit 290 includes an input unit 292, a processing unit 294, and an output unit 296.

[0032] The input unit 292 acquires a user input accepted by the smart device 14 or the smart device 16. Specifically, the input unit 292 acquires at least one of text, voice, and image data of the user accepted by the smart device 14 or the smart device 16.

[0033] The processing unit 294 performs a specification process using the data generation model 58. Specifically, character, voice, and image data input by the user are input to the data generation model 58, and a generation result is obtained. In addition, a specification result regarding the child's emotion is generated based on the generation result.

[0034] The output unit 296 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires voice indicating a user input for the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0035] Furthermore, the output unit 296 transmits the result of the specific processing to the smart device 16. In the smart device 16, the control unit 76A causes the output device 70 to output the result of the specific processing. The microphone 68B acquires voice indicating a user input for the result of the specific processing. The control unit 76A transmits voice data indicating the user input acquired by the microphone 68B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[0036] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by making a neural network perform deep learning. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating a voice, text data indicating a text, and image data indicating an image is input. The data generation model 58 performs inference on the input inference data according to the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0037] Next, the operation of the data processing system 10 will be described.

[0038] An example of the flow of the specific processing will be described with reference to Fig. 4. Note that the flow of the specific processing shown in Fig. 4 is an example of a "data processing method" according to the technology of the present disclosure.

[0039] In step S300, the processing unit 294 determines whether a predetermined trigger condition is met.

[0040] If the trigger condition is met in step S300 (step S300; Yes), the data processing system 10 proceeds to step S301. On the other hand, if the trigger condition is not met in step S300 (step S300; No), the data processing system 10 ends the identification process.

[0041] In step S301, the processing unit 294 generates a prompt by adding an instruction for obtaining a result of a specific process to the text representing the input.

[0042] In step S303, the processing unit 294 inputs the generated prompt to the data generation model 58, and obtains the result of the specific process based on the output of the data generation model 58.

[0043] In step S304, the output unit 296 outputs the result of the identification process to the user terminal, and the identification process ends.

[0044] The specific processing of this embodiment will be further explained below with reference to Figures 5 to 9. The specific processing of this embodiment has the following functions to achieve the following objectives. In other words, for the task of estimating a child's emotions, the specific process is as follows: -Displays the numbers related to your child's emotions - Display information about the reasons for children's emotions - Display information about your child's emotional events It has the following function.

[0045] The following describes the operation of the data processing system 10 in more detail. In the following, a case where the first user is a child and the second user is the child's parent will be described as an example. The first user, who is the child, operates the smart device 14, and the second user, who is the parent, operates the smart device 16.

[0046] The data processing system 10 generates an interactive diary based on a record of the conversation between the child and the data generation model 58. For example, the data processing system 10 judges the child's mental state, and if it judges that the child's mental state is dangerous, it shares the information with the parent or a professional advisor. This makes it possible to protect the child and support the child's healthy growth. It also makes it possible to share the child's mental worries in a safe environment and improve the child's understanding and expression of emotions. It also realizes a new way of watching over children that is neither overprotective nor neglectful.

[0047] As shown in the table below, there are differences between children's diaries and adult diaries. Specifically, because children's diaries are simple, even if you reread them later, you often cannot grasp the details of the information from that time. This is because children have poorer writing skills than adults, and they are often not written with the expectation that they will be read again later. On the other hand, children's diaries contain daily surprises and large emotional ups and downs, and contain more emotion than adult diaries.

[0048] [Table 1]

[0049] As described above, children often have difficulty verbalizing their worries, and parents often consider their children's claims to be selfish and overlook their children's SOS signs. Therefore, in this embodiment, at the end of the day, the child interacts with the data generation model 58 to create an interactive diary that associates the events of the day with the child's feelings about those events.

[0050] FIG. 10 is a diagram for explaining the creation of an interactive diary. In the dialogue between the child and the data generation model 58, for example, the child inputs "the zoo," "what I did and what happened," and "I saw a monkey." In this case, the child inputs only the actions of that day. In response to this, for example, the data generation model 58 outputs a response such as "What did you think?", and the child inputs "what I thought" and "it was cute." This input "it was cute" represents the child's feelings and is the content drawn out in the dialogue between the child and the data generation model 58.

[0051] Furthermore, for example, the data generation model 58 outputs a response such as "What was cute about it?", which allows the child to input "The baby monkey was hanging from its mother's tummy."

[0052] For example, the data generation model 58 outputs a response such as "What else did you do?", which causes the child to input "I saw a lion." In response to this, the data generation model 58 outputs a response such as "What did you think?", which causes the child to input "It looked strong" or "It had a magnificent mane and a big body."

[0053] In this way, the data generation model 58 outputs responses that elicit events and emotions, making it possible to create an interactive diary in which events and emotions are associated.

[0054] Furthermore, for example, by the data generation model 58 outputting a response such as "Is there anything that you didn't like?", the child will input such things as "X-chan pushed me into the pond," "I cried," and "I was sad because she was mean and pushed me into the pond."

[0055] In this way, by having the child interact with the data generation model 58, it becomes possible to extract more information from the child.

[0056] The following table lists the advantages of writing a diary. As shown in the table below, although there are many advantages to writing a diary, having the data generating model 58 write the diary may lead to a decline in a child's writing ability. On the other hand, the data generating model 58 may be able to gain a deeper self-understanding by asking the child daily questions that stimulate his or her creativity. Therefore, dialogue with the data generating model 58 may be a new means of deepening self-understanding.

[0057] [Table 2]

[0058] Fig. 11 is a diagram for explaining an overview of this embodiment. As shown in Fig. 11, the data processing device 12 creates an interactive diary by interacting with a child who is a first user U1. In addition, the data processing system 10 creates a report diary, which is a diary for reporting to a parent who is a second user U2, based on the created interactive diary. This report diary is created according to the results of the interactive diary or the dialogue.

[0059] 12 to 15 are diagrams showing an example of a dialogue between a child, who is a first user U1, and a data generation model 58. FIG.

[0060] 12 to 15, the data processing device 12 inputs a user input from a first user U1 to a data generation model 58, and presents a response output from the data generation model 58 to the first user U1. In this way, a dialogue is carried out between the user and the data generation model 58.

[0061] Specifically, the first user U1 operates the smart device 14 to input a user input to the smart device 14. The smart device 14 accepts the user input and transmits the user input to the data processing device 12. The data processing device 12 inputs the received user input to the data generation model 58 and transmits a response output from the data generation model 58 to the smart device 14. The smart device 14 receives the response and displays the response on the display 40A. In this manner, a dialogue is executed between the first user U1 and the data generation model 58.

[0062] As shown in FIG. 12, when the first user U1 executes a dialogue with the data generation model 58, the first user U1 inputs to the data generation model 58 an interactive diary creation prompt P1 including a profile of the first user U1, an instruction to elicit the first user U1's concerns, and an instruction to create an interactive diary.

[0063] Then, as shown in FIG. 12, a first user U1 executes a dialogue after inputting an interactive diary-making prompt P1 into the data generation model.

[0064] The data processing device 12 creates an interactive diary based on the result of the dialogue between the first user U1 and the data generation model 58. Specifically, as shown in Fig. 14, the interactive diary is created by inputting a prompt P2 instructing the data generation model 58 to create an interactive diary.

[0065] When a dialogue is executed between the first user U1 and the data generation model 58, the first user U1 may express his / her own emotions with marks as shown in FIG. 16. For example, when M in FIG. 16 is input from the first user U1, the input may be accepted as information in which the type and degree of emotion are associated, such as a happiness score of 5. By using such joy, anger, sadness, and happiness buttons, the first user U1 can look back on the day in an abstract manner. The user input in this case is emotion information corresponding to a mark selected from a plurality of predetermined marks.

[0066] Next, as shown in FIG. 15, the parent who is the second user U2 logs in to the data processing device 12 and inputs a report diary creation prompt P3 to the smart device 16, which instructs the user to create a report diary. The smart device 16 accepts the report diary creation prompt P3 as shown in FIG. 15 and transmits the report diary creation prompt P3 to the data processing device 12. The data processing device 12 inputs the received report diary creation prompt P3 to the data generation model 58 and generates a report diary that is a response output from the data generation model 58 and corresponds to the dialogue diary. Then, the data processing device 12 transmits the report diary to the smart device 16. The smart device 16 receives the report diary and displays the report diary on the display 70A. Note that the parent who is the second user U2 cannot view the dialogue between the first user U1 and the data generation model 58 and the dialogue diary. Therefore, the state of the first user U1 who is a child can be appropriately conveyed to the second user U2 who is a parent while protecting the privacy of the first user U1 who is a child to some extent.

[0067] The second user U2 may input a feedback prompt to the data generation model 58 to provide feedback on the report diary. This improves the creation of the interactive diary or the report diary.

[0068] In this way, the data processing device 12 generates an interactive diary for each day within a given period based on the interactions between the first user U1 and the data generating model 58 for each day.

[0069] Then, the data processing device 12 extracts emotion information representing the emotion of the first user U1 from the sentences shown in the dialogue diary for each day. The emotion information extraction process is realized by known technology. The data processing device 12 generates emotion result information representing at least one of the ratio of emotions represented by the emotion information within a predetermined period and the transition of emotions represented by the emotion information within a predetermined period.

[0070] Then, the data processing device 12 transmits the generated emotion result information to the smart device 16 managed by the second user U2. The smart device 16 displays the received emotion result information on the display 70A.

[0071] 17 and 18 are diagrams showing an example of emotion result information. As shown in FIG. 17 and FIG. 18, the display 70A of the smart device 16 displays the ratio of emotions of the child who is the first user U1 and the transition of emotions within a predetermined period. This allows the parent who is the second user U2 to easily understand what emotions the child who is the first user U1 is feeling. In addition, the parent who is the second user U2 can easily understand how the emotions of the child who is the first user U1 are transitioning.

[0072] Furthermore, the data processing device 12 extracts emotion reason information that is the reason why the first user U1 has the emotion represented by the emotion information. Note that the process of extracting emotion reason information is realized by known technology.

[0073] The data processing device 12 transmits the generated emotion reason information to the smart device 16 managed by the second user U2. The smart device 16 displays the received emotion reason information on the display 70A.

[0074] Fig. 19 is a diagram showing an example of emotion reason information. As shown in Fig. 19, the display 70A of the smart device 16 displays the reason why the child, who is the first user U1, had a certain emotion within a certain period of time. This allows the parent, who is the second user U2, to easily understand the reason why the child, who is the first user U1, had the certain emotion.

[0075] Furthermore, the data processing device 12 extracts event information that is an event that caused the first user U1 to have the emotion represented by the emotion information. Note that the process of extracting event information is realized by known technology.

[0076] The data processing device 12 transmits the generated event information to the smart device 16 managed by the second user U2. The smart device 16 displays the received event information on the display 70A.

[0077] Fig. 20 is a diagram showing an example of an event information report. As shown in Fig. 20, the display 40A of the smart device 16 displays events during a predetermined period in which the child, who is the first user U1, had a predetermined emotion. This allows the parent, who is the second user U2, to easily understand the events in which the child, who is the first user U1, had a predetermined emotion.

[0078] As described above, the data processing system 10 of the embodiment acquires a user input, inputs the acquired user input to a data generation model, and presents a response output from the data generation model to the user, thereby executing a dialogue with the user, and creating an interactive diary between the user and the data generation model based on the result of the dialogue. This makes it possible to efficiently create an interactive diary for the user.

[0079] Specifically, when a user creates a diary by himself, necessary information is often missing. In contrast, by executing a dialogue between the user and the data generation model, it is possible to extract necessary information from the user, and it is possible to create an interactive diary containing the necessary information. In particular, when the user is a child, for the reasons described above, necessary information is often not reflected in the diary. For this reason, the data processing system of this embodiment allows the user and the data generation model to execute a dialogue, making it possible to extract necessary information from the user, and it is possible to create an interactive diary containing the necessary information.

[0080] For example, the techniques disclosed in the following reference documents are known.

[0081] References: "Finally here!? A godly app that uses AI to analyze emotions from a baby's cries" <Internet URL: https: / / st.benesse.ne.jp / ikuji / content / ?id=26988#gsc.tab=0> (Retrieved October 30, 2023)

[0082] The technology disclosed in the above references is a technology for estimating a baby's emotions from the baby's crying, and is not a technology for creating an interactive diary based on the results of a dialogue with a user, as in the data processing system of this embodiment.

[0083] Furthermore, the dialogue diary generated by the data processing system of this embodiment is a record that includes the user's feelings and events, and is different from documents that record only facts, such as minutes of a meeting.

[0084] A modification of this embodiment will now be described.

[0085] [Variation 1] In the above embodiment, the user input is dialogue data, and an interactive diary is created based on the dialogue, but the present invention is not limited to this. The user input may include information about the user's actions. The following table shows a list of data sources that can be used as the user input. For example, as shown in the following table, an interactive diary may be created based on data obtained by the user performing various actions, such as a handwritten diary, a picture diary, an illustration, a photo, GPS location information, chat, a video camera, and a game. In addition, when image information such as an illustration is used as the user input, a known machine learning model capable of verbalizing an image may be used. In this case, the data verbalized by the machine learning model is input to the data generation model.

[0086] [Table 3]

[0087] [Variation 2] In addition, in order to encourage the user to continue creating a diary, various measures shown in the table below may be implemented. By creating a character for the data generation model that generates an interactive diary through dialogue with the child, the possibility that the child will enjoy interacting with the data generation model and continue to use it increases.

[0088] [Table 4]

[0089] [Variation 3] The response time of the data generation model described above is very short, and the user may feel that the data generation model's response is too fast. Therefore, it is preferable to adjust the dialogue speed so that the user does not lose time to think. It is also preferable to prevent the user from feeling rushed. Therefore, the dialogue pace may be adjustable, as shown in the following table.

[0090] [Table 5]

[0091] [Variation 4] When creating an interactive diary, the data generation model may take on the role of a teacher. In this case, the data processing device 12 acquires a knowledge provision prompt that instructs the data generation model to provide knowledge to the user, inputs the knowledge provision prompt to the data generation model, and then executes the dialogue. For example, a prompt instructing the data generation model to take on the role of a teacher as shown in the following table may be input to the data generation model. This allows the user to have fun while acquiring knowledge, making it possible to create a more appropriate interactive diary.

[0092] [Table 6]

[0093] [Variation 5] In the above embodiment, the case of creating a dialogue-type diary for a child has been described as an example, but the present invention is not limited thereto. The above embodiment can be applied to various uses. Specifically, the present embodiment can be applied to the following uses. For example, by setting the first user U1 as an elderly person, the present embodiment can be applied to watching over the elderly person.

[0094] [Table 7]

[0095] In addition, it is possible to provide more accurate analysis results based on the dialogue diary obtained in the above embodiment. For example, the dialogue diary can be used for learning, EC recommendations, partner matching, human resource matching, etc.

[0096] Although the system according to the present disclosure has been described above mainly with respect to the function of the specific processing unit 290 of the data processing device 12, the system according to the present disclosure is not necessarily implemented in a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program that runs on a personal computer, or an application that runs on a smartphone or the like. The method according to the present disclosure may be provided to a user in the form of SaaS (Software as a Service).

[0097] In the above embodiment, an example was given in which a specific process is performed by one computer 22, but the technology disclosed herein is not limited to this, and distributed processing of the specific process may be performed by multiple computers, including computer 22.

[0098] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable computer-readable non-transitory storage medium such as a Universal Serial Bus (USB) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[0099] In addition, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 upon request from the data processing device 12.

[0100] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[0101] As the hardware resource for executing the specific process, various processors as shown below can be used. An example of the processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing the specific process by executing software, i.e., a program. Another example of the processor is a dedicated electric circuit, which is a processor having a circuit configuration designed exclusively for executing the specific process, such as a Field-Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), or an Application Specific Integrated Circuit (ASIC). Each processor has a built-in or connected memory, and each processor executes the specific process by using the memory.

[0102] The hardware resource that executes the specific process may be one of these various processors, or may be a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific process may be a single processor.

[0103] As an example of a configuration using one processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a configuration using a processor that realizes the functions of the entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[0104] Furthermore, more specifically, the hardware structure of these various processors can be an electric circuit that combines circuit elements such as semiconductor elements. The specific processes described above are merely examples. It goes without saying that unnecessary steps may be deleted, new steps may be added, or the order of processes may be changed without departing from the spirit of the invention.

[0105] The above description and illustrations are detailed descriptions of the parts related to the technology of the present disclosure, and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, function, action, and effect is an example of the configuration, function, action, and effect of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above description and illustrations, within the scope of the gist of the technology of the present disclosure. In addition, in order to avoid confusion and to facilitate understanding of the parts related to the technology of the present disclosure, the above description and illustrations omit explanations of technical common sense that do not require explanation in order to enable the implementation of the technology of the present disclosure.

[0106] All publications, patent applications, and standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or standard was specifically and individually indicated to be incorporated by reference.

[0107] In relation to the above, the following supplementary notes are further disclosed.

[0108] <Appendix 1> Obtaining user input representing input from a user; inputting the acquired user input into a data generation model and presenting a response output from the data generation model to the user, thereby executing a dialogue with the user, and creating an interactive diary between the user and the data generation model based on a result of the dialogue; A data processing device that performs the processing. <Appendix 2> obtaining an interactive diary creation prompt including a profile of the user, instructions representative of eliciting a concern of the user, and instructions for creating the interactive diary; executing the dialogue after inputting the interactive diary creation prompts into the data generation model, and creating the interactive diary based on a result of the dialogue; 2. A data processing device according to claim 1. <Appendix 3> the user is a first user, generating said interactive diary for each day within a predetermined period of time; extracting emotion information representing an emotion of the first user from a sentence included in the dialogue diary; generating emotion result information that indicates at least one of a ratio of the emotion represented by the emotion information within the predetermined period and a transition of the emotion represented by the emotion information within the predetermined period; Transmitting the emotion result information to a terminal managed by a second user different from the first user; The emotion result information is displayed on a display unit of a terminal managed by the second user. 3. A data processing device according to claim 1 or 2. <Appendix 4> the user is a first user, generating said interactive diary for each day within a predetermined period of time; extracting emotion information representing an emotion of the first user from a sentence included in the dialogue diary; extracting emotion reason information, which is a reason why the first user has the emotion represented by the emotion information, from a sentence shown in the dialogue diary; transmitting the emotion reason information to a terminal managed by a second user different from the first user; the emotion reason information is displayed on a display unit of a terminal managed by the second user. The data processing device according to any one of claims 1 to 3. <Appendix 5> the user is a first user, generating said interactive diary for each day within a predetermined period of time; extracting emotion information representing an emotion of the first user from a sentence included in the dialogue diary; extracting, from a sentence included in the dialogue diary, event information that is an event that caused the first user to have the emotion represented by the emotion information; Transmitting the event information to a terminal managed by a second user different from the first user; The event information is displayed on a display unit of a terminal managed by the second user. A data processing device according to any one of claims 1 to 4. <Appendix 6> Obtaining a report diary creation prompt that instructs the user to create a report diary; inputting the reporting diary creation prompt into the data generation model to create a reporting diary corresponding to the interactive diary; A data processing device according to any one of claims 1 to 5. <Appendix 7> obtaining a feedback prompt instructing feedback on the report diary; inputting the feedback prompts into the data generation model to improve the interactive diary or the report diary; 7. A data processing device according to claim 6. <Appendix 8> the user input includes emotion information corresponding to a mark selected from a predetermined number of marks; A data processing device according to any one of claims 1 to 7. <Appendix 9> The user input includes information regarding the user's actions. A data processing device according to any one of claims 1 to 8. <Appendix 10> obtaining a knowledge provision prompt for instructing the user to provide knowledge; executing the dialogue after inputting the knowledge-providing prompts into the data generation model; A data processing device according to any one of claims 1 to 9. <Appendix 11> Obtaining user input representing input from a user; inputting the acquired user input into a data generation model and presenting a response output from the data generation model to the user, thereby executing a dialogue with the user, and creating an interactive diary between the user and the data generation model based on a result of the dialogue; A data processing method in which processing is performed by a computer. <Appendix 12> Obtaining user input representing input from a user; inputting the acquired user input into a data generation model and presenting a response output from the data generation model to the user, thereby executing a dialogue with the user, and creating an interactive diary between the user and the data generation model based on a result of the dialogue; A data processing program for causing a computer to execute processing. [Explanation of symbols]

[0109] 10 Data Processing System 12 Data Processing Device 14,16 Smart Devices 290 Specific Processing Department 292 Input section 294 Processing section 296 Output section

Claims

1. Obtaining user input representing input from a user; inputting the acquired user input into a data generation model and presenting a response output from the data generation model to the user, thereby executing a dialogue with the user, and creating an interactive diary between the user and the data generation model based on a result of the dialogue; A data processing device that performs the processing.

2. obtaining an interactive diary creation prompt including a profile of the user, instructions representative of eliciting a concern of the user, and instructions for creating the interactive diary; executing the dialogue after inputting the interactive diary creation prompts into the data generation model, and creating the interactive diary based on a result of the dialogue; 2. A data processing apparatus according to claim 1.

3. the user is a first user, generating said interactive diary for each day within a predetermined period of time; extracting emotion information representing an emotion of the first user from a sentence included in the dialogue diary; generating emotion result information that indicates at least one of a ratio of the emotion represented by the emotion information within the predetermined period and a transition of the emotion represented by the emotion information within the predetermined period; Transmitting the emotion result information to a terminal managed by a second user different from the first user; the emotion result information is displayed on a display unit of a terminal managed by the second user.

3. A data processing device according to claim 1 or 2.

4. the user is a first user, generating said interactive diary for each day within a predetermined period of time; extracting emotion information representing an emotion of the first user from a sentence included in the dialogue diary; extracting emotion reason information, which is a reason why the first user has the emotion represented by the emotion information, from a sentence shown in the dialogue diary; Transmitting the emotion reason information to a terminal managed by a second user different from the first user; the emotion reason information is displayed on a display unit of a terminal managed by the second user.

3. A data processing device according to claim 1 or 2.

5. the user is a first user, generating said interactive diary for each day within a predetermined period of time; extracting emotion information representing an emotion of the first user from a sentence included in the dialogue diary; extracting, from a sentence included in the dialogue diary, event information that is an event that caused the first user to have the emotion represented by the emotion information; Transmitting the event information to a terminal managed by a second user different from the first user; The event information is displayed on a display unit of a terminal managed by the second user.

3. A data processing device according to claim 1 or 2.

6. Obtaining a report diary creation prompt that instructs the user to create a report diary; inputting the reporting diary creation prompt into the data generation model to create a reporting diary corresponding to the interactive diary; 3. A data processing device according to claim 1 or 2.

7. obtaining a feedback prompt instructing feedback on the report diary; inputting the feedback prompts into the data generation model to improve the interactive diary or the report diary; 7. A data processing apparatus according to claim 6.

8. the user input includes emotion information corresponding to a mark selected from a predetermined number of marks; 3. A data processing device according to claim 1 or 2.

9. The user input includes information regarding the user's actions.

3. A data processing device according to claim 1 or 2.

10. obtaining a knowledge provision prompt for instructing the user to provide knowledge; executing the dialogue after inputting the knowledge-providing prompts into the data generation model; 3. A data processing device according to claim 1 or 2.

11. Obtaining user input representing input from a user; inputting the acquired user input into a data generation model and presenting a response output from the data generation model to the user, thereby executing a dialogue with the user, and creating an interactive diary between the user and the data generation model based on a result of the dialogue; A data processing method in which processing is performed by a computer.

12. Obtaining user input representing input from a user; inputting the acquired user input into a data generation model and presenting a response output from the data generation model to the user, thereby executing a dialogue with the user, and creating an interactive diary between the user and the data generation model based on a result of the dialogue; A data processing program for causing a computer to execute processing.

Images