System
The system addresses the challenges of diary writing by using a generative AI model to analyze user input, generate prompts, and organize diary entries, enhancing motivation and self-reflection through personalized feedback.
Patent Information
- Application Number
- JP2024121462
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-26
- Publication Date
- 2026-02-05
AI Technical Summary
Existing diary-writing systems fail to effectively analyze user input, generate appropriate prompts, provide feedback and insights, and organize dialogue content into diary format, making it difficult for users to maintain motivation and reflect on their experiences.
A system utilizing a generative AI model to accept user input, analyze it, generate prompts, provide feedback and insights, and organize diary entries into a structured format, facilitating easy continuation and reflection.
Enhances user motivation and promotes self-understanding by simplifying diary writing and providing personalized feedback and insights, enabling effective daily reflection and growth.
Smart Images

Figure 2026019714000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Writing a diary is an important activity that leads to self-understanding and growth, but many people find it difficult to continue writing a diary or do not know what to write. Therefore, in order to promote self-growth through diaries, it is necessary to make it easy for users to continue writing a diary. It is also important to provide users with a way to reflect on their experiences that meets their needs. [Means for solving the problem]
[0005] The present invention solves the above-mentioned problems by providing a system including the following means. First, a means for accepting input from a user is provided, allowing the user to easily write a diary. Next, a means for analyzing the input and generating a prompt for the next input is provided, reducing the difficulty the user has when writing a diary. Furthermore, a means for presenting the prompt to the user makes it easier for the user to continue writing the diary. Furthermore, a means for generating feedback and insights based on the input from the user is provided, helping the user to deepen self-understanding and feel a sense of growth. By providing a means for organizing the content of the dialogue and summarizing it in diary format and a means for saving the summarized diary, a record of the user's growth can be reliably maintained.
[0006] "User" refers to an individual who uses the Service.
[0007] "Input" refers to the act of a user providing text or other information to a system.
[0008] "Analysis" refers to the process of processing input information and understanding its content and meaning.
[0009] A "prompt" is a question or message that prompts the user for further input.
[0010] "Presenting" refers to the act of displaying system-generated information to a user.
[0011] "Feedback" refers to the evaluation and comments the system provides in response to a user's input.
[0012] "Insights" refer to new understandings or perspectives that are derived based on user input.
[0013] "Dialogue content" refers to all messages and information exchanged between the user and the system.
[0014] "Diary format" refers to a written format that organizes a user's input.
[0015] "Summarizing" refers to the act of organizing input information and consolidating it into an easy-to-understand form.
[0016] "Storage" refers to the act of recording organized information in a database or other location so that it can be accessed later.
[0017] The term "system" refers to a combination of a series of software and hardware components related to the present invention. [Brief explanation of the drawings]
[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0020] First, the terms used in the following description will be explained.
[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0026] [First embodiment]
[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0039] An embodiment of the present invention will be described. This system uses a generation AI to assist users in writing their diary entries and reviewing their diary entries. Below, the program's processing will be explained in natural language, with specific examples provided to illustrate the details.
[0040] 1. User Authentication
[0041] 1. The terminal displays a login screen to the user and prompts them to enter their username and password.
[0042] Example: A login page appears, presenting fields for entering a "username" and "password."
[0043] 2. The user enters their username and password and clicks the login button.
[0044] Example: Enter "login_user" and "secure_password" and click the "Login" button.
[0045] 3. The terminal sends the entered login information to the server.
[0046] 4. The server verifies the received login information using the authentication system and returns the authentication result to the terminal.
[0047] Example: If authentication is successful, a message will be displayed informing you to proceed to the next step.
[0048] 2. Gathering user needs
[0049] 1. The terminal displays a question to the user asking about the user's needs for the day's reflection.
[0050] Example: The question "What would you like to reflect on today? (Example: Something that made you happy, something that made you feel you grew)" will be displayed.
[0051] 2. The user enters the content they want to review and clicks the send button.
[0052] Example: Type, "Today I would like to reflect on something that I felt I grew from," and click the "Send" button.
[0053] 3. The terminal sends the user's input to the server.
[0054] 4. The server analyzes the received feedback, generates a corresponding prompt, and returns it to the terminal.
[0055] Example: A prompt might be generated: "Tell me a specific event that made you feel like you grew."
[0056] 3. Diary writing support through dialogue
[0057] 1. The terminal displays the prompt received from the server to the user.
[0058] Example: The message displayed is, "Please tell us a specific event in which you felt you grew."
[0059] 2. The user enters the appropriate answers to the prompts and clicks the submit button.
[0060] Example: Type "I demonstrated leadership in a new project" and click the "Submit" button.
[0061] 3. The terminal sends the user's answer to the server.
[0062] 4. The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the device. This process is repeated as many times as necessary.
[0063] Example: The server generates the next question: "That's great! How do you think you demonstrated leadership?"
[0064] 4. Providing feedback and insights
[0065] 1. The server generates feedback and insights based on the user's input and sends them to the device.
[0066] Example: Feedback generated might include, "The specific explanations and role assignments led to the team's success. What was the reaction?"
[0067] 2. The device displays feedback and insights from the server to the user.
[0068] 5. Organizing and summarizing your diary
[0069] 1. The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[0070] Example: Diary-style data such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up the roles. Result: The project progressed smoothly and everyone was cooperative." is generated.
[0071] 2. The server stores the generated diary data in a database.
[0072] 6. Saving and displaying diary entries
[0073] 1. The server sends a response to the device indicating that the diary entry was successfully saved.
[0074] 2. The device displays a message to the user informing them that the diary entry has been saved.
[0075] Example: The message "Your diary entry has been saved. Would you like to review today's review?" will be displayed.
[0076] 3. The terminal displays the contents of the diary created as needed to the user.
[0077] These steps allow users to write their diary entries through natural dialogue and review them periodically. By utilizing generative AI, we can reduce the difficulty users face when writing a diary and promote their personal growth.
[0078] The processing flow will be explained below.
[0079] Step 1:
[0080] The terminal displays a login screen to the user, prompting them to enter their username and password.
[0081] Specifically, the login screen is rendered and the input fields are made accessible to the user.
[0082] Step 2:
[0083] The user enters the username and password and clicks the login button.
[0084] Specifically, enter "login_user" and "secure_password" in the form and press the "Login" button.
[0085] Step 3:
[0086] The terminal transmits the entered login information to the server.
[0087] Specifically, the username and password are sent to the server via HTTPS.
[0088] Step 4:
[0089] The server verifies the received login information using an authentication system and returns the authentication result to the terminal.
[0090] Specifically, it verifies authentication information through a database query and generates a session ID if authentication is successful.
[0091] Step 5:
[0092] If the authentication is successful, the terminal redirects the user to the main screen, and if it is unsuccessful, it displays an error message.
[0093] Specifically, if successful, the main screen is rendered, and if unsuccessful, an error message is displayed on the screen.
[0094] Step 6:
[0095] The terminal displays a question to the user asking about the user's needs for reviewing the day.
[0096] Specifically, the prompt "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)" will be displayed.
[0097] Step 7:
[0098] The user inputs the content they want to review and clicks the send button.
[0099] Specifically, the user enters "Today I would like to reflect on the things in which I felt I have grown" in the input field and clicks the "Send" button.
[0100] Step 8:
[0101] The terminal transmits the user's input to the server.
[0102] As a specific operation, the input data is sent to the server.
[0103] Step 9:
[0104] The server analyzes the received review content, generates a corresponding prompt, and returns it to the terminal.
[0105] Specifically, the generation AI analyzes the input text and generates a question such as, "Please tell us a specific event that made you feel like you grew."
[0106] Step 10:
[0107] The terminal displays the generated prompt to the user.
[0108] Specifically, a message will appear on the screen saying, "Please tell us a specific event that made you feel like you've grown."
[0109] Step 11:
[0110] The user enters the appropriate answers to the prompts and clicks the submit button.
[0111] Specifically, enter "I demonstrated leadership in a new project" in the input field and click the "Submit" button.
[0112] Step 12:
[0113] The terminal transmits the user's answer to the server.
[0114] Specifically, the input data is sent to the server again.
[0115] Step 13:
[0116] The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the terminal.
[0117] The specific behavior is to generate the following prompt: "That's great! Why do you think that demonstrates leadership?"
[0118] Step 14:
[0119] The terminal displays the feedback and insights received from the server to the user.
[0120] Specifically, the feedback comments are displayed on the screen.
[0121] Step 15:
[0122] The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[0123] Specifically, the following diary data is created and saved: "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up the roles. Result: The project progressed smoothly and everyone was cooperative."
[0124] Step 16:
[0125] The server stores the generated diary data in a database.
[0126] As a specific operation, diary data is registered in a database.
[0127] Step 17:
[0128] The server sends a response to the terminal indicating that the diary has been successfully saved.
[0129] Specifically, a success message is sent to the terminal.
[0130] Step 18:
[0131] The terminal displays a message to the user informing them that the diary entry has been saved.
[0132] Specifically, it displays the message "Your diary has been saved. Would you like to review today's review?"
[0133] Step 19:
[0134] The terminal displays the contents of the diary created as needed to the user.
[0135] Specifically, the contents of the saved diary are displayed on the screen.
[0136] Example 1
[0137] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0138] Previous diary entry support systems lacked the ability to effectively analyze user input and generate appropriate prompts to address individual reflection needs. They also struggled to provide feedback and insights to users, and the process of organizing dialogue content into diary format was laborious. Furthermore, they lacked the ability to categorize diary content for easy future reference, and the ability to collect users' reflection needs.
[0139] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0140] In this invention, the server includes means for accepting input from a user, means for analyzing the input and generating a prompt for the next input, and means for presenting the prompt to the user, thereby enabling generation of an appropriate prompt using a generative AI model.
[0141] "Means for accepting input from the user" is a function that provides an interface for the user to input information to the system.
[0142] The "means for analyzing the input and generating a prompt for the next input" is a function that analyzes the received user input and generates questions and instructions to accurately guide the user to the next information that they should enter.
[0143] The "means for presenting the prompt to the user" is a function for visually or audibly presenting the generated prompt to the user.
[0144] The "means for generating feedback and insights based on user input" is a function that generates appropriate feedback and analysis results based on the user's input and provides them to the user.
[0145] The "means for organizing the contents of the dialogue and summarizing them in a diary format" is a function for organizing information obtained through a dialogue with a user and summarizing it in a diary format based on a specific format.
[0146] The "means for saving the compiled diary" is a function for saving the created diary data in a storage such as a database.
[0147] "Means for generating the prompt using a generative AI model" refers to a function that utilizes an artificial intelligence model to automatically generate the prompt.
[0148] The "means for classifying the diary content entered by the user into categories" is a function for classifying the diary content entered by the user into specific categories or items.
[0149] The "means for collecting the user's reflection needs" is a function for collecting the user's objectives and requests when writing a diary.
[0150] This invention is a system for assisting users in effectively writing and reviewing their diary entries, and specifically, it utilizes a generative AI model to generate prompts and provide feedback and insights to the user. The following describes in detail the embodiments of the invention.
[0151] Hardware and Software
[0152] This system uses the following hardware and software:
[0153] Device: A device (e.g., computer, smartphone, tablet) that provides a user interface (UI) that runs on a web browser.
[0154] Server: The server receives user input, analyzes it, generates feedback and prompts. It also includes storage for saving the diary using a database.
[0155] Generative AI models: AI models that perform natural language processing (e.g., GPT-3).
[0156] Program processing
[0157] A user first accesses the system through a browser on their device. The device displays a login screen and prompts the user to enter their username and password. After the user enters these and clicks the login button, the device sends the information to the server. The server verifies this information using the authentication system and returns the authentication result.
[0158] If the authentication is successful, the device then displays a question to the user asking about their needs for reflection that day. For example, the question might be, "What would you like to reflect on today? (Example: Something that made you happy, something that made you feel you have grown)." If the user enters "I would like to reflect on something that made me feel I have grown today," and clicks the send button, the device sends the input to the server.
[0159] The server analyzes the received input using a generative AI model and generates the next prompt the user should enter. For example, a prompt might be generated such as, "Please tell us a specific event that made you feel like you grew." The device then displays this prompt to the user, who then enters the information again. For example, the user might enter, "I was able to demonstrate leadership in a new project," and click the send button.
[0160] The server analyzes this response and generates further questions and feedback. By repeating this process multiple times, the diary entry progresses through dialogue. The server generates feedback and insights based on the user's input, such as "The specific explanation and division of roles led to the team's success. What was the reaction?" and sends this feedback to the device.
[0161] Finally, the server organizes the diary entries into categories based on all the conversations and compiles them into a diary format. For example, it generates diary-format data such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I carefully explained things to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative." The generated diary data is then saved in a database by the server.
[0162] The device receives a message from the server saying, "Your diary entry has been saved. Would you like to check today's review?" and notifies the user. If necessary, the device displays the saved diary entry to the user.
[0163] Through these processes, users can write their diary through natural dialogue and use generative AI to conduct effective self-reflection. This invention enables users to improve the quality of their daily self-reflection.
[0164] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0165] Step 1: User authentication
[0166] Input: Username, Password
[0167] Processing: The terminal displays a login screen to the user, prompting them to enter their username and password. The user enters these and clicks the login button.
[0168] Data processing: The information entered by the user is sent to the server as an HTTP POST request.
[0169] Output: The authentication information is sent to the server.
[0170] Specific behavior: The terminal displays a login form in the web browser and provides input fields for the username and password. The user enters "login_user" and "secure_password" and clicks the login button.
[0171] Step 2: Returning the authentication result
[0172] Input: Credentials
[0173] Processing: The server verifies the received login information using the authentication system and returns the authentication result to the terminal.
[0174] Data processing: Call the authentication API and parse the response.
[0175] Output: The authentication result is returned to the terminal.
[0176] Specific operation: The server performs authentication using an authentication system (e.g., OAuth 2.0 or LDAP), generates a success or failure message, and returns it to the terminal in JSON format.
[0177] Step 3: Reflection and gathering needs
[0178] Input: Authentication result
[0179] Processing: If authentication is successful, the device displays a question to the user asking about their reflection needs for the day.
[0180] Data processing: Generate a question form and present it to the user.
[0181] Output: User's retrospective needs
[0182] Specific operation: The device displays the question "What would you like to reflect on today?", and the user enters "Today I would like to reflect on something that I felt I grew from," and clicks the send button.
[0183] Step 4: Submitting your retrospective needs
[0184] Input: User's reflection needs
[0185] Processing: The terminal sends the user's input to the server.
[0186] Data processing: The user-entered retrospective needs are sent as an HTTP POST request.
[0187] Output: A lookup request is sent to the server.
[0188] Specific behavior: Generates and sends an HTTP request to send the content entered in the text box to the server.
[0189] Step 5: Generate prompts
[0190] Input: User's reflection needs
[0191] Processing: The server analyzes the received reflection content using the generative AI model and generates a prompt sentence.
[0192] Data processing: Input reflection needs into the AI model to generate appropriate prompts.
[0193] Output: Generated prompt statement
[0194] Specific operation: The server inputs the reflection content (e.g., "Today, I would like to reflect on something that made me feel like I grew") into the AI model, generates a prompt saying, "Please tell us about a specific event that made you feel like you grew," and returns it to the device.
[0195] Step 6: Display a prompt
[0196] Input: prompt statement
[0197] Processing: The terminal displays the prompt received from the server to the user.
[0198] Data processing: The generated prompt text is displayed on the screen.
[0199] Output: The user is prompted.
[0200] Specific action: The device will display the prompt on the screen: "Please tell us a specific event that made you feel like you grew."
[0201] Step 7: Answer the prompts
[0202] Input: prompt statement
[0203] Action: The user enters the appropriate response to the prompt and clicks the submit button.
[0204] Data processing: User answers are sent as HTTP POST requests.
[0205] Output: The user's answer is sent to the server.
[0206] Specific action: Enter "I demonstrated leadership in a new project" in the text box and click the submit button.
[0207] Step 8: Generate your next question or feedback
[0208] Input: User's answer
[0209] Processing: The server analyzes the user's answers and uses the generative AI model to generate the next question and feedback comments.
[0210] Data transformation: Input answers into AI models to generate new questions and feedback.
[0211] Output: New question or feedback statement
[0212] Specific behavior: The server generates the next question, "That's great. Why do you think that demonstrates leadership?", and returns it to the device. This process is repeated as many times as necessary.
[0213] Step 9: View your feedback
[0214] Input: Feedback statement
[0215] Processing: The device displays feedback and insights from the server to the user.
[0216] Data processing: Feedback statements are displayed on the screen.
[0217] Output: Feedback is displayed to the user.
[0218] Specific action: The device displays feedback on the screen, such as, "The specific explanation and division of roles led to the team's success. What was the reaction?"
[0219] Step 10: Organize and summarize your diary
[0220] Input: Dialogue
[0221] Processing: The server organizes the diary entries into categories based on all the conversations and compiles them into a diary format.
[0222] Data processing: The conversation content is retrieved from the database, formatted, and compiled into a diary.
[0223] Output: Generated diary data
[0224] Specific behavior: The server generates specific diary data (e.g., "Today's growth: I was able to demonstrate leadership in a new project. Reason: I carefully explained things to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative.").
[0225] Step 11: Save diary data
[0226] Input: Generated diary data
[0227] Processing: The server saves the generated diary data in a database.
[0228] Data processing: Diary data is saved in the database using an INSERT query.
[0229] Output: Diary data is saved.
[0230] Specific operation: The server creates an INSERT query and saves the diary data to the database.
[0231] Step 12: Save complete notification
[0232] Input: Saved Results
[0233] Processing: The server sends a response to the device indicating that the diary entry has been saved successfully.
[0234] Data processing: Generate a save success message and send it as a JSON response.
[0235] Output: A save success message is sent to the terminal.
[0236] Specific behavior: A JSON response message saying "Your diary entry has been saved. Would you like to review today's review?" is sent to the device.
[0237] Step 13: Notify users
[0238] Input: Save successful message
[0239] Processing: The device displays a message to the user informing them that the diary entry has been saved.
[0240] Data processing: Display the message on the screen.
[0241] Output: A notification is displayed to the user.
[0242] What it does: Your device will display a pop-up notification saying, "Your diary has been saved. Would you like to review today's review?"
[0243] Step 14: Displaying diary entries
[0244] Input: User request
[0245] Processing: The terminal displays the contents of the diary created as needed to the user.
[0246] Data processing: Retrieve diary contents from the database and display them on the screen.
[0247] Output: The user can check the diary contents.
[0248] Specific operation: The device displays the saved diary entry on the user interface, allowing the user to check the contents.
[0249] Through the above processing steps, users can utilize the generative AI model to effectively write and review their diary entries.
[0250] (Application example 1)
[0251] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0252] Conventional user diary writing systems require users to write voluntarily, making it difficult to maintain motivation. They also lack support for effective daily reflection, leaving users with few opportunities to grow and gain new insights. Furthermore, they lack personalized feedback and insights using generative AI, making it difficult to provide optimal content tailored to individual users' needs. A new system is needed to solve these issues.
[0253] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0254] In this invention, the server includes a means for collecting the user's reflection needs, a means for generating prompt sentences using a generative AI model to prompt the next input, and a means for delivering the diary as personalized content. This makes it possible to provide effective support to the user and increase their motivation to write in the diary. In addition, by providing the user with individually optimized feedback and insights, it is possible to promote deeper self-understanding and growth. This makes it possible to effectively carry out daily reflection and support the user's growth.
[0255] "User authentication" is the process by which a user enters a username and password to access a system, and the information is verified to authenticate the user as a legitimate user.
[0256] "Reflection needs" refers to specific themes or items that a user wants to reflect on regarding the events that they experienced or the feelings they had that day.
[0257] A "generative AI model" refers to an artificial intelligence model that uses natural language processing techniques to analyze user input and generate appropriate feedback and prompts.
[0258] A "prompt sentence" refers to a guideline or question sentence that is generated to prompt the user for the next input.
[0259] "Personalized content" refers to customized information and feedback that is optimized to a user's individual needs and inputs.
[0260] "Content distribution" refers to the process of transmitting information to provide generated journal entries and feedback to users.
[0261] A "smartphone" refers to a mobile phone terminal that can connect to the Internet and use multi-function applications.
[0262] The present invention is a system that uses a generative AI model to assist users in writing and reviewing their diary entries. The system aims to provide personalized feedback and insights according to the user's needs, and to organize and store the diary. The following describes in detail the mode for implementing the invention.
[0263] 1. User Authentication
[0264] The server provides an authentication function for users to access the system. The terminal displays a login screen to the user and prompts them to enter their username and password. When the user enters the login information, the information is sent to the server, which then authenticates it using the authentication system.
[0265] 2. Gathering user needs
[0266] The server generates prompts to gather the user's reflection needs and presents them to the user through the terminal. For example, the terminal displays a question to the user such as, "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)." The user inputs what they want to reflect on, and the information is sent to the server.
[0267] 3. Diary writing support through dialogue
[0268] The server analyzes the received reflection content and generates the next prompt using a generative AI model. The generated prompt is sent to the device and displayed to the user. For example, a message might be displayed such as, "Please tell us a specific event that made you feel like you grew." The user then enters an appropriate response, which is then sent back to the server. The server repeats this process multiple times to assist the user in writing their diary.
[0269] 4. Providing feedback and insights
[0270] The server generates feedback and insights based on the user's input. This feedback is generated using a generative AI model. For example, if a user types, "I demonstrated leadership in a new project," the server generates the following feedback and sends it to the device: "That's great. Why do you think you demonstrated leadership?"
[0271] 5. Organizing and summarizing your diary
[0272] The server organizes the diary entries based on all the conversations and saves them as personalized content.
[0273] 6. Saving and displaying diary entries
[0274] The server saves the compiled diary in a database so that the user can access it later. The terminal displays a message to the user that saving is complete and redisplays the contents of the created diary as needed.
[0275] This system uses the OpenAI API as a generative AI model to analyze user input, generate prompts, and provide feedback. In addition, a Python program is implemented on the server and terminal.
[0276] The following are examples of prompts:
[0277] Please tell us specifically how you felt you grew today.
[0278]
[0279] That's great. Why do you think you were able to demonstrate leadership?
[0280] As described above, the system of the present invention can effectively support the user's diary writing and provide individually optimized feedback.
[0281] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0282] Step 1:
[0283] The terminal displays a login screen to the user and prompts them to enter their username and password. The user enters the username "test_user" and the password "secure_password." The input data is sent to the server.
[0284] Step 2:
[0285] The server checks the received login information with the authentication system. If authentication is successful, it returns a success response to the terminal to proceed to the next step. If authentication is unsuccessful, it returns an error message.
[0286] Input: Username and Password
[0287] Output: Authentication result
[0288] Step 3:
[0289] If user authentication is successful, the terminal displays a question to the user asking about their needs for reflection on that day. For example, the user might enter, "I would like to reflect on the things that I felt I grew from today," and the terminal sends that data to the server.
[0290] Step 4:
[0291] The server analyzes the received reflection content and uses a generative AI model to generate a corresponding prompt, such as "Please tell us about a specific event that made you feel like you grew," and returns it to the device.
[0292] Input: User's retrospective needs
[0293] Output: Generated prompt statement
[0294] Step 5:
[0295] The terminal displays the prompt received from the server to the user. The user inputs an appropriate response to the prompt, for example, "I was able to demonstrate leadership in a new project." The terminal then transmits the data to the server.
[0296] Step 6:
[0297] The server analyzes the user's response and uses a generative AI model to generate the next question or feedback comment, such as "That's great. Why do you think you demonstrated leadership?", and returns it to the device.
[0298] Input: User's answer
[0299] Output: Next prompt statement
[0300] Step 7:
[0301] The terminal displays the feedback received from the server and the next prompt to the user, and this process is repeated until the user has written enough diary entries.
[0302] Step 8:
[0303] The server organizes the diary entries into categories based on the content of all the conversations and compiles them in diary format.
[0304] Input: All dialogue
[0305] Output: Diary format data
[0306] Step 9:
[0307] The server saves the organized diary data in a database and then sends a message to the device indicating that the data has been saved.
[0308] Input: Diary-style data
[0309] Output: Save complete message
[0310] Step 10:
[0311] The terminal displays a save completion message from the server to the user, and redisplays the contents of the created diary as necessary.
[0312] This is the specific processing flow of this system. By utilizing a generative AI model to generate prompts and provide feedback based on user input, it is possible to effectively support users in writing their diary entries.
[0313] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0314] An embodiment of the present invention will be described. This system combines a generative AI and an emotion engine to assist users in writing their diary entries and reviewing their diary entries. Below, the program's processing will be explained in natural language, with specific examples provided for further details.
[0315] 1. User Authentication
[0316] 1. The terminal displays a login screen to the user and prompts them to enter their username and password.
[0317] Specifically, the login screen is rendered and the input fields are made accessible to the user.
[0318] 2. The user enters their username and password and clicks the login button.
[0319] Specifically, enter "login_user" and "secure_password" in the form and press the "Login" button.
[0320] 3. The terminal sends the entered login information to the server.
[0321] How it works: The username and password are sent to the server over HTTPS.
[0322] 4. The server verifies the received login information using the authentication system and returns the authentication result to the terminal.
[0323] Specifically, it verifies authentication information through a database query and generates a session ID if authentication is successful.
[0324] 5. If authentication is successful, the terminal redirects the user to the main screen; if not, it displays an error message.
[0325] Specifically, if successful, the main screen is rendered, and if unsuccessful, an error message is displayed on the screen.
[0326] 2. Gathering user needs
[0327] 1. The terminal displays a question to the user asking about the user's needs for the day's reflection.
[0328] Specifically, the prompt "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)" will be displayed.
[0329] 2. The user enters the content they want to review and clicks the send button.
[0330] Specifically, the user enters "Today I would like to reflect on the things in which I felt I have grown" in the input field and clicks the "Send" button.
[0331] 3. The terminal sends the user's input to the server.
[0332] Example of operation: Input data is sent to the server.
[0333] 4. The server analyzes the received feedback, generates a corresponding prompt, and returns it to the terminal.
[0334] Specifically, the generation AI analyzes the input text and generates a question such as, "Please tell us a specific event that made you feel like you grew."
[0335] 3. Diary writing support through dialogue
[0336] 1. The terminal displays the prompt received from the server to the user.
[0337] Specifically, a message will appear on the screen saying, "Please tell us a specific event that made you feel like you've grown."
[0338] 2. The user enters the appropriate answers to the prompts and clicks the submit button.
[0339] Specifically, enter "I demonstrated leadership in a new project" in the input field and click the "Submit" button.
[0340] 3. The terminal sends the user's answer to the server.
[0341] Example of operation: The input data is sent to the server again.
[0342] 4. The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the device. This process is repeated as many times as necessary.
[0343] Specifically, the server generates the following prompt: "That's great! How do you think you demonstrate leadership?"
[0344] 4. Providing feedback and insights
[0345] 1. The server generates feedback and insights based on the user's input and sends them to the device.
[0346] A specific action would be to generate feedback such as, "The specific explanation and division of roles led to the team's success. What was the reaction?"
[0347] 2. The device displays feedback and insights from the server to the user.
[0348] Example of operation: Feedback comments are displayed on the screen.
[0349] 5. Organizing and summarizing your diary
[0350] 1. The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[0351] Specifically, the following diary data is created and saved: "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up the roles. Result: The project progressed smoothly and everyone was cooperative."
[0352] 2. The server stores the generated diary data in a database.
[0353] Example of operation: Diary data is registered in the database.
[0354] 6. Saving and displaying diary entries
[0355] 1. The server sends a response to the device indicating that the diary entry was successfully saved.
[0356] Example of operation: A success message is sent to the terminal.
[0357] 2. The device displays a message to the user informing them that the diary entry has been saved.
[0358] Specifically, it displays the message "Your diary has been saved. Would you like to review today's review?"
[0359] 3. The terminal displays the contents of the diary created as needed to the user.
[0360] Example of operation: The saved diary contents are displayed on the screen.
[0361] 7. Emotion Recognition and Customization
[0362] 1. The server uses an emotion engine to analyze the emotions contained in the user's input.
[0363] Specifically, the emotion engine detects emotions such as "joy," "sadness," and "surprise" from the user's text.
[0364] 2. The server tailors feedback and insights based on the recognized emotions and sends them to the device.
[0365] For example, if a user expresses sadness, gentle feedback is provided: "That must be hard. Is there anything else you're concerned about?"
[0366] 3. The server customizes prompts based on the recognized emotion and sends them to the device.
[0367] Specifically, if the user expresses joy, a proactive prompt is provided: "Tell me more about that event!"
[0368] In this way, a diary entry support system that combines generative AI and an emotion engine allows users to write their diary entries through natural dialogue and periodically review them. By adding emotion recognition functionality, more personalized feedback and insights can be provided to users, promoting deeper self-understanding and growth.
[0369] The processing flow will be explained below.
[0370] Step 1:
[0371] The terminal displays a login screen to the user, prompting them to enter their username and password.
[0372] Specifically, a login screen is rendered, allowing the user to access the input fields.
[0373] Step 2:
[0374] The user enters the username and password and clicks the login button.
[0375] Specifically, enter "login_user" and "secure_password" in the form and press the "Login" button.
[0376] Step 3:
[0377] The terminal transmits the entered login information to the server.
[0378] Specifically, the username and password are sent to the server via HTTPS.
[0379] Step 4:
[0380] The server verifies the received login information using an authentication system and returns the authentication result to the terminal.
[0381] Specifically, it verifies authentication information through a database query and generates a session ID if authentication is successful.
[0382] Step 5:
[0383] If the authentication is successful, the terminal redirects the user to the main screen, and if it is unsuccessful, it displays an error message.
[0384] Specifically, if successful, the main screen is rendered, and if unsuccessful, an error message is displayed on the screen.
[0385] Step 6:
[0386] The terminal displays a question to the user asking about the user's needs for reviewing the day.
[0387] Specifically, the prompt "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)" will be displayed.
[0388] Step 7:
[0389] The user inputs the content they want to review and clicks the send button.
[0390] Specifically, the user enters "Today I would like to reflect on the things in which I felt I have grown" in the input field and clicks the "Send" button.
[0391] Step 8:
[0392] The terminal transmits the user's input to the server.
[0393] As a specific operation, the input data is sent to the server.
[0394] Step 9:
[0395] The server analyzes the received review content, generates a corresponding prompt, and returns it to the terminal.
[0396] Specifically, the generation AI analyzes the input text and generates a question such as, "Please tell us a specific event that made you feel like you grew."
[0397] Step 10:
[0398] The terminal displays the generated prompt to the user.
[0399] Specifically, a message will appear on the screen saying, "Please tell us a specific event that made you feel like you've grown."
[0400] Step 11:
[0401] The user enters the appropriate answers to the prompts and clicks the submit button.
[0402] Specifically, enter "I demonstrated leadership in a new project" in the input field and click the "Submit" button.
[0403] Step 12:
[0404] The terminal transmits the user's answer to the server.
[0405] Specifically, the input data is sent to the server again.
[0406] Step 13:
[0407] The server analyzes the user's responses and uses an emotion engine to recognize the emotions contained in the input.
[0408] Specifically, it detects the emotion "joy" from the text "I was able to demonstrate leadership in a new project."
[0409] Step 14:
[0410] The server tailors feedback and insights based on the emotions recognized by the emotion engine and returns them to the device.
[0411] A specific action would be to generate feedback based on the recognized emotion of "joy" such as, "That's great. What specific leadership skills did you demonstrate?"
[0412] Step 15:
[0413] The device displays feedback and insights to the user.
[0414] Specifically, feedback will appear on the screen saying, "That's great. What specific leadership skills did you demonstrate?"
[0415] Step 16:
[0416] The server customizes prompts according to the recognized emotions and sends them to the device.
[0417] Specifically, users who express joy are proactively prompted with, "Tell us more about what happened!"
[0418] Step 17:
[0419] The terminal displays a prompt to the user.
[0420] Specifically, a prompt will appear on the screen saying, "Tell us more about that event!"
[0421] Step 18:
[0422] The user responds to the prompts with further details and clicks the submit button.
[0423] Specifically, you would enter, "I explained things carefully to my team members and made sure that everyone was properly assigned roles," and then click the "Send" button.
[0424] Step 19:
[0425] The terminal sends the user's detailed response to the server.
[0426] As a specific operation, the input data is sent to the server.
[0427] Step 20:
[0428] The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[0429] Specifically, the conversation is categorized into categories such as "Today's growth," "Reasons," and "Results," and compiled in diary format.
[0430] Step 21:
[0431] The server stores the generated diary data in a database.
[0432] As a specific operation, diary data is registered in a database.
[0433] Step 22:
[0434] The server sends a response to the terminal indicating that the diary has been successfully saved.
[0435] As a specific operation, a save success message is sent to the terminal.
[0436] Step 23:
[0437] The terminal displays a message to the user informing them that the diary entry has been saved.
[0438] Specifically, the message "Your diary has been saved. Would you like to review today's review?" will be displayed.
[0439] Step 24:
[0440] The terminal displays the contents of the diary created as needed to the user.
[0441] Specifically, the contents of the saved diary are displayed on the screen.
[0442] Example 2
[0443] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0444] Conventional interactive diary creation systems have the problem that they do not take into account the user's emotions, provide uniform feedback and prompts, and do not provide personalized dialogue for each user, which does not improve the user experience.In addition, there is also the issue of not being able to flexibly respond to user needs when it comes to organizing and saving the dialogue content.
[0445] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for accepting input from a user, means for analyzing the input and generating a prompt sentence for prompting the next input, means for presenting the prompt sentence to the user, means for generating feedback and insight based on the user input, means for organizing the dialogue content and summarizing it in a diary format, means for saving the summarized diary, means for analyzing emotions included in the user input using an emotion engine, and means for adjusting the feedback and prompt sentences based on the recognized emotions. This allows for the provision of feedback and prompts personalized for each user, enabling a flexible and engaging user experience.
[0446] "User input" refers to information or data provided by a user of the system using an input device.
[0447] "Analysis" is the process of understanding the content and extracting meaning from data input by a user.
[0448] A "prompt sentence" is a question or guide text that prompts the user for the next input.
[0449] "Feedback" refers to the evaluations and comments that the system returns in response to input from the user.
[0450] "Insights" are the knowledge and advice that the system derives from the user's input data.
[0451] "Dialogue content" is a record of a series of messages and exchanges between a user and the system.
[0452] The "diary format" is a document format in which information entered by a user is compiled in the form of a diary.
[0453] "Storage" is the process of recording generated data in a storage device such as a database for long-term retention.
[0454] An "emotion engine" is a system that analyzes text input from a user and identifies the emotions contained therein.
[0455] "Analyzing" means structuring data and processing it to understand its meaning and sentiment.
[0456] "Adjustment" is the process of customizing content based on the analysis results and changing it into a format that is optimal for the user.
[0457] "User needs" are the specific requirements and expectations that users have of a system.
[0458] This invention is a system that utilizes a generative AI model and an emotion engine to support users in writing their diary entries and to allow them to review their diary entries. Specific embodiments of this system are described below.
[0459] Overall system configuration
[0460] This system consists of three main components: a server, a terminal, and a user. The server is responsible for data processing and analysis using a generative AI model and an emotion engine. The terminal provides the user interface and receives user input. The user interacts with the system through the terminal.
[0461] User Authentication
[0462] The terminal first displays a login screen to the user and prompts them to enter their username and password. This authenticates the user. Specifically, the login screen is constructed using HTML, CSS, and JavaScript to accept user input. The user enters their username and password on the login screen and clicks the "Login" button. This information is sent to the server via HTTPS.
[0463] Data analysis and prompt generation
[0464] The server checks the data sent by the user in the database, and if authentication is successful, generates a session ID. The terminal then confirms successful authentication of the user and proceeds to the next step. After the user logs in, the terminal displays a question to the user asking about their needs for reflection on that day. As a specific example, the prompt sentence used is "What would you like to reflect on today? (Example: Something that made you happy, something you felt you grew from)."
[0465] Diary writing through dialogue
[0466] The user enters what they want to reflect on and clicks the send button. For example, they might enter, "Today, I would like to reflect on something that made me feel like I grew." This input is then sent back to the server. The server analyzes the content and uses a generative AI model to generate an appropriate prompt. For example, a question might be generated: "Please tell me about a specific event that made you feel like you grew."
[0467] The terminal displays the generated prompt to the user, and the user responds by typing, for example, "I've demonstrated leadership in the new project." This sequence of interactions is repeated until the dialogue is complete.
[0468] Providing feedback and insights
[0469] The server generates feedback and insights based on the user's input. For example, it generates feedback such as, "The specific explanation and division of roles led to the team's success. What was the reaction?" The generated feedback is displayed to the user via the device.
[0470] Organizing and saving your diary
[0471] After the conversation is complete, the server organizes the diary entries into categories based on the content of the entire conversation and summarizes them in a diary format. For example, diary data can be created in the following format: "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative."
[0472] The generated diary data is saved in a database by the server. The user can then check the created diary at any time. The device notifies the user of a successful save message and displays the contents of the diary as needed. For example, it displays a message saying, "The diary has been saved. Would you like to check today's review?"
[0473] Emotion Recognition and Customization
[0474] The server uses an emotion engine to analyze the emotions contained in the user's input. For example, if a user enters an input such as "I felt very sad today," the emotion engine analyzes this text and recognizes the emotion "sad." Based on the recognized emotion, the server adjusts the feedback and prompt sentences. For example, if the user expresses sadness, the server may provide gentle feedback such as "That must have been difficult. Is there anything else that's bothering you?". Alternatively, if the user expresses joy, the server may provide a proactive prompt such as "Can you tell me more about that event?"
[0475] As described above, by utilizing a generative AI model and an emotion engine, the system provides personalized feedback and prompts to users, improving the user experience.
[0476] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0477] Step 1:
[0478] The terminal displays a login screen to the user and prompts them to enter a username and password. Specifically, you build the user interface using HTML and CSS, create input fields using JavaScript, accept the username and password as input, and obtain authentication data from the user as output.
[0479] Step 2:
[0480] The user enters a username and password and clicks the login button. For example, the username is "login_user" and the password is "secure_password". We provide the username and password as input and get the authentication information sent to the terminal as output.
[0481] Step 3:
[0482] The device sends the entered login information to the server. It uses JavaScript to send authentication information (user name and password) over HTTPS, receiving the authentication information as input and sending encrypted data as output to the server.
[0483] Step 4:
[0484] The server verifies the received login information with its authentication system and returns the authentication result to the device. Specifically, it uses an SQL query to match the username and password against a database. It uses the authentication information retrieved from the database as input and generates an authentication result (success or failure) as output.
[0485] Step 5:
[0486] The terminal redirects the user to the main screen if authentication is successful, or displays an error message if authentication is unsuccessful. Specifically, it uses HTML and JavaScript to render the screen, taking the authentication result as input and updating the user interface as output.
[0487] Step 6:
[0488] The terminal displays a question to the user asking about their needs for reflection on that day. Specifically, it uses an HTML form to display the prompt "What would you like to reflect on today? (e.g., something that made you happy, something you felt you grew from)." It receives the authentication success status as input and presents the question to the user as output.
[0489] Step 7:
[0490] The user inputs the content they want to reflect on and clicks the send button. For example, they might input, "Today, I would like to reflect on the things that I felt I grew from." They provide the content of their reflection as input, and obtain data to be sent to the terminal as output.
[0491] Step 8:
[0492] The device sends the user's input to the server. JavaScript is used to send the reflection content via HTTPS. It receives reflection data from the user as input and generates data to send to the server as output.
[0493] Step 9:
[0494] The server analyzes the received reflection content, generates a corresponding prompt sentence, and returns it to the device. Specifically, it uses a generative AI model to analyze the input text and generate a question such as, "Please tell us a specific event that made you feel like you grew." The reflection data is used as input, and the generated prompt sentence is obtained as output.
[0495] Step 10:
[0496] The terminal displays the prompt received from the server to the user. Specifically, it uses HTML and JavaScript to display the message "Please tell us a specific event that made you feel like you've grown." It receives the prompt as input and updates the user interface as output.
[0497] Step 11:
[0498] The user inputs an appropriate response to the prompt and clicks the submit button. For example, the user might input, "I demonstrated leadership in a new project." The user provides the response data as input and obtains the data to be sent to the terminal as output.
[0499] Step 12:
[0500] The device sends the user's answers to the server. JavaScript is used to send the answer data via HTTPS. The device receives the user's answer data as input and generates data to be sent to the server as output.
[0501] Step 13:
[0502] The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the device. This process is repeated as many times as necessary. Specifically, it uses a generative AI model to generate the next prompt and feedback comments. It uses the user's answer data as input and obtains the new prompt and feedback comments as output.
[0503] Step 14:
[0504] The server organizes the diary entries by topic based on all the dialogue content and compiles them in diary format. Specifically, it analyzes a series of dialogue data and creates diary data such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I carefully explained things to my team members and properly assigned roles. Result: The project progressed smoothly and everyone was cooperative." It uses dialogue data as input and generates diary data as output.
[0505] Step 15:
[0506] The server stores the generated diary data in a database. Specifically, it inserts the diary data into the database using an SQL query. It uses the diary data as input and generates data stored in the database as output.
[0507] Step 16:
[0508] The terminal displays a message to notify the user that the diary entry has been saved. Specifically, it uses HTML and JavaScript to display the message "Your diary entry has been saved. Would you like to check today's review?". It receives a database save success message as input and presents a notification message to the user as output.
[0509] Step 17:
[0510] The server uses an emotion engine to analyze the emotions contained in the user's input. Specifically, it uses natural language processing (NLP) techniques to identify emotions such as "joy," "sadness," and "surprise" from the user's text. It uses the user's text data as input and obtains recognized emotion data as output.
[0511] Step 18:
[0512] The server adjusts the feedback and prompts based on the recognized emotions and sends them to the device. Specifically, the generative AI model adjusts the feedback and prompts based on the results of the emotion engine. For example, if the user expresses sadness, it generates gentle feedback such as, "That must have been hard. Is there anything else bothering you?" It uses emotion data as input and generates adjusted feedback and prompts as output.
[0513] (Application example 2)
[0514] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0515] Conventional systems are unable to provide personalized support and feedback based on emotions when users write their diaries, and lack the ability to help users understand themselves, organize their emotions, or present appropriate related content. As a result, it has been difficult to provide an effective diary experience that responds to users' emotions and needs.
[0516] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0517] In this invention, the server includes means for accepting input from the user, means for analyzing the input and generating a prompt for the next input, and means for analyzing the diary content and the user's emotions and suggesting related content, thereby enabling personalized diary entry support according to the user's emotions and needs and effective presentation of related content.
[0518] 1. "Means for accepting input from the user" refers to the means by which the user inputs text, voice, etc. into the terminal.
[0519] 2. "Means for analyzing the input and generating a prompt for the next input" refers to means for analyzing the content of the user's input and, based on that, generating appropriate questions or instructions to prompt the user for the next step.
[0520] 3. "Means for presenting said prompt to a user" means means for displaying or presenting the generated prompt to a user.
[0521] 4. "Means for generating feedback and insights based on user input" refers to means for generating and providing feedback and insights based on user input.
[0522] 5. "Means for organizing the content of the dialogue and summarizing it in diary format" refers to a means for organizing the content of the dialogue with the user and recording it as a diary.
[0523] 6. "Means for storing the compiled diary" refers to means for storing the organized diary content in a database or the like.
[0524] 7. "Means for analyzing diary content and user emotions and suggesting related content" refers to means for analyzing diary content and user emotions and suggesting related content based on the results.
[0525] 8. "Means for presenting generated suggested content to a user" means means for displaying or providing suggested content to a user.
[0526] These definitions clarify the functions and roles of each element of the system.
[0527] An embodiment of the present invention is described below. This system combines a generative AI and an emotion engine to assist users in writing diary entries and reviewing their diary entries. The system analyzes user input, generates prompts based on the input, and presents them to the user to prompt for the next input. Furthermore, the system generates feedback and insights based on the user input, organizes the dialogue, and saves it in diary format. The system also analyzes the diary entries and the user's emotions, suggests related content, and presents it to the user.
[0528] Specifically, the system includes the following means:
[0529] 1. A means of accepting input from the user
[0530] The device provides the user with an input field and accepts text or voice input, and can be a smartphone or a head-mounted display.
[0531] 2. A means for analyzing the input and generating a prompt for the next input.
[0532] The server analyzes the user's input text and generates appropriate prompts for next steps, using a generative AI model to understand the input and generate relevant questions or instructions.
[0533] 3. Means for presenting said prompt to a user
[0534] The device displays the generated prompt on the screen. An example of the prompt is, "Please tell us a specific event that made you feel like you grew."
[0535] 4. A means of generating feedback and insights based on user input
[0536] The server analyzes the user's responses and provides feedback and insights. It uses an emotion engine to analyze the user's emotions and customizes the feedback accordingly.
[0537] 5. A method for organizing the content of conversations and compiling them in diary format
[0538] The server organizes the contents of the conversation with the user into items and compiles them into a diary, for example, in the format "Today's growth: I was able to demonstrate leadership in a new project."
[0539] 6. Means for saving the compiled diary
[0540] The server stores the organized diary in a database, allowing the user to review the saved diary at a later date.
[0541] 7. A method for analyzing diary content and user sentiment and suggesting related content
[0542] The server analyzes the diary entry and the recognized emotions, and suggests content (articles, videos, music, etc.) that matches the user's interests and needs. A generative AI model is used for the analysis. For example, "If a user writes a positive diary entry, we suggest positive articles."
[0543] 8. Means for presenting generated suggested content to users
[0544] The device presents the suggested content to the user, for example by displaying a message such as "Would you like to watch this video and relax?"
[0545] In this way, users can enjoy a better diary experience and content consumption through emotion-related content. For example, if a user writes, "I had a lot of fun today. I spent time with friends and shared many laughs," the system will suggest related content along with feedback such as, "You are feeling positive emotions. You might enjoy this article: 'How to Stay Positive'."
[0546] This invention is a system that supports the user's diary writing process, provides more personalized emotion-based feedback and insights, and can promote the user's self-understanding and growth.
[0547] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0548] Step 1:
[0549] The terminal displays a login screen to the user and prompts them to enter their username and password. This input is for user authentication, and the username and password are entered. When the user clicks the login button, the terminal sends the entered login information to the server.
[0550] Step 2:
[0551] The server verifies the received login information with its authentication system and returns the authentication result to the terminal. This authentication involves verifying the authentication information through a database query and generating a session ID if authentication is successful. If successful, the terminal redirects the user to the main screen, otherwise it displays an error message.
[0552] Step 3:
[0553] The terminal displays a question to the user asking about their reflection needs for the day. The user inputs the content they want to reflect on and clicks the send button. The input data includes the specific content of the user's reflection (e.g., "Today, I would like to reflect on the things that made me feel I grew"), and the input is sent to the server.
[0554] Step 4:
[0555] The server analyzes the received reflection content, generates a corresponding prompt, and returns it to the device. This analysis uses a generative AI model to generate an appropriate prompt based on the input text. For example, it generates a question such as, "Please tell us about a specific event that made you feel like you grew."
[0556] Step 5:
[0557] The terminal displays the prompts received from the server to the user. The user enters appropriate answers to the prompts and clicks the submit button. The terminal then sends the user's answers back to the server. This process involves repeated user input and server analysis.
[0558] Step 6:
[0559] The server analyzes the user's answers and generates the next question or feedback comment, which is returned to the device. This process can be repeated as many times as necessary. For example, the next prompt might be, "That's great. Why do you think you demonstrated leadership?"
[0560] Step 7:
[0561] The server organizes the diary entries based on all the conversations and summarizes them in a diary format, such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative."
[0562] Step 8:
[0563] The server saves the created diary data in the database. It sends a response indicating that the save was successful to the device. The device then displays a message to the user notifying them that the diary has been saved (e.g., "Your diary has been saved. Would you like to check today's review?").
[0564] Step 9:
[0565] The server uses an emotion engine to analyze the emotions contained in the user's input. This analysis uses a generative AI model to detect emotions such as "happiness," "sadness," and "surprise" from the text. Based on the recognized emotions, the server tailors feedback and insights and sends them to the device. For example, if the user expresses sadness, the server provides gentle feedback such as, "That must be hard. Is there anything else you're concerned about?"
[0566] Step 10:
[0567] The server then suggests content related to the emotion. For example, if a user writes a positive diary entry, it will suggest a positive article called "How to Stay Positive." If a negative emotion is recognized, it will suggest a meditation video for stress relief. The suggested content is then displayed on the device.
[0568] In this way, users can write their diary while receiving personalized feedback based on their emotions, and get an even richer experience through related content.
[0569] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0570] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0571] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0572] [Second embodiment]
[0573] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0574] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0575] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0576] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0577] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0578] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0579] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0580] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0581] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0582] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0583] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0584] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0585] An embodiment of the present invention will be described. This system uses a generation AI to assist users in writing their diary entries and reviewing their diary entries. Below, the program's processing will be explained in natural language, with specific examples provided to illustrate the details.
[0586] 1. User Authentication
[0587] 1. The terminal displays a login screen to the user and prompts them to enter their username and password.
[0588] Example: A login page appears, presenting fields for entering a "username" and "password."
[0589] 2. The user enters their username and password and clicks the login button.
[0590] Example: Enter "login_user" and "secure_password" and click the "Login" button.
[0591] 3. The terminal sends the entered login information to the server.
[0592] 4. The server verifies the received login information using the authentication system and returns the authentication result to the terminal.
[0593] Example: If authentication is successful, a message will be displayed informing you to proceed to the next step.
[0594] 2. Gathering user needs
[0595] 1. The terminal displays a question to the user asking about the user's needs for the day's reflection.
[0596] Example: The question "What would you like to reflect on today? (Example: Something that made you happy, something that made you feel you grew)" will be displayed.
[0597] 2. The user enters the content they want to review and clicks the send button.
[0598] Example: Type, "Today I would like to reflect on something that I felt I grew from," and click the "Send" button.
[0599] 3. The terminal sends the user's input to the server.
[0600] 4. The server analyzes the received feedback, generates a corresponding prompt, and returns it to the terminal.
[0601] Example: A prompt might be generated: "Tell me a specific event that made you feel like you grew."
[0602] 3. Diary writing support through dialogue
[0603] 1. The terminal displays the prompt received from the server to the user.
[0604] Example: The message displayed is, "Please tell us a specific event in which you felt you grew."
[0605] 2. The user enters the appropriate answers to the prompts and clicks the submit button.
[0606] Example: Type "I demonstrated leadership in a new project" and click the "Submit" button.
[0607] 3. The terminal sends the user's answer to the server.
[0608] 4. The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the device. This process is repeated as many times as necessary.
[0609] Example: The server generates the next question: "That's great! How do you think you demonstrated leadership?"
[0610] 4. Providing feedback and insights
[0611] 1. The server generates feedback and insights based on the user's input and sends them to the device.
[0612] Example: Feedback generated might include, "The specific explanations and role assignments led to the team's success. What was the reaction?"
[0613] 2. The device displays feedback and insights from the server to the user.
[0614] 5. Organizing and summarizing your diary
[0615] 1. The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[0616] Example: Diary-style data such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up the roles. Result: The project progressed smoothly and everyone was cooperative." is generated.
[0617] 2. The server stores the generated diary data in a database.
[0618] 6. Saving and displaying diary entries
[0619] 1. The server sends a response to the device indicating that the diary entry was successfully saved.
[0620] 2. The device displays a message to the user informing them that the diary entry has been saved.
[0621] Example: The message "Your diary entry has been saved. Would you like to review today's review?" will be displayed.
[0622] 3. The terminal displays the contents of the diary created as needed to the user.
[0623] These steps allow users to write their diary entries through natural dialogue and review them periodically. By utilizing generative AI, we can reduce the difficulty users face when writing a diary and promote their personal growth.
[0624] The processing flow will be explained below.
[0625] Step 1:
[0626] The terminal displays a login screen to the user, prompting them to enter their username and password.
[0627] Specifically, the login screen is rendered and the input fields are made accessible to the user.
[0628] Step 2:
[0629] The user enters the username and password and clicks the login button.
[0630] Specifically, enter "login_user" and "secure_password" in the form and press the "Login" button.
[0631] Step 3:
[0632] The terminal transmits the entered login information to the server.
[0633] Specifically, the username and password are sent to the server via HTTPS.
[0634] Step 4:
[0635] The server verifies the received login information using an authentication system and returns the authentication result to the terminal.
[0636] Specifically, it verifies authentication information through a database query and generates a session ID if authentication is successful.
[0637] Step 5:
[0638] If the authentication is successful, the terminal redirects the user to the main screen, and if it is unsuccessful, it displays an error message.
[0639] Specifically, if successful, the main screen is rendered, and if unsuccessful, an error message is displayed on the screen.
[0640] Step 6:
[0641] The terminal displays a question to the user asking about the user's needs for reviewing the day.
[0642] Specifically, the prompt "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)" will be displayed.
[0643] Step 7:
[0644] The user inputs the content they want to review and clicks the send button.
[0645] Specifically, the user enters "Today I would like to reflect on the things in which I felt I have grown" in the input field and clicks the "Send" button.
[0646] Step 8:
[0647] The terminal transmits the user's input to the server.
[0648] As a specific operation, the input data is sent to the server.
[0649] Step 9:
[0650] The server analyzes the received review content, generates a corresponding prompt, and returns it to the terminal.
[0651] Specifically, the generation AI analyzes the input text and generates a question such as, "Please tell us a specific event that made you feel like you grew."
[0652] Step 10:
[0653] The terminal displays the generated prompt to the user.
[0654] Specifically, a message will appear on the screen saying, "Please tell us a specific event that made you feel like you've grown."
[0655] Step 11:
[0656] The user enters the appropriate answers to the prompts and clicks the submit button.
[0657] Specifically, enter "I demonstrated leadership in a new project" in the input field and click the "Submit" button.
[0658] Step 12:
[0659] The terminal transmits the user's answer to the server.
[0660] Specifically, the input data is sent to the server again.
[0661] Step 13:
[0662] The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the terminal.
[0663] The specific behavior is to generate the following prompt: "That's great! Why do you think that demonstrates leadership?"
[0664] Step 14:
[0665] The terminal displays the feedback and insights received from the server to the user.
[0666] Specifically, the feedback comments are displayed on the screen.
[0667] Step 15:
[0668] The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[0669] Specifically, the following diary data is created and saved: "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up the roles. Result: The project progressed smoothly and everyone was cooperative."
[0670] Step 16:
[0671] The server stores the generated diary data in a database.
[0672] As a specific operation, diary data is registered in a database.
[0673] Step 17:
[0674] The server sends a response to the terminal indicating that the diary has been successfully saved.
[0675] Specifically, a success message is sent to the terminal.
[0676] Step 18:
[0677] The terminal displays a message to the user informing them that the diary entry has been saved.
[0678] Specifically, it displays the message "Your diary has been saved. Would you like to review today's review?"
[0679] Step 19:
[0680] The terminal displays the contents of the diary created as needed to the user.
[0681] Specifically, the contents of the saved diary are displayed on the screen.
[0682] Example 1
[0683] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0684] Previous diary entry support systems lacked the ability to effectively analyze user input and generate appropriate prompts to address individual reflection needs. They also struggled to provide feedback and insights to users, and the process of organizing dialogue content into diary format was laborious. Furthermore, they lacked the ability to categorize diary content for easy future reference, and the ability to collect users' reflection needs.
[0685] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0686] In this invention, the server includes means for accepting input from a user, means for analyzing the input and generating a prompt for the next input, and means for presenting the prompt to the user, thereby enabling generation of an appropriate prompt using a generative AI model.
[0687] "Means for accepting input from the user" is a function that provides an interface for the user to input information to the system.
[0688] The "means for analyzing the input and generating a prompt for the next input" is a function that analyzes the received user input and generates questions and instructions to accurately guide the user to the next information that they should enter.
[0689] The "means for presenting the prompt to the user" is a function for visually or audibly presenting the generated prompt to the user.
[0690] The "means for generating feedback and insights based on user input" is a function that generates appropriate feedback and analysis results based on the user's input and provides them to the user.
[0691] The "means for organizing the contents of the dialogue and summarizing them in a diary format" is a function for organizing information obtained through a dialogue with a user and summarizing it in a diary format based on a specific format.
[0692] The "means for saving the compiled diary" is a function for saving the created diary data in a storage such as a database.
[0693] "Means for generating the prompt using a generative AI model" refers to a function that utilizes an artificial intelligence model to automatically generate the prompt.
[0694] The "means for classifying the diary content entered by the user into categories" is a function for classifying the diary content entered by the user into specific categories or items.
[0695] The "means for collecting the user's reflection needs" is a function for collecting the user's objectives and requests when writing a diary.
[0696] This invention is a system for assisting users in effectively writing and reviewing their diary entries, and specifically, it utilizes a generative AI model to generate prompts and provide feedback and insights to the user. The following describes in detail the embodiments of the invention.
[0697] Hardware and Software
[0698] This system uses the following hardware and software:
[0699] Device: A device (e.g., computer, smartphone, tablet) that provides a user interface (UI) that runs on a web browser.
[0700] Server: The server receives user input, analyzes it, generates feedback and prompts. It also includes storage for saving the diary using a database.
[0701] Generative AI models: AI models that perform natural language processing (e.g., GPT-3).
[0702] Program processing
[0703] A user first accesses the system through a browser on their device. The device displays a login screen and prompts the user to enter their username and password. After the user enters these and clicks the login button, the device sends the information to the server. The server verifies this information using the authentication system and returns the authentication result.
[0704] If the authentication is successful, the device then displays a question to the user asking about their needs for reflection that day. For example, the question might be, "What would you like to reflect on today? (Example: Something that made you happy, something that made you feel you have grown)." If the user enters "I would like to reflect on something that made me feel I have grown today," and clicks the send button, the device sends the input to the server.
[0705] The server analyzes the received input using a generative AI model and generates the next prompt the user should enter. For example, a prompt might be generated such as, "Please tell us a specific event that made you feel like you grew." The device then displays this prompt to the user, who then enters the information again. For example, the user might enter, "I was able to demonstrate leadership in a new project," and click the send button.
[0706] The server analyzes this response and generates further questions and feedback. By repeating this process multiple times, the diary entry progresses through dialogue. The server generates feedback and insights based on the user's input, such as "The specific explanation and division of roles led to the team's success. What was the reaction?" and sends this feedback to the device.
[0707] Finally, the server organizes the diary entries into categories based on all the conversations and compiles them into a diary format. For example, it generates diary-format data such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I carefully explained things to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative." The generated diary data is then saved in a database by the server.
[0708] The device receives a message from the server saying, "Your diary entry has been saved. Would you like to check today's review?" and notifies the user. If necessary, the device displays the saved diary entry to the user.
[0709] Through these processes, users can write their diary through natural dialogue and use generative AI to conduct effective self-reflection. This invention enables users to improve the quality of their daily self-reflection.
[0710] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0711] Step 1: User authentication
[0712] Input: Username, Password
[0713] Processing: The terminal displays a login screen to the user, prompting them to enter their username and password. The user enters these and clicks the login button.
[0714] Data processing: The information entered by the user is sent to the server as an HTTP POST request.
[0715] Output: The authentication information is sent to the server.
[0716] Specific behavior: The terminal displays a login form in the web browser and provides input fields for the username and password. The user enters "login_user" and "secure_password" and clicks the login button.
[0717] Step 2: Returning the authentication result
[0718] Input: Credentials
[0719] Processing: The server verifies the received login information using the authentication system and returns the authentication result to the terminal.
[0720] Data processing: Call the authentication API and parse the response.
[0721] Output: The authentication result is returned to the terminal.
[0722] Specific operation: The server performs authentication using an authentication system (e.g., OAuth 2.0 or LDAP), generates a success or failure message, and returns it to the terminal in JSON format.
[0723] Step 3: Reflection and gathering needs
[0724] Input: Authentication result
[0725] Processing: If authentication is successful, the device displays a question to the user asking about their reflection needs for the day.
[0726] Data processing: Generate a question form and present it to the user.
[0727] Output: User's retrospective needs
[0728] Specific operation: The device displays the question "What would you like to reflect on today?", and the user enters "Today I would like to reflect on something that I felt I grew from," and clicks the send button.
[0729] Step 4: Submitting your retrospective needs
[0730] Input: User's reflection needs
[0731] Processing: The terminal sends the user's input to the server.
[0732] Data processing: The user-entered retrospective needs are sent as an HTTP POST request.
[0733] Output: A lookup request is sent to the server.
[0734] Specific behavior: Generates and sends an HTTP request to send the content entered in the text box to the server.
[0735] Step 5: Generate prompts
[0736] Input: User's reflection needs
[0737] Processing: The server analyzes the received reflection content using the generative AI model and generates a prompt sentence.
[0738] Data processing: Input reflection needs into the AI model to generate appropriate prompts.
[0739] Output: Generated prompt statement
[0740] Specific operation: The server inputs the reflection content (e.g., "Today, I would like to reflect on something that made me feel like I grew") into the AI model, generates a prompt saying, "Please tell us about a specific event that made you feel like you grew," and returns it to the device.
[0741] Step 6: Display a prompt
[0742] Input: prompt statement
[0743] Processing: The terminal displays the prompt received from the server to the user.
[0744] Data processing: The generated prompt text is displayed on the screen.
[0745] Output: The user is prompted.
[0746] Specific action: The device will display the prompt on the screen: "Please tell us a specific event that made you feel like you grew."
[0747] Step 7: Answer the prompts
[0748] Input: prompt statement
[0749] Action: The user enters the appropriate response to the prompt and clicks the submit button.
[0750] Data processing: User answers are sent as HTTP POST requests.
[0751] Output: The user's answer is sent to the server.
[0752] Specific action: Enter "I demonstrated leadership in a new project" in the text box and click the submit button.
[0753] Step 8: Generate your next question or feedback
[0754] Input: User's answer
[0755] Processing: The server analyzes the user's answers and uses the generative AI model to generate the next question and feedback comments.
[0756] Data transformation: Input answers into AI models to generate new questions and feedback.
[0757] Output: New question or feedback statement
[0758] Specific behavior: The server generates the next question, "That's great. Why do you think that demonstrates leadership?", and returns it to the device. This process is repeated as many times as necessary.
[0759] Step 9: View your feedback
[0760] Input: Feedback statement
[0761] Processing: The device displays feedback and insights from the server to the user.
[0762] Data processing: Feedback statements are displayed on the screen.
[0763] Output: Feedback is displayed to the user.
[0764] Specific action: The device displays feedback on the screen, such as, "The specific explanation and division of roles led to the team's success. What was the reaction?"
[0765] Step 10: Organize and summarize your diary
[0766] Input: Dialogue
[0767] Processing: The server organizes the diary entries into categories based on all the conversations and compiles them into a diary format.
[0768] Data processing: The conversation content is retrieved from the database, formatted, and compiled into a diary.
[0769] Output: Generated diary data
[0770] Specific behavior: The server generates specific diary data (e.g., "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative.").
[0771] Step 11: Save diary data
[0772] Input: Generated diary data
[0773] Processing: The server saves the generated diary data in a database.
[0774] Data processing: Diary data is saved in the database using an INSERT query.
[0775] Output: Diary data is saved.
[0776] Specific operation: The server creates an INSERT query and saves the diary data to the database.
[0777] Step 12: Save complete notification
[0778] Input: Saved Results
[0779] Processing: The server sends a response to the device indicating that the diary entry has been saved successfully.
[0780] Data processing: Generate a save success message and send it as a JSON response.
[0781] Output: A save success message is sent to the terminal.
[0782] Specific behavior: A JSON response message saying "Your diary entry has been saved. Would you like to review today's review?" is sent to the device.
[0783] Step 13: Notify users
[0784] Input: Save successful message
[0785] Processing: The device displays a message to the user informing them that the diary entry has been saved.
[0786] Data processing: Display the message on the screen.
[0787] Output: A notification is displayed to the user.
[0788] What it does: Your device will display a pop-up notification saying, "Your diary has been saved. Would you like to review today's review?"
[0789] Step 14: Displaying diary entries
[0790] Input: User request
[0791] Processing: The terminal displays the contents of the diary created as needed to the user.
[0792] Data processing: Retrieve diary contents from the database and display them on the screen.
[0793] Output: The user can check the diary contents.
[0794] Specific operation: The device displays the saved diary entry on the user interface, allowing the user to check the contents.
[0795] Through the above processing steps, users can utilize the generative AI model to effectively write and review their diary entries.
[0796] (Application example 1)
[0797] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0798] Conventional user diary writing systems require users to write voluntarily, making it difficult to maintain motivation. They also lack support for effective daily reflection, leaving users with few opportunities to grow and gain new insights. Furthermore, they lack personalized feedback and insights using generative AI, making it difficult to provide optimal content tailored to individual users' needs. A new system is needed to solve these issues.
[0799] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0800] In this invention, the server includes a means for collecting the user's reflection needs, a means for generating prompt sentences using a generative AI model to prompt the next input, and a means for delivering the diary as personalized content. This makes it possible to provide effective support to the user and increase their motivation to write in the diary. In addition, by providing the user with individually optimized feedback and insights, it is possible to promote deeper self-understanding and growth. This makes it possible to effectively carry out daily reflection and support the user's growth.
[0801] "User authentication" is the process by which a user enters a username and password to access a system, and the information is verified to authenticate the user as a legitimate user.
[0802] "Reflection needs" refers to specific themes or items that a user wants to reflect on regarding the events that they experienced or the feelings they had that day.
[0803] A "generative AI model" refers to an artificial intelligence model that uses natural language processing techniques to analyze user input and generate appropriate feedback and prompts.
[0804] A "prompt sentence" refers to a guideline or question sentence that is generated to prompt the user for the next input.
[0805] "Personalized content" refers to customized information and feedback that is optimized to a user's individual needs and inputs.
[0806] "Content distribution" refers to the process of transmitting information to provide generated journal entries and feedback to users.
[0807] A "smartphone" refers to a mobile phone terminal that can connect to the Internet and use multi-function applications.
[0808] The present invention is a system that uses a generative AI model to assist users in writing and reviewing their diary entries. The system aims to provide personalized feedback and insights according to the user's needs, and to organize and store the diary. The following describes in detail the mode for implementing the invention.
[0809] 1. User Authentication
[0810] The server provides an authentication function for users to access the system. The terminal displays a login screen to the user and prompts them to enter their username and password. When the user enters the login information, the information is sent to the server, which then authenticates it using the authentication system.
[0811] 2. Gathering user needs
[0812] The server generates prompts to gather the user's reflection needs and presents them to the user through the terminal. For example, the terminal displays a question to the user such as, "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)." The user inputs what they want to reflect on, and the information is sent to the server.
[0813] 3. Diary writing support through dialogue
[0814] The server analyzes the received reflection content and generates the next prompt using a generative AI model. The generated prompt is sent to the device and displayed to the user. For example, a message might be displayed such as, "Please tell us a specific event that made you feel like you grew." The user then enters an appropriate response, which is then sent back to the server. The server repeats this process multiple times to assist the user in writing their diary.
[0815] 4. Providing feedback and insights
[0816] The server generates feedback and insights based on the user's input. This feedback is generated using a generative AI model. For example, if a user types, "I demonstrated leadership in a new project," the server generates the following feedback and sends it to the device: "That's great. Why do you think you demonstrated leadership?"
[0817] 5. Organizing and summarizing your diary
[0818] The server organizes the diary entries based on all the conversations and saves them as personalized content.
[0819] 6. Saving and displaying diary entries
[0820] The server saves the compiled diary in a database so that the user can access it later. The terminal displays a message to the user that saving is complete and redisplays the contents of the created diary as needed.
[0821] This system uses the OpenAI API as a generative AI model to analyze user input, generate prompts, and provide feedback. In addition, a Python program is implemented on the server and terminal.
[0822] The following are examples of prompts:
[0823] Please tell us specifically how you felt you grew today.
[0824]
[0825] That's great. Why do you think you were able to demonstrate leadership?
[0826] As described above, the system of the present invention can effectively support the user's diary writing and provide individually optimized feedback.
[0827] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0828] Step 1:
[0829] The terminal displays a login screen to the user and prompts them to enter their username and password. The user enters the username "test_user" and the password "secure_password." The input data is sent to the server.
[0830] Step 2:
[0831] The server checks the received login information with the authentication system. If authentication is successful, it returns a success response to the terminal to proceed to the next step. If authentication is unsuccessful, it returns an error message.
[0832] Input: Username and Password
[0833] Output: Authentication result
[0834] Step 3:
[0835] If user authentication is successful, the terminal displays a question to the user asking about their needs for reflection on that day. For example, the user might enter, "I would like to reflect on the things that I felt I grew from today," and the terminal sends that data to the server.
[0836] Step 4:
[0837] The server analyzes the received reflection content and uses a generative AI model to generate a corresponding prompt, such as "Please tell us about a specific event that made you feel like you grew," and returns it to the device.
[0838] Input: User's retrospective needs
[0839] Output: Generated prompt statement
[0840] Step 5:
[0841] The terminal displays the prompt received from the server to the user. The user inputs an appropriate response to the prompt, for example, "I was able to demonstrate leadership in a new project." The terminal then transmits the data to the server.
[0842] Step 6:
[0843] The server analyzes the user's response and uses a generative AI model to generate the next question or feedback comment, such as "That's great. Why do you think you demonstrated leadership?", and returns it to the device.
[0844] Input: User's answer
[0845] Output: Next prompt statement
[0846] Step 7:
[0847] The terminal displays the feedback received from the server and the next prompt to the user, and this process is repeated until the user has written enough diary entries.
[0848] Step 8:
[0849] The server organizes the diary entries into categories based on the content of all the conversations and compiles them in diary format.
[0850] Input: All dialogue
[0851] Output: Diary format data
[0852] Step 9:
[0853] The server saves the organized diary data in a database and then sends a message to the device indicating that the data has been saved.
[0854] Input: Diary-style data
[0855] Output: Save complete message
[0856] Step 10:
[0857] The terminal displays a save completion message from the server to the user, and redisplays the contents of the created diary as necessary.
[0858] This is the specific processing flow of this system. By utilizing a generative AI model to generate prompts and provide feedback based on user input, it is possible to effectively support users in writing their diary entries.
[0859] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0860] An embodiment of the present invention will be described. This system combines a generative AI and an emotion engine to assist users in writing their diary entries and reviewing their diary entries. Below, the program's processing will be explained in natural language, with specific examples provided for further details.
[0861] 1. User Authentication
[0862] 1. The terminal displays a login screen to the user and prompts them to enter their username and password.
[0863] Specifically, the login screen is rendered and the input fields are made accessible to the user.
[0864] 2. The user enters their username and password and clicks the login button.
[0865] Specifically, enter "login_user" and "secure_password" in the form and press the "Login" button.
[0866] 3. The terminal sends the entered login information to the server.
[0867] How it works: The username and password are sent to the server over HTTPS.
[0868] 4. The server verifies the received login information using the authentication system and returns the authentication result to the terminal.
[0869] Specifically, it verifies authentication information through a database query and generates a session ID if authentication is successful.
[0870] 5. If authentication is successful, the terminal redirects the user to the main screen; if not, it displays an error message.
[0871] Specifically, if successful, the main screen is rendered, and if unsuccessful, an error message is displayed on the screen.
[0872] 2. Gathering user needs
[0873] 1. The terminal displays a question to the user asking about the user's needs for the day's reflection.
[0874] Specifically, the prompt "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)" will be displayed.
[0875] 2. The user enters the content they want to review and clicks the send button.
[0876] Specifically, the user enters "Today I would like to reflect on the things in which I felt I have grown" in the input field and clicks the "Send" button.
[0877] 3. The terminal sends the user's input to the server.
[0878] Example of operation: Input data is sent to the server.
[0879] 4. The server analyzes the received feedback, generates a corresponding prompt, and returns it to the terminal.
[0880] Specifically, the generation AI analyzes the input text and generates a question such as, "Please tell us a specific event that made you feel like you grew."
[0881] 3. Diary writing support through dialogue
[0882] 1. The terminal displays the prompt received from the server to the user.
[0883] Specifically, a message will appear on the screen saying, "Please tell us a specific event that made you feel like you've grown."
[0884] 2. The user enters the appropriate answers to the prompts and clicks the submit button.
[0885] Specifically, enter "I demonstrated leadership in a new project" in the input field and click the "Submit" button.
[0886] 3. The terminal sends the user's answer to the server.
[0887] Example of operation: The input data is sent to the server again.
[0888] 4. The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the device. This process is repeated as many times as necessary.
[0889] Specifically, the server generates the following prompt: "That's great! How do you think you demonstrate leadership?"
[0890] 4. Providing feedback and insights
[0891] 1. The server generates feedback and insights based on the user's input and sends them to the device.
[0892] A specific action would be to generate feedback such as, "The specific explanation and division of roles led to the team's success. What was the reaction?"
[0893] 2. The device displays feedback and insights from the server to the user.
[0894] Example of operation: Feedback comments are displayed on the screen.
[0895] 5. Organizing and summarizing your diary
[0896] 1. The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[0897] Specifically, the following diary data is created and saved: "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up the roles. Result: The project progressed smoothly and everyone was cooperative."
[0898] 2. The server stores the generated diary data in a database.
[0899] Example of operation: Diary data is registered in the database.
[0900] 6. Saving and displaying diary entries
[0901] 1. The server sends a response to the device indicating that the diary entry was successfully saved.
[0902] Example of operation: A success message is sent to the terminal.
[0903] 2. The device displays a message to the user informing them that the diary entry has been saved.
[0904] Specifically, it displays the message "Your diary has been saved. Would you like to review today's review?"
[0905] 3. The terminal displays the contents of the diary created as needed to the user.
[0906] Example of operation: The saved diary contents are displayed on the screen.
[0907] 7. Emotion Recognition and Customization
[0908] 1. The server uses an emotion engine to analyze the emotions contained in the user's input.
[0909] Specifically, the emotion engine detects emotions such as "joy," "sadness," and "surprise" from the user's text.
[0910] 2. The server tailors feedback and insights based on the recognized emotions and sends them to the device.
[0911] For example, if a user expresses sadness, gentle feedback is provided: "That must be hard. Is there anything else you're concerned about?"
[0912] 3. The server customizes prompts based on the recognized emotion and sends them to the device.
[0913] Specifically, if the user expresses joy, a proactive prompt is provided: "Tell me more about that event!"
[0914] In this way, a diary entry support system that combines generative AI and an emotion engine allows users to write their diary entries through natural dialogue and periodically review them. By adding emotion recognition functionality, more personalized feedback and insights can be provided to users, promoting deeper self-understanding and growth.
[0915] The processing flow will be explained below.
[0916] Step 1:
[0917] The terminal displays a login screen to the user, prompting them to enter their username and password.
[0918] Specifically, a login screen is rendered, allowing the user to access the input fields.
[0919] Step 2:
[0920] The user enters the username and password and clicks the login button.
[0921] Specifically, enter "login_user" and "secure_password" in the form and press the "Login" button.
[0922] Step 3:
[0923] The terminal transmits the entered login information to the server.
[0924] Specifically, the username and password are sent to the server via HTTPS.
[0925] Step 4:
[0926] The server verifies the received login information using an authentication system and returns the authentication result to the terminal.
[0927] Specifically, it verifies authentication information through a database query and generates a session ID if authentication is successful.
[0928] Step 5:
[0929] If the authentication is successful, the terminal redirects the user to the main screen, and if it is unsuccessful, it displays an error message.
[0930] Specifically, if successful, the main screen is rendered, and if unsuccessful, an error message is displayed on the screen.
[0931] Step 6:
[0932] The terminal displays a question to the user asking about the user's needs for reviewing the day.
[0933] Specifically, the prompt "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)" will be displayed.
[0934] Step 7:
[0935] The user inputs the content they want to review and clicks the send button.
[0936] Specifically, the user enters "Today I would like to reflect on the things in which I felt I have grown" in the input field and clicks the "Send" button.
[0937] Step 8:
[0938] The terminal transmits the user's input to the server.
[0939] As a specific operation, the input data is sent to the server.
[0940] Step 9:
[0941] The server analyzes the received review content, generates a corresponding prompt, and returns it to the terminal.
[0942] Specifically, the generation AI analyzes the input text and generates a question such as, "Please tell us a specific event that made you feel like you grew."
[0943] Step 10:
[0944] The terminal displays the generated prompt to the user.
[0945] Specifically, a message will appear on the screen saying, "Please tell us a specific event that made you feel like you've grown."
[0946] Step 11:
[0947] The user enters the appropriate answers to the prompts and clicks the submit button.
[0948] Specifically, enter "I demonstrated leadership in a new project" in the input field and click the "Submit" button.
[0949] Step 12:
[0950] The terminal transmits the user's answer to the server.
[0951] Specifically, the input data is sent to the server again.
[0952] Step 13:
[0953] The server analyzes the user's responses and uses an emotion engine to recognize the emotions contained in the input.
[0954] Specifically, it detects the emotion "joy" from the text "I was able to demonstrate leadership in a new project."
[0955] Step 14:
[0956] The server tailors feedback and insights based on the emotions recognized by the emotion engine and returns them to the device.
[0957] A specific action would be to generate feedback based on the recognized emotion of "joy" such as, "That's great. What specific leadership skills did you demonstrate?"
[0958] Step 15:
[0959] The device displays feedback and insights to the user.
[0960] Specifically, feedback will appear on the screen saying, "That's great. What specific leadership skills did you demonstrate?"
[0961] Step 16:
[0962] The server customizes prompts according to the recognized emotions and sends them to the device.
[0963] Specifically, users who express joy are proactively prompted with, "Tell us more about what happened!"
[0964] Step 17:
[0965] The terminal displays a prompt to the user.
[0966] Specifically, a prompt will appear on the screen saying, "Tell us more about that event!"
[0967] Step 18:
[0968] The user responds to the prompts with further details and clicks the submit button.
[0969] Specifically, you would enter, "I explained things carefully to my team members and made sure that everyone was properly assigned roles," and then click the "Send" button.
[0970] Step 19:
[0971] The terminal sends the user's detailed response to the server.
[0972] As a specific operation, the input data is sent to the server.
[0973] Step 20:
[0974] The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[0975] Specifically, the conversation is categorized into categories such as "Today's growth," "Reasons," and "Results," and compiled in diary format.
[0976] Step 21:
[0977] The server stores the generated diary data in a database.
[0978] As a specific operation, diary data is registered in a database.
[0979] Step 22:
[0980] The server sends a response to the terminal indicating that the diary has been successfully saved.
[0981] As a specific operation, a save success message is sent to the terminal.
[0982] Step 23:
[0983] The terminal displays a message to the user informing them that the diary entry has been saved.
[0984] Specifically, the message "Your diary has been saved. Would you like to review today's review?" will be displayed.
[0985] Step 24:
[0986] The terminal displays the contents of the diary created as needed to the user.
[0987] Specifically, the contents of the saved diary are displayed on the screen.
[0988] Example 2
[0989] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0990] Conventional interactive diary creation systems have the problem that they do not take into account the user's emotions, provide uniform feedback and prompts, and do not provide personalized dialogue for each user, which does not improve the user experience.In addition, there is also the issue of not being able to flexibly respond to user needs when it comes to organizing and saving the dialogue content.
[0991] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for accepting input from a user, means for analyzing the input and generating a prompt sentence for prompting the next input, means for presenting the prompt sentence to the user, means for generating feedback and insight based on the user input, means for organizing the dialogue content and summarizing it in a diary format, means for saving the summarized diary, means for analyzing emotions included in the user input using an emotion engine, and means for adjusting the feedback and prompt sentences based on the recognized emotions. This allows for the provision of feedback and prompts personalized for each user, enabling a flexible and engaging user experience.
[0992] "User input" refers to information or data provided by a user of the system using an input device.
[0993] "Analysis" is the process of understanding the content and extracting meaning from data input by a user.
[0994] A "prompt sentence" is a question or guide text that prompts the user for the next input.
[0995] "Feedback" refers to the evaluations and comments that the system returns in response to input from the user.
[0996] "Insights" are the knowledge and advice that the system derives from the user's input data.
[0997] "Dialogue content" is a record of a series of messages and exchanges between a user and the system.
[0998] The "diary format" is a document format in which information entered by a user is compiled in the form of a diary.
[0999] "Storage" is the process of recording generated data in a storage device such as a database for long-term retention.
[1000] An "emotion engine" is a system that analyzes text input from a user and identifies the emotions contained therein.
[1001] "Analyzing" means structuring data and processing it to understand its meaning and sentiment.
[1002] "Adjustment" is the process of customizing content based on the analysis results and changing it into a format that is optimal for the user.
[1003] "User needs" are the specific requirements and expectations that users have of a system.
[1004] This invention is a system that utilizes a generative AI model and an emotion engine to support users in writing their diary entries and to allow them to review their diary entries. Specific embodiments of this system are described below.
[1005] Overall system configuration
[1006] This system consists of three main components: a server, a terminal, and a user. The server is responsible for data processing and analysis using a generative AI model and an emotion engine. The terminal provides the user interface and receives user input. The user interacts with the system through the terminal.
[1007] User Authentication
[1008] The terminal first displays a login screen to the user and prompts them to enter their username and password. This authenticates the user. Specifically, the login screen is constructed using HTML, CSS, and JavaScript to accept user input. The user enters their username and password on the login screen and clicks the "Login" button. This information is sent to the server via HTTPS.
[1009] Data analysis and prompt generation
[1010] The server checks the data sent by the user in the database, and if authentication is successful, generates a session ID. The terminal then confirms successful authentication of the user and proceeds to the next step. After the user logs in, the terminal displays a question to the user asking about their needs for reflection on that day. As a specific example, the prompt sentence used is "What would you like to reflect on today? (Example: Something that made you happy, something you felt you grew from)."
[1011] Diary writing through dialogue
[1012] The user enters what they want to reflect on and clicks the send button. For example, they might enter, "Today, I would like to reflect on something that made me feel like I grew." This input is then sent back to the server. The server analyzes the content and uses a generative AI model to generate an appropriate prompt. For example, a question might be generated: "Please tell me about a specific event that made you feel like you grew."
[1013] The terminal displays the generated prompt to the user, and the user responds by typing, for example, "I've demonstrated leadership in the new project." This sequence of interactions is repeated until the dialogue is complete.
[1014] Providing feedback and insights
[1015] The server generates feedback and insights based on the user's input. For example, it generates feedback such as, "The specific explanation and division of roles led to the team's success. What was the reaction?" The generated feedback is displayed to the user via the device.
[1016] Organizing and saving your diary
[1017] After the conversation is complete, the server organizes the diary entries into categories based on the content of the entire conversation and summarizes them in a diary format. For example, diary data can be created in the following format: "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative."
[1018] The generated diary data is saved in a database by the server. The user can then check the created diary at any time. The device notifies the user of a successful save message and displays the contents of the diary as needed. For example, it displays a message saying, "The diary has been saved. Would you like to check today's review?"
[1019] Emotion Recognition and Customization
[1020] The server uses an emotion engine to analyze the emotions contained in the user's input. For example, if a user enters an input such as "I felt very sad today," the emotion engine analyzes this text and recognizes the emotion "sad." Based on the recognized emotion, the server adjusts the feedback and prompt sentences. For example, if the user expresses sadness, the server may provide gentle feedback such as "That must have been difficult. Is there anything else that's bothering you?". Alternatively, if the user expresses joy, the server may provide a proactive prompt such as "Can you tell me more about that event?"
[1021] As described above, by utilizing a generative AI model and an emotion engine, the system provides personalized feedback and prompts to users, improving the user experience.
[1022] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1023] Step 1:
[1024] The terminal displays a login screen to the user and prompts them to enter a username and password. Specifically, you build the user interface using HTML and CSS, create input fields using JavaScript, accept the username and password as input, and obtain authentication data from the user as output.
[1025] Step 2:
[1026] The user enters a username and password and clicks the login button. For example, the username is "login_user" and the password is "secure_password". We provide the username and password as input and get the authentication information sent to the terminal as output.
[1027] Step 3:
[1028] The device sends the entered login information to the server. It uses JavaScript to send authentication information (user name and password) over HTTPS, receiving the authentication information as input and sending encrypted data as output to the server.
[1029] Step 4:
[1030] The server verifies the received login information with its authentication system and returns the authentication result to the device. Specifically, it uses an SQL query to match the username and password against a database. It uses the authentication information retrieved from the database as input and generates an authentication result (success or failure) as output.
[1031] Step 5:
[1032] The terminal redirects the user to the main screen if authentication is successful, or displays an error message if authentication is unsuccessful. Specifically, it uses HTML and JavaScript to render the screen, taking the authentication result as input and updating the user interface as output.
[1033] Step 6:
[1034] The terminal displays a question to the user asking about their needs for reflection on that day. Specifically, it uses an HTML form to display the prompt "What would you like to reflect on today? (e.g., something that made you happy, something you felt you grew from)." It receives the authentication success status as input and presents the question to the user as output.
[1035] Step 7:
[1036] The user inputs the content they want to reflect on and clicks the send button. For example, they might input, "Today, I would like to reflect on the things that I felt I grew from." They provide the content of their reflection as input, and obtain data to be sent to the terminal as output.
[1037] Step 8:
[1038] The device sends the user's input to the server. JavaScript is used to send the reflection content via HTTPS. It receives reflection data from the user as input and generates data to send to the server as output.
[1039] Step 9:
[1040] The server analyzes the received reflection content, generates a corresponding prompt sentence, and returns it to the device. Specifically, it uses a generative AI model to analyze the input text and generate a question such as, "Please tell us a specific event that made you feel like you grew." The reflection data is used as input, and the generated prompt sentence is obtained as output.
[1041] Step 10:
[1042] The terminal displays the prompt received from the server to the user. Specifically, it uses HTML and JavaScript to display the message "Please tell us a specific event that made you feel like you've grown." It receives the prompt as input and updates the user interface as output.
[1043] Step 11:
[1044] The user inputs an appropriate response to the prompt and clicks the submit button. For example, the user might input, "I demonstrated leadership in a new project." The user provides the response data as input and obtains the data to be sent to the terminal as output.
[1045] Step 12:
[1046] The device sends the user's answers to the server. JavaScript is used to send the answer data via HTTPS. The device receives the user's answer data as input and generates data to be sent to the server as output.
[1047] Step 13:
[1048] The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the device. This process is repeated as many times as necessary. Specifically, it uses a generative AI model to generate the next prompt and feedback comments. It uses the user's answer data as input and obtains the new prompt and feedback comments as output.
[1049] Step 14:
[1050] The server organizes the diary entries by topic based on all the dialogue content and compiles them in diary format. Specifically, it analyzes a series of dialogue data and creates diary data such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I carefully explained things to my team members and properly assigned roles. Result: The project progressed smoothly and everyone was cooperative." It uses dialogue data as input and generates diary data as output.
[1051] Step 15:
[1052] The server stores the generated diary data in a database. Specifically, it inserts the diary data into the database using an SQL query. It uses the diary data as input and generates data stored in the database as output.
[1053] Step 16:
[1054] The terminal displays a message to notify the user that the diary entry has been saved. Specifically, it uses HTML and JavaScript to display the message "Your diary entry has been saved. Would you like to check today's review?". It receives a database save success message as input and presents a notification message to the user as output.
[1055] Step 17:
[1056] The server uses an emotion engine to analyze the emotions contained in the user's input. Specifically, it uses natural language processing (NLP) techniques to identify emotions such as "joy," "sadness," and "surprise" from the user's text. It uses the user's text data as input and obtains recognized emotion data as output.
[1057] Step 18:
[1058] The server adjusts the feedback and prompts based on the recognized emotions and sends them to the device. Specifically, the generative AI model adjusts the feedback and prompts based on the results of the emotion engine. For example, if the user expresses sadness, it generates gentle feedback such as, "That must have been hard. Is there anything else bothering you?" It uses emotion data as input and generates adjusted feedback and prompts as output.
[1059] (Application example 2)
[1060] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1061] Conventional systems are unable to provide personalized support and feedback based on emotions when users write their diaries, and lack the ability to help users understand themselves, organize their emotions, or present appropriate related content. As a result, it has been difficult to provide an effective diary experience that responds to users' emotions and needs.
[1062] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1063] In this invention, the server includes means for accepting input from the user, means for analyzing the input and generating a prompt for the next input, and means for analyzing the diary content and the user's emotions and suggesting related content, thereby enabling personalized diary entry support according to the user's emotions and needs and effective presentation of related content.
[1064] 1. "Means for accepting input from the user" refers to the means by which the user inputs text, voice, etc. into the terminal.
[1065] 2. "Means for analyzing the input and generating a prompt for the next input" refers to means for analyzing the content of the user's input and, based on that, generating appropriate questions or instructions to prompt the user for the next step.
[1066] 3. "Means for presenting said prompt to a user" means means for displaying or presenting the generated prompt to a user.
[1067] 4. "Means for generating feedback and insights based on user input" refers to means for generating and providing feedback and insights based on user input.
[1068] 5. "Means for organizing the content of the dialogue and summarizing it in diary format" refers to a means for organizing the content of the dialogue with the user and recording it as a diary.
[1069] 6. "Means for storing the compiled diary" refers to means for storing the organized diary content in a database or the like.
[1070] 7. "Means for analyzing diary content and user emotions and suggesting related content" refers to means for analyzing diary content and user emotions and suggesting related content based on the results.
[1071] 8. "Means for presenting generated suggested content to a user" means means for displaying or providing suggested content to a user.
[1072] These definitions clarify the functions and roles of each element of the system.
[1073] An embodiment of the present invention is described below. This system combines a generative AI and an emotion engine to assist users in writing diary entries and reviewing their diary entries. The system analyzes user input, generates prompts based on the input, and presents them to the user to prompt for the next input. Furthermore, the system generates feedback and insights based on the user input, organizes the dialogue, and saves it in diary format. The system also analyzes the diary entries and the user's emotions, suggests related content, and presents it to the user.
[1074] Specifically, the system includes the following means:
[1075] 1. A means of accepting input from the user
[1076] The device provides the user with an input field and accepts text or voice input, and can be a smartphone or a head-mounted display.
[1077] 2. A means for analyzing the input and generating a prompt for the next input.
[1078] The server analyzes the user's input text and generates appropriate prompts for next steps, using a generative AI model to understand the input and generate relevant questions or instructions.
[1079] 3. Means for presenting said prompt to a user
[1080] The device displays the generated prompt on the screen. An example of the prompt is, "Please tell us a specific event that made you feel like you grew."
[1081] 4. A means of generating feedback and insights based on user input
[1082] The server analyzes the user's responses and provides feedback and insights. It uses an emotion engine to analyze the user's emotions and customizes the feedback accordingly.
[1083] 5. A method for organizing the content of conversations and compiling them in diary format
[1084] The server organizes the contents of the conversation with the user into items and compiles them into a diary, for example, in the format "Today's growth: I was able to demonstrate leadership in a new project."
[1085] 6. Means for saving the compiled diary
[1086] The server stores the organized diary in a database, allowing the user to review the saved diary at a later date.
[1087] 7. A method for analyzing diary content and user sentiment and suggesting related content
[1088] The server analyzes the diary entry and the recognized emotions, and suggests content (articles, videos, music, etc.) that matches the user's interests and needs. A generative AI model is used for the analysis. For example, "If a user writes a positive diary entry, we suggest positive articles."
[1089] 8. Means for presenting generated suggested content to users
[1090] The device presents the suggested content to the user, for example by displaying a message such as "Would you like to watch this video and relax?"
[1091] In this way, users can enjoy a better diary experience and content consumption through emotion-related content. For example, if a user writes, "I had a lot of fun today. I spent time with friends and shared many laughs," the system will suggest related content along with feedback such as, "You are feeling positive emotions. You might enjoy this article: 'How to Stay Positive'."
[1092] This invention is a system that supports the user's diary writing process, provides more personalized emotion-based feedback and insights, and can promote the user's self-understanding and growth.
[1093] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1094] Step 1:
[1095] The terminal displays a login screen to the user and prompts them to enter their username and password. This input is for user authentication, and the username and password are entered. When the user clicks the login button, the terminal sends the entered login information to the server.
[1096] Step 2:
[1097] The server verifies the received login information with its authentication system and returns the authentication result to the terminal. This authentication involves verifying the authentication information through a database query and generating a session ID if authentication is successful. If successful, the terminal redirects the user to the main screen, otherwise it displays an error message.
[1098] Step 3:
[1099] The terminal displays a question to the user asking about their reflection needs for the day. The user inputs the content they want to reflect on and clicks the send button. The input data includes the specific content of the user's reflection (e.g., "Today, I would like to reflect on the things that made me feel I grew"), and the input is sent to the server.
[1100] Step 4:
[1101] The server analyzes the received reflection content, generates a corresponding prompt, and returns it to the device. This analysis uses a generative AI model to generate an appropriate prompt based on the input text. For example, it generates a question such as, "Please tell us about a specific event that made you feel like you grew."
[1102] Step 5:
[1103] The terminal displays the prompts received from the server to the user. The user enters appropriate answers to the prompts and clicks the submit button. The terminal then sends the user's answers back to the server. This process involves repeated user input and server analysis.
[1104] Step 6:
[1105] The server analyzes the user's answers and generates the next question or feedback comment, which is returned to the device. This process can be repeated as many times as necessary. For example, the next prompt might be, "That's great. Why do you think you demonstrated leadership?"
[1106] Step 7:
[1107] The server organizes the diary entries based on all the conversations and summarizes them in a diary format, such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative."
[1108] Step 8:
[1109] The server saves the created diary data in the database. It sends a response indicating that the save was successful to the device. The device then displays a message to the user notifying them that the diary has been saved (e.g., "Your diary has been saved. Would you like to check today's review?").
[1110] Step 9:
[1111] The server uses an emotion engine to analyze the emotions contained in the user's input. This analysis uses a generative AI model to detect emotions such as "happiness," "sadness," and "surprise" from the text. Based on the recognized emotions, the server tailors feedback and insights and sends them to the device. For example, if the user expresses sadness, the server provides gentle feedback such as, "That must be hard. Is there anything else you're concerned about?"
[1112] Step 10:
[1113] The server then suggests content related to the emotion. For example, if a user writes a positive diary entry, it will suggest a positive article called "How to Stay Positive." If a negative emotion is recognized, it will suggest a meditation video for stress relief. The suggested content is then displayed on the device.
[1114] In this way, users can write their diary while receiving personalized feedback based on their emotions, and get an even richer experience through related content.
[1115] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1116] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1117] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1118] [Third embodiment]
[1119] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1120] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[1121] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1122] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1123] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1124] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1125] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1126] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1127] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1128] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1129] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1130] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1131] An embodiment of the present invention will be described. This system uses a generation AI to assist users in writing their diary entries and reviewing their diary entries. Below, the program's processing will be explained in natural language, with specific examples provided to illustrate the details.
[1132] 1. User Authentication
[1133] 1. The terminal displays a login screen to the user and prompts them to enter their username and password.
[1134] Example: A login page appears, presenting fields for entering a "username" and "password."
[1135] 2. The user enters their username and password and clicks the login button.
[1136] Example: Enter "login_user" and "secure_password" and click the "Login" button.
[1137] 3. The terminal sends the entered login information to the server.
[1138] 4. The server verifies the received login information using the authentication system and returns the authentication result to the terminal.
[1139] Example: If authentication is successful, a message will be displayed informing you to proceed to the next step.
[1140] 2. Gathering user needs
[1141] 1. The terminal displays a question to the user asking about the user's needs for the day's reflection.
[1142] Example: The question "What would you like to reflect on today? (Example: Something that made you happy, something that made you feel you grew)" will be displayed.
[1143] 2. The user enters the content they want to review and clicks the send button.
[1144] Example: Type, "Today I would like to reflect on something that I felt I grew from," and click the "Send" button.
[1145] 3. The terminal sends the user's input to the server.
[1146] 4. The server analyzes the received feedback, generates a corresponding prompt, and returns it to the terminal.
[1147] Example: A prompt might be generated: "Tell me a specific event that made you feel like you grew."
[1148] 3. Diary writing support through dialogue
[1149] 1. The terminal displays the prompt received from the server to the user.
[1150] Example: The message displayed is, "Please tell us a specific event in which you felt you grew."
[1151] 2. The user enters the appropriate answers to the prompts and clicks the submit button.
[1152] Example: Type "I demonstrated leadership in a new project" and click the "Submit" button.
[1153] 3. The terminal sends the user's answer to the server.
[1154] 4. The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the device. This process is repeated as many times as necessary.
[1155] Example: The server generates the next question: "That's great! How do you think you demonstrated leadership?"
[1156] 4. Providing feedback and insights
[1157] 1. The server generates feedback and insights based on the user's input and sends them to the device.
[1158] Example: Feedback generated might include, "The specific explanations and role assignments led to the team's success. What was the reaction?"
[1159] 2. The device displays feedback and insights from the server to the user.
[1160] 5. Organizing and summarizing your diary
[1161] 1. The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[1162] Example: Diary-style data such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up the roles. Result: The project progressed smoothly and everyone was cooperative." is generated.
[1163] 2. The server stores the generated diary data in a database.
[1164] 6. Saving and displaying diary entries
[1165] 1. The server sends a response to the device indicating that the diary entry was successfully saved.
[1166] 2. The device displays a message to the user informing them that the diary entry has been saved.
[1167] Example: The message "Your diary entry has been saved. Would you like to review today's review?" will be displayed.
[1168] 3. The terminal displays the contents of the diary created as needed to the user.
[1169] These steps allow users to write their diary entries through natural dialogue and review them periodically. By utilizing generative AI, we can reduce the difficulty users face when writing a diary and promote their personal growth.
[1170] The processing flow will be explained below.
[1171] Step 1:
[1172] The terminal displays a login screen to the user, prompting them to enter their username and password.
[1173] Specifically, the login screen is rendered and the input fields are made accessible to the user.
[1174] Step 2:
[1175] The user enters the username and password and clicks the login button.
[1176] Specifically, enter "login_user" and "secure_password" in the form and press the "Login" button.
[1177] Step 3:
[1178] The terminal transmits the entered login information to the server.
[1179] Specifically, the username and password are sent to the server via HTTPS.
[1180] Step 4:
[1181] The server verifies the received login information using an authentication system and returns the authentication result to the terminal.
[1182] Specifically, it verifies authentication information through a database query and generates a session ID if authentication is successful.
[1183] Step 5:
[1184] If the authentication is successful, the terminal redirects the user to the main screen, and if it is unsuccessful, it displays an error message.
[1185] Specifically, if successful, the main screen is rendered, and if unsuccessful, an error message is displayed on the screen.
[1186] Step 6:
[1187] The terminal displays a question to the user asking about the user's needs for reviewing the day.
[1188] Specifically, the prompt "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)" will be displayed.
[1189] Step 7:
[1190] The user inputs the content they want to review and clicks the send button.
[1191] Specifically, the user enters "Today I would like to reflect on the things in which I felt I have grown" in the input field and clicks the "Send" button.
[1192] Step 8:
[1193] The terminal transmits the user's input to the server.
[1194] As a specific operation, the input data is sent to the server.
[1195] Step 9:
[1196] The server analyzes the received review content, generates a corresponding prompt, and returns it to the terminal.
[1197] Specifically, the generation AI analyzes the input text and generates a question such as, "Please tell us a specific event that made you feel like you grew."
[1198] Step 10:
[1199] The terminal displays the generated prompt to the user.
[1200] Specifically, a message will appear on the screen saying, "Please tell us a specific event that made you feel like you've grown."
[1201] Step 11:
[1202] The user enters the appropriate answers to the prompts and clicks the submit button.
[1203] Specifically, enter "I demonstrated leadership in a new project" in the input field and click the "Submit" button.
[1204] Step 12:
[1205] The terminal transmits the user's answer to the server.
[1206] Specifically, the input data is sent to the server again.
[1207] Step 13:
[1208] The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the terminal.
[1209] The specific behavior is to generate the following prompt: "That's great! Why do you think that demonstrates leadership?"
[1210] Step 14:
[1211] The terminal displays the feedback and insights received from the server to the user.
[1212] Specifically, the feedback comments are displayed on the screen.
[1213] Step 15:
[1214] The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[1215] Specifically, the following diary data is created and saved: "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up the roles. Result: The project progressed smoothly and everyone was cooperative."
[1216] Step 16:
[1217] The server stores the generated diary data in a database.
[1218] As a specific operation, diary data is registered in a database.
[1219] Step 17:
[1220] The server sends a response to the terminal indicating that the diary has been successfully saved.
[1221] Specifically, a success message is sent to the terminal.
[1222] Step 18:
[1223] The terminal displays a message to the user informing them that the diary entry has been saved.
[1224] Specifically, it displays the message "Your diary has been saved. Would you like to review today's review?"
[1225] Step 19:
[1226] The terminal displays the contents of the diary created as needed to the user.
[1227] Specifically, the contents of the saved diary are displayed on the screen.
[1228] Example 1
[1229] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1230] Previous diary entry support systems lacked the ability to effectively analyze user input and generate appropriate prompts to address individual reflection needs. They also struggled to provide feedback and insights to users, and the process of organizing dialogue content into diary format was laborious. Furthermore, they lacked the ability to categorize diary content for easy future reference, and the ability to collect users' reflection needs.
[1231] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1232] In this invention, the server includes means for accepting input from a user, means for analyzing the input and generating a prompt for the next input, and means for presenting the prompt to the user, thereby enabling generation of an appropriate prompt using a generative AI model.
[1233] "Means for accepting input from the user" is a function that provides an interface for the user to input information to the system.
[1234] The "means for analyzing the input and generating a prompt for the next input" is a function that analyzes the received user input and generates questions and instructions to accurately guide the user to the next information that they should enter.
[1235] The "means for presenting the prompt to the user" is a function for visually or audibly presenting the generated prompt to the user.
[1236] The "means for generating feedback and insights based on user input" is a function that generates appropriate feedback and analysis results based on the user's input and provides them to the user.
[1237] The "means for organizing the contents of the dialogue and summarizing them in a diary format" is a function for organizing information obtained through a dialogue with a user and summarizing it in a diary format based on a specific format.
[1238] The "means for saving the compiled diary" is a function for saving the created diary data in a storage such as a database.
[1239] "Means for generating the prompt using a generative AI model" refers to a function that utilizes an artificial intelligence model to automatically generate the prompt.
[1240] The "means for classifying the diary content entered by the user into categories" is a function for classifying the diary content entered by the user into specific categories or items.
[1241] The "means for collecting the user's reflection needs" is a function for collecting the user's objectives and requests when writing a diary.
[1242] This invention is a system for assisting users in effectively writing and reviewing their diary entries, and specifically, it utilizes a generative AI model to generate prompts and provide feedback and insights to the user. The following describes in detail the embodiments of the invention.
[1243] Hardware and Software
[1244] This system uses the following hardware and software:
[1245] Device: A device (e.g., computer, smartphone, tablet) that provides a user interface (UI) that runs on a web browser.
[1246] Server: The server receives user input, analyzes it, generates feedback and prompts. It also includes storage for saving the diary using a database.
[1247] Generative AI models: AI models that perform natural language processing (e.g., GPT-3).
[1248] Program processing
[1249] A user first accesses the system through a browser on their device. The device displays a login screen and prompts the user to enter their username and password. After the user enters these and clicks the login button, the device sends the information to the server. The server verifies this information using the authentication system and returns the authentication result.
[1250] If the authentication is successful, the device then displays a question to the user asking about their needs for reflection that day. For example, the question might be, "What would you like to reflect on today? (Example: Something that made you happy, something that made you feel you have grown)." If the user enters "I would like to reflect on something that made me feel I have grown today," and clicks the send button, the device sends the input to the server.
[1251] The server analyzes the received input using a generative AI model and generates the next prompt the user should enter. For example, a prompt might be generated such as, "Please tell us a specific event that made you feel like you grew." The device then displays this prompt to the user, who then enters the information again. For example, the user might enter, "I was able to demonstrate leadership in a new project," and click the send button.
[1252] The server analyzes this response and generates further questions and feedback. By repeating this process multiple times, the diary entry progresses through dialogue. The server generates feedback and insights based on the user's input, such as "The specific explanation and division of roles led to the team's success. What was the reaction?" and sends this feedback to the device.
[1253] Finally, the server organizes the diary entries into categories based on all the conversations and compiles them into a diary format. For example, it generates diary-format data such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I carefully explained things to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative." The generated diary data is then saved in a database by the server.
[1254] The device receives a message from the server saying, "Your diary entry has been saved. Would you like to check today's review?" and notifies the user. If necessary, the device displays the saved diary entry to the user.
[1255] Through these processes, users can write their diary through natural dialogue and use generative AI to conduct effective self-reflection. This invention enables users to improve the quality of their daily self-reflection.
[1256] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1257] Step 1: User authentication
[1258] Input: Username, Password
[1259] Processing: The terminal displays a login screen to the user, prompting them to enter their username and password. The user enters these and clicks the login button.
[1260] Data processing: The information entered by the user is sent to the server as an HTTP POST request.
[1261] Output: The authentication information is sent to the server.
[1262] Specific behavior: The terminal displays a login form in the web browser and provides input fields for the username and password. The user enters "login_user" and "secure_password" and clicks the login button.
[1263] Step 2: Returning the authentication result
[1264] Input: Credentials
[1265] Processing: The server verifies the received login information using the authentication system and returns the authentication result to the terminal.
[1266] Data processing: Call the authentication API and parse the response.
[1267] Output: The authentication result is returned to the terminal.
[1268] Specific operation: The server performs authentication using an authentication system (e.g., OAuth 2.0 or LDAP), generates a success or failure message, and returns it to the terminal in JSON format.
[1269] Step 3: Reflection and gathering needs
[1270] Input: Authentication result
[1271] Processing: If authentication is successful, the device displays a question to the user asking about their reflection needs for the day.
[1272] Data processing: Generate a question form and present it to the user.
[1273] Output: User's retrospective needs
[1274] Specific operation: The device displays the question "What would you like to reflect on today?", and the user enters "Today I would like to reflect on something that I felt I grew from," and clicks the send button.
[1275] Step 4: Submitting your retrospective needs
[1276] Input: User's reflection needs
[1277] Processing: The terminal sends the user's input to the server.
[1278] Data processing: The user-entered retrospective needs are sent as an HTTP POST request.
[1279] Output: A lookup request is sent to the server.
[1280] Specific behavior: Generates and sends an HTTP request to send the content entered in the text box to the server.
[1281] Step 5: Generate prompts
[1282] Input: User's reflection needs
[1283] Processing: The server analyzes the received reflection content using the generative AI model and generates a prompt sentence.
[1284] Data processing: Input reflection needs into the AI model to generate appropriate prompts.
[1285] Output: Generated prompt statement
[1286] Specific operation: The server inputs the reflection content (e.g., "Today, I would like to reflect on something that made me feel like I grew") into the AI model, generates a prompt saying, "Please tell us about a specific event that made you feel like you grew," and returns it to the device.
[1287] Step 6: Display a prompt
[1288] Input: prompt statement
[1289] Processing: The terminal displays the prompt received from the server to the user.
[1290] Data processing: The generated prompt text is displayed on the screen.
[1291] Output: The user is prompted.
[1292] Specific action: The device will display the prompt on the screen: "Please tell us a specific event that made you feel like you grew."
[1293] Step 7: Answer the prompts
[1294] Input: prompt statement
[1295] Action: The user enters the appropriate response to the prompt and clicks the submit button.
[1296] Data processing: User answers are sent as HTTP POST requests.
[1297] Output: The user's answer is sent to the server.
[1298] Specific action: Enter "I demonstrated leadership in a new project" in the text box and click the submit button.
[1299] Step 8: Generate your next question or feedback
[1300] Input: User's answer
[1301] Processing: The server analyzes the user's answers and uses the generative AI model to generate the next question and feedback comments.
[1302] Data transformation: Input answers into AI models to generate new questions and feedback.
[1303] Output: New question or feedback statement
[1304] Specific behavior: The server generates the next question, "That's great. Why do you think that demonstrates leadership?", and returns it to the device. This process is repeated as many times as necessary.
[1305] Step 9: View your feedback
[1306] Input: Feedback statement
[1307] Processing: The device displays feedback and insights from the server to the user.
[1308] Data processing: Feedback statements are displayed on the screen.
[1309] Output: Feedback is displayed to the user.
[1310] Specific action: The device displays feedback on the screen, such as, "The specific explanation and division of roles led to the team's success. What was the reaction?"
[1311] Step 10: Organize and summarize your diary
[1312] Input: Dialogue
[1313] Processing: The server organizes the diary entries into categories based on all the conversations and compiles them into a diary format.
[1314] Data processing: The conversation content is retrieved from the database, formatted, and compiled into a diary.
[1315] Output: Generated diary data
[1316] Specific behavior: The server generates specific diary data (e.g., "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative.").
[1317] Step 11: Save diary data
[1318] Input: Generated diary data
[1319] Processing: The server saves the generated diary data in a database.
[1320] Data processing: Diary data is saved in the database using an INSERT query.
[1321] Output: Diary data is saved.
[1322] Specific operation: The server creates an INSERT query and saves the diary data to the database.
[1323] Step 12: Save complete notification
[1324] Input: Saved Results
[1325] Processing: The server sends a response to the device indicating that the diary entry has been saved successfully.
[1326] Data processing: Generate a save success message and send it as a JSON response.
[1327] Output: A save success message is sent to the terminal.
[1328] Specific behavior: A JSON response message saying "Your diary entry has been saved. Would you like to review today's review?" is sent to the device.
[1329] Step 13: Notify users
[1330] Input: Save successful message
[1331] Processing: The device displays a message to the user informing them that the diary entry has been saved.
[1332] Data processing: Display the message on the screen.
[1333] Output: A notification is displayed to the user.
[1334] What it does: Your device will display a pop-up notification saying, "Your diary has been saved. Would you like to review today's review?"
[1335] Step 14: Displaying diary entries
[1336] Input: User request
[1337] Processing: The terminal displays the contents of the diary created as needed to the user.
[1338] Data processing: Retrieve diary contents from the database and display them on the screen.
[1339] Output: The user can check the diary contents.
[1340] Specific operation: The device displays the saved diary entry on the user interface, allowing the user to check the contents.
[1341] Through the above processing steps, users can utilize the generative AI model to effectively write and review their diary entries.
[1342] (Application example 1)
[1343] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1344] Conventional user diary writing systems require users to write voluntarily, making it difficult to maintain motivation. They also lack support for effective daily reflection, leaving users with few opportunities to grow and gain new insights. Furthermore, they lack personalized feedback and insights using generative AI, making it difficult to provide optimal content tailored to individual users' needs. A new system is needed to solve these issues.
[1345] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1346] In this invention, the server includes a means for collecting the user's reflection needs, a means for generating prompt sentences using a generative AI model to prompt the next input, and a means for delivering the diary as personalized content. This makes it possible to provide effective support to the user and increase their motivation to write in the diary. In addition, by providing the user with individually optimized feedback and insights, it is possible to promote deeper self-understanding and growth. This makes it possible to effectively carry out daily reflection and support the user's growth.
[1347] "User authentication" is the process by which a user enters a username and password to access a system, and the information is verified to authenticate the user as a legitimate user.
[1348] "Reflection needs" refers to specific themes or items that a user wants to reflect on regarding the events that they experienced or the feelings they had that day.
[1349] A "generative AI model" refers to an artificial intelligence model that uses natural language processing techniques to analyze user input and generate appropriate feedback and prompts.
[1350] A "prompt sentence" refers to a guideline or question sentence that is generated to prompt the user for the next input.
[1351] "Personalized content" refers to customized information and feedback that is optimized to a user's individual needs and inputs.
[1352] "Content distribution" refers to the process of transmitting information to provide generated journal entries and feedback to users.
[1353] A "smartphone" refers to a mobile phone terminal that can connect to the Internet and use multi-function applications.
[1354] The present invention is a system that uses a generative AI model to assist users in writing and reviewing their diary entries. The system aims to provide personalized feedback and insights according to the user's needs, and to organize and store the diary. The following describes in detail the mode for implementing the invention.
[1355] 1. User Authentication
[1356] The server provides an authentication function for users to access the system. The terminal displays a login screen to the user and prompts them to enter their username and password. When the user enters the login information, the information is sent to the server, which then authenticates it using the authentication system.
[1357] 2. Gathering user needs
[1358] The server generates prompts to gather the user's reflection needs and presents them to the user through the terminal. For example, the terminal displays a question to the user such as, "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)." The user inputs what they want to reflect on, and the information is sent to the server.
[1359] 3. Diary writing support through dialogue
[1360] The server analyzes the received reflection content and generates the next prompt using a generative AI model. The generated prompt is sent to the device and displayed to the user. For example, a message might be displayed such as, "Please tell us a specific event that made you feel like you grew." The user then enters an appropriate response, which is then sent back to the server. The server repeats this process multiple times to assist the user in writing their diary.
[1361] 4. Providing feedback and insights
[1362] The server generates feedback and insights based on the user's input. This feedback is generated using a generative AI model. For example, if a user types, "I demonstrated leadership in a new project," the server generates the following feedback and sends it to the device: "That's great. Why do you think you demonstrated leadership?"
[1363] 5. Organizing and summarizing your diary
[1364] The server organizes the diary entries based on all the conversations and saves them as personalized content.
[1365] 6. Saving and displaying diary entries
[1366] The server saves the compiled diary in a database so that the user can access it later. The terminal displays a message to the user that saving is complete and redisplays the contents of the created diary as needed.
[1367] This system uses the OpenAI API as a generative AI model to analyze user input, generate prompts, and provide feedback. In addition, a Python program is implemented on the server and terminal.
[1368] The following are examples of prompts:
[1369] Please tell us specifically how you felt you grew today.
[1370]
[1371] That's great. Why do you think you were able to demonstrate leadership?
[1372] As described above, the system of the present invention can effectively support the user's diary writing and provide individually optimized feedback.
[1373] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1374] Step 1:
[1375] The terminal displays a login screen to the user and prompts them to enter their username and password. The user enters the username "test_user" and the password "secure_password." The input data is sent to the server.
[1376] Step 2:
[1377] The server checks the received login information with the authentication system. If authentication is successful, it returns a success response to the terminal to proceed to the next step. If authentication is unsuccessful, it returns an error message.
[1378] Input: Username and Password
[1379] Output: Authentication result
[1380] Step 3:
[1381] If user authentication is successful, the terminal displays a question to the user asking about their needs for reflection on that day. For example, the user might enter, "I would like to reflect on the things that I felt I grew from today," and the terminal sends that data to the server.
[1382] Step 4:
[1383] The server analyzes the received reflection content and uses a generative AI model to generate a corresponding prompt, such as "Please tell us about a specific event that made you feel like you grew," and returns it to the device.
[1384] Input: User's retrospective needs
[1385] Output: Generated prompt statement
[1386] Step 5:
[1387] The terminal displays the prompt received from the server to the user. The user inputs an appropriate response to the prompt, for example, "I was able to demonstrate leadership in a new project." The terminal then transmits the data to the server.
[1388] Step 6:
[1389] The server analyzes the user's response and uses a generative AI model to generate the next question or feedback comment, such as "That's great. Why do you think you demonstrated leadership?", and returns it to the device.
[1390] Input: User's answer
[1391] Output: Next prompt statement
[1392] Step 7:
[1393] The terminal displays the feedback received from the server and the next prompt to the user, and this process is repeated until the user has written enough diary entries.
[1394] Step 8:
[1395] The server organizes the diary entries into categories based on the content of all the conversations and compiles them in diary format.
[1396] Input: All dialogue
[1397] Output: Diary format data
[1398] Step 9:
[1399] The server saves the organized diary data in a database and then sends a message to the device indicating that the data has been saved.
[1400] Input: Diary-style data
[1401] Output: Save complete message
[1402] Step 10:
[1403] The terminal displays a save completion message from the server to the user, and redisplays the contents of the created diary as necessary.
[1404] This is the specific processing flow of this system. By utilizing a generative AI model to generate prompts and provide feedback based on user input, it is possible to effectively support users in writing their diary entries.
[1405] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1406] An embodiment of the present invention will be described. This system combines a generative AI and an emotion engine to assist users in writing their diary entries and reviewing their diary entries. Below, the program's processing will be explained in natural language, with specific examples provided for further details.
[1407] 1. User Authentication
[1408] 1. The terminal displays a login screen to the user and prompts them to enter their username and password.
[1409] Specifically, the login screen is rendered and the input fields are made accessible to the user.
[1410] 2. The user enters their username and password and clicks the login button.
[1411] Specifically, enter "login_user" and "secure_password" in the form and press the "Login" button.
[1412] 3. The terminal sends the entered login information to the server.
[1413] How it works: The username and password are sent to the server over HTTPS.
[1414] 4. The server verifies the received login information using the authentication system and returns the authentication result to the terminal.
[1415] Specifically, it verifies authentication information through a database query and generates a session ID if authentication is successful.
[1416] 5. If authentication is successful, the terminal redirects the user to the main screen; if not, it displays an error message.
[1417] Specifically, if successful, the main screen is rendered, and if unsuccessful, an error message is displayed on the screen.
[1418] 2. Gathering user needs
[1419] 1. The terminal displays a question to the user asking about the user's needs for the day's reflection.
[1420] Specifically, the prompt "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)" will be displayed.
[1421] 2. The user enters the content they want to review and clicks the send button.
[1422] Specifically, the user enters "Today I would like to reflect on the things in which I felt I have grown" in the input field and clicks the "Send" button.
[1423] 3. The terminal sends the user's input to the server.
[1424] Example of operation: Input data is sent to the server.
[1425] 4. The server analyzes the received feedback, generates a corresponding prompt, and returns it to the terminal.
[1426] Specifically, the generation AI analyzes the input text and generates a question such as, "Please tell us a specific event that made you feel like you grew."
[1427] 3. Diary writing support through dialogue
[1428] 1. The terminal displays the prompt received from the server to the user.
[1429] Specifically, a message will appear on the screen saying, "Please tell us a specific event that made you feel like you've grown."
[1430] 2. The user enters the appropriate answers to the prompts and clicks the submit button.
[1431] Specifically, enter "I demonstrated leadership in a new project" in the input field and click the "Submit" button.
[1432] 3. The terminal sends the user's answer to the server.
[1433] Example of operation: The input data is sent to the server again.
[1434] 4. The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the device. This process is repeated as many times as necessary.
[1435] Specifically, the server generates the following prompt: "That's great! How do you think you demonstrate leadership?"
[1436] 4. Providing feedback and insights
[1437] 1. The server generates feedback and insights based on the user's input and sends them to the device.
[1438] A specific action would be to generate feedback such as, "The specific explanation and division of roles led to the team's success. What was the reaction?"
[1439] 2. The device displays feedback and insights from the server to the user.
[1440] Example of operation: Feedback comments are displayed on the screen.
[1441] 5. Organizing and summarizing your diary
[1442] 1. The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[1443] Specifically, the following diary data is created and saved: "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up the roles. Result: The project progressed smoothly and everyone was cooperative."
[1444] 2. The server stores the generated diary data in a database.
[1445] Example of operation: Diary data is registered in the database.
[1446] 6. Saving and displaying diary entries
[1447] 1. The server sends a response to the device indicating that the diary entry was successfully saved.
[1448] Example of operation: A success message is sent to the terminal.
[1449] 2. The device displays a message to the user informing them that the diary entry has been saved.
[1450] Specifically, it displays the message "Your diary has been saved. Would you like to review today's review?"
[1451] 3. The terminal displays the contents of the diary created as needed to the user.
[1452] Example of operation: The saved diary contents are displayed on the screen.
[1453] 7. Emotion Recognition and Customization
[1454] 1. The server uses an emotion engine to analyze the emotions contained in the user's input.
[1455] Specifically, the emotion engine detects emotions such as "joy," "sadness," and "surprise" from the user's text.
[1456] 2. The server tailors feedback and insights based on the recognized emotions and sends them to the device.
[1457] For example, if a user expresses sadness, gentle feedback is provided: "That must be hard. Is there anything else you're concerned about?"
[1458] 3. The server customizes prompts based on the recognized emotion and sends them to the device.
[1459] Specifically, if the user expresses joy, a proactive prompt is provided: "Tell me more about that event!"
[1460] In this way, a diary entry support system that combines generative AI and an emotion engine allows users to write their diary entries through natural dialogue and periodically review them. By adding emotion recognition functionality, more personalized feedback and insights can be provided to users, promoting deeper self-understanding and growth.
[1461] The processing flow will be explained below.
[1462] Step 1:
[1463] The terminal displays a login screen to the user, prompting them to enter their username and password.
[1464] Specifically, a login screen is rendered, allowing the user to access the input fields.
[1465] Step 2:
[1466] The user enters the username and password and clicks the login button.
[1467] Specifically, enter "login_user" and "secure_password" in the form and press the "Login" button.
[1468] Step 3:
[1469] The terminal transmits the entered login information to the server.
[1470] Specifically, the username and password are sent to the server via HTTPS.
[1471] Step 4:
[1472] The server verifies the received login information using an authentication system and returns the authentication result to the terminal.
[1473] Specifically, it verifies authentication information through a database query and generates a session ID if authentication is successful.
[1474] Step 5:
[1475] If the authentication is successful, the terminal redirects the user to the main screen, and if it is unsuccessful, it displays an error message.
[1476] Specifically, if successful, the main screen is rendered, and if unsuccessful, an error message is displayed on the screen.
[1477] Step 6:
[1478] The terminal displays a question to the user asking about the user's needs for reviewing the day.
[1479] Specifically, the prompt "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)" will be displayed.
[1480] Step 7:
[1481] The user inputs the content they want to review and clicks the send button.
[1482] Specifically, the user enters "Today I would like to reflect on the things in which I felt I have grown" in the input field and clicks the "Send" button.
[1483] Step 8:
[1484] The terminal transmits the user's input to the server.
[1485] As a specific operation, the input data is sent to the server.
[1486] Step 9:
[1487] The server analyzes the received review content, generates a corresponding prompt, and returns it to the terminal.
[1488] Specifically, the generation AI analyzes the input text and generates a question such as, "Please tell us a specific event that made you feel like you grew."
[1489] Step 10:
[1490] The terminal displays the generated prompt to the user.
[1491] Specifically, a message will appear on the screen saying, "Please tell us a specific event that made you feel like you've grown."
[1492] Step 11:
[1493] The user enters the appropriate answers to the prompts and clicks the submit button.
[1494] Specifically, enter "I demonstrated leadership in a new project" in the input field and click the "Submit" button.
[1495] Step 12:
[1496] The terminal transmits the user's answer to the server.
[1497] Specifically, the input data is sent to the server again.
[1498] Step 13:
[1499] The server analyzes the user's responses and uses an emotion engine to recognize the emotions contained in the input.
[1500] Specifically, it detects the emotion "joy" from the text "I was able to demonstrate leadership in a new project."
[1501] Step 14:
[1502] The server tailors feedback and insights based on the emotions recognized by the emotion engine and returns them to the device.
[1503] A specific action would be to generate feedback based on the recognized emotion of "joy" such as, "That's great. What specific leadership skills did you demonstrate?"
[1504] Step 15:
[1505] The device displays feedback and insights to the user.
[1506] Specifically, feedback will appear on the screen saying, "That's great. What specific leadership skills did you demonstrate?"
[1507] Step 16:
[1508] The server customizes prompts according to the recognized emotions and sends them to the device.
[1509] Specifically, users who express joy are proactively prompted with, "Tell us more about what happened!"
[1510] Step 17:
[1511] The terminal displays a prompt to the user.
[1512] Specifically, a prompt will appear on the screen saying, "Tell us more about that event!"
[1513] Step 18:
[1514] The user responds to the prompts with further details and clicks the submit button.
[1515] Specifically, you would enter, "I explained things carefully to my team members and made sure that everyone was properly assigned roles," and then click the "Send" button.
[1516] Step 19:
[1517] The terminal sends the user's detailed response to the server.
[1518] As a specific operation, the input data is sent to the server.
[1519] Step 20:
[1520] The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[1521] Specifically, the conversation is categorized into categories such as "Today's growth," "Reasons," and "Results," and compiled in diary format.
[1522] Step 21:
[1523] The server stores the generated diary data in a database.
[1524] As a specific operation, diary data is registered in a database.
[1525] Step 22:
[1526] The server sends a response to the terminal indicating that the diary has been successfully saved.
[1527] As a specific operation, a save success message is sent to the terminal.
[1528] Step 23:
[1529] The terminal displays a message to the user informing them that the diary entry has been saved.
[1530] Specifically, the message "Your diary has been saved. Would you like to review today's review?" will be displayed.
[1531] Step 24:
[1532] The terminal displays the contents of the diary created as needed to the user.
[1533] Specifically, the contents of the saved diary are displayed on the screen.
[1534] Example 2
[1535] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1536] Conventional interactive diary creation systems have the problem that they do not take into account the user's emotions, provide uniform feedback and prompts, and do not provide personalized dialogue for each user, which does not improve the user experience.In addition, there is also the issue of not being able to flexibly respond to user needs when it comes to organizing and saving the dialogue content.
[1537] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for accepting input from a user, means for analyzing the input and generating a prompt sentence for prompting the next input, means for presenting the prompt sentence to the user, means for generating feedback and insight based on the user input, means for organizing the dialogue content and summarizing it in a diary format, means for saving the summarized diary, means for analyzing emotions included in the user input using an emotion engine, and means for adjusting the feedback and prompt sentences based on the recognized emotions. This allows for the provision of feedback and prompts personalized for each user, enabling a flexible and engaging user experience.
[1538] "User input" refers to information or data provided by a user of the system using an input device.
[1539] "Analysis" is the process of understanding the content and extracting meaning from data input by a user.
[1540] A "prompt sentence" is a question or guide text that prompts the user for the next input.
[1541] "Feedback" refers to the evaluations and comments that the system returns in response to input from the user.
[1542] "Insights" are the knowledge and advice that the system derives from the user's input data.
[1543] "Dialogue content" is a record of a series of messages and exchanges between a user and the system.
[1544] The "diary format" is a document format in which information entered by a user is compiled in the form of a diary.
[1545] "Storage" is the process of recording generated data in a storage device such as a database for long-term retention.
[1546] An "emotion engine" is a system that analyzes text input from a user and identifies the emotions contained therein.
[1547] "Analyzing" means structuring data and processing it to understand its meaning and sentiment.
[1548] "Adjustment" is the process of customizing content based on the analysis results and changing it into a format that is optimal for the user.
[1549] "User needs" are the specific requirements and expectations that users have of a system.
[1550] This invention is a system that utilizes a generative AI model and an emotion engine to support users in writing their diary entries and to allow them to review their diary entries. Specific embodiments of this system are described below.
[1551] Overall system configuration
[1552] This system consists of three main components: a server, a terminal, and a user. The server is responsible for data processing and analysis using a generative AI model and an emotion engine. The terminal provides the user interface and receives user input. The user interacts with the system through the terminal.
[1553] User Authentication
[1554] The terminal first displays a login screen to the user and prompts them to enter their username and password. This authenticates the user. Specifically, the login screen is constructed using HTML, CSS, and JavaScript to accept user input. The user enters their username and password on the login screen and clicks the "Login" button. This information is sent to the server via HTTPS.
[1555] Data analysis and prompt generation
[1556] The server checks the data sent by the user in the database, and if authentication is successful, generates a session ID. The terminal then confirms successful authentication of the user and proceeds to the next step. After the user logs in, the terminal displays a question to the user asking about their needs for reflection on that day. As a specific example, the prompt sentence used is "What would you like to reflect on today? (Example: Something that made you happy, something you felt you grew from)."
[1557] Diary writing through dialogue
[1558] The user enters what they want to reflect on and clicks the send button. For example, they might enter, "Today, I would like to reflect on something that made me feel like I grew." This input is then sent back to the server. The server analyzes the content and uses a generative AI model to generate an appropriate prompt. For example, a question might be generated: "Please tell me about a specific event that made you feel like you grew."
[1559] The terminal displays the generated prompt to the user, and the user responds by typing, for example, "I've demonstrated leadership in the new project." This sequence of interactions is repeated until the dialogue is complete.
[1560] Providing feedback and insights
[1561] The server generates feedback and insights based on the user's input. For example, it generates feedback such as, "The specific explanation and division of roles led to the team's success. What was the reaction?" The generated feedback is displayed to the user via the device.
[1562] Organizing and saving your diary
[1563] After the conversation is complete, the server organizes the diary entries into categories based on the content of the entire conversation and summarizes them in a diary format. For example, diary data can be created in the following format: "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative."
[1564] The generated diary data is saved in a database by the server. The user can then check the created diary at any time. The device notifies the user of a successful save message and displays the contents of the diary as needed. For example, it displays a message saying, "The diary has been saved. Would you like to check today's review?"
[1565] Emotion Recognition and Customization
[1566] The server uses an emotion engine to analyze the emotions contained in the user's input. For example, if a user enters an input such as "I felt very sad today," the emotion engine analyzes this text and recognizes the emotion "sad." Based on the recognized emotion, the server adjusts the feedback and prompt sentences. For example, if the user expresses sadness, the server may provide gentle feedback such as "That must have been difficult. Is there anything else that's bothering you?". Alternatively, if the user expresses joy, the server may provide a proactive prompt such as "Can you tell me more about that event?"
[1567] As described above, by utilizing a generative AI model and an emotion engine, the system provides personalized feedback and prompts to users, improving the user experience.
[1568] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1569] Step 1:
[1570] The terminal displays a login screen to the user and prompts them to enter a username and password. Specifically, you build the user interface using HTML and CSS, create input fields using JavaScript, accept the username and password as input, and obtain authentication data from the user as output.
[1571] Step 2:
[1572] The user enters a username and password and clicks the login button. For example, the username is "login_user" and the password is "secure_password". We provide the username and password as input and get the authentication information sent to the terminal as output.
[1573] Step 3:
[1574] The device sends the entered login information to the server. It uses JavaScript to send authentication information (user name and password) over HTTPS, receiving the authentication information as input and sending encrypted data as output to the server.
[1575] Step 4:
[1576] The server verifies the received login information with its authentication system and returns the authentication result to the device. Specifically, it uses an SQL query to match the username and password against a database. It uses the authentication information retrieved from the database as input and generates an authentication result (success or failure) as output.
[1577] Step 5:
[1578] The terminal redirects the user to the main screen if authentication is successful, or displays an error message if authentication is unsuccessful. Specifically, it uses HTML and JavaScript to render the screen, taking the authentication result as input and updating the user interface as output.
[1579] Step 6:
[1580] The terminal displays a question to the user asking about their needs for reflection on that day. Specifically, it uses an HTML form to display the prompt "What would you like to reflect on today? (e.g., something that made you happy, something you felt you grew from)." It receives the authentication success status as input and presents the question to the user as output.
[1581] Step 7:
[1582] The user inputs the content they want to reflect on and clicks the send button. For example, they might input, "Today, I would like to reflect on the things that I felt I grew from." They provide the content of their reflection as input, and obtain data to be sent to the terminal as output.
[1583] Step 8:
[1584] The device sends the user's input to the server. JavaScript is used to send the reflection content via HTTPS. It receives reflection data from the user as input and generates data to send to the server as output.
[1585] Step 9:
[1586] The server analyzes the received reflection content, generates a corresponding prompt sentence, and returns it to the device. Specifically, it uses a generative AI model to analyze the input text and generate a question such as, "Please tell us a specific event that made you feel like you grew." The reflection data is used as input, and the generated prompt sentence is obtained as output.
[1587] Step 10:
[1588] The terminal displays the prompt received from the server to the user. Specifically, it uses HTML and JavaScript to display the message "Please tell us a specific event that made you feel like you've grown." It receives the prompt as input and updates the user interface as output.
[1589] Step 11:
[1590] The user inputs an appropriate response to the prompt and clicks the submit button. For example, the user might input, "I demonstrated leadership in a new project." The user provides the response data as input and obtains the data to be sent to the terminal as output.
[1591] Step 12:
[1592] The device sends the user's answers to the server. JavaScript is used to send the answer data via HTTPS. The device receives the user's answer data as input and generates data to be sent to the server as output.
[1593] Step 13:
[1594] The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the device. This process is repeated as many times as necessary. Specifically, it uses a generative AI model to generate the next prompt and feedback comments. It uses the user's answer data as input and obtains the new prompt and feedback comments as output.
[1595] Step 14:
[1596] The server organizes the diary entries by topic based on all the dialogue content and compiles them in diary format. Specifically, it analyzes a series of dialogue data and creates diary data such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I carefully explained things to my team members and properly assigned roles. Result: The project progressed smoothly and everyone was cooperative." It uses dialogue data as input and generates diary data as output.
[1597] Step 15:
[1598] The server stores the generated diary data in a database. Specifically, it inserts the diary data into the database using an SQL query. It uses the diary data as input and generates data stored in the database as output.
[1599] Step 16:
[1600] The terminal displays a message to notify the user that the diary entry has been saved. Specifically, it uses HTML and JavaScript to display the message "Your diary entry has been saved. Would you like to check today's review?". It receives a database save success message as input and presents a notification message to the user as output.
[1601] Step 17:
[1602] The server uses an emotion engine to analyze the emotions contained in the user's input. Specifically, it uses natural language processing (NLP) techniques to identify emotions such as "joy," "sadness," and "surprise" from the user's text. It uses the user's text data as input and obtains recognized emotion data as output.
[1603] Step 18:
[1604] The server adjusts the feedback and prompts based on the recognized emotions and sends them to the device. Specifically, the generative AI model adjusts the feedback and prompts based on the results of the emotion engine. For example, if the user expresses sadness, it generates gentle feedback such as, "That must have been hard. Is there anything else bothering you?" It uses emotion data as input and generates adjusted feedback and prompts as output.
[1605] (Application example 2)
[1606] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1607] Conventional systems are unable to provide personalized support and feedback based on emotions when users write their diaries, and lack the ability to help users understand themselves, organize their emotions, or present appropriate related content. As a result, it has been difficult to provide an effective diary experience that responds to users' emotions and needs.
[1608] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1609] In this invention, the server includes means for accepting input from the user, means for analyzing the input and generating a prompt for the next input, and means for analyzing the diary content and the user's emotions and suggesting related content, thereby enabling personalized diary entry support according to the user's emotions and needs and effective presentation of related content.
[1610] 1. "Means for accepting input from the user" refers to the means by which the user inputs text, voice, etc. into the terminal.
[1611] 2. "Means for analyzing the input and generating a prompt for the next input" refers to means for analyzing the content of the user's input and, based on that, generating appropriate questions or instructions to prompt the user for the next step.
[1612] 3. "Means for presenting said prompt to a user" means means for displaying or presenting the generated prompt to a user.
[1613] 4. "Means for generating feedback and insights based on user input" refers to means for generating and providing feedback and insights based on user input.
[1614] 5. "Means for organizing the content of the dialogue and summarizing it in diary format" refers to a means for organizing the content of the dialogue with the user and recording it as a diary.
[1615] 6. "Means for storing the compiled diary" refers to means for storing the organized diary content in a database or the like.
[1616] 7. "Means for analyzing diary content and user emotions and suggesting related content" refers to means for analyzing diary content and user emotions and suggesting related content based on the results.
[1617] 8. "Means for presenting generated suggested content to a user" means means for displaying or providing suggested content to a user.
[1618] These definitions clarify the functions and roles of each element of the system.
[1619] An embodiment of the present invention is described below. This system combines a generative AI and an emotion engine to assist users in writing diary entries and reviewing their diary entries. The system analyzes user input, generates prompts based on the input, and presents them to the user to prompt for the next input. Furthermore, the system generates feedback and insights based on the user input, organizes the dialogue, and saves it in diary format. The system also analyzes the diary entries and the user's emotions, suggests related content, and presents it to the user.
[1620] Specifically, the system includes the following means:
[1621] 1. A means of accepting input from the user
[1622] The device provides the user with an input field and accepts text or voice input, and can be a smartphone or a head-mounted display.
[1623] 2. A means for analyzing the input and generating a prompt for the next input.
[1624] The server analyzes the user's input text and generates appropriate prompts for next steps, using a generative AI model to understand the input and generate relevant questions or instructions.
[1625] 3. Means for presenting said prompt to a user
[1626] The device displays the generated prompt on the screen. An example of the prompt is, "Please tell us a specific event that made you feel like you grew."
[1627] 4. A means of generating feedback and insights based on user input
[1628] The server analyzes the user's responses and provides feedback and insights. It uses an emotion engine to analyze the user's emotions and customizes the feedback accordingly.
[1629] 5. A method for organizing the content of conversations and compiling them in diary format
[1630] The server organizes the contents of the conversation with the user into items and compiles them into a diary, for example, in the format "Today's growth: I was able to demonstrate leadership in a new project."
[1631] 6. Means for saving the compiled diary
[1632] The server stores the organized diary in a database, allowing the user to review the saved diary at a later date.
[1633] 7. A method for analyzing diary content and user sentiment and suggesting related content
[1634] The server analyzes the diary entry and the recognized emotions, and suggests content (articles, videos, music, etc.) that matches the user's interests and needs. A generative AI model is used for the analysis. For example, "If a user writes a positive diary entry, we suggest positive articles."
[1635] 8. Means for presenting generated suggested content to users
[1636] The device presents the suggested content to the user, for example by displaying a message such as "Would you like to watch this video and relax?"
[1637] In this way, users can enjoy a better diary experience and content consumption through emotion-related content. For example, if a user writes, "I had a lot of fun today. I spent time with friends and shared many laughs," the system will suggest related content along with feedback such as, "You are feeling positive emotions. You might enjoy this article: 'How to Stay Positive'."
[1638] This invention is a system that supports the user's diary writing process, provides more personalized emotion-based feedback and insights, and can promote the user's self-understanding and growth.
[1639] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1640] Step 1:
[1641] The terminal displays a login screen to the user and prompts them to enter their username and password. This input is for user authentication, and the username and password are entered. When the user clicks the login button, the terminal sends the entered login information to the server.
[1642] Step 2:
[1643] The server verifies the received login information with its authentication system and returns the authentication result to the terminal. This authentication involves verifying the authentication information through a database query and generating a session ID if authentication is successful. If successful, the terminal redirects the user to the main screen, otherwise it displays an error message.
[1644] Step 3:
[1645] The terminal displays a question to the user asking about their reflection needs for the day. The user inputs the content they want to reflect on and clicks the send button. The input data includes the specific content of the user's reflection (e.g., "Today, I would like to reflect on the things that made me feel I grew"), and the input is sent to the server.
[1646] Step 4:
[1647] The server analyzes the received reflection content, generates a corresponding prompt, and returns it to the device. This analysis uses a generative AI model to generate an appropriate prompt based on the input text. For example, it generates a question such as, "Please tell us about a specific event that made you feel like you grew."
[1648] Step 5:
[1649] The terminal displays the prompts received from the server to the user. The user enters appropriate answers to the prompts and clicks the submit button. The terminal then sends the user's answers back to the server. This process involves repeated user input and server analysis.
[1650] Step 6:
[1651] The server analyzes the user's answers and generates the next question or feedback comment, which is returned to the device. This process can be repeated as many times as necessary. For example, the next prompt might be, "That's great. Why do you think you demonstrated leadership?"
[1652] Step 7:
[1653] The server organizes the diary entries based on all the conversations and summarizes them in a diary format, such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative."
[1654] Step 8:
[1655] The server saves the created diary data in the database. It sends a response indicating that the save was successful to the device. The device then displays a message to the user notifying them that the diary has been saved (e.g., "Your diary has been saved. Would you like to check today's review?").
[1656] Step 9:
[1657] The server uses an emotion engine to analyze the emotions contained in the user's input. This analysis uses a generative AI model to detect emotions such as "happiness," "sadness," and "surprise" from the text. Based on the recognized emotions, the server tailors feedback and insights and sends them to the device. For example, if the user expresses sadness, the server provides gentle feedback such as, "That must be hard. Is there anything else you're concerned about?"
[1658] Step 10:
[1659] The server then suggests content related to the emotion. For example, if a user writes a positive diary entry, it will suggest a positive article called "How to Stay Positive." If a negative emotion is recognized, it will suggest a meditation video for stress relief. The suggested content is then displayed on the device.
[1660] In this way, users can write their diary while receiving personalized feedback based on their emotions, and get an even richer experience through related content.
[1661] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1662] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1663] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1664] [Fourth embodiment]
[1665] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1666] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1667] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1668] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1669] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1670] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1671] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1672] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1673] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1674] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1675] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1676] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1677] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1678] An embodiment of the present invention will be described. This system uses a generation AI to assist users in writing their diary entries and reviewing their diary entries. Below, the program's processing will be explained in natural language, with specific examples provided to illustrate the details.
[1679] 1. User Authentication
[1680] 1. The terminal displays a login screen to the user and prompts them to enter their username and password.
[1681] Example: A login page appears, presenting fields for entering a "username" and "password."
[1682] 2. The user enters their username and password and clicks the login button.
[1683] Example: Enter "login_user" and "secure_password" and click the "Login" button.
[1684] 3. The terminal sends the entered login information to the server.
[1685] 4. The server verifies the received login information using the authentication system and returns the authentication result to the terminal.
[1686] Example: If authentication is successful, a message will be displayed informing you to proceed to the next step.
[1687] 2. Gathering user needs
[1688] 1. The terminal displays a question to the user asking about the user's needs for the day's reflection.
[1689] Example: The question "What would you like to reflect on today? (Example: Something that made you happy, something that made you feel you grew)" will be displayed.
[1690] 2. The user enters the content they want to review and clicks the send button.
[1691] Example: Type, "Today I would like to reflect on something that I felt I grew from," and click the "Send" button.
[1692] 3. The terminal sends the user's input to the server.
[1693] 4. The server analyzes the received feedback, generates a corresponding prompt, and returns it to the terminal.
[1694] Example: A prompt might be generated: "Tell me a specific event that made you feel like you grew."
[1695] 3. Diary writing support through dialogue
[1696] 1. The terminal displays the prompt received from the server to the user.
[1697] Example: The message displayed is, "Please tell us a specific event in which you felt you grew."
[1698] 2. The user enters the appropriate answers to the prompts and clicks the submit button.
[1699] Example: Type "I demonstrated leadership in a new project" and click the "Submit" button.
[1700] 3. The terminal sends the user's answer to the server.
[1701] 4. The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the device. This process is repeated as many times as necessary.
[1702] Example: The server generates the next question: "That's great! How do you think you demonstrated leadership?"
[1703] 4. Providing feedback and insights
[1704] 1. The server generates feedback and insights based on the user's input and sends them to the device.
[1705] Example: Feedback generated might include, "The specific explanations and role assignments led to the team's success. What was the reaction?"
[1706] 2. The device displays feedback and insights from the server to the user.
[1707] 5. Organizing and summarizing your diary
[1708] 1. The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[1709] Example: Diary-style data such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up the roles. Result: The project progressed smoothly and everyone was cooperative." is generated.
[1710] 2. The server stores the generated diary data in a database.
[1711] 6. Saving and displaying diary entries
[1712] 1. The server sends a response to the device indicating that the diary entry was successfully saved.
[1713] 2. The device displays a message to the user informing them that the diary entry has been saved.
[1714] Example: The message "Your diary entry has been saved. Would you like to review today's review?" will be displayed.
[1715] 3. The terminal displays the contents of the diary created as needed to the user.
[1716] These steps allow users to write their diary entries through natural dialogue and review them periodically. By utilizing generative AI, we can reduce the difficulty users face when writing a diary and promote their personal growth.
[1717] The processing flow will be explained below.
[1718] Step 1:
[1719] The terminal displays a login screen to the user, prompting them to enter their username and password.
[1720] Specifically, the login screen is rendered and the input fields are made accessible to the user.
[1721] Step 2:
[1722] The user enters the username and password and clicks the login button.
[1723] Specifically, enter "login_user" and "secure_password" in the form and press the "Login" button.
[1724] Step 3:
[1725] The terminal transmits the entered login information to the server.
[1726] Specifically, the username and password are sent to the server via HTTPS.
[1727] Step 4:
[1728] The server verifies the received login information using an authentication system and returns the authentication result to the terminal.
[1729] Specifically, it verifies authentication information through a database query and generates a session ID if authentication is successful.
[1730] Step 5:
[1731] If the authentication is successful, the terminal redirects the user to the main screen, and if it is unsuccessful, it displays an error message.
[1732] Specifically, if successful, the main screen is rendered, and if unsuccessful, an error message is displayed on the screen.
[1733] Step 6:
[1734] The terminal displays a question to the user asking about the user's needs for reviewing the day.
[1735] Specifically, the prompt "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)" will be displayed.
[1736] Step 7:
[1737] The user inputs the content they want to review and clicks the send button.
[1738] Specifically, the user enters "Today I would like to reflect on the things in which I felt I have grown" in the input field and clicks the "Send" button.
[1739] Step 8:
[1740] The terminal transmits the user's input to the server.
[1741] As a specific operation, the input data is sent to the server.
[1742] Step 9:
[1743] The server analyzes the received review content, generates a corresponding prompt, and returns it to the terminal.
[1744] Specifically, the generation AI analyzes the input text and generates a question such as, "Please tell us a specific event that made you feel like you grew."
[1745] Step 10:
[1746] The terminal displays the generated prompt to the user.
[1747] Specifically, a message will appear on the screen saying, "Please tell us a specific event that made you feel like you've grown."
[1748] Step 11:
[1749] The user enters the appropriate answers to the prompts and clicks the submit button.
[1750] Specifically, enter "I demonstrated leadership in a new project" in the input field and click the "Submit" button.
[1751] Step 12:
[1752] The terminal transmits the user's answer to the server.
[1753] Specifically, the input data is sent to the server again.
[1754] Step 13:
[1755] The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the terminal.
[1756] The specific behavior is to generate the following prompt: "That's great! Why do you think that demonstrates leadership?"
[1757] Step 14:
[1758] The terminal displays the feedback and insights received from the server to the user.
[1759] Specifically, the feedback comments are displayed on the screen.
[1760] Step 15:
[1761] The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[1762] Specifically, the following diary data is created and saved: "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up the roles. Result: The project progressed smoothly and everyone was cooperative."
[1763] Step 16:
[1764] The server stores the generated diary data in a database.
[1765] As a specific operation, diary data is registered in a database.
[1766] Step 17:
[1767] The server sends a response to the terminal indicating that the diary has been successfully saved.
[1768] Specifically, a success message is sent to the terminal.
[1769] Step 18:
[1770] The terminal displays a message to the user informing them that the diary entry has been saved.
[1771] Specifically, it displays the message "Your diary has been saved. Would you like to review today's review?"
[1772] Step 19:
[1773] The terminal displays the contents of the diary created as needed to the user.
[1774] Specifically, the contents of the saved diary are displayed on the screen.
[1775] Example 1
[1776] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1777] Previous diary entry support systems lacked the ability to effectively analyze user input and generate appropriate prompts to address individual reflection needs. They also struggled to provide feedback and insights to users, and the process of organizing dialogue content into diary format was laborious. Furthermore, they lacked the ability to categorize diary content for easy future reference, and the ability to collect users' reflection needs.
[1778] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1779] In this invention, the server includes means for accepting input from a user, means for analyzing the input and generating a prompt for the next input, and means for presenting the prompt to the user, thereby enabling generation of an appropriate prompt using a generative AI model.
[1780] "Means for accepting input from the user" is a function that provides an interface for the user to input information to the system.
[1781] The "means for analyzing the input and generating a prompt for the next input" is a function that analyzes the received user input and generates questions and instructions to accurately guide the user to the next information that they should enter.
[1782] The "means for presenting the prompt to the user" is a function for visually or audibly presenting the generated prompt to the user.
[1783] The "means for generating feedback and insights based on user input" is a function that generates appropriate feedback and analysis results based on the user's input and provides them to the user.
[1784] The "means for organizing the contents of the dialogue and summarizing them in a diary format" is a function for organizing information obtained through a dialogue with a user and summarizing it in a diary format based on a specific format.
[1785] The "means for saving the compiled diary" is a function for saving the created diary data in a storage such as a database.
[1786] "Means for generating the prompt using a generative AI model" refers to a function that utilizes an artificial intelligence model to automatically generate the prompt.
[1787] The "means for classifying the diary content entered by the user into categories" is a function for classifying the diary content entered by the user into specific categories or items.
[1788] The "means for collecting the user's reflection needs" is a function for collecting the user's objectives and requests when writing a diary.
[1789] This invention is a system for assisting users in effectively writing and reviewing their diary entries, and specifically, it utilizes a generative AI model to generate prompts and provide feedback and insights to the user. The following describes in detail the embodiments of the invention.
[1790] Hardware and Software
[1791] This system uses the following hardware and software:
[1792] Device: A device (e.g., computer, smartphone, tablet) that provides a user interface (UI) that runs on a web browser.
[1793] Server: The server receives user input, analyzes it, generates feedback and prompts. It also includes storage for saving the diary using a database.
[1794] Generative AI models: AI models that perform natural language processing (e.g., GPT-3).
[1795] Program processing
[1796] A user first accesses the system through a browser on their device. The device displays a login screen and prompts the user to enter their username and password. After the user enters these and clicks the login button, the device sends the information to the server. The server verifies this information using the authentication system and returns the authentication result.
[1797] If the authentication is successful, the device then displays a question to the user asking about their needs for reflection that day. For example, the question might be, "What would you like to reflect on today? (Example: Something that made you happy, something that made you feel you have grown)." If the user enters "I would like to reflect on something that made me feel I have grown today," and clicks the send button, the device sends the input to the server.
[1798] The server analyzes the received input using a generative AI model and generates the next prompt the user should enter. For example, a prompt might be generated such as, "Please tell us a specific event that made you feel like you grew." The device then displays this prompt to the user, who then enters the information again. For example, the user might enter, "I was able to demonstrate leadership in a new project," and click the send button.
[1799] The server analyzes this response and generates further questions and feedback. By repeating this process multiple times, the diary entry progresses through dialogue. The server generates feedback and insights based on the user's input, such as "The specific explanation and division of roles led to the team's success. What was the reaction?" and sends this feedback to the device.
[1800] Finally, the server organizes the diary entries into categories based on all the conversations and compiles them into a diary format. For example, it generates diary-format data such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I carefully explained things to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative." The generated diary data is then saved in a database by the server.
[1801] The device receives a message from the server saying, "Your diary entry has been saved. Would you like to check today's review?" and notifies the user. If necessary, the device displays the saved diary entry to the user.
[1802] Through these processes, users can write their diary through natural dialogue and use generative AI to conduct effective self-reflection. This invention enables users to improve the quality of their daily self-reflection.
[1803] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1804] Step 1: User authentication
[1805] Input: Username, Password
[1806] Processing: The terminal displays a login screen to the user, prompting them to enter their username and password. The user enters these and clicks the login button.
[1807] Data processing: The information entered by the user is sent to the server as an HTTP POST request.
[1808] Output: The authentication information is sent to the server.
[1809] Specific behavior: The terminal displays a login form in the web browser and provides input fields for the username and password. The user enters "login_user" and "secure_password" and clicks the login button.
[1810] Step 2: Returning the authentication result
[1811] Input: Credentials
[1812] Processing: The server verifies the received login information using the authentication system and returns the authentication result to the terminal.
[1813] Data processing: Call the authentication API and parse the response.
[1814] Output: The authentication result is returned to the terminal.
[1815] Specific operation: The server performs authentication using an authentication system (e.g., OAuth 2.0 or LDAP), generates a success or failure message, and returns it to the terminal in JSON format.
[1816] Step 3: Reflection and gathering needs
[1817] Input: Authentication result
[1818] Processing: If authentication is successful, the device displays a question to the user asking about their reflection needs for the day.
[1819] Data processing: Generate a question form and present it to the user.
[1820] Output: User's retrospective needs
[1821] Specific operation: The device displays the question "What would you like to reflect on today?", and the user enters "Today I would like to reflect on something that I felt I grew from," and clicks the send button.
[1822] Step 4: Submitting your retrospective needs
[1823] Input: User's reflection needs
[1824] Processing: The terminal sends the user's input to the server.
[1825] Data processing: The user-entered retrospective needs are sent as an HTTP POST request.
[1826] Output: A lookup request is sent to the server.
[1827] Specific behavior: Generates and sends an HTTP request to send the content entered in the text box to the server.
[1828] Step 5: Generate prompts
[1829] Input: User's reflection needs
[1830] Processing: The server analyzes the received reflection content using the generative AI model and generates a prompt sentence.
[1831] Data processing: Input reflection needs into the AI model to generate appropriate prompts.
[1832] Output: Generated prompt statement
[1833] Specific operation: The server inputs the reflection content (e.g., "Today, I would like to reflect on something that made me feel like I grew") into the AI model, generates a prompt saying, "Please tell us about a specific event that made you feel like you grew," and returns it to the device.
[1834] Step 6: Display a prompt
[1835] Input: prompt statement
[1836] Processing: The terminal displays the prompt received from the server to the user.
[1837] Data processing: The generated prompt text is displayed on the screen.
[1838] Output: The user is prompted.
[1839] Specific action: The device will display the prompt on the screen: "Please tell us a specific event that made you feel like you grew."
[1840] Step 7: Answer the prompts
[1841] Input: prompt statement
[1842] Action: The user enters the appropriate response to the prompt and clicks the submit button.
[1843] Data processing: User answers are sent as HTTP POST requests.
[1844] Output: The user's answer is sent to the server.
[1845] Specific action: Enter "I demonstrated leadership in a new project" in the text box and click the submit button.
[1846] Step 8: Generate your next question or feedback
[1847] Input: User's answer
[1848] Processing: The server analyzes the user's answers and uses the generative AI model to generate the next question and feedback comments.
[1849] Data transformation: Input answers into AI models to generate new questions and feedback.
[1850] Output: New question or feedback statement
[1851] Specific behavior: The server generates the next question, "That's great. Why do you think that demonstrates leadership?", and returns it to the device. This process is repeated as many times as necessary.
[1852] Step 9: View your feedback
[1853] Input: Feedback statement
[1854] Processing: The device displays feedback and insights from the server to the user.
[1855] Data processing: Feedback statements are displayed on the screen.
[1856] Output: Feedback is displayed to the user.
[1857] Specific action: The device displays feedback on the screen, such as, "The specific explanation and division of roles led to the team's success. What was the reaction?"
[1858] Step 10: Organize and summarize your diary
[1859] Input: Dialogue
[1860] Processing: The server organizes the diary entries into categories based on all the conversations and compiles them into a diary format.
[1861] Data processing: The conversation content is retrieved from the database, formatted, and compiled into a diary.
[1862] Output: Generated diary data
[1863] Specific behavior: The server generates specific diary data (e.g., "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative.").
[1864] Step 11: Save diary data
[1865] Input: Generated diary data
[1866] Processing: The server saves the generated diary data in a database.
[1867] Data processing: Diary data is saved in the database using an INSERT query.
[1868] Output: Diary data is saved.
[1869] Specific operation: The server creates an INSERT query and saves the diary data to the database.
[1870] Step 12: Save complete notification
[1871] Input: Saved Results
[1872] Processing: The server sends a response to the device indicating that the diary entry has been saved successfully.
[1873] Data processing: Generate a save success message and send it as a JSON response.
[1874] Output: A save success message is sent to the terminal.
[1875] Specific behavior: A JSON response message saying "Your diary entry has been saved. Would you like to review today's review?" is sent to the device.
[1876] Step 13: Notify users
[1877] Input: Save successful message
[1878] Processing: The device displays a message to the user informing them that the diary entry has been saved.
[1879] Data processing: Display the message on the screen.
[1880] Output: A notification is displayed to the user.
[1881] What it does: Your device will display a pop-up notification saying, "Your diary has been saved. Would you like to review today's review?"
[1882] Step 14: Displaying diary entries
[1883] Input: User request
[1884] Processing: The terminal displays the contents of the diary created as needed to the user.
[1885] Data processing: Retrieve diary contents from the database and display them on the screen.
[1886] Output: The user can check the diary contents.
[1887] Specific operation: The device displays the saved diary entry on the user interface, allowing the user to check the contents.
[1888] Through the above processing steps, users can utilize the generative AI model to effectively write and review their diary entries.
[1889] (Application example 1)
[1890] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1891] Conventional user diary writing systems require users to write voluntarily, making it difficult to maintain motivation. They also lack support for effective daily reflection, leaving users with few opportunities to grow and gain new insights. Furthermore, they lack personalized feedback and insights using generative AI, making it difficult to provide optimal content tailored to individual users' needs. A new system is needed to solve these issues.
[1892] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1893] In this invention, the server includes a means for collecting the user's reflection needs, a means for generating prompt sentences using a generative AI model to prompt the next input, and a means for delivering the diary as personalized content. This makes it possible to provide effective support to the user and increase their motivation to write in the diary. In addition, by providing the user with individually optimized feedback and insights, it is possible to promote deeper self-understanding and growth. This makes it possible to effectively carry out daily reflection and support the user's growth.
[1894] "User authentication" is the process by which a user enters a username and password to access a system, and the information is verified to authenticate the user as a legitimate user.
[1895] "Reflection needs" refers to specific themes or items that a user wants to reflect on regarding the events that they experienced or the feelings they had that day.
[1896] A "generative AI model" refers to an artificial intelligence model that uses natural language processing techniques to analyze user input and generate appropriate feedback and prompts.
[1897] A "prompt sentence" refers to a guideline or question sentence that is generated to prompt the user for the next input.
[1898] "Personalized content" refers to customized information and feedback that is optimized to a user's individual needs and inputs.
[1899] "Content distribution" refers to the process of transmitting information to provide generated journal entries and feedback to users.
[1900] A "smartphone" refers to a mobile phone terminal that can connect to the Internet and use multi-function applications.
[1901] The present invention is a system that uses a generative AI model to assist users in writing and reviewing their diary entries. The system aims to provide personalized feedback and insights according to the user's needs, and to organize and store the diary. The following describes in detail the mode for implementing the invention.
[1902] 1. User Authentication
[1903] The server provides an authentication function for users to access the system. The terminal displays a login screen to the user and prompts them to enter their username and password. When the user enters the login information, the information is sent to the server, which then authenticates it using the authentication system.
[1904] 2. Gathering user needs
[1905] The server generates prompts to gather the user's reflection needs and presents them to the user through the terminal. For example, the terminal displays a question to the user such as, "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)." The user inputs what they want to reflect on, and the information is sent to the server.
[1906] 3. Diary writing support through dialogue
[1907] The server analyzes the received reflection content and generates the next prompt using a generative AI model. The generated prompt is sent to the device and displayed to the user. For example, a message might be displayed such as, "Please tell us a specific event that made you feel like you grew." The user then enters an appropriate response, which is then sent back to the server. The server repeats this process multiple times to assist the user in writing their diary.
[1908] 4. Providing feedback and insights
[1909] The server generates feedback and insights based on the user's input. This feedback is generated using a generative AI model. For example, if a user types, "I demonstrated leadership in a new project," the server generates the following feedback and sends it to the device: "That's great. Why do you think you demonstrated leadership?"
[1910] 5. Organizing and summarizing your diary
[1911] The server organizes the diary entries based on all the conversations and saves them as personalized content.
[1912] 6. Saving and displaying diary entries
[1913] The server saves the compiled diary in a database so that the user can access it later. The terminal displays a message to the user that saving is complete and redisplays the contents of the created diary as needed.
[1914] This system uses the OpenAI API as a generative AI model to analyze user input, generate prompts, and provide feedback. In addition, a Python program is implemented on the server and terminal.
[1915] The following are examples of prompts:
[1916] Please tell us specifically how you felt you grew today.
[1917]
[1918] That's great. Why do you think you were able to demonstrate leadership?
[1919] As described above, the system of the present invention can effectively support the user's diary writing and provide individually optimized feedback.
[1920] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1921] Step 1:
[1922] The terminal displays a login screen to the user and prompts them to enter their username and password. The user enters the username "test_user" and the password "secure_password." The input data is sent to the server.
[1923] Step 2:
[1924] The server checks the received login information with the authentication system. If authentication is successful, it returns a success response to the terminal to proceed to the next step. If authentication is unsuccessful, it returns an error message.
[1925] Input: Username and Password
[1926] Output: Authentication result
[1927] Step 3:
[1928] If user authentication is successful, the terminal displays a question to the user asking about their needs for reflection on that day. For example, the user might enter, "I would like to reflect on the things that I felt I grew from today," and the terminal sends that data to the server.
[1929] Step 4:
[1930] The server analyzes the received reflection content and uses a generative AI model to generate a corresponding prompt, such as "Please tell us about a specific event that made you feel like you grew," and returns it to the device.
[1931] Input: User's retrospective needs
[1932] Output: Generated prompt statement
[1933] Step 5:
[1934] The terminal displays the prompt received from the server to the user. The user inputs an appropriate response to the prompt, for example, "I was able to demonstrate leadership in a new project." The terminal then transmits the data to the server.
[1935] Step 6:
[1936] The server analyzes the user's response and uses a generative AI model to generate the next question or feedback comment, such as "That's great. Why do you think you demonstrated leadership?", and returns it to the device.
[1937] Input: User's answer
[1938] Output: Next prompt statement
[1939] Step 7:
[1940] The terminal displays the feedback received from the server and the next prompt to the user, and this process is repeated until the user has written enough diary entries.
[1941] Step 8:
[1942] The server organizes the diary entries into categories based on the content of all the conversations and compiles them in diary format.
[1943] Input: All dialogue
[1944] Output: Diary format data
[1945] Step 9:
[1946] The server saves the organized diary data in a database and then sends a message to the device indicating that the data has been saved.
[1947] Input: Diary-style data
[1948] Output: Save complete message
[1949] Step 10:
[1950] The terminal displays a save completion message from the server to the user, and redisplays the contents of the created diary as necessary.
[1951] This is the specific processing flow of this system. By utilizing a generative AI model to generate prompts and provide feedback based on user input, it is possible to effectively support users in writing their diary entries.
[1952] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1953] An embodiment of the present invention will be described. This system combines a generative AI and an emotion engine to assist users in writing their diary entries and reviewing their diary entries. Below, the program's processing will be explained in natural language, with specific examples provided for further details.
[1954] 1. User Authentication
[1955] 1. The terminal displays a login screen to the user and prompts them to enter their username and password.
[1956] Specifically, the login screen is rendered and the input fields are made accessible to the user.
[1957] 2. The user enters their username and password and clicks the login button.
[1958] Specifically, enter "login_user" and "secure_password" in the form and press the "Login" button.
[1959] 3. The terminal sends the entered login information to the server.
[1960] How it works: The username and password are sent to the server over HTTPS.
[1961] 4. The server verifies the received login information using the authentication system and returns the authentication result to the terminal.
[1962] Specifically, it verifies authentication information through a database query and generates a session ID if authentication is successful.
[1963] 5. If authentication is successful, the terminal redirects the user to the main screen; if not, it displays an error message.
[1964] Specifically, if successful, the main screen is rendered, and if unsuccessful, an error message is displayed on the screen.
[1965] 2. Gathering user needs
[1966] 1. The terminal displays a question to the user asking about the user's needs for the day's reflection.
[1967] Specifically, the prompt "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)" will be displayed.
[1968] 2. The user enters the content they want to review and clicks the send button.
[1969] Specifically, the user enters "Today I would like to reflect on the things in which I felt I have grown" in the input field and clicks the "Send" button.
[1970] 3. The terminal sends the user's input to the server.
[1971] Example of operation: Input data is sent to the server.
[1972] 4. The server analyzes the received feedback, generates a corresponding prompt, and returns it to the terminal.
[1973] Specifically, the generation AI analyzes the input text and generates a question such as, "Please tell us a specific event that made you feel like you grew."
[1974] 3. Diary writing support through dialogue
[1975] 1. The terminal displays the prompt received from the server to the user.
[1976] Specifically, a message will appear on the screen saying, "Please tell us a specific event that made you feel like you've grown."
[1977] 2. The user enters the appropriate answers to the prompts and clicks the submit button.
[1978] Specifically, enter "I demonstrated leadership in a new project" in the input field and click the "Submit" button.
[1979] 3. The terminal sends the user's answer to the server.
[1980] Example of operation: The input data is sent to the server again.
[1981] 4. The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the device. This process is repeated as many times as necessary.
[1982] Specifically, the server generates the following prompt: "That's great! How do you think you demonstrate leadership?"
[1983] 4. Providing feedback and insights
[1984] 1. The server generates feedback and insights based on the user's input and sends them to the device.
[1985] A specific action would be to generate feedback such as, "The specific explanation and division of roles led to the team's success. What was the reaction?"
[1986] 2. The device displays feedback and insights from the server to the user.
[1987] Example of operation: Feedback comments are displayed on the screen.
[1988] 5. Organizing and summarizing your diary
[1989] 1. The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[1990] Specifically, the following diary data is created and saved: "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up the roles. Result: The project progressed smoothly and everyone was cooperative."
[1991] 2. The server stores the generated diary data in a database.
[1992] Example of operation: Diary data is registered in the database.
[1993] 6. Saving and displaying diary entries
[1994] 1. The server sends a response to the device indicating that the diary entry was successfully saved.
[1995] Example of operation: A success message is sent to the terminal.
[1996] 2. The device displays a message to the user informing them that the diary entry has been saved.
[1997] Specifically, it displays the message "Your diary has been saved. Would you like to review today's review?"
[1998] 3. The terminal displays the contents of the diary created as needed to the user.
[1999] Example of operation: The saved diary contents are displayed on the screen.
[2000] 7. Emotion Recognition and Customization
[2001] 1. The server uses an emotion engine to analyze the emotions contained in the user's input.
[2002] Specifically, the emotion engine detects emotions such as "joy," "sadness," and "surprise" from the user's text.
[2003] 2. The server tailors feedback and insights based on the recognized emotions and sends them to the device.
[2004] For example, if a user expresses sadness, gentle feedback is provided: "That must be hard. Is there anything else you're concerned about?"
[2005] 3. The server customizes prompts based on the recognized emotion and sends them to the device.
[2006] Specifically, if the user expresses joy, a proactive prompt is provided: "Tell me more about that event!"
[2007] In this way, a diary entry support system that combines generative AI and an emotion engine allows users to write their diary entries through natural dialogue and periodically review them. By adding emotion recognition functionality, more personalized feedback and insights can be provided to users, promoting deeper self-understanding and growth.
[2008] The processing flow will be explained below.
[2009] Step 1:
[2010] The terminal displays a login screen to the user, prompting them to enter their username and password.
[2011] Specifically, a login screen is rendered, allowing the user to access the input fields.
[2012] Step 2:
[2013] The user enters the username and password and clicks the login button.
[2014] Specifically, enter "login_user" and "secure_password" in the form and press the "Login" button.
[2015] Step 3:
[2016] The terminal transmits the entered login information to the server.
[2017] Specifically, the username and password are sent to the server via HTTPS.
[2018] Step 4:
[2019] The server verifies the received login information using an authentication system and returns the authentication result to the terminal.
[2020] Specifically, it verifies authentication information through a database query and generates a session ID if authentication is successful.
[2021] Step 5:
[2022] If the authentication is successful, the terminal redirects the user to the main screen, and if it is unsuccessful, it displays an error message.
[2023] Specifically, if successful, the main screen is rendered, and if unsuccessful, an error message is displayed on the screen.
[2024] Step 6:
[2025] The terminal displays a question to the user asking about the user's needs for reviewing the day.
[2026] Specifically, the prompt "What would you like to reflect on today? (e.g., something that made you happy, something that made you feel you grew)" will be displayed.
[2027] Step 7:
[2028] The user inputs the content they want to review and clicks the send button.
[2029] Specifically, the user enters "Today I would like to reflect on the things in which I felt I have grown" in the input field and clicks the "Send" button.
[2030] Step 8:
[2031] The terminal transmits the user's input to the server.
[2032] As a specific operation, the input data is sent to the server.
[2033] Step 9:
[2034] The server analyzes the received review content, generates a corresponding prompt, and returns it to the terminal.
[2035] Specifically, the generation AI analyzes the input text and generates a question such as, "Please tell us a specific event that made you feel like you grew."
[2036] Step 10:
[2037] The terminal displays the generated prompt to the user.
[2038] Specifically, a message will appear on the screen saying, "Please tell us a specific event that made you feel like you've grown."
[2039] Step 11:
[2040] The user enters the appropriate answers to the prompts and clicks the submit button.
[2041] Specifically, enter "I demonstrated leadership in a new project" in the input field and click the "Submit" button.
[2042] Step 12:
[2043] The terminal transmits the user's answer to the server.
[2044] Specifically, the input data is sent to the server again.
[2045] Step 13:
[2046] The server analyzes the user's responses and uses an emotion engine to recognize the emotions contained in the input.
[2047] Specifically, it detects the emotion "joy" from the text "I was able to demonstrate leadership in a new project."
[2048] Step 14:
[2049] The server tailors feedback and insights based on the emotions recognized by the emotion engine and returns them to the device.
[2050] A specific action would be to generate feedback based on the recognized emotion of "joy" such as, "That's great. What specific leadership skills did you demonstrate?"
[2051] Step 15:
[2052] The device displays feedback and insights to the user.
[2053] Specifically, feedback will appear on the screen saying, "That's great. What specific leadership skills did you demonstrate?"
[2054] Step 16:
[2055] The server customizes prompts according to the recognized emotions and sends them to the device.
[2056] Specifically, users who express joy are proactively prompted with, "Tell us more about what happened!"
[2057] Step 17:
[2058] The terminal displays a prompt to the user.
[2059] Specifically, a prompt will appear on the screen saying, "Tell us more about that event!"
[2060] Step 18:
[2061] The user responds to the prompts with further details and clicks the submit button.
[2062] Specifically, you would enter, "I explained things carefully to my team members and made sure that everyone was properly assigned roles," and then click the "Send" button.
[2063] Step 19:
[2064] The terminal sends the user's detailed response to the server.
[2065] As a specific operation, the input data is sent to the server.
[2066] Step 20:
[2067] The server organizes the diary entries into categories based on the content of all conversations and compiles them in diary format.
[2068] Specifically, the conversation is categorized into categories such as "Today's growth," "Reasons," and "Results," and compiled in diary format.
[2069] Step 21:
[2070] The server stores the generated diary data in a database.
[2071] As a specific operation, diary data is registered in a database.
[2072] Step 22:
[2073] The server sends a response to the terminal indicating that the diary has been successfully saved.
[2074] As a specific operation, a save success message is sent to the terminal.
[2075] Step 23:
[2076] The terminal displays a message to the user informing them that the diary entry has been saved.
[2077] Specifically, the message "Your diary has been saved. Would you like to review today's review?" will be displayed.
[2078] Step 24:
[2079] The terminal displays the contents of the diary created as needed to the user.
[2080] Specifically, the contents of the saved diary are displayed on the screen.
[2081] Example 2
[2082] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2083] Conventional interactive diary creation systems have the problem that they do not take into account the user's emotions, provide uniform feedback and prompts, and do not provide personalized dialogue for each user, which does not improve the user experience.In addition, there is also the issue of not being able to flexibly respond to user needs when it comes to organizing and saving the dialogue content.
[2084] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for accepting input from a user, means for analyzing the input and generating a prompt sentence for prompting the next input, means for presenting the prompt sentence to the user, means for generating feedback and insight based on the user input, means for organizing the dialogue content and summarizing it in a diary format, means for saving the summarized diary, means for analyzing emotions included in the user input using an emotion engine, and means for adjusting the feedback and prompt sentences based on the recognized emotions. This allows for the provision of feedback and prompts personalized for each user, enabling a flexible and engaging user experience.
[2085] "User input" refers to information or data provided by a user of the system using an input device.
[2086] "Analysis" is the process of understanding the content and extracting meaning from data input by a user.
[2087] A "prompt sentence" is a question or guide text that prompts the user for the next input.
[2088] "Feedback" refers to the evaluations and comments that the system returns in response to input from the user.
[2089] "Insights" are the knowledge and advice that the system derives from the user's input data.
[2090] "Dialogue content" is a record of a series of messages and exchanges between a user and the system.
[2091] The "diary format" is a document format in which information entered by a user is compiled in the form of a diary.
[2092] "Storage" is the process of recording generated data in a storage device such as a database for long-term retention.
[2093] An "emotion engine" is a system that analyzes text input from a user and identifies the emotions contained therein.
[2094] "Analyzing" means structuring data and processing it to understand its meaning and sentiment.
[2095] "Adjustment" is the process of customizing content based on the analysis results and changing it into a format that is optimal for the user.
[2096] "User needs" are the specific requirements and expectations that users have of a system.
[2097] This invention is a system that utilizes a generative AI model and an emotion engine to support users in writing their diary entries and to allow them to review their diary entries. Specific embodiments of this system are described below.
[2098] Overall system configuration
[2099] This system consists of three main components: a server, a terminal, and a user. The server is responsible for data processing and analysis using a generative AI model and an emotion engine. The terminal provides the user interface and receives user input. The user interacts with the system through the terminal.
[2100] User Authentication
[2101] The terminal first displays a login screen to the user and prompts them to enter their username and password. This authenticates the user. Specifically, the login screen is constructed using HTML, CSS, and JavaScript to accept user input. The user enters their username and password on the login screen and clicks the "Login" button. This information is sent to the server via HTTPS.
[2102] Data analysis and prompt generation
[2103] The server checks the data sent by the user in the database, and if authentication is successful, generates a session ID. The terminal then confirms successful authentication of the user and proceeds to the next step. After the user logs in, the terminal displays a question to the user asking about their needs for reflection on that day. As a specific example, the prompt sentence used is "What would you like to reflect on today? (Example: Something that made you happy, something you felt you grew from)."
[2104] Diary writing through dialogue
[2105] The user enters what they want to reflect on and clicks the send button. For example, they might enter, "Today, I would like to reflect on something that made me feel like I grew." This input is then sent back to the server. The server analyzes the content and uses a generative AI model to generate an appropriate prompt. For example, a question might be generated: "Please tell me about a specific event that made you feel like you grew."
[2106] The terminal displays the generated prompt to the user, and the user responds by typing, for example, "I've demonstrated leadership in the new project." This sequence of interactions is repeated until the dialogue is complete.
[2107] Providing feedback and insights
[2108] The server generates feedback and insights based on the user's input. For example, it generates feedback such as, "The specific explanation and division of roles led to the team's success. What was the reaction?" The generated feedback is displayed to the user via the device.
[2109] Organizing and saving your diary
[2110] After the conversation is complete, the server organizes the diary entries into categories based on the content of the entire conversation and summarizes them in a diary format. For example, diary data can be created in the following format: "Today's growth: I was able to demonstrate leadership in a new project. Reason: I explained things carefully to my team members and clearly divided up their roles. Result: The project progressed smoothly and everyone was cooperative."
[2111] The generated diary data is saved in a database by the server. The user can then check the created diary at any time. The device notifies the user of a successful save message and displays the contents of the diary as needed. For example, it displays a message saying, "The diary has been saved. Would you like to check today's review?"
[2112] Emotion Recognition and Customization
[2113] The server uses an emotion engine to analyze the emotions contained in the user's input. For example, if a user enters an input such as "I felt very sad today," the emotion engine analyzes this text and recognizes the emotion "sad." Based on the recognized emotion, the server adjusts the feedback and prompt sentences. For example, if the user expresses sadness, the server may provide gentle feedback such as "That must have been difficult. Is there anything else that's bothering you?". Alternatively, if the user expresses joy, the server may provide a proactive prompt such as "Can you tell me more about that event?"
[2114] As described above, by utilizing a generative AI model and an emotion engine, the system provides personalized feedback and prompts to users, improving the user experience.
[2115] The flow of the identification process in the second embodiment will be described with reference to FIG.
[2116] Step 1:
[2117] The terminal displays a login screen to the user and prompts them to enter a username and password. Specifically, you build the user interface using HTML and CSS, create input fields using JavaScript, accept the username and password as input, and obtain authentication data from the user as output.
[2118] Step 2:
[2119] The user enters a username and password and clicks the login button. For example, the username is "login_user" and the password is "secure_password". We provide the username and password as input and get the authentication information sent to the terminal as output.
[2120] Step 3:
[2121] The device sends the entered login information to the server. It uses JavaScript to send authentication information (user name and password) over HTTPS, receiving the authentication information as input and sending encrypted data as output to the server.
[2122] Step 4:
[2123] The server verifies the received login information with its authentication system and returns the authentication result to the device. Specifically, it uses an SQL query to match the username and password against a database. It uses the authentication information retrieved from the database as input and generates an authentication result (success or failure) as output.
[2124] Step 5:
[2125] The terminal redirects the user to the main screen if authentication is successful, or displays an error message if authentication is unsuccessful. Specifically, it uses HTML and JavaScript to render the screen, taking the authentication result as input and updating the user interface as output.
[2126] Step 6:
[2127] The terminal displays a question to the user asking about their needs for reflection on that day. Specifically, it uses an HTML form to display the prompt "What would you like to reflect on today? (e.g., something that made you happy, something you felt you grew from)." It receives the authentication success status as input and presents the question to the user as output.
[2128] Step 7:
[2129] The user inputs the content they want to reflect on and clicks the send button. For example, they might input, "Today, I would like to reflect on the things that I felt I grew from." They provide the content of their reflection as input, and obtain data to be sent to the terminal as output.
[2130] Step 8:
[2131] The device sends the user's input to the server. JavaScript is used to send the reflection content via HTTPS. It receives reflection data from the user as input and generates data to send to the server as output.
[2132] Step 9:
[2133] The server analyzes the received reflection content, generates a corresponding prompt sentence, and returns it to the device. Specifically, it uses a generative AI model to analyze the input text and generate a question such as, "Please tell us a specific event that made you feel like you grew." The reflection data is used as input, and the generated prompt sentence is obtained as output.
[2134] Step 10:
[2135] The terminal displays the prompt received from the server to the user. Specifically, it uses HTML and JavaScript to display the message "Please tell us a specific event that made you feel like you've grown." It receives the prompt as input and updates the user interface as output.
[2136] Step 11:
[2137] The user inputs an appropriate response to the prompt and clicks the submit button. For example, the user might input, "I demonstrated leadership in a new project." The user provides the response data as input and obtains the data to be sent to the terminal as output.
[2138] Step 12:
[2139] The device sends the user's answers to the server. JavaScript is used to send the answer data via HTTPS. The device receives the user's answer data as input and generates data to be sent to the server as output.
[2140] Step 13:
[2141] The server analyzes the user's answers, generates the next question and feedback comments, and returns them to the device. This process is repeated as many times as necessary. Specifically, it uses a generative AI model to generate the next prompt and feedback comments. It uses the user's answer data as input and obtains the new prompt and feedback comments as output.
[2142] Step 14:
[2143] The server organizes the diary entries by topic based on all the dialogue content and compiles them in diary format. Specifically, it analyzes a series of dialogue data and creates diary data such as, "Today's growth: I was able to demonstrate leadership in a new project. Reason: I carefully explained things to my team members and properly assigned roles. Result: The project progressed smoothly and everyone was cooperative." It uses dialogue data as input and generates diary data as output.
[2144] Step 15:
[2145] The server stores the generated diary data in a database. Specifically, it inserts the diary data into the database using an SQL query. It uses the diary data as input and generates data stored in the database as output.
[2146] Step 16:
[2147] The terminal...
Claims
1. means for accepting input from a user; means for analyzing the input and generating a prompt for the next input; means for presenting said prompt to a user; a means for generating feedback and insights based on user input; A means of organizing the content of the conversation and summarizing it in diary form, and means for storing the compiled diary.
2. 2. The system according to claim 1, further comprising means for categorizing the input diary contents by item.
3. 10. The system of claim 1, further comprising means for collecting user reflective needs.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A