System

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving user input information and generating a user account; means for displaying a list of selectable characters to a user and receiving a user selection; means for storing task information entered by the user in a database; means for having a character process a task based on the stored task information; and means for notifying the user of the completion of the task processing.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Today's business people have limited time to focus on important work, and much of that time is spent on low-value-added tasks such as miscellaneous tasks and coordination. This reduces business productivity and hinders the efficiency of the entire company. Furthermore, performing miscellaneous tasks and coordination manually requires time and effort and carries a high risk of error. Another issue is that existing secretarial systems lack flexibility and user-friendliness, resulting in a poor user experience. [Means for solving the problem]

[0005] The present invention provides a means for generating a user account based on information entered by a user. It also includes a means for displaying a list of selectable characters to the user and receiving the user's selection, allowing the user to select a character according to their preferences. It also includes a means for saving task information entered by the user in a database and a means for the character to complete the task based on the saved task information. In particular, the inclusion of a means for the character to complete the task using artificial intelligence allows tasks to be completed efficiently and accurately. This provides a system including a means for notifying the user of the completion of task processing, thereby reducing the user's burden of miscellaneous tasks and coordination, allowing businesspeople to focus more on essential work. It also includes a means for displaying details of the processing results to the user, allowing the user to check the progress and results of the task. This improves the flexibility and user friendliness of the system and enhances the user experience.

[0006] "User input information" refers to data provided by the user to use the system, including name, email address, password, etc.

[0007] A "means for generating a user account" is a mechanism for creating an account based on input information provided by a user and granting privileges to that user.

[0008] "Character List" means a list of characters provided by the system that the user can select from, each character having a specific profile and abilities.

[0009] The "means for receiving a selection" is a mechanism for receiving and processing selection information when a user selects a desired character from a character list.

[0010] "Task information" refers to information such as the work content, details, and deadlines entered by the user, and the system uses this information to manage and process tasks.

[0011] "Means for saving to database" refers to the mechanism for recording and saving the task information entered by the user in the database within the system.

[0012] The "means for processing the task" is a mechanism by which the selected character actually carries out the task based on the stored task information.

[0013] "Artificial intelligence" is a technology in which computer programs imitate human intelligence and perform tasks such as learning, reasoning, and recognition.

[0014] The "means for notifying completion of task processing" is a mechanism for notifying the user of the result when the task is completed successfully.

[0015] The "means for displaying details of processing results" is a mechanism for visually presenting detailed information such as the progress and results of a task to the user. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The present invention is a system that efficiently handles the miscellaneous tasks and coordination of a businessman's daily work, and a character selected by the user supports these tasks. The following describes how the program for this system can be implemented and the processing it performs.

[0038] 1. User Registration and Login

[0039] When a user first uses the service, they enter the required information (name, email address, password) into the registration form on their device and press the submit button. The device then sends the entered information to the server, which then stores this information in a database and creates a user account.

[0040] The user enters their ID and password on the login screen and presses the login button. The device sends the authentication information to the server, which then authenticates them. If authentication is successful, the server sends the user's dashboard data to the device, which then displays the dashboard.

[0041] 2. Select a supporter (character)

[0042] The server retrieves the supporter list (character list) from the database and sends it to the terminal. The terminal displays the list to the user, who then selects the desired character. The terminal then sends the character information selected by the user to the server, and the server saves the selection information in the database.

[0043] 3. Enter the task

[0044] The user enters the task title, details, and deadline on the task input screen and presses the send button. The terminal sends the entered task information to the server, which then stores it in a database.

[0045] 4. Task completion by characters

[0046] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine, which then processes the task while imitating the character selected by the user.

[0047] For example, if a user inputs "adjust meeting schedule," the server checks the schedules of the necessary meeting participants and sends instructions to the AI ​​engine to make the adjustments.

[0048] AI will schedule the meeting and send confirmation emails to participants.

[0049] 5. Task Completion and Notifications

[0050] Once the task is completed, the server updates the database and sends a notification of task completion to the device, which displays the notification to the user and provides details about the completed task.

[0051] For example, when the schedule adjustment is completed, the server sends a notification message such as "Schedule adjustment completed."

[0052] Example: Document organization task

[0053] The user inputs the task "organizing documents" and presses the send button.

[0054] The terminal sends the task information to the server, which stores it in a database.

[0055] The server sends the task to the AI ​​engine, and a character selected by the user (e.g., a fictional character) begins organizing the documents.

[0056] The AI ​​engine classifies and organizes documents in real time and sends the results to the server.

[0057] The server stores the information on the completion of document organization in a database and sends a notification to the terminal.

[0058] The terminal notifies the user that "document organization is complete" and displays the detailed results.

[0059] In this way, the system efficiently handles users' miscellaneous tasks and coordination work, allowing them to focus on high-value-added tasks. Flexible support with selectable characters improves the user experience, and the use of artificial intelligence ensures accuracy and efficiency of processing.

[0060] The processing flow will be explained below.

[0061] Step 1: User Registration

[0062] The user opens the registration form on their device, enters their name, email address, and password, and presses the submit button.

[0063] The terminal transmits the input information to the server.

[0064] The server stores the received information in a database and creates a user account.

[0065] The server sends an account creation completion message to the terminal.

[0066] The terminal displays a message to the user indicating that the account has been created.

[0067] Step 2: User Login

[0068] The user opens the login screen on the device, enters their ID (email address) and password, and presses the login button.

[0069] The terminal sends the login information to the server.

[0070] The server compares the information with that in the database and performs authentication processing.

[0071] If the authentication is successful, the server sends an authentication success message and dashboard data to the terminal.

[0072] The terminal displays the user's dashboard.

[0073] Step 3: Select a supporter

[0074] The server retrieves the supporter list from the database and transmits it to the terminal.

[0075] The terminal displays the supporter list to the user.

[0076] The user selects the desired supporter from the list and presses the select button.

[0077] The terminal transmits the selection information to the server.

[0078] The server associates the selected supporter information with the user's account and stores it in a database.

[0079] The server sends a selection completion message to the terminal.

[0080] The terminal displays a selection completion message to the user.

[0081] Step 4: Task Input

[0082] The terminal displays a task input screen to the user.

[0083] The user enters the task title, details, and deadline, and presses the submit button.

[0084] The terminal transmits the input task information to the server.

[0085] The server stores the received task information in a database.

[0086] The server sends a task registration completion message to the terminal.

[0087] The terminal displays a task registration completion message to the user.

[0088] Step 5: Start task processing

[0089] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine.

[0090] The AI ​​engine will begin processing the task while imitating the character of the selected supporter.

[0091] For example, if a user requests a meeting schedule adjustment, the AI ​​engine will check the schedules of the participants and arrange the optimal date.

[0092] Step 6: Task execution

[0093] The AI ​​engine sends confirmation emails to meeting participants.

[0094] The server checks whether the email was sent successfully and stores the result in a database.

[0095] Step 7: Task Completion Notification

[0096] The server updates the database with information about the task completion.

[0097] The server sends a task completion notification to the terminal.

[0098] The terminal displays a task completion notification to the user.

[0099] Step 8: Review task details

[0100] The user checks the task completion notification on the device and opens a screen displaying detailed information.

[0101] The server sends the detailed information to the terminal.

[0102] The terminal displays the detailed results of the task to the user.

[0103] Through this series of steps, users can easily register tasks and have them efficiently handled by the selected supporter. Finally, users can check the progress and completion results of the task. This frees businesspeople from tedious chores and gives them more time to focus on important tasks.

[0104] Example 1

[0105] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0106] In today's business environment, businesspeople are often overwhelmed with numerous miscellaneous tasks and coordination work, resulting in a decline in productivity. There is a need for systems that can efficiently handle these miscellaneous tasks, allowing businesspeople to focus on more value-added work. However, existing systems lack sufficient flexibility in automating tasks and improve the user experience.

[0107] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0108] In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of selectable virtual characters to the user and receiving the user's selection, means for saving the task information entered by the user in a database, means for the virtual character to complete the task based on the saved task information, and means for notifying the user when the task has been completed. This enables the efficient processing of miscellaneous tasks and coordination work for businesspeople, improving the user experience, and ensuring the accuracy and efficiency of processing by using artificial intelligence.

[0109] "User" refers to a person who uses the system, who inputs information into the system, and who receives services provided by the system.

[0110] "Input information" refers to data or information provided by a user to the system, including name, email address, password, etc.

[0111] "User Account" means an account that holds individual identification information for a User to access and use the System.

[0112] A "virtual character" is a digital character that a user can select and use, and has the role of completing the user's tasks.

[0113] "Work information" refers to detailed task information that a user enters into the system, and includes the work title, details, deadline, and so on.

[0114] "Database" refers to the part of a computer system that stores and manages input and activity information.

[0115] A "generative AI model" is an artificial intelligence-based model used to automatically perform tasks while mimicking a virtual character selected by a user.

[0116] "Server" refers to a central computer system that receives information from users, processes it, and provides the necessary data.

[0117] "Notification" refers to messages and alarms that inform the user of the results and progress of task processing.

[0118] The present invention is a system for efficiently handling the miscellaneous tasks and adjustments of a businessman's daily work, and a virtual character selected by the user supports these tasks. A specific embodiment of the program for this system will be described below.

[0119] First, a user accesses the system using a terminal, enters the required information such as name, email address, and password into the registration form, and presses the submit button. The terminal sends this input information to the server, which then stores the received information in a database and creates a user account.

[0120] Next, the user enters their ID (or email address) and password on the login screen and presses the login button. The device sends the authentication information to the server, which then authenticates the user by checking it against the user information stored in the database. If authentication is successful, the server sends the user's dashboard data to the device, and the device displays the dashboard.

[0121] The user then checks the virtual character list on the dashboard and selects their preferred character. The server retrieves the supporter list from the database and sends it to the device. The device displays the list to the user, and the device sends the character information selected by the user to the server. The server saves the selection information in the database.

[0122] The user then enters the task title, details, and deadline on the task input screen and presses the send button. The device sends the entered task information to the server, which stores it in a database. The server retrieves unprocessed task information from the database and sends it to an AI engine that uses a generative AI model. The AI ​​engine processes the task while imitating the behavioral patterns of the character selected by the user.

[0123] For example, if a user enters "arrange a meeting schedule" as a task, the server sends an instruction to the AI ​​engine to check the schedules of the necessary meeting participants. The AI ​​engine accesses the schedule database of meeting participants, adjusts the optimal date, compiles the candidate dates, and sends a confirmation email to the participants. When the task is completed, the server updates the database and sends a task completion notification to the device. The device displays the notification to the user and provides detailed information about the completed task.

[0124] As a concrete example, consider the case where a user inputs the task "organizing documents" and presses the send button. The device sends the task information to the server, which saves it in a database. The server then sends the document organization task to the AI ​​engine, and the virtual character begins organizing the documents. The AI ​​engine classifies and organizes the documents in real time and sends the results to the server. The server saves information about the completion of document organization in the database and sends a notification to the device. The device then notifies the user that "document organization is complete" and displays the detailed results.

[0125] The system efficiently handles users' miscellaneous and coordination tasks, allowing them to focus on higher-value-added tasks. Flexible support from virtual characters improves the user experience, while the use of generative AI models ensures accuracy and efficiency of processing.

[0126] Example prompt sentence:

[0127] "I'd like you to adjust the schedule for a meeting. The participants are A, B, and C. Please arrange the best meeting date and compile a list of possible dates."

[0128] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0129] Step 1: User Registration

[0130] The user enters their name, email address, and password into the registration form via their terminal and presses the submit button. Input: Name, email address, password. Output: User account information is generated.

[0131] The device sends this input information to the server, which then uses a hash function to protect the password and stores it in a database. The specific steps for creating a user account include checking for duplicate email addresses and hashing the password.

[0132] Step 2: Login authentication

[0133] The user enters their ID (or email address) and password on the login screen and presses the login button. Input: ID, password. Output: Authentication results and dashboard data.

[0134] The device sends authentication information to the server, which then authenticates the user by checking the user information stored in a database. If authentication is successful, the server sends the user's dashboard data to the device, which then displays the dashboard. The authentication process includes checking the password against a hash.

[0135] Step 3: Select a Supporter (Character)

[0136] The server retrieves the supporter list from the database and sends it to the terminal. Input: None. Output: Supporter list.

[0137] The terminal displays the supporter list to the user, and the user selects the desired character. Input: User's character selection. Output: Selected character information.

[0138] The terminal sends the character information selected by the user to the server, which then stores the selection information in a database.

[0139] Step 4: Entering the Task

[0140] The user enters the task title, details, and deadline on the task input screen and presses the send button. Input: Task title, details, deadline. Output: Task information.

[0141] The device sends the input task information to the server, which stores the task information in a database. Specifically, the task status is recorded as "unprocessed."

[0142] Step 5: Character Tasks

[0143] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine. Input: Unprocessed task information. Output: Task processing instructions.

[0144] The AI ​​engine processes tasks while imitating the behavioral patterns of the character selected by the user. As a specific example of processing, when scheduling a meeting, the AI ​​engine checks the schedules of the meeting participants and finds the optimal date. Input: User prompt, existing schedule data. Output: Schedule adjustment results.

[0145] Step 6: Task Completion and Notification

[0146] Once the task is completed, the AI ​​engine sends the result to the server, which updates the database with the task completion information. Input: Task completion result. Output: Task status update.

[0147] The server sends a notification of task completion to the terminal. The terminal displays the notification to the user and provides detailed information about the completed task. An example of a prompt sentence is a message displayed to the user such as "Document organization is complete. The classification results are as follows."

[0148] (Application example 1)

[0149] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0150] Currently, the user experience in autonomous vehicles requires users to concentrate on driving, while many miscellaneous tasks must be performed manually. Tasks that must be performed while driving, such as real-time navigation settings, setting reminders, and sending and receiving messages, are particularly burdensome for users. Furthermore, to safely and efficiently handle these tasks, voice input and artificial intelligence are required, but current systems do not adequately address these. Therefore, there is a need for a system that allows users to efficiently handle miscellaneous tasks while still being able to concentrate on driving.

[0151] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0152] In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of selectable characters to the user and receiving the user's selection, means for saving the task information entered by the user in a database, means for the character to complete the task based on the saved task information, means for notifying the user of the completion of task processing, means for the user to input tasks through voice input, and means for providing optimal navigation using the user's location information. This allows a user to efficiently complete various chores through voice input without using their hands while driving. Furthermore, having a character complete tasks increases familiarity and entertainment value, improving driving comfort.

[0153] "User input information" refers to information such as name, email address, and password entered by the user and accepted by the system.

[0154] A "user account" is an individual account that is generated based on information entered by a user and is used for logging in and task management.

[0155] A "character list" is a list of selectable characters that the system displays to the user.

[0156] "Task information" is information including the content, details, and deadline of a task that a user inputs into the system.

[0157] A "database" is a storage device within the system that stores user account information, task information, character information, and so on.

[0158] "Means for a character to process a task" refers to a function in which a character selected by a user executes a task based on task information stored in the system.

[0159] The "means for notifying the user of the completion of task processing" is a function by which the system notifies the user of the completion of the task when it is completed.

[0160] "Voice input" is a method in which a user verbally inputs commands or tasks into a system through a microphone.

[0161] "Location information" is information that indicates the user's current location, and is mainly obtained by a satellite positioning system such as GPS.

[0162] "Navigation" is a function that calculates and guides the optimal route for the user to reach their destination.

[0163] This invention is a system that allows users to efficiently complete tasks in an autonomous vehicle through voice input and characters. This system automatically handles miscellaneous tasks while the user is driving, providing an environment in which the user can concentrate on driving.

[0164] 1. User Registration and Login

[0165] When using the device for the first time, the user enters information such as name, email address, and password on the screen of the vehicle's entertainment system and presses the send button. The device then sends the information to the server, which stores it in a database and creates a user account. When logging in, the device sends the user's ID and password to the server, which then performs authentication. If authentication is successful, the server sends the user's dashboard data to the device, which then displays the dashboard.

[0166] 2. Character Selection

[0167] The server retrieves a character list from the database and sends it to the terminal. The terminal displays the list to the user, who then selects the desired character. The terminal then sends the character information selected by the user to the server, which then stores the selection information in the database.

[0168] 3. Enter the task

[0169] Users input tasks through the vehicle's voice input system, such as navigation settings, reminder settings, and message sending. The device uses voice recognition to convert the input into text and send the task information to the server, which stores the task information in a database and updates the user's task list.

[0170] 4. Task completion by characters

[0171] The server retrieves unprocessed task information from the database and sends it to a generative AI model (e.g., GPT-4 (registered trademark)) installed in the vehicle. The AI ​​engine then processes the task while imitating the character selected by the user. For example, it sets navigation routes, sends messages, and sets reminders.

[0172] 5. Task Completion and Notifications

[0173] Once the task is completed, the server updates the database and sends a task completion notification to the vehicle's terminal, which notifies the user by display and voice and displays detailed results.

[0174] Hardware and software used

[0175] Hardware:

[0176] Entertainment systems (displays) for autonomous vehicles

[0177] Voice recognition device

[0178] Internet connection function

[0179] Vehicle-mounted AI engines (e.g., systems equipped with GPT-4)

[0180] software:

[0181] Server-side database software (e.g., MySQL (registered trademark))

[0182] User authentication system (e.g. OAuth)

[0183] Speech recognition systems (e.g., Google® Cloud Speech-to-Text)

[0184] AI engine (e.g. GPT-4)

[0185] Examples of concrete examples and prompts

[0186] For example, if a user issues a voice command such as "Tell me the best route to my next meeting," the vehicle's AI engine will calculate the current location and destination and set the optimal route. This will take into account traffic congestion and other traffic conditions in real time and be reflected in the navigation system. Furthermore, if the user instructs, "Set a reminder. Notify me when I arrive at my destination," the reminder will be set appropriately.

[0187] Example prompt sentence:

[0188] "What's the best route to my next meeting?"

[0189] "Set a reminder. Notify me when I reach my destination."

[0190] "Send me a message. Let me know the meeting is ready."

[0191] In this way, the system provides an environment in which the user can efficiently complete tasks while driving, improving driving safety and comfort.

[0192] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0193] Step 1:

[0194] The user enters information such as name, email address, and password through the screen of the entertainment system in the vehicle and presses the send button.

[0195] Input: Name, email address, password

[0196] Data processing: The terminal sends the input information in text format to the server.

[0197] Output: The server saves the user information to a database and creates a user account.

[0198] Step 2:

[0199] The user enters their ID and password on the vehicle's entertainment system screen and presses the login button. The device then sends the authentication information to the server, which then performs the authentication.

[0200] Input: User ID, Password

[0201] Data processing: The server checks the authentication information against a database and performs authentication.

[0202] Output: If authentication is successful, the server sends the user's dashboard data to the device, and the device displays the dashboard.

[0203] Step 3:

[0204] The server retrieves the character list from the database and sends it to the terminal. The user can then check the list on the vehicle's screen and select the desired character.

[0205] Input: User character selection

[0206] Data processing: The device sends the selected character information to the server, which stores the selected information in the database.

[0207] Output: The information of the selected character is saved in the database.

[0208] Step 4:

[0209] The user uses the vehicle's voice input system to input a task, such as "What is the best route to my next meeting?"

[0210] Input: Voice command

[0211] Data processing: The device's voice recognition device converts the voice into text data and sends it to the server as task information.

[0212] Output: The server saves the task information to the database and updates the user's task list.

[0213] Step 5:

[0214] The server retrieves raw task information from the database and sends it to a generative AI model (e.g., GPT-4) installed in the vehicle.

[0215] Input: Open task information

[0216] Data processing: The AI ​​engine processes tasks while imitating the character selected by the user.

[0217] Output: For example, setting a navigation route, sending a message, setting a reminder, etc.

[0218] Step 6:

[0219] Once the task is completed, the server updates the database and sends a notification of task completion to the vehicle's terminal.

[0220] Input: Task completion information

[0221] Data processing: The server updates the database and records the completion status.

[0222] Output: The device notifies the user of task completion via display and audio, and displays detailed results.

[0223] This program process allows users to efficiently perform various tasks hands-free while driving, with seamless input and output interactions at each step, enhancing the driving experience.

[0224] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0225] The present invention is a system that accepts user input information to create a user account, displays a list of selectable characters to receive the user's selection, saves the task information entered by the user in a database, and has the character complete tasks based on the saved task information. Furthermore, the present invention is equipped with a function that combines an emotion engine to recognize the user's emotions and adjust the character's responses and actions according to those emotions.

[0226] An embodiment of this system will be specifically described below.

[0227] 1. User Registration and Login

[0228] When a user first uses the service, they open the registration form on their device, enter their name, email address, and password, and press the submit button. The device then sends the information to the server, which automatically saves it in a database and creates a user account.

[0229] When a user enters their ID (email address) and password on the login screen and presses the login button, the device sends the authentication information to the server. The server performs authentication by comparing it with information in the database, and if successful, sends dashboard data to the device. The device then displays the user's dashboard.

[0230] 2. Supporter Selection

[0231] The server retrieves a pre-prepared supporter list (character list) from the database and sends it to the terminal, which then displays the supporter list to the user.

[0232] The user selects their favorite character and presses the select button. The device sends the selection information to the server. The server associates the selected supporter information with the user's account and saves it in a database. The server then sends a selection completion message to the device, which displays it to the user.

[0233] 3. Enter the task

[0234] The terminal displays a task input screen to the user, who then enters the task title, details, deadline, etc. and presses the send button.

[0235] The terminal sends the entered task information to the server. The server stores the received task information in a database. The server then sends a task registration completion message to the terminal, which the terminal displays to the user.

[0236] 4. Task Processing

[0237] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine, which then begins processing the task while imitating the selected character.

[0238] For example, if a user inputs "adjust meeting schedule," the server issues instructions to the AI ​​engine, and the AI ​​adjusts the schedules of the participants.

[0239] The AI ​​engine executes tasks according to the work content and reports to the server when the processing is complete. The server stores the processing results in a database and sends a notification to the user, who then displays it on the device.

[0240] 5. Emotion Engine

[0241] The system is equipped with an emotion engine that recognizes emotions from the user's facial expressions, voice, text, etc. For example, when a user accesses the system through a camera, the device sends the user's facial expression data to the server, which then analyzes it using the emotion engine to recognize the user's emotion.

[0242] The recognized emotion information is transmitted to the AI ​​engine via the server, and the character's responses and actions are adjusted to match the user's emotions. For example, if the user shows a tired expression, the character will display a supportive message such as "You should take a break."

[0243] Example: Document organization task

[0244] The user enters "organizing documents" as a task and presses the send button.

[0245] The terminal sends task information to the server, which stores it in a database.

[0246] The server sends task information to the AI ​​engine, and the selected character begins organizing the documents.

[0247] The AI ​​engine classifies and organizes documents in real time and sends the results to the server.

[0248] The server updates the database with the information about the completion of the document organization and sends a notification to the terminal. The terminal notifies the user that "document organization is complete" and displays the detailed results.

[0249] In this way, this system efficiently handles the user's miscellaneous tasks and coordination work, grasps the user's emotions using an emotion engine, and provides support accordingly, providing an environment in which business people can concentrate on more important tasks.

[0250] The processing flow will be explained below.

[0251] Step 1: User Registration

[0252] The user opens the registration form on their device, enters their name, email address, and password, and presses the submit button.

[0253] The terminal transmits the input information to the server.

[0254] The server stores the received information in a database and creates a user account.

[0255] The server sends an account creation completion message to the terminal.

[0256] The terminal displays a message to the user indicating that the account has been created.

[0257] Step 2: User Login

[0258] The user opens the login screen on the device, enters their ID (email address) and password, and presses the login button.

[0259] The terminal sends the login information to the server.

[0260] The server compares the information with that in the database and performs authentication processing.

[0261] If the authentication is successful, the server sends an authentication success message and dashboard data to the terminal.

[0262] The terminal displays the user's dashboard.

[0263] Step 3: Select a supporter

[0264] The server retrieves a pre-prepared supporter list from the database and sends it to the terminal.

[0265] The terminal displays the supporter list to the user.

[0266] The user selects a preferred supporter from the list and presses the select button.

[0267] The terminal transmits the selection information to the server.

[0268] The server associates the selected supporter information with the user's account and stores it in a database.

[0269] The server sends a selection completion message to the terminal.

[0270] The terminal displays a selection completion message to the user.

[0271] Step 4: Task Input

[0272] The terminal displays a task input screen to the user.

[0273] The user enters the task title, details, and deadline, and presses the submit button.

[0274] The terminal transmits the input task information to the server.

[0275] The server stores the received task information in a database.

[0276] The server sends a task registration completion message to the terminal.

[0277] The terminal displays a task registration completion message to the user.

[0278] Step 5: Emotion Recognition

[0279] The camera captures the user's facial expressions while using the system.

[0280] The terminal transmits the user's facial expression data to the server.

[0281] The server uses an emotion engine to analyze the facial expression data and recognize the user's emotion.

[0282] The server sends the recognized emotional information to the AI ​​engine.

[0283] Step 6: Start task processing

[0284] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine.

[0285] The AI ​​engine will begin processing the task while imitating the character of the selected supporter.

[0286] For example, if a user requests a meeting schedule adjustment, the AI ​​engine will check the schedules of the participants and arrange the optimal date.

[0287] Step 7: Task execution

[0288] The AI ​​engine sends confirmation emails to meeting participants.

[0289] The server checks whether the email was sent successfully and stores the result in a database.

[0290] Step 8: Task Completion Notification

[0291] The server updates the database with information about the task completion.

[0292] The server sends a task completion notification to the terminal.

[0293] The terminal displays a task completion notification to the user.

[0294] Step 9: Review task details

[0295] The user checks the task completion notification on the device and opens a screen displaying detailed information.

[0296] The server sends the detailed information to the terminal.

[0297] The terminal displays the detailed results of the task to the user.

[0298] Step 10: Emotion-Based Responding

[0299] The server adjusts the AI ​​engine's character responses based on the recognized user's emotional information.

[0300] If the user looks tired, a character will display a supportive message such as "You should take a break."

[0301] Through this series of steps, users can easily register tasks and have them efficiently handled by the selected supporter. The system also recognizes the user's emotions and adjusts responses accordingly, allowing users to receive more personalized support. This frees users from mundane tasks and allows them to focus on important tasks.

[0302] Example 2

[0303] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0304] Current task management systems cannot take into account the user's emotions and state, which can cause stress for the user. Furthermore, users must manually input and manage tasks, which is time-consuming. Furthermore, even in task management systems using characters, the characters' responses and actions are uniform, making it difficult to individually optimize the user experience. There is a need to solve these issues and provide a more convenient and personalized task management system.

[0305] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0306] In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of selectable characters to the user and accepting the user's selection, means for saving the task information entered by the user in a database, means for the character to complete the task based on the saved task information, means for notifying the user that the task has been completed, and means for recognizing the user's emotions and adjusting the character's responses and actions in response to the emotions. This allows the user to not only efficiently manage tasks but also receive support in accordance with their own emotions and state.

[0307] "User input information" refers to information such as name, email address, and password that a user inputs into the system.

[0308] The "means for generating a user account" is a function that creates an account associated with a user based on information input by the user and stores the account in a database.

[0309] The "character list" is a list of multiple characters prepared in advance by the system, and is displayed to the user to allow them to select one.

[0310] "Task information" refers to information to be managed, such as the title, details, and deadline of a task, which is entered into the system by the user.

[0311] A "database" is a storage device for centrally storing data managed by the system, such as user account information and task information.

[0312] "The means by which the character completes the task" refers to the algorithm or AI engine that the character utilizes to complete the assigned task.

[0313] The "means for notifying the user of the completion of task processing" is a function for notifying the user of the completion information when the character completes a task.

[0314] "Means for recognizing emotions" refers to a function that analyzes data such as the user's facial expressions, voice, and text, and estimates the user's emotions.

[0315] The "means for adjusting the character's response and behavior according to the emotion" is a function for changing the character's expression and behavior based on the user's recognized emotional information.

[0316] "Means of utilizing artificial intelligence" refers to a function that uses AI technology to allow characters to automatically complete tasks.

[0317] The "means for displaying the details of the processing results" is a display function for specifically informing the user of the content and results of the task processing.

[0318] The present invention is a system that accepts user input information to create a user account, displays a list of selectable characters to receive the user's selection, saves the task information entered by the user in a database, and has the character complete tasks based on the saved task information. Furthermore, the present invention is equipped with a function that combines an emotion engine to recognize the user's emotions and adjust the character's responses and actions according to those emotions.

[0319] User Registration and Login

[0320] When using the service for the first time, the user opens the registration form on the device, enters their name, email address, and password, and presses the send button. The device sends this input information to the server. The server saves the input information in a database and creates a user account. When using the service next time, the user enters their ID (email address) and password on the login screen and presses the login button, and the device sends the authentication information to the server. The server compares the information with the information in the database and performs authentication processing, and if successful, sends dashboard data to the device. The device then displays the user's dashboard.

[0321] Supporter Selection

[0322] The server retrieves a prepared supporter list (character list) from the database and sends it to the terminal. The terminal displays this list to the user. The user selects their preferred character and presses the select button. The terminal sends this selection information to the server. The server associates the selected supporter information with the user's account, saves it in the database, and sends a selection completion message to the terminal. The terminal displays this to the user.

[0323] Task Input

[0324] The terminal displays the task input screen to the user. The user enters the task title, details, deadline, etc., and presses the send button. The terminal sends the entered task information to the server. The server stores the received task information in a database. The server sends a task registration completion message to the terminal, which the terminal displays to the user.

[0325] Task Processing

[0326] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine. The AI ​​engine begins processing the task while imitating the selected character. For example, if a user inputs the task "arrange meeting schedules," the server issues instructions to the AI ​​engine, and the AI ​​arranges the schedules of the participants. The AI ​​engine executes the task according to the work content and reports to the server when processing is complete. The server saves the processing results in the database and sends a notification to the user. The device displays this to the user.

[0327] Emotion Engine

[0328] The system is equipped with an emotion engine that recognizes emotions from the user's facial expressions, voice, text, etc. For example, when a user accesses the system through a camera, the device sends the user's facial expression data to the server. The server then analyzes this using the emotion engine to recognize the user's emotion. The recognized emotion information is transmitted to the AI ​​engine via the server, and the character is adjusted to respond and act in accordance with the user's emotion. For example, if the user shows a tired expression, the character will display a supportive message such as "It would be better to take a break."

[0329] Example: Document organization task

[0330] The user enters "organizing documents" as a task and presses the send button. The device sends the task information to the server, which saves it in a database. The server then sends the task information to the AI ​​engine, and the selected character begins organizing the documents. The AI ​​engine classifies and organizes the documents in real time and sends the results to the server. The server updates the database with information about the completion of document organization and sends a notification to the device. The device notifies the user that "document organization is complete" and displays the detailed results. This not only enables the user to efficiently handle miscellaneous tasks and coordination work, but also allows the emotion engine to provide support tailored to their emotions.

[0331] Example prompts for generative AI models

[0332] The user inputs "organizing documents" as a task, and the selected character simulates the process of sorting and organizing documents in real time.

[0333] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0334] Step 1:

[0335] The user opens the registration form on the terminal, enters their name, email address, and password, and presses the submit button.

[0336] Input: Name, email address, and password entered by the user

[0337] Output: User registration information sent from the device to the server

[0338] What happens: A user fills in a form and clicks the submit button.

[0339] Step 2:

[0340] The terminal transmits the input information to the server.

[0341] Input: User registration information

[0342] Output: HTTP POST request sent to the server

[0343] Specific operation: The device sends user information to the server via the Internet.

[0344] Step 3:

[0345] The server stores the entered information in a database and creates a user account.

[0346] Input: User registration information received by the server

[0347] Output: User information stored in the database and the new user account.

[0348] Specific operation: The server executes an SQL query on the database and saves the user information.

[0349] Step 4:

[0350] The server sends a message to the terminal to notify it that the input information has been successfully saved.

[0351] Input: Information that has been saved to the database

[0352] Output: Registration completion message to the device

[0353] Specific operation: The server creates an HTTP response and sends it to the terminal.

[0354] Step 5:

[0355] The terminal receives the message and displays a notification to the user that registration is complete.

[0356] Input: Registration completion message from the server

[0357] Output: Registration completion notification displayed in the user interface

[0358] Specific operation: The device analyzes the response message and the browser displays a notification.

[0359] Step 6:

[0360] User enters ID (email address) and password on the login screen and clicks login button.

[0361] Input: User ID (email address) and password

[0362] Output: Login request sent from the terminal to the server

[0363] What happens: The user fills in the login form and clicks the submit button.

[0364] Step 7:

[0365] The terminal transmits the authentication information to the server.

[0366] Input: Login information (email address and password)

[0367] Output: HTTP POST request to the server

[0368] Specific operation: The device sends login information to the server.

[0369] Step 8:

[0370] The server performs authentication by comparing the information with that in the database.

[0371] Input: Login information sent to the server

[0372] Output: Authentication result (success or failure)

[0373] What happens: The server runs an SQL query against the database to match the submitted information with existing information.

[0374] Step 9:

[0375] If the authentication is successful, the server transmits the dashboard data to the terminal.

[0376] Input: Authentication success information

[0377] Output: Dashboard data to terminal

[0378] Specific operation: The server returns user-specific dashboard data in an HTTP response.

[0379] Step 10:

[0380] The device receives the data and displays the user's dashboard.

[0381] Input: Dashboard data from the server

[0382] Output: A dashboard displayed in the user interface

[0383] Specific operation: The terminal analyzes the response data and generates and displays the dashboard screen.

[0384] Step 11:

[0385] The server retrieves a pre-prepared supporter list (character list) from the database and sends it to the terminal.

[0386] Input: Query to get supporter list from database

[0387] Output: Supporter list data to the terminal

[0388] Specific operation: The server executes the SQL query, retrieves the list data, and returns it in the HTTP response.

[0389] Step 12:

[0390] The terminal displays the list to the user.

[0391] Input: Supporter list data

[0392] Output: A list of supporters displayed in the user interface

[0393] Specific behavior: Renders list data in the user interface.

[0394] Step 13:

[0395] The user selects a desired character and presses the select button.

[0396] Input: User's character selection information

[0397] Output: Character selection request from device to server

[0398] Specific behavior: The user selects a character and clicks a button.

[0399] Step 14:

[0400] The terminal transmits the selection information to the server.

[0401] Input: Character selection information

[0402] Output: HTTP POST request to the server

[0403] Specific operation: The terminal transmits the selection information to the server.

[0404] Step 15:

[0405] The server associates the selected supporter information with the user's account and stores it in a database.

[0406] Input: Character selection information

[0407] Output: Character information stored in the database

[0408] Specific operation: The server executes the SQL query and saves the selected character to the user information.

[0409] Step 16:

[0410] The server sends a selection completion message to the terminal.

[0411] Input: Information saved to the database

[0412] Output: Selection complete message to terminal

[0413] Specific operation: The server returns a selection completion message in the HTTP response.

[0414] Step 17:

[0415] The terminal receives the message and displays it to the user.

[0416] Input: Selection completion message from the server

[0417] Output: Selection completion notification displayed in the user interface

[0418] Specific operation: The device analyzes the response data and displays a notification on the user interface.

[0419] Step 18:

[0420] The terminal displays a task input screen to the user.

[0421] input:--

[0422] Output: Task entry screen displayed in the user interface

[0423] Specific behavior: Renders and displays the task input form.

[0424] Step 19:

[0425] The user enters the task title, details, deadline, etc., and presses the send button.

[0426] Input: Task title, details, due date

[0427] Output: Task input information from the terminal to the server

[0428] Specific behavior: The user enters task information and clicks the submit button.

[0429] Step 20:

[0430] The terminal transmits the task information to the server.

[0431] Input: Task input information

[0432] Output: HTTP POST request to the server

[0433] Specific operation: Form data is sent to the server via HTTP POST.

[0434] Step 21:

[0435] The server stores the received task information in a database.

[0436] Input: Task input information

[0437] Output: Task information stored in the database

[0438] Specific operation: The server executes an SQL query and saves the task information to the database.

[0439] Step 22:

[0440] The server sends a task registration completion message to the terminal.

[0441] Input: Task save completion information to database

[0442] Output: Task registration completion message to the terminal

[0443] Specific operation: A registration completion message is returned as an HTTP response.

[0444] Step 23:

[0445] The terminal receives the message and displays it to the user.

[0446] Input: Task registration completion message from the server

[0447] Output: Task registration completion notification displayed in the user interface

[0448] Specific operation: A task registration completion message is displayed on the user interface.

[0449] Step 24:

[0450] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine.

[0451] Input: Open task information from the database

[0452] Output: Task information to the AI ​​engine

[0453] What happens: The server executes the SQL query, retrieves the outstanding tasks, and sends the data to the API endpoint.

[0454] Step 25:

[0455] The AI ​​engine will begin processing the task while imitating the selected character.

[0456] Input: Task information sent to the AI ​​engine

[0457] Output: Task processing results

[0458] Specific operation: The AI ​​model starts processing based on the task information, for example, "arranging a meeting schedule."

[0459] Step 26:

[0460] The AI ​​engine executes tasks according to the work content and reports to the server once the processing is complete.

[0461] input:--

[0462] Output: Task processing completion information to the server

[0463] Specific operation: The results of the task execution are sent to the server.

[0464] Step 27:

[0465] The server stores the processing results in a database and sends a notification to the user.

[0466] Input: Task processing completion information

[0467] Output: A message to inform the user

[0468] What happens: The server executes the SQL query, stores the results in a database, and sends a notification as an HTTP response.

[0469] Step 28:

[0470] The terminal displays the processing results to the user.

[0471] Input: Processing result notification from the server

[0472] Output: Processing result notification displayed in the user interface

[0473] Specific behavior: Display a process completion notification in the user interface.

[0474] Step 29:

[0475] The system is equipped with an emotion engine that recognizes emotions from the user's facial expressions, voice, text, etc.

[0476] Input: User's facial expression data, voice data, text data

[0477] Output: Recognized user emotion information

[0478] Specific operation: The emotion engine analyzes facial expression data and voice data to generate emotion information.

[0479] Step 30:

[0480] The server analyzes this using an emotion engine and recognizes the user's emotion.

[0481] Input: Data submitted by the user

[0482] Output: Parsed emotion information

[0483] Specific operation: The server analyzes the data and determines the emotion.

[0484] Step 31:

[0485] The recognized emotional information is transmitted to the AI ​​engine.

[0486] Input: Parsed emotion information

[0487] Output: Emotion data to the AI ​​engine

[0488] Specific operation: Emotional information is sent to the AI ​​engine to generate an appropriate response.

[0489] Step 32:

[0490] The AI ​​engine adjusts the character's responses and actions to reflect the user's emotions.

[0491] Input: Emotion information

[0492] Output: Emotion-based responses and actions

[0493] Specific behavior: The character displays messages and actions according to the user's emotions.

[0494] The above are the specific processing steps of this system, which allows users to manage tasks efficiently and personalizedly.

[0495] (Application example 2)

[0496] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0497] While most conventional task management systems simply store and process tasks entered by users in a database, it is difficult to provide flexible support that responds to the user's emotional state. Furthermore, in autonomous vehicles, it is dangerous for users to enter tasks while driving, so a solution was needed.

[0498] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of characters selectable by the user and receiving the user's selection, means for saving task information entered by the user in a database, means for the character to complete a task based on the saved task information, means for recognizing the user's emotions and adjusting the character's responses and actions in accordance with the emotions, means for displaying the task processing results and emotion-based support messages on the user interface of the autonomously driven vehicle, and means for notifying the user of the completion of task processing. This makes it possible to safely input and process tasks even while the autonomously driven vehicle is traveling, and further makes it possible to provide flexible support in accordance with the user's emotional state.

[0499] The "means for accepting user input information and generating a user account" is a function for sending information provided by the user through an input form to the system and creating an individual account for the user based on this information.

[0500] "Means for displaying a list of selectable characters and receiving a user's selection" is a function that allows the system to display a pre-prepared character list on the user interface, allowing the user to select a character of their choice.

[0501] The "means for saving task information entered by the user in a database" is a function for collecting task information specified by the user and safely saving it in a database.

[0502] "Means for a character to process a task based on stored task information" is a function that reads task information stored in a database and allows a selected character to perform an actual task based on that information.

[0503] "Means for recognizing the user's emotions and adjusting the character's response and behavior in accordance with those emotions" refers to a function that analyzes the user's emotions from their facial expressions and voice, and changes the character's dialogue and behavior based on the results.

[0504] "Means for displaying support messages based on task processing results and emotions on the user interface of an autonomous vehicle" refers to a function that uses the display and speakers of an autonomous vehicle to display messages based on task processing results and the user's emotional state.

[0505] The "means for notifying the user of the completion of task processing" is a function that sends a notification or an alert to inform the user that the task has been completed.

[0506] This invention is a system that allows users to manage and instruct tasks in an autonomous vehicle and provides optimal support based on emotion recognition. Next, we will explain how to implement this system.

[0507] In this system, a user account is created by providing input information through the in-car smart display or voice recognition function. The user enters their name, email address, and password into a registration form, which is then sent to the server.

[0508] Next, the user is presented with a list of supporting characters and selects the character they wish to play. The selection information is sent to the server and stored in a database. The user can input tasks, such as setting a destination, and provide task information, which is then stored in the database.

[0509] The system uses the character to complete tasks based on the saved task information. The character uses an AI engine to search for map information and adjust navigation, for example, for a destination setting task. Once the task is completed, the system notifies the user.

[0510] Furthermore, the system uses in-car cameras and voice recognition technology to recognize the user's emotions. For example, if the system recognizes that the user is tired, a character will display a support message such as "It's a good idea to take a break." This allows the user to perform tasks with peace of mind while driving an autonomous vehicle, and provides support that also takes safety into consideration.

[0511] The system uses various hardware and software for its specific processing. For example, cameras and smart displays are installed in the vehicle, and voice recognition software and emotion recognition engines (such as EmotionRecognizer) are also used. User information and task information are stored in a database, and the AI ​​engine processes tasks using generative AI models from Google Cloud AI or Amazon SageMaker.

[0512] For example, if a user says, "Set my destination to Tokyo Station," task information will be displayed on the smart display and the system will store that information in a database. The AI ​​engine will adjust navigation based on map information and complete the task. At the same time, an appropriate support message will be displayed based on the user's facial expression data captured by the camera.

[0513] Example prompt sentence:

[0514] "Based on the following information, please design a system that processes tasks while the user is driving and displays support messages according to the user's emotional state. User information: name, email address, password. Input tasks: setting destination, task management. Emotion recognition: analyzing facial expression data from the camera. Response according to emotional state: recommending a break if the user is tired."

[0515] In this way, the system combines user task management and emotion recognition to improve the safety and convenience of self-driving vehicles.

[0516] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0517] Step 1:

[0518] The user uses the in-car smart display or voice recognition function to enter their name, email address, and password into the registration form. The device then sends this information to the server, which stores it in a database and creates a user account.

[0519] Input: Name, email address, password

[0520] Data processing: storing the entered information in a database and creating a user account

[0521] Output: User account creation completion notification

[0522] Step 2:

[0523] The server retrieves a pre-prepared character list from a database and sends it to the terminal. The terminal displays this character list on the user interface. The user selects their preferred character from the list and sends the selection information to the server.

[0524] Input: Request to get character list, user character selection

[0525] Data processing: Retrieving character list from database, sending selected information to server

[0526] Output: Display of character list, notification of selection completion

[0527] Step 3:

[0528] The user inputs task information into the terminal using voice input or a touch panel. The terminal sends this task information to the server, which then stores the task information in a database.

[0529] Input: Task information (e.g., destination setting)

[0530] Data processing: saving task information to a database

[0531] Output: Notification of completion of saving task information

[0532] Step 4:

[0533] The server retrieves the stored task information from the database and sends it to the AI ​​engine. The AI ​​engine processes the task based on the task information and sends the results back to the server. The character then executes the task based on the results obtained.

[0534] Input: Task information, instructions to send to AI engine

[0535] Data processing: Analysis of task information, execution of task processing

[0536] Output: Obtaining the task processing results

[0537] Step 5:

[0538] The device captures the user's facial expression data through a camera installed on the device. The device then sends this data to a server, which analyzes it using an emotion recognition engine. The server recognizes the user's emotional state and adjusts the character's responses and behavior accordingly.

[0539] Input: User's facial expression data

[0540] Data processing: Analysis of facial expression data using an emotion recognition engine

[0541] Output: Emotion recognition result

[0542] Step 6:

[0543] The device displays task processing results and emotional support messages on the user interface based on information obtained from the AI ​​engine and emotion recognition engine. The server notifies the user when task processing is complete.

[0544] Input: Task processing results, emotion recognition results

[0545] Data processing: Integrating task processing results and emotion recognition results, generating display messages

[0546] Output: Display of task processing results and supporting messages

[0547] Step 7:

[0548] The user receives notification of task completion and can enter additional instructions or tasks as needed, allowing the system to provide ongoing support to the user.

[0549] Input: Task completion notification, additional instructions and task information

[0550] Data processing: Add instructions and save task information to the database

[0551] Output: Notification of start of additional task processing

[0552] In this way, the various processing steps work together, allowing users to safely and efficiently manage tasks within an autonomous vehicle and receive the support they need.

[0553] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0554] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0555] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0556] [Second embodiment]

[0557] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0558] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0559] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0560] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0561] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0562] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0563] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0564] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0565] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0566] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0567] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0568] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0569] The present invention is a system that efficiently handles the miscellaneous tasks and coordination of a businessman's daily work, and a character selected by the user supports these tasks. The following describes how the program for this system can be implemented and the processing it performs.

[0570] 1. User Registration and Login

[0571] When a user first uses the service, they enter the required information (name, email address, password) into the registration form on their device and press the submit button. The device then sends the entered information to the server, which then stores this information in a database and creates a user account.

[0572] The user enters their ID and password on the login screen and presses the login button. The device sends the authentication information to the server, which then authenticates them. If authentication is successful, the server sends the user's dashboard data to the device, which then displays the dashboard.

[0573] 2. Select a supporter (character)

[0574] The server retrieves the supporter list (character list) from the database and sends it to the terminal. The terminal displays the list to the user, who then selects the desired character. The terminal then sends the character information selected by the user to the server, and the server saves the selection information in the database.

[0575] 3. Enter the task

[0576] The user enters the task title, details, and deadline on the task input screen and presses the send button. The terminal sends the entered task information to the server, which then stores it in a database.

[0577] 4. Task completion by characters

[0578] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine, which then processes the task while imitating the character selected by the user.

[0579] For example, if a user inputs "adjust meeting schedule," the server checks the schedules of the necessary meeting participants and sends instructions to the AI ​​engine to make the adjustments.

[0580] AI will schedule the meeting and send confirmation emails to participants.

[0581] 5. Task Completion and Notifications

[0582] Once the task is completed, the server updates the database and sends a notification of task completion to the device, which displays the notification to the user and provides details about the completed task.

[0583] For example, when the schedule adjustment is completed, the server sends a notification message such as "Schedule adjustment completed."

[0584] Example: Document organization task

[0585] The user inputs the task "organizing documents" and presses the send button.

[0586] The terminal sends the task information to the server, which stores it in a database.

[0587] The server sends the task to the AI ​​engine, and a character selected by the user (e.g., a fictional character) begins organizing the documents.

[0588] The AI ​​engine classifies and organizes documents in real time and sends the results to the server.

[0589] The server stores the information on the completion of document organization in a database and sends a notification to the terminal.

[0590] The terminal notifies the user that "document organization is complete" and displays the detailed results.

[0591] In this way, the system efficiently handles users' miscellaneous tasks and coordination work, allowing them to focus on high-value-added tasks. Flexible support with selectable characters improves the user experience, and the use of artificial intelligence ensures accuracy and efficiency of processing.

[0592] The processing flow will be explained below.

[0593] Step 1: User Registration

[0594] The user opens the registration form on their device, enters their name, email address, and password, and presses the submit button.

[0595] The terminal transmits the input information to the server.

[0596] The server stores the received information in a database and creates a user account.

[0597] The server sends an account creation completion message to the terminal.

[0598] The terminal displays a message to the user indicating that the account has been created.

[0599] Step 2: User Login

[0600] The user opens the login screen on the device, enters their ID (email address) and password, and presses the login button.

[0601] The terminal sends the login information to the server.

[0602] The server compares the information with that in the database and performs authentication processing.

[0603] If the authentication is successful, the server sends an authentication success message and dashboard data to the terminal.

[0604] The terminal displays the user's dashboard.

[0605] Step 3: Select a supporter

[0606] The server retrieves the supporter list from the database and transmits it to the terminal.

[0607] The terminal displays the supporter list to the user.

[0608] The user selects the desired supporter from the list and presses the select button.

[0609] The terminal transmits the selection information to the server.

[0610] The server associates the selected supporter information with the user's account and stores it in a database.

[0611] The server sends a selection completion message to the terminal.

[0612] The terminal displays a selection completion message to the user.

[0613] Step 4: Task Input

[0614] The terminal displays a task input screen to the user.

[0615] The user enters the task title, details, and deadline, and presses the submit button.

[0616] The terminal transmits the input task information to the server.

[0617] The server stores the received task information in a database.

[0618] The server sends a task registration completion message to the terminal.

[0619] The terminal displays a task registration completion message to the user.

[0620] Step 5: Start task processing

[0621] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine.

[0622] The AI ​​engine will begin processing the task while imitating the character of the selected supporter.

[0623] For example, if a user requests a meeting schedule adjustment, the AI ​​engine will check the schedules of the participants and arrange the optimal date.

[0624] Step 6: Task execution

[0625] The AI ​​engine sends confirmation emails to meeting participants.

[0626] The server checks whether the email was sent successfully and stores the result in a database.

[0627] Step 7: Task Completion Notification

[0628] The server updates the database with information about the task completion.

[0629] The server sends a task completion notification to the terminal.

[0630] The terminal displays a task completion notification to the user.

[0631] Step 8: Review task details

[0632] The user checks the task completion notification on the device and opens a screen displaying detailed information.

[0633] The server sends the detailed information to the terminal.

[0634] The terminal displays the detailed results of the task to the user.

[0635] Through this series of steps, users can easily register tasks and have them efficiently handled by the selected supporter. Finally, users can check the progress and completion results of the task. This frees businesspeople from tedious chores and gives them more time to focus on important tasks.

[0636] Example 1

[0637] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0638] In today's business environment, businesspeople are often overwhelmed with numerous miscellaneous tasks and coordination work, resulting in a decline in productivity. There is a need for systems that can efficiently handle these miscellaneous tasks, allowing businesspeople to focus on more value-added work. However, existing systems lack sufficient flexibility in automating tasks and improve the user experience.

[0639] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0640] In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of selectable virtual characters to the user and receiving the user's selection, means for saving the task information entered by the user in a database, means for the virtual character to complete the task based on the saved task information, and means for notifying the user when the task has been completed. This enables the efficient processing of miscellaneous tasks and coordination work for businesspeople, improving the user experience, and ensuring the accuracy and efficiency of processing by using artificial intelligence.

[0641] "User" refers to a person who uses the system, who inputs information into the system, and who receives services provided by the system.

[0642] "Input information" refers to data or information provided by a user to the system, including name, email address, password, etc.

[0643] "User Account" means an account that holds individual identification information for a User to access and use the System.

[0644] A "virtual character" is a digital character that a user can select and use, and has the role of completing the user's tasks.

[0645] "Work information" refers to detailed task information that a user enters into the system, and includes the work title, details, deadline, and so on.

[0646] "Database" refers to the part of a computer system that stores and manages input and activity information.

[0647] A "generative AI model" is an artificial intelligence-based model used to automatically perform tasks while mimicking a virtual character selected by a user.

[0648] "Server" refers to a central computer system that receives information from users, processes it, and provides the necessary data.

[0649] "Notification" refers to messages and alarms that inform the user of the results and progress of task processing.

[0650] The present invention is a system for efficiently handling the miscellaneous tasks and adjustments of a businessman's daily work, and a virtual character selected by the user supports these tasks. A specific embodiment of the program for this system will be described below.

[0651] First, a user accesses the system using a terminal, enters the required information such as name, email address, and password into the registration form, and presses the submit button. The terminal sends this input information to the server, which then stores the received information in a database and creates a user account.

[0652] Next, the user enters their ID (or email address) and password on the login screen and presses the login button. The device sends the authentication information to the server, which then authenticates the user by checking it against the user information stored in the database. If authentication is successful, the server sends the user's dashboard data to the device, and the device displays the dashboard.

[0653] The user then checks the virtual character list on the dashboard and selects their preferred character. The server retrieves the supporter list from the database and sends it to the device. The device displays the list to the user, and the device sends the character information selected by the user to the server. The server saves the selection information in the database.

[0654] The user then enters the task title, details, and deadline on the task input screen and presses the send button. The device sends the entered task information to the server, which stores it in a database. The server retrieves unprocessed task information from the database and sends it to an AI engine that uses a generative AI model. The AI ​​engine processes the task while imitating the behavioral patterns of the character selected by the user.

[0655] For example, if a user enters "arrange a meeting schedule" as a task, the server sends an instruction to the AI ​​engine to check the schedules of the necessary meeting participants. The AI ​​engine accesses the schedule database of meeting participants, adjusts the optimal date, compiles the candidate dates, and sends a confirmation email to the participants. When the task is completed, the server updates the database and sends a task completion notification to the device. The device displays the notification to the user and provides detailed information about the completed task.

[0656] As a concrete example, consider the case where a user inputs the task "organizing documents" and presses the send button. The device sends the task information to the server, which saves it in a database. The server then sends the document organization task to the AI ​​engine, and the virtual character begins organizing the documents. The AI ​​engine classifies and organizes the documents in real time and sends the results to the server. The server saves information about the completion of document organization in the database and sends a notification to the device. The device then notifies the user that "document organization is complete" and displays the detailed results.

[0657] The system efficiently handles users' miscellaneous and coordination tasks, allowing them to focus on higher-value-added tasks. Flexible support from virtual characters improves the user experience, while the use of generative AI models ensures accuracy and efficiency of processing.

[0658] Example prompt sentence:

[0659] "I'd like you to adjust the schedule for a meeting. The participants are A, B, and C. Please arrange the best meeting date and compile a list of possible dates."

[0660] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0661] Step 1: User Registration

[0662] The user enters their name, email address, and password into the registration form via their terminal and presses the submit button. Input: Name, email address, password. Output: User account information is generated.

[0663] The device sends this input information to the server, which then uses a hash function to protect the password and stores it in a database. The specific steps for creating a user account include checking for duplicate email addresses and hashing the password.

[0664] Step 2: Login authentication

[0665] The user enters their ID (or email address) and password on the login screen and presses the login button. Input: ID, password. Output: Authentication results and dashboard data.

[0666] The device sends authentication information to the server, which then authenticates the user by checking the user information stored in a database. If authentication is successful, the server sends the user's dashboard data to the device, which then displays the dashboard. The authentication process includes checking the password against a hash.

[0667] Step 3: Select a Supporter (Character)

[0668] The server retrieves the supporter list from the database and sends it to the terminal. Input: None. Output: Supporter list.

[0669] The terminal displays the supporter list to the user, and the user selects the desired character. Input: User's character selection. Output: Selected character information.

[0670] The terminal sends the character information selected by the user to the server, which then stores the selection information in a database.

[0671] Step 4: Entering the Task

[0672] The user enters the task title, details, and deadline on the task input screen and presses the send button. Input: Task title, details, deadline. Output: Task information.

[0673] The device sends the input task information to the server, which stores the task information in a database. Specifically, the task status is recorded as "unprocessed."

[0674] Step 5: Character Tasks

[0675] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine. Input: Unprocessed task information. Output: Task processing instructions.

[0676] The AI ​​engine processes tasks while imitating the behavioral patterns of the character selected by the user. As a specific example of processing, when scheduling a meeting, the AI ​​engine checks the schedules of the meeting participants and finds the optimal date. Input: User prompt, existing schedule data. Output: Schedule adjustment results.

[0677] Step 6: Task Completion and Notification

[0678] Once the task is completed, the AI ​​engine sends the result to the server, which updates the database with the task completion information. Input: Task completion result. Output: Task status update.

[0679] The server sends a notification of task completion to the terminal. The terminal displays the notification to the user and provides detailed information about the completed task. An example of a prompt sentence is a message displayed to the user such as "Document organization is complete. The classification results are as follows."

[0680] (Application example 1)

[0681] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0682] Currently, the user experience in autonomous vehicles requires users to concentrate on driving, while many miscellaneous tasks must be performed manually. Tasks that must be performed while driving, such as real-time navigation settings, setting reminders, and sending and receiving messages, are particularly burdensome for users. Furthermore, to safely and efficiently handle these tasks, voice input and artificial intelligence are required, but current systems do not adequately address these. Therefore, there is a need for a system that allows users to efficiently handle miscellaneous tasks while still being able to concentrate on driving.

[0683] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0684] In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of selectable characters to the user and receiving the user's selection, means for saving the task information entered by the user in a database, means for the character to complete the task based on the saved task information, means for notifying the user of the completion of task processing, means for the user to input tasks through voice input, and means for providing optimal navigation using the user's location information. This allows a user to efficiently complete various chores through voice input without using their hands while driving. Furthermore, having a character complete tasks increases familiarity and entertainment value, improving driving comfort.

[0685] "User input information" refers to information such as name, email address, and password entered by the user and accepted by the system.

[0686] A "user account" is an individual account that is generated based on information entered by a user and is used for logging in and task management.

[0687] A "character list" is a list of selectable characters that the system displays to the user.

[0688] "Task information" is information including the content, details, and deadline of a task that a user inputs into the system.

[0689] A "database" is a storage device within the system that stores user account information, task information, character information, and so on.

[0690] "Means for a character to process a task" refers to a function in which a character selected by a user executes a task based on task information stored in the system.

[0691] The "means for notifying the user of the completion of task processing" is a function by which the system notifies the user of the completion of the task when it is completed.

[0692] "Voice input" is a method in which a user verbally inputs commands or tasks into a system through a microphone.

[0693] "Location information" is information that indicates the user's current location, and is mainly obtained by a satellite positioning system such as GPS.

[0694] "Navigation" is a function that calculates and guides the optimal route for the user to reach their destination.

[0695] This invention is a system that allows users to efficiently complete tasks in an autonomous vehicle through voice input and characters. This system automatically handles miscellaneous tasks while the user is driving, providing an environment in which the user can concentrate on driving.

[0696] 1. User Registration and Login

[0697] When using the device for the first time, the user enters information such as name, email address, and password on the screen of the vehicle's entertainment system and presses the send button. The device then sends the information to the server, which stores it in a database and creates a user account. When logging in, the device sends the user's ID and password to the server, which then performs authentication. If authentication is successful, the server sends the user's dashboard data to the device, which then displays the dashboard.

[0698] 2. Character Selection

[0699] The server retrieves a character list from the database and sends it to the terminal. The terminal displays the list to the user, who then selects the desired character. The terminal then sends the character information selected by the user to the server, which then stores the selection information in the database.

[0700] 3. Enter the task

[0701] Users input tasks through the vehicle's voice input system, such as navigation settings, reminder settings, and message sending. The device uses voice recognition to convert the input into text and send the task information to the server, which stores the task information in a database and updates the user's task list.

[0702] 4. Task completion by characters

[0703] The server retrieves unprocessed task information from the database and sends it to a generative AI model (e.g., GPT-4) installed in the vehicle. The AI ​​engine then processes the task while imitating the character selected by the user, such as setting a navigation route, sending messages, or setting reminders.

[0704] 5. Task Completion and Notifications

[0705] Once the task is completed, the server updates the database and sends a task completion notification to the vehicle's terminal, which notifies the user by display and voice and displays detailed results.

[0706] Hardware and software used

[0707] Hardware:

[0708] Entertainment systems (displays) for autonomous vehicles

[0709] Voice recognition device

[0710] Internet connection function

[0711] Vehicle-mounted AI engines (e.g., systems equipped with GPT-4)

[0712] software:

[0713] Server-side database software (e.g., MySQL)

[0714] User authentication system (e.g. OAuth)

[0715] Speech recognition systems (e.g., Google Cloud Speech-to-Text)

[0716] AI engine (e.g. GPT-4)

[0717] Examples of concrete examples and prompts

[0718] For example, if a user issues a voice command such as "Tell me the best route to my next meeting," the vehicle's AI engine will calculate the current location and destination and set the optimal route. This will take into account traffic congestion and other traffic conditions in real time and be reflected in the navigation system. Furthermore, if the user instructs, "Set a reminder. Notify me when I arrive at my destination," the reminder will be set appropriately.

[0719] Example prompt sentence:

[0720] "What's the best route to my next meeting?"

[0721] "Set a reminder. Notify me when I reach my destination."

[0722] "Send me a message. Let me know the meeting is ready."

[0723] In this way, the system provides an environment in which the user can efficiently complete tasks while driving, improving driving safety and comfort.

[0724] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0725] Step 1:

[0726] The user enters information such as name, email address, and password through the screen of the entertainment system in the vehicle and presses the send button.

[0727] Input: Name, email address, password

[0728] Data processing: The terminal sends the input information in text format to the server.

[0729] Output: The server saves the user information to a database and creates a user account.

[0730] Step 2:

[0731] The user enters their ID and password on the vehicle's entertainment system screen and presses the login button. The device then sends the authentication information to the server, which then performs the authentication.

[0732] Input: User ID, Password

[0733] Data processing: The server checks the authentication information against a database and performs authentication.

[0734] Output: If authentication is successful, the server sends the user's dashboard data to the device, and the device displays the dashboard.

[0735] Step 3:

[0736] The server retrieves the character list from the database and sends it to the terminal. The user can then check the list on the vehicle's screen and select the desired character.

[0737] Input: User character selection

[0738] Data processing: The device sends the selected character information to the server, which stores the selected information in the database.

[0739] Output: The information of the selected character is saved in the database.

[0740] Step 4:

[0741] The user uses the vehicle's voice input system to input a task, such as "What is the best route to my next meeting?"

[0742] Input: Voice command

[0743] Data processing: The device's voice recognition device converts the voice into text data and sends it to the server as task information.

[0744] Output: The server saves the task information to the database and updates the user's task list.

[0745] Step 5:

[0746] The server retrieves raw task information from the database and sends it to a generative AI model (e.g., GPT-4) installed in the vehicle.

[0747] Input: Open task information

[0748] Data processing: The AI ​​engine processes tasks while imitating the character selected by the user.

[0749] Output: For example, setting a navigation route, sending a message, setting a reminder, etc.

[0750] Step 6:

[0751] Once the task is completed, the server updates the database and sends a notification of task completion to the vehicle's terminal.

[0752] Input: Task completion information

[0753] Data processing: The server updates the database and records the completion status.

[0754] Output: The device notifies the user of task completion via display and audio, and displays detailed results.

[0755] This program process allows users to efficiently perform various tasks hands-free while driving, with seamless input and output interactions at each step, enhancing the driving experience.

[0756] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0757] The present invention is a system that accepts user input information to create a user account, displays a list of selectable characters to receive the user's selection, saves the task information entered by the user in a database, and has the character complete tasks based on the saved task information. Furthermore, the present invention is equipped with a function that combines an emotion engine to recognize the user's emotions and adjust the character's responses and actions according to those emotions.

[0758] An embodiment of this system will be specifically described below.

[0759] 1. User Registration and Login

[0760] When a user first uses the service, they open the registration form on their device, enter their name, email address, and password, and press the submit button. The device then sends the information to the server, which automatically saves it in a database and creates a user account.

[0761] When a user enters their ID (email address) and password on the login screen and presses the login button, the device sends the authentication information to the server. The server performs authentication by comparing it with information in the database, and if successful, sends dashboard data to the device. The device then displays the user's dashboard.

[0762] 2. Supporter Selection

[0763] The server retrieves a pre-prepared supporter list (character list) from the database and sends it to the terminal, which then displays the supporter list to the user.

[0764] The user selects their favorite character and presses the select button. The device sends the selection information to the server. The server associates the selected supporter information with the user's account and saves it in a database. The server then sends a selection completion message to the device, which displays it to the user.

[0765] 3. Enter the task

[0766] The terminal displays a task input screen to the user, who then enters the task title, details, deadline, etc. and presses the send button.

[0767] The terminal sends the entered task information to the server. The server stores the received task information in a database. The server then sends a task registration completion message to the terminal, which the terminal displays to the user.

[0768] 4. Task Processing

[0769] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine, which then begins processing the task while imitating the selected character.

[0770] For example, if a user inputs "adjust meeting schedule," the server issues instructions to the AI ​​engine, and the AI ​​adjusts the schedules of the participants.

[0771] The AI ​​engine executes tasks according to the work content and reports to the server when the processing is complete. The server stores the processing results in a database and sends a notification to the user, who then displays it on the device.

[0772] 5. Emotion Engine

[0773] The system is equipped with an emotion engine that recognizes emotions from the user's facial expressions, voice, text, etc. For example, when a user accesses the system through a camera, the device sends the user's facial expression data to the server, which then analyzes it using the emotion engine to recognize the user's emotion.

[0774] The recognized emotion information is transmitted to the AI ​​engine via the server, and the character's responses and actions are adjusted to match the user's emotions. For example, if the user shows a tired expression, the character will display a supportive message such as "You should take a break."

[0775] Example: Document organization task

[0776] The user enters "organizing documents" as a task and presses the send button.

[0777] The terminal sends task information to the server, which stores it in a database.

[0778] The server sends task information to the AI ​​engine, and the selected character begins organizing the documents.

[0779] The AI ​​engine classifies and organizes documents in real time and sends the results to the server.

[0780] The server updates the database with the information about the completion of the document organization and sends a notification to the terminal. The terminal notifies the user that "document organization is complete" and displays the detailed results.

[0781] In this way, this system efficiently handles the user's miscellaneous tasks and coordination work, grasps the user's emotions using an emotion engine, and provides support accordingly, providing an environment in which business people can concentrate on more important tasks.

[0782] The processing flow will be explained below.

[0783] Step 1: User Registration

[0784] The user opens the registration form on their device, enters their name, email address, and password, and presses the submit button.

[0785] The terminal transmits the input information to the server.

[0786] The server stores the received information in a database and creates a user account.

[0787] The server sends an account creation completion message to the terminal.

[0788] The terminal displays a message to the user indicating that the account has been created.

[0789] Step 2: User Login

[0790] The user opens the login screen on the device, enters their ID (email address) and password, and presses the login button.

[0791] The terminal sends the login information to the server.

[0792] The server compares the information with that in the database and performs authentication processing.

[0793] If the authentication is successful, the server sends an authentication success message and dashboard data to the terminal.

[0794] The terminal displays the user's dashboard.

[0795] Step 3: Select a supporter

[0796] The server retrieves a pre-prepared supporter list from the database and sends it to the terminal.

[0797] The terminal displays the supporter list to the user.

[0798] The user selects a preferred supporter from the list and presses the select button.

[0799] The terminal transmits the selection information to the server.

[0800] The server associates the selected supporter information with the user's account and stores it in a database.

[0801] The server sends a selection completion message to the terminal.

[0802] The terminal displays a selection completion message to the user.

[0803] Step 4: Task Input

[0804] The terminal displays a task input screen to the user.

[0805] The user enters the task title, details, and deadline, and presses the submit button.

[0806] The terminal transmits the input task information to the server.

[0807] The server stores the received task information in a database.

[0808] The server sends a task registration completion message to the terminal.

[0809] The terminal displays a task registration completion message to the user.

[0810] Step 5: Emotion Recognition

[0811] The camera captures the user's facial expressions while using the system.

[0812] The terminal transmits the user's facial expression data to the server.

[0813] The server uses an emotion engine to analyze the facial expression data and recognize the user's emotion.

[0814] The server sends the recognized emotional information to the AI ​​engine.

[0815] Step 6: Start task processing

[0816] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine.

[0817] The AI ​​engine will begin processing the task while imitating the character of the selected supporter.

[0818] For example, if a user requests a meeting schedule adjustment, the AI ​​engine will check the schedules of the participants and arrange the optimal date.

[0819] Step 7: Task execution

[0820] The AI ​​engine sends confirmation emails to meeting participants.

[0821] The server checks whether the email was sent successfully and stores the result in a database.

[0822] Step 8: Task Completion Notification

[0823] The server updates the database with information about the task completion.

[0824] The server sends a task completion notification to the terminal.

[0825] The terminal displays a task completion notification to the user.

[0826] Step 9: Review task details

[0827] The user checks the task completion notification on the device and opens a screen displaying detailed information.

[0828] The server sends the detailed information to the terminal.

[0829] The terminal displays the detailed results of the task to the user.

[0830] Step 10: Emotion-Based Responding

[0831] The server adjusts the AI ​​engine's character responses based on the recognized user's emotional information.

[0832] If the user looks tired, a character will display a supportive message such as "You should take a break."

[0833] Through this series of steps, users can easily register tasks and have them efficiently handled by the selected supporter. The system also recognizes the user's emotions and adjusts responses accordingly, allowing users to receive more personalized support. This frees users from mundane tasks and allows them to focus on important tasks.

[0834] Example 2

[0835] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0836] Current task management systems cannot take into account the user's emotions and state, which can cause stress for the user. Furthermore, users must manually input and manage tasks, which is time-consuming. Furthermore, even in task management systems using characters, the characters' responses and actions are uniform, making it difficult to individually optimize the user experience. There is a need to solve these issues and provide a more convenient and personalized task management system.

[0837] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0838] In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of selectable characters to the user and accepting the user's selection, means for saving the task information entered by the user in a database, means for the character to complete the task based on the saved task information, means for notifying the user that the task has been completed, and means for recognizing the user's emotions and adjusting the character's responses and actions in response to the emotions. This allows the user to not only efficiently manage tasks but also receive support in accordance with their own emotions and state.

[0839] "User input information" refers to information such as name, email address, and password that a user inputs into the system.

[0840] The "means for generating a user account" is a function that creates an account associated with a user based on information input by the user and stores the account in a database.

[0841] The "character list" is a list of multiple characters prepared in advance by the system, and is displayed to the user to allow them to select one.

[0842] "Task information" refers to information to be managed, such as the title, details, and deadline of a task, which is entered into the system by the user.

[0843] A "database" is a storage device for centrally storing data managed by the system, such as user account information and task information.

[0844] "The means by which the character completes the task" refers to the algorithm or AI engine that the character utilizes to complete the assigned task.

[0845] The "means for notifying the user of the completion of task processing" is a function for notifying the user of the completion information when the character completes a task.

[0846] "Means for recognizing emotions" refers to a function that analyzes data such as the user's facial expressions, voice, and text, and estimates the user's emotions.

[0847] The "means for adjusting the character's response and behavior according to the emotion" is a function for changing the character's expression and behavior based on the user's recognized emotional information.

[0848] "Means of utilizing artificial intelligence" refers to a function that uses AI technology to allow characters to automatically complete tasks.

[0849] The "means for displaying the details of the processing results" is a display function for specifically informing the user of the content and results of the task processing.

[0850] The present invention is a system that accepts user input information to create a user account, displays a list of selectable characters to receive the user's selection, saves the task information entered by the user in a database, and has the character complete tasks based on the saved task information. Furthermore, the present invention is equipped with a function that combines an emotion engine to recognize the user's emotions and adjust the character's responses and actions according to those emotions.

[0851] User Registration and Login

[0852] When using the service for the first time, the user opens the registration form on the device, enters their name, email address, and password, and presses the send button. The device sends this input information to the server. The server saves the input information in a database and creates a user account. When using the service next time, the user enters their ID (email address) and password on the login screen and presses the login button, and the device sends the authentication information to the server. The server compares the information with the information in the database and performs authentication processing, and if successful, sends dashboard data to the device. The device then displays the user's dashboard.

[0853] Supporter Selection

[0854] The server retrieves a prepared supporter list (character list) from the database and sends it to the terminal. The terminal displays this list to the user. The user selects their preferred character and presses the select button. The terminal sends this selection information to the server. The server associates the selected supporter information with the user's account, saves it in the database, and sends a selection completion message to the terminal. The terminal displays this to the user.

[0855] Task Input

[0856] The terminal displays the task input screen to the user. The user enters the task title, details, deadline, etc., and presses the send button. The terminal sends the entered task information to the server. The server stores the received task information in a database. The server sends a task registration completion message to the terminal, which the terminal displays to the user.

[0857] Task Processing

[0858] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine. The AI ​​engine begins processing the task while imitating the selected character. For example, if a user inputs the task "arrange meeting schedules," the server issues instructions to the AI ​​engine, and the AI ​​arranges the schedules of the participants. The AI ​​engine executes the task according to the work content and reports to the server when processing is complete. The server saves the processing results in the database and sends a notification to the user. The device displays this to the user.

[0859] Emotion Engine

[0860] The system is equipped with an emotion engine that recognizes emotions from the user's facial expressions, voice, text, etc. For example, when a user accesses the system through a camera, the device sends the user's facial expression data to the server. The server then analyzes this using the emotion engine to recognize the user's emotion. The recognized emotion information is transmitted to the AI ​​engine via the server, and the character is adjusted to respond and act in accordance with the user's emotion. For example, if the user shows a tired expression, the character will display a supportive message such as "It would be better to take a break."

[0861] Example: Document organization task

[0862] The user enters "organizing documents" as a task and presses the send button. The device sends the task information to the server, which saves it in a database. The server then sends the task information to the AI ​​engine, and the selected character begins organizing the documents. The AI ​​engine classifies and organizes the documents in real time and sends the results to the server. The server updates the database with information about the completion of document organization and sends a notification to the device. The device notifies the user that "document organization is complete" and displays the detailed results. This not only enables the user to efficiently handle miscellaneous tasks and coordination work, but also allows the emotion engine to provide support tailored to their emotions.

[0863] Example prompts for generative AI models

[0864] The user inputs "organizing documents" as a task, and the selected character simulates the process of sorting and organizing documents in real time.

[0865] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0866] Step 1:

[0867] The user opens the registration form on the terminal, enters their name, email address, and password, and presses the submit button.

[0868] Input: Name, email address, and password entered by the user

[0869] Output: User registration information sent from the device to the server

[0870] What happens: A user fills in a form and clicks the submit button.

[0871] Step 2:

[0872] The terminal transmits the input information to the server.

[0873] Input: User registration information

[0874] Output: HTTP POST request sent to the server

[0875] Specific operation: The device sends user information to the server via the Internet.

[0876] Step 3:

[0877] The server stores the entered information in a database and creates a user account.

[0878] Input: User registration information received by the server

[0879] Output: User information stored in the database and the new user account.

[0880] Specific operation: The server executes an SQL query on the database and saves the user information.

[0881] Step 4:

[0882] The server sends a message to the terminal to notify it that the input information has been successfully saved.

[0883] Input: Information that has been saved to the database

[0884] Output: Registration completion message to the device

[0885] Specific operation: The server creates an HTTP response and sends it to the terminal.

[0886] Step 5:

[0887] The terminal receives the message and displays a notification to the user that registration is complete.

[0888] Input: Registration completion message from the server

[0889] Output: Registration completion notification displayed in the user interface

[0890] Specific operation: The device analyzes the response message and the browser displays a notification.

[0891] Step 6:

[0892] User enters ID (email address) and password on the login screen and clicks login button.

[0893] Input: User ID (email address) and password

[0894] Output: Login request sent from the terminal to the server

[0895] What happens: The user fills in the login form and clicks the submit button.

[0896] Step 7:

[0897] The terminal transmits the authentication information to the server.

[0898] Input: Login information (email address and password)

[0899] Output: HTTP POST request to the server

[0900] Specific operation: The device sends login information to the server.

[0901] Step 8:

[0902] The server performs authentication by comparing the information with that in the database.

[0903] Input: Login information sent to the server

[0904] Output: Authentication result (success or failure)

[0905] What happens: The server runs an SQL query against the database to match the submitted information with existing information.

[0906] Step 9:

[0907] If the authentication is successful, the server transmits the dashboard data to the terminal.

[0908] Input: Authentication success information

[0909] Output: Dashboard data to terminal

[0910] Specific operation: The server returns user-specific dashboard data in an HTTP response.

[0911] Step 10:

[0912] The device receives the data and displays the user's dashboard.

[0913] Input: Dashboard data from the server

[0914] Output: A dashboard displayed in the user interface

[0915] Specific operation: The terminal analyzes the response data and generates and displays the dashboard screen.

[0916] Step 11:

[0917] The server retrieves a pre-prepared supporter list (character list) from the database and sends it to the terminal.

[0918] Input: Query to get supporter list from database

[0919] Output: Supporter list data to the terminal

[0920] Specific operation: The server executes the SQL query, retrieves the list data, and returns it in the HTTP response.

[0921] Step 12:

[0922] The terminal displays the list to the user.

[0923] Input: Supporter list data

[0924] Output: A list of supporters displayed in the user interface

[0925] Specific behavior: Renders list data in the user interface.

[0926] Step 13:

[0927] The user selects a desired character and presses the select button.

[0928] Input: User's character selection information

[0929] Output: Character selection request from device to server

[0930] Specific behavior: The user selects a character and clicks a button.

[0931] Step 14:

[0932] The terminal transmits the selection information to the server.

[0933] Input: Character selection information

[0934] Output: HTTP POST request to the server

[0935] Specific operation: The terminal transmits the selection information to the server.

[0936] Step 15:

[0937] The server associates the selected supporter information with the user's account and stores it in a database.

[0938] Input: Character selection information

[0939] Output: Character information stored in the database

[0940] Specific operation: The server executes the SQL query and saves the selected character to the user information.

[0941] Step 16:

[0942] The server sends a selection completion message to the terminal.

[0943] Input: Information saved to the database

[0944] Output: Selection complete message to terminal

[0945] Specific operation: The server returns a selection completion message in the HTTP response.

[0946] Step 17:

[0947] The terminal receives the message and displays it to the user.

[0948] Input: Selection completion message from the server

[0949] Output: Selection completion notification displayed in the user interface

[0950] Specific operation: The device analyzes the response data and displays a notification on the user interface.

[0951] Step 18:

[0952] The terminal displays a task input screen to the user.

[0953] input:--

[0954] Output: Task entry screen displayed in the user interface

[0955] Specific behavior: Renders and displays the task input form.

[0956] Step 19:

[0957] The user enters the task title, details, deadline, etc., and presses the send button.

[0958] Input: Task title, details, due date

[0959] Output: Task input information from the terminal to the server

[0960] Specific behavior: The user enters task information and clicks the submit button.

[0961] Step 20:

[0962] The terminal transmits the task information to the server.

[0963] Input: Task input information

[0964] Output: HTTP POST request to the server

[0965] Specific operation: Form data is sent to the server via HTTP POST.

[0966] Step 21:

[0967] The server stores the received task information in a database.

[0968] Input: Task input information

[0969] Output: Task information stored in the database

[0970] Specific operation: The server executes an SQL query and saves the task information to the database.

[0971] Step 22:

[0972] The server sends a task registration completion message to the terminal.

[0973] Input: Task save completion information to database

[0974] Output: Task registration completion message to the terminal

[0975] Specific operation: A registration completion message is returned as an HTTP response.

[0976] Step 23:

[0977] The terminal receives the message and displays it to the user.

[0978] Input: Task registration completion message from the server

[0979] Output: Task registration completion notification displayed in the user interface

[0980] Specific operation: A task registration completion message is displayed on the user interface.

[0981] Step 24:

[0982] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine.

[0983] Input: Open task information from the database

[0984] Output: Task information to the AI ​​engine

[0985] What happens: The server executes the SQL query, retrieves the outstanding tasks, and sends the data to the API endpoint.

[0986] Step 25:

[0987] The AI ​​engine will begin processing the task while imitating the selected character.

[0988] Input: Task information sent to the AI ​​engine

[0989] Output: Task processing results

[0990] Specific operation: The AI ​​model starts processing based on the task information, for example, "arranging a meeting schedule."

[0991] Step 26:

[0992] The AI ​​engine executes tasks according to the work content and reports to the server once the processing is complete.

[0993] input:--

[0994] Output: Task processing completion information to the server

[0995] Specific operation: The results of the task execution are sent to the server.

[0996] Step 27:

[0997] The server stores the processing results in a database and sends a notification to the user.

[0998] Input: Task processing completion information

[0999] Output: A message to inform the user

[1000] What happens: The server executes the SQL query, stores the results in a database, and sends a notification as an HTTP response.

[1001] Step 28:

[1002] The terminal displays the processing results to the user.

[1003] Input: Processing result notification from the server

[1004] Output: Processing result notification displayed in the user interface

[1005] Specific behavior: Display a process completion notification in the user interface.

[1006] Step 29:

[1007] The system is equipped with an emotion engine that recognizes emotions from the user's facial expressions, voice, text, etc.

[1008] Input: User's facial expression data, voice data, text data

[1009] Output: Recognized user emotion information

[1010] Specific operation: The emotion engine analyzes facial expression data and voice data to generate emotion information.

[1011] Step 30:

[1012] The server analyzes this using an emotion engine and recognizes the user's emotion.

[1013] Input: Data submitted by the user

[1014] Output: Parsed emotion information

[1015] Specific operation: The server analyzes the data and determines the emotion.

[1016] Step 31:

[1017] The recognized emotional information is transmitted to the AI ​​engine.

[1018] Input: Parsed emotion information

[1019] Output: Emotion data to the AI ​​engine

[1020] Specific operation: Emotional information is sent to the AI ​​engine to generate an appropriate response.

[1021] Step 32:

[1022] The AI ​​engine adjusts the character's responses and actions to reflect the user's emotions.

[1023] Input: Emotion information

[1024] Output: Emotion-based responses and actions

[1025] Specific behavior: The character displays messages and actions according to the user's emotions.

[1026] The above are the specific processing steps of this system, which allows users to manage tasks efficiently and personalizedly.

[1027] (Application example 2)

[1028] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1029] While most conventional task management systems simply store and process tasks entered by users in a database, it is difficult to provide flexible support that responds to the user's emotional state. Furthermore, in autonomous vehicles, it is dangerous for users to enter tasks while driving, so a solution was needed.

[1030] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of characters selectable by the user and receiving the user's selection, means for saving task information entered by the user in a database, means for the character to complete a task based on the saved task information, means for recognizing the user's emotions and adjusting the character's responses and actions in accordance with the emotions, means for displaying the task processing results and emotion-based support messages on the user interface of the autonomously driven vehicle, and means for notifying the user of the completion of task processing. This makes it possible to safely input and process tasks even while the autonomously driven vehicle is traveling, and further makes it possible to provide flexible support in accordance with the user's emotional state.

[1031] The "means for accepting user input information and generating a user account" is a function for sending information provided by the user through an input form to the system and creating an individual account for the user based on this information.

[1032] "Means for displaying a list of selectable characters and receiving a user's selection" is a function that allows the system to display a pre-prepared character list on the user interface, allowing the user to select a character of their choice.

[1033] The "means for saving task information entered by the user in a database" is a function for collecting task information specified by the user and safely saving it in a database.

[1034] "Means for a character to process a task based on stored task information" is a function that reads task information stored in a database and allows a selected character to perform an actual task based on that information.

[1035] "Means for recognizing the user's emotions and adjusting the character's response and behavior in accordance with those emotions" refers to a function that analyzes the user's emotions from their facial expressions and voice, and changes the character's dialogue and behavior based on the results.

[1036] "Means for displaying support messages based on task processing results and emotions on the user interface of an autonomous vehicle" refers to a function that uses the display and speakers of an autonomous vehicle to display messages based on task processing results and the user's emotional state.

[1037] The "means for notifying the user of the completion of task processing" is a function that sends a notification or an alert to inform the user that the task has been completed.

[1038] This invention is a system that allows users to manage and instruct tasks in an autonomous vehicle and provides optimal support based on emotion recognition. Next, we will explain how to implement this system.

[1039] In this system, a user account is created by providing input information through the in-car smart display or voice recognition function. The user enters their name, email address, and password into a registration form, which is then sent to the server.

[1040] Next, the user is presented with a list of supporting characters and selects the character they wish to play. The selection information is sent to the server and stored in a database. The user can input tasks, such as setting a destination, and provide task information, which is then stored in the database.

[1041] The system uses the character to complete tasks based on the saved task information. The character uses an AI engine to search for map information and adjust navigation, for example, for a destination setting task. Once the task is completed, the system notifies the user.

[1042] Furthermore, the system uses in-car cameras and voice recognition technology to recognize the user's emotions. For example, if the system recognizes that the user is tired, a character will display a support message such as "It's a good idea to take a break." This allows the user to perform tasks with peace of mind while driving an autonomous vehicle, and provides support that also takes safety into consideration.

[1043] The system uses various hardware and software for its specific processing. For example, cameras and smart displays are installed in the vehicle, and voice recognition software and emotion recognition engines (such as EmotionRecognizer) are also used. User information and task information are stored in a database, and the AI ​​engine processes tasks using generative AI models from Google Cloud AI or Amazon SageMaker.

[1044] For example, if a user says, "Set my destination to Tokyo Station," task information will be displayed on the smart display and the system will store that information in a database. The AI ​​engine will adjust navigation based on map information and complete the task. At the same time, an appropriate support message will be displayed based on the user's facial expression data captured by the camera.

[1045] Example prompt sentence:

[1046] "Based on the following information, please design a system that processes tasks while the user is driving and displays support messages according to the user's emotional state. User information: name, email address, password. Input tasks: setting destination, task management. Emotion recognition: analyzing facial expression data from the camera. Response according to emotional state: recommending a break if the user is tired."

[1047] In this way, the system combines user task management and emotion recognition to improve the safety and convenience of self-driving vehicles.

[1048] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1049] Step 1:

[1050] The user uses the in-car smart display or voice recognition function to enter their name, email address, and password into the registration form. The device then sends this information to the server, which stores it in a database and creates a user account.

[1051] Input: Name, email address, password

[1052] Data processing: storing the entered information in a database and creating a user account

[1053] Output: User account creation completion notification

[1054] Step 2:

[1055] The server retrieves a pre-prepared character list from a database and sends it to the terminal. The terminal displays this character list on the user interface. The user selects their preferred character from the list and sends the selection information to the server.

[1056] Input: Request to get character list, user character selection

[1057] Data processing: Retrieving character list from database, sending selected information to server

[1058] Output: Display of character list, notification of selection completion

[1059] Step 3:

[1060] The user inputs task information into the terminal using voice input or a touch panel. The terminal sends this task information to the server, which then stores the task information in a database.

[1061] Input: Task information (e.g., destination setting)

[1062] Data processing: saving task information to a database

[1063] Output: Notification of completion of saving task information

[1064] Step 4:

[1065] The server retrieves the stored task information from the database and sends it to the AI ​​engine. The AI ​​engine processes the task based on the task information and sends the results back to the server. The character then executes the task based on the results obtained.

[1066] Input: Task information, instructions to send to AI engine

[1067] Data processing: Analysis of task information, execution of task processing

[1068] Output: Obtaining the task processing results

[1069] Step 5:

[1070] The device captures the user's facial expression data through a camera installed on the device. The device then sends this data to a server, which analyzes it using an emotion recognition engine. The server recognizes the user's emotional state and adjusts the character's responses and behavior accordingly.

[1071] Input: User's facial expression data

[1072] Data processing: Analysis of facial expression data using an emotion recognition engine

[1073] Output: Emotion recognition result

[1074] Step 6:

[1075] The device displays task processing results and emotional support messages on the user interface based on information obtained from the AI ​​engine and emotion recognition engine. The server notifies the user when task processing is complete.

[1076] Input: Task processing results, emotion recognition results

[1077] Data processing: Integrating task processing results and emotion recognition results, generating display messages

[1078] Output: Display of task processing results and supporting messages

[1079] Step 7:

[1080] The user receives notification of task completion and can enter additional instructions or tasks as needed, allowing the system to provide ongoing support to the user.

[1081] Input: Task completion notification, additional instructions and task information

[1082] Data processing: Add instructions and save task information to the database

[1083] Output: Notification of start of additional task processing

[1084] In this way, the various processing steps work together, allowing users to safely and efficiently manage tasks within an autonomous vehicle and receive the support they need.

[1085] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1086] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1087] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1088] [Third embodiment]

[1089] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1090] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1091] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1092] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1093] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1094] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1095] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1096] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1097] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1098] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1099] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1100] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1101] The present invention is a system that efficiently handles the miscellaneous tasks and coordination of a businessman's daily work, and a character selected by the user supports these tasks. The following describes how the program for this system can be implemented and the processing it performs.

[1102] 1. User Registration and Login

[1103] When a user first uses the service, they enter the required information (name, email address, password) into the registration form on their device and press the submit button. The device then sends the entered information to the server, which then stores this information in a database and creates a user account.

[1104] The user enters their ID and password on the login screen and presses the login button. The device sends the authentication information to the server, which then authenticates them. If authentication is successful, the server sends the user's dashboard data to the device, which then displays the dashboard.

[1105] 2. Select a supporter (character)

[1106] The server retrieves the supporter list (character list) from the database and sends it to the terminal. The terminal displays the list to the user, who then selects the desired character. The terminal then sends the character information selected by the user to the server, and the server saves the selection information in the database.

[1107] 3. Enter the task

[1108] The user enters the task title, details, and deadline on the task input screen and presses the send button. The terminal sends the entered task information to the server, which then stores it in a database.

[1109] 4. Task completion by characters

[1110] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine, which then processes the task while imitating the character selected by the user.

[1111] For example, if a user inputs "adjust meeting schedule," the server checks the schedules of the necessary meeting participants and sends instructions to the AI ​​engine to make the adjustments.

[1112] AI will schedule the meeting and send confirmation emails to participants.

[1113] 5. Task Completion and Notifications

[1114] Once the task is completed, the server updates the database and sends a notification of task completion to the device, which displays the notification to the user and provides details about the completed task.

[1115] For example, when the schedule adjustment is completed, the server sends a notification message such as "Schedule adjustment completed."

[1116] Example: Document organization task

[1117] The user inputs the task "organizing documents" and presses the send button.

[1118] The terminal sends the task information to the server, which stores it in a database.

[1119] The server sends the task to the AI ​​engine, and a character selected by the user (e.g., a fictional character) begins organizing the documents.

[1120] The AI ​​engine classifies and organizes documents in real time and sends the results to the server.

[1121] The server stores the information on the completion of document organization in a database and sends a notification to the terminal.

[1122] The terminal notifies the user that "document organization is complete" and displays the detailed results.

[1123] In this way, the system efficiently handles users' miscellaneous tasks and coordination work, allowing them to focus on high-value-added tasks. Flexible support with selectable characters improves the user experience, and the use of artificial intelligence ensures accuracy and efficiency of processing.

[1124] The processing flow will be explained below.

[1125] Step 1: User Registration

[1126] The user opens the registration form on their device, enters their name, email address, and password, and presses the submit button.

[1127] The terminal transmits the input information to the server.

[1128] The server stores the received information in a database and creates a user account.

[1129] The server sends an account creation completion message to the terminal.

[1130] The terminal displays a message to the user indicating that the account has been created.

[1131] Step 2: User Login

[1132] The user opens the login screen on the device, enters their ID (email address) and password, and presses the login button.

[1133] The terminal sends the login information to the server.

[1134] The server compares the information with that in the database and performs authentication processing.

[1135] If the authentication is successful, the server sends an authentication success message and dashboard data to the terminal.

[1136] The terminal displays the user's dashboard.

[1137] Step 3: Select a supporter

[1138] The server retrieves the supporter list from the database and transmits it to the terminal.

[1139] The terminal displays the supporter list to the user.

[1140] The user selects the desired supporter from the list and presses the select button.

[1141] The terminal transmits the selection information to the server.

[1142] The server associates the selected supporter information with the user's account and stores it in a database.

[1143] The server sends a selection completion message to the terminal.

[1144] The terminal displays a selection completion message to the user.

[1145] Step 4: Task Input

[1146] The terminal displays a task input screen to the user.

[1147] The user enters the task title, details, and deadline, and presses the submit button.

[1148] The terminal transmits the input task information to the server.

[1149] The server stores the received task information in a database.

[1150] The server sends a task registration completion message to the terminal.

[1151] The terminal displays a task registration completion message to the user.

[1152] Step 5: Start task processing

[1153] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine.

[1154] The AI ​​engine will begin processing the task while imitating the character of the selected supporter.

[1155] For example, if a user requests a meeting schedule adjustment, the AI ​​engine will check the schedules of the participants and arrange the optimal date.

[1156] Step 6: Task execution

[1157] The AI ​​engine sends confirmation emails to meeting participants.

[1158] The server checks whether the email was sent successfully and stores the result in a database.

[1159] Step 7: Task Completion Notification

[1160] The server updates the database with information about the task completion.

[1161] The server sends a task completion notification to the terminal.

[1162] The terminal displays a task completion notification to the user.

[1163] Step 8: Review task details

[1164] The user checks the task completion notification on the device and opens a screen displaying detailed information.

[1165] The server sends the detailed information to the terminal.

[1166] The terminal displays the detailed results of the task to the user.

[1167] Through this series of steps, users can easily register tasks and have them efficiently handled by the selected supporter. Finally, users can check the progress and completion results of the task. This frees businesspeople from tedious chores and gives them more time to focus on important tasks.

[1168] Example 1

[1169] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1170] In today's business environment, businesspeople are often overwhelmed with numerous miscellaneous tasks and coordination work, resulting in a decline in productivity. There is a need for systems that can efficiently handle these miscellaneous tasks, allowing businesspeople to focus on more value-added work. However, existing systems lack sufficient flexibility in automating tasks and improve the user experience.

[1171] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1172] In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of selectable virtual characters to the user and receiving the user's selection, means for saving the task information entered by the user in a database, means for the virtual character to complete the task based on the saved task information, and means for notifying the user when the task has been completed. This enables the efficient processing of miscellaneous tasks and coordination work for businesspeople, improving the user experience, and ensuring the accuracy and efficiency of processing by using artificial intelligence.

[1173] "User" refers to a person who uses the system, who inputs information into the system, and who receives services provided by the system.

[1174] "Input information" refers to data or information provided by a user to the system, including name, email address, password, etc.

[1175] "User Account" means an account that holds individual identification information for a User to access and use the System.

[1176] A "virtual character" is a digital character that a user can select and use, and has the role of completing the user's tasks.

[1177] "Work information" refers to detailed task information that a user enters into the system, and includes the work title, details, deadline, and so on.

[1178] "Database" refers to the part of a computer system that stores and manages input and activity information.

[1179] A "generative AI model" is an artificial intelligence-based model used to automatically perform tasks while mimicking a virtual character selected by a user.

[1180] "Server" refers to a central computer system that receives information from users, processes it, and provides the necessary data.

[1181] "Notification" refers to messages and alarms that inform the user of the results and progress of task processing.

[1182] The present invention is a system for efficiently handling the miscellaneous tasks and adjustments of a businessman's daily work, and a virtual character selected by the user supports these tasks. A specific embodiment of the program for this system will be described below.

[1183] First, a user accesses the system using a terminal, enters the required information such as name, email address, and password into the registration form, and presses the submit button. The terminal sends this input information to the server, which then stores the received information in a database and creates a user account.

[1184] Next, the user enters their ID (or email address) and password on the login screen and presses the login button. The device sends the authentication information to the server, which then authenticates the user by checking it against the user information stored in the database. If authentication is successful, the server sends the user's dashboard data to the device, and the device displays the dashboard.

[1185] The user then checks the virtual character list on the dashboard and selects their preferred character. The server retrieves the supporter list from the database and sends it to the device. The device displays the list to the user, and the device sends the character information selected by the user to the server. The server saves the selection information in the database.

[1186] The user then enters the task title, details, and deadline on the task input screen and presses the send button. The device sends the entered task information to the server, which stores it in a database. The server retrieves unprocessed task information from the database and sends it to an AI engine that uses a generative AI model. The AI ​​engine processes the task while imitating the behavioral patterns of the character selected by the user.

[1187] For example, if a user enters "arrange a meeting schedule" as a task, the server sends an instruction to the AI ​​engine to check the schedules of the necessary meeting participants. The AI ​​engine accesses the schedule database of meeting participants, adjusts the optimal date, compiles the candidate dates, and sends a confirmation email to the participants. When the task is completed, the server updates the database and sends a task completion notification to the device. The device displays the notification to the user and provides detailed information about the completed task.

[1188] As a concrete example, consider the case where a user inputs the task "organizing documents" and presses the send button. The device sends the task information to the server, which saves it in a database. The server then sends the document organization task to the AI ​​engine, and the virtual character begins organizing the documents. The AI ​​engine classifies and organizes the documents in real time and sends the results to the server. The server saves information about the completion of document organization in the database and sends a notification to the device. The device then notifies the user that "document organization is complete" and displays the detailed results.

[1189] The system efficiently handles users' miscellaneous and coordination tasks, allowing them to focus on higher-value-added tasks. Flexible support from virtual characters improves the user experience, while the use of generative AI models ensures accuracy and efficiency of processing.

[1190] Example prompt sentence:

[1191] "I'd like you to adjust the schedule for a meeting. The participants are A, B, and C. Please arrange the best meeting date and compile a list of possible dates."

[1192] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1193] Step 1: User Registration

[1194] The user enters their name, email address, and password into the registration form via their terminal and presses the submit button. Input: Name, email address, password. Output: User account information is generated.

[1195] The device sends this input information to the server, which then uses a hash function to protect the password and stores it in a database. The specific steps for creating a user account include checking for duplicate email addresses and hashing the password.

[1196] Step 2: Login authentication

[1197] The user enters their ID (or email address) and password on the login screen and presses the login button. Input: ID, password. Output: Authentication results and dashboard data.

[1198] The device sends authentication information to the server, which then authenticates the user by checking the user information stored in a database. If authentication is successful, the server sends the user's dashboard data to the device, which then displays the dashboard. The authentication process includes checking the password against a hash.

[1199] Step 3: Select a Supporter (Character)

[1200] The server retrieves the supporter list from the database and sends it to the terminal. Input: None. Output: Supporter list.

[1201] The terminal displays the supporter list to the user, and the user selects the desired character. Input: User's character selection. Output: Selected character information.

[1202] The terminal sends the character information selected by the user to the server, which then stores the selection information in a database.

[1203] Step 4: Entering the Task

[1204] The user enters the task title, details, and deadline on the task input screen and presses the send button. Input: Task title, details, deadline. Output: Task information.

[1205] The device sends the input task information to the server, which stores the task information in a database. Specifically, the task status is recorded as "unprocessed."

[1206] Step 5: Character Tasks

[1207] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine. Input: Unprocessed task information. Output: Task processing instructions.

[1208] The AI ​​engine processes tasks while imitating the behavioral patterns of the character selected by the user. As a specific example of processing, when scheduling a meeting, the AI ​​engine checks the schedules of the meeting participants and finds the optimal date. Input: User prompt, existing schedule data. Output: Schedule adjustment results.

[1209] Step 6: Task Completion and Notification

[1210] Once the task is completed, the AI ​​engine sends the result to the server, which updates the database with the task completion information. Input: Task completion result. Output: Task status update.

[1211] The server sends a notification of task completion to the terminal. The terminal displays the notification to the user and provides detailed information about the completed task. An example of a prompt sentence is a message displayed to the user such as "Document organization is complete. The classification results are as follows."

[1212] (Application example 1)

[1213] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1214] Currently, the user experience in autonomous vehicles requires users to concentrate on driving, while many miscellaneous tasks must be performed manually. Tasks that must be performed while driving, such as real-time navigation settings, setting reminders, and sending and receiving messages, are particularly burdensome for users. Furthermore, to safely and efficiently handle these tasks, voice input and artificial intelligence are required, but current systems do not adequately address these. Therefore, there is a need for a system that allows users to efficiently handle miscellaneous tasks while still being able to concentrate on driving.

[1215] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1216] In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of selectable characters to the user and receiving the user's selection, means for saving the task information entered by the user in a database, means for the character to complete the task based on the saved task information, means for notifying the user of the completion of task processing, means for the user to input tasks through voice input, and means for providing optimal navigation using the user's location information. This allows a user to efficiently complete various chores through voice input without using their hands while driving. Furthermore, having a character complete tasks increases familiarity and entertainment value, improving driving comfort.

[1217] "User input information" refers to information such as name, email address, and password entered by the user and accepted by the system.

[1218] A "user account" is an individual account that is generated based on information entered by a user and is used for logging in and task management.

[1219] A "character list" is a list of selectable characters that the system displays to the user.

[1220] "Task information" is information including the content, details, and deadline of a task that a user inputs into the system.

[1221] A "database" is a storage device within the system that stores user account information, task information, character information, and so on.

[1222] "Means for a character to process a task" refers to a function in which a character selected by a user executes a task based on task information stored in the system.

[1223] The "means for notifying the user of the completion of task processing" is a function by which the system notifies the user of the completion of the task when it is completed.

[1224] "Voice input" is a method in which a user verbally inputs commands or tasks into a system through a microphone.

[1225] "Location information" is information that indicates the user's current location, and is mainly obtained by a satellite positioning system such as GPS.

[1226] "Navigation" is a function that calculates and guides the optimal route for the user to reach their destination.

[1227] This invention is a system that allows users to efficiently complete tasks in an autonomous vehicle through voice input and characters. This system automatically handles miscellaneous tasks while the user is driving, providing an environment in which the user can concentrate on driving.

[1228] 1. User Registration and Login

[1229] When using the device for the first time, the user enters information such as name, email address, and password on the screen of the vehicle's entertainment system and presses the send button. The device then sends the information to the server, which stores it in a database and creates a user account. When logging in, the device sends the user's ID and password to the server, which then performs authentication. If authentication is successful, the server sends the user's dashboard data to the device, which then displays the dashboard.

[1230] 2. Character Selection

[1231] The server retrieves a character list from the database and sends it to the terminal. The terminal displays the list to the user, who then selects the desired character. The terminal then sends the character information selected by the user to the server, which then stores the selection information in the database.

[1232] 3. Enter the task

[1233] Users input tasks through the vehicle's voice input system, such as navigation settings, reminder settings, and message sending. The device uses voice recognition to convert the input into text and send the task information to the server, which stores the task information in a database and updates the user's task list.

[1234] 4. Task completion by characters

[1235] The server retrieves unprocessed task information from the database and sends it to a generative AI model (e.g., GPT-4) installed in the vehicle. The AI ​​engine then processes the task while imitating the character selected by the user, such as setting a navigation route, sending messages, or setting reminders.

[1236] 5. Task Completion and Notifications

[1237] Once the task is completed, the server updates the database and sends a task completion notification to the vehicle's terminal, which notifies the user by display and voice and displays detailed results.

[1238] Hardware and software used

[1239] Hardware:

[1240] Entertainment systems (displays) for autonomous vehicles

[1241] Voice recognition device

[1242] Internet connection function

[1243] Vehicle-mounted AI engines (e.g., systems equipped with GPT-4)

[1244] software:

[1245] Server-side database software (e.g., MySQL)

[1246] User authentication system (e.g. OAuth)

[1247] Speech recognition systems (e.g., Google Cloud Speech-to-Text)

[1248] AI engine (e.g. GPT-4)

[1249] Examples of concrete examples and prompts

[1250] For example, if a user issues a voice command such as "Tell me the best route to my next meeting," the vehicle's AI engine will calculate the current location and destination and set the optimal route. This will take into account traffic congestion and other traffic conditions in real time and be reflected in the navigation system. Furthermore, if the user instructs, "Set a reminder. Notify me when I arrive at my destination," the reminder will be set appropriately.

[1251] Example prompt sentence:

[1252] "What's the best route to my next meeting?"

[1253] "Set a reminder. Notify me when I reach my destination."

[1254] "Send me a message. Let me know the meeting is ready."

[1255] In this way, the system provides an environment in which the user can efficiently complete tasks while driving, improving driving safety and comfort.

[1256] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1257] Step 1:

[1258] The user enters information such as name, email address, and password through the screen of the entertainment system in the vehicle and presses the send button.

[1259] Input: Name, email address, password

[1260] Data processing: The terminal sends the input information in text format to the server.

[1261] Output: The server saves the user information to a database and creates a user account.

[1262] Step 2:

[1263] The user enters their ID and password on the vehicle's entertainment system screen and presses the login button. The device then sends the authentication information to the server, which then performs the authentication.

[1264] Input: User ID, Password

[1265] Data processing: The server checks the authentication information against a database and performs authentication.

[1266] Output: If authentication is successful, the server sends the user's dashboard data to the device, and the device displays the dashboard.

[1267] Step 3:

[1268] The server retrieves the character list from the database and sends it to the terminal. The user can then check the list on the vehicle's screen and select the desired character.

[1269] Input: User character selection

[1270] Data processing: The device sends the selected character information to the server, which stores the selected information in the database.

[1271] Output: The information of the selected character is saved in the database.

[1272] Step 4:

[1273] The user uses the vehicle's voice input system to input a task, such as "What is the best route to my next meeting?"

[1274] Input: Voice command

[1275] Data processing: The device's voice recognition device converts the voice into text data and sends it to the server as task information.

[1276] Output: The server saves the task information to the database and updates the user's task list.

[1277] Step 5:

[1278] The server retrieves raw task information from the database and sends it to a generative AI model (e.g., GPT-4) installed in the vehicle.

[1279] Input: Open task information

[1280] Data processing: The AI ​​engine processes tasks while imitating the character selected by the user.

[1281] Output: For example, setting a navigation route, sending a message, setting a reminder, etc.

[1282] Step 6:

[1283] Once the task is completed, the server updates the database and sends a notification of task completion to the vehicle's terminal.

[1284] Input: Task completion information

[1285] Data processing: The server updates the database and records the completion status.

[1286] Output: The device notifies the user of task completion via display and audio, and displays detailed results.

[1287] This program process allows users to efficiently perform various tasks hands-free while driving, with seamless input and output interactions at each step, enhancing the driving experience.

[1288] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1289] The present invention is a system that accepts user input information to create a user account, displays a list of selectable characters to receive the user's selection, saves the task information entered by the user in a database, and has the character complete tasks based on the saved task information. Furthermore, the present invention is equipped with a function that combines an emotion engine to recognize the user's emotions and adjust the character's responses and actions according to those emotions.

[1290] An embodiment of this system will be specifically described below.

[1291] 1. User Registration and Login

[1292] When a user first uses the service, they open the registration form on their device, enter their name, email address, and password, and press the submit button. The device then sends the information to the server, which automatically saves it in a database and creates a user account.

[1293] When a user enters their ID (email address) and password on the login screen and presses the login button, the device sends the authentication information to the server. The server performs authentication by comparing it with information in the database, and if successful, sends dashboard data to the device. The device then displays the user's dashboard.

[1294] 2. Supporter Selection

[1295] The server retrieves a pre-prepared supporter list (character list) from the database and sends it to the terminal, which then displays the supporter list to the user.

[1296] The user selects their favorite character and presses the select button. The device sends the selection information to the server. The server associates the selected supporter information with the user's account and saves it in a database. The server then sends a selection completion message to the device, which displays it to the user.

[1297] 3. Enter the task

[1298] The terminal displays a task input screen to the user, who then enters the task title, details, deadline, etc. and presses the send button.

[1299] The terminal sends the entered task information to the server. The server stores the received task information in a database. The server then sends a task registration completion message to the terminal, which the terminal displays to the user.

[1300] 4. Task Processing

[1301] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine, which then begins processing the task while imitating the selected character.

[1302] For example, if a user inputs "adjust meeting schedule," the server issues instructions to the AI ​​engine, and the AI ​​adjusts the schedules of the participants.

[1303] The AI ​​engine executes tasks according to the work content and reports to the server when the processing is complete. The server stores the processing results in a database and sends a notification to the user, who then displays it on the device.

[1304] 5. Emotion Engine

[1305] The system is equipped with an emotion engine that recognizes emotions from the user's facial expressions, voice, text, etc. For example, when a user accesses the system through a camera, the device sends the user's facial expression data to the server, which then analyzes it using the emotion engine to recognize the user's emotion.

[1306] The recognized emotion information is transmitted to the AI ​​engine via the server, and the character's responses and actions are adjusted to match the user's emotions. For example, if the user shows a tired expression, the character will display a supportive message such as "You should take a break."

[1307] Example: Document organization task

[1308] The user enters "organizing documents" as a task and presses the send button.

[1309] The terminal sends task information to the server, which stores it in a database.

[1310] The server sends task information to the AI ​​engine, and the selected character begins organizing the documents.

[1311] The AI ​​engine classifies and organizes documents in real time and sends the results to the server.

[1312] The server updates the database with the information about the completion of the document organization and sends a notification to the terminal. The terminal notifies the user that "document organization is complete" and displays the detailed results.

[1313] In this way, this system efficiently handles the user's miscellaneous tasks and coordination work, grasps the user's emotions using an emotion engine, and provides support accordingly, providing an environment in which business people can concentrate on more important tasks.

[1314] The processing flow will be explained below.

[1315] Step 1: User Registration

[1316] The user opens the registration form on their device, enters their name, email address, and password, and presses the submit button.

[1317] The terminal transmits the input information to the server.

[1318] The server stores the received information in a database and creates a user account.

[1319] The server sends an account creation completion message to the terminal.

[1320] The terminal displays a message to the user indicating that the account has been created.

[1321] Step 2: User Login

[1322] The user opens the login screen on the device, enters their ID (email address) and password, and presses the login button.

[1323] The terminal sends the login information to the server.

[1324] The server compares the information with that in the database and performs authentication processing.

[1325] If the authentication is successful, the server sends an authentication success message and dashboard data to the terminal.

[1326] The terminal displays the user's dashboard.

[1327] Step 3: Select a supporter

[1328] The server retrieves a pre-prepared supporter list from the database and sends it to the terminal.

[1329] The terminal displays the supporter list to the user.

[1330] The user selects a preferred supporter from the list and presses the select button.

[1331] The terminal transmits the selection information to the server.

[1332] The server associates the selected supporter information with the user's account and stores it in a database.

[1333] The server sends a selection completion message to the terminal.

[1334] The terminal displays a selection completion message to the user.

[1335] Step 4: Task Input

[1336] The terminal displays a task input screen to the user.

[1337] The user enters the task title, details, and deadline, and presses the submit button.

[1338] The terminal transmits the input task information to the server.

[1339] The server stores the received task information in a database.

[1340] The server sends a task registration completion message to the terminal.

[1341] The terminal displays a task registration completion message to the user.

[1342] Step 5: Emotion Recognition

[1343] The camera captures the user's facial expressions while using the system.

[1344] The terminal transmits the user's facial expression data to the server.

[1345] The server uses an emotion engine to analyze the facial expression data and recognize the user's emotion.

[1346] The server sends the recognized emotional information to the AI ​​engine.

[1347] Step 6: Start task processing

[1348] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine.

[1349] The AI ​​engine will begin processing the task while imitating the character of the selected supporter.

[1350] For example, if a user requests a meeting schedule adjustment, the AI ​​engine will check the schedules of the participants and arrange the optimal date.

[1351] Step 7: Task execution

[1352] The AI ​​engine sends confirmation emails to meeting participants.

[1353] The server checks whether the email was sent successfully and stores the result in a database.

[1354] Step 8: Task Completion Notification

[1355] The server updates the database with information about the task completion.

[1356] The server sends a task completion notification to the terminal.

[1357] The terminal displays a task completion notification to the user.

[1358] Step 9: Review task details

[1359] The user checks the task completion notification on the device and opens a screen displaying detailed information.

[1360] The server sends the detailed information to the terminal.

[1361] The terminal displays the detailed results of the task to the user.

[1362] Step 10: Emotion-Based Responding

[1363] The server adjusts the AI ​​engine's character responses based on the recognized user's emotional information.

[1364] If the user looks tired, a character will display a supportive message such as "You should take a break."

[1365] Through this series of steps, users can easily register tasks and have them efficiently handled by the selected supporter. The system also recognizes the user's emotions and adjusts responses accordingly, allowing users to receive more personalized support. This frees users from mundane tasks and allows them to focus on important tasks.

[1366] Example 2

[1367] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1368] Current task management systems cannot take into account the user's emotions and state, which can cause stress for the user. Furthermore, users must manually input and manage tasks, which is time-consuming. Furthermore, even in task management systems using characters, the characters' responses and actions are uniform, making it difficult to individually optimize the user experience. There is a need to solve these issues and provide a more convenient and personalized task management system.

[1369] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1370] In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of selectable characters to the user and accepting the user's selection, means for saving the task information entered by the user in a database, means for the character to complete the task based on the saved task information, means for notifying the user that the task has been completed, and means for recognizing the user's emotions and adjusting the character's responses and actions in response to the emotions. This allows the user to not only efficiently manage tasks but also receive support in accordance with their own emotions and state.

[1371] "User input information" refers to information such as name, email address, and password that a user inputs into the system.

[1372] The "means for generating a user account" is a function that creates an account associated with a user based on information input by the user and stores the account in a database.

[1373] The "character list" is a list of multiple characters prepared in advance by the system, and is displayed to the user to allow them to select one.

[1374] "Task information" refers to information to be managed, such as the title, details, and deadline of a task, which is entered into the system by the user.

[1375] A "database" is a storage device for centrally storing data managed by the system, such as user account information and task information.

[1376] "The means by which the character completes the task" refers to the algorithm or AI engine that the character utilizes to complete the assigned task.

[1377] The "means for notifying the user of the completion of task processing" is a function for notifying the user of the completion information when the character completes a task.

[1378] "Means for recognizing emotions" refers to a function that analyzes data such as the user's facial expressions, voice, and text, and estimates the user's emotions.

[1379] The "means for adjusting the character's response and behavior according to the emotion" is a function for changing the character's expression and behavior based on the user's recognized emotional information.

[1380] "Means of utilizing artificial intelligence" refers to a function that uses AI technology to allow characters to automatically complete tasks.

[1381] The "means for displaying the details of the processing results" is a display function for specifically informing the user of the content and results of the task processing.

[1382] The present invention is a system that accepts user input information to create a user account, displays a list of selectable characters to receive the user's selection, saves the task information entered by the user in a database, and has the character complete tasks based on the saved task information. Furthermore, the present invention is equipped with a function that combines an emotion engine to recognize the user's emotions and adjust the character's responses and actions according to those emotions.

[1383] User Registration and Login

[1384] When using the service for the first time, the user opens the registration form on the device, enters their name, email address, and password, and presses the send button. The device sends this input information to the server. The server saves the input information in a database and creates a user account. When using the service next time, the user enters their ID (email address) and password on the login screen and presses the login button, and the device sends the authentication information to the server. The server compares the information with the information in the database and performs authentication processing, and if successful, sends dashboard data to the device. The device then displays the user's dashboard.

[1385] Supporter Selection

[1386] The server retrieves a prepared supporter list (character list) from the database and sends it to the terminal. The terminal displays this list to the user. The user selects their preferred character and presses the select button. The terminal sends this selection information to the server. The server associates the selected supporter information with the user's account, saves it in the database, and sends a selection completion message to the terminal. The terminal displays this to the user.

[1387] Task Input

[1388] The terminal displays the task input screen to the user. The user enters the task title, details, deadline, etc., and presses the send button. The terminal sends the entered task information to the server. The server stores the received task information in a database. The server sends a task registration completion message to the terminal, which the terminal displays to the user.

[1389] Task Processing

[1390] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine. The AI ​​engine begins processing the task while imitating the selected character. For example, if a user inputs the task "arrange meeting schedules," the server issues instructions to the AI ​​engine, and the AI ​​arranges the schedules of the participants. The AI ​​engine executes the task according to the work content and reports to the server when processing is complete. The server saves the processing results in the database and sends a notification to the user. The device displays this to the user.

[1391] Emotion Engine

[1392] The system is equipped with an emotion engine that recognizes emotions from the user's facial expressions, voice, text, etc. For example, when a user accesses the system through a camera, the device sends the user's facial expression data to the server. The server then analyzes this using the emotion engine to recognize the user's emotion. The recognized emotion information is transmitted to the AI ​​engine via the server, and the character is adjusted to respond and act in accordance with the user's emotion. For example, if the user shows a tired expression, the character will display a supportive message such as "It would be better to take a break."

[1393] Example: Document organization task

[1394] The user enters "organizing documents" as a task and presses the send button. The device sends the task information to the server, which saves it in a database. The server then sends the task information to the AI ​​engine, and the selected character begins organizing the documents. The AI ​​engine classifies and organizes the documents in real time and sends the results to the server. The server updates the database with information about the completion of document organization and sends a notification to the device. The device notifies the user that "document organization is complete" and displays the detailed results. This not only enables the user to efficiently handle miscellaneous tasks and coordination work, but also allows the emotion engine to provide support tailored to their emotions.

[1395] Example prompts for generative AI models

[1396] The user inputs "organizing documents" as a task, and the selected character simulates the process of sorting and organizing documents in real time.

[1397] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1398] Step 1:

[1399] The user opens the registration form on the terminal, enters their name, email address, and password, and presses the submit button.

[1400] Input: Name, email address, and password entered by the user

[1401] Output: User registration information sent from the device to the server

[1402] What happens: A user fills in a form and clicks the submit button.

[1403] Step 2:

[1404] The terminal transmits the input information to the server.

[1405] Input: User registration information

[1406] Output: HTTP POST request sent to the server

[1407] Specific operation: The device sends user information to the server via the Internet.

[1408] Step 3:

[1409] The server stores the entered information in a database and creates a user account.

[1410] Input: User registration information received by the server

[1411] Output: User information stored in the database and the new user account.

[1412] Specific operation: The server executes an SQL query on the database and saves the user information.

[1413] Step 4:

[1414] The server sends a message to the terminal to notify it that the input information has been successfully saved.

[1415] Input: Information that has been saved to the database

[1416] Output: Registration completion message to the device

[1417] Specific operation: The server creates an HTTP response and sends it to the terminal.

[1418] Step 5:

[1419] The terminal receives the message and displays a notification to the user that registration is complete.

[1420] Input: Registration completion message from the server

[1421] Output: Registration completion notification displayed in the user interface

[1422] Specific operation: The device analyzes the response message and the browser displays a notification.

[1423] Step 6:

[1424] User enters ID (email address) and password on the login screen and clicks login button.

[1425] Input: User ID (email address) and password

[1426] Output: Login request sent from the terminal to the server

[1427] What happens: The user fills in the login form and clicks the submit button.

[1428] Step 7:

[1429] The terminal transmits the authentication information to the server.

[1430] Input: Login information (email address and password)

[1431] Output: HTTP POST request to the server

[1432] Specific operation: The device sends login information to the server.

[1433] Step 8:

[1434] The server performs authentication by comparing the information with that in the database.

[1435] Input: Login information sent to the server

[1436] Output: Authentication result (success or failure)

[1437] What happens: The server runs an SQL query against the database to match the submitted information with existing information.

[1438] Step 9:

[1439] If the authentication is successful, the server transmits the dashboard data to the terminal.

[1440] Input: Authentication success information

[1441] Output: Dashboard data to terminal

[1442] Specific operation: The server returns user-specific dashboard data in an HTTP response.

[1443] Step 10:

[1444] The device receives the data and displays the user's dashboard.

[1445] Input: Dashboard data from the server

[1446] Output: A dashboard displayed in the user interface

[1447] Specific operation: The terminal analyzes the response data and generates and displays the dashboard screen.

[1448] Step 11:

[1449] The server retrieves a pre-prepared supporter list (character list) from the database and sends it to the terminal.

[1450] Input: Query to get supporter list from database

[1451] Output: Supporter list data to the terminal

[1452] Specific operation: The server executes the SQL query, retrieves the list data, and returns it in the HTTP response.

[1453] Step 12:

[1454] The terminal displays the list to the user.

[1455] Input: Supporter list data

[1456] Output: A list of supporters displayed in the user interface

[1457] Specific behavior: Renders list data in the user interface.

[1458] Step 13:

[1459] The user selects a desired character and presses the select button.

[1460] Input: User's character selection information

[1461] Output: Character selection request from device to server

[1462] Specific behavior: The user selects a character and clicks a button.

[1463] Step 14:

[1464] The terminal transmits the selection information to the server.

[1465] Input: Character selection information

[1466] Output: HTTP POST request to the server

[1467] Specific operation: The terminal transmits the selection information to the server.

[1468] Step 15:

[1469] The server associates the selected supporter information with the user's account and stores it in a database.

[1470] Input: Character selection information

[1471] Output: Character information stored in the database

[1472] Specific operation: The server executes the SQL query and saves the selected character to the user information.

[1473] Step 16:

[1474] The server sends a selection completion message to the terminal.

[1475] Input: Information saved to the database

[1476] Output: Selection complete message to terminal

[1477] Specific operation: The server returns a selection completion message in the HTTP response.

[1478] Step 17:

[1479] The terminal receives the message and displays it to the user.

[1480] Input: Selection completion message from the server

[1481] Output: Selection completion notification displayed in the user interface

[1482] Specific operation: The device analyzes the response data and displays a notification on the user interface.

[1483] Step 18:

[1484] The terminal displays a task input screen to the user.

[1485] input:--

[1486] Output: Task entry screen displayed in the user interface

[1487] Specific behavior: Renders and displays the task input form.

[1488] Step 19:

[1489] The user enters the task title, details, deadline, etc., and presses the send button.

[1490] Input: Task title, details, due date

[1491] Output: Task input information from the terminal to the server

[1492] Specific behavior: The user enters task information and clicks the submit button.

[1493] Step 20:

[1494] The terminal transmits the task information to the server.

[1495] Input: Task input information

[1496] Output: HTTP POST request to the server

[1497] Specific operation: Form data is sent to the server via HTTP POST.

[1498] Step 21:

[1499] The server stores the received task information in a database.

[1500] Input: Task input information

[1501] Output: Task information stored in the database

[1502] Specific operation: The server executes an SQL query and saves the task information to the database.

[1503] Step 22:

[1504] The server sends a task registration completion message to the terminal.

[1505] Input: Task save completion information to database

[1506] Output: Task registration completion message to the terminal

[1507] Specific operation: A registration completion message is returned as an HTTP response.

[1508] Step 23:

[1509] The terminal receives the message and displays it to the user.

[1510] Input: Task registration completion message from the server

[1511] Output: Task registration completion notification displayed in the user interface

[1512] Specific operation: A task registration completion message is displayed on the user interface.

[1513] Step 24:

[1514] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine.

[1515] Input: Open task information from the database

[1516] Output: Task information to the AI ​​engine

[1517] What happens: The server executes the SQL query, retrieves the outstanding tasks, and sends the data to the API endpoint.

[1518] Step 25:

[1519] The AI ​​engine will begin processing the task while imitating the selected character.

[1520] Input: Task information sent to the AI ​​engine

[1521] Output: Task processing results

[1522] Specific operation: The AI ​​model starts processing based on the task information, for example, "arranging a meeting schedule."

[1523] Step 26:

[1524] The AI ​​engine executes tasks according to the work content and reports to the server once the processing is complete.

[1525] input:--

[1526] Output: Task processing completion information to the server

[1527] Specific operation: The results of the task execution are sent to the server.

[1528] Step 27:

[1529] The server stores the processing results in a database and sends a notification to the user.

[1530] Input: Task processing completion information

[1531] Output: A message to inform the user

[1532] What happens: The server executes the SQL query, stores the results in a database, and sends a notification as an HTTP response.

[1533] Step 28:

[1534] The terminal displays the processing results to the user.

[1535] Input: Processing result notification from the server

[1536] Output: Processing result notification displayed in the user interface

[1537] Specific behavior: Display a process completion notification in the user interface.

[1538] Step 29:

[1539] The system is equipped with an emotion engine that recognizes emotions from the user's facial expressions, voice, text, etc.

[1540] Input: User's facial expression data, voice data, text data

[1541] Output: Recognized user emotion information

[1542] Specific operation: The emotion engine analyzes facial expression data and voice data to generate emotion information.

[1543] Step 30:

[1544] The server analyzes this using an emotion engine and recognizes the user's emotion.

[1545] Input: Data submitted by the user

[1546] Output: Parsed emotion information

[1547] Specific operation: The server analyzes the data and determines the emotion.

[1548] Step 31:

[1549] The recognized emotional information is transmitted to the AI ​​engine.

[1550] Input: Parsed emotion information

[1551] Output: Emotion data to the AI ​​engine

[1552] Specific operation: Emotional information is sent to the AI ​​engine to generate an appropriate response.

[1553] Step 32:

[1554] The AI ​​engine adjusts the character's responses and actions to reflect the user's emotions.

[1555] Input: Emotion information

[1556] Output: Emotion-based responses and actions

[1557] Specific behavior: The character displays messages and actions according to the user's emotions.

[1558] The above are the specific processing steps of this system, which allows users to manage tasks efficiently and personalizedly.

[1559] (Application example 2)

[1560] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1561] While most conventional task management systems simply store and process tasks entered by users in a database, it is difficult to provide flexible support that responds to the user's emotional state. Furthermore, in autonomous vehicles, it is dangerous for users to enter tasks while driving, so a solution was needed.

[1562] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of characters selectable by the user and receiving the user's selection, means for saving task information entered by the user in a database, means for the character to complete a task based on the saved task information, means for recognizing the user's emotions and adjusting the character's responses and actions in accordance with the emotions, means for displaying the task processing results and emotion-based support messages on the user interface of the autonomously driven vehicle, and means for notifying the user of the completion of task processing. This makes it possible to safely input and process tasks even while the autonomously driven vehicle is traveling, and further makes it possible to provide flexible support in accordance with the user's emotional state.

[1563] The "means for accepting user input information and generating a user account" is a function for sending information provided by the user through an input form to the system and creating an individual account for the user based on this information.

[1564] "Means for displaying a list of selectable characters and receiving a user's selection" is a function that allows the system to display a pre-prepared character list on the user interface, allowing the user to select a character of their choice.

[1565] The "means for saving task information entered by the user in a database" is a function for collecting task information specified by the user and safely saving it in a database.

[1566] "Means for a character to process a task based on stored task information" is a function that reads task information stored in a database and allows a selected character to perform an actual task based on that information.

[1567] "Means for recognizing the user's emotions and adjusting the character's response and behavior in accordance with those emotions" refers to a function that analyzes the user's emotions from their facial expressions and voice, and changes the character's dialogue and behavior based on the results.

[1568] "Means for displaying support messages based on task processing results and emotions on the user interface of an autonomous vehicle" refers to a function that uses the display and speakers of an autonomous vehicle to display messages based on task processing results and the user's emotional state.

[1569] The "means for notifying the user of the completion of task processing" is a function that sends a notification or an alert to inform the user that the task has been completed.

[1570] This invention is a system that allows users to manage and instruct tasks in an autonomous vehicle and provides optimal support based on emotion recognition. Next, we will explain how to implement this system.

[1571] In this system, a user account is created by providing input information through the in-car smart display or voice recognition function. The user enters their name, email address, and password into a registration form, which is then sent to the server.

[1572] Next, the user is presented with a list of supporting characters and selects the character they wish to play. The selection information is sent to the server and stored in a database. The user can input tasks, such as setting a destination, and provide task information, which is then stored in the database.

[1573] The system uses the character to complete tasks based on the saved task information. The character uses an AI engine to search for map information and adjust navigation, for example, for a destination setting task. Once the task is completed, the system notifies the user.

[1574] Furthermore, the system uses in-car cameras and voice recognition technology to recognize the user's emotions. For example, if the system recognizes that the user is tired, a character will display a support message such as "It's a good idea to take a break." This allows the user to perform tasks with peace of mind while driving an autonomous vehicle, and provides support that also takes safety into consideration.

[1575] The system uses various hardware and software for its specific processing. For example, cameras and smart displays are installed in the vehicle, and voice recognition software and emotion recognition engines (such as EmotionRecognizer) are also used. User information and task information are stored in a database, and the AI ​​engine processes tasks using generative AI models from Google Cloud AI or Amazon SageMaker.

[1576] For example, if a user says, "Set my destination to Tokyo Station," task information will be displayed on the smart display and the system will store that information in a database. The AI ​​engine will adjust navigation based on map information and complete the task. At the same time, an appropriate support message will be displayed based on the user's facial expression data captured by the camera.

[1577] Example prompt sentence:

[1578] "Based on the following information, please design a system that processes tasks while the user is driving and displays support messages according to the user's emotional state. User information: name, email address, password. Input tasks: setting destination, task management. Emotion recognition: analyzing facial expression data from the camera. Response according to emotional state: recommending a break if the user is tired."

[1579] In this way, the system combines user task management and emotion recognition to improve the safety and convenience of self-driving vehicles.

[1580] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1581] Step 1:

[1582] The user uses the in-car smart display or voice recognition function to enter their name, email address, and password into the registration form. The device then sends this information to the server, which stores it in a database and creates a user account.

[1583] Input: Name, email address, password

[1584] Data processing: storing the entered information in a database and creating a user account

[1585] Output: User account creation completion notification

[1586] Step 2:

[1587] The server retrieves a pre-prepared character list from a database and sends it to the terminal. The terminal displays this character list on the user interface. The user selects their preferred character from the list and sends the selection information to the server.

[1588] Input: Request to get character list, user character selection

[1589] Data processing: Retrieving character list from database, sending selected information to server

[1590] Output: Display of character list, notification of selection completion

[1591] Step 3:

[1592] The user inputs task information into the terminal using voice input or a touch panel. The terminal sends this task information to the server, which then stores the task information in a database.

[1593] Input: Task information (e.g., destination setting)

[1594] Data processing: saving task information to a database

[1595] Output: Notification of completion of saving task information

[1596] Step 4:

[1597] The server retrieves the stored task information from the database and sends it to the AI ​​engine. The AI ​​engine processes the task based on the task information and sends the results back to the server. The character then executes the task based on the results obtained.

[1598] Input: Task information, instructions to send to AI engine

[1599] Data processing: Analysis of task information, execution of task processing

[1600] Output: Obtaining the task processing results

[1601] Step 5:

[1602] The device captures the user's facial expression data through a camera installed on the device. The device then sends this data to a server, which analyzes it using an emotion recognition engine. The server recognizes the user's emotional state and adjusts the character's responses and behavior accordingly.

[1603] Input: User's facial expression data

[1604] Data processing: Analysis of facial expression data using an emotion recognition engine

[1605] Output: Emotion recognition result

[1606] Step 6:

[1607] The device displays task processing results and emotional support messages on the user interface based on information obtained from the AI ​​engine and emotion recognition engine. The server notifies the user when task processing is complete.

[1608] Input: Task processing results, emotion recognition results

[1609] Data processing: Integrating task processing results and emotion recognition results, generating display messages

[1610] Output: Display of task processing results and supporting messages

[1611] Step 7:

[1612] The user receives notification of task completion and can enter additional instructions or tasks as needed, allowing the system to provide ongoing support to the user.

[1613] Input: Task completion notification, additional instructions and task information

[1614] Data processing: Add instructions and save task information to the database

[1615] Output: Notification of start of additional task processing

[1616] In this way, the various processing steps work together, allowing users to safely and efficiently manage tasks within an autonomous vehicle and receive the support they need.

[1617] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1618] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1619] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1620] [Fourth embodiment]

[1621] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1622] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1623] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1624] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1625] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1626] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1627] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1628] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1629] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1630] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1631] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1632] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1633] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1634] The present invention is a system that efficiently handles the miscellaneous tasks and coordination of a businessman's daily work, and a character selected by the user supports these tasks. The following describes how the program for this system can be implemented and the processing it performs.

[1635] 1. User Registration and Login

[1636] When a user first uses the service, they enter the required information (name, email address, password) into the registration form on their device and press the submit button. The device then sends the entered information to the server, which then stores this information in a database and creates a user account.

[1637] The user enters their ID and password on the login screen and presses the login button. The device sends the authentication information to the server, which then authenticates them. If authentication is successful, the server sends the user's dashboard data to the device, which then displays the dashboard.

[1638] 2. Select a supporter (character)

[1639] The server retrieves the supporter list (character list) from the database and sends it to the terminal. The terminal displays the list to the user, who then selects the desired character. The terminal then sends the character information selected by the user to the server, and the server saves the selection information in the database.

[1640] 3. Enter the task

[1641] The user enters the task title, details, and deadline on the task input screen and presses the send button. The terminal sends the entered task information to the server, which then stores it in a database.

[1642] 4. Task completion by characters

[1643] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine, which then processes the task while imitating the character selected by the user.

[1644] For example, if a user inputs "adjust meeting schedule," the server checks the schedules of the necessary meeting participants and sends instructions to the AI ​​engine to make the adjustments.

[1645] AI will schedule the meeting and send confirmation emails to participants.

[1646] 5. Task Completion and Notifications

[1647] Once the task is completed, the server updates the database and sends a notification of task completion to the device, which displays the notification to the user and provides details about the completed task.

[1648] For example, when the schedule adjustment is completed, the server sends a notification message such as "Schedule adjustment completed."

[1649] Example: Document organization task

[1650] The user inputs the task "organizing documents" and presses the send button.

[1651] The terminal sends the task information to the server, which stores it in a database.

[1652] The server sends the task to the AI ​​engine, and a character selected by the user (e.g., a fictional character) begins organizing the documents.

[1653] The AI ​​engine classifies and organizes documents in real time and sends the results to the server.

[1654] The server stores the information on the completion of document organization in a database and sends a notification to the terminal.

[1655] The terminal notifies the user that "document organization is complete" and displays the detailed results.

[1656] In this way, the system efficiently handles users' miscellaneous tasks and coordination work, allowing them to focus on high-value-added tasks. Flexible support with selectable characters improves the user experience, and the use of artificial intelligence ensures accuracy and efficiency of processing.

[1657] The processing flow will be explained below.

[1658] Step 1: User Registration

[1659] The user opens the registration form on their device, enters their name, email address, and password, and presses the submit button.

[1660] The terminal transmits the input information to the server.

[1661] The server stores the received information in a database and creates a user account.

[1662] The server sends an account creation completion message to the terminal.

[1663] The terminal displays a message to the user indicating that the account has been created.

[1664] Step 2: User Login

[1665] The user opens the login screen on the device, enters their ID (email address) and password, and presses the login button.

[1666] The terminal sends the login information to the server.

[1667] The server compares the information with that in the database and performs authentication processing.

[1668] If the authentication is successful, the server sends an authentication success message and dashboard data to the terminal.

[1669] The terminal displays the user's dashboard.

[1670] Step 3: Select a supporter

[1671] The server retrieves the supporter list from the database and transmits it to the terminal.

[1672] The terminal displays the supporter list to the user.

[1673] The user selects the desired supporter from the list and presses the select button.

[1674] The terminal transmits the selection information to the server.

[1675] The server associates the selected supporter information with the user's account and stores it in a database.

[1676] The server sends a selection completion message to the terminal.

[1677] The terminal displays a selection completion message to the user.

[1678] Step 4: Task Input

[1679] The terminal displays a task input screen to the user.

[1680] The user enters the task title, details, and deadline, and presses the submit button.

[1681] The terminal transmits the input task information to the server.

[1682] The server stores the received task information in a database.

[1683] The server sends a task registration completion message to the terminal.

[1684] The terminal displays a task registration completion message to the user.

[1685] Step 5: Start task processing

[1686] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine.

[1687] The AI ​​engine will begin processing the task while imitating the character of the selected supporter.

[1688] For example, if a user requests a meeting schedule adjustment, the AI ​​engine will check the schedules of the participants and arrange the optimal date.

[1689] Step 6: Task execution

[1690] The AI ​​engine sends confirmation emails to meeting participants.

[1691] The server checks whether the email was sent successfully and stores the result in a database.

[1692] Step 7: Task Completion Notification

[1693] The server updates the database with information about the task completion.

[1694] The server sends a task completion notification to the terminal.

[1695] The terminal displays a task completion notification to the user.

[1696] Step 8: Review task details

[1697] The user checks the task completion notification on the device and opens a screen displaying detailed information.

[1698] The server sends the detailed information to the terminal.

[1699] The terminal displays the detailed results of the task to the user.

[1700] Through this series of steps, users can easily register tasks and have them efficiently handled by the selected supporter. Finally, users can check the progress and completion results of the task. This frees businesspeople from tedious chores and gives them more time to focus on important tasks.

[1701] Example 1

[1702] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1703] In today's business environment, businesspeople are often overwhelmed with numerous miscellaneous tasks and coordination work, resulting in a decline in productivity. There is a need for systems that can efficiently handle these miscellaneous tasks, allowing businesspeople to focus on more value-added work. However, existing systems lack sufficient flexibility in automating tasks and improve the user experience.

[1704] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1705] In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of selectable virtual characters to the user and receiving the user's selection, means for saving the task information entered by the user in a database, means for the virtual character to complete the task based on the saved task information, and means for notifying the user when the task has been completed. This enables the efficient processing of miscellaneous tasks and coordination work for businesspeople, improving the user experience, and ensuring the accuracy and efficiency of processing by using artificial intelligence.

[1706] "User" refers to a person who uses the system, who inputs information into the system, and who receives services provided by the system.

[1707] "Input information" refers to data or information provided by a user to the system, including name, email address, password, etc.

[1708] "User Account" means an account that holds individual identification information for a User to access and use the System.

[1709] A "virtual character" is a digital character that a user can select and use, and has the role of completing the user's tasks.

[1710] "Work information" refers to detailed task information that a user enters into the system, and includes the work title, details, deadline, and so on.

[1711] "Database" refers to the part of a computer system that stores and manages input and activity information.

[1712] A "generative AI model" is an artificial intelligence-based model used to automatically perform tasks while mimicking a virtual character selected by a user.

[1713] "Server" refers to a central computer system that receives information from users, processes it, and provides the necessary data.

[1714] "Notification" refers to messages and alarms that inform the user of the results and progress of task processing.

[1715] The present invention is a system for efficiently handling the miscellaneous tasks and adjustments of a businessman's daily work, and a virtual character selected by the user supports these tasks. A specific embodiment of the program for this system will be described below.

[1716] First, a user accesses the system using a terminal, enters the required information such as name, email address, and password into the registration form, and presses the submit button. The terminal sends this input information to the server, which then stores the received information in a database and creates a user account.

[1717] Next, the user enters their ID (or email address) and password on the login screen and presses the login button. The device sends the authentication information to the server, which then authenticates the user by checking it against the user information stored in the database. If authentication is successful, the server sends the user's dashboard data to the device, and the device displays the dashboard.

[1718] The user then checks the virtual character list on the dashboard and selects their preferred character. The server retrieves the supporter list from the database and sends it to the device. The device displays the list to the user, and the device sends the character information selected by the user to the server. The server saves the selection information in the database.

[1719] The user then enters the task title, details, and deadline on the task input screen and presses the send button. The device sends the entered task information to the server, which stores it in a database. The server retrieves unprocessed task information from the database and sends it to an AI engine that uses a generative AI model. The AI ​​engine processes the task while imitating the behavioral patterns of the character selected by the user.

[1720] For example, if a user enters "arrange a meeting schedule" as a task, the server sends an instruction to the AI ​​engine to check the schedules of the necessary meeting participants. The AI ​​engine accesses the schedule database of meeting participants, adjusts the optimal date, compiles the candidate dates, and sends a confirmation email to the participants. When the task is completed, the server updates the database and sends a task completion notification to the device. The device displays the notification to the user and provides detailed information about the completed task.

[1721] As a concrete example, consider the case where a user inputs the task "organizing documents" and presses the send button. The device sends the task information to the server, which saves it in a database. The server then sends the document organization task to the AI ​​engine, and the virtual character begins organizing the documents. The AI ​​engine classifies and organizes the documents in real time and sends the results to the server. The server saves information about the completion of document organization in the database and sends a notification to the device. The device then notifies the user that "document organization is complete" and displays the detailed results.

[1722] The system efficiently handles users' miscellaneous and coordination tasks, allowing them to focus on higher-value-added tasks. Flexible support from virtual characters improves the user experience, while the use of generative AI models ensures accuracy and efficiency of processing.

[1723] Example prompt sentence:

[1724] "I'd like you to adjust the schedule for a meeting. The participants are A, B, and C. Please arrange the best meeting date and compile a list of possible dates."

[1725] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1726] Step 1: User Registration

[1727] The user enters their name, email address, and password into the registration form via their terminal and presses the submit button. Input: Name, email address, password. Output: User account information is generated.

[1728] The device sends this input information to the server, which then uses a hash function to protect the password and stores it in a database. The specific steps for creating a user account include checking for duplicate email addresses and hashing the password.

[1729] Step 2: Login authentication

[1730] The user enters their ID (or email address) and password on the login screen and presses the login button. Input: ID, password. Output: Authentication results and dashboard data.

[1731] The device sends authentication information to the server, which then authenticates the user by checking the user information stored in a database. If authentication is successful, the server sends the user's dashboard data to the device, which then displays the dashboard. The authentication process includes checking the password against a hash.

[1732] Step 3: Select a Supporter (Character)

[1733] The server retrieves the supporter list from the database and sends it to the terminal. Input: None. Output: Supporter list.

[1734] The terminal displays the supporter list to the user, and the user selects the desired character. Input: User's character selection. Output: Selected character information.

[1735] The terminal sends the character information selected by the user to the server, which then stores the selection information in a database.

[1736] Step 4: Entering the Task

[1737] The user enters the task title, details, and deadline on the task input screen and presses the send button. Input: Task title, details, deadline. Output: Task information.

[1738] The device sends the input task information to the server, which stores the task information in a database. Specifically, the task status is recorded as "unprocessed."

[1739] Step 5: Character Tasks

[1740] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine. Input: Unprocessed task information. Output: Task processing instructions.

[1741] The AI ​​engine processes tasks while imitating the behavioral patterns of the character selected by the user. As a specific example of processing, when scheduling a meeting, the AI ​​engine checks the schedules of the meeting participants and finds the optimal date. Input: User prompt, existing schedule data. Output: Schedule adjustment results.

[1742] Step 6: Task Completion and Notification

[1743] Once the task is completed, the AI ​​engine sends the result to the server, which updates the database with the task completion information. Input: Task completion result. Output: Task status update.

[1744] The server sends a notification of task completion to the terminal. The terminal displays the notification to the user and provides detailed information about the completed task. An example of a prompt sentence is a message displayed to the user such as "Document organization is complete. The classification results are as follows."

[1745] (Application example 1)

[1746] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1747] Currently, the user experience in autonomous vehicles requires users to concentrate on driving, while many miscellaneous tasks must be performed manually. Tasks that must be performed while driving, such as real-time navigation settings, setting reminders, and sending and receiving messages, are particularly burdensome for users. Furthermore, to safely and efficiently handle these tasks, voice input and artificial intelligence are required, but current systems do not adequately address these. Therefore, there is a need for a system that allows users to efficiently handle miscellaneous tasks while still being able to concentrate on driving.

[1748] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1749] In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of selectable characters to the user and receiving the user's selection, means for saving the task information entered by the user in a database, means for the character to complete the task based on the saved task information, means for notifying the user of the completion of task processing, means for the user to input tasks through voice input, and means for providing optimal navigation using the user's location information. This allows a user to efficiently complete various chores through voice input without using their hands while driving. Furthermore, having a character complete tasks increases familiarity and entertainment value, improving driving comfort.

[1750] "User input information" refers to information such as name, email address, and password entered by the user and accepted by the system.

[1751] A "user account" is an individual account that is generated based on information entered by a user and is used for logging in and task management.

[1752] A "character list" is a list of selectable characters that the system displays to the user.

[1753] "Task information" is information including the content, details, and deadline of a task that a user inputs into the system.

[1754] A "database" is a storage device within the system that stores user account information, task information, character information, and so on.

[1755] "Means for a character to process a task" refers to a function in which a character selected by a user executes a task based on task information stored in the system.

[1756] The "means for notifying the user of the completion of task processing" is a function by which the system notifies the user of the completion of the task when it is completed.

[1757] "Voice input" is a method in which a user verbally inputs commands or tasks into a system through a microphone.

[1758] "Location information" is information that indicates the user's current location, and is mainly obtained by a satellite positioning system such as GPS.

[1759] "Navigation" is a function that calculates and guides the optimal route for the user to reach their destination.

[1760] This invention is a system that allows users to efficiently complete tasks in an autonomous vehicle through voice input and characters. This system automatically handles miscellaneous tasks while the user is driving, providing an environment in which the user can concentrate on driving.

[1761] 1. User Registration and Login

[1762] When using the device for the first time, the user enters information such as name, email address, and password on the screen of the vehicle's entertainment system and presses the send button. The device then sends the information to the server, which stores it in a database and creates a user account. When logging in, the device sends the user's ID and password to the server, which then performs authentication. If authentication is successful, the server sends the user's dashboard data to the device, which then displays the dashboard.

[1763] 2. Character Selection

[1764] The server retrieves a character list from the database and sends it to the terminal. The terminal displays the list to the user, who then selects the desired character. The terminal then sends the character information selected by the user to the server, which then stores the selection information in the database.

[1765] 3. Enter the task

[1766] Users input tasks through the vehicle's voice input system, such as navigation settings, reminder settings, and message sending. The device uses voice recognition to convert the input into text and send the task information to the server, which stores the task information in a database and updates the user's task list.

[1767] 4. Task completion by characters

[1768] The server retrieves unprocessed task information from the database and sends it to a generative AI model (e.g., GPT-4) installed in the vehicle. The AI ​​engine then processes the task while imitating the character selected by the user, such as setting a navigation route, sending messages, or setting reminders.

[1769] 5. Task Completion and Notifications

[1770] Once the task is completed, the server updates the database and sends a task completion notification to the vehicle's terminal, which notifies the user by display and voice and displays detailed results.

[1771] Hardware and software used

[1772] Hardware:

[1773] Entertainment systems (displays) for autonomous vehicles

[1774] Voice recognition device

[1775] Internet connection function

[1776] Vehicle-mounted AI engines (e.g., systems equipped with GPT-4)

[1777] software:

[1778] Server-side database software (e.g., MySQL)

[1779] User authentication system (e.g. OAuth)

[1780] Speech recognition systems (e.g., Google Cloud Speech-to-Text)

[1781] AI engine (e.g. GPT-4)

[1782] Examples of concrete examples and prompts

[1783] For example, if a user issues a voice command such as "Tell me the best route to my next meeting," the vehicle's AI engine will calculate the current location and destination and set the optimal route. This will take into account traffic congestion and other traffic conditions in real time and be reflected in the navigation system. Furthermore, if the user instructs, "Set a reminder. Notify me when I arrive at my destination," the reminder will be set appropriately.

[1784] Example prompt sentence:

[1785] "What's the best route to my next meeting?"

[1786] "Set a reminder. Notify me when I reach my destination."

[1787] "Send me a message. Let me know the meeting is ready."

[1788] In this way, the system provides an environment in which the user can efficiently complete tasks while driving, improving driving safety and comfort.

[1789] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1790] Step 1:

[1791] The user enters information such as name, email address, and password through the screen of the entertainment system in the vehicle and presses the send button.

[1792] Input: Name, email address, password

[1793] Data processing: The terminal sends the input information in text format to the server.

[1794] Output: The server saves the user information to a database and creates a user account.

[1795] Step 2:

[1796] The user enters their ID and password on the vehicle's entertainment system screen and presses the login button. The device then sends the authentication information to the server, which then performs the authentication.

[1797] Input: User ID, Password

[1798] Data processing: The server checks the authentication information against a database and performs authentication.

[1799] Output: If authentication is successful, the server sends the user's dashboard data to the device, and the device displays the dashboard.

[1800] Step 3:

[1801] The server retrieves the character list from the database and sends it to the terminal. The user can then check the list on the vehicle's screen and select the desired character.

[1802] Input: User character selection

[1803] Data processing: The device sends the selected character information to the server, which stores the selected information in the database.

[1804] Output: The information of the selected character is saved in the database.

[1805] Step 4:

[1806] The user uses the vehicle's voice input system to input a task, such as "What is the best route to my next meeting?"

[1807] Input: Voice command

[1808] Data processing: The device's voice recognition device converts the voice into text data and sends it to the server as task information.

[1809] Output: The server saves the task information to the database and updates the user's task list.

[1810] Step 5:

[1811] The server retrieves raw task information from the database and sends it to a generative AI model (e.g., GPT-4) installed in the vehicle.

[1812] Input: Open task information

[1813] Data processing: The AI ​​engine processes tasks while imitating the character selected by the user.

[1814] Output: For example, setting a navigation route, sending a message, setting a reminder, etc.

[1815] Step 6:

[1816] Once the task is completed, the server updates the database and sends a notification of task completion to the vehicle's terminal.

[1817] Input: Task completion information

[1818] Data processing: The server updates the database and records the completion status.

[1819] Output: The device notifies the user of task completion via display and audio, and displays detailed results.

[1820] This program process allows users to efficiently perform various tasks hands-free while driving, with seamless input and output interactions at each step, enhancing the driving experience.

[1821] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1822] The present invention is a system that accepts user input information to create a user account, displays a list of selectable characters to receive the user's selection, saves the task information entered by the user in a database, and has the character complete tasks based on the saved task information. Furthermore, the present invention is equipped with a function that combines an emotion engine to recognize the user's emotions and adjust the character's responses and actions according to those emotions.

[1823] An embodiment of this system will be specifically described below.

[1824] 1. User Registration and Login

[1825] When a user first uses the service, they open the registration form on their device, enter their name, email address, and password, and press the submit button. The device then sends the information to the server, which automatically saves it in a database and creates a user account.

[1826] When a user enters their ID (email address) and password on the login screen and presses the login button, the device sends the authentication information to the server. The server performs authentication by comparing it with information in the database, and if successful, sends dashboard data to the device. The device then displays the user's dashboard.

[1827] 2. Supporter Selection

[1828] The server retrieves a pre-prepared supporter list (character list) from the database and sends it to the terminal, which then displays the supporter list to the user.

[1829] The user selects their favorite character and presses the select button. The device sends the selection information to the server. The server associates the selected supporter information with the user's account and saves it in a database. The server then sends a selection completion message to the device, which displays it to the user.

[1830] 3. Enter the task

[1831] The terminal displays a task input screen to the user, who then enters the task title, details, deadline, etc. and presses the send button.

[1832] The terminal sends the entered task information to the server. The server stores the received task information in a database. The server then sends a task registration completion message to the terminal, which the terminal displays to the user.

[1833] 4. Task Processing

[1834] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine, which then begins processing the task while imitating the selected character.

[1835] For example, if a user inputs "adjust meeting schedule," the server issues instructions to the AI ​​engine, and the AI ​​adjusts the schedules of the participants.

[1836] The AI ​​engine executes tasks according to the work content and reports to the server when the processing is complete. The server stores the processing results in a database and sends a notification to the user, who then displays it on the device.

[1837] 5. Emotion Engine

[1838] The system is equipped with an emotion engine that recognizes emotions from the user's facial expressions, voice, text, etc. For example, when a user accesses the system through a camera, the device sends the user's facial expression data to the server, which then analyzes it using the emotion engine to recognize the user's emotion.

[1839] The recognized emotion information is transmitted to the AI ​​engine via the server, and the character's responses and actions are adjusted to match the user's emotions. For example, if the user shows a tired expression, the character will display a supportive message such as "You should take a break."

[1840] Example: Document organization task

[1841] The user enters "organizing documents" as a task and presses the send button.

[1842] The terminal sends task information to the server, which stores it in a database.

[1843] The server sends task information to the AI ​​engine, and the selected character begins organizing the documents.

[1844] The AI ​​engine classifies and organizes documents in real time and sends the results to the server.

[1845] The server updates the database with the information about the completion of the document organization and sends a notification to the terminal. The terminal notifies the user that "document organization is complete" and displays the detailed results.

[1846] In this way, this system efficiently handles the user's miscellaneous tasks and coordination work, grasps the user's emotions using an emotion engine, and provides support accordingly, providing an environment in which business people can concentrate on more important tasks.

[1847] The processing flow will be explained below.

[1848] Step 1: User Registration

[1849] The user opens the registration form on their device, enters their name, email address, and password, and presses the submit button.

[1850] The terminal transmits the input information to the server.

[1851] The server stores the received information in a database and creates a user account.

[1852] The server sends an account creation completion message to the terminal.

[1853] The terminal displays a message to the user indicating that the account has been created.

[1854] Step 2: User Login

[1855] The user opens the login screen on the device, enters their ID (email address) and password, and presses the login button.

[1856] The terminal sends the login information to the server.

[1857] The server compares the information with that in the database and performs authentication processing.

[1858] If the authentication is successful, the server sends an authentication success message and dashboard data to the terminal.

[1859] The terminal displays the user's dashboard.

[1860] Step 3: Select a supporter

[1861] The server retrieves a pre-prepared supporter list from the database and sends it to the terminal.

[1862] The terminal displays the supporter list to the user.

[1863] The user selects a preferred supporter from the list and presses the select button.

[1864] The terminal transmits the selection information to the server.

[1865] The server associates the selected supporter information with the user's account and stores it in a database.

[1866] The server sends a selection completion message to the terminal.

[1867] The terminal displays a selection completion message to the user.

[1868] Step 4: Task Input

[1869] The terminal displays a task input screen to the user.

[1870] The user enters the task title, details, and deadline, and presses the submit button.

[1871] The terminal transmits the input task information to the server.

[1872] The server stores the received task information in a database.

[1873] The server sends a task registration completion message to the terminal.

[1874] The terminal displays a task registration completion message to the user.

[1875] Step 5: Emotion Recognition

[1876] The camera captures the user's facial expressions while using the system.

[1877] The terminal transmits the user's facial expression data to the server.

[1878] The server uses an emotion engine to analyze the facial expression data and recognize the user's emotion.

[1879] The server sends the recognized emotional information to the AI ​​engine.

[1880] Step 6: Start task processing

[1881] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine.

[1882] The AI ​​engine will begin processing the task while imitating the character of the selected supporter.

[1883] For example, if a user requests a meeting schedule adjustment, the AI ​​engine will check the schedules of the participants and arrange the optimal date.

[1884] Step 7: Task execution

[1885] The AI ​​engine sends confirmation emails to meeting participants.

[1886] The server checks whether the email was sent successfully and stores the result in a database.

[1887] Step 8: Task Completion Notification

[1888] The server updates the database with information about the task completion.

[1889] The server sends a task completion notification to the terminal.

[1890] The terminal displays a task completion notification to the user.

[1891] Step 9: Review task details

[1892] The user checks the task completion notification on the device and opens a screen displaying detailed information.

[1893] The server sends the detailed information to the terminal.

[1894] The terminal displays the detailed results of the task to the user.

[1895] Step 10: Emotion-Based Responding

[1896] The server adjusts the AI ​​engine's character responses based on the recognized user's emotional information.

[1897] If the user looks tired, a character will display a supportive message such as "You should take a break."

[1898] Through this series of steps, users can easily register tasks and have them efficiently handled by the selected supporter. The system also recognizes the user's emotions and adjusts responses accordingly, allowing users to receive more personalized support. This frees users from mundane tasks and allows them to focus on important tasks.

[1899] Example 2

[1900] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1901] Current task management systems cannot take into account the user's emotions and state, which can cause stress for the user. Furthermore, users must manually input and manage tasks, which is time-consuming. Furthermore, even in task management systems using characters, the characters' responses and actions are uniform, making it difficult to individually optimize the user experience. There is a need to solve these issues and provide a more convenient and personalized task management system.

[1902] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1903] In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of selectable characters to the user and accepting the user's selection, means for saving the task information entered by the user in a database, means for the character to complete the task based on the saved task information, means for notifying the user that the task has been completed, and means for recognizing the user's emotions and adjusting the character's responses and actions in response to the emotions. This allows the user to not only efficiently manage tasks but also receive support in accordance with their own emotions and state.

[1904] "User input information" refers to information such as name, email address, and password that a user inputs into the system.

[1905] The "means for generating a user account" is a function that creates an account associated with a user based on information input by the user and stores the account in a database.

[1906] The "character list" is a list of multiple characters prepared in advance by the system, and is displayed to the user to allow them to select one.

[1907] "Task information" refers to information to be managed, such as the title, details, and deadline of a task, which is entered into the system by the user.

[1908] A "database" is a storage device for centrally storing data managed by the system, such as user account information and task information.

[1909] "The means by which the character completes the task" refers to the algorithm or AI engine that the character utilizes to complete the assigned task.

[1910] The "means for notifying the user of the completion of task processing" is a function for notifying the user of the completion information when the character completes a task.

[1911] "Means for recognizing emotions" refers to a function that analyzes data such as the user's facial expressions, voice, and text, and estimates the user's emotions.

[1912] The "means for adjusting the character's response and behavior according to the emotion" is a function for changing the character's expression and behavior based on the user's recognized emotional information.

[1913] "Means of utilizing artificial intelligence" refers to a function that uses AI technology to allow characters to automatically complete tasks.

[1914] The "means for displaying the details of the processing results" is a display function for specifically informing the user of the content and results of the task processing.

[1915] The present invention is a system that accepts user input information to create a user account, displays a list of selectable characters to receive the user's selection, saves the task information entered by the user in a database, and has the character complete tasks based on the saved task information. Furthermore, the present invention is equipped with a function that combines an emotion engine to recognize the user's emotions and adjust the character's responses and actions according to those emotions.

[1916] User Registration and Login

[1917] When using the service for the first time, the user opens the registration form on the device, enters their name, email address, and password, and presses the send button. The device sends this input information to the server. The server saves the input information in a database and creates a user account. When using the service next time, the user enters their ID (email address) and password on the login screen and presses the login button, and the device sends the authentication information to the server. The server compares the information with the information in the database and performs authentication processing, and if successful, sends dashboard data to the device. The device then displays the user's dashboard.

[1918] Supporter Selection

[1919] The server retrieves a prepared supporter list (character list) from the database and sends it to the terminal. The terminal displays this list to the user. The user selects their preferred character and presses the select button. The terminal sends this selection information to the server. The server associates the selected supporter information with the user's account, saves it in the database, and sends a selection completion message to the terminal. The terminal displays this to the user.

[1920] Task Input

[1921] The terminal displays the task input screen to the user. The user enters the task title, details, deadline, etc., and presses the send button. The terminal sends the entered task information to the server. The server stores the received task information in a database. The server sends a task registration completion message to the terminal, which the terminal displays to the user.

[1922] Task Processing

[1923] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine. The AI ​​engine begins processing the task while imitating the selected character. For example, if a user inputs the task "arrange meeting schedules," the server issues instructions to the AI ​​engine, and the AI ​​arranges the schedules of the participants. The AI ​​engine executes the task according to the work content and reports to the server when processing is complete. The server saves the processing results in the database and sends a notification to the user. The device displays this to the user.

[1924] Emotion Engine

[1925] The system is equipped with an emotion engine that recognizes emotions from the user's facial expressions, voice, text, etc. For example, when a user accesses the system through a camera, the device sends the user's facial expression data to the server. The server then analyzes this using the emotion engine to recognize the user's emotion. The recognized emotion information is transmitted to the AI ​​engine via the server, and the character is adjusted to respond and act in accordance with the user's emotion. For example, if the user shows a tired expression, the character will display a supportive message such as "It would be better to take a break."

[1926] Example: Document organization task

[1927] The user enters "organizing documents" as a task and presses the send button. The device sends the task information to the server, which saves it in a database. The server then sends the task information to the AI ​​engine, and the selected character begins organizing the documents. The AI ​​engine classifies and organizes the documents in real time and sends the results to the server. The server updates the database with information about the completion of document organization and sends a notification to the device. The device notifies the user that "document organization is complete" and displays the detailed results. This not only enables the user to efficiently handle miscellaneous tasks and coordination work, but also allows the emotion engine to provide support tailored to their emotions.

[1928] Example prompts for generative AI models

[1929] The user inputs "organizing documents" as a task, and the selected character simulates the process of sorting and organizing documents in real time.

[1930] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1931] Step 1:

[1932] The user opens the registration form on the terminal, enters their name, email address, and password, and presses the submit button.

[1933] Input: Name, email address, and password entered by the user

[1934] Output: User registration information sent from the device to the server

[1935] What happens: A user fills in a form and clicks the submit button.

[1936] Step 2:

[1937] The terminal transmits the input information to the server.

[1938] Input: User registration information

[1939] Output: HTTP POST request sent to the server

[1940] Specific operation: The device sends user information to the server via the Internet.

[1941] Step 3:

[1942] The server stores the entered information in a database and creates a user account.

[1943] Input: User registration information received by the server

[1944] Output: User information stored in the database and the new user account.

[1945] Specific operation: The server executes an SQL query on the database and saves the user information.

[1946] Step 4:

[1947] The server sends a message to the terminal to notify it that the input information has been successfully saved.

[1948] Input: Information that has been saved to the database

[1949] Output: Registration completion message to the device

[1950] Specific operation: The server creates an HTTP response and sends it to the terminal.

[1951] Step 5:

[1952] The terminal receives the message and displays a notification to the user that registration is complete.

[1953] Input: Registration completion message from the server

[1954] Output: Registration completion notification displayed in the user interface

[1955] Specific operation: The device analyzes the response message and the browser displays a notification.

[1956] Step 6:

[1957] User enters ID (email address) and password on the login screen and clicks login button.

[1958] Input: User ID (email address) and password

[1959] Output: Login request sent from the terminal to the server

[1960] What happens: The user fills in the login form and clicks the submit button.

[1961] Step 7:

[1962] The terminal transmits the authentication information to the server.

[1963] Input: Login information (email address and password)

[1964] Output: HTTP POST request to the server

[1965] Specific operation: The device sends login information to the server.

[1966] Step 8:

[1967] The server performs authentication by comparing the information with that in the database.

[1968] Input: Login information sent to the server

[1969] Output: Authentication result (success or failure)

[1970] What happens: The server runs an SQL query against the database to match the submitted information with existing information.

[1971] Step 9:

[1972] If the authentication is successful, the server transmits the dashboard data to the terminal.

[1973] Input: Authentication success information

[1974] Output: Dashboard data to terminal

[1975] Specific operation: The server returns user-specific dashboard data in an HTTP response.

[1976] Step 10:

[1977] The device receives the data and displays the user's dashboard.

[1978] Input: Dashboard data from the server

[1979] Output: A dashboard displayed in the user interface

[1980] Specific operation: The terminal analyzes the response data and generates and displays the dashboard screen.

[1981] Step 11:

[1982] The server retrieves a pre-prepared supporter list (character list) from the database and sends it to the terminal.

[1983] Input: Query to get supporter list from database

[1984] Output: Supporter list data to the terminal

[1985] Specific operation: The server executes the SQL query, retrieves the list data, and returns it in the HTTP response.

[1986] Step 12:

[1987] The terminal displays the list to the user.

[1988] Input: Supporter list data

[1989] Output: A list of supporters displayed in the user interface

[1990] Specific behavior: Renders list data in the user interface.

[1991] Step 13:

[1992] The user selects a desired character and presses the select button.

[1993] Input: User's character selection information

[1994] Output: Character selection request from device to server

[1995] Specific behavior: The user selects a character and clicks a button.

[1996] Step 14:

[1997] The terminal transmits the selection information to the server.

[1998] Input: Character selection information

[1999] Output: HTTP POST request to the server

[2000] Specific operation: The terminal transmits the selection information to the server.

[2001] Step 15:

[2002] The server associates the selected supporter information with the user's account and stores it in a database.

[2003] Input: Character selection information

[2004] Output: Character information stored in the database

[2005] Specific operation: The server executes the SQL query and saves the selected character to the user information.

[2006] Step 16:

[2007] The server sends a selection completion message to the terminal.

[2008] Input: Information saved to the database

[2009] Output: Selection complete message to terminal

[2010] Specific operation: The server returns a selection completion message in the HTTP response.

[2011] Step 17:

[2012] The terminal receives the message and displays it to the user.

[2013] Input: Selection completion message from the server

[2014] Output: Selection completion notification displayed in the user interface

[2015] Specific operation: The device analyzes the response data and displays a notification on the user interface.

[2016] Step 18:

[2017] The terminal displays a task input screen to the user.

[2018] input:--

[2019] Output: Task entry screen displayed in the user interface

[2020] Specific behavior: Renders and displays the task input form.

[2021] Step 19:

[2022] The user enters the task title, details, deadline, etc., and presses the send button.

[2023] Input: Task title, details, due date

[2024] Output: Task input information from the terminal to the server

[2025] Specific behavior: The user enters task information and clicks the submit button.

[2026] Step 20:

[2027] The terminal transmits the task information to the server.

[2028] Input: Task input information

[2029] Output: HTTP POST request to the server

[2030] Specific operation: Form data is sent to the server via HTTP POST.

[2031] Step 21:

[2032] The server stores the received task information in a database.

[2033] Input: Task input information

[2034] Output: Task information stored in the database

[2035] Specific operation: The server executes an SQL query and saves the task information to the database.

[2036] Step 22:

[2037] The server sends a task registration completion message to the terminal.

[2038] Input: Task save completion information to database

[2039] Output: Task registration completion message to the terminal

[2040] Specific operation: A registration completion message is returned as an HTTP response.

[2041] Step 23:

[2042] The terminal receives the message and displays it to the user.

[2043] Input: Task registration completion message from the server

[2044] Output: Task registration completion notification displayed in the user interface

[2045] Specific operation: A task registration completion message is displayed on the user interface.

[2046] Step 24:

[2047] The server retrieves unprocessed task information from the database and sends it to the AI ​​engine.

[2048] Input: Open task information from the database

[2049] Output: Task information to the AI ​​engine

[2050] What happens: The server executes the SQL query, retrieves the outstanding tasks, and sends the data to the API endpoint.

[2051] Step 25:

[2052] The AI ​​engine will begin processing the task while imitating the selected character.

[2053] Input: Task information sent to the AI ​​engine

[2054] Output: Task processing results

[2055] Specific operation: The AI ​​model starts processing based on the task information, for example, "arranging a meeting schedule."

[2056] Step 26:

[2057] The AI ​​engine executes tasks according to the work content and reports to the server once the processing is complete.

[2058] input:--

[2059] Output: Task processing completion information to the server

[2060] Specific operation: The results of the task execution are sent to the server.

[2061] Step 27:

[2062] The server stores the processing results in a database and sends a notification to the user.

[2063] Input: Task processing completion information

[2064] Output: A message to inform the user

[2065] What happens: The server executes the SQL query, stores the results in a database, and sends a notification as an HTTP response.

[2066] Step 28:

[2067] The terminal displays the processing results to the user.

[2068] Input: Processing result notification from the server

[2069] Output: Processing result notification displayed in the user interface

[2070] Specific behavior: Display a process completion notification in the user interface.

[2071] Step 29:

[2072] The system is equipped with an emotion engine that recognizes emotions from the user's facial expressions, voice, text, etc.

[2073] Input: User's facial expression data, voice data, text data

[2074] Output: Recognized user emotion information

[2075] Specific operation: The emotion engine analyzes facial expression data and voice data to generate emotion information.

[2076] Step 30:

[2077] The server analyzes this using an emotion engine and recognizes the user's emotion.

[2078] Input: Data submitted by the user

[2079] Output: Parsed emotion information

[2080] Specific operation: The server analyzes the data and determines the emotion.

[2081] Step 31:

[2082] The recognized emotional information is transmitted to the AI ​​engine.

[2083] Input: Parsed emotion information

[2084] Output: Emotion data to the AI ​​engine

[2085] Specific operation: Emotional information is sent to the AI ​​engine to generate an appropriate response.

[2086] Step 32:

[2087] The AI ​​engine adjusts the character's responses and actions to reflect the user's emotions.

[2088] Input: Emotion information

[2089] Output: Emotion-based responses and actions

[2090] Specific behavior: The character displays messages and actions according to the user's emotions.

[2091] The above are the specific processing steps of this system, which allows users to manage tasks efficiently and personalizedly.

[2092] (Application example 2)

[2093] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2094] While most conventional task management systems simply store and process tasks entered by users in a database, it is difficult to provide flexible support that responds to the user's emotional state. Furthermore, in autonomous vehicles, it is dangerous for users to enter tasks while driving, so a solution was needed.

[2095] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting user input information and creating a user account, means for displaying a list of characters selectable by the user and receiving the user's selection, means for saving task information entered by the user in a database, means for the character to complete a task based on the saved task information, means for recognizing the user's emotions and adjusting the character's responses and actions in accordance with the emotions, means for displaying the task processing results and emotion-based support messages on the user interface of the autonomously driven vehicle, and means for notifying the user of the completion of task processing. This makes it possible to safely input and process tasks even while the autonomously driven vehicle is traveling, and further makes it possible to provide flexible support in accordance with the user's emotional state.

[2096] The "means for accepting user input information and generating a user account" is a function for sending information provided by the user through an input form to the system and creating an individual account for the user based on this information.

[2097] "Means for displaying a list of selectable characters and receiving a user's selection" is a function that allows the system to display a pre-prepared character list on the user interface, allowing the user to select a character of their choice.

[2098] The "means for saving task information entered by the user in a database" is a function for collecting task information specified by the user and safely saving it in a database.

[2099] "Means for a character to process a task based on stored task information" is a function that reads task information stored in a database and allows a selected character to perform an actual task based on that information.

[2100] "Means for recognizing the user's emotions and adjusting the character's response and behavior in accordance with those emotions" refers to a function that analyzes the user's emotions from their facial expressions and voice, and changes the character's dialogue and behavior based on the results.

[2101] "Means for displaying support messages based on task processing results and emotions on the user interface of an autonomous vehicle" refers to a function that uses the display and speakers of an autonomous vehicle to display messages based on task processing results and the user's emotional state.

[2102] The "means for notifying the user of the completion of task processing" is a function that sends a notification or an alert to inform the user that the task has been completed.

[2103] This invention is a system that allows users to manage and instruct tasks in an autonomous vehicle and provides optimal support based on emotion recognition. Next, we will explain how to implement this system.

[2104] In this system, a user account is created by providing input information through the in-car smart display or voice recognition function. The user enters their name, email address, and password into a registration form, which is then sent to the server.

[2105] Next, the user is presented with a list of supporting characters and selects the character they wish to play. The selection information is sent to the server and stored in a database. The user can input tasks, such as setting a destination, and provide task information, which is then stored in the database.

[2106] The system uses the character to complete tasks based on the saved task information. The character uses an AI engine to search for map information and adjust navigation, for example, for a destination setting task. Once the task is completed, the system notifies the user.

[2107] Furthermore, the system uses in-car cameras and voice recognition technology to recognize the user's emotions. For example, if the system recognizes that the user is tired, a character will display a support message such as "It's a good idea to take a break." This allows the user to perform tasks with peace of mind while driving an autonomous vehicle, and provides support that also takes safety into consideration.

[2108] The system uses various hardware and software for its specific processing. For example, cameras and smart displays are installed in the vehicle, and voice recognition software and emotion recognition engines (such as EmotionRecognizer) are also used. User information and task information are stored in a database, and the AI ​​engine processes tasks using generative AI models from Google Cloud AI or Amazon SageMaker.

[2109] For example, if a user says, "Set my destination to Tokyo Station," task information will be displayed on the smart display and the system will store that information in a database. The AI ​​engine will adjust navigation based on map information and complete the task. At the same time, an appropriate support message will be displayed based on the user's facial expression data captured by the camera.

[2110] Example prompt sentence:

[2111] "Based on the following information, please design a system that processes tasks while the user is driving and displays support messages according to the user's emotional state. User information: name, email address, password. Input tasks: setting destination, task management. Emotion recognition: analyzing facial expression data from the camera. Response according to emotional state: recommending a break if the user is tired."

[2112] In this way, the system combines user task management and emotion recognition to impr...

Claims

1. means for accepting user input information and generating a user account; means for displaying a list of selectable characters to a user and receiving a selection from the user; a means for storing the task information entered by the user in a database; Based on the saved task information, the character will be able to complete the task. means for notifying a user of the completion of task processing; A system including:

2. 10. The system of claim 1, further comprising means for the character to utilize artificial intelligence to complete the task.

3. 10. The system of claim 1, further comprising means for displaying details of the processing results to the user.

Images