System

Abstract

A system is provided.SOLUTION: A system comprising: an input unit configured to allow a user to input a customization option; a generation unit configured to generate a character based on the customization option; a control unit configured to control an operation of the generated character; a schedule management unit configured to allow the character to manage a schedule of the user; a notification unit configured to allow the character to notify the user of a reminder; and a message generation unit configured to allow the character to generate a reward or encouragement message when the user completes a task.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, daily schedule and task management can be monotonous, making it difficult to maintain motivation. Existing schedule management tools and reminder apps lack visual appeal and fail to sustain user interest. Furthermore, it is currently difficult to provide a feature that allows users to create characters with various customization options tailored to their preferences. This invention aims to provide users with a fun experience, streamline daily task management, and increase motivation. [Means for solving the problem]

[0005] The present invention provides a system including an input means for a user to input customization options, a generation means for generating a character based on the customization options, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, and a message generation means for the character to generate messages of praise or encouragement when the user completes a task. The system further includes an exchange / sales means for a user to exchange or sell the generated character with other users, promoting interaction between users and providing greater enjoyment. Furthermore, the generation means generates the character using a generative AI model, thereby enabling the creation of an ideal character tailored to the user's preferences with high accuracy.

[0006] "Input means" refers to the interface and its functions for users to input customization options and settings.

[0007] "Generation means" refers to the AI ​​model and process for generating a character based on a user's customization options.

[0008] "Control means" refers to the function for managing the actions of the generated character and displaying and operating it on the terminal.

[0009] "Schedule management means" refers to a function that manages the user's schedule and issues reminders and notifications based on that schedule.

[0010] "Notification means" refers to a function for notifying the user of information related to an event or task, such as a reminder or a task completion notification.

[0011] The "message generation means" refers to a function for generating a message that praises or encourages the user when the task is completed.

[0012] "Exchange and sales means" refers to the function that allows users to exchange or sell characters they have created with other users.

[0013] "Generative AI Model" refers to an artificial intelligence model for generating characters based on user customization options. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] The present invention is a system in which a user creates a character customized based on their preferences, and the character manages the user's daily tasks. The present invention operates in cooperation with the user, a terminal, and a server.

[0036] Overall system configuration

[0037] The system of the present invention includes an input means for a user to input customization options, a generation means for generating a character based on the customization options, a control means for controlling the behavior of the generated character, a schedule management means for managing the user's schedule and notifying them of reminders, a message generation means for generating messages of praise or encouragement upon completion of a task, and an exchange / sale means for exchanging or selling characters with other users.

[0038] Specific program operation explanation

[0039] Character Generation

[0040] User

[0041] 1. Launch the app.

[0042] 2. Go to the customization options screen and enter your gender, hair color, body type, clothing, etc.

[0043] 3. Press the "Generate" button.

[0044] Terminal

[0045] 1. Sends the customization options entered by the user to the server.

[0046] server

[0047] 1. Use a generative AI model to generate a character based on customization options.

[0048] 2. The generated character data is sent back to the device.

[0049] Terminal

[0050] 1. Draw the received character data and display it on the user's screen.

[0051] Character movement control

[0052] Terminal

[0053] 1. Execute the character's movement script and make it move on the screen in real time.

[0054] 2. The character talks to the user and walks around the screen.

[0055] Scheduling and Reminders

[0056] User

[0057] 1. Add a new task or event.

[0058] 2. Set the reminder time and date.

[0059] Terminal

[0060] 1. Sends tasks and events set by the user to the server.

[0061] server

[0062] 1. Store task and event information in a database.

[0063] 2. Send notifications at the set reminder time.

[0064] Terminal

[0065] 1. When the specified time arrives, the user will receive a reminder notification and a character will display the details of the reminder on the screen. The character will notify the user, "Mr. / Ms. XX, you have a meeting in 15 minutes."

[0066] Generate messages of praise and encouragement

[0067] User

[0068] 1. Enter the completion of the task in the app and press the Complete button.

[0069] Terminal

[0070] 1. Send task completion information to the server.

[0071] server

[0072] 1. Receive task completion information and generate messages of praise and encouragement.

[0073] 2. Send the generated message back to the terminal.

[0074] Terminal

[0075] 1. The character displays the received message. For example, the character tells the user, "As expected! Thank you for your hard work."

[0076] Character exchange and sales

[0077] User

[0078] 1. Go to the character exchange / sales screen.

[0079] 2. Check the character lists published by other users.

[0080] 3. Choose your favorite character and send an exchange or purchase request.

[0081] Terminal

[0082] 1. Send a request from the user to the server.

[0083] server

[0084] 1. Receive the request and update the character information.

[0085] 2. Verify character ownership and send update information back to your device.

[0086] Terminal

[0087] 1. Display updated character information and notify the user.

[0088] Specific examples

[0089] For example, if user A sets an alarm for 7:00 a.m. and then checks his / her schedule for the day, the system operates as follows:

[0090] User A launches the app, enters "Set alarm for 7:00" and saves it.

[0091] The terminal transmits the alarm information to the server.

[0092] The server saves the alarm settings and notifies the device at the specified time.

[0093] At the set time, the device will receive a notification and the character will say, "Good morning, today's schedule is..."

[0094] User A checks the calendar and a character reads out today's schedule.

[0095] In this way, users can enjoy managing their daily tasks through the characters.

[0096] The processing flow will be explained below.

[0097] Specific processing steps of the program

[0098] Character Generation

[0099] Step 1:

[0100] The user launches the app and navigates to the customization options screen.

[0101] Step 2:

[0102] The user enters customization options such as gender, hair color, body type, and clothing, and presses the "Generate" button.

[0103] Step 3:

[0104] The terminal transmits the customization options entered by the user to the server.

[0105] Step 4:

[0106] The server passes the received customization options to the generative AI model.

[0107] Step 5:

[0108] The server uses a generative AI model to generate a character based on customization options.

[0109] Step 6:

[0110] The server returns the generated character data (images and animations) to the device.

[0111] Step 7:

[0112] The terminal analyzes the received character data and displays it on the user's screen.

[0113] Character movement control

[0114] Step 1:

[0115] The device loads and executes the character's movement script.

[0116] Step 2:

[0117] The device depicts the character's movements on the screen in real time.

[0118] Step 3:

[0119] The device causes the character to talk to the user and walk around the screen.

[0120] Scheduling and Reminders

[0121] Step 1:

[0122] A user adds a new task or event within the app.

[0123] Step 2:

[0124] The user sets the reminder time and date.

[0125] Step 3:

[0126] The terminal transmits the task and event information entered by the user to the server.

[0127] Step 4:

[0128] The server stores task and event information in a database.

[0129] Step 5:

[0130] Schedule the server to send notifications at set reminder times.

[0131] Step 6:

[0132] The server sends a reminder notification to the device at the specified time.

[0133] Step 7:

[0134] The device will receive a reminder notification and a character will display the reminder details on the screen.

[0135] Step 8:

[0136] The character will notify the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[0137] Generate messages of praise and encouragement

[0138] Step 1:

[0139] The user enters that the task has been completed within the app and presses the Complete button.

[0140] Step 2:

[0141] The terminal sends task completion information to the server.

[0142] Step 3:

[0143] The server receives the task completion information and generates a message of praise or encouragement.

[0144] Step 4:

[0145] The server sends the generated message back to the terminal.

[0146] Step 5:

[0147] The message received by the device is displayed on the character.

[0148] Step 6:

[0149] The character tells the user, "As expected! Thank you for your hard work."

[0150] Character exchange and sales

[0151] Step 1:

[0152] The user will be taken to the character exchange / sales screen.

[0153] Step 2:

[0154] The terminal sends a request to the server to display a list of characters that other users have made public.

[0155] Step 3:

[0156] The server returns the character list data to the device.

[0157] Step 4:

[0158] The terminal displays a list of characters to the user.

[0159] Step 5:

[0160] Users can choose their favorite character and send an exchange or purchase request.

[0161] Step 6:

[0162] The terminal sends a request from the user to the server.

[0163] Step 7:

[0164] The server receives the request and updates the character's ownership.

[0165] Step 8:

[0166] The server returns the updated character information to the terminal.

[0167] Step 9:

[0168] The terminal notifies the user of the updated character information.

[0169] Example 1

[0170] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0171] In today's world, users need to manage many daily tasks and schedules, but traditional schedule management tools and reminder functions lack the motivation to actively continue using them. While systems exist that allow users to enjoyably manage tasks through customizable characters, they lack sufficient functionality for character behavior and the ability to exchange and sell characters between users. Furthermore, there is a need for a system that automatically generates appropriate messages of praise and encouragement tailored to individual needs when users complete tasks.

[0172] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0173] In this invention, the server includes input means for a user to input customization options, generation means for generating a character based on the customization options, control means for controlling the behavior of the generated character, schedule management means for managing the user's schedule, notification means for notifying the user of reminders, message generation means for generating messages of praise or encouragement upon task completion, exchange / sale means for exchanging / selling the generated character with other users, and action script execution means for executing the character's action script in real time. This allows users to enjoy task management through customizable characters, effectively receive notifications of reminders and praise, and further enjoy interaction with other users by exchanging and selling characters.

[0174] An "input means" is a means by which a user inputs customization options.

[0175] "Generation means" means for generating a character based on customization options.

[0176] "Control means" refers to means for controlling the actions of the generated character.

[0177] The "schedule management means" is a means by which a character manages a user's schedule.

[0178] The "notification means" is a means by which a character notifies a user of a reminder.

[0179] The "message generating means" is a means for a character to generate a message of praise or encouragement when the user completes a task.

[0180] "Means for exchange and sale" refers to means for exchanging or selling generated characters with other users.

[0181] The "action script execution means" is a means for moving a character in real time and displaying a message to the user.

[0182] A "generative AI model" is an artificial intelligence model that generates characters based on customization options entered by a user.

[0183] A "prompt sentence" is an instruction sentence for character generation that is input to the generative AI model.

[0184] The present invention is a system in which a user creates a character customized based on their preferences, and the character manages the user's daily tasks. The present invention operates in cooperation with a user, a terminal, and a server. Specific embodiments for implementing the present invention are described below.

[0185] Character Generation

[0186] User

[0187] Users first launch the application and navigate to a customization options screen, where they enter details such as gender, hair color, body type, and clothing.

[0188] For example, enter customization options such as "Male gender, brown hair color, sporty clothing" and press the "Generate" button.

[0189] Terminal

[0190] The device sends the customization options entered by the user to the server using HTTP POST as the specific communication protocol.

[0191] server

[0192] The server uses a generative AI model (e.g., DALL-E or other artificial intelligence model) to generate a character based on the customization options specified by the user.

[0193] Example: The prompt sentence "Gender is male, hair color is brown, and sportswear is worn" is input into the generative AI model.

[0194] The server returns the generated character data to the device in JSON format.

[0195] Terminal

[0196] The device then draws the received character data and displays it on the user's screen. HTML5 Canvas or WebGL can be used for drawing.

[0197] Character movement control

[0198] Terminal

[0199] The terminal executes the character's movement script and controls the character's movements on the screen in real time, for example, using JavaScript (registered trademark).

[0200] The character will talk to the user and walk around the screen, for example saying "Good morning!"

[0201] Scheduling and Reminders

[0202] User

[0203] Users can add new tasks and events and set reminder times and dates.

[0204] Terminal

[0205] The device sends the tasks and event data set by the user to the server via an HTTP POST request.

[0206] server

[0207] The server stores task and event information in a database using MySQL (registered trademark) and uses INSERT statements.

[0208] At the specified reminder time, the server sends a push notification to the device using Firebase Cloud Messaging (FCM).

[0209] Terminal

[0210] At the specified time, the device receives a notification and a character notifies the user, saying, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[0211] Generate messages of praise and encouragement

[0212] User

[0213] The user enters task completion in the app and presses the "Complete" button.

[0214] Terminal

[0215] The terminal sends task completion information to the server via an HTTP POST request.

[0216] server

[0217] The server uses a generative AI model (such as ChatGPT (registered trademark)) based on the task completion information to generate praise and encouraging messages.

[0218] Example: Enter the prompt "The user has completed the task. Please generate a compliment." into the AI ​​model.

[0219] The server returns the generated message to the terminal.

[0220] Terminal

[0221] The device displays the received message on the character. For example, the character tells the user, "As expected! Thank you for your hard work."

[0222] Character exchange and sales

[0223] User

[0224] The user goes to the character exchange / sales screen and checks the list of characters that other users have made public.

[0225] Choose your favorite character and submit a trade or purchase request.

[0226] Terminal

[0227] The terminal sends a request from the user to the server by using an HTTP POST request.

[0228] server

[0229] The server receives the request and updates the character information in the database. The database used is PostgreSQL, and the UPDATE statement is used.

[0230] The server verifies the ownership of the character and sends update information back to the device in JSON format.

[0231] Terminal

[0232] The device will display the updated character information on the screen and notify the user, for example, "Ownership of this character has been transferred to you."

[0233] With the above-described configuration, the present invention enables users to manage their daily tasks in a fun and effective manner using characters customized by the user.

[0234] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0235] Step 1:

[0236] User

[0237] Launch the app and go to the customization options screen.

[0238] Customization options include gender, hair color, body type, clothing, etc.

[0239] Input: Customization options data entered by the user (e.g., gender is male, hair color is brown, sportswear style)

[0240] Output: Customization options data is sent to the device.

[0241] Step 2:

[0242] Terminal

[0243] The customization option data entered by the user is sent to the server via an HTTP POST request.

[0244] Input: Customization options data entered by the user (gender, hair color, body type, clothing, etc.)

[0245] Output: Customization options data is sent to the server.

[0246] Step 3:

[0247] server

[0248] Based on the received customization option data, a prompt sentence is generated and passed to the generative AI model (e.g., DALL-E).

[0249] A generative AI model generates characters based on customization options.

[0250] Input: Customization option data (e.g., prompt text "Gender is male, hair color is brown, and sportswear is worn")

[0251] Output: The generated character data (JSON format) is saved on the server.

[0252] Step 4:

[0253] server

[0254] The generated character data is returned to the device in JSON format as an HTTP response.

[0255] Input: Generated character data (JSON format)

[0256] Output: Character data is sent to the terminal.

[0257] Step 5:

[0258] Terminal

[0259] The received character data is analyzed and the character is drawn on the user's screen using a drawing engine (e.g. HTML5 Canvas or WebGL).

[0260] Input: Generated character data (JSON format)

[0261] Output: The customized character that is displayed on the user's screen.

[0262] Step 6:

[0263] Terminal

[0264] The character's action script is executed, and the character moves in real time to greet the user, for example.

[0265] Input: Character movement script

[0266] Output: A character that acts on the screen (e.g., says "Good morning!").

[0267] Step 7:

[0268] User

[0269] Add new tasks and events within the app and set reminder times and dates.

[0270] Input: Task and event information set by the user, as well as reminder times and dates

[0271] Output: The configured task and event information is sent to the device.

[0272] Step 8:

[0273] Terminal

[0274] Tasks and event data set by the user are sent to the server via an HTTP POST request.

[0275] Input: Task and event data set by the user

[0276] Output: Task and event data is sent to the server.

[0277] Step 9:

[0278] server

[0279] Save the received task and event data in a database (e.g. MySQL) using INSERT statements.

[0280] Input: Task and event data

[0281] Output: Task and event information stored in a database.

[0282] Step 10:

[0283] server

[0284] When the set reminder time arrives, a push notification is sent to the device using FCM (Firebase Cloud Messaging).

[0285] Input: Reminder time information

[0286] Output: The push notification sent to the device.

[0287] Step 11:

[0288] Terminal

[0289] When the specified time arrives, the user will receive a notification and a character will notify them, saying, "Mr. / Ms. XX, there will be a meeting in 15 minutes."

[0290] Input: Push notification from the server

[0291] Output: A reminder notification that appears on the screen.

[0292] Step 12:

[0293] User

[0294] Enter task completion in the app and press the "Complete" button.

[0295] Input: Completed task information (user input)

[0296] Output: Completion information is sent to the terminal.

[0297] Step 13:

[0298] Terminal

[0299] Completed task information is sent to the server via an HTTP POST request.

[0300] Input: Completed task information

[0301] Output: Completion information is sent to the server.

[0302] Step 14:

[0303] server

[0304] Based on the completion information, a prompt message is generated and passed to a generative AI model (e.g., ChatGPT) to generate a message of praise or encouragement.

[0305] Input: Completion information and message generation prompt (e.g., "The user has completed the task. Please generate a compliment.")

[0306] Output: The generated message.

[0307] Step 15:

[0308] server

[0309] The generated message is sent back to the terminal.

[0310] Input: The generated message

[0311] Output: The message is sent to the terminal.

[0312] Step 16:

[0313] Terminal

[0314] Display the received message on the character.

[0315] Input: The generated message

[0316] Output: A message of praise or encouragement that is displayed on the screen (e.g., "Great job!").

[0317] Step 17:

[0318] User

[0319] Go to the character exchange / sales screen and check the list of characters posted by other users. Select the character you like and send an exchange or purchase request.

[0320] Input: Character exchange / sale request

[0321] Output: The request is sent to the terminal.

[0322] Step 18:

[0323] Terminal

[0324] The user's request is sent to the server via an HTTP POST request.

[0325] Input: Character exchange / sale request

[0326] Output: The request is sent to the server.

[0327] Step 19:

[0328] server

[0329] Receives the request and updates the character information in the database (e.g., PostgreSQL) using the UPDATE statement.

[0330] Input: Character information update request

[0331] Output: The updates stored in the database.

[0332] Step 20:

[0333] server

[0334] Confirms character ownership and returns update information in JSON format to the device.

[0335] Input: Updated character information

[0336] Output: Character information with updated ownership.

[0337] Step 21:

[0338] Terminal

[0339] The updated character information is displayed on the screen to notify the user.

[0340] Input: Updated character information

[0341] Output: The user is notified that "Ownership of this character has been transferred to you."

[0342] Through the above processing steps, users can enjoy managing tasks using customizable characters, receive reminders and praise notifications effectively, and enjoy interacting with other users by exchanging and selling characters.

[0343] (Application example 1)

[0344] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0345] The present invention aims to provide a system that not only supports daily task and schedule management but also assists users in purchasing products in an enjoyable and efficient manner by utilizing characters customized based on the user's preferences. Many current online shopping sites have problems in that product recommendations and purchasing procedures are mechanical and not sufficiently personalized for users. Furthermore, there is a problem in that schedule management and task completion notifications do not provide an attractive user experience. To solve these problems, a new system is needed.

[0346] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0347] In this invention, the server includes an input means for a user to input customization options, a generation means for generating a character based on the customization options using a generative AI model, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate messages of praise and encouragement when the user completes a task, and a navigation means for the character to recommend products to the user and assist with purchasing procedures. This allows users to enjoyably and efficiently manage their daily tasks and purchase products through characters customized to their preferences.

[0348] A "user" is a person who uses the system.

[0349] "Customization options" are input items that allow the user to set options such as the character's gender, hairstyle, and clothing.

[0350] An "input means" is a device or interface through which a user inputs customization options.

[0351] "Generator" refers to a function or device that generates a character based on customization options entered by the user.

[0352] A "generative AI model" is an artificial intelligence model that uses machine learning algorithms to generate characters.

[0353] "Control means" refers to a function or device that manages and controls the actions of the generated character.

[0354] "Schedule management means" refers to a function or device that allows a character to manage the user's schedule and tasks.

[0355] "Notification means" refers to a function or device that allows a character to notify the user of reminders or alerts.

[0356] The "message generating means" is a function or device that allows a character to create a message of praise or encouragement when the user completes a task.

[0357] "Navigation means" refers to a function or device that allows a character to recommend products to users and assist them in the purchasing process.

[0358] The system for implementing this invention uses a user-customized character to assist with daily tasks, schedule management, and navigation on online shopping sites. The entire system is configured with the user's smartphone at its center, with a server and terminals working together.

[0359] Character Generation

[0360] The user launches the app and navigates to the customization options screen. They enter options such as gender, hairstyle, hair color, and clothing, and press the "Generate" button. The device then sends these customization options to the server. The server uses a generative AI model to generate a character based on the customization options and sends the data back to the device. The device then renders the received character data and displays it on the user's screen.

[0361] The generative AI model used is a generative model with an advanced algorithm, such as GPT-4 (registered trademark).

[0362] Character movement control

[0363] The character's movement script is executed by the device and runs in real time on the screen. The character talks to the user and moves around the screen. The software used for this is an application building framework such as Flutter (registered trademark) or React Native.

[0364] Scheduling and Reminders

[0365] The user adds a new task or event and sets the time and date of the reminder. This information is sent from the device to the server, where it is stored in a database (e.g., AWS (registered trademark) DynamoDB or Firebase Firestore). When the specified time arrives, the server sends a reminder notification to the device, and a character displays the details of the reminder on the screen.

[0366] Message Generation

[0367] When a user enters their task completion status in the app and presses the "Done" button, the device sends this information to the server, which then generates a message of praise or encouragement based on the information received and sends it back to the device. A character then conveys this message to the user.

[0368] Product Recommendation and Navigation

[0369] The character recommends products based on the user's purchase history and preferences. When the user visits a product page, the character explains the product's features and guides the user through the purchase process. The character also allows the user to set subscription reminders and notify the user accordingly.

[0370] An example of a specific prompt is as follows:

[0371] Generate your character based on the following customization options:

[0372] Gender: Female

[0373] Hairstyle: Long

[0374] Hair Color: Brown

[0375] Dress Code: Casual

[0376] The generated character will act as an assistant, managing the user's calendar and tasks, and recommending products.

[0377] This system allows users to manage their daily tasks and purchase products in a fun and efficient way through characters they customize to their liking.

[0378] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0379] Step 1:

[0380] The user launches the app and navigates to the customization options screen, where they input customization options such as gender, hairstyle, hair color, and clothing. By pressing the "Generate" button, these options are input into the device.

[0381] Step 2:

[0382] The device sends the customization options entered by the user to the server, including information such as gender, hairstyle, hair color, and clothing. The data is sent using a REST API.

[0383] Step 3:

[0384] The server calls a generative AI model based on the received customization options to generate a character. The generative AI model (e.g., OpenAI (registered trademark) GPT-4) receives the prompt as input and generates a customized character. The generated character data is sent back from the server to the device.

[0385] Step 4:

[0386] The device then renders the received character data and displays it on the user's screen, allowing the customized character to move in real time and providing the user with an interactive experience.

[0387] Step 5:

[0388] When a user adds a new task or event, the information is entered into the device, the user sets the time and date for the reminder, and the information is sent from the device to the server.

[0389] Step 6:

[0390] The server saves the submitted task and event information in a database, for example, a cloud database such as AWS DynamoDB or Firebase Firestore, and triggers a notification when the set reminder time arrives.

[0391] Step 7:

[0392] When the device receives a reminder notification from the server, a character displays the details of the reminder on the screen and speaks to the user, saying, "Mr. / Ms. XX, you have a meeting in 15 minutes."

[0393] Step 8:

[0394] When a user completes a task, they input the completion information into the terminal. The terminal then sends the task completion information to the server. The server then generates a message of praise or encouragement based on the task completion information.

[0395] Step 9:

[0396] The server sends the generated message back to the terminal. The terminal displays this message on the character. The character tells the user, "You're amazing! Thank you for your hard work."

[0397] Step 10:

[0398] If a user wants to receive product recommendations, the character will recommend products based on the user's purchase history and preferences. While the user is browsing the product page, the character will explain the product's features and guide the user through the purchase process.

[0399] Step 11:

[0400] When a user sets a subscription reminder, the information is sent to the server via the device, and the server triggers a notification based on the set reminder time, with a character informing the user, "Today is the day to order your subscription!"

[0401] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0402] The present invention is a system in which a character created by a user through input of customization options manages the user's daily tasks, and further has the function of recognizing the user's emotions and appropriately changing behaviors and messages. The present invention operates in cooperation with the user, terminal, and server.

[0403] Overall system configuration

[0404] The system according to the present invention includes an input means for a user to input customization options, a generation means for generating a character based on the customization options, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate messages of praise or encouragement when the user completes a task, an emotion recognition means for recognizing the user's emotions, and an exchange / sales means for the user to exchange or sell the generated character with other users. Furthermore, the emotion recognition means uses an emotion engine that analyzes the user's voice and facial expressions.

[0405] Specific program operation explanation

[0406] Character Generation

[0407] User

[0408] 1. Launch the app and go to the customization options screen.

[0409] 2. Enter customization options such as gender, hair color, body type, and clothing, and press the "Generate" button.

[0410] Terminal

[0411] 1. Sends the customization options entered by the user to the server.

[0412] server

[0413] 1. Using a generative AI model, we generate a character based on submitted customization options.

[0414] 2. The generated character data (images and animations) is sent back to the device.

[0415] Terminal

[0416] 1. Analyze the received character data and display it on the user's screen.

[0417] Character movement control

[0418] Terminal

[0419] 1. Load and execute the character's movement script.

[0420] 2. Depict the character's movements on the screen in real time.

[0421] 3. Have the character talk to the user and walk around the screen.

[0422] Scheduling and Reminders

[0423] User

[0424] 1. Add a new task or event within the app.

[0425] 2. Set the reminder time and date.

[0426] Terminal

[0427] 1. Send the task and event information entered by the user to the server.

[0428] server

[0429] 1. Store task and event information in a database.

[0430] 2. Set a schedule to send notifications at set reminder times.

[0431] server

[0432] 1. Send a reminder notification to your device at the specified time.

[0433] Terminal

[0434] 1. When you receive a reminder notification, a character will display the reminder details on the screen.

[0435] 2. The character notifies the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[0436] Generate messages of praise and encouragement

[0437] User

[0438] 1. Enter the completion of the task in the app and press the Complete button.

[0439] Terminal

[0440] 1. Send task completion information to the server.

[0441] server

[0442] 1. Receive task completion information and generate messages of praise and encouragement.

[0443] 2. Send the generated message back to the terminal.

[0444] Terminal

[0445] 1. Display the received message on the character.

[0446] 2. The character tells the user, "As expected! Thank you for your hard work."

[0447] emotion recognition

[0448] Terminal

[0449] 1. An emotion recognition means (emotion engine) is used to analyze the user's voice and facial expressions in real time.

[0450] 2. Send the user's emotional state to the server.

[0451] server

[0452] 1. Generate instructions to automatically change the character's behavior and message content based on the user's emotional state.

[0453] 2. Send the generated instructions back to the terminal.

[0454] Terminal

[0455] 1. Update the character's actions and message content based on the instructions received.

[0456] 2. The character will respond appropriately to the user's emotions.

[0457] Character exchange and sales

[0458] User

[0459] 1. Go to the character exchange / sales screen.

[0460] 2. Check the character lists published by other users.

[0461] 3. Choose your favorite character and send an exchange or purchase request.

[0462] Terminal

[0463] 1. Send a request from the user to the server.

[0464] server

[0465] 1. Receive the request and update the character information.

[0466] 2. Verify character ownership and send update information back to your device.

[0467] Terminal

[0468] 1. Notify the user of updated character information.

[0469] Specific examples

[0470] For example, if user A sets an alarm for 7:00 a.m. and then checks his / her schedule for the day, the system operates as follows:

[0471] User A launches the app, enters "Set alarm for 7:00" and saves it.

[0472] The terminal transmits the alarm information to the server.

[0473] The server saves the alarm settings and notifies the device at the specified time.

[0474] At the set time, the device will receive a notification and the character will say, "Good morning, today's schedule is..."

[0475] User A checks the calendar and a character reads out today's schedule.

[0476] Furthermore, the character recognizes user A's emotions and, for example, if user A is feeling a little down, provides an encouraging message such as, "Why don't you take a walk today to refresh your mood?"

[0477] In this way, users can not only manage their daily tasks in a fun and efficient way through the characters, but also receive support that is tailored to their emotional state at the time.

[0478] The processing flow will be explained below.

[0479] Specific processing steps of the program

[0480] Character Generation

[0481] Step 1:

[0482] The user launches the app and navigates to the customization options screen.

[0483] Step 2:

[0484] The user enters customization options such as gender, hair color, body type, and clothing, and presses the "Generate" button.

[0485] Step 3:

[0486] The terminal transmits the customization options entered by the user to the server.

[0487] Step 4:

[0488] The server passes the received customization options to the generative AI model.

[0489] Step 5:

[0490] The server uses a generative AI model to generate a character based on customization options.

[0491] Step 6:

[0492] The server returns the generated character data (images and animations) to the device.

[0493] Step 7:

[0494] The terminal analyzes the received character data and displays it on the user's screen.

[0495] Character movement control

[0496] Step 1:

[0497] The device loads and executes the character's movement script.

[0498] Step 2:

[0499] The device depicts the character's movements on the screen in real time.

[0500] Step 3:

[0501] The device causes the character to talk to the user and walk around the screen.

[0502] Scheduling and Reminders

[0503] Step 1:

[0504] A user adds a new task or event within the app.

[0505] Step 2:

[0506] The user sets the reminder time and date.

[0507] Step 3:

[0508] The terminal transmits the task and event information entered by the user to the server.

[0509] Step 4:

[0510] The server stores task and event information in a database.

[0511] Step 5:

[0512] Schedule the server to send notifications at set reminder times.

[0513] Step 6:

[0514] The server sends a reminder notification to the device at the specified time.

[0515] Step 7:

[0516] The device will receive a reminder notification and a character will display the reminder details on the screen.

[0517] Step 8:

[0518] The character will notify the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[0519] Generate messages of praise and encouragement

[0520] Step 1:

[0521] The user enters that the task has been completed within the app and presses the Complete button.

[0522] Step 2:

[0523] The terminal sends task completion information to the server.

[0524] Step 3:

[0525] The server receives the task completion information and generates a message of praise or encouragement.

[0526] Step 4:

[0527] The server sends the generated message back to the terminal.

[0528] Step 5:

[0529] The message received by the device is displayed on the character.

[0530] Step 6:

[0531] The character tells the user, "As expected! Thank you for your hard work."

[0532] emotion recognition

[0533] Step 1:

[0534] The device uses an emotion recognition means (emotion engine) to analyze the user's voice and facial expressions in real time.

[0535] Step 2:

[0536] The terminal transmits the user's emotional state to the server.

[0537] Step 3:

[0538] The server generates instructions to automatically change the character's behavior and message content based on the user's emotional state.

[0539] Step 4:

[0540] The server sends the generated instructions back to the terminal.

[0541] Step 5:

[0542] The character's movements and message content are updated based on the instructions received by the device.

[0543] Step 6:

[0544] The character will respond appropriately to the user's emotions.

[0545] For example, if the user is feeling down, the character might suggest, "Why not take a walk today to refresh your mood?"

[0546] Character exchange and sales

[0547] Step 1:

[0548] The user will be taken to the character exchange / sales screen.

[0549] Step 2:

[0550] The terminal sends a request to the server to display a list of characters that other users have made public.

[0551] Step 3:

[0552] The server returns the character list data to the device.

[0553] Step 4:

[0554] The terminal displays a list of characters to the user.

[0555] Step 5:

[0556] Users can choose their favorite character and send an exchange or purchase request.

[0557] Step 6:

[0558] The terminal sends a request from the user to the server.

[0559] Step 7:

[0560] The server receives the request and updates the character's ownership.

[0561] Step 8:

[0562] The server returns the updated character information to the terminal.

[0563] Step 9:

[0564] The terminal notifies the user of the updated character information.

[0565] Example 2

[0566] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0567] In conventional task management systems, it was difficult for users to receive appropriate support that took their emotional state into consideration. Furthermore, there were few interactive task management methods through characters, and the system lacked features to enhance user motivation. Furthermore, character customization and sharing functions were limited, limiting the user experience.

[0568] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an input means for a user to input customization options, a generation means for generating a character using a generative AI model, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate a message of praise or encouragement when the user completes a task, an emotion recognition means for analyzing the user's voice and facial expressions, an emotion adaptation means for changing the character's behavior and message content based on the emotional state recognized by the emotion recognition means, and an exchange / sales means for exchanging or selling the user-generated character with other users. This enables users to perform interactive and motivational task management while receiving appropriate support according to their emotions. Furthermore, the range of character customization and sharing is expanded, providing a rich user experience.

[0569] An "input means" is a device or interface through which a user inputs customization options.

[0570] "Generation means" refers to a mechanism or program for generating a character based on input customization options.

[0571] "Control means" refers to a system or program for managing and controlling the actions of the generated character.

[0572] "Schedule management means" refers to functions and programs that allow a character to manage a user's schedule and tasks.

[0573] "Notification means" refers to a function or program that allows a character to send reminders or other notifications to the user.

[0574] The "message generating means" is a mechanism or program that allows a character to generate a message of praise or encouragement when the user completes a task.

[0575] "Emotion recognition means" refers to a system or program for analyzing the user's voice and facial expressions to recognize their emotions.

[0576] The "emotion adaptation means" is a function or program for automatically changing the character's behavior or message content based on the emotional state recognized by the emotion recognition means.

[0577] "Exchange / sales means" refers to the functions and interfaces for exchanging or selling characters created by a user with other users.

[0578] A "generative AI model" is an artificial intelligence model that generates characters according to customization options entered by a user.

[0579] The present invention is a system in which a character created by a user through input of customization options manages the user's daily tasks, and further has the function of recognizing the user's emotions and appropriately changing behaviors and messages. Specific embodiments of the present invention will be described below.

[0580] Character Generation

[0581] User

[0582] 1. Launch the app on your smartphone or tablet and go to the customization options screen.

[0583] 2. Enter customization options such as gender, hair color, body type, and clothing, and press the "Generate" button.

[0584] Terminal

[0585] 1. The customization options entered by the user are sent to the server using a REST API, and the data is sent in JSON format.

[0586] server

[0587] 1. On the server, a generative AI model (e.g., OpenAI's API) generates a character based on the customization options. This generative AI model is an artificial intelligence model that generates a character corresponding to the input data.

[0588] 2. The generated character data (images and animations) is sent back to the device.

[0589] Terminal

[0590] 1. Analyze the received character data and display it on the user's screen. The analyzed data is displayed through a UI component.

[0591] Character movement control

[0592] Terminal

[0593] 1. Load and execute the character's movement script. The movement script is written in a scripting language such as JavaScript.

[0594] 2. Depicting the character's movements on the screen in real time, using a rendering loop to generate and draw animation frames.

[0595] 3. Have the character talk to the user and walk around the screen.

[0596] Scheduling and Reminders

[0597] User

[0598] 1. Add a new task or event within the app.

[0599] 2. Set the reminder time and date.

[0600] Terminal

[0601] 1. Task and event information entered by the user is sent to the server in JSON format.

[0602] server

[0603] 1. The server stores the received task and event information in a database, such as MySQL or MongoDB.

[0604] 2. Use task scheduling features (e.g. cron jobs) to send notifications at set reminder times.

[0605] server

[0606] 1. At the specified time, a reminder notification is sent to the device using a push notification service (e.g., Firebase Cloud Messaging).

[0607] Terminal

[0608] 1. When you receive a reminder notification, a character will display the reminder details on the screen.

[0609] 2. The character notifies the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[0610] Generate messages of praise and encouragement

[0611] User

[0612] 1. Enter the completion of the task in the app and press the Complete button.

[0613] Terminal

[0614] 1. Send task completion information to the server.

[0615] server

[0616] 1. Receive task completion information and generate praise and encouraging messages using an AI model (e.g., GPT-3 (registered trademark)).

[0617] 2. Send the generated message back to the terminal.

[0618] Terminal

[0619] 1. Display the received message on the character.

[0620] 2. The character tells the user, "As expected! Thank you for your hard work."

[0621] emotion recognition

[0622] Terminal

[0623] 1. Analyze the user's voice and facial expressions in real time using a speech recognition API or facial recognition API. An example is the emotion recognition API from Microsoft® Azure®.

[0624] 2. The user's emotional state is sent to the server in JSON format.

[0625] server

[0626] 1. Generate instructions to automatically change the character's behavior and message content based on the user's emotional state.

[0627] 2. Send the generated instructions back to the terminal.

[0628] Terminal

[0629] 1. Update the character's actions and message content based on the instructions received.

[0630] 2. The character will respond appropriately to the user's emotions.

[0631] Character exchange and sales

[0632] User

[0633] 1. Go to the character exchange / sales screen.

[0634] 2. Check the character lists published by other users.

[0635] 3. Choose your favorite character and send an exchange or purchase request.

[0636] Terminal

[0637] 1. The user's request is sent to the server in JSON format.

[0638] server

[0639] 1. Receive the request and update the character information.

[0640] 2. Verify character ownership and send update information back to your device.

[0641] Terminal

[0642] 1. Notify the user of updated character information.

[0643] Specific examples

[0644] For example, if user A sets an alarm for 7:00 a.m. and then checks his / her schedule for the day, the system operates as follows:

[0645] User A launches the app, enters "Set alarm for 7:00" and saves it.

[0646] The terminal transmits the alarm information to the server.

[0647] The server saves the alarm settings and notifies the device at the specified time.

[0648] At the set time, the device will receive a notification and the character will say, "Good morning, today's schedule is..."

[0649] User A checks the calendar and a character reads out today's schedule.

[0650] Furthermore, the character recognizes user A's emotions and, for example, if user A is feeling a little down, provides an encouraging message such as, "Why don't you take a walk today to refresh your mood?"

[0651] Prompt Sentence Examples

[0652] "Describe a system where a user can input customization options to generate a character, which then manages the user's daily tasks and reacts appropriately using emotion recognition."

[0653] In this way, users can not only manage their daily tasks in a fun and efficient way through the characters, but also receive support that is tailored to their emotional state at the time.

[0654] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0655] Step 1:

[0656] The user launches the app on their smartphone or tablet and navigates to the customization options screen. They enter customization options such as gender, hair color, body type, and clothing, and press the "Generate" button. The input at this time is the customization information specified by the user. The output is data based on the customization options.

[0657] Step 2:

[0658] The terminal sends the customization options entered by the user to the server using the REST API, and the data is sent in JSON format. The input is the user's customization option data, and the output is the data transferred to the server in JSON format.

[0659] Step 3:

[0660] The server inputs the received customization options into a generative AI model (e.g., OpenAI's API). The generative AI model generates character images and animations based on the input data. The input is customization option data, and the output is the generated character data (images and animations).

[0661] Step 4:

[0662] The server returns the generated character data in JSON format to the terminal, and an HTTP response containing the generated character data is returned as output.

[0663] Step 5:

[0664] The device analyzes the received character data and displays it on the user's screen. The input is the character data received from the server, and the output is the character image or animation displayed on the screen. Specifically, the character is displayed through a UI component.

[0665] Step 6:

[0666] Users can add new tasks and events within the app and set reminder times and dates, with inputs including task and event information and reminder settings.

[0667] Step 7:

[0668] The terminal sends task and event information entered by the user to the server. The input is the task and event information set by the user, and the output is data sent to the server in JSON format.

[0669] Step 8:

[0670] The server stores the received task and event information in a database. The database used is MySQL, MongoDB, etc. The input is task and event information, and the output is the data stored in the database.

[0671] Step 9:

[0672] The server uses a task scheduling facility (e.g. a cron job) to send notifications at the reminder time. The input is the reminder configuration information, and the output is the notification action to be scheduled.

[0673] Step 10:

[0674] The server sends a reminder notification to the device at the specified time using a push notification service (e.g., Firebase Cloud Messaging). The input is the reminder schedule data, and the output is the notification data sent to the device.

[0675] Step 11:

[0676] The device receives the reminder notification and a character displays the reminder content on the screen. The input is the notification data sent from the server, and the output is the reminder content displayed on the screen.

[0677] Step 12:

[0678] The character notifies the user, for example, "Mr. / Ms. XX, you have a meeting in 15 minutes." Specifically, it uses a speech synthesis API to speak the notification message and displays an animation.

[0679] Step 13:

[0680] The user inputs the task completion information in the app and presses the completion button.

[0681] Step 14:

[0682] The terminal sends task completion information to the server. The input is the task completion information entered by the user, and the output is the data sent to the server.

[0683] Step 15:

[0684] The server receives task completion information and generates messages of praise or encouragement. The messages are generated using an AI model (e.g., GPT-3). The input is the task completion information, and the output is the generated message.

[0685] Step 16:

[0686] The server sends the generated message back to the terminal, which returns an HTTP response containing the generated message as output.

[0687] Step 17:

[0688] The terminal displays the received message on the character and tells the user, "You're amazing! Thank you for your hard work." The input is the generated message data, and the output is the character's voice and animation.

[0689] Step 18:

[0690] The device analyzes the user's voice and facial expressions in real time using a voice recognition API or a face recognition API. As an example, we use Microsoft Azure's emotion recognition API. The input is the user's voice and facial expression data, and the output is analyzed emotional data.

[0691] Step 19:

[0692] The terminal transmits its emotional state to the server. The input is the analyzed emotional data, and the output is the data sent to the server.

[0693] Step 20:

[0694] The server generates instructions to automatically change the character's behavior and message content based on the emotional state. The input is emotional data, and the output is instructions regarding the character's behavior and message content.

[0695] Step 21:

[0696] The server returns the generated instructions to the terminal, and an HTTP response is returned containing the generated instruction data as output.

[0697] Step 22:

[0698] The terminal updates the character's actions and message content based on the received instructions. The input is the generated instruction data, and the output is the updated character's actions and messages.

[0699] Step 23:

[0700] The character will respond appropriately to the user's emotions, changing its facial expressions and movements in real time to match the emotion.

[0701] Step 24:

[0702] The user moves to the character exchange / sales screen. The input is a screen transition request.

[0703] Step 25:

[0704] The user checks the character lists published by other users. The input is a character list display request, and the output is the displayed character list.

[0705] Step 26:

[0706] The user selects a character they like and sends a request to exchange or purchase it. The input is the character selection and request data, and the output is the data to be sent to the server.

[0707] Step 27:

[0708] The terminal sends requests from users to the server. The input is the exchange / purchase request data, and the output is the data to be sent to the server.

[0709] Step 28:

[0710] The server receives the request and updates the character information. The input is the received request data, and the output is the updated character information.

[0711] Step 29:

[0712] The server verifies the ownership of the character and sends the updated information back to the device, which returns an HTTP response containing the updated character information as output.

[0713] Step 30:

[0714] The terminal notifies the user of the updated character information. The input is the updated character information, and the output is a notification displayed on the screen.

[0715] (Application example 2)

[0716] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0717] While conventional character-based systems were capable of managing users' schedules and tasks, they struggled to respond to users' emotional changes in real time or provide appropriate entertainment and navigation information in autonomous vehicles. Furthermore, they lacked a system for optimizing the in-car user experience, resulting in problems that reduced user comfort and usage efficiency.

[0718] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0719] In this invention, the server includes an input means for a user to input customization options, a generation means for generating a character based on the customization options, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate messages of praise or encouragement when the user completes a task, an entertainment means for the character to provide entertainment and navigation information within the autonomous vehicle, and an emotion recognition means for recognizing the user's emotions within the autonomous vehicle and changing the character's behavior and message content based on the emotions. This optimizes the user's experience within the autonomous vehicle, enabling comfortable and efficient use.

[0720] An "input means" is a device through which a user inputs customization options.

[0721] "Generator" means a device for generating a character based on customization options.

[0722] "Control means" refers to a device for controlling the actions of the generated character.

[0723] The "schedule management means" is a device that allows the character to manage the user's schedule.

[0724] The "notification means" is a device that allows the character to notify the user of a reminder.

[0725] The "message generating means" is a device that allows a character to generate a message of praise or encouragement when the user completes a task.

[0726] An "entertainment vehicle" is a device that allows a character to provide entertainment or navigation information within an autonomous vehicle.

[0727] The "emotion recognition means" is a device that recognizes the emotions of the user inside the autonomous vehicle and changes the character's behavior and message content based on those emotions.

[0728] The present invention provides a system that utilizes a user-customized character in an autonomous vehicle to provide entertainment, navigation, task management, and situational responses based on the user's emotions. This system operates in cooperation with the user, a terminal, and a server.

[0729] Overall system configuration

[0730] The system according to the present invention comprises the following main components:

[0731] Input means: A device through which users input customization options. This is implemented as a smartphone app.

[0732] Generator: A device that generates characters based on customization options. It uses a generative AI model (e.g., GPT-4) on a server.

[0733] Control means: A device that controls the actions of the generated character. It is executed in real time on the terminal.

[0734] Schedule management tool: A device in which a character manages the user's schedule. It is incorporated into a smartphone app.

[0735] Notification method: A character notifies the user of reminders. This is achieved through push notifications on smartphones.

[0736] Message Generation Means: A device that generates messages of praise and encouragement when a character completes a task. Executed on the server.

[0737] Entertainment: A device in which characters provide entertainment and navigation information inside an autonomous vehicle, using in-car displays and voice assistants.

[0738] Emotion recognition means: A device that recognizes the user's emotions inside the autonomous vehicle and changes the character's behavior and message content based on those emotions. It uses a camera, microphone, and emotion engine (e.g., Azure Emotion API).

[0739] Program processing overview

[0740] The system begins with the user customizing their character through a smartphone app. The customized options are sent from the device to a server, which then generates the character using a generative AI model. The generated character data is then sent back to the device, where it can be displayed and controlled in real time.

[0741] When a user inputs schedules and tasks while driving, the information is stored and managed on the server and sent to the device as reminders when necessary. In addition, when the user completes a task, the character generates a message of praise or encouragement that is displayed on the device.

[0742] Furthermore, the user's emotions are analyzed in real time through the in-car camera and microphone, and the character's behavior and messages change automatically depending on the user's emotions. This is done using an emotion engine (e.g., Azure Emotion API).

[0743] Specific examples

[0744] For example, consider a user who wants to create a customized character in the morning. The user launches the app and inputs the character's gender, hair color, clothing, etc.

[0745] An example prompt might look like this:

[0746] Character Gender: Male

[0747] Hair Color: Black

[0748] Dress Code: Casual

[0749] When the user presses the generate button, the device sends these customization options to the server, which uses a generative AI model (e.g., GPT-4) to generate a character and sends the data back to the device, which then displays the generated character in real time.

[0750] Additionally, when a user inputs their next destination in an autonomous vehicle, that information is also sent to the server, and a character provides entertainment and navigation information through the in-car display. The user's emotions are analyzed, and the character responds appropriately with appropriate responses and messages. For example, if the user is feeling stressed while driving, the character may suggest, "Would you like me to play some relaxing music?"

[0751] In this way, the system optimizes the user's experience inside the autonomous vehicle, ensuring a comfortable and efficient use.

[0752] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0753] Step 1:

[0754] User: Launches the app and enters customization options. The user selects options such as gender, hair color, and clothing, and presses the generate button.

[0755] Input: Customization options such as gender, hair color, clothing, etc.

[0756] Output: The customization options are entered into the terminal.

[0757] Step 2:

[0758] Terminal: Sends the entered customization options to the server.

[0759] Input: Customization option data entered by the user.

[0760] Data Calculation: Converts input data into an appropriate format and sends it over the network to the server.

[0761] Output: Customization options data is sent to the server.

[0762] Step 3:

[0763] Server: Uses a generative AI model (e.g. GPT-4) to generate a character based on customization options.

[0764] Input: Customization option data sent from the device.

[0765] Data calculation: Enter the following as a prompt into the generation AI model to generate a character.

[0766] Character Gender: Male

[0767] Hair Color: Black

[0768] Dress Code: Casual

[0769] Output: Generated character data (images and animations).

[0770] Step 4:

[0771] Server: Returns the generated character data to the device.

[0772] Input: Generated character data.

[0773] Data calculation: Converts character data into an appropriate format and sends it to the terminal via the network.

[0774] Output: Character data is sent to the terminal.

[0775] Step 5:

[0776] Terminal: Displays the received character data and controls the character's actions.

[0777] Input: Character data sent from the server.

[0778] Data calculation: Analyzes character data and converts it into a format that can be displayed on the screen.

[0779] Output: The character is displayed on the user's smartphone or in-car display.

[0780] Step 6:

[0781] User: Enter schedule and tasks in the app, enter next destination and appointment information, and press the save button.

[0782] Input: Schedule, task information, and destination information.

[0783] Output: The entered information is saved on the device.

[0784] Step 7:

[0785] Terminal: Sends schedule and task information entered by the user to the server.

[0786] Input: Schedule and task information entered by the user.

[0787] Data Calculation: Converts input data into an appropriate format and sends it over the network to the server.

[0788] Output: Schedule and task information is sent to the server.

[0789] Step 8:

[0790] Server: Stores schedule and task information and sends notifications to devices when reminders are due.

[0791] Input: Schedule and task information sent from the device.

[0792] Data calculation: Save schedule and task information in a database and set reminder timings.

[0793] Output: A reminder will be ready to be sent when an event occurs.

[0794] Step 9:

[0795] Server: Sends a notification to the device when the reminder time arrives.

[0796] Input: Reminder time and corresponding task information.

[0797] Data calculation: Generates reminder notifications and sends them to the device over the network.

[0798] Output: A reminder notification is sent to the device.

[0799] Step 10:

[0800] Device: Receive reminder notifications and notify the user via a character.

[0801] Input: Reminder notification from the server.

[0802] Data Calculation: Analyzes reminder notifications and displays them as character messages.

[0803] Output: The character informs the user, "Dear Mr. / Ms. X, you have a meeting in 15 minutes."

[0804] Step 11:

[0805] User: Enter task completion in the app and press the Complete button.

[0806] Input: Task completion information.

[0807] Output: The entered task completion information is saved on the device.

[0808] Step 12:

[0809] Terminal: Sends task completion information to the server.

[0810] Input: Task completion information entered by the user.

[0811] Data calculation: Convert the task completion information data into an appropriate format and send it to the server via the network.

[0812] Output: Task completion information is sent to the server.

[0813] Step 13:

[0814] Server: Receives task completion information and generates praise and encouragement messages.

[0815] Input: Task completion information sent from the terminal.

[0816] Data Computing: Using a message generation AI model, we generate messages of praise and encouragement.

[0817] Output: The generated message.

[0818] Step 14:

[0819] Server: Returns the generated message to the device.

[0820] Input: A generated message of praise or encouragement.

[0821] Data Calculation: Converts message data into an appropriate format and sends it to the terminal over the network.

[0822] Output: The message is sent to the terminal.

[0823] Step 15:

[0824] Terminal: Displays received messages to the character.

[0825] Input: A message of praise or encouragement sent by the server.

[0826] Data Calculation: Parses messages and converts them into a format that the character can display.

[0827] Output: The character tells the user, "You're amazing! Great job!"

[0828] Step 16:

[0829] Device: Uses a camera and microphone to analyze the user's emotions in real time and send them to the server.

[0830] Input: User's facial and voice data.

[0831] Data calculation: Analyze using an emotion engine (e.g., Azure Emotion API) to generate emotion data.

[0832] Output: Emotion data is sent to the server.

[0833] Step 17:

[0834] Server: Generates instructions to change the character's behavior and message content based on the user's emotional data and sends them back to the device.

[0835] Input: Emotion data sent from the device.

[0836] Data calculation: Generates character movement instructions and message content based on emotional data.

[0837] Output: Operation instructions and message content are sent to the terminal.

[0838] Step 18:

[0839] Terminal: Updates character behavior and message content based on received instructions.

[0840] Input: Operation instructions and message content sent from the server.

[0841] Data calculation: Analyzes action instructions and messages and reflects them on the character.

[0842] Output: The character responds in real time according to the emotion.

[0843] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0844] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0845] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0846] [Second embodiment]

[0847] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0848] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0849] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0850] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0851] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0852] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0853] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0854] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0855] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0856] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0857] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0858] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0859] The present invention is a system in which a user creates a character customized based on their preferences, and the character manages the user's daily tasks. The present invention operates in cooperation with the user, a terminal, and a server.

[0860] Overall system configuration

[0861] The system of the present invention includes an input means for a user to input customization options, a generation means for generating a character based on the customization options, a control means for controlling the behavior of the generated character, a schedule management means for managing the user's schedule and notifying them of reminders, a message generation means for generating messages of praise or encouragement upon completion of a task, and an exchange / sale means for exchanging or selling characters with other users.

[0862] Specific program operation explanation

[0863] Character Generation

[0864] User

[0865] 1. Launch the app.

[0866] 2. Go to the customization options screen and enter your gender, hair color, body type, clothing, etc.

[0867] 3. Press the "Generate" button.

[0868] Terminal

[0869] 1. Sends the customization options entered by the user to the server.

[0870] server

[0871] 1. Use a generative AI model to generate a character based on customization options.

[0872] 2. The generated character data is sent back to the device.

[0873] Terminal

[0874] 1. Draw the received character data and display it on the user's screen.

[0875] Character movement control

[0876] Terminal

[0877] 1. Execute the character's movement script and make it move on the screen in real time.

[0878] 2. The character talks to the user and walks around the screen.

[0879] Scheduling and Reminders

[0880] User

[0881] 1. Add a new task or event.

[0882] 2. Set the reminder time and date.

[0883] Terminal

[0884] 1. Sends tasks and events set by the user to the server.

[0885] server

[0886] 1. Store task and event information in a database.

[0887] 2. Send notifications at the set reminder time.

[0888] Terminal

[0889] 1. When the specified time arrives, the user will receive a reminder notification and a character will display the details of the reminder on the screen. The character will notify the user, "Mr. / Ms. XX, you have a meeting in 15 minutes."

[0890] Generate messages of praise and encouragement

[0891] User

[0892] 1. Enter the completion of the task in the app and press the Complete button.

[0893] Terminal

[0894] 1. Send task completion information to the server.

[0895] server

[0896] 1. Receive task completion information and generate messages of praise and encouragement.

[0897] 2. Send the generated message back to the terminal.

[0898] Terminal

[0899] 1. The character displays the received message. For example, the character tells the user, "As expected! Thank you for your hard work."

[0900] Character exchange and sales

[0901] User

[0902] 1. Go to the character exchange / sales screen.

[0903] 2. Check the character lists published by other users.

[0904] 3. Choose your favorite character and send an exchange or purchase request.

[0905] Terminal

[0906] 1. Send a request from the user to the server.

[0907] server

[0908] 1. Receive the request and update the character information.

[0909] 2. Verify character ownership and send update information back to your device.

[0910] Terminal

[0911] 1. Display updated character information and notify the user.

[0912] Specific examples

[0913] For example, if user A sets an alarm for 7:00 a.m. and then checks his / her schedule for the day, the system operates as follows:

[0914] User A launches the app, enters "Set alarm for 7:00" and saves it.

[0915] The terminal transmits the alarm information to the server.

[0916] The server saves the alarm settings and notifies the device at the specified time.

[0917] At the set time, the device will receive a notification and the character will say, "Good morning, today's schedule is..."

[0918] User A checks the calendar and a character reads out today's schedule.

[0919] In this way, users can enjoy managing their daily tasks through the characters.

[0920] The processing flow will be explained below.

[0921] Specific processing steps of the program

[0922] Character Generation

[0923] Step 1:

[0924] The user launches the app and navigates to the customization options screen.

[0925] Step 2:

[0926] The user enters customization options such as gender, hair color, body type, and clothing, and presses the "Generate" button.

[0927] Step 3:

[0928] The terminal transmits the customization options entered by the user to the server.

[0929] Step 4:

[0930] The server passes the received customization options to the generative AI model.

[0931] Step 5:

[0932] The server uses a generative AI model to generate a character based on customization options.

[0933] Step 6:

[0934] The server returns the generated character data (images and animations) to the device.

[0935] Step 7:

[0936] The terminal analyzes the received character data and displays it on the user's screen.

[0937] Character movement control

[0938] Step 1:

[0939] The device loads and executes the character's movement script.

[0940] Step 2:

[0941] The device depicts the character's movements on the screen in real time.

[0942] Step 3:

[0943] The device causes the character to talk to the user and walk around the screen.

[0944] Scheduling and Reminders

[0945] Step 1:

[0946] A user adds a new task or event within the app.

[0947] Step 2:

[0948] The user sets the reminder time and date.

[0949] Step 3:

[0950] The terminal transmits the task and event information entered by the user to the server.

[0951] Step 4:

[0952] The server stores task and event information in a database.

[0953] Step 5:

[0954] Schedule the server to send notifications at set reminder times.

[0955] Step 6:

[0956] The server sends a reminder notification to the device at the specified time.

[0957] Step 7:

[0958] The device will receive a reminder notification and a character will display the reminder details on the screen.

[0959] Step 8:

[0960] The character will notify the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[0961] Generate messages of praise and encouragement

[0962] Step 1:

[0963] The user enters that the task has been completed within the app and presses the Complete button.

[0964] Step 2:

[0965] The terminal sends task completion information to the server.

[0966] Step 3:

[0967] The server receives the task completion information and generates a message of praise or encouragement.

[0968] Step 4:

[0969] The server sends the generated message back to the terminal.

[0970] Step 5:

[0971] The message received by the device is displayed on the character.

[0972] Step 6:

[0973] The character tells the user, "As expected! Thank you for your hard work."

[0974] Character exchange and sales

[0975] Step 1:

[0976] The user will be taken to the character exchange / sales screen.

[0977] Step 2:

[0978] The terminal sends a request to the server to display a list of characters that other users have made public.

[0979] Step 3:

[0980] The server returns the character list data to the device.

[0981] Step 4:

[0982] The terminal displays a list of characters to the user.

[0983] Step 5:

[0984] Users can choose their favorite character and send an exchange or purchase request.

[0985] Step 6:

[0986] The terminal sends a request from the user to the server.

[0987] Step 7:

[0988] The server receives the request and updates the character's ownership.

[0989] Step 8:

[0990] The server returns the updated character information to the terminal.

[0991] Step 9:

[0992] The terminal notifies the user of the updated character information.

[0993] Example 1

[0994] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0995] In today's world, users need to manage many daily tasks and schedules, but traditional schedule management tools and reminder functions lack the motivation to actively continue using them. While systems exist that allow users to enjoyably manage tasks through customizable characters, they lack sufficient functionality for character behavior and the ability to exchange and sell characters between users. Furthermore, there is a need for a system that automatically generates appropriate messages of praise and encouragement tailored to individual needs when users complete tasks.

[0996] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0997] In this invention, the server includes input means for a user to input customization options, generation means for generating a character based on the customization options, control means for controlling the behavior of the generated character, schedule management means for managing the user's schedule, notification means for notifying the user of reminders, message generation means for generating messages of praise or encouragement upon task completion, exchange / sale means for exchanging / selling the generated character with other users, and action script execution means for executing the character's action script in real time. This allows users to enjoy task management through customizable characters, effectively receive notifications of reminders and praise, and further enjoy interaction with other users by exchanging and selling characters.

[0998] An "input means" is a means by which a user inputs customization options.

[0999] "Generation means" means for generating a character based on customization options.

[1000] "Control means" refers to means for controlling the actions of the generated character.

[1001] The "schedule management means" is a means by which a character manages a user's schedule.

[1002] The "notification means" is a means by which a character notifies a user of a reminder.

[1003] The "message generating means" is a means for a character to generate a message of praise or encouragement when the user completes a task.

[1004] "Means for exchange and sale" refers to means for exchanging or selling generated characters with other users.

[1005] The "action script execution means" is a means for moving a character in real time and displaying a message to the user.

[1006] A "generative AI model" is an artificial intelligence model that generates characters based on customization options entered by a user.

[1007] A "prompt sentence" is an instruction sentence for character generation that is input to the generative AI model.

[1008] The present invention is a system in which a user creates a character customized based on their preferences, and the character manages the user's daily tasks. The present invention operates in cooperation with a user, a terminal, and a server. Specific embodiments for implementing the present invention are described below.

[1009] Character Generation

[1010] User

[1011] Users first launch the application and navigate to a customization options screen, where they enter details such as gender, hair color, body type, and clothing.

[1012] For example, enter customization options such as "Male gender, brown hair color, sporty clothing" and press the "Generate" button.

[1013] Terminal

[1014] The device sends the customization options entered by the user to the server using HTTP POST as the specific communication protocol.

[1015] server

[1016] The server uses a generative AI model (e.g., DALL-E or other artificial intelligence model) to generate a character based on the customization options specified by the user.

[1017] Example: The prompt sentence "Gender is male, hair color is brown, and sportswear is worn" is input into the generative AI model.

[1018] The server returns the generated character data to the device in JSON format.

[1019] Terminal

[1020] The device then draws the received character data and displays it on the user's screen. HTML5 Canvas or WebGL can be used for drawing.

[1021] Character movement control

[1022] Terminal

[1023] The device executes the character's movement script and controls the character's movements on the screen in real time, for example, using JavaScript.

[1024] The character will talk to the user and walk around the screen, for example saying "Good morning!"

[1025] Scheduling and Reminders

[1026] User

[1027] Users can add new tasks and events and set reminder times and dates.

[1028] Terminal

[1029] The device sends the tasks and event data set by the user to the server via an HTTP POST request.

[1030] server

[1031] The server stores task and event information in a database, using MySQL, using INSERT statements.

[1032] At the specified reminder time, the server sends a push notification to the device using Firebase Cloud Messaging (FCM).

[1033] Terminal

[1034] At the specified time, the device receives a notification and a character notifies the user, saying, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[1035] Generate messages of praise and encouragement

[1036] User

[1037] The user enters task completion in the app and presses the "Complete" button.

[1038] Terminal

[1039] The terminal sends task completion information to the server via an HTTP POST request.

[1040] server

[1041] The server uses a generative AI model (such as ChatGPT) based on task completion information to generate praise and encouraging messages.

[1042] Example: Enter the prompt "The user has completed the task. Please generate a compliment." into the AI ​​model.

[1043] The server returns the generated message to the terminal.

[1044] Terminal

[1045] The device displays the received message on the character. For example, the character tells the user, "As expected! Thank you for your hard work."

[1046] Character exchange and sales

[1047] User

[1048] The user goes to the character exchange / sales screen and checks the list of characters that other users have made public.

[1049] Choose your favorite character and submit a trade or purchase request.

[1050] Terminal

[1051] The terminal sends a request from the user to the server by using an HTTP POST request.

[1052] server

[1053] The server receives the request and updates the character information in the database. The database used is PostgreSQL, and the UPDATE statement is used.

[1054] The server verifies the ownership of the character and sends update information back to the device in JSON format.

[1055] Terminal

[1056] The device will display the updated character information on the screen and notify the user, for example, "Ownership of this character has been transferred to you."

[1057] With the above-described configuration, the present invention enables users to manage their daily tasks in a fun and effective manner using characters customized by the user.

[1058] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1059] Step 1:

[1060] User

[1061] Launch the app and go to the customization options screen.

[1062] Customization options include gender, hair color, body type, clothing, etc.

[1063] Input: Customization options data entered by the user (e.g., gender is male, hair color is brown, sportswear style)

[1064] Output: Customization options data is sent to the device.

[1065] Step 2:

[1066] Terminal

[1067] The customization option data entered by the user is sent to the server via an HTTP POST request.

[1068] Input: Customization options data entered by the user (gender, hair color, body type, clothing, etc.)

[1069] Output: Customization options data is sent to the server.

[1070] Step 3:

[1071] server

[1072] Based on the received customization option data, a prompt sentence is generated and passed to the generative AI model (e.g., DALL-E).

[1073] A generative AI model generates characters based on customization options.

[1074] Input: Customization option data (e.g., prompt text "Gender is male, hair color is brown, and sportswear is worn")

[1075] Output: The generated character data (JSON format) is saved on the server.

[1076] Step 4:

[1077] server

[1078] The generated character data is returned to the device in JSON format as an HTTP response.

[1079] Input: Generated character data (JSON format)

[1080] Output: Character data is sent to the terminal.

[1081] Step 5:

[1082] Terminal

[1083] The received character data is analyzed and the character is drawn on the user's screen using a drawing engine (e.g. HTML5 Canvas or WebGL).

[1084] Input: Generated character data (JSON format)

[1085] Output: The customized character that is displayed on the user's screen.

[1086] Step 6:

[1087] Terminal

[1088] The character's action script is executed, and the character moves in real time to greet the user, for example.

[1089] Input: Character movement script

[1090] Output: A character that acts on the screen (e.g., says "Good morning!").

[1091] Step 7:

[1092] User

[1093] Add new tasks and events within the app and set reminder times and dates.

[1094] Input: Task and event information set by the user, as well as reminder times and dates

[1095] Output: The configured task and event information is sent to the device.

[1096] Step 8:

[1097] Terminal

[1098] Tasks and event data set by the user are sent to the server via an HTTP POST request.

[1099] Input: Task and event data set by the user

[1100] Output: Task and event data is sent to the server.

[1101] Step 9:

[1102] server

[1103] Save the received task and event data in a database (e.g. MySQL) using INSERT statements.

[1104] Input: Task and event data

[1105] Output: Task and event information stored in a database.

[1106] Step 10:

[1107] server

[1108] When the set reminder time arrives, a push notification is sent to the device using FCM (Firebase Cloud Messaging).

[1109] Input: Reminder time information

[1110] Output: The push notification sent to the device.

[1111] Step 11:

[1112] Terminal

[1113] When the specified time arrives, the user will receive a notification and a character will notify them, saying, "Mr. / Ms. XX, there will be a meeting in 15 minutes."

[1114] Input: Push notification from the server

[1115] Output: A reminder notification that appears on the screen.

[1116] Step 12:

[1117] User

[1118] Enter task completion in the app and press the "Complete" button.

[1119] Input: Completed task information (user input)

[1120] Output: Completion information is sent to the terminal.

[1121] Step 13:

[1122] Terminal

[1123] Completed task information is sent to the server via an HTTP POST request.

[1124] Input: Completed task information

[1125] Output: Completion information is sent to the server.

[1126] Step 14:

[1127] server

[1128] Based on the completion information, a prompt message is generated and passed to a generative AI model (e.g., ChatGPT) to generate a message of praise or encouragement.

[1129] Input: Completion information and message generation prompt (e.g., "The user has completed the task. Please generate a compliment.")

[1130] Output: The generated message.

[1131] Step 15:

[1132] server

[1133] The generated message is sent back to the terminal.

[1134] Input: The generated message

[1135] Output: The message is sent to the terminal.

[1136] Step 16:

[1137] Terminal

[1138] Display the received message on the character.

[1139] Input: The generated message

[1140] Output: A message of praise or encouragement that is displayed on the screen (e.g., "Great job!").

[1141] Step 17:

[1142] User

[1143] Go to the character exchange / sales screen and check the list of characters posted by other users. Select the character you like and send an exchange or purchase request.

[1144] Input: Character exchange / sale request

[1145] Output: The request is sent to the terminal.

[1146] Step 18:

[1147] Terminal

[1148] The user's request is sent to the server via an HTTP POST request.

[1149] Input: Character exchange / sale request

[1150] Output: The request is sent to the server.

[1151] Step 19:

[1152] server

[1153] Receives the request and updates the character information in the database (e.g., PostgreSQL) using the UPDATE statement.

[1154] Input: Character information update request

[1155] Output: The updates stored in the database.

[1156] Step 20:

[1157] server

[1158] Confirms character ownership and returns update information in JSON format to the device.

[1159] Input: Updated character information

[1160] Output: Character information with updated ownership.

[1161] Step 21:

[1162] Terminal

[1163] The updated character information is displayed on the screen to notify the user.

[1164] Input: Updated character information

[1165] Output: The user is notified that "Ownership of this character has been transferred to you."

[1166] Through the above processing steps, users can enjoy managing tasks using customizable characters, receive reminders and praise notifications effectively, and enjoy interacting with other users by exchanging and selling characters.

[1167] (Application example 1)

[1168] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1169] The present invention aims to provide a system that not only supports daily task and schedule management but also assists users in purchasing products in an enjoyable and efficient manner by utilizing characters customized based on the user's preferences. Many current online shopping sites have problems in that product recommendations and purchasing procedures are mechanical and not sufficiently personalized for users. Furthermore, there is a problem in that schedule management and task completion notifications do not provide an attractive user experience. To solve these problems, a new system is needed.

[1170] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1171] In this invention, the server includes an input means for a user to input customization options, a generation means for generating a character based on the customization options using a generative AI model, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate messages of praise and encouragement when the user completes a task, and a navigation means for the character to recommend products to the user and assist with purchasing procedures. This allows users to enjoyably and efficiently manage their daily tasks and purchase products through characters customized to their preferences.

[1172] A "user" is a person who uses the system.

[1173] "Customization options" are input items that allow the user to set options such as the character's gender, hairstyle, and clothing.

[1174] An "input means" is a device or interface through which a user inputs customization options.

[1175] "Generator" refers to a function or device that generates a character based on customization options entered by the user.

[1176] A "generative AI model" is an artificial intelligence model that uses machine learning algorithms to generate characters.

[1177] "Control means" refers to a function or device that manages and controls the actions of the generated character.

[1178] "Schedule management means" refers to a function or device that allows a character to manage the user's schedule and tasks.

[1179] "Notification means" refers to a function or device that allows a character to notify the user of reminders or alerts.

[1180] The "message generating means" is a function or device that allows a character to create a message of praise or encouragement when the user completes a task.

[1181] "Navigation means" refers to a function or device that allows a character to recommend products to users and assist them in the purchasing process.

[1182] The system for implementing this invention uses a user-customized character to assist with daily tasks, schedule management, and navigation on online shopping sites. The entire system is configured with the user's smartphone at its center, with a server and terminals working together.

[1183] Character Generation

[1184] The user launches the app and navigates to the customization options screen. They enter options such as gender, hairstyle, hair color, and clothing, and press the "Generate" button. The device then sends these customization options to the server. The server uses a generative AI model to generate a character based on the customization options and sends the data back to the device. The device then renders the received character data and displays it on the user's screen.

[1185] The generative AI model used is a generative model with an advanced algorithm, such as GPT-4.

[1186] Character movement control

[1187] The character's behavior script is executed by the device and runs in real time on the screen. The character talks to the user and moves around the screen. The software used for this is an application building framework such as Flutter or React Native.

[1188] Scheduling and Reminders

[1189] The user adds a new task or event and sets the time and date of the reminder. This information is sent from the device to the server, where it is stored in a database (e.g., AWS DynamoDB or Firebase Firestore). When the specified time arrives, the server sends a reminder notification to the device, and a character displays the reminder details on the screen.

[1190] Message Generation

[1191] When a user enters their task completion status in the app and presses the "Done" button, the device sends this information to the server, which then generates a message of praise or encouragement based on the information received and sends it back to the device. A character then conveys this message to the user.

[1192] Product Recommendation and Navigation

[1193] The character recommends products based on the user's purchase history and preferences. When the user visits a product page, the character explains the product's features and guides the user through the purchase process. The character also allows the user to set subscription reminders and notify the user accordingly.

[1194] An example of a specific prompt is as follows:

[1195] Generate your character based on the following customization options:

[1196] Gender: Female

[1197] Hairstyle: Long

[1198] Hair Color: Brown

[1199] Dress Code: Casual

[1200] The generated character will act as an assistant, managing the user's calendar and tasks, and recommending products.

[1201] This system allows users to manage their daily tasks and purchase products in a fun and efficient way through characters they customize to their liking.

[1202] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1203] Step 1:

[1204] The user launches the app and navigates to the customization options screen, where they input customization options such as gender, hairstyle, hair color, and clothing. By pressing the "Generate" button, these options are input into the device.

[1205] Step 2:

[1206] The device sends the customization options entered by the user to the server, including information such as gender, hairstyle, hair color, and clothing. The data is sent using a REST API.

[1207] Step 3:

[1208] The server calls a generative AI model based on the received customization options to generate a character. The generative AI model (e.g., OpenAI GPT-4) receives the prompt as input and generates a customized character. The generated character data is sent back to the device from the server.

[1209] Step 4:

[1210] The device then renders the received character data and displays it on the user's screen, allowing the customized character to move in real time and providing the user with an interactive experience.

[1211] Step 5:

[1212] When a user adds a new task or event, the information is entered into the device, the user sets the time and date for the reminder, and the information is sent from the device to the server.

[1213] Step 6:

[1214] The server saves the submitted task and event information in a database, for example, a cloud database such as AWS DynamoDB or Firebase Firestore, and triggers a notification when the set reminder time arrives.

[1215] Step 7:

[1216] When the device receives a reminder notification from the server, a character displays the details of the reminder on the screen and speaks to the user, saying, "Mr. / Ms. XX, you have a meeting in 15 minutes."

[1217] Step 8:

[1218] When a user completes a task, they input the completion information into the terminal. The terminal then sends the task completion information to the server. The server then generates a message of praise or encouragement based on the task completion information.

[1219] Step 9:

[1220] The server sends the generated message back to the terminal. The terminal displays this message on the character. The character tells the user, "You're amazing! Thank you for your hard work."

[1221] Step 10:

[1222] If a user wants to receive product recommendations, the character will recommend products based on the user's purchase history and preferences. While the user is browsing the product page, the character will explain the product's features and guide the user through the purchase process.

[1223] Step 11:

[1224] When a user sets a subscription reminder, the information is sent to the server via the device, and the server triggers a notification based on the set reminder time, with a character informing the user, "Today is the day to order your subscription!"

[1225] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1226] The present invention is a system in which a character created by a user through input of customization options manages the user's daily tasks, and further has the function of recognizing the user's emotions and appropriately changing behaviors and messages. The present invention operates in cooperation with the user, terminal, and server.

[1227] Overall system configuration

[1228] The system according to the present invention includes an input means for a user to input customization options, a generation means for generating a character based on the customization options, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate messages of praise or encouragement when the user completes a task, an emotion recognition means for recognizing the user's emotions, and an exchange / sales means for the user to exchange or sell the generated character with other users. Furthermore, the emotion recognition means uses an emotion engine that analyzes the user's voice and facial expressions.

[1229] Specific program operation explanation

[1230] Character Generation

[1231] User

[1232] 1. Launch the app and go to the customization options screen.

[1233] 2. Enter customization options such as gender, hair color, body type, and clothing, and press the "Generate" button.

[1234] Terminal

[1235] 1. Sends the customization options entered by the user to the server.

[1236] server

[1237] 1. Using a generative AI model, we generate a character based on submitted customization options.

[1238] 2. The generated character data (images and animations) is sent back to the device.

[1239] Terminal

[1240] 1. Analyze the received character data and display it on the user's screen.

[1241] Character movement control

[1242] Terminal

[1243] 1. Load and execute the character's movement script.

[1244] 2. Depict the character's movements on the screen in real time.

[1245] 3. Have the character talk to the user and walk around the screen.

[1246] Scheduling and Reminders

[1247] User

[1248] 1. Add a new task or event within the app.

[1249] 2. Set the reminder time and date.

[1250] Terminal

[1251] 1. Send the task and event information entered by the user to the server.

[1252] server

[1253] 1. Store task and event information in a database.

[1254] 2. Set a schedule to send notifications at set reminder times.

[1255] server

[1256] 1. Send a reminder notification to your device at the specified time.

[1257] Terminal

[1258] 1. When you receive a reminder notification, a character will display the reminder details on the screen.

[1259] 2. The character notifies the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[1260] Generate messages of praise and encouragement

[1261] User

[1262] 1. Enter the completion of the task in the app and press the Complete button.

[1263] Terminal

[1264] 1. Send task completion information to the server.

[1265] server

[1266] 1. Receive task completion information and generate messages of praise and encouragement.

[1267] 2. Send the generated message back to the terminal.

[1268] Terminal

[1269] 1. Display the received message on the character.

[1270] 2. The character tells the user, "As expected! Thank you for your hard work."

[1271] emotion recognition

[1272] Terminal

[1273] 1. An emotion recognition means (emotion engine) is used to analyze the user's voice and facial expressions in real time.

[1274] 2. Send the user's emotional state to the server.

[1275] server

[1276] 1. Generate instructions to automatically change the character's behavior and message content based on the user's emotional state.

[1277] 2. Send the generated instructions back to the terminal.

[1278] Terminal

[1279] 1. Update the character's actions and message content based on the instructions received.

[1280] 2. The character will respond appropriately to the user's emotions.

[1281] Character exchange and sales

[1282] User

[1283] 1. Go to the character exchange / sales screen.

[1284] 2. Check the character lists published by other users.

[1285] 3. Choose your favorite character and send an exchange or purchase request.

[1286] Terminal

[1287] 1. Send a request from the user to the server.

[1288] server

[1289] 1. Receive the request and update the character information.

[1290] 2. Verify character ownership and send update information back to your device.

[1291] Terminal

[1292] 1. Notify the user of updated character information.

[1293] Specific examples

[1294] For example, if user A sets an alarm for 7:00 a.m. and then checks his / her schedule for the day, the system operates as follows:

[1295] User A launches the app, enters "Set alarm for 7:00" and saves it.

[1296] The terminal transmits the alarm information to the server.

[1297] The server saves the alarm settings and notifies the device at the specified time.

[1298] At the set time, the device will receive a notification and the character will say, "Good morning, today's schedule is..."

[1299] User A checks the calendar and a character reads out today's schedule.

[1300] Furthermore, the character recognizes user A's emotions and, for example, if user A is feeling a little down, provides an encouraging message such as, "Why don't you take a walk today to refresh your mood?"

[1301] In this way, users can not only manage their daily tasks in a fun and efficient way through the characters, but also receive support that is tailored to their emotional state at the time.

[1302] The processing flow will be explained below.

[1303] Specific processing steps of the program

[1304] Character Generation

[1305] Step 1:

[1306] The user launches the app and navigates to the customization options screen.

[1307] Step 2:

[1308] The user enters customization options such as gender, hair color, body type, and clothing, and presses the "Generate" button.

[1309] Step 3:

[1310] The terminal transmits the customization options entered by the user to the server.

[1311] Step 4:

[1312] The server passes the received customization options to the generative AI model.

[1313] Step 5:

[1314] The server uses a generative AI model to generate a character based on customization options.

[1315] Step 6:

[1316] The server returns the generated character data (images and animations) to the device.

[1317] Step 7:

[1318] The terminal analyzes the received character data and displays it on the user's screen.

[1319] Character movement control

[1320] Step 1:

[1321] The device loads and executes the character's movement script.

[1322] Step 2:

[1323] The device depicts the character's movements on the screen in real time.

[1324] Step 3:

[1325] The device causes the character to talk to the user and walk around the screen.

[1326] Scheduling and Reminders

[1327] Step 1:

[1328] A user adds a new task or event within the app.

[1329] Step 2:

[1330] The user sets the reminder time and date.

[1331] Step 3:

[1332] The terminal transmits the task and event information entered by the user to the server.

[1333] Step 4:

[1334] The server stores task and event information in a database.

[1335] Step 5:

[1336] Schedule the server to send notifications at set reminder times.

[1337] Step 6:

[1338] The server sends a reminder notification to the device at the specified time.

[1339] Step 7:

[1340] The device will receive a reminder notification and a character will display the reminder details on the screen.

[1341] Step 8:

[1342] The character will notify the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[1343] Generate messages of praise and encouragement

[1344] Step 1:

[1345] The user enters that the task has been completed within the app and presses the Complete button.

[1346] Step 2:

[1347] The terminal sends task completion information to the server.

[1348] Step 3:

[1349] The server receives the task completion information and generates a message of praise or encouragement.

[1350] Step 4:

[1351] The server sends the generated message back to the terminal.

[1352] Step 5:

[1353] The message received by the device is displayed on the character.

[1354] Step 6:

[1355] The character tells the user, "As expected! Thank you for your hard work."

[1356] emotion recognition

[1357] Step 1:

[1358] The device uses an emotion recognition means (emotion engine) to analyze the user's voice and facial expressions in real time.

[1359] Step 2:

[1360] The terminal transmits the user's emotional state to the server.

[1361] Step 3:

[1362] The server generates instructions to automatically change the character's behavior and message content based on the user's emotional state.

[1363] Step 4:

[1364] The server sends the generated instructions back to the terminal.

[1365] Step 5:

[1366] The character's movements and message content are updated based on the instructions received by the device.

[1367] Step 6:

[1368] The character will respond appropriately to the user's emotions.

[1369] For example, if the user is feeling down, the character might suggest, "Why not take a walk today to refresh your mood?"

[1370] Character exchange and sales

[1371] Step 1:

[1372] The user will be taken to the character exchange / sales screen.

[1373] Step 2:

[1374] The terminal sends a request to the server to display a list of characters that other users have made public.

[1375] Step 3:

[1376] The server returns the character list data to the device.

[1377] Step 4:

[1378] The terminal displays a list of characters to the user.

[1379] Step 5:

[1380] Users can choose their favorite character and send an exchange or purchase request.

[1381] Step 6:

[1382] The terminal sends a request from the user to the server.

[1383] Step 7:

[1384] The server receives the request and updates the character's ownership.

[1385] Step 8:

[1386] The server returns the updated character information to the terminal.

[1387] Step 9:

[1388] The terminal notifies the user of the updated character information.

[1389] Example 2

[1390] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1391] In conventional task management systems, it was difficult for users to receive appropriate support that took their emotional state into consideration. Furthermore, there were few interactive task management methods through characters, and the system lacked features to enhance user motivation. Furthermore, character customization and sharing functions were limited, limiting the user experience.

[1392] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an input means for a user to input customization options, a generation means for generating a character using a generative AI model, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate a message of praise or encouragement when the user completes a task, an emotion recognition means for analyzing the user's voice and facial expressions, an emotion adaptation means for changing the character's behavior and message content based on the emotional state recognized by the emotion recognition means, and an exchange / sales means for exchanging or selling the user-generated character with other users. This enables users to perform interactive and motivational task management while receiving appropriate support according to their emotions. Furthermore, the range of character customization and sharing is expanded, providing a rich user experience.

[1393] An "input means" is a device or interface through which a user inputs customization options.

[1394] "Generation means" refers to a mechanism or program for generating a character based on input customization options.

[1395] "Control means" refers to a system or program for managing and controlling the actions of the generated character.

[1396] "Schedule management means" refers to functions and programs that allow a character to manage a user's schedule and tasks.

[1397] "Notification means" refers to a function or program that allows a character to send reminders or other notifications to the user.

[1398] The "message generating means" is a mechanism or program that allows a character to generate a message of praise or encouragement when the user completes a task.

[1399] "Emotion recognition means" refers to a system or program for analyzing the user's voice and facial expressions to recognize their emotions.

[1400] The "emotion adaptation means" is a function or program for automatically changing the character's behavior or message content based on the emotional state recognized by the emotion recognition means.

[1401] "Exchange / sales means" refers to the functions and interfaces for exchanging or selling characters created by a user with other users.

[1402] A "generative AI model" is an artificial intelligence model that generates characters according to customization options entered by a user.

[1403] The present invention is a system in which a character created by a user through input of customization options manages the user's daily tasks, and further has the function of recognizing the user's emotions and appropriately changing behaviors and messages. Specific embodiments of the present invention will be described below.

[1404] Character Generation

[1405] User

[1406] 1. Launch the app on your smartphone or tablet and go to the customization options screen.

[1407] 2. Enter customization options such as gender, hair color, body type, and clothing, and press the "Generate" button.

[1408] Terminal

[1409] 1. The customization options entered by the user are sent to the server using a REST API, and the data is sent in JSON format.

[1410] server

[1411] 1. On the server, a generative AI model (e.g., OpenAI's API) generates a character based on the customization options. This generative AI model is an artificial intelligence model that generates a character corresponding to the input data.

[1412] 2. The generated character data (images and animations) is sent back to the device.

[1413] Terminal

[1414] 1. Analyze the received character data and display it on the user's screen. The analyzed data is displayed through a UI component.

[1415] Character movement control

[1416] Terminal

[1417] 1. Load and execute the character's movement script. The movement script is written in a scripting language such as JavaScript.

[1418] 2. Depicting the character's movements on the screen in real time, using a rendering loop to generate and draw animation frames.

[1419] 3. Have the character talk to the user and walk around the screen.

[1420] Scheduling and Reminders

[1421] User

[1422] 1. Add a new task or event within the app.

[1423] 2. Set the reminder time and date.

[1424] Terminal

[1425] 1. Task and event information entered by the user is sent to the server in JSON format.

[1426] server

[1427] 1. The server stores the received task and event information in a database, such as MySQL or MongoDB.

[1428] 2. Use task scheduling features (e.g. cron jobs) to send notifications at set reminder times.

[1429] server

[1430] 1. At the specified time, a reminder notification is sent to the device using a push notification service (e.g., Firebase Cloud Messaging).

[1431] Terminal

[1432] 1. When you receive a reminder notification, a character will display the reminder details on the screen.

[1433] 2. The character notifies the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[1434] Generate messages of praise and encouragement

[1435] User

[1436] 1. Enter the completion of the task in the app and press the Complete button.

[1437] Terminal

[1438] 1. Send task completion information to the server.

[1439] server

[1440] 1. Receive task completion information and generate praise and encouraging messages using an AI model (e.g., GPT-3).

[1441] 2. Send the generated message back to the terminal.

[1442] Terminal

[1443] 1. Display the received message on the character.

[1444] 2. The character tells the user, "As expected! Thank you for your hard work."

[1445] emotion recognition

[1446] Terminal

[1447] 1. Analyze the user's voice and facial expressions in real time using speech recognition APIs and facial recognition APIs. An example is Microsoft Azure's emotion recognition API.

[1448] 2. The user's emotional state is sent to the server in JSON format.

[1449] server

[1450] 1. Generate instructions to automatically change the character's behavior and message content based on the user's emotional state.

[1451] 2. Send the generated instructions back to the terminal.

[1452] Terminal

[1453] 1. Update the character's actions and message content based on the instructions received.

[1454] 2. The character will respond appropriately to the user's emotions.

[1455] Character exchange and sales

[1456] User

[1457] 1. Go to the character exchange / sales screen.

[1458] 2. Check the character lists published by other users.

[1459] 3. Choose your favorite character and send an exchange or purchase request.

[1460] Terminal

[1461] 1. The user's request is sent to the server in JSON format.

[1462] server

[1463] 1. Receive the request and update the character information.

[1464] 2. Verify character ownership and send update information back to your device.

[1465] Terminal

[1466] 1. Notify the user of updated character information.

[1467] Specific examples

[1468] For example, if user A sets an alarm for 7:00 a.m. and then checks his / her schedule for the day, the system operates as follows:

[1469] User A launches the app, enters "Set alarm for 7:00" and saves it.

[1470] The terminal transmits the alarm information to the server.

[1471] The server saves the alarm settings and notifies the device at the specified time.

[1472] At the set time, the device will receive a notification and the character will say, "Good morning, today's schedule is..."

[1473] User A checks the calendar and a character reads out today's schedule.

[1474] Furthermore, the character recognizes user A's emotions and, for example, if user A is feeling a little down, provides an encouraging message such as, "Why don't you take a walk today to refresh your mood?"

[1475] Prompt Sentence Examples

[1476] "Describe a system where a user can input customization options to generate a character, which then manages the user's daily tasks and reacts appropriately using emotion recognition."

[1477] In this way, users can not only manage their daily tasks in a fun and efficient way through the characters, but also receive support that is tailored to their emotional state at the time.

[1478] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1479] Step 1:

[1480] The user launches the app on their smartphone or tablet and navigates to the customization options screen. They enter customization options such as gender, hair color, body type, and clothing, and press the "Generate" button. The input at this time is the customization information specified by the user. The output is data based on the customization options.

[1481] Step 2:

[1482] The terminal sends the customization options entered by the user to the server using the REST API, and the data is sent in JSON format. The input is the user's customization option data, and the output is the data transferred to the server in JSON format.

[1483] Step 3:

[1484] The server inputs the received customization options into a generative AI model (e.g., OpenAI's API). The generative AI model generates character images and animations based on the input data. The input is customization option data, and the output is the generated character data (images and animations).

[1485] Step 4:

[1486] The server returns the generated character data in JSON format to the terminal, and an HTTP response containing the generated character data is returned as output.

[1487] Step 5:

[1488] The device analyzes the received character data and displays it on the user's screen. The input is the character data received from the server, and the output is the character image or animation displayed on the screen. Specifically, the character is displayed through a UI component.

[1489] Step 6:

[1490] Users can add new tasks and events within the app and set reminder times and dates, with inputs including task and event information and reminder settings.

[1491] Step 7:

[1492] The terminal sends task and event information entered by the user to the server. The input is the task and event information set by the user, and the output is data sent to the server in JSON format.

[1493] Step 8:

[1494] The server stores the received task and event information in a database. The database used is MySQL, MongoDB, etc. The input is task and event information, and the output is the data stored in the database.

[1495] Step 9:

[1496] The server uses a task scheduling facility (e.g. a cron job) to send notifications at the reminder time. The input is the reminder configuration information, and the output is the notification action to be scheduled.

[1497] Step 10:

[1498] The server sends a reminder notification to the device at the specified time using a push notification service (e.g., Firebase Cloud Messaging). The input is the reminder schedule data, and the output is the notification data sent to the device.

[1499] Step 11:

[1500] The device receives the reminder notification and a character displays the reminder content on the screen. The input is the notification data sent from the server, and the output is the reminder content displayed on the screen.

[1501] Step 12:

[1502] The character notifies the user, for example, "Mr. / Ms. XX, you have a meeting in 15 minutes." Specifically, it uses a speech synthesis API to speak the notification message and displays an animation.

[1503] Step 13:

[1504] The user inputs the task completion information in the app and presses the completion button.

[1505] Step 14:

[1506] The terminal sends task completion information to the server. The input is the task completion information entered by the user, and the output is the data sent to the server.

[1507] Step 15:

[1508] The server receives task completion information and generates messages of praise or encouragement. The messages are generated using an AI model (e.g., GPT-3). The input is the task completion information, and the output is the generated message.

[1509] Step 16:

[1510] The server sends the generated message back to the terminal, which returns an HTTP response containing the generated message as output.

[1511] Step 17:

[1512] The terminal displays the received message on the character and tells the user, "You're amazing! Thank you for your hard work." The input is the generated message data, and the output is the character's voice and animation.

[1513] Step 18:

[1514] The device analyzes the user's voice and facial expressions in real time using a voice recognition API or a face recognition API. As an example, we use Microsoft Azure's emotion recognition API. The input is the user's voice and facial expression data, and the output is analyzed emotional data.

[1515] Step 19:

[1516] The terminal transmits its emotional state to the server. The input is the analyzed emotional data, and the output is the data sent to the server.

[1517] Step 20:

[1518] The server generates instructions to automatically change the character's behavior and message content based on the emotional state. The input is emotional data, and the output is instructions regarding the character's behavior and message content.

[1519] Step 21:

[1520] The server returns the generated instructions to the terminal, and an HTTP response is returned containing the generated instruction data as output.

[1521] Step 22:

[1522] The terminal updates the character's actions and message content based on the received instructions. The input is the generated instruction data, and the output is the updated character's actions and messages.

[1523] Step 23:

[1524] The character will respond appropriately to the user's emotions, changing its facial expressions and movements in real time to match the emotion.

[1525] Step 24:

[1526] The user moves to the character exchange / sales screen. The input is a screen transition request.

[1527] Step 25:

[1528] The user checks the character lists published by other users. The input is a character list display request, and the output is the displayed character list.

[1529] Step 26:

[1530] The user selects a character they like and sends a request to exchange or purchase it. The input is the character selection and request data, and the output is the data to be sent to the server.

[1531] Step 27:

[1532] The terminal sends requests from users to the server. The input is the exchange / purchase request data, and the output is the data to be sent to the server.

[1533] Step 28:

[1534] The server receives the request and updates the character information. The input is the received request data, and the output is the updated character information.

[1535] Step 29:

[1536] The server verifies the ownership of the character and sends the updated information back to the device, which returns an HTTP response containing the updated character information as output.

[1537] Step 30:

[1538] The terminal notifies the user of the updated character information. The input is the updated character information, and the output is a notification displayed on the screen.

[1539] (Application example 2)

[1540] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1541] While conventional character-based systems were capable of managing users' schedules and tasks, they struggled to respond to users' emotional changes in real time or provide appropriate entertainment and navigation information in autonomous vehicles. Furthermore, they lacked a system for optimizing the in-car user experience, resulting in problems that reduced user comfort and usage efficiency.

[1542] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1543] In this invention, the server includes an input means for a user to input customization options, a generation means for generating a character based on the customization options, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate messages of praise or encouragement when the user completes a task, an entertainment means for the character to provide entertainment and navigation information within the autonomous vehicle, and an emotion recognition means for recognizing the user's emotions within the autonomous vehicle and changing the character's behavior and message content based on the emotions. This optimizes the user's experience within the autonomous vehicle, enabling comfortable and efficient use.

[1544] An "input means" is a device through which a user inputs customization options.

[1545] "Generator" means a device for generating a character based on customization options.

[1546] "Control means" refers to a device for controlling the actions of the generated character.

[1547] The "schedule management means" is a device that allows the character to manage the user's schedule.

[1548] The "notification means" is a device that allows the character to notify the user of a reminder.

[1549] The "message generating means" is a device that allows a character to generate a message of praise or encouragement when the user completes a task.

[1550] An "entertainment vehicle" is a device that allows a character to provide entertainment or navigation information within an autonomous vehicle.

[1551] The "emotion recognition means" is a device that recognizes the emotions of the user inside the autonomous vehicle and changes the character's behavior and message content based on those emotions.

[1552] The present invention provides a system that utilizes a user-customized character in an autonomous vehicle to provide entertainment, navigation, task management, and situational responses based on the user's emotions. This system operates in cooperation with the user, a terminal, and a server.

[1553] Overall system configuration

[1554] The system according to the present invention comprises the following main components:

[1555] Input means: A device through which users input customization options. This is implemented as a smartphone app.

[1556] Generator: A device that generates characters based on customization options. It uses a generative AI model (e.g., GPT-4) on a server.

[1557] Control means: A device that controls the actions of the generated character. It is executed in real time on the terminal.

[1558] Schedule management tool: A device in which a character manages the user's schedule. It is incorporated into a smartphone app.

[1559] Notification method: A character notifies the user of reminders. This is achieved through push notifications on smartphones.

[1560] Message Generation Means: A device that generates messages of praise and encouragement when a character completes a task. Executed on the server.

[1561] Entertainment: A device in which characters provide entertainment and navigation information inside an autonomous vehicle, using in-car displays and voice assistants.

[1562] Emotion recognition means: A device that recognizes the user's emotions inside the autonomous vehicle and changes the character's behavior and message content based on those emotions. It uses a camera, microphone, and emotion engine (e.g., Azure Emotion API).

[1563] Program processing overview

[1564] The system begins with the user customizing their character through a smartphone app. The customized options are sent from the device to a server, which then generates the character using a generative AI model. The generated character data is then sent back to the device, where it can be displayed and controlled in real time.

[1565] When a user inputs schedules and tasks while driving, the information is stored and managed on the server and sent to the device as reminders when necessary. In addition, when the user completes a task, the character generates a message of praise or encouragement that is displayed on the device.

[1566] Furthermore, the user's emotions are analyzed in real time through the in-car camera and microphone, and the character's behavior and messages change automatically depending on the user's emotions. This is done using an emotion engine (e.g., Azure Emotion API).

[1567] Specific examples

[1568] For example, consider a user who wants to create a customized character in the morning. The user launches the app and inputs the character's gender, hair color, clothing, etc.

[1569] An example prompt might look like this:

[1570] Character Gender: Male

[1571] Hair Color: Black

[1572] Dress Code: Casual

[1573] When the user presses the generate button, the device sends these customization options to the server, which uses a generative AI model (e.g., GPT-4) to generate a character and sends the data back to the device, which then displays the generated character in real time.

[1574] Additionally, when a user inputs their next destination in an autonomous vehicle, that information is also sent to the server, and a character provides entertainment and navigation information through the in-car display. The user's emotions are analyzed, and the character responds appropriately with appropriate responses and messages. For example, if the user is feeling stressed while driving, the character may suggest, "Would you like me to play some relaxing music?"

[1575] In this way, the system optimizes the user's experience inside the autonomous vehicle, ensuring a comfortable and efficient use.

[1576] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1577] Step 1:

[1578] User: Launches the app and enters customization options. The user selects options such as gender, hair color, and clothing, and presses the generate button.

[1579] Input: Customization options such as gender, hair color, clothing, etc.

[1580] Output: The customization options are entered into the terminal.

[1581] Step 2:

[1582] Terminal: Sends the entered customization options to the server.

[1583] Input: Customization option data entered by the user.

[1584] Data Calculation: Converts input data into an appropriate format and sends it over the network to the server.

[1585] Output: Customization options data is sent to the server.

[1586] Step 3:

[1587] Server: Uses a generative AI model (e.g. GPT-4) to generate a character based on customization options.

[1588] Input: Customization option data sent from the device.

[1589] Data calculation: Enter the following as a prompt into the generation AI model to generate a character.

[1590] Character Gender: Male

[1591] Hair Color: Black

[1592] Dress Code: Casual

[1593] Output: Generated character data (images and animations).

[1594] Step 4:

[1595] Server: Returns the generated character data to the device.

[1596] Input: Generated character data.

[1597] Data calculation: Converts character data into an appropriate format and sends it to the terminal via the network.

[1598] Output: Character data is sent to the terminal.

[1599] Step 5:

[1600] Terminal: Displays the received character data and controls the character's actions.

[1601] Input: Character data sent from the server.

[1602] Data calculation: Analyzes character data and converts it into a format that can be displayed on the screen.

[1603] Output: The character is displayed on the user's smartphone or in-car display.

[1604] Step 6:

[1605] User: Enter schedule and tasks in the app, enter next destination and appointment information, and press the save button.

[1606] Input: Schedule, task information, and destination information.

[1607] Output: The entered information is saved on the device.

[1608] Step 7:

[1609] Terminal: Sends schedule and task information entered by the user to the server.

[1610] Input: Schedule and task information entered by the user.

[1611] Data Calculation: Converts input data into an appropriate format and sends it over the network to the server.

[1612] Output: Schedule and task information is sent to the server.

[1613] Step 8:

[1614] Server: Stores schedule and task information and sends notifications to devices when reminders are due.

[1615] Input: Schedule and task information sent from the device.

[1616] Data calculation: Save schedule and task information in a database and set reminder timings.

[1617] Output: A reminder will be ready to be sent when an event occurs.

[1618] Step 9:

[1619] Server: Sends a notification to the device when the reminder time arrives.

[1620] Input: Reminder time and corresponding task information.

[1621] Data calculation: Generates reminder notifications and sends them to the device over the network.

[1622] Output: A reminder notification is sent to the device.

[1623] Step 10:

[1624] Device: Receive reminder notifications and notify the user via a character.

[1625] Input: Reminder notification from the server.

[1626] Data Calculation: Analyzes reminder notifications and displays them as character messages.

[1627] Output: The character informs the user, "Dear Mr. / Ms. X, you have a meeting in 15 minutes."

[1628] Step 11:

[1629] User: Enter task completion in the app and press the Complete button.

[1630] Input: Task completion information.

[1631] Output: The entered task completion information is saved on the device.

[1632] Step 12:

[1633] Terminal: Sends task completion information to the server.

[1634] Input: Task completion information entered by the user.

[1635] Data calculation: Convert the task completion information data into an appropriate format and send it to the server via the network.

[1636] Output: Task completion information is sent to the server.

[1637] Step 13:

[1638] Server: Receives task completion information and generates praise and encouragement messages.

[1639] Input: Task completion information sent from the terminal.

[1640] Data Computing: Using a message generation AI model, we generate messages of praise and encouragement.

[1641] Output: The generated message.

[1642] Step 14:

[1643] Server: Returns the generated message to the device.

[1644] Input: A generated message of praise or encouragement.

[1645] Data Calculation: Converts message data into an appropriate format and sends it to the terminal over the network.

[1646] Output: The message is sent to the terminal.

[1647] Step 15:

[1648] Terminal: Displays received messages to the character.

[1649] Input: A message of praise or encouragement sent by the server.

[1650] Data Calculation: Parses messages and converts them into a format that the character can display.

[1651] Output: The character tells the user, "You're amazing! Great job!"

[1652] Step 16:

[1653] Device: Uses a camera and microphone to analyze the user's emotions in real time and send them to the server.

[1654] Input: User's facial and voice data.

[1655] Data calculation: Analyze using an emotion engine (e.g., Azure Emotion API) to generate emotion data.

[1656] Output: Emotion data is sent to the server.

[1657] Step 17:

[1658] Server: Generates instructions to change the character's behavior and message content based on the user's emotional data and sends them back to the device.

[1659] Input: Emotion data sent from the device.

[1660] Data calculation: Generates character movement instructions and message content based on emotional data.

[1661] Output: Operation instructions and message content are sent to the terminal.

[1662] Step 18:

[1663] Terminal: Updates character behavior and message content based on received instructions.

[1664] Input: Operation instructions and message content sent from the server.

[1665] Data calculation: Analyzes action instructions and messages and reflects them on the character.

[1666] Output: The character responds in real time according to the emotion.

[1667] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1668] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1669] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1670] [Third embodiment]

[1671] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1672] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1673] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1674] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1675] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1676] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1677] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1678] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1679] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1680] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1681] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1682] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1683] The present invention is a system in which a user creates a character customized based on their preferences, and the character manages the user's daily tasks. The present invention operates in cooperation with the user, a terminal, and a server.

[1684] Overall system configuration

[1685] The system of the present invention includes an input means for a user to input customization options, a generation means for generating a character based on the customization options, a control means for controlling the behavior of the generated character, a schedule management means for managing the user's schedule and notifying them of reminders, a message generation means for generating messages of praise or encouragement upon completion of a task, and an exchange / sale means for exchanging or selling characters with other users.

[1686] Specific program operation explanation

[1687] Character Generation

[1688] User

[1689] 1. Launch the app.

[1690] 2. Go to the customization options screen and enter your gender, hair color, body type, clothing, etc.

[1691] 3. Press the "Generate" button.

[1692] Terminal

[1693] 1. Sends the customization options entered by the user to the server.

[1694] server

[1695] 1. Use a generative AI model to generate a character based on customization options.

[1696] 2. The generated character data is sent back to the device.

[1697] Terminal

[1698] 1. Draw the received character data and display it on the user's screen.

[1699] Character movement control

[1700] Terminal

[1701] 1. Execute the character's movement script and make it move on the screen in real time.

[1702] 2. The character talks to the user and walks around the screen.

[1703] Scheduling and Reminders

[1704] User

[1705] 1. Add a new task or event.

[1706] 2. Set the reminder time and date.

[1707] Terminal

[1708] 1. Sends tasks and events set by the user to the server.

[1709] server

[1710] 1. Store task and event information in a database.

[1711] 2. Send notifications at the set reminder time.

[1712] Terminal

[1713] 1. When the specified time arrives, the user will receive a reminder notification and a character will display the details of the reminder on the screen. The character will notify the user, "Mr. / Ms. XX, you have a meeting in 15 minutes."

[1714] Generate messages of praise and encouragement

[1715] User

[1716] 1. Enter the completion of the task in the app and press the Complete button.

[1717] Terminal

[1718] 1. Send task completion information to the server.

[1719] server

[1720] 1. Receive task completion information and generate messages of praise and encouragement.

[1721] 2. Send the generated message back to the terminal.

[1722] Terminal

[1723] 1. The character displays the received message. For example, the character tells the user, "As expected! Thank you for your hard work."

[1724] Character exchange and sales

[1725] User

[1726] 1. Go to the character exchange / sales screen.

[1727] 2. Check the character lists published by other users.

[1728] 3. Choose your favorite character and send an exchange or purchase request.

[1729] Terminal

[1730] 1. Send a request from the user to the server.

[1731] server

[1732] 1. Receive the request and update the character information.

[1733] 2. Verify character ownership and send update information back to your device.

[1734] Terminal

[1735] 1. Display updated character information and notify the user.

[1736] Specific examples

[1737] For example, if user A sets an alarm for 7:00 a.m. and then checks his / her schedule for the day, the system operates as follows:

[1738] User A launches the app, enters "Set alarm for 7:00" and saves it.

[1739] The terminal transmits the alarm information to the server.

[1740] The server saves the alarm settings and notifies the device at the specified time.

[1741] At the set time, the device will receive a notification and the character will say, "Good morning, today's schedule is..."

[1742] User A checks the calendar and a character reads out today's schedule.

[1743] In this way, users can enjoy managing their daily tasks through the characters.

[1744] The processing flow will be explained below.

[1745] Specific processing steps of the program

[1746] Character Generation

[1747] Step 1:

[1748] The user launches the app and navigates to the customization options screen.

[1749] Step 2:

[1750] The user enters customization options such as gender, hair color, body type, and clothing, and presses the "Generate" button.

[1751] Step 3:

[1752] The terminal transmits the customization options entered by the user to the server.

[1753] Step 4:

[1754] The server passes the received customization options to the generative AI model.

[1755] Step 5:

[1756] The server uses a generative AI model to generate a character based on customization options.

[1757] Step 6:

[1758] The server returns the generated character data (images and animations) to the device.

[1759] Step 7:

[1760] The terminal analyzes the received character data and displays it on the user's screen.

[1761] Character movement control

[1762] Step 1:

[1763] The device loads and executes the character's movement script.

[1764] Step 2:

[1765] The device depicts the character's movements on the screen in real time.

[1766] Step 3:

[1767] The device causes the character to talk to the user and walk around the screen.

[1768] Scheduling and Reminders

[1769] Step 1:

[1770] A user adds a new task or event within the app.

[1771] Step 2:

[1772] The user sets the reminder time and date.

[1773] Step 3:

[1774] The terminal transmits the task and event information entered by the user to the server.

[1775] Step 4:

[1776] The server stores task and event information in a database.

[1777] Step 5:

[1778] Schedule the server to send notifications at set reminder times.

[1779] Step 6:

[1780] The server sends a reminder notification to the device at the specified time.

[1781] Step 7:

[1782] The device will receive a reminder notification and a character will display the reminder details on the screen.

[1783] Step 8:

[1784] The character will notify the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[1785] Generate messages of praise and encouragement

[1786] Step 1:

[1787] The user enters that the task has been completed within the app and presses the Complete button.

[1788] Step 2:

[1789] The terminal sends task completion information to the server.

[1790] Step 3:

[1791] The server receives the task completion information and generates a message of praise or encouragement.

[1792] Step 4:

[1793] The server sends the generated message back to the terminal.

[1794] Step 5:

[1795] The message received by the device is displayed on the character.

[1796] Step 6:

[1797] The character tells the user, "As expected! Thank you for your hard work."

[1798] Character exchange and sales

[1799] Step 1:

[1800] The user will be taken to the character exchange / sales screen.

[1801] Step 2:

[1802] The terminal sends a request to the server to display a list of characters that other users have made public.

[1803] Step 3:

[1804] The server returns the character list data to the device.

[1805] Step 4:

[1806] The terminal displays a list of characters to the user.

[1807] Step 5:

[1808] Users can choose their favorite character and send an exchange or purchase request.

[1809] Step 6:

[1810] The terminal sends a request from the user to the server.

[1811] Step 7:

[1812] The server receives the request and updates the character's ownership.

[1813] Step 8:

[1814] The server returns the updated character information to the terminal.

[1815] Step 9:

[1816] The terminal notifies the user of the updated character information.

[1817] Example 1

[1818] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1819] In today's world, users need to manage many daily tasks and schedules, but traditional schedule management tools and reminder functions lack the motivation to actively continue using them. While systems exist that allow users to enjoyably manage tasks through customizable characters, they lack sufficient functionality for character behavior and the ability to exchange and sell characters between users. Furthermore, there is a need for a system that automatically generates appropriate messages of praise and encouragement tailored to individual needs when users complete tasks.

[1820] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1821] In this invention, the server includes input means for a user to input customization options, generation means for generating a character based on the customization options, control means for controlling the behavior of the generated character, schedule management means for managing the user's schedule, notification means for notifying the user of reminders, message generation means for generating messages of praise or encouragement upon task completion, exchange / sale means for exchanging / selling the generated character with other users, and action script execution means for executing the character's action script in real time. This allows users to enjoy task management through customizable characters, effectively receive notifications of reminders and praise, and further enjoy interaction with other users by exchanging and selling characters.

[1822] An "input means" is a means by which a user inputs customization options.

[1823] "Generation means" means for generating a character based on customization options.

[1824] "Control means" refers to means for controlling the actions of the generated character.

[1825] The "schedule management means" is a means by which a character manages a user's schedule.

[1826] The "notification means" is a means by which a character notifies a user of a reminder.

[1827] The "message generating means" is a means for a character to generate a message of praise or encouragement when the user completes a task.

[1828] "Means for exchange and sale" refers to means for exchanging or selling generated characters with other users.

[1829] The "action script execution means" is a means for moving a character in real time and displaying a message to the user.

[1830] A "generative AI model" is an artificial intelligence model that generates characters based on customization options entered by a user.

[1831] A "prompt sentence" is an instruction sentence for character generation that is input to the generative AI model.

[1832] The present invention is a system in which a user creates a character customized based on their preferences, and the character manages the user's daily tasks. The present invention operates in cooperation with a user, a terminal, and a server. Specific embodiments for implementing the present invention are described below.

[1833] Character Generation

[1834] User

[1835] Users first launch the application and navigate to a customization options screen, where they enter details such as gender, hair color, body type, and clothing.

[1836] For example, enter customization options such as "Male gender, brown hair color, sporty clothing" and press the "Generate" button.

[1837] Terminal

[1838] The device sends the customization options entered by the user to the server using HTTP POST as the specific communication protocol.

[1839] server

[1840] The server uses a generative AI model (e.g., DALL-E or other artificial intelligence model) to generate a character based on the customization options specified by the user.

[1841] Example: The prompt sentence "Gender is male, hair color is brown, and sportswear is worn" is input into the generative AI model.

[1842] The server returns the generated character data to the device in JSON format.

[1843] Terminal

[1844] The device then draws the received character data and displays it on the user's screen. HTML5 Canvas or WebGL can be used for drawing.

[1845] Character movement control

[1846] Terminal

[1847] The device executes the character's movement script and controls the character's movements on the screen in real time, for example, using JavaScript.

[1848] The character will talk to the user and walk around the screen, for example saying "Good morning!"

[1849] Scheduling and Reminders

[1850] User

[1851] Users can add new tasks and events and set reminder times and dates.

[1852] Terminal

[1853] The device sends the tasks and event data set by the user to the server via an HTTP POST request.

[1854] server

[1855] The server stores task and event information in a database, using MySQL, using INSERT statements.

[1856] At the specified reminder time, the server sends a push notification to the device using Firebase Cloud Messaging (FCM).

[1857] Terminal

[1858] At the specified time, the device receives a notification and a character notifies the user, saying, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[1859] Generate messages of praise and encouragement

[1860] User

[1861] The user enters task completion in the app and presses the "Complete" button.

[1862] Terminal

[1863] The terminal sends task completion information to the server via an HTTP POST request.

[1864] server

[1865] The server uses a generative AI model (such as ChatGPT) based on task completion information to generate praise and encouraging messages.

[1866] Example: Enter the prompt "The user has completed the task. Please generate a compliment." into the AI ​​model.

[1867] The server returns the generated message to the terminal.

[1868] Terminal

[1869] The device displays the received message on the character. For example, the character tells the user, "As expected! Thank you for your hard work."

[1870] Character exchange and sales

[1871] User

[1872] The user goes to the character exchange / sales screen and checks the list of characters that other users have made public.

[1873] Choose your favorite character and submit a trade or purchase request.

[1874] Terminal

[1875] The terminal sends a request from the user to the server by using an HTTP POST request.

[1876] server

[1877] The server receives the request and updates the character information in the database. The database used is PostgreSQL, and the UPDATE statement is used.

[1878] The server verifies the ownership of the character and sends update information back to the device in JSON format.

[1879] Terminal

[1880] The device will display the updated character information on the screen and notify the user, for example, "Ownership of this character has been transferred to you."

[1881] With the above-described configuration, the present invention enables users to manage their daily tasks in a fun and effective manner using characters customized by the user.

[1882] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1883] Step 1:

[1884] User

[1885] Launch the app and go to the customization options screen.

[1886] Customization options include gender, hair color, body type, clothing, etc.

[1887] Input: Customization options data entered by the user (e.g., gender is male, hair color is brown, sportswear style)

[1888] Output: Customization options data is sent to the device.

[1889] Step 2:

[1890] Terminal

[1891] The customization option data entered by the user is sent to the server via an HTTP POST request.

[1892] Input: Customization options data entered by the user (gender, hair color, body type, clothing, etc.)

[1893] Output: Customization options data is sent to the server.

[1894] Step 3:

[1895] server

[1896] Based on the received customization option data, a prompt sentence is generated and passed to the generative AI model (e.g., DALL-E).

[1897] A generative AI model generates characters based on customization options.

[1898] Input: Customization option data (e.g., prompt text "Gender is male, hair color is brown, and sportswear is worn")

[1899] Output: The generated character data (JSON format) is saved on the server.

[1900] Step 4:

[1901] server

[1902] The generated character data is returned to the device in JSON format as an HTTP response.

[1903] Input: Generated character data (JSON format)

[1904] Output: Character data is sent to the terminal.

[1905] Step 5:

[1906] Terminal

[1907] The received character data is analyzed and the character is drawn on the user's screen using a drawing engine (e.g. HTML5 Canvas or WebGL).

[1908] Input: Generated character data (JSON format)

[1909] Output: The customized character that is displayed on the user's screen.

[1910] Step 6:

[1911] Terminal

[1912] The character's action script is executed, and the character moves in real time to greet the user, for example.

[1913] Input: Character movement script

[1914] Output: A character that acts on the screen (e.g., says "Good morning!").

[1915] Step 7:

[1916] User

[1917] Add new tasks and events within the app and set reminder times and dates.

[1918] Input: Task and event information set by the user, as well as reminder times and dates

[1919] Output: The configured task and event information is sent to the device.

[1920] Step 8:

[1921] Terminal

[1922] Tasks and event data set by the user are sent to the server via an HTTP POST request.

[1923] Input: Task and event data set by the user

[1924] Output: Task and event data is sent to the server.

[1925] Step 9:

[1926] server

[1927] Save the received task and event data in a database (e.g. MySQL) using INSERT statements.

[1928] Input: Task and event data

[1929] Output: Task and event information stored in a database.

[1930] Step 10:

[1931] server

[1932] When the set reminder time arrives, a push notification is sent to the device using FCM (Firebase Cloud Messaging).

[1933] Input: Reminder time information

[1934] Output: The push notification sent to the device.

[1935] Step 11:

[1936] Terminal

[1937] When the specified time arrives, the user will receive a notification and a character will notify them, saying, "Mr. / Ms. XX, there will be a meeting in 15 minutes."

[1938] Input: Push notification from the server

[1939] Output: A reminder notification that appears on the screen.

[1940] Step 12:

[1941] User

[1942] Enter task completion in the app and press the "Complete" button.

[1943] Input: Completed task information (user input)

[1944] Output: Completion information is sent to the terminal.

[1945] Step 13:

[1946] Terminal

[1947] Completed task information is sent to the server via an HTTP POST request.

[1948] Input: Completed task information

[1949] Output: Completion information is sent to the server.

[1950] Step 14:

[1951] server

[1952] Based on the completion information, a prompt message is generated and passed to a generative AI model (e.g., ChatGPT) to generate a message of praise or encouragement.

[1953] Input: Completion information and message generation prompt (e.g., "The user has completed the task. Please generate a compliment.")

[1954] Output: The generated message.

[1955] Step 15:

[1956] server

[1957] The generated message is sent back to the terminal.

[1958] Input: The generated message

[1959] Output: The message is sent to the terminal.

[1960] Step 16:

[1961] Terminal

[1962] Display the received message on the character.

[1963] Input: The generated message

[1964] Output: A message of praise or encouragement that is displayed on the screen (e.g., "Great job!").

[1965] Step 17:

[1966] User

[1967] Go to the character exchange / sales screen and check the list of characters posted by other users. Select the character you like and send an exchange or purchase request.

[1968] Input: Character exchange / sale request

[1969] Output: The request is sent to the terminal.

[1970] Step 18:

[1971] Terminal

[1972] The user's request is sent to the server via an HTTP POST request.

[1973] Input: Character exchange / sale request

[1974] Output: The request is sent to the server.

[1975] Step 19:

[1976] server

[1977] Receives the request and updates the character information in the database (e.g., PostgreSQL) using the UPDATE statement.

[1978] Input: Character information update request

[1979] Output: The updates stored in the database.

[1980] Step 20:

[1981] server

[1982] Confirms character ownership and returns update information in JSON format to the device.

[1983] Input: Updated character information

[1984] Output: Character information with updated ownership.

[1985] Step 21:

[1986] Terminal

[1987] The updated character information is displayed on the screen to notify the user.

[1988] Input: Updated character information

[1989] Output: The user is notified that "Ownership of this character has been transferred to you."

[1990] Through the above processing steps, users can enjoy managing tasks using customizable characters, receive reminders and praise notifications effectively, and enjoy interacting with other users by exchanging and selling characters.

[1991] (Application example 1)

[1992] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1993] The present invention aims to provide a system that not only supports daily task and schedule management but also assists users in purchasing products in an enjoyable and efficient manner by utilizing characters customized based on the user's preferences. Many current online shopping sites have problems in that product recommendations and purchasing procedures are mechanical and not sufficiently personalized for users. Furthermore, there is a problem in that schedule management and task completion notifications do not provide an attractive user experience. To solve these problems, a new system is needed.

[1994] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1995] In this invention, the server includes an input means for a user to input customization options, a generation means for generating a character based on the customization options using a generative AI model, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate messages of praise and encouragement when the user completes a task, and a navigation means for the character to recommend products to the user and assist with purchasing procedures. This allows users to enjoyably and efficiently manage their daily tasks and purchase products through characters customized to their preferences.

[1996] A "user" is a person who uses the system.

[1997] "Customization options" are input items that allow the user to set options such as the character's gender, hairstyle, and clothing.

[1998] An "input means" is a device or interface through which a user inputs customization options.

[1999] "Generator" refers to a function or device that generates a character based on customization options entered by the user.

[2000] A "generative AI model" is an artificial intelligence model that uses machine learning algorithms to generate characters.

[2001] "Control means" refers to a function or device that manages and controls the actions of the generated character.

[2002] "Schedule management means" refers to a function or device that allows a character to manage the user's schedule and tasks.

[2003] "Notification means" refers to a function or device that allows a character to notify the user of reminders or alerts.

[2004] The "message generating means" is a function or device that allows a character to create a message of praise or encouragement when the user completes a task.

[2005] "Navigation means" refers to a function or device that allows a character to recommend products to users and assist them in the purchasing process.

[2006] The system for implementing this invention uses a user-customized character to assist with daily tasks, schedule management, and navigation on online shopping sites. The entire system is configured with the user's smartphone at its center, with a server and terminals working together.

[2007] Character Generation

[2008] The user launches the app and navigates to the customization options screen. They enter options such as gender, hairstyle, hair color, and clothing, and press the "Generate" button. The device then sends these customization options to the server. The server uses a generative AI model to generate a character based on the customization options and sends the data back to the device. The device then renders the received character data and displays it on the user's screen.

[2009] The generative AI model used is a generative model with an advanced algorithm, such as GPT-4.

[2010] Character movement control

[2011] The character's behavior script is executed by the device and runs in real time on the screen. The character talks to the user and moves around the screen. The software used for this is an application building framework such as Flutter or React Native.

[2012] Scheduling and Reminders

[2013] The user adds a new task or event and sets the time and date of the reminder. This information is sent from the device to the server, where it is stored in a database (e.g., AWS DynamoDB or Firebase Firestore). When the specified time arrives, the server sends a reminder notification to the device, and a character displays the reminder details on the screen.

[2014] Message Generation

[2015] When a user enters their task completion status in the app and presses the "Done" button, the device sends this information to the server, which then generates a message of praise or encouragement based on the information received and sends it back to the device. A character then conveys this message to the user.

[2016] Product Recommendation and Navigation

[2017] The character recommends products based on the user's purchase history and preferences. When the user visits a product page, the character explains the product's features and guides the user through the purchase process. The character also allows the user to set subscription reminders and notify the user accordingly.

[2018] An example of a specific prompt is as follows:

[2019] Generate your character based on the following customization options:

[2020] Gender: Female

[2021] Hairstyle: Long

[2022] Hair Color: Brown

[2023] Dress Code: Casual

[2024] The generated character will act as an assistant, managing the user's calendar and tasks, and recommending products.

[2025] This system allows users to manage their daily tasks and purchase products in a fun and efficient way through characters they customize to their liking.

[2026] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2027] Step 1:

[2028] The user launches the app and navigates to the customization options screen, where they input customization options such as gender, hairstyle, hair color, and clothing. By pressing the "Generate" button, these options are input into the device.

[2029] Step 2:

[2030] The device sends the customization options entered by the user to the server, including information such as gender, hairstyle, hair color, and clothing. The data is sent using a REST API.

[2031] Step 3:

[2032] The server calls a generative AI model based on the received customization options to generate a character. The generative AI model (e.g., OpenAI GPT-4) receives the prompt as input and generates a customized character. The generated character data is sent back to the device from the server.

[2033] Step 4:

[2034] The device then renders the received character data and displays it on the user's screen, allowing the customized character to move in real time and providing the user with an interactive experience.

[2035] Step 5:

[2036] When a user adds a new task or event, the information is entered into the device, the user sets the time and date for the reminder, and the information is sent from the device to the server.

[2037] Step 6:

[2038] The server saves the submitted task and event information in a database, for example, a cloud database such as AWS DynamoDB or Firebase Firestore, and triggers a notification when the set reminder time arrives.

[2039] Step 7:

[2040] When the device receives a reminder notification from the server, a character displays the details of the reminder on the screen and speaks to the user, saying, "Mr. / Ms. XX, you have a meeting in 15 minutes."

[2041] Step 8:

[2042] When a user completes a task, they input the completion information into the terminal. The terminal then sends the task completion information to the server. The server then generates a message of praise or encouragement based on the task completion information.

[2043] Step 9:

[2044] The server sends the generated message back to the terminal. The terminal displays this message on the character. The character tells the user, "You're amazing! Thank you for your hard work."

[2045] Step 10:

[2046] If a user wants to receive product recommendations, the character will recommend products based on the user's purchase history and preferences. While the user is browsing the product page, the character will explain the product's features and guide the user through the purchase process.

[2047] Step 11:

[2048] When a user sets a subscription reminder, the information is sent to the server via the device, and the server triggers a notification based on the set reminder time, with a character informing the user, "Today is the day to order your subscription!"

[2049] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2050] The present invention is a system in which a character created by a user through input of customization options manages the user's daily tasks, and further has the function of recognizing the user's emotions and appropriately changing behaviors and messages. The present invention operates in cooperation with the user, terminal, and server.

[2051] Overall system configuration

[2052] The system according to the present invention includes an input means for a user to input customization options, a generation means for generating a character based on the customization options, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate messages of praise or encouragement when the user completes a task, an emotion recognition means for recognizing the user's emotions, and an exchange / sales means for the user to exchange or sell the generated character with other users. Furthermore, the emotion recognition means uses an emotion engine that analyzes the user's voice and facial expressions.

[2053] Specific program operation explanation

[2054] Character Generation

[2055] User

[2056] 1. Launch the app and go to the customization options screen.

[2057] 2. Enter customization options such as gender, hair color, body type, and clothing, and press the "Generate" button.

[2058] Terminal

[2059] 1. Sends the customization options entered by the user to the server.

[2060] server

[2061] 1. Using a generative AI model, we generate a character based on submitted customization options.

[2062] 2. The generated character data (images and animations) is sent back to the device.

[2063] Terminal

[2064] 1. Analyze the received character data and display it on the user's screen.

[2065] Character movement control

[2066] Terminal

[2067] 1. Load and execute the character's movement script.

[2068] 2. Depict the character's movements on the screen in real time.

[2069] 3. Have the character talk to the user and walk around the screen.

[2070] Scheduling and Reminders

[2071] User

[2072] 1. Add a new task or event within the app.

[2073] 2. Set the reminder time and date.

[2074] Terminal

[2075] 1. Send the task and event information entered by the user to the server.

[2076] server

[2077] 1. Store task and event information in a database.

[2078] 2. Set a schedule to send notifications at set reminder times.

[2079] server

[2080] 1. Send a reminder notification to your device at the specified time.

[2081] Terminal

[2082] 1. When you receive a reminder notification, a character will display the reminder details on the screen.

[2083] 2. The character notifies the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[2084] Generate messages of praise and encouragement

[2085] User

[2086] 1. Enter the completion of the task in the app and press the Complete button.

[2087] Terminal

[2088] 1. Send task completion information to the server.

[2089] server

[2090] 1. Receive task completion information and generate messages of praise and encouragement.

[2091] 2. Send the generated message back to the terminal.

[2092] Terminal

[2093] 1. Display the received message on the character.

[2094] 2. The character tells the user, "As expected! Thank you for your hard work."

[2095] emotion recognition

[2096] Terminal

[2097] 1. An emotion recognition means (emotion engine) is used to analyze the user's voice and facial expressions in real time.

[2098] 2. Send the user's emotional state to the server.

[2099] server

[2100] 1. Generate instructions to automatically change the character's behavior and message content based on the user's emotional state.

[2101] 2. Send the generated instructions back to the terminal.

[2102] Terminal

[2103] 1. Update the character's actions and message content based on the instructions received.

[2104] 2. The character will respond appropriately to the user's emotions.

[2105] Character exchange and sales

[2106] User

[2107] 1. Go to the character exchange / sales screen.

[2108] 2. Check the character lists published by other users.

[2109] 3. Choose your favorite character and send an exchange or purchase request.

[2110] Terminal

[2111] 1. Send a request from the user to the server.

[2112] server

[2113] 1. Receive the request and update the character information.

[2114] 2. Verify character ownership and send update information back to your device.

[2115] Terminal

[2116] 1. Notify the user of updated character information.

[2117] Specific examples

[2118] For example, if user A sets an alarm for 7:00 a.m. and then checks his / her schedule for the day, the system operates as follows:

[2119] User A launches the app, enters "Set alarm for 7:00" and saves it.

[2120] The terminal transmits the alarm information to the server.

[2121] The server saves the alarm settings and notifies the device at the specified time.

[2122] At the set time, the device will receive a notification and the character will say, "Good morning, today's schedule is..."

[2123] User A checks the calendar and a character reads out today's schedule.

[2124] Furthermore, the character recognizes user A's emotions and, for example, if user A is feeling a little down, provides an encouraging message such as, "Why don't you take a walk today to refresh your mood?"

[2125] In this way, users can not only manage their daily tasks in a fun and efficient way through the characters, but also receive support that is tailored to their emotional state at the time.

[2126] The processing flow will be explained below.

[2127] Specific processing steps of the program

[2128] Character Generation

[2129] Step 1:

[2130] The user launches the app and navigates to the customization options screen.

[2131] Step 2:

[2132] The user enters customization options such as gender, hair color, body type, and clothing, and presses the "Generate" button.

[2133] Step 3:

[2134] The terminal transmits the customization options entered by the user to the server.

[2135] Step 4:

[2136] The server passes the received customization options to the generative AI model.

[2137] Step 5:

[2138] The server uses a generative AI model to generate a character based on customization options.

[2139] Step 6:

[2140] The server returns the generated character data (images and animations) to the device.

[2141] Step 7:

[2142] The terminal analyzes the received character data and displays it on the user's screen.

[2143] Character movement control

[2144] Step 1:

[2145] The device loads and executes the character's movement script.

[2146] Step 2:

[2147] The device depicts the character's movements on the screen in real time.

[2148] Step 3:

[2149] The device causes the character to talk to the user and walk around the screen.

[2150] Scheduling and Reminders

[2151] Step 1:

[2152] A user adds a new task or event within the app.

[2153] Step 2:

[2154] The user sets the reminder time and date.

[2155] Step 3:

[2156] The terminal transmits the task and event information entered by the user to the server.

[2157] Step 4:

[2158] The server stores task and event information in a database.

[2159] Step 5:

[2160] Schedule the server to send notifications at set reminder times.

[2161] Step 6:

[2162] The server sends a reminder notification to the device at the specified time.

[2163] Step 7:

[2164] The device will receive a reminder notification and a character will display the reminder details on the screen.

[2165] Step 8:

[2166] The character will notify the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[2167] Generate messages of praise and encouragement

[2168] Step 1:

[2169] The user enters that the task has been completed within the app and presses the Complete button.

[2170] Step 2:

[2171] The terminal sends task completion information to the server.

[2172] Step 3:

[2173] The server receives the task completion information and generates a message of praise or encouragement.

[2174] Step 4:

[2175] The server sends the generated message back to the terminal.

[2176] Step 5:

[2177] The message received by the device is displayed on the character.

[2178] Step 6:

[2179] The character tells the user, "As expected! Thank you for your hard work."

[2180] emotion recognition

[2181] Step 1:

[2182] The device uses an emotion recognition means (emotion engine) to analyze the user's voice and facial expressions in real time.

[2183] Step 2:

[2184] The terminal transmits the user's emotional state to the server.

[2185] Step 3:

[2186] The server generates instructions to automatically change the character's behavior and message content based on the user's emotional state.

[2187] Step 4:

[2188] The server sends the generated instructions back to the terminal.

[2189] Step 5:

[2190] The character's movements and message content are updated based on the instructions received by the device.

[2191] Step 6:

[2192] The character will respond appropriately to the user's emotions.

[2193] For example, if the user is feeling down, the character might suggest, "Why not take a walk today to refresh your mood?"

[2194] Character exchange and sales

[2195] Step 1:

[2196] The user will be taken to the character exchange / sales screen.

[2197] Step 2:

[2198] The terminal sends a request to the server to display a list of characters that other users have made public.

[2199] Step 3:

[2200] The server returns the character list data to the device.

[2201] Step 4:

[2202] The terminal displays a list of characters to the user.

[2203] Step 5:

[2204] Users can choose their favorite character and send an exchange or purchase request.

[2205] Step 6:

[2206] The terminal sends a request from the user to the server.

[2207] Step 7:

[2208] The server receives the request and updates the character's ownership.

[2209] Step 8:

[2210] The server returns the updated character information to the terminal.

[2211] Step 9:

[2212] The terminal notifies the user of the updated character information.

[2213] Example 2

[2214] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2215] In conventional task management systems, it was difficult for users to receive appropriate support that took their emotional state into consideration. Furthermore, there were few interactive task management methods through characters, and the system lacked features to enhance user motivation. Furthermore, character customization and sharing functions were limited, limiting the user experience.

[2216] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an input means for a user to input customization options, a generation means for generating a character using a generative AI model, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate a message of praise or encouragement when the user completes a task, an emotion recognition means for analyzing the user's voice and facial expressions, an emotion adaptation means for changing the character's behavior and message content based on the emotional state recognized by the emotion recognition means, and an exchange / sales means for exchanging or selling the user-generated character with other users. This enables users to perform interactive and motivational task management while receiving appropriate support according to their emotions. Furthermore, the range of character customization and sharing is expanded, providing a rich user experience.

[2217] An "input means" is a device or interface through which a user inputs customization options.

[2218] "Generation means" refers to a mechanism or program for generating a character based on input customization options.

[2219] "Control means" refers to a system or program for managing and controlling the actions of the generated character.

[2220] "Schedule management means" refers to functions and programs that allow a character to manage a user's schedule and tasks.

[2221] "Notification means" refers to a function or program that allows a character to send reminders or other notifications to the user.

[2222] The "message generating means" is a mechanism or program that allows a character to generate a message of praise or encouragement when the user completes a task.

[2223] "Emotion recognition means" refers to a system or program for analyzing the user's voice and facial expressions to recognize their emotions.

[2224] The "emotion adaptation means" is a function or program for automatically changing the character's behavior or message content based on the emotional state recognized by the emotion recognition means.

[2225] "Exchange / sales means" refers to the functions and interfaces for exchanging or selling characters created by a user with other users.

[2226] A "generative AI model" is an artificial intelligence model that generates characters according to customization options entered by a user.

[2227] The present invention is a system in which a character created by a user through input of customization options manages the user's daily tasks, and further has the function of recognizing the user's emotions and appropriately changing behaviors and messages. Specific embodiments of the present invention will be described below.

[2228] Character Generation

[2229] User

[2230] 1. Launch the app on your smartphone or tablet and go to the customization options screen.

[2231] 2. Enter customization options such as gender, hair color, body type, and clothing, and press the "Generate" button.

[2232] Terminal

[2233] 1. The customization options entered by the user are sent to the server using a REST API, and the data is sent in JSON format.

[2234] server

[2235] 1. On the server, a generative AI model (e.g., OpenAI's API) generates a character based on the customization options. This generative AI model is an artificial intelligence model that generates a character corresponding to the input data.

[2236] 2. The generated character data (images and animations) is sent back to the device.

[2237] Terminal

[2238] 1. Analyze the received character data and display it on the user's screen. The analyzed data is displayed through a UI component.

[2239] Character movement control

[2240] Terminal

[2241] 1. Load and execute the character's movement script. The movement script is written in a scripting language such as JavaScript.

[2242] 2. Depicting the character's movements on the screen in real time, using a rendering loop to generate and draw animation frames.

[2243] 3. Have the character talk to the user and walk around the screen.

[2244] Scheduling and Reminders

[2245] User

[2246] 1. Add a new task or event within the app.

[2247] 2. Set the reminder time and date.

[2248] Terminal

[2249] 1. Task and event information entered by the user is sent to the server in JSON format.

[2250] server

[2251] 1. The server stores the received task and event information in a database, such as MySQL or MongoDB.

[2252] 2. Use task scheduling features (e.g. cron jobs) to send notifications at set reminder times.

[2253] server

[2254] 1. At the specified time, a reminder notification is sent to the device using a push notification service (e.g., Firebase Cloud Messaging).

[2255] Terminal

[2256] 1. When you receive a reminder notification, a character will display the reminder details on the screen.

[2257] 2. The character notifies the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[2258] Generate messages of praise and encouragement

[2259] User

[2260] 1. Enter the completion of the task in the app and press the Complete button.

[2261] Terminal

[2262] 1. Send task completion information to the server.

[2263] server

[2264] 1. Receive task completion information and generate praise and encouraging messages using an AI model (e.g., GPT-3).

[2265] 2. Send the generated message back to the terminal.

[2266] Terminal

[2267] 1. Display the received message on the character.

[2268] 2. The character tells the user, "As expected! Thank you for your hard work."

[2269] emotion recognition

[2270] Terminal

[2271] 1. Analyze the user's voice and facial expressions in real time using speech recognition APIs and facial recognition APIs. An example is Microsoft Azure's emotion recognition API.

[2272] 2. The user's emotional state is sent to the server in JSON format.

[2273] server

[2274] 1. Generate instructions to automatically change the character's behavior and message content based on the user's emotional state.

[2275] 2. Send the generated instructions back to the terminal.

[2276] Terminal

[2277] 1. Update the character's actions and message content based on the instructions received.

[2278] 2. The character will respond appropriately to the user's emotions.

[2279] Character exchange and sales

[2280] User

[2281] 1. Go to the character exchange / sales screen.

[2282] 2. Check the character lists published by other users.

[2283] 3. Choose your favorite character and send an exchange or purchase request.

[2284] Terminal

[2285] 1. The user's request is sent to the server in JSON format.

[2286] server

[2287] 1. Receive the request and update the character information.

[2288] 2. Verify character ownership and send update information back to your device.

[2289] Terminal

[2290] 1. Notify the user of updated character information.

[2291] Specific examples

[2292] For example, if user A sets an alarm for 7:00 a.m. and then checks his / her schedule for the day, the system operates as follows:

[2293] User A launches the app, enters "Set alarm for 7:00" and saves it.

[2294] The terminal transmits the alarm information to the server.

[2295] The server saves the alarm settings and notifies the device at the specified time.

[2296] At the set time, the device will receive a notification and the character will say, "Good morning, today's schedule is..."

[2297] User A checks the calendar and a character reads out today's schedule.

[2298] Furthermore, the character recognizes user A's emotions and, for example, if user A is feeling a little down, provides an encouraging message such as, "Why don't you take a walk today to refresh your mood?"

[2299] Prompt Sentence Examples

[2300] "Describe a system where a user can input customization options to generate a character, which then manages the user's daily tasks and reacts appropriately using emotion recognition."

[2301] In this way, users can not only manage their daily tasks in a fun and efficient way through the characters, but also receive support that is tailored to their emotional state at the time.

[2302] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2303] Step 1:

[2304] The user launches the app on their smartphone or tablet and navigates to the customization options screen. They enter customization options such as gender, hair color, body type, and clothing, and press the "Generate" button. The input at this time is the customization information specified by the user. The output is data based on the customization options.

[2305] Step 2:

[2306] The terminal sends the customization options entered by the user to the server using the REST API, and the data is sent in JSON format. The input is the user's customization option data, and the output is the data transferred to the server in JSON format.

[2307] Step 3:

[2308] The server inputs the received customization options into a generative AI model (e.g., OpenAI's API). The generative AI model generates character images and animations based on the input data. The input is customization option data, and the output is the generated character data (images and animations).

[2309] Step 4:

[2310] The server returns the generated character data in JSON format to the terminal, and an HTTP response containing the generated character data is returned as output.

[2311] Step 5:

[2312] The device analyzes the received character data and displays it on the user's screen. The input is the character data received from the server, and the output is the character image or animation displayed on the screen. Specifically, the character is displayed through a UI component.

[2313] Step 6:

[2314] Users can add new tasks and events within the app and set reminder times and dates, with inputs including task and event information and reminder settings.

[2315] Step 7:

[2316] The terminal sends task and event information entered by the user to the server. The input is the task and event information set by the user, and the output is data sent to the server in JSON format.

[2317] Step 8:

[2318] The server stores the received task and event information in a database. The database used is MySQL, MongoDB, etc. The input is task and event information, and the output is the data stored in the database.

[2319] Step 9:

[2320] The server uses a task scheduling facility (e.g. a cron job) to send notifications at the reminder time. The input is the reminder configuration information, and the output is the notification action to be scheduled.

[2321] Step 10:

[2322] The server sends a reminder notification to the device at the specified time using a push notification service (e.g., Firebase Cloud Messaging). The input is the reminder schedule data, and the output is the notification data sent to the device.

[2323] Step 11:

[2324] The device receives the reminder notification and a character displays the reminder content on the screen. The input is the notification data sent from the server, and the output is the reminder content displayed on the screen.

[2325] Step 12:

[2326] The character notifies the user, for example, "Mr. / Ms. XX, you have a meeting in 15 minutes." Specifically, it uses a speech synthesis API to speak the notification message and displays an animation.

[2327] Step 13:

[2328] The user inputs the task completion information in the app and presses the completion button.

[2329] Step 14:

[2330] The terminal sends task completion information to the server. The input is the task completion information entered by the user, and the output is the data sent to the server.

[2331] Step 15:

[2332] The server receives task completion information and generates messages of praise or encouragement. The messages are generated using an AI model (e.g., GPT-3). The input is the task completion information, and the output is the generated message.

[2333] Step 16:

[2334] The server sends the generated message back to the terminal, which returns an HTTP response containing the generated message as output.

[2335] Step 17:

[2336] The terminal displays the received message on the character and tells the user, "You're amazing! Thank you for your hard work." The input is the generated message data, and the output is the character's voice and animation.

[2337] Step 18:

[2338] The device analyzes the user's voice and facial expressions in real time using a voice recognition API or a face recognition API. As an example, we use Microsoft Azure's emotion recognition API. The input is the user's voice and facial expression data, and the output is analyzed emotional data.

[2339] Step 19:

[2340] The terminal transmits its emotional state to the server. The input is the analyzed emotional data, and the output is the data sent to the server.

[2341] Step 20:

[2342] The server generates instructions to automatically change the character's behavior and message content based on the emotional state. The input is emotional data, and the output is instructions regarding the character's behavior and message content.

[2343] Step 21:

[2344] The server returns the generated instructions to the terminal, and an HTTP response is returned containing the generated instruction data as output.

[2345] Step 22:

[2346] The terminal updates the character's actions and message content based on the received instructions. The input is the generated instruction data, and the output is the updated character's actions and messages.

[2347] Step 23:

[2348] The character will respond appropriately to the user's emotions, changing its facial expressions and movements in real time to match the emotion.

[2349] Step 24:

[2350] The user moves to the character exchange / sales screen. The input is a screen transition request.

[2351] Step 25:

[2352] The user checks the character lists published by other users. The input is a character list display request, and the output is the displayed character list.

[2353] Step 26:

[2354] The user selects a character they like and sends a request to exchange or purchase it. The input is the character selection and request data, and the output is the data to be sent to the server.

[2355] Step 27:

[2356] The terminal sends requests from users to the server. The input is the exchange / purchase request data, and the output is the data to be sent to the server.

[2357] Step 28:

[2358] The server receives the request and updates the character information. The input is the received request data, and the output is the updated character information.

[2359] Step 29:

[2360] The server verifies the ownership of the character and sends the updated information back to the device, which returns an HTTP response containing the updated character information as output.

[2361] Step 30:

[2362] The terminal notifies the user of the updated character information. The input is the updated character information, and the output is a notification displayed on the screen.

[2363] (Application example 2)

[2364] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2365] While conventional character-based systems were capable of managing users' schedules and tasks, they struggled to respond to users' emotional changes in real time or provide appropriate entertainment and navigation information in autonomous vehicles. Furthermore, they lacked a system for optimizing the in-car user experience, resulting in problems that reduced user comfort and usage efficiency.

[2366] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2367] In this invention, the server includes an input means for a user to input customization options, a generation means for generating a character based on the customization options, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate messages of praise or encouragement when the user completes a task, an entertainment means for the character to provide entertainment and navigation information within the autonomous vehicle, and an emotion recognition means for recognizing the user's emotions within the autonomous vehicle and changing the character's behavior and message content based on the emotions. This optimizes the user's experience within the autonomous vehicle, enabling comfortable and efficient use.

[2368] An "input means" is a device through which a user inputs customization options.

[2369] "Generator" means a device for generating a character based on customization options.

[2370] "Control means" refers to a device for controlling the actions of the generated character.

[2371] The "schedule management means" is a device that allows the character to manage the user's schedule.

[2372] The "notification means" is a device that allows the character to notify the user of a reminder.

[2373] The "message generating means" is a device that allows a character to generate a message of praise or encouragement when the user completes a task.

[2374] An "entertainment vehicle" is a device that allows a character to provide entertainment or navigation information within an autonomous vehicle.

[2375] The "emotion recognition means" is a device that recognizes the emotions of the user inside the autonomous vehicle and changes the character's behavior and message content based on those emotions.

[2376] The present invention provides a system that utilizes a user-customized character in an autonomous vehicle to provide entertainment, navigation, task management, and situational responses based on the user's emotions. This system operates in cooperation with the user, a terminal, and a server.

[2377] Overall system configuration

[2378] The system according to the present invention comprises the following main components:

[2379] Input means: A device through which users input customization options. This is implemented as a smartphone app.

[2380] Generator: A device that generates characters based on customization options. It uses a generative AI model (e.g., GPT-4) on a server.

[2381] Control means: A device that controls the actions of the generated character. It is executed in real time on the terminal.

[2382] Schedule management tool: A device in which a character manages the user's schedule. It is incorporated into a smartphone app.

[2383] Notification method: A character notifies the user of reminders. This is achieved through push notifications on smartphones.

[2384] Message Generation Means: A device that generates messages of praise and encouragement when a character completes a task. Executed on the server.

[2385] Entertainment: A device in which characters provide entertainment and navigation information inside an autonomous vehicle, using in-car displays and voice assistants.

[2386] Emotion recognition means: A device that recognizes the user's emotions inside the autonomous vehicle and changes the character's behavior and message content based on those emotions. It uses a camera, microphone, and emotion engine (e.g., Azure Emotion API).

[2387] Program processing overview

[2388] The system begins with the user customizing their character through a smartphone app. The customized options are sent from the device to a server, which then generates the character using a generative AI model. The generated character data is then sent back to the device, where it can be displayed and controlled in real time.

[2389] When a user inputs schedules and tasks while driving, the information is stored and managed on the server and sent to the device as reminders when necessary. In addition, when the user completes a task, the character generates a message of praise or encouragement that is displayed on the device.

[2390] Furthermore, the user's emotions are analyzed in real time through the in-car camera and microphone, and the character's behavior and messages change automatically depending on the user's emotions. This is done using an emotion engine (e.g., Azure Emotion API).

[2391] Specific examples

[2392] For example, consider a user who wants to create a customized character in the morning. The user launches the app and inputs the character's gender, hair color, clothing, etc.

[2393] An example prompt might look like this:

[2394] Character Gender: Male

[2395] Hair Color: Black

[2396] Dress Code: Casual

[2397] When the user presses the generate button, the device sends these customization options to the server, which uses a generative AI model (e.g., GPT-4) to generate a character and sends the data back to the device, which then displays the generated character in real time.

[2398] Additionally, when a user inputs their next destination in an autonomous vehicle, that information is also sent to the server, and a character provides entertainment and navigation information through the in-car display. The user's emotions are analyzed, and the character responds appropriately with appropriate responses and messages. For example, if the user is feeling stressed while driving, the character may suggest, "Would you like me to play some relaxing music?"

[2399] In this way, the system optimizes the user's experience inside the autonomous vehicle, ensuring a comfortable and efficient use.

[2400] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2401] Step 1:

[2402] User: Launches the app and enters customization options. The user selects options such as gender, hair color, and clothing, and presses the generate button.

[2403] Input: Customization options such as gender, hair color, clothing, etc.

[2404] Output: The customization options are entered into the terminal.

[2405] Step 2:

[2406] Terminal: Sends the entered customization options to the server.

[2407] Input: Customization option data entered by the user.

[2408] Data Calculation: Converts input data into an appropriate format and sends it over the network to the server.

[2409] Output: Customization options data is sent to the server.

[2410] Step 3:

[2411] Server: Uses a generative AI model (e.g. GPT-4) to generate a character based on customization options.

[2412] Input: Customization option data sent from the device.

[2413] Data calculation: Enter the following as a prompt into the generation AI model to generate a character.

[2414] Character Gender: Male

[2415] Hair Color: Black

[2416] Dress Code: Casual

[2417] Output: Generated character data (images and animations).

[2418] Step 4:

[2419] Server: Returns the generated character data to the device.

[2420] Input: Generated character data.

[2421] Data calculation: Converts character data into an appropriate format and sends it to the terminal via the network.

[2422] Output: Character data is sent to the terminal.

[2423] Step 5:

[2424] Terminal: Displays the received character data and controls the character's actions.

[2425] Input: Character data sent from the server.

[2426] Data calculation: Analyzes character data and converts it into a format that can be displayed on the screen.

[2427] Output: The character is displayed on the user's smartphone or in-car display.

[2428] Step 6:

[2429] User: Enter schedule and tasks in the app, enter next destination and appointment information, and press the save button.

[2430] Input: Schedule, task information, and destination information.

[2431] Output: The entered information is saved on the device.

[2432] Step 7:

[2433] Terminal: Sends schedule and task information entered by the user to the server.

[2434] Input: Schedule and task information entered by the user.

[2435] Data Calculation: Converts input data into an appropriate format and sends it over the network to the server.

[2436] Output: Schedule and task information is sent to the server.

[2437] Step 8:

[2438] Server: Stores schedule and task information and sends notifications to devices when reminders are due.

[2439] Input: Schedule and task information sent from the device.

[2440] Data calculation: Save schedule and task information in a database and set reminder timings.

[2441] Output: A reminder will be ready to be sent when an event occurs.

[2442] Step 9:

[2443] Server: Sends a notification to the device when the reminder time arrives.

[2444] Input: Reminder time and corresponding task information.

[2445] Data calculation: Generates reminder notifications and sends them to the device over the network.

[2446] Output: A reminder notification is sent to the device.

[2447] Step 10:

[2448] Device: Receive reminder notifications and notify the user via a character.

[2449] Input: Reminder notification from the server.

[2450] Data Calculation: Analyzes reminder notifications and displays them as character messages.

[2451] Output: The character informs the user, "Dear Mr. / Ms. X, you have a meeting in 15 minutes."

[2452] Step 11:

[2453] User: Enter task completion in the app and press the Complete button.

[2454] Input: Task completion information.

[2455] Output: The entered task completion information is saved on the device.

[2456] Step 12:

[2457] Terminal: Sends task completion information to the server.

[2458] Input: Task completion information entered by the user.

[2459] Data calculation: Convert the task completion information data into an appropriate format and send it to the server via the network.

[2460] Output: Task completion information is sent to the server.

[2461] Step 13:

[2462] Server: Receives task completion information and generates praise and encouragement messages.

[2463] Input: Task completion information sent from the terminal.

[2464] Data Computing: Using a message generation AI model, we generate messages of praise and encouragement.

[2465] Output: The generated message.

[2466] Step 14:

[2467] Server: Returns the generated message to the device.

[2468] Input: A generated message of praise or encouragement.

[2469] Data Calculation: Converts message data into an appropriate format and sends it to the terminal over the network.

[2470] Output: The message is sent to the terminal.

[2471] Step 15:

[2472] Terminal: Displays received messages to the character.

[2473] Input: A message of praise or encouragement sent by the server.

[2474] Data Calculation: Parses messages and converts them into a format that the character can display.

[2475] Output: The character tells the user, "You're amazing! Great job!"

[2476] Step 16:

[2477] Device: Uses a camera and microphone to analyze the user's emotions in real time and send them to the server.

[2478] Input: User's facial and voice data.

[2479] Data calculation: Analyze using an emotion engine (e.g., Azure Emotion API) to generate emotion data.

[2480] Output: Emotion data is sent to the server.

[2481] Step 17:

[2482] Server: Generates instructions to change the character's behavior and message content based on the user's emotional data and sends them back to the device.

[2483] Input: Emotion data sent from the device.

[2484] Data calculation: Generates character movement instructions and message content based on emotional data.

[2485] Output: Operation instructions and message content are sent to the terminal.

[2486] Step 18:

[2487] Terminal: Updates character behavior and message content based on received instructions.

[2488] Input: Operation instructions and message content sent from the server.

[2489] Data calculation: Analyzes action instructions and messages and reflects them on the character.

[2490] Output: The character responds in real time according to the emotion.

[2491] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2492] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2493] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2494] [Fourth embodiment]

[2495] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2496] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2497] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2498] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2499] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2500] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2501] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2502] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2503] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2504] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2505] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2506] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2507] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2508] The present invention is a system in which a user creates a character customized based on their preferences, and the character manages the user's daily tasks. The present invention operates in cooperation with the user, a terminal, and a server.

[2509] Overall system configuration

[2510] The system of the present invention includes an input means for a user to input customization options, a generation means for generating a character based on the customization options, a control means for controlling the behavior of the generated character, a schedule management means for managing the user's schedule and notifying them of reminders, a message generation means for generating messages of praise or encouragement upon completion of a task, and an exchange / sale means for exchanging or selling characters with other users.

[2511] Specific program operation explanation

[2512] Character Generation

[2513] User

[2514] 1. Launch the app.

[2515] 2. Go to the customization options screen and enter your gender, hair color, body type, clothing, etc.

[2516] 3. Press the "Generate" button.

[2517] Terminal

[2518] 1. Sends the customization options entered by the user to the server.

[2519] server

[2520] 1. Use a generative AI model to generate a character based on customization options.

[2521] 2. The generated character data is sent back to the device.

[2522] Terminal

[2523] 1. Draw the received character data and display it on the user's screen.

[2524] Character movement control

[2525] Terminal

[2526] 1. Execute the character's movement script and make it move on the screen in real time.

[2527] 2. The character talks to the user and walks around the screen.

[2528] Scheduling and Reminders

[2529] User

[2530] 1. Add a new task or event.

[2531] 2. Set the reminder time and date.

[2532] Terminal

[2533] 1. Sends tasks and events set by the user to the server.

[2534] server

[2535] 1. Store task and event information in a database.

[2536] 2. Send notifications at the set reminder time.

[2537] Terminal

[2538] 1. When the specified time arrives, the user will receive a reminder notification and a character will display the details of the reminder on the screen. The character will notify the user, "Mr. / Ms. XX, you have a meeting in 15 minutes."

[2539] Generate messages of praise and encouragement

[2540] User

[2541] 1. Enter the completion of the task in the app and press the Complete button.

[2542] Terminal

[2543] 1. Send task completion information to the server.

[2544] server

[2545] 1. Receive task completion information and generate messages of praise and encouragement.

[2546] 2. Send the generated message back to the terminal.

[2547] Terminal

[2548] 1. The character displays the received message. For example, the character tells the user, "As expected! Thank you for your hard work."

[2549] Character exchange and sales

[2550] User

[2551] 1. Go to the character exchange / sales screen.

[2552] 2. Check the character lists published by other users.

[2553] 3. Choose your favorite character and send an exchange or purchase request.

[2554] Terminal

[2555] 1. Send a request from the user to the server.

[2556] server

[2557] 1. Receive the request and update the character information.

[2558] 2. Verify character ownership and send update information back to your device.

[2559] Terminal

[2560] 1. Display updated character information and notify the user.

[2561] Specific examples

[2562] For example, if user A sets an alarm for 7:00 a.m. and then checks his / her schedule for the day, the system operates as follows:

[2563] User A launches the app, enters "Set alarm for 7:00" and saves it.

[2564] The terminal transmits the alarm information to the server.

[2565] The server saves the alarm settings and notifies the device at the specified time.

[2566] At the set time, the device will receive a notification and the character will say, "Good morning, today's schedule is..."

[2567] User A checks the calendar and a character reads out today's schedule.

[2568] In this way, users can enjoy managing their daily tasks through the characters.

[2569] The processing flow will be explained below.

[2570] Specific processing steps of the program

[2571] Character Generation

[2572] Step 1:

[2573] The user launches the app and navigates to the customization options screen.

[2574] Step 2:

[2575] The user enters customization options such as gender, hair color, body type, and clothing, and presses the "Generate" button.

[2576] Step 3:

[2577] The terminal transmits the customization options entered by the user to the server.

[2578] Step 4:

[2579] The server passes the received customization options to the generative AI model.

[2580] Step 5:

[2581] The server uses a generative AI model to generate a character based on customization options.

[2582] Step 6:

[2583] The server returns the generated character data (images and animations) to the device.

[2584] Step 7:

[2585] The terminal analyzes the received character data and displays it on the user's screen.

[2586] Character movement control

[2587] Step 1:

[2588] The device loads and executes the character's movement script.

[2589] Step 2:

[2590] The device depicts the character's movements on the screen in real time.

[2591] Step 3:

[2592] The device causes the character to talk to the user and walk around the screen.

[2593] Scheduling and Reminders

[2594] Step 1:

[2595] A user adds a new task or event within the app.

[2596] Step 2:

[2597] The user sets the reminder time and date.

[2598] Step 3:

[2599] The terminal transmits the task and event information entered by the user to the server.

[2600] Step 4:

[2601] The server stores task and event information in a database.

[2602] Step 5:

[2603] Schedule the server to send notifications at set reminder times.

[2604] Step 6:

[2605] The server sends a reminder notification to the device at the specified time.

[2606] Step 7:

[2607] The device will receive a reminder notification and a character will display the reminder details on the screen.

[2608] Step 8:

[2609] The character will notify the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[2610] Generate messages of praise and encouragement

[2611] Step 1:

[2612] The user enters that the task has been completed within the app and presses the Complete button.

[2613] Step 2:

[2614] The terminal sends task completion information to the server.

[2615] Step 3:

[2616] The server receives the task completion information and generates a message of praise or encouragement.

[2617] Step 4:

[2618] The server sends the generated message back to the terminal.

[2619] Step 5:

[2620] The message received by the device is displayed on the character.

[2621] Step 6:

[2622] The character tells the user, "As expected! Thank you for your hard work."

[2623] Character exchange and sales

[2624] Step 1:

[2625] The user will be taken to the character exchange / sales screen.

[2626] Step 2:

[2627] The terminal sends a request to the server to display a list of characters that other users have made public.

[2628] Step 3:

[2629] The server returns the character list data to the device.

[2630] Step 4:

[2631] The terminal displays a list of characters to the user.

[2632] Step 5:

[2633] Users can choose their favorite character and send an exchange or purchase request.

[2634] Step 6:

[2635] The terminal sends a request from the user to the server.

[2636] Step 7:

[2637] The server receives the request and updates the character's ownership.

[2638] Step 8:

[2639] The server returns the updated character information to the terminal.

[2640] Step 9:

[2641] The terminal notifies the user of the updated character information.

[2642] Example 1

[2643] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2644] In today's world, users need to manage many daily tasks and schedules, but traditional schedule management tools and reminder functions lack the motivation to actively continue using them. While systems exist that allow users to enjoyably manage tasks through customizable characters, they lack sufficient functionality for character behavior and the ability to exchange and sell characters between users. Furthermore, there is a need for a system that automatically generates appropriate messages of praise and encouragement tailored to individual needs when users complete tasks.

[2645] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2646] In this invention, the server includes input means for a user to input customization options, generation means for generating a character based on the customization options, control means for controlling the behavior of the generated character, schedule management means for managing the user's schedule, notification means for notifying the user of reminders, message generation means for generating messages of praise or encouragement upon task completion, exchange / sale means for exchanging / selling the generated character with other users, and action script execution means for executing the character's action script in real time. This allows users to enjoy task management through customizable characters, effectively receive notifications of reminders and praise, and further enjoy interaction with other users by exchanging and selling characters.

[2647] An "input means" is a means by which a user inputs customization options.

[2648] "Generation means" means for generating a character based on customization options.

[2649] "Control means" refers to means for controlling the actions of the generated character.

[2650] The "schedule management means" is a means by which a character manages a user's schedule.

[2651] The "notification means" is a means by which a character notifies a user of a reminder.

[2652] The "message generating means" is a means for a character to generate a message of praise or encouragement when the user completes a task.

[2653] "Means for exchange and sale" refers to means for exchanging or selling generated characters with other users.

[2654] The "action script execution means" is a means for moving a character in real time and displaying a message to the user.

[2655] A "generative AI model" is an artificial intelligence model that generates characters based on customization options entered by a user.

[2656] A "prompt sentence" is an instruction sentence for character generation that is input to the generative AI model.

[2657] The present invention is a system in which a user creates a character customized based on their preferences, and the character manages the user's daily tasks. The present invention operates in cooperation with a user, a terminal, and a server. Specific embodiments for implementing the present invention are described below.

[2658] Character Generation

[2659] User

[2660] Users first launch the application and navigate to a customization options screen, where they enter details such as gender, hair color, body type, and clothing.

[2661] For example, enter customization options such as "Male gender, brown hair color, sporty clothing" and press the "Generate" button.

[2662] Terminal

[2663] The device sends the customization options entered by the user to the server using HTTP POST as the specific communication protocol.

[2664] server

[2665] The server uses a generative AI model (e.g., DALL-E or other artificial intelligence model) to generate a character based on the customization options specified by the user.

[2666] Example: The prompt sentence "Gender is male, hair color is brown, and sportswear is worn" is input into the generative AI model.

[2667] The server returns the generated character data to the device in JSON format.

[2668] Terminal

[2669] The device then draws the received character data and displays it on the user's screen. HTML5 Canvas or WebGL can be used for drawing.

[2670] Character movement control

[2671] Terminal

[2672] The device executes the character's movement script and controls the character's movements on the screen in real time, for example, using JavaScript.

[2673] The character will talk to the user and walk around the screen, for example saying "Good morning!"

[2674] Scheduling and Reminders

[2675] User

[2676] Users can add new tasks and events and set reminder times and dates.

[2677] Terminal

[2678] The device sends the tasks and event data set by the user to the server via an HTTP POST request.

[2679] server

[2680] The server stores task and event information in a database, using MySQL, using INSERT statements.

[2681] At the specified reminder time, the server sends a push notification to the device using Firebase Cloud Messaging (FCM).

[2682] Terminal

[2683] At the specified time, the device receives a notification and a character notifies the user, saying, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[2684] Generate messages of praise and encouragement

[2685] User

[2686] The user enters task completion in the app and presses the "Complete" button.

[2687] Terminal

[2688] The terminal sends task completion information to the server via an HTTP POST request.

[2689] server

[2690] The server uses a generative AI model (such as ChatGPT) based on task completion information to generate praise and encouraging messages.

[2691] Example: Enter the prompt "The user has completed the task. Please generate a compliment." into the AI ​​model.

[2692] The server returns the generated message to the terminal.

[2693] Terminal

[2694] The device displays the received message on the character. For example, the character tells the user, "As expected! Thank you for your hard work."

[2695] Character exchange and sales

[2696] User

[2697] The user goes to the character exchange / sales screen and checks the list of characters that other users have made public.

[2698] Choose your favorite character and submit a trade or purchase request.

[2699] Terminal

[2700] The terminal sends a request from the user to the server by using an HTTP POST request.

[2701] server

[2702] The server receives the request and updates the character information in the database. The database used is PostgreSQL, and the UPDATE statement is used.

[2703] The server verifies the ownership of the character and sends update information back to the device in JSON format.

[2704] Terminal

[2705] The device will display the updated character information on the screen and notify the user, for example, "Ownership of this character has been transferred to you."

[2706] With the above-described configuration, the present invention enables users to manage their daily tasks in a fun and effective manner using characters customized by the user.

[2707] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2708] Step 1:

[2709] User

[2710] Launch the app and go to the customization options screen.

[2711] Customization options include gender, hair color, body type, clothing, etc.

[2712] Input: Customization options data entered by the user (e.g., gender is male, hair color is brown, sportswear style)

[2713] Output: Customization options data is sent to the device.

[2714] Step 2:

[2715] Terminal

[2716] The customization option data entered by the user is sent to the server via an HTTP POST request.

[2717] Input: Customization options data entered by the user (gender, hair color, body type, clothing, etc.)

[2718] Output: Customization options data is sent to the server.

[2719] Step 3:

[2720] server

[2721] Based on the received customization option data, a prompt sentence is generated and passed to the generative AI model (e.g., DALL-E).

[2722] A generative AI model generates characters based on customization options.

[2723] Input: Customization option data (e.g., prompt text "Gender is male, hair color is brown, and sportswear is worn")

[2724] Output: The generated character data (JSON format) is saved on the server.

[2725] Step 4:

[2726] server

[2727] The generated character data is returned to the device in JSON format as an HTTP response.

[2728] Input: Generated character data (JSON format)

[2729] Output: Character data is sent to the terminal.

[2730] Step 5:

[2731] Terminal

[2732] The received character data is analyzed and the character is drawn on the user's screen using a drawing engine (e.g. HTML5 Canvas or WebGL).

[2733] Input: Generated character data (JSON format)

[2734] Output: The customized character that is displayed on the user's screen.

[2735] Step 6:

[2736] Terminal

[2737] The character's action script is executed, and the character moves in real time to greet the user, for example.

[2738] Input: Character movement script

[2739] Output: A character that acts on the screen (e.g., says "Good morning!").

[2740] Step 7:

[2741] User

[2742] Add new tasks and events within the app and set reminder times and dates.

[2743] Input: Task and event information set by the user, as well as reminder times and dates

[2744] Output: The configured task and event information is sent to the device.

[2745] Step 8:

[2746] Terminal

[2747] Tasks and event data set by the user are sent to the server via an HTTP POST request.

[2748] Input: Task and event data set by the user

[2749] Output: Task and event data is sent to the server.

[2750] Step 9:

[2751] server

[2752] Save the received task and event data in a database (e.g. MySQL) using INSERT statements.

[2753] Input: Task and event data

[2754] Output: Task and event information stored in a database.

[2755] Step 10:

[2756] server

[2757] When the set reminder time arrives, a push notification is sent to the device using FCM (Firebase Cloud Messaging).

[2758] Input: Reminder time information

[2759] Output: The push notification sent to the device.

[2760] Step 11:

[2761] Terminal

[2762] When the specified time arrives, the user will receive a notification and a character will notify them, saying, "Mr. / Ms. XX, there will be a meeting in 15 minutes."

[2763] Input: Push notification from the server

[2764] Output: A reminder notification that appears on the screen.

[2765] Step 12:

[2766] User

[2767] Enter task completion in the app and press the "Complete" button.

[2768] Input: Completed task information (user input)

[2769] Output: Completion information is sent to the terminal.

[2770] Step 13:

[2771] Terminal

[2772] Completed task information is sent to the server via an HTTP POST request.

[2773] Input: Completed task information

[2774] Output: Completion information is sent to the server.

[2775] Step 14:

[2776] server

[2777] Based on the completion information, a prompt message is generated and passed to a generative AI model (e.g., ChatGPT) to generate a message of praise or encouragement.

[2778] Input: Completion information and message generation prompt (e.g., "The user has completed the task. Please generate a compliment.")

[2779] Output: The generated message.

[2780] Step 15:

[2781] server

[2782] The generated message is sent back to the terminal.

[2783] Input: The generated message

[2784] Output: The message is sent to the terminal.

[2785] Step 16:

[2786] Terminal

[2787] Display the received message on the character.

[2788] Input: The generated message

[2789] Output: A message of praise or encouragement that is displayed on the screen (e.g., "Great job!").

[2790] Step 17:

[2791] User

[2792] Go to the character exchange / sales screen and check the list of characters posted by other users. Select the character you like and send an exchange or purchase request.

[2793] Input: Character exchange / sale request

[2794] Output: The request is sent to the terminal.

[2795] Step 18:

[2796] Terminal

[2797] The user's request is sent to the server via an HTTP POST request.

[2798] Input: Character exchange / sale request

[2799] Output: The request is sent to the server.

[2800] Step 19:

[2801] server

[2802] Receives the request and updates the character information in the database (e.g., PostgreSQL) using the UPDATE statement.

[2803] Input: Character information update request

[2804] Output: The updates stored in the database.

[2805] Step 20:

[2806] server

[2807] Confirms character ownership and returns update information in JSON format to the device.

[2808] Input: Updated character information

[2809] Output: Character information with updated ownership.

[2810] Step 21:

[2811] Terminal

[2812] The updated character information is displayed on the screen to notify the user.

[2813] Input: Updated character information

[2814] Output: The user is notified that "Ownership of this character has been transferred to you."

[2815] Through the above processing steps, users can enjoy managing tasks using customizable characters, receive reminders and praise notifications effectively, and enjoy interacting with other users by exchanging and selling characters.

[2816] (Application example 1)

[2817] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2818] The present invention aims to provide a system that not only supports daily task and schedule management but also assists users in purchasing products in an enjoyable and efficient manner by utilizing characters customized based on the user's preferences. Many current online shopping sites have problems in that product recommendations and purchasing procedures are mechanical and not sufficiently personalized for users. Furthermore, there is a problem in that schedule management and task completion notifications do not provide an attractive user experience. To solve these problems, a new system is needed.

[2819] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2820] In this invention, the server includes an input means for a user to input customization options, a generation means for generating a character based on the customization options using a generative AI model, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate messages of praise and encouragement when the user completes a task, and a navigation means for the character to recommend products to the user and assist with purchasing procedures. This allows users to enjoyably and efficiently manage their daily tasks and purchase products through characters customized to their preferences.

[2821] A "user" is a person who uses the system.

[2822] "Customization options" are input items that allow the user to set options such as the character's gender, hairstyle, and clothing.

[2823] An "input means" is a device or interface through which a user inputs customization options.

[2824] "Generator" refers to a function or device that generates a character based on customization options entered by the user.

[2825] A "generative AI model" is an artificial intelligence model that uses machine learning algorithms to generate characters.

[2826] "Control means" refers to a function or device that manages and controls the actions of the generated character.

[2827] "Schedule management means" refers to a function or device that allows a character to manage the user's schedule and tasks.

[2828] "Notification means" refers to a function or device that allows a character to notify the user of reminders or alerts.

[2829] The "message generating means" is a function or device that allows a character to create a message of praise or encouragement when the user completes a task.

[2830] "Navigation means" refers to a function or device that allows a character to recommend products to users and assist them in the purchasing process.

[2831] The system for implementing this invention uses a user-customized character to assist with daily tasks, schedule management, and navigation on online shopping sites. The entire system is configured with the user's smartphone at its center, with a server and terminals working together.

[2832] Character Generation

[2833] The user launches the app and navigates to the customization options screen. They enter options such as gender, hairstyle, hair color, and clothing, and press the "Generate" button. The device then sends these customization options to the server. The server uses a generative AI model to generate a character based on the customization options and sends the data back to the device. The device then renders the received character data and displays it on the user's screen.

[2834] The generative AI model used is a generative model with an advanced algorithm, such as GPT-4.

[2835] Character movement control

[2836] The character's behavior script is executed by the device and runs in real time on the screen. The character talks to the user and moves around the screen. The software used for this is an application building framework such as Flutter or React Native.

[2837] Scheduling and Reminders

[2838] The user adds a new task or event and sets the time and date of the reminder. This information is sent from the device to the server, where it is stored in a database (e.g., AWS DynamoDB or Firebase Firestore). When the specified time arrives, the server sends a reminder notification to the device, and a character displays the reminder details on the screen.

[2839] Message Generation

[2840] When a user enters their task completion status in the app and presses the "Done" button, the device sends this information to the server, which then generates a message of praise or encouragement based on the information received and sends it back to the device. A character then conveys this message to the user.

[2841] Product Recommendation and Navigation

[2842] The character recommends products based on the user's purchase history and preferences. When the user visits a product page, the character explains the product's features and guides the user through the purchase process. The character also allows the user to set subscription reminders and notify the user accordingly.

[2843] An example of a specific prompt is as follows:

[2844] Generate your character based on the following customization options:

[2845] Gender: Female

[2846] Hairstyle: Long

[2847] Hair Color: Brown

[2848] Dress Code: Casual

[2849] The generated character will act as an assistant, managing the user's calendar and tasks, and recommending products.

[2850] This system allows users to manage their daily tasks and purchase products in a fun and efficient way through characters they customize to their liking.

[2851] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2852] Step 1:

[2853] The user launches the app and navigates to the customization options screen, where they input customization options such as gender, hairstyle, hair color, and clothing. By pressing the "Generate" button, these options are input into the device.

[2854] Step 2:

[2855] The device sends the customization options entered by the user to the server, including information such as gender, hairstyle, hair color, and clothing. The data is sent using a REST API.

[2856] Step 3:

[2857] The server calls a generative AI model based on the received customization options to generate a character. The generative AI model (e.g., OpenAI GPT-4) receives the prompt as input and generates a customized character. The generated character data is sent back to the device from the server.

[2858] Step 4:

[2859] The device then renders the received character data and displays it on the user's screen, allowing the customized character to move in real time and providing the user with an interactive experience.

[2860] Step 5:

[2861] When a user adds a new task or event, the information is entered into the device, the user sets the time and date for the reminder, and the information is sent from the device to the server.

[2862] Step 6:

[2863] The server saves the submitted task and event information in a database, for example, a cloud database such as AWS DynamoDB or Firebase Firestore, and triggers a notification when the set reminder time arrives.

[2864] Step 7:

[2865] When the device receives a reminder notification from the server, a character displays the details of the reminder on the screen and speaks to the user, saying, "Mr. / Ms. XX, you have a meeting in 15 minutes."

[2866] Step 8:

[2867] When a user completes a task, they input the completion information into the terminal. The terminal then sends the task completion information to the server. The server then generates a message of praise or encouragement based on the task completion information.

[2868] Step 9:

[2869] The server sends the generated message back to the terminal. The terminal displays this message on the character. The character tells the user, "You're amazing! Thank you for your hard work."

[2870] Step 10:

[2871] If a user wants to receive product recommendations, the character will recommend products based on the user's purchase history and preferences. While the user is browsing the product page, the character will explain the product's features and guide the user through the purchase process.

[2872] Step 11:

[2873] When a user sets a subscription reminder, the information is sent to the server via the device, and the server triggers a notification based on the set reminder time, with a character informing the user, "Today is the day to order your subscription!"

[2874] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2875] The present invention is a system in which a character created by a user through input of customization options manages the user's daily tasks, and further has the function of recognizing the user's emotions and appropriately changing behaviors and messages. The present invention operates in cooperation with the user, terminal, and server.

[2876] Overall system configuration

[2877] The system according to the present invention includes an input means for a user to input customization options, a generation means for generating a character based on the customization options, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate messages of praise or encouragement when the user completes a task, an emotion recognition means for recognizing the user's emotions, and an exchange / sales means for the user to exchange or sell the generated character with other users. Furthermore, the emotion recognition means uses an emotion engine that analyzes the user's voice and facial expressions.

[2878] Specific program operation explanation

[2879] Character Generation

[2880] User

[2881] 1. Launch the app and go to the customization options screen.

[2882] 2. Enter customization options such as gender, hair color, body type, and clothing, and press the "Generate" button.

[2883] Terminal

[2884] 1. Sends the customization options entered by the user to the server.

[2885] server

[2886] 1. Using a generative AI model, we generate a character based on submitted customization options.

[2887] 2. The generated character data (images and animations) is sent back to the device.

[2888] Terminal

[2889] 1. Analyze the received character data and display it on the user's screen.

[2890] Character movement control

[2891] Terminal

[2892] 1. Load and execute the character's movement script.

[2893] 2. Depict the character's movements on the screen in real time.

[2894] 3. Have the character talk to the user and walk around the screen.

[2895] Scheduling and Reminders

[2896] User

[2897] 1. Add a new task or event within the app.

[2898] 2. Set the reminder time and date.

[2899] Terminal

[2900] 1. Send the task and event information entered by the user to the server.

[2901] server

[2902] 1. Store task and event information in a database.

[2903] 2. Set a schedule to send notifications at set reminder times.

[2904] server

[2905] 1. Send a reminder notification to your device at the specified time.

[2906] Terminal

[2907] 1. When you receive a reminder notification, a character will display the reminder details on the screen.

[2908] 2. The character notifies the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[2909] Generate messages of praise and encouragement

[2910] User

[2911] 1. Enter the completion of the task in the app and press the Complete button.

[2912] Terminal

[2913] 1. Send task completion information to the server.

[2914] server

[2915] 1. Receive task completion information and generate messages of praise and encouragement.

[2916] 2. Send the generated message back to the terminal.

[2917] Terminal

[2918] 1. Display the received message on the character.

[2919] 2. The character tells the user, "As expected! Thank you for your hard work."

[2920] emotion recognition

[2921] Terminal

[2922] 1. An emotion recognition means (emotion engine) is used to analyze the user's voice and facial expressions in real time.

[2923] 2. Send the user's emotional state to the server.

[2924] server

[2925] 1. Generate instructions to automatically change the character's behavior and message content based on the user's emotional state.

[2926] 2. Send the generated instructions back to the terminal.

[2927] Terminal

[2928] 1. Update the character's actions and message content based on the instructions received.

[2929] 2. The character will respond appropriately to the user's emotions.

[2930] Character exchange and sales

[2931] User

[2932] 1. Go to the character exchange / sales screen.

[2933] 2. Check the character lists published by other users.

[2934] 3. Choose your favorite character and send an exchange or purchase request.

[2935] Terminal

[2936] 1. Send a request from the user to the server.

[2937] server

[2938] 1. Receive the request and update the character information.

[2939] 2. Verify character ownership and send update information back to your device.

[2940] Terminal

[2941] 1. Notify the user of updated character information.

[2942] Specific examples

[2943] For example, if user A sets an alarm for 7:00 a.m. and then checks his / her schedule for the day, the system operates as follows:

[2944] User A launches the app, enters "Set alarm for 7:00" and saves it.

[2945] The terminal transmits the alarm information to the server.

[2946] The server saves the alarm settings and notifies the device at the specified time.

[2947] At the set time, the device will receive a notification and the character will say, "Good morning, today's schedule is..."

[2948] User A checks the calendar and a character reads out today's schedule.

[2949] Furthermore, the character recognizes user A's emotions and, for example, if user A is feeling a little down, provides an encouraging message such as, "Why don't you take a walk today to refresh your mood?"

[2950] In this way, users can not only manage their daily tasks in a fun and efficient way through the characters, but also receive support that is tailored to their emotional state at the time.

[2951] The processing flow will be explained below.

[2952] Specific processing steps of the program

[2953] Character Generation

[2954] Step 1:

[2955] The user launches the app and navigates to the customization options screen.

[2956] Step 2:

[2957] The user enters customization options such as gender, hair color, body type, and clothing, and presses the "Generate" button.

[2958] Step 3:

[2959] The terminal transmits the customization options entered by the user to the server.

[2960] Step 4:

[2961] The server passes the received customization options to the generative AI model.

[2962] Step 5:

[2963] The server uses a generative AI model to generate a character based on customization options.

[2964] Step 6:

[2965] The server returns the generated character data (images and animations) to the device.

[2966] Step 7:

[2967] The terminal analyzes the received character data and displays it on the user's screen.

[2968] Character movement control

[2969] Step 1:

[2970] The device loads and executes the character's movement script.

[2971] Step 2:

[2972] The device depicts the character's movements on the screen in real time.

[2973] Step 3:

[2974] The device causes the character to talk to the user and walk around the screen.

[2975] Scheduling and Reminders

[2976] Step 1:

[2977] A user adds a new task or event within the app.

[2978] Step 2:

[2979] The user sets the reminder time and date.

[2980] Step 3:

[2981] The terminal transmits the task and event information entered by the user to the server.

[2982] Step 4:

[2983] The server stores task and event information in a database.

[2984] Step 5:

[2985] Schedule the server to send notifications at set reminder times.

[2986] Step 6:

[2987] The server sends a reminder notification to the device at the specified time.

[2988] Step 7:

[2989] The device will receive a reminder notification and a character will display the reminder details on the screen.

[2990] Step 8:

[2991] The character will notify the user, for example, "Mr. / Ms. XX, there is a meeting in 15 minutes."

[2992] Generate messages of praise and encouragement

[2993] Step 1:

[2994] The user enters that the task has been completed within the app and presses the Complete button.

[2995] Step 2:

[2996] The terminal sends task completion information to the server.

[2997] Step 3:

[2998] The server receives the task completion information and generates a message of praise or encouragement.

[2999] Step 4:

[3000] The server sends the generated message back to the terminal.

[3001] Step 5:

[3002] The message received by the device is displayed on the character.

[3003] Step 6:

[3004] The character tells the user, "As expected! Thank you for your hard work."

[3005] emotion recognition

[3006] Step 1:

[3007] The device uses an emotion recognition means (emotion engine) to analyze the user's voice and facial expressions in real time.

[3008] Step 2:

[3009] The terminal transmits the user's emotional state to the server.

[3010] Step 3:

[3011] The server generates instructions to automatically change the character's behavior and message content based on the user's emotional state.

[3012] Step 4:

[3013] The server sends the generated instructions back to the terminal.

[3014] Step 5:

[3015] The character's movements and message content are updated based on the instructions received by the device.

[3016] Step 6:

[3017] The character will respond appropriately to the user's emotions.

[3018] For example, if the user is feeling down, the character might suggest, "Why not take a walk today to refresh your mood?"

[3019] Character exchange and sales

[3020] Step 1:

[3021] The user will be taken to the character exchange / sales screen.

[3022] Step 2:

[3023] The terminal sends a request to the server to display a list of characters that other users have made public.

[3024] Step 3:

[3025] The server returns the character list data to the device.

[3026] Step 4:

[3027] The terminal displays a list of characters to the user.

[3028] Step 5:

[3029] Users can choose their favorite character and send an exchange or purchase request.

[3030] Step 6:

[3031] The terminal sends a request from the user to the server.

[3032] Step 7:

[3033] The server receives the request and updates the character's ownership.

[3034] Step 8:

[3035] The server returns the updated character information to the terminal.

[3036] Step 9:

[3037] The terminal notifies the user of the updated character information.

[3038] Example 2

[3039] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[3040] In conventional task management systems, it was difficult for users to receive appropriate support that took their emotional state into consideration. Furthermore, there were few interactive task management methods through characters, and the system lacked features to enhance user motivation. Furthermore, character customization and sharing functions were limited, limiting the user experience.

[3041] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an input means for a user to input customization options, a generation means for generating a character using a generative AI model, a control means for controlling the behavior of the generated character, a schedule management means for the character to manage the user's schedule, a notification means for the character to notify the user of reminders, a message generation means for the character to generate a message of praise or encouragement when the user completes a task, an emotion recognition means for analyzing the user's voice and facial expressions, an emotion adaptation means for changing the character's behavior and message content based on the emotional state recognized by the emotion recognition means, and an exchange / sales means for exchanging or selling the user-generated character with other users. This enables users to perform interactive and motivational task management while receiving appropriate support according to their emotions. Furthermore, the range of character customization and sharing is expanded, providing a rich user experience.

[3042] An "input means" is a device or interface through which a user inputs customization options.

[3043] "Generation means" refers to a mechanism or program for generating a character based on input customization options. ...

Claims

1. an input means for a user to input customization options; a generation means for generating a character based on the customization options; a control means for controlling the actions of the generated character; a schedule management means for managing the schedule of the user by the character; a notification means for the character to notify the user of a reminder; a message generating means for generating a message of praise or encouragement from the character when the user completes a task; A system including:

2. The system according to claim 1 , further comprising an exchange / sales means for exchanging or selling the character generated by the user with other users.

3. The system of claim 1 , wherein the generating means generates the character using a generative AI model.

Images