System

Abstract

A system is provided.SOLUTION: This system includes a means for inputting the profile information of a user and the allocation of free time, a means for generating a plurality of action plans based on the profile information and time allocation inputted by using a generation AI, a means for presenting the generated action plans to the user, a means for sharing the action plan selected by the user with a family, and a means for providing reminders for executing the action plan.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern society, many factors intersect, such as work, family, personal hobbies, and studies, making it difficult to decide what to prioritize in the limited time available. For this reason, there is a growing need for a system that instantly provides specific action plans to maximize free time and satisfy diverse needs.

[0005] Traditional scheduling applications and manual planning methods have difficulty meeting these complex needs, and users end up spending a lot of time trying to choose the optimal course of action. It is particularly difficult to balance time with family and self-improvement, creating a need for efficient time management.

[0006] An object of the present invention is to provide a system that allows users to efficiently utilize their free time while effectively satisfying various needs of users. [Means for solving the problem]

[0007] The present invention solves the above problem by providing a system including a means for inputting a user's profile information and free time allocation, a means for generating multiple action plans based on the input profile information and time allocation using a generation AI, a means for presenting the generated action plans to the user, a means for sharing the action plans selected by the user with family members, and a means for providing reminders to carry out the action plans.

[0008] Specifically, users enter a profile including their basic information, interests, and family information, and then set how much free time they have available. Based on this, the AI ​​generates optimal activity plans and suggests them to the user. The user can then choose from the proposed activities and share them with their family. The system also uses a reminder function to notify them of any necessary preparations or reservations, allowing them to use their free time efficiently and effectively.

[0009] "User" refers to an individual or group that uses the system.

[0010] "Profile information" refers to basic information such as a user's name, age, family composition, occupation, hobbies, and interests.

[0011] "Time allocation" refers to information for setting how much of a user's free time to allocate to which activity.

[0012] "Generative AI" is a type of artificial intelligence that has the ability to generate multiple action plans based on a user's profile information and time allocation.

[0013] "Action proposal" refers to a specific activity or plan proposed by the generative AI, which is appropriate for the user's interests and time allocation.

[0014] "Family" refers to an individual or group of people who are closely related to the user to share action suggestions with.

[0015] "Remind" refers to a function that notifies or alerts the user about a specific time or event.

[0016] "System" refers to the entire functionality including a series of processes such as inputting user information, generating action plans, presenting them, sharing them, and reminding them. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] ---

[0039] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of using a generation AI to propose multiple action plans and share them with the user and their family. The system of the present invention includes the following procedures and functions.

[0040] 1. User information registration:

[0041] Users first log in or register with the system and enter their profile information, which includes their name, age, family composition, occupation, hobbies, interests, etc.

[0042] Next, the user sets how to allocate their free time, dividing it into categories such as time with family, study time, and self-improvement time.

[0043] 2. Generate action plans:

[0044] The terminal receives the registered user information and time allocation and transmits them to the server.

[0045] The server uses a generation AI to generate multiple action plans based on the received user information and time allocation. This generation process takes into account the user's interests and hobbies, family schedules and interests, budget and time constraints, location and travel time, etc.

[0046] 3. Propose a plan of action:

[0047] The server returns the generated action plan to the terminal.

[0048] The device presents this to the user in a list format, with detailed information attached to each proposed action (such as the required time, cost, and necessary preparations).

[0049] 4. Select an action plan and confirm details:

[0050] The user selects the plan they are interested in from the proposed activities. Detailed information about the selected plan is provided via the terminal. Necessary preparations and reservations are also notified at this stage.

[0051] 5. Share with family:

[0052] To share the user's selected action plan with family members, the device will send a notification to the family member's device, allowing everyone in the family to see the plan details.

[0053] 6. Reminder function:

[0054] The device will set a reminder for the planned action date, notify the user of the preparation list the day before the scheduled time, and send another reminder one hour before the scheduled time.

[0055] Specific examples

[0056] Here, a specific example of use will be shown.

[0057] Registering user information and selecting action plans

[0058] User Ichiro Sato signs up for the app and enters his name, age, family composition, occupation, and hobbies (reading, cooking, outdoors) as profile information.

[0059] User Ichiro Sato sets his free time as "time with family" for three hours on weekends, "time for study" for one hour on weekdays, and "time for self-improvement" for two hours a week.

[0060] The device sends the input data to the server, which uses a generative AI to generate the following action plan:

[0061] "Family time": Day trips to theme parks, movies, board games at home

[0062] "Study Time": Online courses for exam preparation, learning new programming languages

[0063] "Time for self-improvement": Trying new recipes, reading books as a hobby

[0064] The server returns the generated action plan to the terminal, and the terminal presents the action plan to the user, Ichiro Sato, in a list format.

[0065] Action plan execution and reminder function

[0066] User Ichiro Sato selects "day trip to a theme park" as "time with family."

[0067] The device will provide the user with the selected details (time required, cost, packing list, etc.) and notify them of the preparation list the day before, and will also send another reminder one hour before the day.

[0068] User Ichiro Sato and his family enjoy a fun day at the theme park.

[0069] In this way, the system of the present invention provides a variety of action plans tailored to the user's needs, allowing the user to use their time efficiently and effectively.

[0070] The processing flow will be explained below.

[0071] Step 1:

[0072] A user signs up or logs into the system and enters profile information, including name, age, family status, occupation, hobbies, and interests.

[0073] Step 2:

[0074] The device receives the user's profile information and stores it in a local database.

[0075] Step 3:

[0076] Users can set how much free time they have available, for example, by setting time for family, study, self-improvement, etc.

[0077] Step 4:

[0078] The terminal receives the configured free time allocation and stores it in a local database.

[0079] Step 5:

[0080] The terminal transmits profile information and time allocation information to the server.

[0081] Step 6:

[0082] The server uses AI to generate multiple action plans based on the profile information and time allocation information received, taking into account the user's interests, hobbies, budget, time, location, etc.

[0083] Step 7:

[0084] The server returns the generated action plan to the terminal.

[0085] Step 8:

[0086] The device receives the proposed activities and presents them to the user in a list format, with detailed information attached to each proposed activity, such as the required time, cost, and necessary preparations.

[0087] Step 9:

[0088] The user selects from the proposed activities and chooses the plan that interests them.

[0089] Step 10:

[0090] The device will display detailed information about the selected plan of action and notify you of any necessary preparations or reservations.

[0091] Step 11:

[0092] To share the user's selected action plan with family members, the device sends a notification to the family members' devices.

[0093] Step 12:

[0094] Family members' devices will receive a notification and display detailed information about the proposed action.

[0095] Step 13:

[0096] The device will set a reminder function for the planned action date and notify you of the preparation list the day before the scheduled time.

[0097] Step 14:

[0098] The device will send another reminder to the user one hour before the scheduled time.

[0099] Step 15:

[0100] On the scheduled day, the user and family carry out the selected action plan.

[0101] Example 1

[0102] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0103] In modern society, users lead busy lives, making it difficult to utilize their free time efficiently and effectively. Furthermore, the processes of coordinating schedules with family members, selecting activity plans, and setting reminders are time-consuming. To solve these problems, a system is needed that can suggest optimal activity plans based on the user's interests and time allocation, and easily share these plans with family members.

[0104] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0105] In this invention, the server includes means for inputting a user's profile information and free time allocation, means for generating multiple action plans based on the input profile information and free time allocation using a generation AI model, means for presenting the generated action plans to the user, means for sharing the action plans selected by the user with other users, and means for providing reminders to execute the action plans. This makes it possible to efficiently generate a variety of action plans tailored to the user's needs and easily coordinate time with family members.

[0106] A "user" is an individual who uses the system to set profile information and time allocation and receive action suggestions.

[0107] "Profile information" is personal information including the user's name, age, family composition, occupation, hobbies, interests, etc.

[0108] A "generative AI model" is an artificial intelligence program that generates action plans based on information input by the user.

[0109] "Action suggestions" are options or plans suggested by the generative AI model based on the user's profile information and time allocation.

[0110] "Remind" is a function that notifies the user of a specified time and content in order to carry out a proposed action.

[0111] A "terminal" is a device such as a computer or smartphone that a user uses to operate the system.

[0112] The "server" is a central processing unit that processes user input information and generates action plans using generative AI models and provides reminder functions.

[0113] "Share" is a function that notifies other users of information about the action plan selected by the user, allowing them to check the same action plan.

[0114] "Detailed information" refers to additional information about the proposed action, such as the time required, costs, and necessary preparations.

[0115] MODE FOR CARRYING OUT THE INVENTION

[0116] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of using a generation AI to propose multiple action plans and share them with the user and their family. The system for implementing the present invention performs data processing and data calculation using the following hardware and software.

[0117] Hardware and software used

[0118] Hardware:

[0119] Devices: computers, smartphones, tablets, etc.

[0120] Server: Cloud-based server or server located in a data center

[0121] software:

[0122] Generative AI models: Natural language processing models such as GPT-4

[0123] Data transmission and reception: RESTful API using HTTP protocol

[0124] Database: A relational database (e.g., MySQL, PostgreSQL) to store user information

[0125] Specific example explanation

[0126] Registering user information and selecting action plans

[0127] 1. A user logs in to the system or registers. They enter their name, age, family composition, occupation, hobbies, and interests as profile information. For example, a user clicks the "New Registration" button and enters information such as "Name: Taro Tanaka," "Age: 35," "Family composition: Wife and two children," "Occupation: Engineer," and "Hobbies: Reading, cooking, and the outdoors" into the form.

[0128] 2. The user sets how they want to allocate their free time. For example, they can set three hours of "time with family" on the weekend, one hour of "study time" on weekdays, and two hours of "self-improvement time" per week. This data is collected by the device and sent to the server.

[0129] Generation and presentation of action plans

[0130] 1. The server inputs the received user information and time allocation into the generative AI model. An example of a prompt sentence is, "Please suggest an action plan for Taro Tanaka, a 35-year-old man with two children, to spend the weekend with his family."

[0131] 2. The generative AI model generates multiple suggested actions based on the prompt, such as "take a day trip to a theme park," "watch a movie," or "play board games at home."

[0132] 3. The server returns the generated action plans to the terminal, which then presents them to the user in a list format. Each action plan includes detailed information such as the required time, cost, and necessary preparations.

[0133] Selecting and sharing action plans

[0134] 1. The user selects an action plan that interests them from the presented options. For example, they select "a day trip to a theme park."

[0135] 2. The selected action plan is shared from the device to the devices of other users (family members), and all family members can check the details of the plan. Specifically, using the reminder function, the preparation list is notified the day before the action plan is to be carried out. A reminder is also sent one hour before the day.

[0136] In this way, the system of the present invention can utilize a generative AI model to propose various action plans based on the user's profile information and time allocation, making it possible to utilize free time efficiently and effectively.

[0137] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0138] Step 1:

[0139] A user logs in to the system or registers. The user clicks the "New Registration" button on the login screen and enters the required profile information (name, age, family composition, occupation, hobbies, interests, etc.) in the form. By pressing the submit button for the input data, the input data is sent from the terminal to the server. This input data includes the user's basic personal information. The server stores the received data in a database and confirms that registration is complete.

[0140] Step 2:

[0141] Users set how their free time is allocated within the system. On the "Time Settings" page, users use the pull-down menus to allocate time to "time with family," "time for study," and "time for self-improvement." For example, users can set "time with family" for three hours on weekends, "time for study" for one hour on weekdays, and "time for self-improvement" for two hours a week. The entered time allocation data is sent from the device to the server. The server receives this data and stores it together with the user's profile information.

[0142] Step 3:

[0143] The server uses the collected user information and time allocation data to create a prompt to be input into the generative AI model. For example, it generates a prompt such as, "Please suggest some activities that Taro Tanaka, a 35-year-old man with two children, should do to spend the weekend with his family." This prompt is sent to the generative AI model, which then generates a proposed action. The input here is the prompt and user data, and the output is multiple proposed actions.

[0144] Step 4:

[0145] The generative AI model generates multiple suggested actions based on the input prompt. For example, it generates suggested actions such as "day trip to a theme park," "watching a movie," or "playing board games at home." These suggested actions are returned to the server as JSON-formatted data. The server receives this data, analyzes it, and selects the optimal suggested action for the user.

[0146] Step 5:

[0147] The server sends the selected action plan in JSON format to the device. The device analyzes the received data and generates a list of action plans. These are presented to the user in list format, with each action plan accompanied by detailed information such as the required time, cost, and necessary preparations. The user can view this information on the device screen.

[0148] Step 6:

[0149] The user selects an interesting plan from the proposed activities. For example, they select "a day trip to a theme park." The selected activity plan is sent from the device to the server, which stores this information. After that, detailed information about the selected activity plan is sent back to the device and displayed to the user.

[0150] Step 7:

[0151] The device will send a push notification to the family members' devices to share the selected action plan with them, allowing all family members to view the plan details.

[0152] Step 8:

[0153] The device will set a reminder function for the planned action date. Specifically, the device will notify the user of the preparation list the day before the planned action time, and will also send another reminder one hour before the planned action time. The notification will be sent using the device's alarm function.

[0154] In this way, the processing flow and operations at each step provide functions that allow users to efficiently and effectively utilize their free time and share it with family and other users.

[0155] (Application example 1)

[0156] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0157] Conventional lifestyle support systems lack the functionality to provide specific and personalized suggestions for efficiently and effectively utilizing users' free time, and have issues with mechanisms for sharing or reminding users of suggested activities.Furthermore, they lack the functionality to generate shopping plans based on users' interests and family schedules, and are unable to provide information that is truly useful in daily life.

[0158] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0159] In this invention, the server includes means for inputting a user's profile information and free time allocation, means for generating multiple planned activities based on the input profile information and free time allocation using a generation AI, means for presenting the generated planned activities to the user, means for sharing the planned activities selected by the user, means for providing reminders to carry out the planned activities, means for providing detailed information about the generated planned activities (e.g., required time, cost, location, recommended products), and means for sending notifications to share the selected planned activities with family members. This allows the server to provide specific suggestions based on the user's interests and preferences, enabling the user and his or her family to use their time efficiently.

[0160] "User profile information" refers to information about an individual, such as the user's name, age, family structure, occupation, hobbies, and interests.

[0161] "Free time allocation" refers to the allocation of free time available to a user to specific categories (for example, time with family, time for shopping, time for self-improvement, etc.).

[0162] "Generative AI" is artificial intelligence that automatically generates multiple action plans based on user input information.

[0163] An "action plan" is a specific action plan proposed by the generative AI, and includes detailed information such as the required time, cost, location, and recommended products.

[0164] "Remind" is a function that notifies the user in advance of the information necessary for preparation and implementation of the action plan selected by the user on the execution date.

[0165] "Detailed information" refers to specific information related to the proposed action, such as the required time, cost, location, and recommended products.

[0166] "Notification" is a message for conveying information about the generated action plan or reminder information to the user or their family.

[0167] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of using a generation AI to propose multiple action plans and share them with the user and their family. The system of the present invention includes the following procedures and functions.

[0168] First, users log in or register with the system's application. At this time, they enter their profile information (name, age, family composition, occupation, hobbies, interests, etc.). They then set their free time into categories such as "shopping time," "shopping time with family," and "short shopping (5-30 minutes)."

[0169] The device sends the input data to the server, which uses a generative AI to generate multiple action plans based on the user's information and free time allocation. The generation process takes into account the user's interests and hobbies, family schedules and interests, budget and time constraints.

[0170] The server sends the generated action plans back to the device, which then presents them to the user in list form. Detailed information (e.g., required time, cost, store location, recommended products, etc.) is attached to each action plan. The user selects the plan that interests them from the presented action plans. Detailed information about the selected action plan is provided via the device, along with notifications of necessary preparations and store reservations.

[0171] Additionally, the device will send a notification to family members' devices to share the user's selected action plan with them, allowing all family members to review the plan details and agree to it.

[0172] The device will set a reminder function for the planned action date. The device will notify the user of the preparation list the day before the planned action date, and will also send another reminder one hour before the planned action date. This reminder function helps the user to remember to carry out the planned action.

[0173] As a specific example of use, let's consider a case where a user uses a shopping assistant app. The user enters their profile information and sets up three hours of shopping time on the weekend. The server uses generative AI to suggest activities such as "looking for new clothes" and "visiting electronics stores," and provides detailed information (time required, cost, location, recommended products). When the user selects "looking for new clothes," the detailed information is displayed in the app, and a shared notification is sent to family members. The reminder function sends notifications the day before and one hour before, allowing the user to smoothly carry out the proposed action plan.

[0174] An example prompt might look like this:

[0175] User profile: Taro Tanaka, Age: 32, Family: Wife, Children, Occupation: Engineer

[0176] Interests: clothing, electronics, books

[0177] Free time: 3 hours of shopping on weekends, 30 minutes of quick shopping on weekdays

[0178] prompt:

[0179] User: "Taro Tanaka, 32 years old, Family: Wife, Children, Occupation: Engineer, Interests: Clothing, Electronics, Books, 3 hours of shopping on weekends, 30 minutes of quick shopping on weekdays"

[0180] Generation AI: Returns the generated action plan.

[0181] Examples: "Looking for new clothes, Time required: 180 minutes, Cost: 5,000 yen, Store location: Commercial district, Recommended items: Simple shirts, shoes"; "Visiting electronics stores, Time required: 120 minutes, Cost: 60,000 yen, Store location: Electric town, Recommended items: Latest smartphone, headphones"

[0182] As a result, the system of the present invention can provide a variety of action plans according to the user's needs, allowing the user to use their time efficiently and effectively.

[0183] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0184] Step 1:

[0185] A user logs in to the system's application or registers. The user enters profile information such as name, age, family composition, occupation, hobbies, and interests. The user also divides their free time into categories such as "shopping time," "shopping time with family," and "short shopping (5-30 minutes)." This input information is saved on the device.

[0186] Input: User profile information and free time allocation

[0187] Output: User information stored on the device

[0188] Step 2:

[0189] The terminal sends the data entered by the user to the server using an HTTP request, sending the data in JSON format.

[0190] Input: User information stored on the device

[0191] Output: User information sent to the server

[0192] Step 3:

[0193] The server inputs the received user information into a generative AI model, which generates multiple action plans based on the user information and time allocation. The generative AI model generates action plans based on the prompt text and creates specific suggestions.

[0194] Input: User information sent to the server

[0195] Output: Action plans generated by the generative AI model

[0196] Step 4:

[0197] The server sends the generated action plan back to the device, along with detailed information (time required, cost, store location, recommended products, etc.) in JSON format.

[0198] Input: Action proposals generated by a generative AI model

[0199] Output: Action plan and detailed information sent to the device

[0200] Step 5:

[0201] The device displays the received action plans and detailed information to the user in a list format. The user can select an action plan that interests them from the list and check the detailed information of the selected action plan.

[0202] Input: Action plan and details sent to the terminal

[0203] Output: A list of suggested actions shown to the user, with detailed information

[0204] Step 6:

[0205] When the user selects an activity plan that interests them, the terminal displays the selected activity plan in more detail and prepares to notify them if any related preparations or reservations are required.

[0206] Input: User selected action plan

[0207] Output: Display details of selected action plan and prepare notification

[0208] Step 7:

[0209] The device then sends details of the selected plan to the family members' devices, allowing all family members to confirm the plan details and obtain their consent.

[0210] Input: Details of selected action plan

[0211] Output: Notification of proposed actions sent to family members' devices

[0212] Step 8:

[0213] The device will set up a reminder function to remind users to carry out their planned action plan. The device will notify them of the preparation list the day before the planned date, and will also send another reminder one hour before the planned date. This will help users remember to carry out their planned action plan.

[0214] Input: Selected action plan and its execution date

[0215] Output: Reminder notification

[0216] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0217] ---

[0218] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of combining a generative AI and an emotion engine to propose multiple action plans and share them with the user and their family. The system of the present invention includes the following procedures and functions.

[0219] 1. User information registration:

[0220] Users first log in or register with the system and enter their profile information, which includes their name, age, family composition, occupation, hobbies, interests, etc.

[0221] Next, the user sets how to allocate their free time, dividing it into categories such as time with family, study time, and self-improvement time.

[0222] 2. Generate action plans:

[0223] The terminal receives the registered user information and time allocation and transmits them to the server.

[0224] The server uses a generation AI to generate multiple action plans based on the received user information and time allocation. This generation process takes into account the user's interests and hobbies, family schedules and interests, budget and time constraints, location and travel time, and emotional information obtained from the emotion engine.

[0225] 3. Emotional Engine Linkage:

[0226] The device recognizes the user's real-time emotional state and transmits the emotional information to the server.

[0227] The server uses an emotion engine to analyze the user's emotional state and optimizes suggested actions accordingly.

[0228] The system also analyzes the user's past emotional history and generates more appropriate action plans based on this.

[0229] 4. Propose a plan of action:

[0230] The server returns the generated action plan to the terminal.

[0231] The device presents this to the user in a list format, with detailed information attached to each proposed action (such as the required time, cost, and necessary preparations).

[0232] 5. Select an action plan and confirm details:

[0233] The user selects the plan of interest from the presented options. Detailed information about the selected option is provided via the terminal. Necessary preparations and reservation information are also notified at this stage.

[0234] 6. Share with family:

[0235] To share the user's selected action plan with family members, the device will send a notification to the family member's device, allowing everyone in the family to see the plan details.

[0236] 7. Reminder function:

[0237] The device will set a reminder function for the planned action date and notify the user of the preparation list the day before the scheduled time.

[0238] It will also send another reminder one hour before the scheduled time.

[0239] Specific examples

[0240] Here, a specific example of use will be shown.

[0241] Registering user information and selecting action plans

[0242] User Yamada Taro signs up for the app and enters his name, age, family composition, occupation, and hobbies (reading, cooking, outdoors) as profile information.

[0243] User Yamada Taro sets his free time as "time with family" for three hours on weekends, "time for study" for one hour on weekdays, and "time for self-improvement" for two hours a week.

[0244] The device sends the input data to the server, which uses a generative AI to generate the following action plan:

[0245] "Family time": Day trips to theme parks, movies, board games at home

[0246] "Study Time": Online courses for exam preparation, learning new programming languages

[0247] "Time for self-improvement": Trying new recipes, reading books as a hobby

[0248] The server also uses an emotion engine to analyze Yamada Taro's real-time emotions and past emotion history, and determines that a "day trip to a theme park" is the best option.

[0249] The server returns the action plan to the terminal, and the terminal presents the action plan to the user Yamada Taro in list form.

[0250] Action plan execution and reminder function

[0251] User Yamada Taro selects "day trip to a theme park" as "time with family."

[0252] The device will provide the user with the selected details (time required, cost, packing list, etc.) and notify them of the preparation list the day before, and will also send another reminder one hour before the day.

[0253] User Yamada Taro and his family enjoy a fun day at the theme park.

[0254] In this way, the system of the present invention takes into consideration not only the user's needs but also the user's emotional information, provides optimal action plans, and enables efficient and effective use of time.

[0255] The processing flow will be explained below.

[0256] Step 1:

[0257] A user signs up or logs into the system and enters profile information, including name, age, family status, occupation, hobbies, and interests.

[0258] Step 2:

[0259] The device receives the user's profile information and stores it in a local database.

[0260] Step 3:

[0261] Users can set how much free time they have available, for example, by setting time for family, study, self-improvement, etc.

[0262] Step 4:

[0263] The terminal receives the configured free time allocation and stores it in a local database.

[0264] Step 5:

[0265] The terminal transmits profile information and time allocation information to the server.

[0266] Step 6:

[0267] The server uses a generation AI to generate multiple action plans based on the profile information and time allocation information received. This process takes into account the user's interests, hobbies, budget, time, location, and emotional information obtained from the emotion engine.

[0268] Step 7:

[0269] The device recognizes the user's real-time emotional state and transmits the emotional information to the server.

[0270] Step 8:

[0271] The server uses an emotion engine to analyze the user's emotional state and optimizes the proposed actions based on it, and also analyzes the user's past emotional history to generate more appropriate proposed actions.

[0272] Step 9:

[0273] The server returns the generated action plan to the terminal.

[0274] Step 10:

[0275] The device receives the proposed activities and presents them to the user in a list format, with detailed information attached to each proposed activity, such as the required time, cost, and necessary preparations.

[0276] Step 11:

[0277] The user selects from the proposed activities and chooses the plan that interests them.

[0278] Step 12:

[0279] The device will display detailed information about the selected plan of action and notify you of any necessary preparations or reservations.

[0280] Step 13:

[0281] To share the user's selected action plan with family members, the device sends a notification to the family members' devices.

[0282] Step 14:

[0283] Family members' devices will receive a notification and display detailed information about the proposed action.

[0284] Step 15:

[0285] The device will set a reminder function for the planned action date and notify you of the preparation list the day before the scheduled time.

[0286] Step 16:

[0287] The device will send another reminder to the user one hour before the scheduled time.

[0288] Step 17:

[0289] On the scheduled day, the user and family carry out the selected action plan.

[0290] Example 2

[0291] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0292] In modern society, users are expected to use their free time efficiently and effectively. However, conventional scheduling and planning tools struggle to provide optimal action plans that take into account the user's interests and real-time emotional state. Furthermore, they lack the functionality to share action plans with family and related individuals, or to provide reminders for the execution of action plans. This leads to issues such as low user satisfaction and inefficient time utilization.

[0293] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting a user's identification information and free time allocation, means for generating multiple activity plans based on the input identification information and free time allocation using a generative AI model, means for acquiring and analyzing real-time emotional information, means for optimizing the activity plans based on the emotional state using an emotion engine, means for displaying the generated activity plans to the user, means for sharing the activity plan selected by the user with related others, and means for providing reminders to execute the activity plans. This makes it possible to provide optimal action plans tailored to the user's interests and real-time emotional state, enabling efficient and effective time utilization.

[0294] "User identification information" is information for identifying an individual user, and includes data such as name, age, occupation, and hobbies.

[0295] "Allocation of free time" is information indicating the free time that the user can use for specific activities, and is time allocated to each category such as time with family and time for self-improvement.

[0296] A "generative AI model" is an artificial intelligence model that generates specific outputs based on input data.

[0297] "Real-time emotional information" refers to information that indicates a user's current emotional state, and includes data obtained from sensors such as facial recognition cameras and smart devices.

[0298] An "emotion engine" is a software or hardware component that analyzes the acquired emotion information and identifies the user's emotional state.

[0299] "Activity suggestions" are suggestions for specific activities that a user can undertake in their free time.

[0300] "Related others" are people who may share time with the user, and primarily include family and friends.

[0301] The "remind function" is a function that notifies the user at a specific time or date of the information and preparations necessary to carry out the activity plan selected by the user.

[0302] This invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of combining a generative AI and an emotion engine to propose multiple action plans and share them with the user and related others.

[0303] Specific system configuration

[0304] 1. Hardware and Software Configuration

[0305] The server has computational resources including a database, generative AI models, and emotion engines, and plays a central role in distributing the generated action plans to each user.

[0306] The device includes an interface that allows users to input information, sensors to acquire real-time emotional states, and a screen that displays data from a server. Typical examples are smartphones and personal computers.

[0307] Users interact with the system through terminals.

[0308] 2. System Operation

[0309] First, a user logs in or registers with the system and enters identifying information such as name, age, family composition, occupation, hobbies, and interests. After successful login, the system assigns the next available time. For example, the user can set three hours on the weekend for family time, one hour on weekdays for study, and two hours per week for self-improvement.

[0310] The device receives the input identification information and time allocation and sends it to the server, which then creates a prompt for the generative AI model, such as: "Please generate action suggestions based on the user's interests and time allocation."

[0311] Based on this prompt, the generative AI model generates multiple suggested activities, such as a day trip to a theme park, going to the movies, or playing board games at home for "family time."

[0312] Second, real-time emotional information is crucial. The device acquires the user's current emotional state through sensors or smartwatches and transmits it to the server. The server uses an emotion engine to analyze this emotional information and identify the user's emotional state. Based on this emotional state, the generated action plan is optimized.

[0313] The server then sends the generated optimal action plans to the device, which then presents them to the user in a list format, including detailed information about each action plan, such as the required time, cost, and necessary preparations.

[0314] When the user selects a plan, the details are displayed again, along with any necessary preparations or booking information.

[0315] Furthermore, the selected action plan can be shared with other related parties, such as family members, and the device can send notifications to the family members' devices and add the event to a shared calendar.

[0316] The reminder function is also an important element. The device notifies the user of the preparation list the day before the planned action, and then sends another reminder one hour before the scheduled action. This helps the user to remember to carry out the planned action.

[0317] Specific examples

[0318] Here is a specific example.

[0319] Registering user information and selecting action plans

[0320] User A signs up for the app and enters his / her name, age, family composition, occupation, and hobbies (reading, cooking, outdoors) as profile information. User A sets his / her free time as "time with family" for three hours on weekends, "study time" for one hour on weekdays, and "self-improvement time" for two hours a week. The device sends this data to the server, which stores it in a database.

[0321] Generate action plans

[0322] The device periodically sends user information to a server, which then uses a generative AI model to generate suggested activities. For example, suggested activities for "family time" include a day trip to a theme park, going to the movies, and playing board games at home.

[0323] Linking the Emotion Engine

[0324] The device captures the user's current emotional state using a facial recognition camera and sends it to the server, which uses an emotion engine to identify the user's emotional state, such as "I'm currently stressed," and optimizes the suggested actions.

[0325] Proposing action plans

[0326] The server sends the optimized itinerary to the device, which displays the itinerary in a list format and provides detailed information (e.g., duration, cost, required ticket information, and packing list for a day trip to a theme park).

[0327] Select an action plan and confirm details

[0328] User A selects "Day trip to a theme park." The device displays detailed information about the selected plan and notifies the user of necessary preparations and reservation information.

[0329] Sharing with family

[0330] The device notifies the family members of the selected action plan and adds it to a shared calendar.

[0331] Reminder function

[0332] The device will notify you of the preparation list the day before the planned action is to be carried out, and will send another reminder one hour before the scheduled action.

[0333] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0334] Processing Steps

[0335] Step 1: Enter user information and register

[0336] input:

[0337] Users log in or register with the system and enter identifying information such as name, age, family status, occupation, hobbies, interests, etc. They also set their available time allocations.

[0338] Specific behavior:

[0339] 1. A user accesses the app and enters their login information (username and password).

[0340] 2. The device sends the authentication data to the server.

[0341] 3. The server performs authentication, and if authentication is successful, displays a profile entry screen to the user.

[0342] 4. The user enters the required profile information and time allocation.

[0343] output:

[0344] Profile information and time allocations are stored in a database.

[0345] Step 2: Generate action plans

[0346] input:

[0347] The terminal transmits the stored user information and time allocation to the server.

[0348] Specific behavior:

[0349] 1. The terminal periodically sends user information to the server.

[0350] 2. The server creates a prompt for the generative AI model and instructs it to generate an action plan.

[0351] 3. For example, send a prompt such as, "Generate action plans based on the user's interests and time allocation."

[0352] output:

[0353] The generative AI model outputs multiple action plans, which are stored on the server.

[0354] Step 3: Acquiring and analyzing emotional information

[0355] input:

[0356] The device acquires the user's real-time emotional information and transmits it to the server.

[0357] Specific behavior:

[0358] 1. The device uses sensors or smartwatches to capture the user's emotional state, for example, by reading facial expressions with a facial recognition camera or measuring heart rate.

[0359] 2. The device sends the acquired emotion information to the server.

[0360] 3. The server uses an emotion engine to analyze this emotion information.

[0361] output:

[0362] The emotion engine identifies the user's emotional state and the results of this analysis are stored on the server.

[0363] Step 4: Optimize your action plan

[0364] input:

[0365] The server obtains the generated action plan and the analysis results of the emotion engine.

[0366] Specific behavior:

[0367] 1. The server integrates the stored action plans with the sentiment analysis results.

[0368] 2. Optimize the generated action proposals based on the analysis results of the emotion engine.

[0369] output:

[0370] The optimized action plan is stored on the server and used for further processing.

[0371] Step 5: Propose a course of action

[0372] input:

[0373] The server sends the optimized action plan to the terminal.

[0374] Specific behavior:

[0375] 1. The server sends the optimized action plan to the device.

[0376] 2. The device presents the user with a list of suggested activities, each of which includes detailed information such as the time required, cost, and necessary preparations.

[0377] output:

[0378] The suggested actions are displayed on the user's device.

[0379] Step 6: Select an action plan and confirm details

[0380] input:

[0381] The user selects an action plan that interests them from the presented options.

[0382] Specific behavior:

[0383] 1. The user taps or clicks to select an action.

[0384] 2. The device will display detailed information about the selected activity, such as a "day trip to a theme park" (duration, cost, required tickets, packing list, etc.).

[0385] output:

[0386] Detailed information about the selected action plan is displayed on the user's terminal.

[0387] Step 7: Share your action plan

[0388] input:

[0389] The user's selected action plan is shared with the device.

[0390] Specific behavior:

[0391] 1. The device sends notifications of the selected action plan to the devices of other relevant people (family and friends).

[0392] 2. The device sends the shared information to other related devices and adds the event to the shared calendar.

[0393] output:

[0394] Notify others on their devices and add them to a shared calendar.

[0395] Step 8: Reminders

[0396] input:

[0397] When the planned action date approaches, the device will set a reminder.

[0398] Specific behavior:

[0399] 1. The terminal notifies the user of the preparation list the day before the planned action is to be carried out.

[0400] 2. The device will send another reminder one hour before the scheduled departure time, including a final confirmation of departure time and a final check of the packing list.

[0401] output:

[0402] A reminder notification will be displayed on the user's device, and the action plan will be ready to be carried out.

[0403] In this way, the system considers the user's needs and emotional information at each step, generating and providing optimal action plans, allowing for efficient and effective use of time.

[0404] (Application example 2)

[0405] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0406] Efficient operation management and maintenance planning for machines in factories are crucial for maximizing production efficiency. However, current systems make it difficult to centrally manage machine idle times and maintenance schedules, and are unable to provide optimal task and maintenance proposals that take into account machine utilization rates and failure trends. Furthermore, a flexible system that can handle a large number of machines and a variety of tasks is required. To solve this problem, a system is needed that can monitor machine operation status and emotional state in real time and propose optimal task proposals and maintenance schedules.

[0407] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0408] In this invention, the server includes a means for inputting a user's profile information and free time allocation, a means for generating multiple action plans based on the input profile information and free time allocation using a generation AI, and a means for managing the free time and maintenance schedules of machines in a factory and generating optimal task plans and maintenance plans. This makes it possible to realize efficient machine operation and optimized maintenance, thereby improving production efficiency.

[0409] "User" means an individual or company representative who uses the system.

[0410] "Profile information" is basic information for identifying an individual, such as the user's name, age, occupation, and hobbies.

[0411] "Free time allocation" refers to settings that indicate how much time a user will devote to a particular activity.

[0412] "Generative AI" is a system that uses artificial intelligence technology to automatically generate optimal action plans and task plans based on information from users and machines.

[0413] An "action plan" is an activity plan that is suitable for the user's free time.

[0414] "Maintenance schedule" refers to the schedule for regular maintenance, inspection, and repair work on machinery.

[0415] A "task proposal" is a specific work instruction or work plan for a machine to carry out.

[0416] A "farm manager" is a person in charge of operating and managing machinery and systems within a factory.

[0417] "Remind" is a function that notifies users and farm managers before carrying out proposed actions or performing maintenance.

[0418] The "emotion engine" is a technology that analyzes a machine's operating rate and tendency to fail as an emotional evaluation, and generates optimal action plans and task plans based on that.

[0419] "Notification" is a means of communicating generated task proposals and maintenance schedules to users and farm managers.

[0420] The present invention is a system for efficiently and effectively utilizing the free time of users (e.g., factory managers) and the operating time of machines in a factory. In particular, it has the function of combining a generative AI and an emotion engine to propose multiple action plans and task plans and share them with users and related parties. The system of the present invention includes the following procedures and functions.

[0421] 1. User information registration

[0422] First, the user logs in or registers on the terminal and enters their profile information. User information includes their name, age, occupation, etc. At the same time, the allocation of their free time is also set, and time is allocated to specific categories (e.g., maintenance time, product assembly time, etc.). This allows the user to give detailed instructions on the operation schedule of the machines under their control.

[0423] 2. Generate action and task proposals

[0424] The device receives the registered user information and time allocation and sends it to the server. The server uses a generation AI to generate multiple action plans and task plans based on the received user information and time allocation. This generation process takes into account the machine's operating status, maintenance history, past machine performance data, budget and time constraints, and emotional information obtained from the emotion engine.

[0425] 3. Linking the Emotional Engine

[0426] The terminal monitors the machine's real-time operating rate and failure rate and transmits emotional information to the server. The server uses an emotion engine to analyze the machine's emotional state and optimizes action and task proposals based on that information. For example, the emotion engine can predict the possibility of a machine failure based on its past operating history and automatically create an appropriate maintenance schedule.

[0427] 4. Proposing actions and tasks

[0428] The server sends the generated action plans and task plans back to the device, which then presents them to the user in a list format, with detailed information attached to each plan (e.g., required time, cost, necessary preparations, etc.), allowing the user to create an optimal plan.

[0429] 5. Sharing action and task ideas

[0430] To share the user's selected action plan or task plan with the relevant parties, the device sends a notification to the relevant parties' devices, allowing all parties involved to view the plan details and work more efficiently.

[0431] 6. Reminder function

[0432] The device can set reminders for proposed actions or tasks on the day they are to be performed, notify you of the preparation list the day before the scheduled time, and send another reminder one hour before the scheduled time.

[0433] Specific examples

[0434] For example, a factory manager can sign up for the app and set their free time allocation along with their profile information. The device sends this information to the server, which then uses generative AI to generate action plans and task proposals. The generated action proposals might include, for example, "assembly of the product line," "machine maintenance," or "new product testing."

[0435] The server uses an emotion engine to analyze the machine's operating rate and failure trends, and determines that "machine maintenance" is optimal. The terminal notifies the administrator of the selected plan via a reminder function, which is then shared with relevant parties. Another reminder is also sent one hour before the plan is to be implemented.

[0436] Prompt Sentence Examples

[0437] "Machine A in the factory is currently idle, and one week has passed since the last maintenance. Based on this information, please suggest the best tasks and maintenance schedule."

[0438] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0439] Step 1:

[0440] Registering user information

[0441] How it works: A user logs in or registers through their device and enters their profile information.

[0442] Input: Name, age, occupation, hobbies, free time allocation

[0443] Data processing: The device formats the entered profile information and time allocation and stores it in a database.

[0444] Output: Registered user information and time allocation data

[0445] Step 2:

[0446] Generation of action and task proposals

[0447] Operation: The device sends registered user information and time allocation data to the server.

[0448] Input: User information data, time allocation data

[0449] Data processing: The server uses a generative AI to generate multiple action plans and task plans based on user information and time allocation.

[0450] Data calculation: AI algorithms generate action suggestions using the user profile and task optimization criteria.

[0451] Output: Multiple action and task proposals

[0452] Step 3:

[0453] Linking the Emotion Engine

[0454] Operation: The terminal monitors the real-time operating rate and failure rate of the machine and sends the data to the server.

[0455] Input: Machine availability data, failure history data

[0456] Data processing: The server uses an emotion engine to analyze the emotional state of the machine and evaluate its availability and tendency to malfunction.

[0457] Data calculation: The emotion engine performs emotion evaluation based on historical and real-time data.

[0458] Output: Emotion evaluation result

[0459] Step 4:

[0460] Optimizing action and task proposals

[0461] Operation: The server optimizes the generated action and task proposals based on the emotion evaluation results.

[0462] Input: Multiple action and task proposals, emotion evaluation results

[0463] Data calculations: Combining the results of generative AI and emotion engines to prioritize proposed actions.

[0464] Output: Optimized action and task proposals

[0465] Step 5:

[0466] Proposing action and task ideas

[0467] How it works: The server sends optimized action and task proposals back to the device.

[0468] Input: Optimized action and task proposals

[0469] Data processing: The terminal presents this to the user in a list format, with detailed information attached to each option (time required, cost, necessary preparations, etc.).

[0470] Output: A list of suggested actions that the user can review.

[0471] Step 6:

[0472] Sharing action and task ideas

[0473] Operation: The device sends a notification to the device of the person involved to share the action or task proposal selected by the user with the person involved.

[0474] Input: User-selected action and task proposals

[0475] Data processing: The terminal notifies the selected proposal to the relevant parties' devices.

[0476] Output: Notifications of proposed actions and tasks received by stakeholders

[0477] Step 7:

[0478] Reminder function

[0479] How it works: Your device will set a reminder for the proposed action or task on the scheduled date, notify you of the preparation list the day before the scheduled time, and send another reminder one hour before the scheduled time.

[0480] Input: Action proposal and task proposal execution date and time

[0481] Data processing: The device sets the reminder function and sends notifications to relevant parties.

[0482] Output: Reminder notification

[0483] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0484] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0485] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0486] [Second embodiment]

[0487] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0488] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0489] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0490] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0491] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0492] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0493] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0494] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0495] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0496] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0497] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0498] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0499] ---

[0500] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of using a generation AI to propose multiple action plans and share them with the user and their family. The system of the present invention includes the following procedures and functions.

[0501] 1. User information registration:

[0502] Users first log in or register with the system and enter their profile information, which includes their name, age, family composition, occupation, hobbies, interests, etc.

[0503] Next, the user sets how to allocate their free time, dividing it into categories such as time with family, study time, and self-improvement time.

[0504] 2. Generate action plans:

[0505] The terminal receives the registered user information and time allocation and transmits them to the server.

[0506] The server uses a generation AI to generate multiple action plans based on the received user information and time allocation. This generation process takes into account the user's interests and hobbies, family schedules and interests, budget and time constraints, location and travel time, etc.

[0507] 3. Propose a plan of action:

[0508] The server returns the generated action plan to the terminal.

[0509] The device presents this to the user in a list format, with detailed information attached to each proposed action (such as the required time, cost, and necessary preparations).

[0510] 4. Select an action plan and confirm details:

[0511] The user selects the plan they are interested in from the proposed activities. Detailed information about the selected plan is provided via the terminal. Necessary preparations and reservations are also notified at this stage.

[0512] 5. Share with family:

[0513] To share the user's selected action plan with family members, the device will send a notification to the family member's device, allowing everyone in the family to see the plan details.

[0514] 6. Reminder function:

[0515] The device will set a reminder for the planned action date, notify the user of the preparation list the day before the scheduled time, and send another reminder one hour before the scheduled time.

[0516] Specific examples

[0517] Here, a specific example of use will be shown.

[0518] Registering user information and selecting action plans

[0519] User Ichiro Sato signs up for the app and enters his name, age, family composition, occupation, and hobbies (reading, cooking, outdoors) as profile information.

[0520] User Ichiro Sato sets his free time as "time with family" for three hours on weekends, "time for study" for one hour on weekdays, and "time for self-improvement" for two hours a week.

[0521] The device sends the input data to the server, which uses a generative AI to generate the following action plan:

[0522] "Family time": Day trips to theme parks, movies, board games at home

[0523] "Study Time": Online courses for exam preparation, learning new programming languages

[0524] "Time for self-improvement": Trying new recipes, reading books as a hobby

[0525] The server returns the generated action plan to the terminal, and the terminal presents the action plan to the user, Ichiro Sato, in a list format.

[0526] Action plan execution and reminder function

[0527] User Ichiro Sato selects "day trip to a theme park" as "time with family."

[0528] The device will provide the user with the selected details (time required, cost, packing list, etc.) and notify them of the preparation list the day before, and will also send another reminder one hour before the day.

[0529] User Ichiro Sato and his family enjoy a fun day at the theme park.

[0530] In this way, the system of the present invention provides a variety of action plans tailored to the user's needs, allowing the user to use their time efficiently and effectively.

[0531] The processing flow will be explained below.

[0532] Step 1:

[0533] A user signs up or logs into the system and enters profile information, including name, age, family status, occupation, hobbies, and interests.

[0534] Step 2:

[0535] The device receives the user's profile information and stores it in a local database.

[0536] Step 3:

[0537] Users can set how much free time they have available, for example, by setting time for family, study, self-improvement, etc.

[0538] Step 4:

[0539] The terminal receives the configured free time allocation and stores it in a local database.

[0540] Step 5:

[0541] The terminal transmits profile information and time allocation information to the server.

[0542] Step 6:

[0543] The server uses AI to generate multiple action plans based on the profile information and time allocation information received, taking into account the user's interests, hobbies, budget, time, location, etc.

[0544] Step 7:

[0545] The server returns the generated action plan to the terminal.

[0546] Step 8:

[0547] The device receives the proposed activities and presents them to the user in a list format, with detailed information attached to each proposed activity, such as the required time, cost, and necessary preparations.

[0548] Step 9:

[0549] The user selects from the proposed activities and chooses the plan that interests them.

[0550] Step 10:

[0551] The device will display detailed information about the selected plan of action and notify you of any necessary preparations or reservations.

[0552] Step 11:

[0553] To share the user's selected action plan with family members, the device sends a notification to the family members' devices.

[0554] Step 12:

[0555] Family members' devices will receive a notification and display detailed information about the proposed action.

[0556] Step 13:

[0557] The device will set a reminder function for the planned action date and notify you of the preparation list the day before the scheduled time.

[0558] Step 14:

[0559] The device will send another reminder to the user one hour before the scheduled time.

[0560] Step 15:

[0561] On the scheduled day, the user and family carry out the selected action plan.

[0562] Example 1

[0563] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0564] In modern society, users lead busy lives, making it difficult to utilize their free time efficiently and effectively. Furthermore, the processes of coordinating schedules with family members, selecting activity plans, and setting reminders are time-consuming. To solve these problems, a system is needed that can suggest optimal activity plans based on the user's interests and time allocation, and easily share these plans with family members.

[0565] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0566] In this invention, the server includes means for inputting a user's profile information and free time allocation, means for generating multiple action plans based on the input profile information and free time allocation using a generation AI model, means for presenting the generated action plans to the user, means for sharing the action plans selected by the user with other users, and means for providing reminders to execute the action plans. This makes it possible to efficiently generate a variety of action plans tailored to the user's needs and easily coordinate time with family members.

[0567] A "user" is an individual who uses the system to set profile information and time allocation and receive action suggestions.

[0568] "Profile information" is personal information including the user's name, age, family composition, occupation, hobbies, interests, etc.

[0569] A "generative AI model" is an artificial intelligence program that generates action plans based on information input by the user.

[0570] "Action suggestions" are options or plans suggested by the generative AI model based on the user's profile information and time allocation.

[0571] "Remind" is a function that notifies the user of a specified time and content in order to carry out a proposed action.

[0572] A "terminal" is a device such as a computer or smartphone that a user uses to operate the system.

[0573] The "server" is a central processing unit that processes user input information and generates action plans using generative AI models and provides reminder functions.

[0574] "Share" is a function that notifies other users of information about the action plan selected by the user, allowing them to check the same action plan.

[0575] "Detailed information" refers to additional information about the proposed action, such as the time required, costs, and necessary preparations.

[0576] MODE FOR CARRYING OUT THE INVENTION

[0577] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of using a generation AI to propose multiple action plans and share them with the user and their family. The system for implementing the present invention performs data processing and data calculation using the following hardware and software.

[0578] Hardware and software used

[0579] Hardware:

[0580] Devices: computers, smartphones, tablets, etc.

[0581] Server: Cloud-based server or server located in a data center

[0582] software:

[0583] Generative AI models: Natural language processing models such as GPT-4

[0584] Data transmission and reception: RESTful API using HTTP protocol

[0585] Database: A relational database (e.g., MySQL, PostgreSQL) to store user information

[0586] Specific example explanation

[0587] Registering user information and selecting action plans

[0588] 1. A user logs in to the system or registers. They enter their name, age, family composition, occupation, hobbies, and interests as profile information. For example, a user clicks the "New Registration" button and enters information such as "Name: Taro Tanaka," "Age: 35," "Family composition: Wife and two children," "Occupation: Engineer," and "Hobbies: Reading, cooking, and the outdoors" into the form.

[0589] 2. The user sets how they want to allocate their free time. For example, they can set three hours of "time with family" on the weekend, one hour of "study time" on weekdays, and two hours of "self-improvement time" per week. This data is collected by the device and sent to the server.

[0590] Generation and presentation of action plans

[0591] 1. The server inputs the received user information and time allocation into the generative AI model. An example of a prompt sentence is, "Please suggest an action plan for Taro Tanaka, a 35-year-old man with two children, to spend the weekend with his family."

[0592] 2. The generative AI model generates multiple suggested actions based on the prompt, such as "take a day trip to a theme park," "watch a movie," or "play board games at home."

[0593] 3. The server returns the generated action plans to the terminal, which then presents them to the user in a list format. Each action plan includes detailed information such as the required time, cost, and necessary preparations.

[0594] Selecting and sharing action plans

[0595] 1. The user selects an action plan that interests them from the presented options. For example, they select "a day trip to a theme park."

[0596] 2. The selected action plan is shared from the device to the devices of other users (family members), and all family members can check the details of the plan. Specifically, using the reminder function, the preparation list is notified the day before the action plan is to be carried out. A reminder is also sent one hour before the day.

[0597] In this way, the system of the present invention can utilize a generative AI model to propose various action plans based on the user's profile information and time allocation, making it possible to utilize free time efficiently and effectively.

[0598] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0599] Step 1:

[0600] A user logs in to the system or registers. The user clicks the "New Registration" button on the login screen and enters the required profile information (name, age, family composition, occupation, hobbies, interests, etc.) in the form. By pressing the submit button for the input data, the input data is sent from the terminal to the server. This input data includes the user's basic personal information. The server stores the received data in a database and confirms that registration is complete.

[0601] Step 2:

[0602] Users set how their free time is allocated within the system. On the "Time Settings" page, users use the pull-down menus to allocate time to "time with family," "time for study," and "time for self-improvement." For example, users can set "time with family" for three hours on weekends, "time for study" for one hour on weekdays, and "time for self-improvement" for two hours a week. The entered time allocation data is sent from the device to the server. The server receives this data and stores it together with the user's profile information.

[0603] Step 3:

[0604] The server uses the collected user information and time allocation data to create a prompt to be input into the generative AI model. For example, it generates a prompt such as, "Please suggest some activities that Taro Tanaka, a 35-year-old man with two children, should do to spend the weekend with his family." This prompt is sent to the generative AI model, which then generates a proposed action. The input here is the prompt and user data, and the output is multiple proposed actions.

[0605] Step 4:

[0606] The generative AI model generates multiple suggested actions based on the input prompt. For example, it generates suggested actions such as "day trip to a theme park," "watching a movie," or "playing board games at home." These suggested actions are returned to the server as JSON-formatted data. The server receives this data, analyzes it, and selects the optimal suggested action for the user.

[0607] Step 5:

[0608] The server sends the selected action plan in JSON format to the device. The device analyzes the received data and generates a list of action plans. These are presented to the user in list format, with each action plan accompanied by detailed information such as the required time, cost, and necessary preparations. The user can view this information on the device screen.

[0609] Step 6:

[0610] The user selects an interesting plan from the proposed activities. For example, they select "a day trip to a theme park." The selected activity plan is sent from the device to the server, which stores this information. After that, detailed information about the selected activity plan is sent back to the device and displayed to the user.

[0611] Step 7:

[0612] The device will send a push notification to the family members' devices to share the selected action plan with them, allowing all family members to view the plan details.

[0613] Step 8:

[0614] The device will set a reminder function for the planned action date. Specifically, the device will notify the user of the preparation list the day before the planned action time, and will also send another reminder one hour before the planned action time. The notification will be sent using the device's alarm function.

[0615] In this way, the processing flow and operations at each step provide functions that allow users to efficiently and effectively utilize their free time and share it with family and other users.

[0616] (Application example 1)

[0617] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0618] Conventional lifestyle support systems lack the functionality to provide specific and personalized suggestions for efficiently and effectively utilizing users' free time, and have issues with mechanisms for sharing or reminding users of suggested activities.Furthermore, they lack the functionality to generate shopping plans based on users' interests and family schedules, and are unable to provide information that is truly useful in daily life.

[0619] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0620] In this invention, the server includes means for inputting a user's profile information and free time allocation, means for generating multiple planned activities based on the input profile information and free time allocation using a generation AI, means for presenting the generated planned activities to the user, means for sharing the planned activities selected by the user, means for providing reminders to carry out the planned activities, means for providing detailed information about the generated planned activities (e.g., required time, cost, location, recommended products), and means for sending notifications to share the selected planned activities with family members. This allows the server to provide specific suggestions based on the user's interests and preferences, enabling the user and his or her family to use their time efficiently.

[0621] "User profile information" refers to information about an individual, such as the user's name, age, family structure, occupation, hobbies, and interests.

[0622] "Free time allocation" refers to the allocation of free time available to a user to specific categories (for example, time with family, time for shopping, time for self-improvement, etc.).

[0623] "Generative AI" is artificial intelligence that automatically generates multiple action plans based on user input information.

[0624] An "action plan" is a specific action plan proposed by the generative AI, and includes detailed information such as the required time, cost, location, and recommended products.

[0625] "Remind" is a function that notifies the user in advance of the information necessary for preparation and implementation of the action plan selected by the user on the execution date.

[0626] "Detailed information" refers to specific information related to the proposed action, such as the required time, cost, location, and recommended products.

[0627] "Notification" is a message for conveying information about the generated action plan or reminder information to the user or their family.

[0628] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of using a generation AI to propose multiple action plans and share them with the user and their family. The system of the present invention includes the following procedures and functions.

[0629] First, users log in or register with the system's application. At this time, they enter their profile information (name, age, family composition, occupation, hobbies, interests, etc.). They then set their free time into categories such as "shopping time," "shopping time with family," and "short shopping (5-30 minutes)."

[0630] The device sends the input data to the server, which uses a generative AI to generate multiple action plans based on the user's information and free time allocation. The generation process takes into account the user's interests and hobbies, family schedules and interests, budget and time constraints.

[0631] The server sends the generated action plans back to the device, which then presents them to the user in list form. Detailed information (e.g., required time, cost, store location, recommended products, etc.) is attached to each action plan. The user selects the plan that interests them from the presented action plans. Detailed information about the selected action plan is provided via the device, along with notifications of necessary preparations and store reservations.

[0632] Additionally, the device will send a notification to family members' devices to share the user's selected action plan with them, allowing all family members to review the plan details and agree to it.

[0633] The device will set a reminder function for the planned action date. The device will notify the user of the preparation list the day before the planned action date, and will also send another reminder one hour before the planned action date. This reminder function helps the user to remember to carry out the planned action.

[0634] As a specific example of use, let's consider a case where a user uses a shopping assistant app. The user enters their profile information and sets up three hours of shopping time on the weekend. The server uses generative AI to suggest activities such as "looking for new clothes" and "visiting electronics stores," and provides detailed information (time required, cost, location, recommended products). When the user selects "looking for new clothes," the detailed information is displayed in the app, and a shared notification is sent to family members. The reminder function sends notifications the day before and one hour before, allowing the user to smoothly carry out the proposed action plan.

[0635] An example prompt might look like this:

[0636] User profile: Taro Tanaka, Age: 32, Family: Wife, Children, Occupation: Engineer

[0637] Interests: clothing, electronics, books

[0638] Free time: 3 hours of shopping on weekends, 30 minutes of quick shopping on weekdays

[0639] prompt:

[0640] User: "Taro Tanaka, 32 years old, Family: Wife, Children, Occupation: Engineer, Interests: Clothing, Electronics, Books, 3 hours of shopping on weekends, 30 minutes of quick shopping on weekdays"

[0641] Generation AI: Returns the generated action plan.

[0642] Examples: "Looking for new clothes, Time required: 180 minutes, Cost: 5,000 yen, Store location: Commercial district, Recommended items: Simple shirts, shoes"; "Visiting electronics stores, Time required: 120 minutes, Cost: 60,000 yen, Store location: Electric town, Recommended items: Latest smartphone, headphones"

[0643] As a result, the system of the present invention can provide a variety of action plans according to the user's needs, allowing the user to use their time efficiently and effectively.

[0644] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0645] Step 1:

[0646] A user logs in to the system's application or registers. The user enters profile information such as name, age, family composition, occupation, hobbies, and interests. The user also divides their free time into categories such as "shopping time," "shopping time with family," and "short shopping (5-30 minutes)." This input information is saved on the device.

[0647] Input: User profile information and free time allocation

[0648] Output: User information stored on the device

[0649] Step 2:

[0650] The terminal sends the data entered by the user to the server using an HTTP request, sending the data in JSON format.

[0651] Input: User information stored on the device

[0652] Output: User information sent to the server

[0653] Step 3:

[0654] The server inputs the received user information into a generative AI model, which generates multiple action plans based on the user information and time allocation. The generative AI model generates action plans based on the prompt text and creates specific suggestions.

[0655] Input: User information sent to the server

[0656] Output: Action plans generated by the generative AI model

[0657] Step 4:

[0658] The server sends the generated action plan back to the device, along with detailed information (time required, cost, store location, recommended products, etc.) in JSON format.

[0659] Input: Action proposals generated by a generative AI model

[0660] Output: Action plan and detailed information sent to the device

[0661] Step 5:

[0662] The device displays the received action plans and detailed information to the user in a list format. The user can select an action plan that interests them from the list and check the detailed information of the selected action plan.

[0663] Input: Action plan and details sent to the terminal

[0664] Output: A list of suggested actions shown to the user, with detailed information

[0665] Step 6:

[0666] When the user selects an activity plan that interests them, the terminal displays the selected activity plan in more detail and prepares to notify them if any related preparations or reservations are required.

[0667] Input: User selected action plan

[0668] Output: Display details of selected action plan and prepare notification

[0669] Step 7:

[0670] The device then sends details of the selected plan to the family members' devices, allowing all family members to confirm the plan details and obtain their consent.

[0671] Input: Details of selected action plan

[0672] Output: Notification of proposed actions sent to family members' devices

[0673] Step 8:

[0674] The device will set up a reminder function to remind users to carry out their planned action plan. The device will notify them of the preparation list the day before the planned date, and will also send another reminder one hour before the planned date. This will help users remember to carry out their planned action plan.

[0675] Input: Selected action plan and its execution date

[0676] Output: Reminder notification

[0677] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0678] ---

[0679] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of combining a generative AI and an emotion engine to propose multiple action plans and share them with the user and their family. The system of the present invention includes the following procedures and functions.

[0680] 1. User information registration:

[0681] Users first log in or register with the system and enter their profile information, which includes their name, age, family composition, occupation, hobbies, interests, etc.

[0682] Next, the user sets how to allocate their free time, dividing it into categories such as time with family, study time, and self-improvement time.

[0683] 2. Generate action plans:

[0684] The terminal receives the registered user information and time allocation and transmits them to the server.

[0685] The server uses a generation AI to generate multiple action plans based on the received user information and time allocation. This generation process takes into account the user's interests and hobbies, family schedules and interests, budget and time constraints, location and travel time, and emotional information obtained from the emotion engine.

[0686] 3. Emotional Engine Linkage:

[0687] The device recognizes the user's real-time emotional state and transmits the emotional information to the server.

[0688] The server uses an emotion engine to analyze the user's emotional state and optimizes suggested actions accordingly.

[0689] The system also analyzes the user's past emotional history and generates more appropriate action plans based on this.

[0690] 4. Propose a plan of action:

[0691] The server returns the generated action plan to the terminal.

[0692] The device presents this to the user in a list format, with detailed information attached to each proposed action (such as the required time, cost, and necessary preparations).

[0693] 5. Select an action plan and confirm details:

[0694] The user selects the plan of interest from the presented options. Detailed information about the selected option is provided via the terminal. Necessary preparations and reservation information are also notified at this stage.

[0695] 6. Share with family:

[0696] To share the user's selected action plan with family members, the device will send a notification to the family member's device, allowing everyone in the family to see the plan details.

[0697] 7. Reminder function:

[0698] The device will set a reminder function for the planned action date and notify the user of the preparation list the day before the scheduled time.

[0699] It will also send another reminder one hour before the scheduled time.

[0700] Specific examples

[0701] Here, a specific example of use will be shown.

[0702] Registering user information and selecting action plans

[0703] User Yamada Taro signs up for the app and enters his name, age, family composition, occupation, and hobbies (reading, cooking, outdoors) as profile information.

[0704] User Yamada Taro sets his free time as "time with family" for three hours on weekends, "time for study" for one hour on weekdays, and "time for self-improvement" for two hours a week.

[0705] The device sends the input data to the server, which uses a generative AI to generate the following action plan:

[0706] "Family time": Day trips to theme parks, movies, board games at home

[0707] "Study Time": Online courses for exam preparation, learning new programming languages

[0708] "Time for self-improvement": Trying new recipes, reading books as a hobby

[0709] The server also uses an emotion engine to analyze Yamada Taro's real-time emotions and past emotion history, and determines that a "day trip to a theme park" is the best option.

[0710] The server returns the action plan to the terminal, and the terminal presents the action plan to the user Yamada Taro in list form.

[0711] Action plan execution and reminder function

[0712] User Yamada Taro selects "day trip to a theme park" as "time with family."

[0713] The device will provide the user with the selected details (time required, cost, packing list, etc.) and notify them of the preparation list the day before, and will also send another reminder one hour before the day.

[0714] User Yamada Taro and his family enjoy a fun day at the theme park.

[0715] In this way, the system of the present invention takes into consideration not only the user's needs but also the user's emotional information, provides optimal action plans, and enables efficient and effective use of time.

[0716] The processing flow will be explained below.

[0717] Step 1:

[0718] A user signs up or logs into the system and enters profile information, including name, age, family status, occupation, hobbies, and interests.

[0719] Step 2:

[0720] The device receives the user's profile information and stores it in a local database.

[0721] Step 3:

[0722] Users can set how much free time they have available, for example, by setting time for family, study, self-improvement, etc.

[0723] Step 4:

[0724] The terminal receives the configured free time allocation and stores it in a local database.

[0725] Step 5:

[0726] The terminal transmits profile information and time allocation information to the server.

[0727] Step 6:

[0728] The server uses a generation AI to generate multiple action plans based on the profile information and time allocation information received. This process takes into account the user's interests, hobbies, budget, time, location, and emotional information obtained from the emotion engine.

[0729] Step 7:

[0730] The device recognizes the user's real-time emotional state and transmits the emotional information to the server.

[0731] Step 8:

[0732] The server uses an emotion engine to analyze the user's emotional state and optimizes the proposed actions based on it, and also analyzes the user's past emotional history to generate more appropriate proposed actions.

[0733] Step 9:

[0734] The server returns the generated action plan to the terminal.

[0735] Step 10:

[0736] The device receives the proposed activities and presents them to the user in a list format, with detailed information attached to each proposed activity, such as the required time, cost, and necessary preparations.

[0737] Step 11:

[0738] The user selects from the proposed activities and chooses the plan that interests them.

[0739] Step 12:

[0740] The device will display detailed information about the selected plan of action and notify you of any necessary preparations or reservations.

[0741] Step 13:

[0742] To share the user's selected action plan with family members, the device sends a notification to the family members' devices.

[0743] Step 14:

[0744] Family members' devices will receive a notification and display detailed information about the proposed action.

[0745] Step 15:

[0746] The device will set a reminder function for the planned action date and notify you of the preparation list the day before the scheduled time.

[0747] Step 16:

[0748] The device will send another reminder to the user one hour before the scheduled time.

[0749] Step 17:

[0750] On the scheduled day, the user and family carry out the selected action plan.

[0751] Example 2

[0752] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0753] In modern society, users are expected to use their free time efficiently and effectively. However, conventional scheduling and planning tools struggle to provide optimal action plans that take into account the user's interests and real-time emotional state. Furthermore, they lack the functionality to share action plans with family and related individuals, or to provide reminders for the execution of action plans. This leads to issues such as low user satisfaction and inefficient time utilization.

[0754] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting a user's identification information and free time allocation, means for generating multiple activity plans based on the input identification information and free time allocation using a generative AI model, means for acquiring and analyzing real-time emotional information, means for optimizing the activity plans based on the emotional state using an emotion engine, means for displaying the generated activity plans to the user, means for sharing the activity plan selected by the user with related others, and means for providing reminders to execute the activity plans. This makes it possible to provide optimal action plans tailored to the user's interests and real-time emotional state, enabling efficient and effective time utilization.

[0755] "User identification information" is information for identifying an individual user, and includes data such as name, age, occupation, and hobbies.

[0756] "Allocation of free time" is information indicating the free time that the user can use for specific activities, and is time allocated to each category such as time with family and time for self-improvement.

[0757] A "generative AI model" is an artificial intelligence model that generates specific outputs based on input data.

[0758] "Real-time emotional information" refers to information that indicates a user's current emotional state, and includes data obtained from sensors such as facial recognition cameras and smart devices.

[0759] An "emotion engine" is a software or hardware component that analyzes the acquired emotion information and identifies the user's emotional state.

[0760] "Activity suggestions" are suggestions for specific activities that a user can undertake in their free time.

[0761] "Related others" are people who may share time with the user, and primarily include family and friends.

[0762] The "remind function" is a function that notifies the user at a specific time or date of the information and preparations necessary to carry out the activity plan selected by the user.

[0763] This invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of combining a generative AI and an emotion engine to propose multiple action plans and share them with the user and related others.

[0764] Specific system configuration

[0765] 1. Hardware and Software Configuration

[0766] The server has computational resources including a database, generative AI models, and emotion engines, and plays a central role in distributing the generated action plans to each user.

[0767] The device includes an interface that allows users to input information, sensors to acquire real-time emotional states, and a screen that displays data from a server. Typical examples are smartphones and personal computers.

[0768] Users interact with the system through terminals.

[0769] 2. System Operation

[0770] First, a user logs in or registers with the system and enters identifying information such as name, age, family composition, occupation, hobbies, and interests. After successful login, the system assigns the next available time. For example, the user can set three hours on the weekend for family time, one hour on weekdays for study, and two hours per week for self-improvement.

[0771] The device receives the input identification information and time allocation and sends it to the server, which then creates a prompt for the generative AI model, such as: "Please generate action suggestions based on the user's interests and time allocation."

[0772] Based on this prompt, the generative AI model generates multiple suggested activities, such as a day trip to a theme park, going to the movies, or playing board games at home for "family time."

[0773] Second, real-time emotional information is crucial. The device acquires the user's current emotional state through sensors or smartwatches and transmits it to the server. The server uses an emotion engine to analyze this emotional information and identify the user's emotional state. Based on this emotional state, the generated action plan is optimized.

[0774] The server then sends the generated optimal action plans to the device, which then presents them to the user in a list format, including detailed information about each action plan, such as the required time, cost, and necessary preparations.

[0775] When the user selects a plan, the details are displayed again, along with any necessary preparations or booking information.

[0776] Furthermore, the selected action plan can be shared with other related parties, such as family members, and the device can send notifications to the family members' devices and add the event to a shared calendar.

[0777] The reminder function is also an important element. The device notifies the user of the preparation list the day before the planned action, and then sends another reminder one hour before the scheduled action. This helps the user to remember to carry out the planned action.

[0778] Specific examples

[0779] Here is a specific example.

[0780] Registering user information and selecting action plans

[0781] User A signs up for the app and enters his / her name, age, family composition, occupation, and hobbies (reading, cooking, outdoors) as profile information. User A sets his / her free time as "time with family" for three hours on weekends, "study time" for one hour on weekdays, and "self-improvement time" for two hours a week. The device sends this data to the server, which stores it in a database.

[0782] Generate action plans

[0783] The device periodically sends user information to a server, which then uses a generative AI model to generate suggested activities. For example, suggested activities for "family time" include a day trip to a theme park, going to the movies, and playing board games at home.

[0784] Linking the Emotion Engine

[0785] The device captures the user's current emotional state using a facial recognition camera and sends it to the server, which uses an emotion engine to identify the user's emotional state, such as "I'm currently stressed," and optimizes the suggested actions.

[0786] Proposing action plans

[0787] The server sends the optimized itinerary to the device, which displays the itinerary in a list format and provides detailed information (e.g., duration, cost, required ticket information, and packing list for a day trip to a theme park).

[0788] Select an action plan and confirm details

[0789] User A selects "Day trip to a theme park." The device displays detailed information about the selected plan and notifies the user of necessary preparations and reservation information.

[0790] Sharing with family

[0791] The device notifies the family members of the selected action plan and adds it to a shared calendar.

[0792] Reminder function

[0793] The device will notify you of the preparation list the day before the planned action is to be carried out, and will send another reminder one hour before the scheduled action.

[0794] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0795] Processing Steps

[0796] Step 1: Enter user information and register

[0797] input:

[0798] Users log in or register with the system and enter identifying information such as name, age, family status, occupation, hobbies, interests, etc. They also set their available time allocations.

[0799] Specific behavior:

[0800] 1. A user accesses the app and enters their login information (username and password).

[0801] 2. The device sends the authentication data to the server.

[0802] 3. The server performs authentication, and if authentication is successful, displays a profile entry screen to the user.

[0803] 4. The user enters the required profile information and time allocation.

[0804] output:

[0805] Profile information and time allocations are stored in a database.

[0806] Step 2: Generate action plans

[0807] input:

[0808] The terminal transmits the stored user information and time allocation to the server.

[0809] Specific behavior:

[0810] 1. The terminal periodically sends user information to the server.

[0811] 2. The server creates a prompt for the generative AI model and instructs it to generate an action plan.

[0812] 3. For example, send a prompt such as, "Generate action plans based on the user's interests and time allocation."

[0813] output:

[0814] The generative AI model outputs multiple action plans, which are stored on the server.

[0815] Step 3: Acquiring and analyzing emotional information

[0816] input:

[0817] The device acquires the user's real-time emotional information and transmits it to the server.

[0818] Specific behavior:

[0819] 1. The device uses sensors or smartwatches to capture the user's emotional state, for example, by reading facial expressions with a facial recognition camera or measuring heart rate.

[0820] 2. The device sends the acquired emotion information to the server.

[0821] 3. The server uses an emotion engine to analyze this emotion information.

[0822] output:

[0823] The emotion engine identifies the user's emotional state and the results of this analysis are stored on the server.

[0824] Step 4: Optimize your action plan

[0825] input:

[0826] The server obtains the generated action plan and the analysis results of the emotion engine.

[0827] Specific behavior:

[0828] 1. The server integrates the stored action plans with the sentiment analysis results.

[0829] 2. Optimize the generated action proposals based on the analysis results of the emotion engine.

[0830] output:

[0831] The optimized action plan is stored on the server and used for further processing.

[0832] Step 5: Propose a course of action

[0833] input:

[0834] The server sends the optimized action plan to the terminal.

[0835] Specific behavior:

[0836] 1. The server sends the optimized action plan to the device.

[0837] 2. The device presents the user with a list of suggested activities, each of which includes detailed information such as the time required, cost, and necessary preparations.

[0838] output:

[0839] The suggested actions are displayed on the user's device.

[0840] Step 6: Select an action plan and confirm details

[0841] input:

[0842] The user selects an action plan that interests them from the presented options.

[0843] Specific behavior:

[0844] 1. The user taps or clicks to select an action.

[0845] 2. The device will display detailed information about the selected activity, such as a "day trip to a theme park" (duration, cost, required tickets, packing list, etc.).

[0846] output:

[0847] Detailed information about the selected action plan is displayed on the user's terminal.

[0848] Step 7: Share your action plan

[0849] input:

[0850] The user's selected action plan is shared with the device.

[0851] Specific behavior:

[0852] 1. The device sends notifications of the selected action plan to the devices of other relevant people (family and friends).

[0853] 2. The device sends the shared information to other related devices and adds the event to the shared calendar.

[0854] output:

[0855] Notify others on their devices and add them to a shared calendar.

[0856] Step 8: Reminders

[0857] input:

[0858] When the planned action date approaches, the device will set a reminder.

[0859] Specific behavior:

[0860] 1. The terminal notifies the user of the preparation list the day before the planned action is to be carried out.

[0861] 2. The device will send another reminder one hour before the scheduled departure time, including a final confirmation of departure time and a final check of the packing list.

[0862] output:

[0863] A reminder notification will be displayed on the user's device, and the action plan will be ready to be carried out.

[0864] In this way, the system considers the user's needs and emotional information at each step, generating and providing optimal action plans, allowing for efficient and effective use of time.

[0865] (Application example 2)

[0866] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0867] Efficient operation management and maintenance planning for machines in factories are crucial for maximizing production efficiency. However, current systems make it difficult to centrally manage machine idle times and maintenance schedules, and are unable to provide optimal task and maintenance proposals that take into account machine utilization rates and failure trends. Furthermore, a flexible system that can handle a large number of machines and a variety of tasks is required. To solve this problem, a system is needed that can monitor machine operation status and emotional state in real time and propose optimal task proposals and maintenance schedules.

[0868] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0869] In this invention, the server includes a means for inputting a user's profile information and free time allocation, a means for generating multiple action plans based on the input profile information and free time allocation using a generation AI, and a means for managing the free time and maintenance schedules of machines in a factory and generating optimal task plans and maintenance plans. This makes it possible to realize efficient machine operation and optimized maintenance, thereby improving production efficiency.

[0870] "User" means an individual or company representative who uses the system.

[0871] "Profile information" is basic information for identifying an individual, such as the user's name, age, occupation, and hobbies.

[0872] "Free time allocation" refers to settings that indicate how much time a user will devote to a particular activity.

[0873] "Generative AI" is a system that uses artificial intelligence technology to automatically generate optimal action plans and task plans based on information from users and machines.

[0874] An "action plan" is an activity plan that is suitable for the user's free time.

[0875] "Maintenance schedule" refers to the schedule for regular maintenance, inspection, and repair work on machinery.

[0876] A "task proposal" is a specific work instruction or work plan for a machine to carry out.

[0877] A "farm manager" is a person in charge of operating and managing machinery and systems within a factory.

[0878] "Remind" is a function that notifies users and farm managers before carrying out proposed actions or performing maintenance.

[0879] The "emotion engine" is a technology that analyzes a machine's operating rate and tendency to fail as an emotional evaluation, and generates optimal action plans and task plans based on that.

[0880] "Notification" is a means of communicating generated task proposals and maintenance schedules to users and farm managers.

[0881] The present invention is a system for efficiently and effectively utilizing the free time of users (e.g., factory managers) and the operating time of machines in a factory. In particular, it has the function of combining a generative AI and an emotion engine to propose multiple action plans and task plans and share them with users and related parties. The system of the present invention includes the following procedures and functions.

[0882] 1. User information registration

[0883] First, the user logs in or registers on the terminal and enters their profile information. User information includes their name, age, occupation, etc. At the same time, the allocation of their free time is also set, and time is allocated to specific categories (e.g., maintenance time, product assembly time, etc.). This allows the user to give detailed instructions on the operation schedule of the machines under their control.

[0884] 2. Generate action and task proposals

[0885] The device receives the registered user information and time allocation and sends it to the server. The server uses a generation AI to generate multiple action plans and task plans based on the received user information and time allocation. This generation process takes into account the machine's operating status, maintenance history, past machine performance data, budget and time constraints, and emotional information obtained from the emotion engine.

[0886] 3. Linking the Emotional Engine

[0887] The terminal monitors the machine's real-time operating rate and failure rate and transmits emotional information to the server. The server uses an emotion engine to analyze the machine's emotional state and optimizes action and task proposals based on that information. For example, the emotion engine can predict the possibility of a machine failure based on its past operating history and automatically create an appropriate maintenance schedule.

[0888] 4. Proposing actions and tasks

[0889] The server sends the generated action plans and task plans back to the device, which then presents them to the user in a list format, with detailed information attached to each plan (e.g., required time, cost, necessary preparations, etc.), allowing the user to create an optimal plan.

[0890] 5. Sharing action and task ideas

[0891] To share the user's selected action plan or task plan with the relevant parties, the device sends a notification to the relevant parties' devices, allowing all parties involved to view the plan details and work more efficiently.

[0892] 6. Reminder function

[0893] The device can set reminders for proposed actions or tasks on the day they are to be performed, notify you of the preparation list the day before the scheduled time, and send another reminder one hour before the scheduled time.

[0894] Specific examples

[0895] For example, a factory manager can sign up for the app and set their free time allocation along with their profile information. The device sends this information to the server, which then uses generative AI to generate action plans and task proposals. The generated action proposals might include, for example, "assembly of the product line," "machine maintenance," or "new product testing."

[0896] The server uses an emotion engine to analyze the machine's operating rate and failure trends, and determines that "machine maintenance" is optimal. The terminal notifies the administrator of the selected plan via a reminder function, which is then shared with relevant parties. Another reminder is also sent one hour before the plan is to be implemented.

[0897] Prompt Sentence Examples

[0898] "Machine A in the factory is currently idle, and one week has passed since the last maintenance. Based on this information, please suggest the best tasks and maintenance schedule."

[0899] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0900] Step 1:

[0901] Registering user information

[0902] How it works: A user logs in or registers through their device and enters their profile information.

[0903] Input: Name, age, occupation, hobbies, free time allocation

[0904] Data processing: The device formats the entered profile information and time allocation and stores it in a database.

[0905] Output: Registered user information and time allocation data

[0906] Step 2:

[0907] Generation of action and task proposals

[0908] Operation: The device sends registered user information and time allocation data to the server.

[0909] Input: User information data, time allocation data

[0910] Data processing: The server uses a generative AI to generate multiple action plans and task plans based on user information and time allocation.

[0911] Data calculation: AI algorithms generate action suggestions using the user profile and task optimization criteria.

[0912] Output: Multiple action and task proposals

[0913] Step 3:

[0914] Linking the Emotion Engine

[0915] Operation: The terminal monitors the real-time operating rate and failure rate of the machine and sends the data to the server.

[0916] Input: Machine availability data, failure history data

[0917] Data processing: The server uses an emotion engine to analyze the emotional state of the machine and evaluate its availability and tendency to malfunction.

[0918] Data calculation: The emotion engine performs emotion evaluation based on historical and real-time data.

[0919] Output: Emotion evaluation result

[0920] Step 4:

[0921] Optimizing action and task proposals

[0922] Operation: The server optimizes the generated action and task proposals based on the emotion evaluation results.

[0923] Input: Multiple action and task proposals, emotion evaluation results

[0924] Data calculations: Combining the results of generative AI and emotion engines to prioritize proposed actions.

[0925] Output: Optimized action and task proposals

[0926] Step 5:

[0927] Proposing action and task ideas

[0928] How it works: The server sends optimized action and task proposals back to the device.

[0929] Input: Optimized action and task proposals

[0930] Data processing: The terminal presents this to the user in a list format, with detailed information attached to each option (time required, cost, necessary preparations, etc.).

[0931] Output: A list of suggested actions that the user can review.

[0932] Step 6:

[0933] Sharing action and task ideas

[0934] Operation: The device sends a notification to the device of the person involved to share the action or task proposal selected by the user with the person involved.

[0935] Input: User-selected action and task proposals

[0936] Data processing: The terminal notifies the selected proposal to the relevant parties' devices.

[0937] Output: Notifications of proposed actions and tasks received by stakeholders

[0938] Step 7:

[0939] Reminder function

[0940] How it works: Your device will set a reminder for the proposed action or task on the scheduled date, notify you of the preparation list the day before the scheduled time, and send another reminder one hour before the scheduled time.

[0941] Input: Action proposal and task proposal execution date and time

[0942] Data processing: The device sets the reminder function and sends notifications to relevant parties.

[0943] Output: Reminder notification

[0944] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0945] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0946] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0947] [Third embodiment]

[0948] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0949] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0950] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0951] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0952] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0953] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0954] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0955] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0956] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0957] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0958] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0959] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0960] ---

[0961] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of using a generation AI to propose multiple action plans and share them with the user and their family. The system of the present invention includes the following procedures and functions.

[0962] 1. User information registration:

[0963] Users first log in or register with the system and enter their profile information, which includes their name, age, family composition, occupation, hobbies, interests, etc.

[0964] Next, the user sets how to allocate their free time, dividing it into categories such as time with family, study time, and self-improvement time.

[0965] 2. Generate action plans:

[0966] The terminal receives the registered user information and time allocation and transmits them to the server.

[0967] The server uses a generation AI to generate multiple action plans based on the received user information and time allocation. This generation process takes into account the user's interests and hobbies, family schedules and interests, budget and time constraints, location and travel time, etc.

[0968] 3. Propose a plan of action:

[0969] The server returns the generated action plan to the terminal.

[0970] The device presents this to the user in a list format, with detailed information attached to each proposed action (such as the required time, cost, and necessary preparations).

[0971] 4. Select an action plan and confirm details:

[0972] The user selects the plan they are interested in from the proposed activities. Detailed information about the selected plan is provided via the terminal. Necessary preparations and reservations are also notified at this stage.

[0973] 5. Share with family:

[0974] To share the user's selected action plan with family members, the device will send a notification to the family member's device, allowing everyone in the family to see the plan details.

[0975] 6. Reminder function:

[0976] The device will set a reminder for the planned action date, notify the user of the preparation list the day before the scheduled time, and send another reminder one hour before the scheduled time.

[0977] Specific examples

[0978] Here, a specific example of use will be shown.

[0979] Registering user information and selecting action plans

[0980] User Ichiro Sato signs up for the app and enters his name, age, family composition, occupation, and hobbies (reading, cooking, outdoors) as profile information.

[0981] User Ichiro Sato sets his free time as "time with family" for three hours on weekends, "time for study" for one hour on weekdays, and "time for self-improvement" for two hours a week.

[0982] The device sends the input data to the server, which uses a generative AI to generate the following action plan:

[0983] "Family time": Day trips to theme parks, movies, board games at home

[0984] "Study Time": Online courses for exam preparation, learning new programming languages

[0985] "Time for self-improvement": Trying new recipes, reading books as a hobby

[0986] The server returns the generated action plan to the terminal, and the terminal presents the action plan to the user, Ichiro Sato, in a list format.

[0987] Action plan execution and reminder function

[0988] User Ichiro Sato selects "day trip to a theme park" as "time with family."

[0989] The device will provide the user with the selected details (time required, cost, packing list, etc.) and notify them of the preparation list the day before, and will also send another reminder one hour before the day.

[0990] User Ichiro Sato and his family enjoy a fun day at the theme park.

[0991] In this way, the system of the present invention provides a variety of action plans tailored to the user's needs, allowing the user to use their time efficiently and effectively.

[0992] The processing flow will be explained below.

[0993] Step 1:

[0994] A user signs up or logs into the system and enters profile information, including name, age, family status, occupation, hobbies, and interests.

[0995] Step 2:

[0996] The device receives the user's profile information and stores it in a local database.

[0997] Step 3:

[0998] Users can set how much free time they have available, for example, by setting time for family, study, self-improvement, etc.

[0999] Step 4:

[1000] The terminal receives the configured free time allocation and stores it in a local database.

[1001] Step 5:

[1002] The terminal transmits profile information and time allocation information to the server.

[1003] Step 6:

[1004] The server uses AI to generate multiple action plans based on the profile information and time allocation information received, taking into account the user's interests, hobbies, budget, time, location, etc.

[1005] Step 7:

[1006] The server returns the generated action plan to the terminal.

[1007] Step 8:

[1008] The device receives the proposed activities and presents them to the user in a list format, with detailed information attached to each proposed activity, such as the required time, cost, and necessary preparations.

[1009] Step 9:

[1010] The user selects from the proposed activities and chooses the plan that interests them.

[1011] Step 10:

[1012] The device will display detailed information about the selected plan of action and notify you of any necessary preparations or reservations.

[1013] Step 11:

[1014] To share the user's selected action plan with family members, the device sends a notification to the family members' devices.

[1015] Step 12:

[1016] Family members' devices will receive a notification and display detailed information about the proposed action.

[1017] Step 13:

[1018] The device will set a reminder function for the planned action date and notify you of the preparation list the day before the scheduled time.

[1019] Step 14:

[1020] The device will send another reminder to the user one hour before the scheduled time.

[1021] Step 15:

[1022] On the scheduled day, the user and family carry out the selected action plan.

[1023] Example 1

[1024] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1025] In modern society, users lead busy lives, making it difficult to utilize their free time efficiently and effectively. Furthermore, the processes of coordinating schedules with family members, selecting activity plans, and setting reminders are time-consuming. To solve these problems, a system is needed that can suggest optimal activity plans based on the user's interests and time allocation, and easily share these plans with family members.

[1026] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1027] In this invention, the server includes means for inputting a user's profile information and free time allocation, means for generating multiple action plans based on the input profile information and free time allocation using a generation AI model, means for presenting the generated action plans to the user, means for sharing the action plans selected by the user with other users, and means for providing reminders to execute the action plans. This makes it possible to efficiently generate a variety of action plans tailored to the user's needs and easily coordinate time with family members.

[1028] A "user" is an individual who uses the system to set profile information and time allocation and receive action suggestions.

[1029] "Profile information" is personal information including the user's name, age, family composition, occupation, hobbies, interests, etc.

[1030] A "generative AI model" is an artificial intelligence program that generates action plans based on information input by the user.

[1031] "Action suggestions" are options or plans suggested by the generative AI model based on the user's profile information and time allocation.

[1032] "Remind" is a function that notifies the user of a specified time and content in order to carry out a proposed action.

[1033] A "terminal" is a device such as a computer or smartphone that a user uses to operate the system.

[1034] The "server" is a central processing unit that processes user input information and generates action plans using generative AI models and provides reminder functions.

[1035] "Share" is a function that notifies other users of information about the action plan selected by the user, allowing them to check the same action plan.

[1036] "Detailed information" refers to additional information about the proposed action, such as the time required, costs, and necessary preparations.

[1037] MODE FOR CARRYING OUT THE INVENTION

[1038] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of using a generation AI to propose multiple action plans and share them with the user and their family. The system for implementing the present invention performs data processing and data calculation using the following hardware and software.

[1039] Hardware and software used

[1040] Hardware:

[1041] Devices: computers, smartphones, tablets, etc.

[1042] Server: Cloud-based server or server located in a data center

[1043] software:

[1044] Generative AI models: Natural language processing models such as GPT-4

[1045] Data transmission and reception: RESTful API using HTTP protocol

[1046] Database: A relational database (e.g., MySQL, PostgreSQL) to store user information

[1047] Specific example explanation

[1048] Registering user information and selecting action plans

[1049] 1. A user logs in to the system or registers. They enter their name, age, family composition, occupation, hobbies, and interests as profile information. For example, a user clicks the "New Registration" button and enters information such as "Name: Taro Tanaka," "Age: 35," "Family composition: Wife and two children," "Occupation: Engineer," and "Hobbies: Reading, cooking, and the outdoors" into the form.

[1050] 2. The user sets how they want to allocate their free time. For example, they can set three hours of "time with family" on the weekend, one hour of "study time" on weekdays, and two hours of "self-improvement time" per week. This data is collected by the device and sent to the server.

[1051] Generation and presentation of action plans

[1052] 1. The server inputs the received user information and time allocation into the generative AI model. An example of a prompt sentence is, "Please suggest an action plan for Taro Tanaka, a 35-year-old man with two children, to spend the weekend with his family."

[1053] 2. The generative AI model generates multiple suggested actions based on the prompt, such as "take a day trip to a theme park," "watch a movie," or "play board games at home."

[1054] 3. The server returns the generated action plans to the terminal, which then presents them to the user in a list format. Each action plan includes detailed information such as the required time, cost, and necessary preparations.

[1055] Selecting and sharing action plans

[1056] 1. The user selects an action plan that interests them from the presented options. For example, they select "a day trip to a theme park."

[1057] 2. The selected action plan is shared from the device to the devices of other users (family members), and all family members can check the details of the plan. Specifically, using the reminder function, the preparation list is notified the day before the action plan is to be carried out. A reminder is also sent one hour before the day.

[1058] In this way, the system of the present invention can utilize a generative AI model to propose various action plans based on the user's profile information and time allocation, making it possible to utilize free time efficiently and effectively.

[1059] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1060] Step 1:

[1061] A user logs in to the system or registers. The user clicks the "New Registration" button on the login screen and enters the required profile information (name, age, family composition, occupation, hobbies, interests, etc.) in the form. By pressing the submit button for the input data, the input data is sent from the terminal to the server. This input data includes the user's basic personal information. The server stores the received data in a database and confirms that registration is complete.

[1062] Step 2:

[1063] Users set how their free time is allocated within the system. On the "Time Settings" page, users use the pull-down menus to allocate time to "time with family," "time for study," and "time for self-improvement." For example, users can set "time with family" for three hours on weekends, "time for study" for one hour on weekdays, and "time for self-improvement" for two hours a week. The entered time allocation data is sent from the device to the server. The server receives this data and stores it together with the user's profile information.

[1064] Step 3:

[1065] The server uses the collected user information and time allocation data to create a prompt to be input into the generative AI model. For example, it generates a prompt such as, "Please suggest some activities that Taro Tanaka, a 35-year-old man with two children, should do to spend the weekend with his family." This prompt is sent to the generative AI model, which then generates a proposed action. The input here is the prompt and user data, and the output is multiple proposed actions.

[1066] Step 4:

[1067] The generative AI model generates multiple suggested actions based on the input prompt. For example, it generates suggested actions such as "day trip to a theme park," "watching a movie," or "playing board games at home." These suggested actions are returned to the server as JSON-formatted data. The server receives this data, analyzes it, and selects the optimal suggested action for the user.

[1068] Step 5:

[1069] The server sends the selected action plan in JSON format to the device. The device analyzes the received data and generates a list of action plans. These are presented to the user in list format, with each action plan accompanied by detailed information such as the required time, cost, and necessary preparations. The user can view this information on the device screen.

[1070] Step 6:

[1071] The user selects an interesting plan from the proposed activities. For example, they select "a day trip to a theme park." The selected activity plan is sent from the device to the server, which stores this information. After that, detailed information about the selected activity plan is sent back to the device and displayed to the user.

[1072] Step 7:

[1073] The device will send a push notification to the family members' devices to share the selected action plan with them, allowing all family members to view the plan details.

[1074] Step 8:

[1075] The device will set a reminder function for the planned action date. Specifically, the device will notify the user of the preparation list the day before the planned action time, and will also send another reminder one hour before the planned action time. The notification will be sent using the device's alarm function.

[1076] In this way, the processing flow and operations at each step provide functions that allow users to efficiently and effectively utilize their free time and share it with family and other users.

[1077] (Application example 1)

[1078] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1079] Conventional lifestyle support systems lack the functionality to provide specific and personalized suggestions for efficiently and effectively utilizing users' free time, and have issues with mechanisms for sharing or reminding users of suggested activities.Furthermore, they lack the functionality to generate shopping plans based on users' interests and family schedules, and are unable to provide information that is truly useful in daily life.

[1080] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1081] In this invention, the server includes means for inputting a user's profile information and free time allocation, means for generating multiple planned activities based on the input profile information and free time allocation using a generation AI, means for presenting the generated planned activities to the user, means for sharing the planned activities selected by the user, means for providing reminders to carry out the planned activities, means for providing detailed information about the generated planned activities (e.g., required time, cost, location, recommended products), and means for sending notifications to share the selected planned activities with family members. This allows the server to provide specific suggestions based on the user's interests and preferences, enabling the user and his or her family to use their time efficiently.

[1082] "User profile information" refers to information about an individual, such as the user's name, age, family structure, occupation, hobbies, and interests.

[1083] "Free time allocation" refers to the allocation of free time available to a user to specific categories (for example, time with family, time for shopping, time for self-improvement, etc.).

[1084] "Generative AI" is artificial intelligence that automatically generates multiple action plans based on user input information.

[1085] An "action plan" is a specific action plan proposed by the generative AI, and includes detailed information such as the required time, cost, location, and recommended products.

[1086] "Remind" is a function that notifies the user in advance of the information necessary for preparation and implementation of the action plan selected by the user on the execution date.

[1087] "Detailed information" refers to specific information related to the proposed action, such as the required time, cost, location, and recommended products.

[1088] "Notification" is a message for conveying information about the generated action plan or reminder information to the user or their family.

[1089] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of using a generation AI to propose multiple action plans and share them with the user and their family. The system of the present invention includes the following procedures and functions.

[1090] First, users log in or register with the system's application. At this time, they enter their profile information (name, age, family composition, occupation, hobbies, interests, etc.). They then set their free time into categories such as "shopping time," "shopping time with family," and "short shopping (5-30 minutes)."

[1091] The device sends the input data to the server, which uses a generative AI to generate multiple action plans based on the user's information and free time allocation. The generation process takes into account the user's interests and hobbies, family schedules and interests, budget and time constraints.

[1092] The server sends the generated action plans back to the device, which then presents them to the user in list form. Detailed information (e.g., required time, cost, store location, recommended products, etc.) is attached to each action plan. The user selects the plan that interests them from the presented action plans. Detailed information about the selected action plan is provided via the device, along with notifications of necessary preparations and store reservations.

[1093] Additionally, the device will send a notification to family members' devices to share the user's selected action plan with them, allowing all family members to review the plan details and agree to it.

[1094] The device will set a reminder function for the planned action date. The device will notify the user of the preparation list the day before the planned action date, and will also send another reminder one hour before the planned action date. This reminder function helps the user to remember to carry out the planned action.

[1095] As a specific example of use, let's consider a case where a user uses a shopping assistant app. The user enters their profile information and sets up three hours of shopping time on the weekend. The server uses generative AI to suggest activities such as "looking for new clothes" and "visiting electronics stores," and provides detailed information (time required, cost, location, recommended products). When the user selects "looking for new clothes," the detailed information is displayed in the app, and a shared notification is sent to family members. The reminder function sends notifications the day before and one hour before, allowing the user to smoothly carry out the proposed action plan.

[1096] An example prompt might look like this:

[1097] User profile: Taro Tanaka, Age: 32, Family: Wife, Children, Occupation: Engineer

[1098] Interests: clothing, electronics, books

[1099] Free time: 3 hours of shopping on weekends, 30 minutes of quick shopping on weekdays

[1100] prompt:

[1101] User: "Taro Tanaka, 32 years old, Family: Wife, Children, Occupation: Engineer, Interests: Clothing, Electronics, Books, 3 hours of shopping on weekends, 30 minutes of quick shopping on weekdays"

[1102] Generation AI: Returns the generated action plan.

[1103] Examples: "Looking for new clothes, Time required: 180 minutes, Cost: 5,000 yen, Store location: Commercial district, Recommended items: Simple shirts, shoes"; "Visiting electronics stores, Time required: 120 minutes, Cost: 60,000 yen, Store location: Electric town, Recommended items: Latest smartphone, headphones"

[1104] As a result, the system of the present invention can provide a variety of action plans according to the user's needs, allowing the user to use their time efficiently and effectively.

[1105] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1106] Step 1:

[1107] A user logs in to the system's application or registers. The user enters profile information such as name, age, family composition, occupation, hobbies, and interests. The user also divides their free time into categories such as "shopping time," "shopping time with family," and "short shopping (5-30 minutes)." This input information is saved on the device.

[1108] Input: User profile information and free time allocation

[1109] Output: User information stored on the device

[1110] Step 2:

[1111] The terminal sends the data entered by the user to the server using an HTTP request, sending the data in JSON format.

[1112] Input: User information stored on the device

[1113] Output: User information sent to the server

[1114] Step 3:

[1115] The server inputs the received user information into a generative AI model, which generates multiple action plans based on the user information and time allocation. The generative AI model generates action plans based on the prompt text and creates specific suggestions.

[1116] Input: User information sent to the server

[1117] Output: Action plans generated by the generative AI model

[1118] Step 4:

[1119] The server sends the generated action plan back to the device, along with detailed information (time required, cost, store location, recommended products, etc.) in JSON format.

[1120] Input: Action proposals generated by a generative AI model

[1121] Output: Action plan and detailed information sent to the device

[1122] Step 5:

[1123] The device displays the received action plans and detailed information to the user in a list format. The user can select an action plan that interests them from the list and check the detailed information of the selected action plan.

[1124] Input: Action plan and details sent to the terminal

[1125] Output: A list of suggested actions shown to the user, with detailed information

[1126] Step 6:

[1127] When the user selects an activity plan that interests them, the terminal displays the selected activity plan in more detail and prepares to notify them if any related preparations or reservations are required.

[1128] Input: User selected action plan

[1129] Output: Display details of selected action plan and prepare notification

[1130] Step 7:

[1131] The device then sends details of the selected plan to the family members' devices, allowing all family members to confirm the plan details and obtain their consent.

[1132] Input: Details of selected action plan

[1133] Output: Notification of proposed actions sent to family members' devices

[1134] Step 8:

[1135] The device will set up a reminder function to remind users to carry out their planned action plan. The device will notify them of the preparation list the day before the planned date, and will also send another reminder one hour before the planned date. This will help users remember to carry out their planned action plan.

[1136] Input: Selected action plan and its execution date

[1137] Output: Reminder notification

[1138] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1139] ---

[1140] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of combining a generative AI and an emotion engine to propose multiple action plans and share them with the user and their family. The system of the present invention includes the following procedures and functions.

[1141] 1. User information registration:

[1142] Users first log in or register with the system and enter their profile information, which includes their name, age, family composition, occupation, hobbies, interests, etc.

[1143] Next, the user sets how to allocate their free time, dividing it into categories such as time with family, study time, and self-improvement time.

[1144] 2. Generate action plans:

[1145] The terminal receives the registered user information and time allocation and transmits them to the server.

[1146] The server uses a generation AI to generate multiple action plans based on the received user information and time allocation. This generation process takes into account the user's interests and hobbies, family schedules and interests, budget and time constraints, location and travel time, and emotional information obtained from the emotion engine.

[1147] 3. Emotional Engine Linkage:

[1148] The device recognizes the user's real-time emotional state and transmits the emotional information to the server.

[1149] The server uses an emotion engine to analyze the user's emotional state and optimizes suggested actions accordingly.

[1150] The system also analyzes the user's past emotional history and generates more appropriate action plans based on this.

[1151] 4. Propose a plan of action:

[1152] The server returns the generated action plan to the terminal.

[1153] The device presents this to the user in a list format, with detailed information attached to each proposed action (such as the required time, cost, and necessary preparations).

[1154] 5. Select an action plan and confirm details:

[1155] The user selects the plan of interest from the presented options. Detailed information about the selected option is provided via the terminal. Necessary preparations and reservation information are also notified at this stage.

[1156] 6. Share with family:

[1157] To share the user's selected action plan with family members, the device will send a notification to the family member's device, allowing everyone in the family to see the plan details.

[1158] 7. Reminder function:

[1159] The device will set a reminder function for the planned action date and notify the user of the preparation list the day before the scheduled time.

[1160] It will also send another reminder one hour before the scheduled time.

[1161] Specific examples

[1162] Here, a specific example of use will be shown.

[1163] Registering user information and selecting action plans

[1164] User Yamada Taro signs up for the app and enters his name, age, family composition, occupation, and hobbies (reading, cooking, outdoors) as profile information.

[1165] User Yamada Taro sets his free time as "time with family" for three hours on weekends, "time for study" for one hour on weekdays, and "time for self-improvement" for two hours a week.

[1166] The device sends the input data to the server, which uses a generative AI to generate the following action plan:

[1167] "Family time": Day trips to theme parks, movies, board games at home

[1168] "Study Time": Online courses for exam preparation, learning new programming languages

[1169] "Time for self-improvement": Trying new recipes, reading books as a hobby

[1170] The server also uses an emotion engine to analyze Yamada Taro's real-time emotions and past emotion history, and determines that a "day trip to a theme park" is the best option.

[1171] The server returns the action plan to the terminal, and the terminal presents the action plan to the user Yamada Taro in list form.

[1172] Action plan execution and reminder function

[1173] User Yamada Taro selects "day trip to a theme park" as "time with family."

[1174] The device will provide the user with the selected details (time required, cost, packing list, etc.) and notify them of the preparation list the day before, and will also send another reminder one hour before the day.

[1175] User Yamada Taro and his family enjoy a fun day at the theme park.

[1176] In this way, the system of the present invention takes into consideration not only the user's needs but also the user's emotional information, provides optimal action plans, and enables efficient and effective use of time.

[1177] The processing flow will be explained below.

[1178] Step 1:

[1179] A user signs up or logs into the system and enters profile information, including name, age, family status, occupation, hobbies, and interests.

[1180] Step 2:

[1181] The device receives the user's profile information and stores it in a local database.

[1182] Step 3:

[1183] Users can set how much free time they have available, for example, by setting time for family, study, self-improvement, etc.

[1184] Step 4:

[1185] The terminal receives the configured free time allocation and stores it in a local database.

[1186] Step 5:

[1187] The terminal transmits profile information and time allocation information to the server.

[1188] Step 6:

[1189] The server uses a generation AI to generate multiple action plans based on the profile information and time allocation information received. This process takes into account the user's interests, hobbies, budget, time, location, and emotional information obtained from the emotion engine.

[1190] Step 7:

[1191] The device recognizes the user's real-time emotional state and transmits the emotional information to the server.

[1192] Step 8:

[1193] The server uses an emotion engine to analyze the user's emotional state and optimizes the proposed actions based on it, and also analyzes the user's past emotional history to generate more appropriate proposed actions.

[1194] Step 9:

[1195] The server returns the generated action plan to the terminal.

[1196] Step 10:

[1197] The device receives the proposed activities and presents them to the user in a list format, with detailed information attached to each proposed activity, such as the required time, cost, and necessary preparations.

[1198] Step 11:

[1199] The user selects from the proposed activities and chooses the plan that interests them.

[1200] Step 12:

[1201] The device will display detailed information about the selected plan of action and notify you of any necessary preparations or reservations.

[1202] Step 13:

[1203] To share the user's selected action plan with family members, the device sends a notification to the family members' devices.

[1204] Step 14:

[1205] Family members' devices will receive a notification and display detailed information about the proposed action.

[1206] Step 15:

[1207] The device will set a reminder function for the planned action date and notify you of the preparation list the day before the scheduled time.

[1208] Step 16:

[1209] The device will send another reminder to the user one hour before the scheduled time.

[1210] Step 17:

[1211] On the scheduled day, the user and family carry out the selected action plan.

[1212] Example 2

[1213] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1214] In modern society, users are expected to use their free time efficiently and effectively. However, conventional scheduling and planning tools struggle to provide optimal action plans that take into account the user's interests and real-time emotional state. Furthermore, they lack the functionality to share action plans with family and related individuals, or to provide reminders for the execution of action plans. This leads to issues such as low user satisfaction and inefficient time utilization.

[1215] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting a user's identification information and free time allocation, means for generating multiple activity plans based on the input identification information and free time allocation using a generative AI model, means for acquiring and analyzing real-time emotional information, means for optimizing the activity plans based on the emotional state using an emotion engine, means for displaying the generated activity plans to the user, means for sharing the activity plan selected by the user with related others, and means for providing reminders to execute the activity plans. This makes it possible to provide optimal action plans tailored to the user's interests and real-time emotional state, enabling efficient and effective time utilization.

[1216] "User identification information" is information for identifying an individual user, and includes data such as name, age, occupation, and hobbies.

[1217] "Allocation of free time" is information indicating the free time that the user can use for specific activities, and is time allocated to each category such as time with family and time for self-improvement.

[1218] A "generative AI model" is an artificial intelligence model that generates specific outputs based on input data.

[1219] "Real-time emotional information" refers to information that indicates a user's current emotional state, and includes data obtained from sensors such as facial recognition cameras and smart devices.

[1220] An "emotion engine" is a software or hardware component that analyzes the acquired emotion information and identifies the user's emotional state.

[1221] "Activity suggestions" are suggestions for specific activities that a user can undertake in their free time.

[1222] "Related others" are people who may share time with the user, and primarily include family and friends.

[1223] The "remind function" is a function that notifies the user at a specific time or date of the information and preparations necessary to carry out the activity plan selected by the user.

[1224] This invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of combining a generative AI and an emotion engine to propose multiple action plans and share them with the user and related others.

[1225] Specific system configuration

[1226] 1. Hardware and Software Configuration

[1227] The server has computational resources including a database, generative AI models, and emotion engines, and plays a central role in distributing the generated action plans to each user.

[1228] The device includes an interface that allows users to input information, sensors to acquire real-time emotional states, and a screen that displays data from a server. Typical examples are smartphones and personal computers.

[1229] Users interact with the system through terminals.

[1230] 2. System Operation

[1231] First, a user logs in or registers with the system and enters identifying information such as name, age, family composition, occupation, hobbies, and interests. After successful login, the system assigns the next available time. For example, the user can set three hours on the weekend for family time, one hour on weekdays for study, and two hours per week for self-improvement.

[1232] The device receives the input identification information and time allocation and sends it to the server, which then creates a prompt for the generative AI model, such as: "Please generate action suggestions based on the user's interests and time allocation."

[1233] Based on this prompt, the generative AI model generates multiple suggested activities, such as a day trip to a theme park, going to the movies, or playing board games at home for "family time."

[1234] Second, real-time emotional information is crucial. The device acquires the user's current emotional state through sensors or smartwatches and transmits it to the server. The server uses an emotion engine to analyze this emotional information and identify the user's emotional state. Based on this emotional state, the generated action plan is optimized.

[1235] The server then sends the generated optimal action plans to the device, which then presents them to the user in a list format, including detailed information about each action plan, such as the required time, cost, and necessary preparations.

[1236] When the user selects a plan, the details are displayed again, along with any necessary preparations or booking information.

[1237] Furthermore, the selected action plan can be shared with other related parties, such as family members, and the device can send notifications to the family members' devices and add the event to a shared calendar.

[1238] The reminder function is also an important element. The device notifies the user of the preparation list the day before the planned action, and then sends another reminder one hour before the scheduled action. This helps the user to remember to carry out the planned action.

[1239] Specific examples

[1240] Here is a specific example.

[1241] Registering user information and selecting action plans

[1242] User A signs up for the app and enters his / her name, age, family composition, occupation, and hobbies (reading, cooking, outdoors) as profile information. User A sets his / her free time as "time with family" for three hours on weekends, "study time" for one hour on weekdays, and "self-improvement time" for two hours a week. The device sends this data to the server, which stores it in a database.

[1243] Generate action plans

[1244] The device periodically sends user information to a server, which then uses a generative AI model to generate suggested activities. For example, suggested activities for "family time" include a day trip to a theme park, going to the movies, and playing board games at home.

[1245] Linking the Emotion Engine

[1246] The device captures the user's current emotional state using a facial recognition camera and sends it to the server, which uses an emotion engine to identify the user's emotional state, such as "I'm currently stressed," and optimizes the suggested actions.

[1247] Proposing action plans

[1248] The server sends the optimized itinerary to the device, which displays the itinerary in a list format and provides detailed information (e.g., duration, cost, required ticket information, and packing list for a day trip to a theme park).

[1249] Select an action plan and confirm details

[1250] User A selects "Day trip to a theme park." The device displays detailed information about the selected plan and notifies the user of necessary preparations and reservation information.

[1251] Sharing with family

[1252] The device notifies the family members of the selected action plan and adds it to a shared calendar.

[1253] Reminder function

[1254] The device will notify you of the preparation list the day before the planned action is to be carried out, and will send another reminder one hour before the scheduled action.

[1255] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1256] Processing Steps

[1257] Step 1: Enter user information and register

[1258] input:

[1259] Users log in or register with the system and enter identifying information such as name, age, family status, occupation, hobbies, interests, etc. They also set their available time allocations.

[1260] Specific behavior:

[1261] 1. A user accesses the app and enters their login information (username and password).

[1262] 2. The device sends the authentication data to the server.

[1263] 3. The server performs authentication, and if authentication is successful, displays a profile entry screen to the user.

[1264] 4. The user enters the required profile information and time allocation.

[1265] output:

[1266] Profile information and time allocations are stored in a database.

[1267] Step 2: Generate action plans

[1268] input:

[1269] The terminal transmits the stored user information and time allocation to the server.

[1270] Specific behavior:

[1271] 1. The terminal periodically sends user information to the server.

[1272] 2. The server creates a prompt for the generative AI model and instructs it to generate an action plan.

[1273] 3. For example, send a prompt such as, "Generate action plans based on the user's interests and time allocation."

[1274] output:

[1275] The generative AI model outputs multiple action plans, which are stored on the server.

[1276] Step 3: Acquiring and analyzing emotional information

[1277] input:

[1278] The device acquires the user's real-time emotional information and transmits it to the server.

[1279] Specific behavior:

[1280] 1. The device uses sensors or smartwatches to capture the user's emotional state, for example, by reading facial expressions with a facial recognition camera or measuring heart rate.

[1281] 2. The device sends the acquired emotion information to the server.

[1282] 3. The server uses an emotion engine to analyze this emotion information.

[1283] output:

[1284] The emotion engine identifies the user's emotional state and the results of this analysis are stored on the server.

[1285] Step 4: Optimize your action plan

[1286] input:

[1287] The server obtains the generated action plan and the analysis results of the emotion engine.

[1288] Specific behavior:

[1289] 1. The server integrates the stored action plans with the sentiment analysis results.

[1290] 2. Optimize the generated action proposals based on the analysis results of the emotion engine.

[1291] output:

[1292] The optimized action plan is stored on the server and used for further processing.

[1293] Step 5: Propose a course of action

[1294] input:

[1295] The server sends the optimized action plan to the terminal.

[1296] Specific behavior:

[1297] 1. The server sends the optimized action plan to the device.

[1298] 2. The device presents the user with a list of suggested activities, each of which includes detailed information such as the time required, cost, and necessary preparations.

[1299] output:

[1300] The suggested actions are displayed on the user's device.

[1301] Step 6: Select an action plan and confirm details

[1302] input:

[1303] The user selects an action plan that interests them from the presented options.

[1304] Specific behavior:

[1305] 1. The user taps or clicks to select an action.

[1306] 2. The device will display detailed information about the selected activity, such as a "day trip to a theme park" (duration, cost, required tickets, packing list, etc.).

[1307] output:

[1308] Detailed information about the selected action plan is displayed on the user's terminal.

[1309] Step 7: Share your action plan

[1310] input:

[1311] The user's selected action plan is shared with the device.

[1312] Specific behavior:

[1313] 1. The device sends notifications of the selected action plan to the devices of other relevant people (family and friends).

[1314] 2. The device sends the shared information to other related devices and adds the event to the shared calendar.

[1315] output:

[1316] Notify others on their devices and add them to a shared calendar.

[1317] Step 8: Reminders

[1318] input:

[1319] When the planned action date approaches, the device will set a reminder.

[1320] Specific behavior:

[1321] 1. The terminal notifies the user of the preparation list the day before the planned action is to be carried out.

[1322] 2. The device will send another reminder one hour before the scheduled departure time, including a final confirmation of departure time and a final check of the packing list.

[1323] output:

[1324] A reminder notification will be displayed on the user's device, and the action plan will be ready to be carried out.

[1325] In this way, the system considers the user's needs and emotional information at each step, generating and providing optimal action plans, allowing for efficient and effective use of time.

[1326] (Application example 2)

[1327] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1328] Efficient operation management and maintenance planning for machines in factories are crucial for maximizing production efficiency. However, current systems make it difficult to centrally manage machine idle times and maintenance schedules, and are unable to provide optimal task and maintenance proposals that take into account machine utilization rates and failure trends. Furthermore, a flexible system that can handle a large number of machines and a variety of tasks is required. To solve this problem, a system is needed that can monitor machine operation status and emotional state in real time and propose optimal task proposals and maintenance schedules.

[1329] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1330] In this invention, the server includes a means for inputting a user's profile information and free time allocation, a means for generating multiple action plans based on the input profile information and free time allocation using a generation AI, and a means for managing the free time and maintenance schedules of machines in a factory and generating optimal task plans and maintenance plans. This makes it possible to realize efficient machine operation and optimized maintenance, thereby improving production efficiency.

[1331] "User" means an individual or company representative who uses the system.

[1332] "Profile information" is basic information for identifying an individual, such as the user's name, age, occupation, and hobbies.

[1333] "Free time allocation" refers to settings that indicate how much time a user will devote to a particular activity.

[1334] "Generative AI" is a system that uses artificial intelligence technology to automatically generate optimal action plans and task plans based on information from users and machines.

[1335] An "action plan" is an activity plan that is suitable for the user's free time.

[1336] "Maintenance schedule" refers to the schedule for regular maintenance, inspection, and repair work on machinery.

[1337] A "task proposal" is a specific work instruction or work plan for a machine to carry out.

[1338] A "farm manager" is a person in charge of operating and managing machinery and systems within a factory.

[1339] "Remind" is a function that notifies users and farm managers before carrying out proposed actions or performing maintenance.

[1340] The "emotion engine" is a technology that analyzes a machine's operating rate and tendency to fail as an emotional evaluation, and generates optimal action plans and task plans based on that.

[1341] "Notification" is a means of communicating generated task proposals and maintenance schedules to users and farm managers.

[1342] The present invention is a system for efficiently and effectively utilizing the free time of users (e.g., factory managers) and the operating time of machines in a factory. In particular, it has the function of combining a generative AI and an emotion engine to propose multiple action plans and task plans and share them with users and related parties. The system of the present invention includes the following procedures and functions.

[1343] 1. User information registration

[1344] First, the user logs in or registers on the terminal and enters their profile information. User information includes their name, age, occupation, etc. At the same time, the allocation of their free time is also set, and time is allocated to specific categories (e.g., maintenance time, product assembly time, etc.). This allows the user to give detailed instructions on the operation schedule of the machines under their control.

[1345] 2. Generate action and task proposals

[1346] The device receives the registered user information and time allocation and sends it to the server. The server uses a generation AI to generate multiple action plans and task plans based on the received user information and time allocation. This generation process takes into account the machine's operating status, maintenance history, past machine performance data, budget and time constraints, and emotional information obtained from the emotion engine.

[1347] 3. Linking the Emotional Engine

[1348] The terminal monitors the machine's real-time operating rate and failure rate and transmits emotional information to the server. The server uses an emotion engine to analyze the machine's emotional state and optimizes action and task proposals based on that information. For example, the emotion engine can predict the possibility of a machine failure based on its past operating history and automatically create an appropriate maintenance schedule.

[1349] 4. Proposing actions and tasks

[1350] The server sends the generated action plans and task plans back to the device, which then presents them to the user in a list format, with detailed information attached to each plan (e.g., required time, cost, necessary preparations, etc.), allowing the user to create an optimal plan.

[1351] 5. Sharing action and task ideas

[1352] To share the user's selected action plan or task plan with the relevant parties, the device sends a notification to the relevant parties' devices, allowing all parties involved to view the plan details and work more efficiently.

[1353] 6. Reminder function

[1354] The device can set reminders for proposed actions or tasks on the day they are to be performed, notify you of the preparation list the day before the scheduled time, and send another reminder one hour before the scheduled time.

[1355] Specific examples

[1356] For example, a factory manager can sign up for the app and set their free time allocation along with their profile information. The device sends this information to the server, which then uses generative AI to generate action plans and task proposals. The generated action proposals might include, for example, "assembly of the product line," "machine maintenance," or "new product testing."

[1357] The server uses an emotion engine to analyze the machine's operating rate and failure trends, and determines that "machine maintenance" is optimal. The terminal notifies the administrator of the selected plan via a reminder function, which is then shared with relevant parties. Another reminder is also sent one hour before the plan is to be implemented.

[1358] Prompt Sentence Examples

[1359] "Machine A in the factory is currently idle, and one week has passed since the last maintenance. Based on this information, please suggest the best tasks and maintenance schedule."

[1360] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1361] Step 1:

[1362] Registering user information

[1363] How it works: A user logs in or registers through their device and enters their profile information.

[1364] Input: Name, age, occupation, hobbies, free time allocation

[1365] Data processing: The device formats the entered profile information and time allocation and stores it in a database.

[1366] Output: Registered user information and time allocation data

[1367] Step 2:

[1368] Generation of action and task proposals

[1369] Operation: The device sends registered user information and time allocation data to the server.

[1370] Input: User information data, time allocation data

[1371] Data processing: The server uses a generative AI to generate multiple action plans and task plans based on user information and time allocation.

[1372] Data calculation: AI algorithms generate action suggestions using the user profile and task optimization criteria.

[1373] Output: Multiple action and task proposals

[1374] Step 3:

[1375] Linking the Emotion Engine

[1376] Operation: The terminal monitors the real-time operating rate and failure rate of the machine and sends the data to the server.

[1377] Input: Machine availability data, failure history data

[1378] Data processing: The server uses an emotion engine to analyze the emotional state of the machine and evaluate its availability and tendency to malfunction.

[1379] Data calculation: The emotion engine performs emotion evaluation based on historical and real-time data.

[1380] Output: Emotion evaluation result

[1381] Step 4:

[1382] Optimizing action and task proposals

[1383] Operation: The server optimizes the generated action and task proposals based on the emotion evaluation results.

[1384] Input: Multiple action and task proposals, emotion evaluation results

[1385] Data calculations: Combining the results of generative AI and emotion engines to prioritize proposed actions.

[1386] Output: Optimized action and task proposals

[1387] Step 5:

[1388] Proposing action and task ideas

[1389] How it works: The server sends optimized action and task proposals back to the device.

[1390] Input: Optimized action and task proposals

[1391] Data processing: The terminal presents this to the user in a list format, with detailed information attached to each option (time required, cost, necessary preparations, etc.).

[1392] Output: A list of suggested actions that the user can review.

[1393] Step 6:

[1394] Sharing action and task ideas

[1395] Operation: The device sends a notification to the device of the person involved to share the action or task proposal selected by the user with the person involved.

[1396] Input: User-selected action and task proposals

[1397] Data processing: The terminal notifies the selected proposal to the relevant parties' devices.

[1398] Output: Notifications of proposed actions and tasks received by stakeholders

[1399] Step 7:

[1400] Reminder function

[1401] How it works: Your device will set a reminder for the proposed action or task on the scheduled date, notify you of the preparation list the day before the scheduled time, and send another reminder one hour before the scheduled time.

[1402] Input: Action proposal and task proposal execution date and time

[1403] Data processing: The device sets the reminder function and sends notifications to relevant parties.

[1404] Output: Reminder notification

[1405] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1406] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1407] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1408] [Fourth embodiment]

[1409] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1410] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1411] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1412] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1413] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1414] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1415] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1416] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1417] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1418] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1419] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1420] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1421] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1422] ---

[1423] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of using a generation AI to propose multiple action plans and share them with the user and their family. The system of the present invention includes the following procedures and functions.

[1424] 1. User information registration:

[1425] Users first log in or register with the system and enter their profile information, which includes their name, age, family composition, occupation, hobbies, interests, etc.

[1426] Next, the user sets how to allocate their free time, dividing it into categories such as time with family, study time, and self-improvement time.

[1427] 2. Generate action plans:

[1428] The terminal receives the registered user information and time allocation and transmits them to the server.

[1429] The server uses a generation AI to generate multiple action plans based on the received user information and time allocation. This generation process takes into account the user's interests and hobbies, family schedules and interests, budget and time constraints, location and travel time, etc.

[1430] 3. Propose a plan of action:

[1431] The server returns the generated action plan to the terminal.

[1432] The device presents this to the user in a list format, with detailed information attached to each proposed action (such as the required time, cost, and necessary preparations).

[1433] 4. Select an action plan and confirm details:

[1434] The user selects the plan they are interested in from the proposed activities. Detailed information about the selected plan is provided via the terminal. Necessary preparations and reservations are also notified at this stage.

[1435] 5. Share with family:

[1436] To share the user's selected action plan with family members, the device will send a notification to the family member's device, allowing everyone in the family to see the plan details.

[1437] 6. Reminder function:

[1438] The device will set a reminder for the planned action date, notify the user of the preparation list the day before the scheduled time, and send another reminder one hour before the scheduled time.

[1439] Specific examples

[1440] Here, a specific example of use will be shown.

[1441] Registering user information and selecting action plans

[1442] User Ichiro Sato signs up for the app and enters his name, age, family composition, occupation, and hobbies (reading, cooking, outdoors) as profile information.

[1443] User Ichiro Sato sets his free time as "time with family" for three hours on weekends, "time for study" for one hour on weekdays, and "time for self-improvement" for two hours a week.

[1444] The device sends the input data to the server, which uses a generative AI to generate the following action plan:

[1445] "Family time": Day trips to theme parks, movies, board games at home

[1446] "Study Time": Online courses for exam preparation, learning new programming languages

[1447] "Time for self-improvement": Trying new recipes, reading books as a hobby

[1448] The server returns the generated action plan to the terminal, and the terminal presents the action plan to the user, Ichiro Sato, in a list format.

[1449] Action plan execution and reminder function

[1450] User Ichiro Sato selects "day trip to a theme park" as "time with family."

[1451] The device will provide the user with the selected details (time required, cost, packing list, etc.) and notify them of the preparation list the day before, and will also send another reminder one hour before the day.

[1452] User Ichiro Sato and his family enjoy a fun day at the theme park.

[1453] In this way, the system of the present invention provides a variety of action plans tailored to the user's needs, allowing the user to use their time efficiently and effectively.

[1454] The processing flow will be explained below.

[1455] Step 1:

[1456] A user signs up or logs into the system and enters profile information, including name, age, family status, occupation, hobbies, and interests.

[1457] Step 2:

[1458] The device receives the user's profile information and stores it in a local database.

[1459] Step 3:

[1460] Users can set how much free time they have available, for example, by setting time for family, study, self-improvement, etc.

[1461] Step 4:

[1462] The terminal receives the configured free time allocation and stores it in a local database.

[1463] Step 5:

[1464] The terminal transmits profile information and time allocation information to the server.

[1465] Step 6:

[1466] The server uses AI to generate multiple action plans based on the profile information and time allocation information received, taking into account the user's interests, hobbies, budget, time, location, etc.

[1467] Step 7:

[1468] The server returns the generated action plan to the terminal.

[1469] Step 8:

[1470] The device receives the proposed activities and presents them to the user in a list format, with detailed information attached to each proposed activity, such as the required time, cost, and necessary preparations.

[1471] Step 9:

[1472] The user selects from the proposed activities and chooses the plan that interests them.

[1473] Step 10:

[1474] The device will display detailed information about the selected plan of action and notify you of any necessary preparations or reservations.

[1475] Step 11:

[1476] To share the user's selected action plan with family members, the device sends a notification to the family members' devices.

[1477] Step 12:

[1478] Family members' devices will receive a notification and display detailed information about the proposed action.

[1479] Step 13:

[1480] The device will set a reminder function for the planned action date and notify you of the preparation list the day before the scheduled time.

[1481] Step 14:

[1482] The device will send another reminder to the user one hour before the scheduled time.

[1483] Step 15:

[1484] On the scheduled day, the user and family carry out the selected action plan.

[1485] Example 1

[1486] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1487] In modern society, users lead busy lives, making it difficult to utilize their free time efficiently and effectively. Furthermore, the processes of coordinating schedules with family members, selecting activity plans, and setting reminders are time-consuming. To solve these problems, a system is needed that can suggest optimal activity plans based on the user's interests and time allocation, and easily share these plans with family members.

[1488] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1489] In this invention, the server includes means for inputting a user's profile information and free time allocation, means for generating multiple action plans based on the input profile information and free time allocation using a generation AI model, means for presenting the generated action plans to the user, means for sharing the action plans selected by the user with other users, and means for providing reminders to execute the action plans. This makes it possible to efficiently generate a variety of action plans tailored to the user's needs and easily coordinate time with family members.

[1490] A "user" is an individual who uses the system to set profile information and time allocation and receive action suggestions.

[1491] "Profile information" is personal information including the user's name, age, family composition, occupation, hobbies, interests, etc.

[1492] A "generative AI model" is an artificial intelligence program that generates action plans based on information input by the user.

[1493] "Action suggestions" are options or plans suggested by the generative AI model based on the user's profile information and time allocation.

[1494] "Remind" is a function that notifies the user of a specified time and content in order to carry out a proposed action.

[1495] A "terminal" is a device such as a computer or smartphone that a user uses to operate the system.

[1496] The "server" is a central processing unit that processes user input information and generates action plans using generative AI models and provides reminder functions.

[1497] "Share" is a function that notifies other users of information about the action plan selected by the user, allowing them to check the same action plan.

[1498] "Detailed information" refers to additional information about the proposed action, such as the time required, costs, and necessary preparations.

[1499] MODE FOR CARRYING OUT THE INVENTION

[1500] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of using a generation AI to propose multiple action plans and share them with the user and their family. The system for implementing the present invention performs data processing and data calculation using the following hardware and software.

[1501] Hardware and software used

[1502] Hardware:

[1503] Devices: computers, smartphones, tablets, etc.

[1504] Server: Cloud-based server or server located in a data center

[1505] software:

[1506] Generative AI models: Natural language processing models such as GPT-4

[1507] Data transmission and reception: RESTful API using HTTP protocol

[1508] Database: A relational database (e.g., MySQL, PostgreSQL) to store user information

[1509] Specific example explanation

[1510] Registering user information and selecting action plans

[1511] 1. A user logs in to the system or registers. They enter their name, age, family composition, occupation, hobbies, and interests as profile information. For example, a user clicks the "New Registration" button and enters information such as "Name: Taro Tanaka," "Age: 35," "Family composition: Wife and two children," "Occupation: Engineer," and "Hobbies: Reading, cooking, and the outdoors" into the form.

[1512] 2. The user sets how they want to allocate their free time. For example, they can set three hours of "time with family" on the weekend, one hour of "study time" on weekdays, and two hours of "self-improvement time" per week. This data is collected by the device and sent to the server.

[1513] Generation and presentation of action plans

[1514] 1. The server inputs the received user information and time allocation into the generative AI model. An example of a prompt sentence is, "Please suggest an action plan for Taro Tanaka, a 35-year-old man with two children, to spend the weekend with his family."

[1515] 2. The generative AI model generates multiple suggested actions based on the prompt, such as "take a day trip to a theme park," "watch a movie," or "play board games at home."

[1516] 3. The server returns the generated action plans to the terminal, which then presents them to the user in a list format. Each action plan includes detailed information such as the required time, cost, and necessary preparations.

[1517] Selecting and sharing action plans

[1518] 1. The user selects an action plan that interests them from the presented options. For example, they select "a day trip to a theme park."

[1519] 2. The selected action plan is shared from the device to the devices of other users (family members), and all family members can check the details of the plan. Specifically, using the reminder function, the preparation list is notified the day before the action plan is to be carried out. A reminder is also sent one hour before the day.

[1520] In this way, the system of the present invention can utilize a generative AI model to propose various action plans based on the user's profile information and time allocation, making it possible to utilize free time efficiently and effectively.

[1521] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1522] Step 1:

[1523] A user logs in to the system or registers. The user clicks the "New Registration" button on the login screen and enters the required profile information (name, age, family composition, occupation, hobbies, interests, etc.) in the form. By pressing the submit button for the input data, the input data is sent from the terminal to the server. This input data includes the user's basic personal information. The server stores the received data in a database and confirms that registration is complete.

[1524] Step 2:

[1525] Users set how their free time is allocated within the system. On the "Time Settings" page, users use the pull-down menus to allocate time to "time with family," "time for study," and "time for self-improvement." For example, users can set "time with family" for three hours on weekends, "time for study" for one hour on weekdays, and "time for self-improvement" for two hours a week. The entered time allocation data is sent from the device to the server. The server receives this data and stores it together with the user's profile information.

[1526] Step 3:

[1527] The server uses the collected user information and time allocation data to create a prompt to be input into the generative AI model. For example, it generates a prompt such as, "Please suggest some activities that Taro Tanaka, a 35-year-old man with two children, should do to spend the weekend with his family." This prompt is sent to the generative AI model, which then generates a proposed action. The input here is the prompt and user data, and the output is multiple proposed actions.

[1528] Step 4:

[1529] The generative AI model generates multiple suggested actions based on the input prompt. For example, it generates suggested actions such as "day trip to a theme park," "watching a movie," or "playing board games at home." These suggested actions are returned to the server as JSON-formatted data. The server receives this data, analyzes it, and selects the optimal suggested action for the user.

[1530] Step 5:

[1531] The server sends the selected action plan in JSON format to the device. The device analyzes the received data and generates a list of action plans. These are presented to the user in list format, with each action plan accompanied by detailed information such as the required time, cost, and necessary preparations. The user can view this information on the device screen.

[1532] Step 6:

[1533] The user selects an interesting plan from the proposed activities. For example, they select "a day trip to a theme park." The selected activity plan is sent from the device to the server, which stores this information. After that, detailed information about the selected activity plan is sent back to the device and displayed to the user.

[1534] Step 7:

[1535] The device will send a push notification to the family members' devices to share the selected action plan with them, allowing all family members to view the plan details.

[1536] Step 8:

[1537] The device will set a reminder function for the planned action date. Specifically, the device will notify the user of the preparation list the day before the planned action time, and will also send another reminder one hour before the planned action time. The notification will be sent using the device's alarm function.

[1538] In this way, the processing flow and operations at each step provide functions that allow users to efficiently and effectively utilize their free time and share it with family and other users.

[1539] (Application example 1)

[1540] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1541] Conventional lifestyle support systems lack the functionality to provide specific and personalized suggestions for efficiently and effectively utilizing users' free time, and have issues with mechanisms for sharing or reminding users of suggested activities.Furthermore, they lack the functionality to generate shopping plans based on users' interests and family schedules, and are unable to provide information that is truly useful in daily life.

[1542] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1543] In this invention, the server includes means for inputting a user's profile information and free time allocation, means for generating multiple planned activities based on the input profile information and free time allocation using a generation AI, means for presenting the generated planned activities to the user, means for sharing the planned activities selected by the user, means for providing reminders to carry out the planned activities, means for providing detailed information about the generated planned activities (e.g., required time, cost, location, recommended products), and means for sending notifications to share the selected planned activities with family members. This allows the server to provide specific suggestions based on the user's interests and preferences, enabling the user and his or her family to use their time efficiently.

[1544] "User profile information" refers to information about an individual, such as the user's name, age, family structure, occupation, hobbies, and interests.

[1545] "Free time allocation" refers to the allocation of free time available to a user to specific categories (for example, time with family, time for shopping, time for self-improvement, etc.).

[1546] "Generative AI" is artificial intelligence that automatically generates multiple action plans based on user input information.

[1547] An "action plan" is a specific action plan proposed by the generative AI, and includes detailed information such as the required time, cost, location, and recommended products.

[1548] "Remind" is a function that notifies the user in advance of the information necessary for preparation and implementation of the action plan selected by the user on the execution date.

[1549] "Detailed information" refers to specific information related to the proposed action, such as the required time, cost, location, and recommended products.

[1550] "Notification" is a message for conveying information about the generated action plan or reminder information to the user or their family.

[1551] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of using a generation AI to propose multiple action plans and share them with the user and their family. The system of the present invention includes the following procedures and functions.

[1552] First, users log in or register with the system's application. At this time, they enter their profile information (name, age, family composition, occupation, hobbies, interests, etc.). They then set their free time into categories such as "shopping time," "shopping time with family," and "short shopping (5-30 minutes)."

[1553] The device sends the input data to the server, which uses a generative AI to generate multiple action plans based on the user's information and free time allocation. The generation process takes into account the user's interests and hobbies, family schedules and interests, budget and time constraints.

[1554] The server sends the generated action plans back to the device, which then presents them to the user in list form. Detailed information (e.g., required time, cost, store location, recommended products, etc.) is attached to each action plan. The user selects the plan that interests them from the presented action plans. Detailed information about the selected action plan is provided via the device, along with notifications of necessary preparations and store reservations.

[1555] Additionally, the device will send a notification to family members' devices to share the user's selected action plan with them, allowing all family members to review the plan details and agree to it.

[1556] The device will set a reminder function for the planned action date. The device will notify the user of the preparation list the day before the planned action date, and will also send another reminder one hour before the planned action date. This reminder function helps the user to remember to carry out the planned action.

[1557] As a specific example of use, let's consider a case where a user uses a shopping assistant app. The user enters their profile information and sets up three hours of shopping time on the weekend. The server uses generative AI to suggest activities such as "looking for new clothes" and "visiting electronics stores," and provides detailed information (time required, cost, location, recommended products). When the user selects "looking for new clothes," the detailed information is displayed in the app, and a shared notification is sent to family members. The reminder function sends notifications the day before and one hour before, allowing the user to smoothly carry out the proposed action plan.

[1558] An example prompt might look like this:

[1559] User profile: Taro Tanaka, Age: 32, Family: Wife, Children, Occupation: Engineer

[1560] Interests: clothing, electronics, books

[1561] Free time: 3 hours of shopping on weekends, 30 minutes of quick shopping on weekdays

[1562] prompt:

[1563] User: "Taro Tanaka, 32 years old, Family: Wife, Children, Occupation: Engineer, Interests: Clothing, Electronics, Books, 3 hours of shopping on weekends, 30 minutes of quick shopping on weekdays"

[1564] Generation AI: Returns the generated action plan.

[1565] Examples: "Looking for new clothes, Time required: 180 minutes, Cost: 5,000 yen, Store location: Commercial district, Recommended items: Simple shirts, shoes"; "Visiting electronics stores, Time required: 120 minutes, Cost: 60,000 yen, Store location: Electric town, Recommended items: Latest smartphone, headphones"

[1566] As a result, the system of the present invention can provide a variety of action plans according to the user's needs, allowing the user to use their time efficiently and effectively.

[1567] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1568] Step 1:

[1569] A user logs in to the system's application or registers. The user enters profile information such as name, age, family composition, occupation, hobbies, and interests. The user also divides their free time into categories such as "shopping time," "shopping time with family," and "short shopping (5-30 minutes)." This input information is saved on the device.

[1570] Input: User profile information and free time allocation

[1571] Output: User information stored on the device

[1572] Step 2:

[1573] The terminal sends the data entered by the user to the server using an HTTP request, sending the data in JSON format.

[1574] Input: User information stored on the device

[1575] Output: User information sent to the server

[1576] Step 3:

[1577] The server inputs the received user information into a generative AI model, which generates multiple action plans based on the user information and time allocation. The generative AI model generates action plans based on the prompt text and creates specific suggestions.

[1578] Input: User information sent to the server

[1579] Output: Action plans generated by the generative AI model

[1580] Step 4:

[1581] The server sends the generated action plan back to the device, along with detailed information (time required, cost, store location, recommended products, etc.) in JSON format.

[1582] Input: Action proposals generated by a generative AI model

[1583] Output: Action plan and detailed information sent to the device

[1584] Step 5:

[1585] The device displays the received action plans and detailed information to the user in a list format. The user can select an action plan that interests them from the list and check the detailed information of the selected action plan.

[1586] Input: Action plan and details sent to the terminal

[1587] Output: A list of suggested actions shown to the user, with detailed information

[1588] Step 6:

[1589] When the user selects an activity plan that interests them, the terminal displays the selected activity plan in more detail and prepares to notify them if any related preparations or reservations are required.

[1590] Input: User selected action plan

[1591] Output: Display details of selected action plan and prepare notification

[1592] Step 7:

[1593] The device then sends details of the selected plan to the family members' devices, allowing all family members to confirm the plan details and obtain their consent.

[1594] Input: Details of selected action plan

[1595] Output: Notification of proposed actions sent to family members' devices

[1596] Step 8:

[1597] The device will set up a reminder function to remind users to carry out their planned action plan. The device will notify them of the preparation list the day before the planned date, and will also send another reminder one hour before the planned date. This will help users remember to carry out their planned action plan.

[1598] Input: Selected action plan and its execution date

[1599] Output: Reminder notification

[1600] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1601] ---

[1602] The present invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of combining a generative AI and an emotion engine to propose multiple action plans and share them with the user and their family. The system of the present invention includes the following procedures and functions.

[1603] 1. User information registration:

[1604] Users first log in or register with the system and enter their profile information, which includes their name, age, family composition, occupation, hobbies, interests, etc.

[1605] Next, the user sets how to allocate their free time, dividing it into categories such as time with family, study time, and self-improvement time.

[1606] 2. Generate action plans:

[1607] The terminal receives the registered user information and time allocation and transmits them to the server.

[1608] The server uses a generation AI to generate multiple action plans based on the received user information and time allocation. This generation process takes into account the user's interests and hobbies, family schedules and interests, budget and time constraints, location and travel time, and emotional information obtained from the emotion engine.

[1609] 3. Emotional Engine Linkage:

[1610] The device recognizes the user's real-time emotional state and transmits the emotional information to the server.

[1611] The server uses an emotion engine to analyze the user's emotional state and optimizes suggested actions accordingly.

[1612] The system also analyzes the user's past emotional history and generates more appropriate action plans based on this.

[1613] 4. Propose a plan of action:

[1614] The server returns the generated action plan to the terminal.

[1615] The device presents this to the user in a list format, with detailed information attached to each proposed action (such as the required time, cost, and necessary preparations).

[1616] 5. Select an action plan and confirm details:

[1617] The user selects the plan of interest from the presented options. Detailed information about the selected option is provided via the terminal. Necessary preparations and reservation information are also notified at this stage.

[1618] 6. Share with family:

[1619] To share the user's selected action plan with family members, the device will send a notification to the family member's device, allowing everyone in the family to see the plan details.

[1620] 7. Reminder function:

[1621] The device will set a reminder function for the planned action date and notify the user of the preparation list the day before the scheduled time.

[1622] It will also send another reminder one hour before the scheduled time.

[1623] Specific examples

[1624] Here, a specific example of use will be shown.

[1625] Registering user information and selecting action plans

[1626] User Yamada Taro signs up for the app and enters his name, age, family composition, occupation, and hobbies (reading, cooking, outdoors) as profile information.

[1627] User Yamada Taro sets his free time as "time with family" for three hours on weekends, "time for study" for one hour on weekdays, and "time for self-improvement" for two hours a week.

[1628] The device sends the input data to the server, which uses a generative AI to generate the following action plan:

[1629] "Family time": Day trips to theme parks, movies, board games at home

[1630] "Study Time": Online courses for exam preparation, learning new programming languages

[1631] "Time for self-improvement": Trying new recipes, reading books as a hobby

[1632] The server also uses an emotion engine to analyze Yamada Taro's real-time emotions and past emotion history, and determines that a "day trip to a theme park" is the best option.

[1633] The server returns the action plan to the terminal, and the terminal presents the action plan to the user Yamada Taro in list form.

[1634] Action plan execution and reminder function

[1635] User Yamada Taro selects "day trip to a theme park" as "time with family."

[1636] The device will provide the user with the selected details (time required, cost, packing list, etc.) and notify them of the preparation list the day before, and will also send another reminder one hour before the day.

[1637] User Yamada Taro and his family enjoy a fun day at the theme park.

[1638] In this way, the system of the present invention takes into consideration not only the user's needs but also the user's emotional information, provides optimal action plans, and enables efficient and effective use of time.

[1639] The processing flow will be explained below.

[1640] Step 1:

[1641] A user signs up or logs into the system and enters profile information, including name, age, family status, occupation, hobbies, and interests.

[1642] Step 2:

[1643] The device receives the user's profile information and stores it in a local database.

[1644] Step 3:

[1645] Users can set how much free time they have available, for example, by setting time for family, study, self-improvement, etc.

[1646] Step 4:

[1647] The terminal receives the configured free time allocation and stores it in a local database.

[1648] Step 5:

[1649] The terminal transmits profile information and time allocation information to the server.

[1650] Step 6:

[1651] The server uses a generation AI to generate multiple action plans based on the profile information and time allocation information received. This process takes into account the user's interests, hobbies, budget, time, location, and emotional information obtained from the emotion engine.

[1652] Step 7:

[1653] The device recognizes the user's real-time emotional state and transmits the emotional information to the server.

[1654] Step 8:

[1655] The server uses an emotion engine to analyze the user's emotional state and optimizes the proposed actions based on it, and also analyzes the user's past emotional history to generate more appropriate proposed actions.

[1656] Step 9:

[1657] The server returns the generated action plan to the terminal.

[1658] Step 10:

[1659] The device receives the proposed activities and presents them to the user in a list format, with detailed information attached to each proposed activity, such as the required time, cost, and necessary preparations.

[1660] Step 11:

[1661] The user selects from the proposed activities and chooses the plan that interests them.

[1662] Step 12:

[1663] The device will display detailed information about the selected plan of action and notify you of any necessary preparations or reservations.

[1664] Step 13:

[1665] To share the user's selected action plan with family members, the device sends a notification to the family members' devices.

[1666] Step 14:

[1667] Family members' devices will receive a notification and display detailed information about the proposed action.

[1668] Step 15:

[1669] The device will set a reminder function for the planned action date and notify you of the preparation list the day before the scheduled time.

[1670] Step 16:

[1671] The device will send another reminder to the user one hour before the scheduled time.

[1672] Step 17:

[1673] On the scheduled day, the user and family carry out the selected action plan.

[1674] Example 2

[1675] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1676] In modern society, users are expected to use their free time efficiently and effectively. However, conventional scheduling and planning tools struggle to provide optimal action plans that take into account the user's interests and real-time emotional state. Furthermore, they lack the functionality to share action plans with family and related individuals, or to provide reminders for the execution of action plans. This leads to issues such as low user satisfaction and inefficient time utilization.

[1677] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for inputting a user's identification information and free time allocation, means for generating multiple activity plans based on the input identification information and free time allocation using a generative AI model, means for acquiring and analyzing real-time emotional information, means for optimizing the activity plans based on the emotional state using an emotion engine, means for displaying the generated activity plans to the user, means for sharing the activity plan selected by the user with related others, and means for providing reminders to execute the activity plans. This makes it possible to provide optimal action plans tailored to the user's interests and real-time emotional state, enabling efficient and effective time utilization.

[1678] "User identification information" is information for identifying an individual user, and includes data such as name, age, occupation, and hobbies.

[1679] "Allocation of free time" is information indicating the free time that the user can use for specific activities, and is time allocated to each category such as time with family and time for self-improvement.

[1680] A "generative AI model" is an artificial intelligence model that generates specific outputs based on input data.

[1681] "Real-time emotional information" refers to information that indicates a user's current emotional state, and includes data obtained from sensors such as facial recognition cameras and smart devices.

[1682] An "emotion engine" is a software or hardware component that analyzes the acquired emotion information and identifies the user's emotional state.

[1683] "Activity suggestions" are suggestions for specific activities that a user can undertake in their free time.

[1684] "Related others" are people who may share time with the user, and primarily include family and friends.

[1685] The "remind function" is a function that notifies the user at a specific time or date of the information and preparations necessary to carry out the activity plan selected by the user.

[1686] This invention is a system for efficiently and effectively utilizing a user's free time, and in particular has the function of combining a generative AI and an emotion engine to propose multiple action plans and share them with the user and related others.

[1687] Specific system configuration

[1688] 1. Hardware and Software Configuration

[1689] The server has computational resources including a database, generative AI models, and emotion engines, and plays a central role in distributing the generated action plans to each user.

[1690] The device includes an interface that allows users to input information, sensors to acquire real-time emotional states, and a screen that displays data from a server. Typical examples are smartphones and personal computers.

[1691] Users interact with the system through terminals.

[1692] 2. System Operation

[1693] First, a user logs in or registers with the system and enters identifying information such as name, age, family composition, occupation, hobbies, and interests. After successful login, the system assigns the next available time. For example, the user can set three hours on the weekend for family time, one hour on weekdays for study, and two hours per week for self-improvement.

[1694] The device receives the input identification information and time allocation and sends it to the server, which then creates a prompt for the generative AI model, such as: "Please generate action suggestions based on the user's interests and time allocation."

[1695] Based on this prompt, the generative AI model generates multiple suggested activities, such as a day trip to a theme park, going to the movies, or playing board games at home for "family time."

[1696] Second, real-time emotional information is crucial. The device acquires the user's current emotional state through sensors or smartwatches and transmits it to the server. The server uses an emotion engine to analyze this emotional information and identify the user's emotional state. Based on this emotional state, the generated action plan is optimized.

[1697] The server then sends the generated optimal action plans to the device, which then presents them to the user in a list format, including detailed information about each action plan, such as the required time, cost, and necessary preparations.

[1698] When the user selects a plan, the details are displayed again, along with any necessary preparations or booking information.

[1699] Furthermore, the selected action plan can be shared with other related parties, such as family members, and the device can send notifications to the family members' devices and add the event to a shared calendar.

[1700] The reminder function is also an important element. The device notifies the user of the preparation list the day before the planned action, and then sends another reminder one hour before the scheduled action. This helps the user to remember to carry out the planned action.

[1701] Specific examples

[1702] Here is a specific example.

[1703] Registering user information and selecting action plans

[1704] User A signs up for the app and enters his / her name, age, family composition, occupation, and hobbies (reading, cooking, outdoors) as profile information. User A sets his / her free time as "time with family" for three hours on weekends, "study time" for one hour on weekdays, and "self-improvement time" for two hours a week. The device sends this data to the server, which stores it in a database.

[1705] Generate action plans

[1706] The device periodically sends user information to a server, which then uses a generative AI model to generate suggested activities. For example, suggested activities for "family time" include a day trip to a theme park, going to the movies, and playing board games at home.

[1707] Linking the Emotion Engine

[1708] The device captures the user's current emotional state using a facial recognition camera and sends it to the server, which uses an emotion engine to identify the user's emotional state, such as "I'm currently stressed," and optimizes the suggested actions.

[1709] Proposing action plans

[1710] The server sends the optimized itinerary to the device, which displays the itinerary in a list format and provides detailed information (e.g., duration, cost, required ticket information, and packing list for a day trip to a theme park).

[1711] Select an action plan and confirm details

[1712] User A selects "Day trip to a theme park." The device displays detailed information about the selected plan and notifies the user of necessary preparations and reservation information.

[1713] Sharing with family

[1714] The device notifies the family members of the selected action plan and adds it to a shared calendar.

[1715] Reminder function

[1716] The device will notify you of the preparation list the day before the planned action is to be carried out, and will send another reminder one hour before the scheduled action.

[1717] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1718] Processing Steps

[1719] Step 1: Enter user information and register

[1720] input:

[1721] Users log in or register with the system and enter identifying information such as name, age, family status, occupation, hobbies, interests, etc. They also set their available time allocations.

[1722] Specific behavior:

[1723] 1. A user accesses the app and enters their login information (username and password).

[1724] 2. The device sends the authentication data to the server.

[1725] 3. The server performs authentication, and if authentication is successful, displays a profile entry screen to the user.

[1726] 4. The user enters the required profile information and time allocation.

[1727] output:

[1728] Profile information and time allocations are stored in a database.

[1729] Step 2: Generate action plans

[1730] input:

[1731] The terminal transmits the stored user information and time allocation to the server.

[1732] Specific behavior:

[1733] 1. The terminal periodically sends user information to the server.

[1734] 2. The server creates a prompt for the generative AI model and instructs it to generate an action plan.

[1735] 3. For example, send a prompt such as, "Generate action plans based on the user's interests and time allocation."

[1736] output:

[1737] The generative AI model outputs multiple action plans, which are stored on the server.

[1738] Step 3: Acquiring and analyzing emotional information

[1739] input:

[1740] The device acquires the user's real-time emotional information and transmits it to the server.

[1741] Specific behavior:

[1742] 1. The device uses sensors or smartwatches to capture the user's emotional state, for example, by reading facial expressions with a facial recognition camera or measuring heart rate.

[1743] 2. The device sends the acquired emotion information to the server.

[1744] 3. The server uses an emotion engine to analyze this emotion information.

[1745] output:

[1746] The emotion engine identifies the user's emotional state and the results of this analysis are stored on the server.

[1747] Step 4: Optimize your action plan

[1748] input:

[1749] The server obtains the generated action plan and the analysis results of the emotion engine.

[1750] Specific behavior:

[1751] 1. The server integrates the stored action plans with the sentiment analysis results.

[1752] 2. Optimize the generated action proposals based on the analysis results of the emotion engine.

[1753] output:

[1754] The optimized action plan is stored on the server and used for further processing.

[1755] Step 5: Propose a course of action

[1756] input:

[1757] The server sends the optimized action plan to the terminal.

[1758] Specific behavior:

[1759] 1. The server sends the optimized action plan to the device.

[1760] 2. The device presents the user with a list of suggested activities, each of which includes detailed information such as the time required, cost, and necessary preparations.

[1761] output:

[1762] The suggested actions are displayed on the user's device.

[1763] Step 6: Select an action plan and confirm details

[1764] input:

[1765] The user selects an action plan that interests them from the presented options.

[1766] Specific behavior:

[1767] 1. The user taps or clicks to select an action.

[1768] 2. The device will display detailed information about the selected activity, such as a "day trip to a theme park" (duration, cost, required tickets, packing list, etc.).

[1769] output:

[1770] Detailed information about the selected action plan is displayed on the user's terminal.

[1771] Step 7: Share your action plan

[1772] input:

[1773] The user's selected action plan is shared with the device.

[1774] Specific behavior:

[1775] 1. The device sends notifications of the selected action plan to the devices of other relevant people (family and friends).

[1776] 2. The device sends the shared information to other related devices and adds the event to the shared calendar.

[1777] output:

[1778] Notify others on their devices and add them to a shared calendar.

[1779] Step 8: Reminders

[1780] input:

[1781] When the planned action date approaches, the device will set a reminder.

[1782] Specific behavior:

[1783] 1. The terminal notifies the user of the preparation list the day before the planned action is to be carried out.

[1784] 2. The device will send another reminder one hour before the scheduled departure time, including a final confirmation of departure time and a final check of the packing list.

[1785] output:

[1786] A reminder notification will be displayed on the user's device, and the action plan will be ready to be carried out.

[1787] In this way, the system considers the user's needs and emotional information at each step, generating and providing optimal action plans, allowing for efficient and effective use of time.

[1788] (Application example 2)

[1789] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1790] Efficient operation management and maintenance planning for machines in factories are crucial for maximizing production efficiency. However, current systems make it difficult to centrally manage machine idle times and maintenance schedules, and are unable to provide optimal task and maintenance proposals that take into account machine utilization rates and failure trends. Furthermore, a flexible system that can handle a large number of machines and a variety of tasks is required. To solve this problem, a system is needed that can monitor machine operation status and emotional state in real time and propose optimal task proposals and maintenance schedules.

[1791] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1792] In this invention, the server includes a means for inputting a user's profile information and free time allocation, a means for generating multiple action plans based on the input profile information and free time allocation using a generation AI, and a means for managing the free time and maintenance schedules of machines in a factory and generating optimal task plans and maintenance plans. This makes it possible to realize efficient machine operation and optimized maintenance, thereby improving production efficiency.

[1793] "User" means an individual or company representative who uses the system.

[1794] "Profile information" is basic information for identifying an individual, such as the user's name, age, occupation, and hobbies.

[1795] "Free time allocation" refers to settings that indicate how much time a user will devote to a particular activity.

[1796] "Generative AI" is a system that uses artificial intelligence technology to automatically generate optimal action plans and task plans based on information from users and machines.

[1797] An "action plan" is an activity plan that is suitable for the user's free time.

[1798] "Maintenance schedule" refers to the schedule for regular maintenance, inspection, and repair work on machinery.

[1799] A "task proposal" is a specific work instruction or work plan for a machine to carry out.

[1800] A "farm manager" is a person in charge of operating and managing machinery and systems within a factory.

[1801] "Remind" is a function that notifies users and farm managers before carrying out proposed actions or performing maintenance.

[1802] The "emotion engine" is a technology that analyzes a machine's operating rate and tendency to fail as an emotional evaluation, and generates optimal action plans and task plans based on that.

[1803] "Notification" is a means of communicating generated task proposals and maintenance schedules to users and farm managers.

[1804] The present invention is a system for efficiently and effectively utilizing the free time of users (e.g., factory managers) and the operating time of machines in a factory. In particular, it has the function of combining a generative AI and an emotion engine to propose multiple action plans and task plans and share them with users and related parties. The system of the present invention includes the following procedures and functions.

[1805] 1. User information registration

[1806] First, the user logs in or registers on the terminal and enters their profile information. User information includes their name, age, occupation, etc. At the same time, the allocation of their free time is also set, and time is allocated to specific categories (e.g., maintenance time, product assembly time, etc.). This allows the user to give detailed instructions on the operation schedule of the machines under their control.

[1807] 2. Generate action and task proposals

[1808] The device receives the registered user information and time allocation and sends it to the server. The server uses a generation AI to generate multiple action plans and task plans based on the received user information and time allocation. This generation process takes into account the machine's operating status, maintenance history, past machine performance data, budget and time constraints, and emotional information obtained from the emotion engine.

[1809] 3. Linking the Emotional Engine

[1810] The terminal monitors the machine's real-time operating rate and failure rate and transmits emotional information to the server. The server uses an emotion engine to analyze the machine's emotional state and optimizes action and task proposals based on that information. For example, the emotion engine can predict the possibility of a machine failure based on its past operating history and automatically create an appropriate maintenance schedule.

[1811] 4. Proposing actions and tasks

[1812] The server sends the generated action plans and task plans back to the device, which then presents them to the user in a list format, with detailed information attached to each plan (e.g., required time, cost, necessary preparations, etc.), allowing the user to create an optimal plan.

[1813] 5. Sharing action and task ideas

[1814] To share the user's selected action plan or task plan with the relevant parties, the device sends a notification to the relevant parties' devices, allowing all parties involved to view the plan details and work more efficiently.

[1815] 6. Reminder function

[1816] The device can set reminders for proposed actions or tasks on the day they are to be performed, notify you of the preparation list the day before the scheduled time, and send another reminder one hour before the scheduled time.

[1817] Specific examples

[1818] For example, a factory manager can sign up for the app and set their free time allocation along with their profile information. The device sends this information to the server, which then uses generative AI to generate action plans and task proposals. The generated action proposals might include, for example, "assembly of the product line," "machine maintenance," or "new product testing."

[1819] The server uses an emotion engine to analyze the machine's operating rate and failure trends, and determines that "machine maintenance" is optimal. The terminal notifies the administrator of the selected plan via a reminder function, which is then shared with relevant parties. Another reminder is also sent one hour before the plan is to be implemented.

[1820] Prompt Sentence Examples

[1821] "Machine A in the factory is currently idle, and one week has passed since the last maintenance. Based on this information, please suggest the best tasks and maintenance schedule."

[1822] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1823] Step 1:

[1824] Registering user information

[1825] How it works: A user logs in or registers through their device and enters their profile information.

[1826] Input: Name, age, occupation, hobbies, free time allocation

[1827] Data processing: The device formats the entered profile information and time allocation and stores it in a database.

[1828] Output: Registered user information and time allocation data

[1829] Step 2:

[1830] Generation of action and task proposals

[1831] Operation: The device sends registered user information and time allocation data to the server.

[1832] Input: User information data, time allocation data

[1833] Data processing: The server uses a generative AI to generate multiple action plans and task plans based on user information and time allocation.

[1834] Data calculation: AI algorithms generate action suggestions using the user profile and task optimization criteria.

[1835] Output: Multiple action and task proposals

[1836] Step 3:

[1837] Linking the Emotion Engine

[1838] Operation: The terminal monitors the real-time operating rate and failure rate of the machine and sends the data to the server.

[1839] Input: Machine availability data, failure history data

[1840] Data processing: The server uses an emotion engine to analyze the emotional state of the machine and evaluate its availability and tendency to malfunction.

[1841] Data calculation: The emotion engine performs emotion evaluation based on historical and real-time data.

[1842] Output: Emotion evaluation result

[1843] Step 4:

[1844] Optimizing action and task proposals

[1845] Operation: The server optimizes the generated action and task proposals based on the emotion evaluation results.

[1846] Input: Multiple action and task proposals, emotion evaluation results

[1847] Data calculations: Combining the results of generative AI and emotion engines to prioritize proposed actions.

[1848] Output: Optimized action and task proposals

[1849] Step 5:

[1850] Proposing action and task ideas

[1851] How it works: The server sends optimized action and task proposals back to the device.

[1852] Input: Optimized action and task proposals

[1853] Data processing: The terminal presents this to the user in a list format, with detailed information attached to each option (time required, cost, necessary preparations, etc.).

[1854] Output: A list of suggested actions that the user can review.

[1855] Step 6:

[1856] Sharing action and task ideas

[1857] Operation: The device sends a notification to the device of the person involved to share the action or task proposal selected by the user with the person involved.

[1858] Input: User-selected action and task proposals

[1859] Data processing: The terminal notifies the selected proposal to the relevant parties' devices.

[1860] Output: Notifications of proposed actions and tasks received by stakeholders

[1861] Step 7:

[1862] Reminder function

[1863] How it works: Your device will set a reminder for the proposed action or task on the scheduled date, notify you of the preparation list the day before the scheduled time, and send another reminder one hour before the scheduled time.

[1864] Input: Action proposal and task proposal execution date and time

[1865] Data processing: The device sets the reminder function and sends notifications to relevant parties.

[1866] Output: Reminder notification

[1867] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1868] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1869] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1870] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1871] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1872] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1873] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1874] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1875] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1876] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1877] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1878] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1879] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1880] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1881] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1882] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1883] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1884] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1885] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1886] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1887] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1888] The following is further disclosed regarding the above embodiment.

[1889] (Claim 1)

[1890] a means for inputting user profile information and available time allocation;

[1891] A means for generating a plurality of action plans based on input profile information and time allocation using a generation AI;

[1892] means for presenting the generated action plan to a user;

[1893] a means for the user to share the selected action plan with family members;

[1894] The system includes a means for providing reminders to carry out the proposed action.

[1895] (Claim 2)

[1896] 10. The system of claim 1, further comprising: means for presenting detailed information about the generated suggested actions to the user.

[1897] (Claim 3)

[1898] 10. The system of claim 1, further comprising means for notifying weather and traffic information for the proposed action date.

[1899] "Example 1"

[1900] (Claim 1)

[1901] a means for inputting user profile information and available time allocation;

[1902] A means for generating a plurality of action plans based on input profile information and time allocation using a generative AI model;

[1903] means for presenting the generated action plan to a user;

[1904] A means for the user to share the selected action plan with other users;

[1905] The system includes a means for providing reminders to carry out the proposed action.

[1906] (Claim 2)

[1907] 10. The system of claim 1, further comprising: means for presenting detailed information about the generated suggested actions to the user.

[1908] (Claim 3)

[1909] 10. The system of claim 1, further comprising means for notifying weather and traffic information for the proposed action date.

[1910] "Application Example 1"

[1911] (Claim 1)

[1912] a means for inputting user profile information and available time allocation;

[1913] A means for generating a plurality of action plans based on input profile information and time allocation using a generation AI;

[1914] means for presenting the generated action plan to a user;

[1915] a means for the user to share their selected action plan;

[1916] a means for providing reminders to carry out the proposed action;

[1917] A means to provide detailed information about the generated action plan (e.g., required time, cost, location, recommended products, etc.),

[1918] A way to send notifications to share selected actions with family members.

[1919] Including system.

[1920] (Claim 2)

[1921] 10. The system of claim 1, further comprising: means for presenting detailed information about the generated suggested actions to the user.

[1922] (Claim 3)

[1923] 10. The system of claim 1, further comprising means for notifying weather and traffic information for the proposed action date.

[1924] "Example 2: Combining Emotion Engines"

[1925] (Claim 1)

[1926] means for inputting user identification information and available time allocation;

[1927] a means for generating a plurality of activity proposals based on the input identification information and time allocation using a generative AI model;

[1928] A means for acquiring and analyzing real-time emotional information;

[1929] means for optimizing proposed activities based on emotional state using an emotion engine;

[1930] means for displaying the generated activity proposals to a user;

[1931] a means for the user to share the selected activity suggestions with relevant others;

[1932] The system includes a means for providing reminders to perform the proposed activity.

[1933] (Claim 2)

[1934] 10. The system of claim 1, further comprising: means for displaying detailed information about the generated proposed activities to the user.

[1935] (Claim 3)

[1936] 10. The system of claim 1, further comprising means for providing weather and traffic information for the proposed activity date.

[1937] "Application example 2 when combining emotion engines"

[1938] (Claim 1)

[1939] a means for inputting user profile information and available time allocation;

[1940] A means for generating a plurality of action plans based on input profile information and time allocation using a generation AI;

[1941] means for presenting the generated action plan to a user;

[1942] A means for the user to share the selected action plan with relevant parties;

[1943] a means for providing reminders to carry out the proposed action;

[1944] A means to manage the idle time and maintenance schedule of machines in the factory and generate optimal task and maintenance proposals;

[1945] The system includes a means for notifying the plant manager of the generated task proposals and maintenance schedules.

[1946] (Claim 2)

[1947] 10. The system of claim 1, further comprising: means for presenting detailed information about the generated suggested actions to the user.

[1948] (Claim 3)

[1949] The system according to claim 1, further comprising means for notifying weather and traffic information for the execution date of the proposed action, and means for analyzing the availability and failure trends of factory machinery and providing an optimal operation plan. [Explanation of symbols]

[1950] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for inputting user profile information and available time allocation; A means for generating a plurality of action plans based on input profile information and time allocation using a generation AI; means for presenting the generated action plan to a user; a means for the user to share the selected action plan with family members; The system includes a means for providing reminders to carry out the proposed action.

2. The system of claim 1 , further comprising: means for presenting detailed information about the generated proposed actions to the user.

3. The system of claim 1 further comprising means for notifying weather and traffic information for the day on which the proposed action is to be carried out.

Images