system

Abstract

We provide the system. [Solution] A terminal means for receiving multiple activity information, A server means that accesses an external database based on the aforementioned activity information and collects necessary information, An evaluation means for evaluating time performance based on the information collected above, A generation means for generating an optimal activity plan based on evaluation results, A transmission means for sending the generated activity plan to a terminal, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern society, many individuals seek to maximize time efficiency. However, on the other hand, the abundance and uncertainty of information are increasing, making it difficult to use time efficiently. Users want to enjoy high-quality services while minimizing waiting time and travel time, but there is a lack of appropriate metrics and support to achieve this. Therefore, there is a need for a system that objectively evaluates time efficiency and provides an optimal activity plan.

Means for Solving the Problems

[0005] This invention provides a system in which a server collects necessary information from an external database based on activity information entered by the user, and evaluates time performance using an evaluation means. Based on the evaluation results, this system generates an optimal activity plan and transmits it to the user's terminal. Furthermore, by providing feedback on the user's selections, the accuracy of the suggestions is improved. This allows the user to maximize time efficiency and minimize waiting and travel times.

[0006] "Terminal device" refers to an electronic device on which users input activity information, receive information, and view plans.

[0007] A "server device" refers to a computing device that accesses an external database to collect necessary information and supports evaluation and generation devices.

[0008] "Evaluation method" refers to an algorithm or technique that calculates time performance based on collected information and evaluates the activity plan.

[0009] "Generation means" refers to a function or method that constructs an optimal activity plan for the user based on the results calculated by the evaluation means.

[0010] "Transmission means" refers to a communication function for transmitting the generated activity plan to the terminal means. [Brief explanation of the drawing]

[0011] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4]This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0012] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0013] First, let's explain the terminology used in the following explanation.

[0014] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0015] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0016] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0017] In the following embodiments, the numbered communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), and the like.

[0018] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0019] [First Embodiment]

[0020] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0021] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0022] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0023] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0024] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0025] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0026] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0027] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0028] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0029] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0030] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0031] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0032] This invention is a system that enables users to effectively utilize their time. The system begins with the user inputting desired activity information into a terminal. The terminal then transmits this information to a server. The server utilizes external databases and APIs to retrieve the necessary information in real time.

[0033] The server evaluates time performance using a dedicated evaluation tool based on the collected information. This evaluation takes into account factors such as waiting time, travel time, and service quality. Based on the evaluation results, the server generates an optimal activity plan and sends it to the terminal. Users can review the proposed plan and make the best choice to use their time as efficiently as possible.

[0034] As a concrete example, consider a case where a user wants to see a movie at a specific time. The user enters their request into a device. The device sends this information to a server. The server searches for information on nearby movie theaters and collects showtimes, seat availability, and review ratings for each theater. Based on this information, the server evaluates which theater and which movie would be the most efficient to see from a time-performance perspective. The optimal plan generated based on the evaluation results is sent to the user's device. The user can then decide which theater to choose based on the information received. This allows the user to avoid unnecessary waiting time and have a more fulfilling experience.

[0035] The following describes the processing flow.

[0036] Step 1:

[0037] The user uses their device and enters information about their desired activity (e.g., "I want to see a movie at 1pm") into the app.

[0038] Step 2:

[0039] The device sends the entered activity information to the server. Additional information, such as location and time constraints, is also sent at this time.

[0040] Step 3:

[0041] Based on the activity information received by the server, it accesses relevant external databases and APIs to retrieve the necessary information. This information includes movie theater locations, showtimes, reviews, and seat availability.

[0042] Step 4:

[0043] The server analyzes the collected information using evaluation tools and calculates the time performance of each option. The calculation takes into account factors such as travel time, waiting time, and review ratings.

[0044] Step 5:

[0045] The server generates an optimal activity plan based on the evaluation results. This plan includes movie theaters and time slots with high time-performance ratios.

[0046] Step 6:

[0047] The server generates a plan and sends it to the device. The user receives and views the proposed plan on their device.

[0048] Step 7:

[0049] The user reviews the proposed plan and makes the choice that best suits them. This choice will later be used as feedback.

[0050] Step 8:

[0051] The device feeds user selection information back to the server. This information is used to improve the accuracy of future suggestions.

[0052] (Example 1)

[0053] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0054] In modern society, it is a challenging task for users to effectively utilize their limited time and efficiently select activities that align with their objectives. In particular, selecting the optimal activity from multiple options requires a method for rapidly processing vast amounts of information and maximizing time efficiency. This invention aims to solve these problems and provide a method for optimizing users' time utilization.

[0055] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0056] In this invention, the server includes an information processing device means for receiving multiple activity information, a data collection device means for accessing external information sources and collecting necessary information, and an evaluation device means for evaluating time efficiency based on the collected information. This makes it possible to generate and provide users with an optimal activity plan for making the most effective use of their time.

[0057] An "information processing device" is a device that has the function of receiving activity information and selection information from a user and transmitting it to a server.

[0058] "Data collection device means" refers to a part of a server that has the function of accessing external information sources and collecting necessary data.

[0059] An "evaluation device" is a program that calculates time efficiency based on collected information and determines which activity is most effective.

[0060] "Plan generation device means" refers to a program or system that has the function of constructing an optimal activity plan based on evaluation results.

[0061] "Communication device means" refers to hardware or software that has the function of transmitting the activity plan generated by the server to an information processing device.

[0062] This invention is an information processing system designed to help users utilize their time more efficiently. In particular, it aims to propose the optimal activity from multiple options in response to user requests.

[0063] The user first enters activity information into a terminal. This terminal is an information processing device such as a computer or smartphone. The user's input is collected by the terminal and sent to the server. The terminal structures the data and sends it to the server in a standard data format, such as JSON.

[0064] The server accesses external information sources based on the received data and collects the necessary information. External APIs (Application Programming Interfaces) can be used for this process. For example, information about surrounding facilities can be obtained using the API of a map service that provides location information. Based on the information thus collected, the server performs calculations to evaluate time efficiency using an evaluation device. This evaluation takes into account factors such as waiting time and travel time.

[0065] Based on the evaluation results, the server uses a plan generation device to generate an optimal activity plan. This activity plan is structured with convenience and efficiency in mind, providing the user with the most beneficial options.

[0066] The generated activity plan is transmitted to the terminal via a communication device. The user can review the received information and select the most suitable activity from the suggested options.

[0067] As a concrete example, consider a scenario where a user wants to see a movie in their neighborhood at 3 PM. The user enters this information into a terminal, and the server collects information such as the schedules, seat availability, and review ratings of nearby movie theaters. Based on this information, the server evaluates which movie theater is the most efficient and suggests it to the user. This evaluation takes into account factors such as waiting time and travel time.

[0068] The following are specific examples of prompt statements for a generative AI model:

[0069] "The user wants to see a movie at 3:00 PM. Based on the specified geographical information, collect showtimes and seat availability for nearby movie theaters, and recommend the best theater considering waiting time and travel time."

[0070] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0071] Step 1:

[0072] The user inputs their activity preferences into an information processing device (terminal). For example, they might input, "I want to see a movie at 3 PM." The terminal reads this input, structures it in the required format (e.g., JSON), and prepares it as data to be used in the next processing step. The input is "activity preference information," and the output is "structured user activity information."

[0073] Step 2:

[0074] The terminal sends the user's activity requests to the server. This transmission takes place over the network, typically using the HTTP protocol. The server stores the received user activity information and prepares it for the next information collection step. The input is "structured user activity information," and the output is "received activity information."

[0075] Step 3:

[0076] The server accesses external information sources based on received activity information and collects the necessary relevant data. For example, it uses a movie theater API to obtain movie screenings, showtimes, and seat availability. The inputs are "received activity information" and "external API identifiers," and the output is "collected movie theater-related data."

[0077] Step 4:

[0078] The server evaluates time efficiency using collected movie theater-related data. A dedicated evaluation algorithm considers factors such as time, distance, and waiting time to calculate the most efficient option. The input is "collected movie theater-related data," and the output is "evaluated plan candidates."

[0079] Step 5:

[0080] The server generates the optimal action plan from the evaluated plan candidates. This plan includes the movie theater to choose, specific showtimes, estimated travel time, etc. The input is the "evaluated plan candidates," and the output is the "optimal action plan."

[0081] Step 6:

[0082] The server sends the optimal activity plan to the terminal. The terminal receives this plan and presents it visually to the user. The input is the "optimal activity plan," and the output is the "optimal activity plan displayed on the terminal."

[0083] Step 7:

[0084] The user can review the optimal activity plan displayed on the device and choose the option that best suits them from the suggested choices. This decision allows the user to use their time efficiently and achieve a fulfilling experience. The input is the "optimal activity plan displayed on the device," and the output is the "user's activity selection."

[0085] (Application Example 1)

[0086] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0087] Modern users want to minimize traffic congestion and wasted travel time, and manage their time optimally. However, current systems make it difficult to create efficient action plans based on real-time traffic conditions and the location of moving objects, resulting in wasted valuable time. To address these challenges, it is necessary to provide more efficient and precise planning.

[0088] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0089] In this invention, the server includes communication means for receiving multiple activity information; processing means for accessing external information sources and collecting necessary information based on the activity information; analysis means for evaluating time efficiency based on the collected information; planning means for generating an optimal action plan based on the evaluation results; transmission means for transmitting the generated action plan to a communication terminal; and adjustment means characterized in that the time efficiency takes into account traffic conditions and the location data of the moving object. This enables users to receive an efficient action plan in real time that minimizes traffic conditions and waiting times.

[0090] "Communication means" refers to devices and technologies for efficiently receiving multiple pieces of activity information.

[0091] "Processing means" refers to devices and technologies that access external information sources based on received activity information and collect necessary information.

[0092] "Analysis means" refers to devices and technologies used to evaluate time efficiency using collected information.

[0093] "Planning means" refers to devices and technologies for generating an optimal action plan based on the results of time efficiency evaluations.

[0094] "Means of transmission" refers to devices and technologies used to transmit the generated action plan to a communication terminal.

[0095] "Adjustment means" refers to devices or technologies that have the function of taking into account traffic conditions and the location data of moving objects when evaluating time efficiency.

[0096] This invention provides a system that enables users to efficiently utilize autonomous vehicles. The system receives activity information requested by the user via a smartphone using communication means. The received information is sent from the terminal to a server. The server uses processing means to collect data on current traffic conditions and the location of vehicles in real time from external information sources.

[0097] Next, the server utilizes analytical tools to evaluate time efficiency from the collected data. This evaluation includes traffic conditions, location data of moving objects, and waiting times. Based on the evaluation results, the planning tool generates an optimal action plan and transmits it to the user's communication terminal via a transmission tool.

[0098] As a concrete example, when a user uses an autonomous vehicle for shopping, they can receive a real-time action plan on their smartphone that reflects the optimal route, estimated travel time, and traffic conditions to their destination. This plan allows the user to act efficiently without wasting time. Furthermore, this system promotes effective use of time and improves user convenience.

[0099] An example of input to the generating AI model is a prompt such as, "Calculate the optimal route for an autonomous vehicle and generate a schedule and dispatch plan to reach the destination quickly, even in rainy weather."

[0100] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0101] Step 1:

[0102] The user enters desired activity information (e.g., destination, planned time) into the device via a smartphone application. The device then transmits this input information to the server via a communication method. The input consists of the user's desired information and is sent to the server as output.

[0103] Step 2:

[0104] Based on the user activity information received, the server accesses external information sources to obtain the latest traffic data and autonomous vehicle location data. The input for this process is the user's requested information, and the output is the collection of traffic data and location data. The system utilizes traffic APIs and map services to acquire this data.

[0105] Step 3:

[0106] The server uses analytical tools to evaluate time efficiency by using the collected traffic and location data. The input here is the data obtained in step 2, and the output is the evaluation result showing the optimal efficiency. A data analysis algorithm is used to perform analysis for time reduction and efficiency improvements.

[0107] Step 4:

[0108] The server uses planning tools to generate an optimal action plan based on the evaluation results. The input is the evaluation results from step 3, and the output is the specific action plan. Planning processing is performed to determine the optimal route and time allocation.

[0109] Step 5:

[0110] The server transmits the generated action plan to the communication terminal. Using a communication method, it conveys the specific details of the plan to the user. The input is the action plan from step 4, and the output is the plan information displayed on the user's terminal. The user can refer to the displayed information and receive instructions for efficiently carrying out their activities.

[0111] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0112] This invention provides a system that allows users to effectively utilize their time while receiving suggestions that take their emotional state into consideration. The system begins with the user inputting desired activity information into a terminal. The terminal then transmits this information to a server. Simultaneously, an emotion engine within the terminal recognizes the user's emotions and transmits that emotion data to the server.

[0113] The server uses external databases and APIs to acquire necessary information in real time based on user activity and sentiment data. The collected information is analyzed using evaluation tools, and an optimal activity plan is generated based on time performance and user sentiment. The generated plan is sent to the terminal, where the user reviews the proposed plan and makes the best choice.

[0114] As a concrete example, consider a scenario where a user wants to watch a movie at a specific time. The user inputs this request into the device. The device, through its emotion engine, recognizes the user's current emotional state (e.g., want to relax, want to feel energized). The device sends this information to a server. The server evaluates information about nearby movie theaters and which movies are suitable for the user's current emotional state, and generates an optimal plan considering time performance. This plan is then sent back to the device.

[0115] Based on the information received on their device, users can decide which movie to watch and at which theater. This selection information and emotional data are fed back to the server to make future recommendations more accurate. This allows users to maximize not only their time but also their emotional satisfaction.

[0116] The following describes the processing flow.

[0117] Step 1:

[0118] The user uses their device and enters information about their desired activity (e.g., "I want to see a movie at 1pm") into the app. Simultaneously, the device's emotion engine recognizes the user's emotions through the camera and sensors.

[0119] Step 2:

[0120] The device sends user input information and sentiment data to the server. Detailed information such as location and time constraints are also transmitted at this time.

[0121] Step 3:

[0122] Based on the activity and sentiment data received by the server, it accesses relevant external databases and APIs to retrieve information such as the cinema's location, showtimes, seat availability, movie reviews, and the emotional characteristics of the film.

[0123] Step 4:

[0124] The server analyzes the collected information using evaluation tools and evaluates each option based on time performance and user sentiment. This evaluation considers factors such as movie selection that matches the sentiment, travel time, waiting time, and review ratings.

[0125] Step 5:

[0126] The server generates an optimal activity plan based on the evaluation results. This plan includes movies and cinemas that offer high time performance and match the user's emotional state.

[0127] Step 6:

[0128] The server sends the generated plan to the device. The user reviews and views the proposed plan on their device.

[0129] Step 7:

[0130] Users review the proposed plans and make the choice that best suits them. This selection information and emotional data are later used as feedback.

[0131] Step 8:

[0132] The device sends user selection information and emotional feedback to the server. This information is used by the server to improve the accuracy of future suggestions.

[0133] (Example 2)

[0134] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0135] In today's busy lifestyle, it is difficult to maximize personal time while selecting the optimal activity based on one's emotional state at any given moment. In particular, the lack of systems that can suggest activities based on emotions is a major obstacle for users in improving time management and emotional satisfaction.

[0136] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0137] In this invention, the server includes terminal means for receiving multiple activity information and emotion data, server means for accessing external information sources and collecting necessary information, evaluation means for evaluating time performance and emotional suitability based on the information, generation means including a generation AI model, and transmission means. This makes it possible for the user to be offered an activity plan optimized for their current emotional state and schedule.

[0138] A "terminal device" is a device that receives activity information and emotion data entered by the user and transmits it to the server.

[0139] A "server device" is a device that has the function of accessing external information sources and collecting necessary information based on activity information and sentiment data received from users.

[0140] The "evaluation method" refers to a function that evaluates time performance and emotional compatibility based on information collected by the server.

[0141] "Generation means" refers to components, including a generative AI model, used to generate the optimal activity plan based on evaluation results.

[0142] The "transmission method" is a function that sends the generated activity plan to the terminal and provides feedback on the user's selections.

[0143] A "generative AI model" is a model that uses artificial intelligence technology to generate the optimal activity plan from the results of an evaluation method.

[0144] This invention is a system in which a user inputs activity information and the system proposes an optimal activity plan based on their emotional state at that time. To achieve this, a terminal, server, evaluation means, a generation AI model, and transmission means are used.

[0145] The user first enters information about their desired activity through a terminal. This terminal is equipped with an emotion engine that can recognize emotional data in real time from the user's voice and facial expressions. This information is encrypted and transmitted to the server in a secure state.

[0146] The server accesses external information sources based on the received activity and sentiment data to collect necessary data. Through this, the server obtains information such as nearby event information, facility opening hours, weather data, and transportation status.

[0147] The evaluation method analyzes information collected by the server and assesses time performance and emotional suitability in accordance with the user's desired activities and emotional state. Based on this evaluation, a generative AI model generates the optimal activity plan. This generative AI model improves the accuracy of information processing by using prompts that are tailored to the user's emotional state. An example of a prompt is, "The user wants to relax. Please recommend the optimal holiday plan."

[0148] Finally, the generated activity plan is sent to the device via a transmission method for the user to review. The user can review the proposed plan on the device and select the activity that best suits them. This selection information is fed back to the server to help improve the accuracy of future suggestions.

[0149] This system allows users to select more appropriate and meaningful activities that align with their emotional state, enabling them to effectively manage their time in daily life.

[0150] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0151] Step 1:

[0152] The user uses a device to input information about their desired activity. This information includes details such as the type of activity and the preferred time slot. Furthermore, the device's built-in emotion engine analyzes the user's voice and facial expressions to recognize emotional data in real time. The resulting activity information and emotional data are then processed as the system's initial input.

[0153] Step 2:

[0154] The device sends collected activity information and emotion data to the server. Security is ensured by encrypting this data during transmission. Successful transmission allows the server to perform further data processing. Once data transmission is complete, the server is ready to begin analyzing the data.

[0155] Step 3:

[0156] The server accesses external information sources based on the received activity and sentiment data. Specific data processing involves, for example, using APIs to obtain information on currently running local events and transportation status. This external data is aggregated to form a primary dataset for the next evaluation step.

[0157] Step 4:

[0158] The server analyzes the data aggregated by the evaluation method. This data processing includes calculating time performance and evaluating the compatibility between user sentiment data and collected external data. The output of this evaluation serves as the base data for activity plans proposed to users.

[0159] Step 5:

[0160] The server uses a generative AI model to generate an optimal activity plan based on the evaluation results. This step utilizes prompts, such as "The user wants to relax. Please recommend an optimal holiday plan," which is expected to improve the accuracy of the AI ​​model. The final output is a specific activity plan tailored to the user.

[0161] Step 6:

[0162] The server sends the generated activity plan to the terminal. The terminal displays the received plan for the user to review. The user uses this plan to decide which activities to actually select. This user selection information is then fed back to the server, contributing to the accuracy of future suggestions.

[0163] (Application Example 2)

[0164] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0165] Modern consumers are required to choose the best products and services from a wide range of options, and time efficiency and consideration of individual emotions are crucial in this process. However, traditional methods have made it difficult to receive optimal suggestions that take into account an individual's current emotional state. As a result, choices that do not meet user expectations are sometimes made, leading to decreased satisfaction.

[0166] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0167] In this invention, the server includes an information processing device means for receiving multiple activity information, a computer means for accessing an external information storage device and collecting necessary information based on the activity information and emotion data, and an evaluation means for evaluating time efficiency and emotional state based on the collected information and emotion data. This makes it possible to propose an optimal and time-efficient activity plan tailored to the individual circumstances of the user, thereby improving user satisfaction.

[0168] An "information processing device" is a device that has the function of receiving various input data from a user and transmitting that data to a computer.

[0169] "Electronic computing means" refers to a computing device that performs analysis based on received data and has the function of accessing an external information storage device to obtain necessary information.

[0170] An "evaluation tool" is a device that analyzes acquired information and emotional data to assess the optimal activity plan, taking into account time efficiency and the user's emotional state.

[0171] A "supplying device" is a device that has the function of presenting the generated activity plan to the user and providing information to encourage them to make a choice.

[0172] "Emotional data" refers to information that quantifies a user's emotional state, and is provided individually based on the user's preferences and tastes.

[0173] An "activity plan" is a guideline designed to facilitate appropriate behavioral choices, taking into account the user's time efficiency and emotional state.

[0174] The system of the present invention is mainly composed of an information processing device, a computer, an evaluation device, and a supply device. This allows the user to receive an optimal activity plan that takes their emotional state into consideration.

[0175] Information processing devices include smart glasses and smartphones. These devices provide an interface for users to input desired activities and their current emotional state. In particular, to acquire emotional data, cameras and microphones are used to detect the user's facial expressions and voice tone, and an emotion engine is used to analyze the data.

[0176] The computer system utilizes a standard server device and accesses an external information storage device based on data sent from the information processing device. The external information storage device contains data such as information on nearby shops, product information, and service hours, which are retrieved in real time as needed.

[0177] The evaluation method analyzes time efficiency and the user's emotional state based on information and emotional data. For this, the emotional engine may utilize, for example, Microsoft® Azure® Face API, and Python libraries such as NumPy and Pandas may be used for analysis. Furthermore, a machine learning model is built using SciKit-Learn to provide optimal suggestions based on the user's emotional state and time efficiency.

[0178] The supply means presents the generated activity plan to the information processing device means. If smart glasses are used, recommended shopping routes and product information will be displayed on the screen.

[0179] For example, if a user is feeling down while shopping, the system will find items or specific shops that will cheer them up. By prompting the user with a question like, "What kind of products would help me feel better and enjoy shopping?", the system will provide appropriate suggestions.

[0180] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0181] Step 1:

[0182] The device starts up, and the user inputs activity information and emotional data. As an information processing device, smart glasses use an emotion engine to analyze facial expressions and voice tone from the camera and microphone, and generate emotional data. At this point, the input is the user's desired activity and emotional state, and the output is emotional data.

[0183] Step 2:

[0184] The device sends the activity information and emotion data it generates to the server. During this process, the data is securely transferred via HTTP communication. The input is the activity information and emotion data obtained in the previous step, and the output is the data packet sent to the server.

[0185] Step 3:

[0186] Based on the data received by the server, a computer system accesses an external information storage device to collect necessary information. Specifically, information such as nearby store information and product information is obtained via an API. The input is activity information and sentiment data, and the output is the acquired external data.

[0187] Step 4:

[0188] The server's evaluation method analyzes collected information and sentiment data. Here, data analysis is performed using Microsoft Azure's Face API, Python's NumPy, and Pandas, and a machine learning model using SciKit-Learn evaluates time efficiency and emotional state to generate an optimal action plan. The inputs are external data and sentiment data, and the outputs are the evaluation results and the optimal action plan.

[0189] Step 5:

[0190] The server sends the generated activity plan to the terminal. The terminal's supply mechanism displays it on the user's smart glasses, providing information to support the user's optimal shopping experience. The input is the optimal activity plan, and the output is the display on the terminal's screen.

[0191] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0192] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0193] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0194] [Second Embodiment]

[0195] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0196] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0197] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0198] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0199] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0200] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0201] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0202] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0203] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0204] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0205] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0206] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0207] This invention is a system that enables users to effectively utilize their time. The system begins with the user inputting desired activity information into a terminal. The terminal then transmits this information to a server. The server utilizes external databases and APIs to retrieve the necessary information in real time.

[0208] The server evaluates time performance using a dedicated evaluation tool based on the collected information. This evaluation takes into account factors such as waiting time, travel time, and service quality. Based on the evaluation results, the server generates an optimal activity plan and sends it to the terminal. Users can review the proposed plan and make the best choice to use their time as efficiently as possible.

[0209] As a concrete example, consider a case where a user wants to see a movie at a specific time. The user enters their request into a device. The device sends this information to a server. The server searches for information on nearby movie theaters and collects showtimes, seat availability, and review ratings for each theater. Based on this information, the server evaluates which theater and which movie would be the most efficient to see from a time-performance perspective. The optimal plan generated based on the evaluation results is sent to the user's device. The user can then decide which theater to choose based on the information received. This allows the user to avoid unnecessary waiting time and have a more fulfilling experience.

[0210] The following describes the processing flow.

[0211] Step 1:

[0212] The user uses their device and enters information about their desired activity (e.g., "I want to see a movie at 1pm") into the app.

[0213] Step 2:

[0214] The device sends the entered activity information to the server. Additional information, such as location and time constraints, is also sent at this time.

[0215] Step 3:

[0216] Based on the activity information received by the server, it accesses relevant external databases and APIs to retrieve the necessary information. This information includes movie theater locations, showtimes, reviews, and seat availability.

[0217] Step 4:

[0218] The server analyzes the collected information using evaluation tools and calculates the time performance of each option. The calculation takes into account factors such as travel time, waiting time, and review ratings.

[0219] Step 5:

[0220] The server generates an optimal activity plan based on the evaluation results. This plan includes movie theaters and time slots with high time-performance ratios.

[0221] Step 6:

[0222] The server generates a plan and sends it to the device. The user receives and views the proposed plan on their device.

[0223] Step 7:

[0224] The user reviews the proposed plan and makes the choice that best suits them. This choice will later be used as feedback.

[0225] Step 8:

[0226] The device feeds user selection information back to the server. This information is used to improve the accuracy of future suggestions.

[0227] (Example 1)

[0228] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0229] In modern society, it is a challenging task for users to effectively utilize their limited time and efficiently select activities that align with their objectives. In particular, selecting the optimal activity from multiple options requires a method for rapidly processing vast amounts of information and maximizing time efficiency. This invention aims to solve these problems and provide a method for optimizing users' time utilization.

[0230] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0231] In this invention, the server includes an information processing device means for receiving multiple activity information, a data collection device means for accessing external information sources and collecting necessary information, and an evaluation device means for evaluating time efficiency based on the collected information. This makes it possible to generate and provide users with an optimal activity plan for making the most effective use of their time.

[0232] An "information processing device" is a device that has the function of receiving activity information and selection information from a user and transmitting it to a server.

[0233] "Data collection device means" refers to a part of a server that has the function of accessing external information sources and collecting necessary data.

[0234] An "evaluation device" is a program that calculates time efficiency based on collected information and determines which activity is most effective.

[0235] "Plan generation device means" refers to a program or system that has the function of constructing an optimal activity plan based on evaluation results.

[0236] "Communication device means" refers to hardware or software that has the function of transmitting the activity plan generated by the server to an information processing device.

[0237] This invention is an information processing system designed to help users utilize their time more efficiently. In particular, it aims to propose the optimal activity from multiple options in response to user requests.

[0238] The user first enters activity information into a terminal. This terminal is an information processing device such as a computer or smartphone. The user's input is collected by the terminal and sent to the server. The terminal structures the data and sends it to the server in a standard data format, such as JSON.

[0239] The server accesses external information sources based on the received data and collects the necessary information. External APIs (Application Programming Interfaces) can be used for this process. For example, information about surrounding facilities can be obtained using the API of a map service that provides location information. Based on the information thus collected, the server performs calculations to evaluate time efficiency using an evaluation device. This evaluation takes into account factors such as waiting time and travel time.

[0240] Based on the evaluation results, the server uses a plan generation device to generate an optimal activity plan. This activity plan is structured with convenience and efficiency in mind, providing the user with the most beneficial options.

[0241] The generated activity plan is transmitted to the terminal via a communication device. The user can review the received information and select the most suitable activity from the suggested options.

[0242] As a concrete example, consider a scenario where a user wants to see a movie in their neighborhood at 3 PM. The user enters this information into a terminal, and the server collects information such as the schedules, seat availability, and review ratings of nearby movie theaters. Based on this information, the server evaluates which movie theater is the most efficient and suggests it to the user. This evaluation takes into account factors such as waiting time and travel time.

[0243] The following are specific examples of prompt statements for a generative AI model:

[0244] "The user wants to see a movie at 3:00 PM. Based on the specified geographical information, collect showtimes and seat availability for nearby movie theaters, and recommend the best theater considering waiting time and travel time."

[0245] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0246] Step 1:

[0247] The user inputs their activity preferences into an information processing device (terminal). For example, they might input, "I want to see a movie at 3 PM." The terminal reads this input, structures it in the required format (e.g., JSON), and prepares it as data to be used in the next processing step. The input is "activity preference information," and the output is "structured user activity information."

[0248] Step 2:

[0249] The terminal sends the user's activity requests to the server. This transmission takes place over the network, typically using the HTTP protocol. The server stores the received user activity information and prepares it for the next information collection step. The input is "structured user activity information," and the output is "received activity information."

[0250] Step 3:

[0251] The server accesses external information sources based on received activity information and collects the necessary relevant data. For example, it uses a movie theater API to obtain movie screenings, showtimes, and seat availability. The inputs are "received activity information" and "external API identifiers," and the output is "collected movie theater-related data."

[0252] Step 4:

[0253] The server evaluates time efficiency using collected movie theater-related data. A dedicated evaluation algorithm considers factors such as time, distance, and waiting time to calculate the most efficient option. The input is "collected movie theater-related data," and the output is "evaluated plan candidates."

[0254] Step 5:

[0255] The server generates the optimal action plan from the evaluated plan candidates. This plan includes the movie theater to choose, specific showtimes, estimated travel time, etc. The input is the "evaluated plan candidates," and the output is the "optimal action plan."

[0256] Step 6:

[0257] The server sends the optimal activity plan to the terminal. The terminal receives this plan and presents it visually to the user. The input is the "optimal activity plan," and the output is the "optimal activity plan displayed on the terminal."

[0258] Step 7:

[0259] The user can review the optimal activity plan displayed on the device and choose the option that best suits them from the suggested choices. This decision allows the user to use their time efficiently and achieve a fulfilling experience. The input is the "optimal activity plan displayed on the device," and the output is the "user's activity selection."

[0260] (Application Example 1)

[0261] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0262] Modern users want to minimize traffic congestion and wasted travel time, and manage their time optimally. However, current systems make it difficult to create efficient action plans based on real-time traffic conditions and the location of moving objects, resulting in wasted valuable time. To address these challenges, it is necessary to provide more efficient and precise planning.

[0263] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0264] In this invention, the server includes communication means for receiving multiple activity information; processing means for accessing external information sources and collecting necessary information based on the activity information; analysis means for evaluating time efficiency based on the collected information; planning means for generating an optimal action plan based on the evaluation results; transmission means for transmitting the generated action plan to a communication terminal; and adjustment means characterized in that the time efficiency takes into account traffic conditions and the location data of the moving object. This enables users to receive an efficient action plan in real time that minimizes traffic conditions and waiting times.

[0265] "Communication means" refers to devices and technologies for efficiently receiving multiple pieces of activity information.

[0266] "Processing means" refers to devices and technologies that access external information sources based on received activity information and collect necessary information.

[0267] "Analysis means" refers to devices and technologies used to evaluate time efficiency using collected information.

[0268] "Planning means" refers to devices and technologies for generating an optimal action plan based on the results of time efficiency evaluations.

[0269] "Means of transmission" refers to devices and technologies used to transmit the generated action plan to a communication terminal.

[0270] "Adjustment means" refers to devices or technologies that have the function of taking into account traffic conditions and the location data of moving objects when evaluating time efficiency.

[0271] This invention provides a system that enables users to efficiently utilize autonomous vehicles. The system receives activity information requested by the user via a smartphone using communication means. The received information is sent from the terminal to a server. The server uses processing means to collect data on current traffic conditions and the location of vehicles in real time from external information sources.

[0272] Next, the server utilizes analytical tools to evaluate time efficiency from the collected data. This evaluation includes traffic conditions, location data of moving objects, and waiting times. Based on the evaluation results, the planning tool generates an optimal action plan and transmits it to the user's communication terminal via a transmission tool.

[0273] As a concrete example, when a user uses an autonomous vehicle for shopping, they can receive a real-time action plan on their smartphone that reflects the optimal route, estimated travel time, and traffic conditions to their destination. This plan allows the user to act efficiently without wasting time. Furthermore, this system promotes effective use of time and improves user convenience.

[0274] An example of input to the generating AI model is a prompt such as, "Calculate the optimal route for an autonomous vehicle and generate a schedule and dispatch plan to reach the destination quickly, even in rainy weather."

[0275] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0276] Step 1:

[0277] The user inputs the desired activity information (e.g., destination, scheduled time) into the terminal through the smartphone application. The terminal transmits this input information to the server via the communication means. What is input is the user's desired information, and it is transmitted to the server as output.

[0278] Step 2:

[0279] Based on the received user activity information, the server accesses external information sources to obtain the latest traffic situation data and the position data of the self-driving vehicle. The input for this operation performed by the processing means is the user's desired information, and the traffic situation data and position data are collected as output. Operations are carried out to obtain data using traffic APIs and map services.

[0280] Step 3: [[ID=o13]]

[0281] The server uses analysis means to use the collected traffic situation data and position data for the evaluation of time efficiency. The input here is the data obtained in Step 2, and the output is the evaluation result indicating the optimal efficiency. Operations are implemented to perform analysis for shortening time and improving efficiency using data analysis algorithms.

[0282] Step 4:

[0283] The server uses planning means to generate an optimal action plan based on the evaluation result. The input is the evaluation result of Step 3, and the output is a specific action plan. Planning processing is carried out to determine the optimal route and time allocation.

[0284] Step 5:

[0285] The server transmits the generated action plan to the communication terminal. Using transmission means, the specific plan content is conveyed to the user. The input is the action plan of Step 4, and the output is the plan information displayed on the user terminal. The user can refer to the displayed information and receive operations for efficiently carrying out activities.

[0286] Furthermore, an emotion engine for estimating the user's emotion may be combined. That is, the specific processing unit 290 may estimate the user's emotion using the emotion specific model 59 and perform specific processing using the user's emotion.

[0287] The present invention is a system that enables a user to receive a proposal considering their own emotional state while effectively utilizing time. This system starts with the user inputting activity information they desire into the terminal. The terminal serves to transmit the input information to the server. At the same time, an emotion engine equipped in the terminal recognizes the user's emotion and transmits the emotion data to the server.

[0288] The server utilizes an external database or API to obtain necessary information in real time based on the user's activity information and emotion data. The collected information is analyzed by an evaluation means, and an optimal activity plan is generated based on the time performance and the user's emotion. The generated plan is transmitted to the terminal, and the user checks the proposed plan and makes an optimal choice.

[0289] As a specific example, consider the case where a user wishes to watch a movie at a specific time. The user inputs that wish into the terminal. The terminal recognizes through the emotion engine how the user is feeling (e.g., wants to relax, wants to boost energy). The terminal transmits that information to the server. The server evaluates information on nearby movie theaters and which movies are suitable for the user's emotion at that time, and generates an optimal plan considering the time performance. This plan is transmitted to the terminal.

[0290] Based on the information received on the terminal, the user can decide which movie to watch at which movie theater. This selection information and emotion data are fed back to the server to make subsequent proposals more accurate. As a result, the user can maximize not only time but also emotional satisfaction.

[0291] The processing flow will be described below.

[0292] Step 1:

[0293] The user uses their device and enters information about their desired activity (e.g., "I want to see a movie at 1pm") into the app. Simultaneously, the device's emotion engine recognizes the user's emotions through the camera and sensors.

[0294] Step 2:

[0295] The device sends user input information and sentiment data to the server. Detailed information such as location and time constraints are also transmitted at this time.

[0296] Step 3:

[0297] Based on the activity and sentiment data received by the server, it accesses relevant external databases and APIs to retrieve information such as the cinema's location, showtimes, seat availability, movie reviews, and the emotional characteristics of the film.

[0298] Step 4:

[0299] The server analyzes the collected information using evaluation tools and evaluates each option based on time performance and user sentiment. This evaluation considers factors such as movie selection that matches the sentiment, travel time, waiting time, and review ratings.

[0300] Step 5:

[0301] The server generates an optimal activity plan based on the evaluation results. This plan includes movies and cinemas that offer high time performance and match the user's emotional state.

[0302] Step 6:

[0303] The server sends the generated plan to the device. The user reviews and views the proposed plan on their device.

[0304] Step 7:

[0305] The user checks the proposed plan and makes the most suitable choice for themselves. This selection information and emotional data will be utilized as feedback later.

[0306] Step 8:

[0307] The terminal sends the user's selection information and emotional feedback to the server. This information is utilized by the server to improve the accuracy of the next proposal.

[0308] (Example 2)

[0309] Next, Example 2 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal".

[0310] In modern busy lives, it is difficult to maximize personal time while choosing the optimal activities according to the emotional state at that time. In particular, the absence of a system that can propose activities based on emotions is a major obstacle for users to improve time management and emotional satisfaction.

[0311] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0312] In this invention, the server includes terminal means for receiving a plurality of activity information and emotional data, server means for accessing an external information source and collecting necessary information, evaluation means for evaluating time performance and emotional suitability based on the information, generation means including a generation AI model, and transmission means. Thereby, it becomes possible for the user to be proposed an activity plan optimized for the emotional state and schedule at that time.

[0313] The "terminal means" is a device for receiving activity information and emotional data input from the user and transmitting them to the server.

[0314] A "server device" is a device that has the function of accessing external information sources and collecting necessary information based on activity information and sentiment data received from users.

[0315] The "evaluation method" refers to a function that evaluates time performance and emotional compatibility based on information collected by the server.

[0316] "Generation means" refers to components, including a generative AI model, used to generate the optimal activity plan based on evaluation results.

[0317] The "transmission method" is a function that sends the generated activity plan to the terminal and provides feedback on the user's selections.

[0318] A "generative AI model" is a model that uses artificial intelligence technology to generate the optimal activity plan from the results of an evaluation method.

[0319] This invention is a system in which a user inputs activity information and the system proposes an optimal activity plan based on their emotional state at that time. To achieve this, a terminal, server, evaluation means, a generation AI model, and transmission means are used.

[0320] The user first enters information about their desired activity through a terminal. This terminal is equipped with an emotion engine that can recognize emotional data in real time from the user's voice and facial expressions. This information is encrypted and transmitted to the server in a secure state.

[0321] The server accesses external information sources based on the received activity and sentiment data to collect necessary data. Through this, the server obtains information such as nearby event information, facility opening hours, weather data, and transportation status.

[0322] The evaluation method analyzes information collected by the server and assesses time performance and emotional suitability in accordance with the user's desired activities and emotional state. Based on this evaluation, a generative AI model generates the optimal activity plan. This generative AI model improves the accuracy of information processing by using prompts that are tailored to the user's emotional state. An example of a prompt is, "The user wants to relax. Please recommend the optimal holiday plan."

[0323] Finally, the generated activity plan is sent to the device via a transmission method for the user to review. The user can review the proposed plan on the device and select the activity that best suits them. This selection information is fed back to the server to help improve the accuracy of future suggestions.

[0324] This system allows users to select more appropriate and meaningful activities that align with their emotional state, enabling them to effectively manage their time in daily life.

[0325] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0326] Step 1:

[0327] The user uses a device to input information about their desired activity. This information includes details such as the type of activity and the preferred time slot. Furthermore, the device's built-in emotion engine analyzes the user's voice and facial expressions to recognize emotional data in real time. The resulting activity information and emotional data are then processed as the system's initial input.

[0328] Step 2:

[0329] The device sends collected activity information and emotion data to the server. Security is ensured by encrypting this data during transmission. Successful transmission allows the server to perform further data processing. Once data transmission is complete, the server is ready to begin analyzing the data.

[0330] Step 3:

[0331] The server accesses external information sources based on the received activity and sentiment data. Specific data processing involves, for example, using APIs to obtain information on currently running local events and transportation status. This external data is aggregated to form a primary dataset for the next evaluation step.

[0332] Step 4:

[0333] The server analyzes the data aggregated by the evaluation method. This data processing includes calculating time performance and evaluating the compatibility between user sentiment data and collected external data. The output of this evaluation serves as the base data for activity plans proposed to users.

[0334] Step 5:

[0335] The server uses a generative AI model to generate an optimal activity plan based on the evaluation results. This step utilizes prompts, such as "The user wants to relax. Please recommend an optimal holiday plan," which is expected to improve the accuracy of the AI ​​model. The final output is a specific activity plan tailored to the user.

[0336] Step 6:

[0337] The server sends the generated activity plan to the terminal. The terminal displays the received plan for the user to review. The user uses this plan to decide which activities to actually select. This user selection information is then fed back to the server, contributing to the accuracy of future suggestions.

[0338] (Application Example 2)

[0339] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0340] Modern consumers are required to choose the best products and services from a wide range of options, and time efficiency and consideration of individual emotions are crucial in this process. However, traditional methods have made it difficult to receive optimal suggestions that take into account an individual's current emotional state. As a result, choices that do not meet user expectations are sometimes made, leading to decreased satisfaction.

[0341] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0342] In this invention, the server includes an information processing device means for receiving multiple activity information, a computer means for accessing an external information storage device and collecting necessary information based on the activity information and emotion data, and an evaluation means for evaluating time efficiency and emotional state based on the collected information and emotion data. This makes it possible to propose an optimal and time-efficient activity plan tailored to the individual circumstances of the user, thereby improving user satisfaction.

[0343] An "information processing device" is a device that has the function of receiving various input data from a user and transmitting that data to a computer.

[0344] "Electronic computing means" refers to a computing device that performs analysis based on received data and has the function of accessing an external information storage device to obtain necessary information.

[0345] An "evaluation tool" is a device that analyzes acquired information and emotional data to assess the optimal activity plan, taking into account time efficiency and the user's emotional state.

[0346] A "supplying device" is a device that has the function of presenting the generated activity plan to the user and providing information to encourage them to make a choice.

[0347] "Emotional data" refers to information that quantifies a user's emotional state, and is provided individually based on the user's preferences and tastes.

[0348] An "activity plan" is a guideline designed to facilitate appropriate behavioral choices, taking into account the user's time efficiency and emotional state.

[0349] The system of the present invention is mainly composed of an information processing device, a computer, an evaluation device, and a supply device. This allows the user to receive an optimal activity plan that takes their emotional state into consideration.

[0350] Information processing devices include smart glasses and smartphones. These devices provide an interface for users to input desired activities and their current emotional state. In particular, to acquire emotional data, cameras and microphones are used to detect the user's facial expressions and voice tone, and an emotion engine is used to analyze the data.

[0351] The computer system utilizes a standard server device and accesses an external information storage device based on data sent from the information processing device. The external information storage device contains data such as information on nearby shops, product information, and service hours, which are retrieved in real time as needed.

[0352] The evaluation method analyzes time efficiency and the user's emotional state based on information and emotional data. For this, the emotional engine may utilize, for example, Microsoft Azure's Face API, and Python libraries such as NumPy and Pandas may be used for analysis. Furthermore, a machine learning model is built using SciKit-Learn to provide optimal suggestions based on the user's emotional state and time efficiency.

[0353] The supply means presents the generated activity plan to the information processing device means. If smart glasses are used, recommended shopping routes and product information will be displayed on the screen.

[0354] For example, if a user is feeling down while shopping, the system will find items or specific shops that will cheer them up. By prompting the user with a question like, "What kind of products would help me feel better and enjoy shopping?", the system will provide appropriate suggestions.

[0355] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0356] Step 1:

[0357] The device starts up, and the user inputs activity information and emotional data. As an information processing device, smart glasses use an emotion engine to analyze facial expressions and voice tone from the camera and microphone, and generate emotional data. At this point, the input is the user's desired activity and emotional state, and the output is emotional data.

[0358] Step 2:

[0359] The device sends the activity information and emotion data it generates to the server. During this process, the data is securely transferred via HTTP communication. The input is the activity information and emotion data obtained in the previous step, and the output is the data packet sent to the server.

[0360] Step 3:

[0361] Based on the data received by the server, a computer system accesses an external information storage device to collect necessary information. Specifically, information such as nearby store information and product information is obtained via an API. The input is activity information and sentiment data, and the output is the acquired external data.

[0362] Step 4:

[0363] The server's evaluation method analyzes collected information and sentiment data. Here, data analysis is performed using Microsoft Azure's Face API, Python's NumPy, and Pandas, and a machine learning model using SciKit-Learn evaluates time efficiency and emotional state to generate an optimal action plan. The inputs are external data and sentiment data, and the outputs are the evaluation results and the optimal action plan.

[0364] Step 5:

[0365] The server sends the generated activity plan to the terminal. The terminal's supply mechanism displays it on the user's smart glasses, providing information to support the user's optimal shopping experience. The input is the optimal activity plan, and the output is the display on the terminal's screen.

[0366] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0367] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0368] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0369] [Third Embodiment]

[0370] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0371] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0372] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0373] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0374] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0375] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0376] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0377] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0378] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0379] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0380] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0381] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0382] This invention is a system that enables users to effectively utilize their time. The system begins with the user inputting desired activity information into a terminal. The terminal then transmits this information to a server. The server utilizes external databases and APIs to retrieve the necessary information in real time.

[0383] The server evaluates time performance using a dedicated evaluation tool based on the collected information. This evaluation takes into account factors such as waiting time, travel time, and service quality. Based on the evaluation results, the server generates an optimal activity plan and sends it to the terminal. Users can review the proposed plan and make the best choice to use their time as efficiently as possible.

[0384] As a concrete example, consider a case where a user wants to see a movie at a specific time. The user enters their request into a device. The device sends this information to a server. The server searches for information on nearby movie theaters and collects showtimes, seat availability, and review ratings for each theater. Based on this information, the server evaluates which theater and which movie would be the most efficient to see from a time-performance perspective. The optimal plan generated based on the evaluation results is sent to the user's device. The user can then decide which theater to choose based on the information received. This allows the user to avoid unnecessary waiting time and have a more fulfilling experience.

[0385] The following describes the processing flow.

[0386] Step 1:

[0387] The user uses their device and enters information about their desired activity (e.g., "I want to see a movie at 1pm") into the app.

[0388] Step 2:

[0389] The device sends the entered activity information to the server. Additional information, such as location and time constraints, is also sent at this time.

[0390] Step 3:

[0391] Based on the activity information received by the server, it accesses relevant external databases and APIs to retrieve the necessary information. This information includes movie theater locations, showtimes, reviews, and seat availability.

[0392] Step 4:

[0393] The server analyzes the collected information using evaluation tools and calculates the time performance of each option. The calculation takes into account factors such as travel time, waiting time, and review ratings.

[0394] Step 5:

[0395] The server generates an optimal activity plan based on the evaluation results. This plan includes movie theaters and time slots with high time-performance ratios.

[0396] Step 6:

[0397] The server generates a plan and sends it to the device. The user receives and views the proposed plan on their device.

[0398] Step 7:

[0399] The user reviews the proposed plan and makes the choice that best suits them. This choice will later be used as feedback.

[0400] Step 8:

[0401] The device feeds user selection information back to the server. This information is used to improve the accuracy of future suggestions.

[0402] (Example 1)

[0403] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0404] In modern society, it is a challenging task for users to effectively utilize their limited time and efficiently select activities that align with their objectives. In particular, selecting the optimal activity from multiple options requires a method for rapidly processing vast amounts of information and maximizing time efficiency. This invention aims to solve these problems and provide a method for optimizing users' time utilization.

[0405] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0406] In this invention, the server includes an information processing device means for receiving multiple activity information, a data collection device means for accessing external information sources and collecting necessary information, and an evaluation device means for evaluating time efficiency based on the collected information. This makes it possible to generate and provide users with an optimal activity plan for making the most effective use of their time.

[0407] An "information processing device" is a device that has the function of receiving activity information and selection information from a user and transmitting it to a server.

[0408] "Data collection device means" refers to a part of a server that has the function of accessing external information sources and collecting necessary data.

[0409] An "evaluation device" is a program that calculates time efficiency based on collected information and determines which activity is most effective.

[0410] "Plan generation device means" refers to a program or system that has the function of constructing an optimal activity plan based on evaluation results.

[0411] "Communication device means" refers to hardware or software that has the function of transmitting the activity plan generated by the server to an information processing device.

[0412] This invention is an information processing system designed to help users utilize their time more efficiently. In particular, it aims to propose the optimal activity from multiple options in response to user requests.

[0413] The user first enters activity information into a terminal. This terminal is an information processing device such as a computer or smartphone. The user's input is collected by the terminal and sent to the server. The terminal structures the data and sends it to the server in a standard data format, such as JSON.

[0414] The server accesses external information sources based on the received data and collects the necessary information. External APIs (Application Programming Interfaces) can be used for this process. For example, information about surrounding facilities can be obtained using the API of a map service that provides location information. Based on the information thus collected, the server performs calculations to evaluate time efficiency using an evaluation device. This evaluation takes into account factors such as waiting time and travel time.

[0415] Based on the evaluation results, the server uses a plan generation device to generate an optimal activity plan. This activity plan is structured with convenience and efficiency in mind, providing the user with the most beneficial options.

[0416] The generated activity plan is transmitted to the terminal via a communication device. The user can review the received information and select the most suitable activity from the suggested options.

[0417] As a concrete example, consider a scenario where a user wants to see a movie in their neighborhood at 3 PM. The user enters this information into a terminal, and the server collects information such as the schedules, seat availability, and review ratings of nearby movie theaters. Based on this information, the server evaluates which movie theater is the most efficient and suggests it to the user. This evaluation takes into account factors such as waiting time and travel time.

[0418] The following are specific examples of prompt statements for a generative AI model:

[0419] "The user wants to see a movie at 3:00 PM. Based on the specified geographical information, collect showtimes and seat availability for nearby movie theaters, and recommend the best theater considering waiting time and travel time."

[0420] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0421] Step 1:

[0422] The user inputs their activity preferences into an information processing device (terminal). For example, they might input, "I want to see a movie at 3 PM." The terminal reads this input, structures it in the required format (e.g., JSON), and prepares it as data to be used in the next processing step. The input is "activity preference information," and the output is "structured user activity information."

[0423] Step 2:

[0424] The terminal sends the user's activity requests to the server. This transmission takes place over the network, typically using the HTTP protocol. The server stores the received user activity information and prepares it for the next information collection step. The input is "structured user activity information," and the output is "received activity information."

[0425] Step 3:

[0426] The server accesses external information sources based on received activity information and collects the necessary relevant data. For example, it uses a movie theater API to obtain movie screenings, showtimes, and seat availability. The inputs are "received activity information" and "external API identifiers," and the output is "collected movie theater-related data."

[0427] Step 4:

[0428] The server evaluates time efficiency using collected movie theater-related data. A dedicated evaluation algorithm considers factors such as time, distance, and waiting time to calculate the most efficient option. The input is "collected movie theater-related data," and the output is "evaluated plan candidates."

[0429] Step 5:

[0430] The server generates the optimal action plan from the evaluated plan candidates. This plan includes the movie theater to choose, specific showtimes, estimated travel time, etc. The input is the "evaluated plan candidates," and the output is the "optimal action plan."

[0431] Step 6:

[0432] The server sends the optimal activity plan to the terminal. The terminal receives this plan and presents it visually to the user. The input is the "optimal activity plan," and the output is the "optimal activity plan displayed on the terminal."

[0433] Step 7:

[0434] The user can review the optimal activity plan displayed on the device and choose the option that best suits them from the suggested choices. This decision allows the user to use their time efficiently and achieve a fulfilling experience. The input is the "optimal activity plan displayed on the device," and the output is the "user's activity selection."

[0435] (Application Example 1)

[0436] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0437] Modern users want to minimize traffic congestion and wasted travel time, and manage their time optimally. However, current systems make it difficult to create efficient action plans based on real-time traffic conditions and the location of moving objects, resulting in wasted valuable time. To address these challenges, it is necessary to provide more efficient and precise planning.

[0438] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0439] In this invention, the server includes communication means for receiving multiple activity information; processing means for accessing external information sources and collecting necessary information based on the activity information; analysis means for evaluating time efficiency based on the collected information; planning means for generating an optimal action plan based on the evaluation results; transmission means for transmitting the generated action plan to a communication terminal; and adjustment means characterized in that the time efficiency takes into account traffic conditions and the location data of the moving object. This enables users to receive an efficient action plan in real time that minimizes traffic conditions and waiting times.

[0440] "Communication means" refers to devices and technologies for efficiently receiving multiple pieces of activity information.

[0441] "Processing means" refers to devices and technologies that access external information sources based on received activity information and collect necessary information.

[0442] "Analysis means" refers to devices and technologies used to evaluate time efficiency using collected information.

[0443] "Planning means" refers to devices and technologies for generating an optimal action plan based on the results of time efficiency evaluations.

[0444] "Means of transmission" refers to devices and technologies used to transmit the generated action plan to a communication terminal.

[0445] "Adjustment means" refers to devices or technologies that have the function of taking into account traffic conditions and the location data of moving objects when evaluating time efficiency.

[0446] This invention provides a system that enables users to efficiently utilize autonomous vehicles. The system receives activity information requested by the user via a smartphone using communication means. The received information is sent from the terminal to a server. The server uses processing means to collect data on current traffic conditions and the location of vehicles in real time from external information sources.

[0447] Next, the server utilizes analytical tools to evaluate time efficiency from the collected data. This evaluation includes traffic conditions, location data of moving objects, and waiting times. Based on the evaluation results, the planning tool generates an optimal action plan and transmits it to the user's communication terminal via a transmission tool.

[0448] As a concrete example, when a user uses an autonomous vehicle for shopping, they can receive a real-time action plan on their smartphone that reflects the optimal route, estimated travel time, and traffic conditions to their destination. This plan allows the user to act efficiently without wasting time. Furthermore, this system promotes effective use of time and improves user convenience.

[0449] An example of input to the generating AI model is a prompt such as, "Calculate the optimal route for an autonomous vehicle and generate a schedule and dispatch plan to reach the destination quickly, even in rainy weather."

[0450] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0451] Step 1:

[0452] The user enters desired activity information (e.g., destination, planned time) into the device via a smartphone application. The device then transmits this input information to the server via a communication method. The input consists of the user's desired information and is sent to the server as output.

[0453] Step 2:

[0454] Based on the user activity information received, the server accesses external information sources to obtain the latest traffic data and autonomous vehicle location data. The input for this process is the user's requested information, and the output is the collection of traffic data and location data. The system utilizes traffic APIs and map services to acquire this data.

[0455] Step 3:

[0456] The server uses analytical tools to evaluate time efficiency by using the collected traffic and location data. The input here is the data obtained in step 2, and the output is the evaluation result showing the optimal efficiency. A data analysis algorithm is used to perform analysis for time reduction and efficiency improvements.

[0457] Step 4:

[0458] The server uses planning tools to generate an optimal action plan based on the evaluation results. The input is the evaluation results from step 3, and the output is the specific action plan. Planning processing is performed to determine the optimal route and time allocation.

[0459] Step 5:

[0460] The server transmits the generated action plan to the communication terminal. Using a communication method, it conveys the specific details of the plan to the user. The input is the action plan from step 4, and the output is the plan information displayed on the user's terminal. The user can refer to the displayed information and receive instructions for efficiently carrying out their activities.

[0461] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0462] This invention provides a system that allows users to effectively utilize their time while receiving suggestions that take their emotional state into consideration. The system begins with the user inputting desired activity information into a terminal. The terminal then transmits this information to a server. Simultaneously, an emotion engine within the terminal recognizes the user's emotions and transmits that emotion data to the server.

[0463] The server uses external databases and APIs to acquire necessary information in real time based on user activity and sentiment data. The collected information is analyzed using evaluation tools, and an optimal activity plan is generated based on time performance and user sentiment. The generated plan is sent to the terminal, where the user reviews the proposed plan and makes the best choice.

[0464] As a concrete example, consider a scenario where a user wants to watch a movie at a specific time. The user inputs this request into the device. The device, through its emotion engine, recognizes the user's current emotional state (e.g., want to relax, want to feel energized). The device sends this information to a server. The server evaluates information about nearby movie theaters and which movies are suitable for the user's current emotional state, and generates an optimal plan considering time performance. This plan is then sent back to the device.

[0465] Based on the information received on their device, users can decide which movie to watch and at which theater. This selection information and emotional data are fed back to the server to make future recommendations more accurate. This allows users to maximize not only their time but also their emotional satisfaction.

[0466] The following describes the processing flow.

[0467] Step 1:

[0468] The user uses their device and enters information about their desired activity (e.g., "I want to see a movie at 1pm") into the app. Simultaneously, the device's emotion engine recognizes the user's emotions through the camera and sensors.

[0469] Step 2:

[0470] The device sends user input information and sentiment data to the server. Detailed information such as location and time constraints are also transmitted at this time.

[0471] Step 3:

[0472] Based on the activity and sentiment data received by the server, it accesses relevant external databases and APIs to retrieve information such as the cinema's location, showtimes, seat availability, movie reviews, and the emotional characteristics of the film.

[0473] Step 4:

[0474] The server analyzes the collected information using evaluation tools and evaluates each option based on time performance and user sentiment. This evaluation considers factors such as movie selection that matches the sentiment, travel time, waiting time, and review ratings.

[0475] Step 5:

[0476] The server generates an optimal activity plan based on the evaluation results. This plan includes movies and cinemas that offer high time performance and match the user's emotional state.

[0477] Step 6:

[0478] The server sends the generated plan to the device. The user reviews and views the proposed plan on their device.

[0479] Step 7:

[0480] Users review the proposed plans and make the choice that best suits them. This selection information and emotional data are later used as feedback.

[0481] Step 8:

[0482] The device sends user selection information and emotional feedback to the server. This information is used by the server to improve the accuracy of future suggestions.

[0483] (Example 2)

[0484] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0485] In today's busy lifestyle, it is difficult to maximize personal time while selecting the optimal activity based on one's emotional state at any given moment. In particular, the lack of systems that can suggest activities based on emotions is a major obstacle for users in improving time management and emotional satisfaction.

[0486] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0487] In this invention, the server includes terminal means for receiving multiple activity information and emotion data, server means for accessing external information sources and collecting necessary information, evaluation means for evaluating time performance and emotional suitability based on the information, generation means including a generation AI model, and transmission means. This makes it possible for the user to be offered an activity plan optimized for their current emotional state and schedule.

[0488] A "terminal device" is a device that receives activity information and emotion data entered by the user and transmits it to the server.

[0489] A "server device" is a device that has the function of accessing external information sources and collecting necessary information based on activity information and sentiment data received from users.

[0490] The "evaluation method" refers to a function that evaluates time performance and emotional compatibility based on information collected by the server.

[0491] "Generation means" refers to components, including a generative AI model, used to generate the optimal activity plan based on evaluation results.

[0492] The "transmission method" is a function that sends the generated activity plan to the terminal and provides feedback on the user's selections.

[0493] A "generative AI model" is a model that uses artificial intelligence technology to generate the optimal activity plan from the results of an evaluation method.

[0494] This invention is a system in which a user inputs activity information and the system proposes an optimal activity plan based on their emotional state at that time. To achieve this, a terminal, server, evaluation means, a generation AI model, and transmission means are used.

[0495] The user first enters information about their desired activity through a terminal. This terminal is equipped with an emotion engine that can recognize emotional data in real time from the user's voice and facial expressions. This information is encrypted and transmitted to the server in a secure state.

[0496] The server accesses external information sources based on the received activity and sentiment data to collect necessary data. Through this, the server obtains information such as nearby event information, facility opening hours, weather data, and transportation status.

[0497] The evaluation method analyzes information collected by the server and assesses time performance and emotional suitability in accordance with the user's desired activities and emotional state. Based on this evaluation, a generative AI model generates the optimal activity plan. This generative AI model improves the accuracy of information processing by using prompts that are tailored to the user's emotional state. An example of a prompt is, "The user wants to relax. Please recommend the optimal holiday plan."

[0498] Finally, the generated activity plan is sent to the device via a transmission method for the user to review. The user can review the proposed plan on the device and select the activity that best suits them. This selection information is fed back to the server to help improve the accuracy of future suggestions.

[0499] This system allows users to select more appropriate and meaningful activities that align with their emotional state, enabling them to effectively manage their time in daily life.

[0500] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0501] Step 1:

[0502] The user uses a device to input information about their desired activity. This information includes details such as the type of activity and the preferred time slot. Furthermore, the device's built-in emotion engine analyzes the user's voice and facial expressions to recognize emotional data in real time. The resulting activity information and emotional data are then processed as the system's initial input.

[0503] Step 2:

[0504] The device sends collected activity information and emotion data to the server. Security is ensured by encrypting this data during transmission. Successful transmission allows the server to perform further data processing. Once data transmission is complete, the server is ready to begin analyzing the data.

[0505] Step 3:

[0506] The server accesses external information sources based on the received activity and sentiment data. Specific data processing involves, for example, using APIs to obtain information on currently running local events and transportation status. This external data is aggregated to form a primary dataset for the next evaluation step.

[0507] Step 4:

[0508] The server analyzes the data aggregated by the evaluation method. This data processing includes calculating time performance and evaluating the compatibility between user sentiment data and collected external data. The output of this evaluation serves as the base data for activity plans proposed to users.

[0509] Step 5:

[0510] The server uses a generative AI model to generate an optimal activity plan based on the evaluation results. This step utilizes prompts, such as "The user wants to relax. Please recommend an optimal holiday plan," which is expected to improve the accuracy of the AI ​​model. The final output is a specific activity plan tailored to the user.

[0511] Step 6:

[0512] The server sends the generated activity plan to the terminal. The terminal displays the received plan for the user to review. The user uses this plan to decide which activities to actually select. This user selection information is then fed back to the server, contributing to the accuracy of future suggestions.

[0513] (Application Example 2)

[0514] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0515] Modern consumers are required to choose the best products and services from a wide range of options, and time efficiency and consideration of individual emotions are crucial in this process. However, traditional methods have made it difficult to receive optimal suggestions that take into account an individual's current emotional state. As a result, choices that do not meet user expectations are sometimes made, leading to decreased satisfaction.

[0516] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0517] In this invention, the server includes an information processing device means for receiving multiple activity information, a computer means for accessing an external information storage device and collecting necessary information based on the activity information and emotion data, and an evaluation means for evaluating time efficiency and emotional state based on the collected information and emotion data. This makes it possible to propose an optimal and time-efficient activity plan tailored to the individual circumstances of the user, thereby improving user satisfaction.

[0518] An "information processing device" is a device that has the function of receiving various input data from a user and transmitting that data to a computer.

[0519] "Electronic computing means" refers to a computing device that performs analysis based on received data and has the function of accessing an external information storage device to obtain necessary information.

[0520] An "evaluation tool" is a device that analyzes acquired information and emotional data to assess the optimal activity plan, taking into account time efficiency and the user's emotional state.

[0521] A "supplying device" is a device that has the function of presenting the generated activity plan to the user and providing information to encourage them to make a choice.

[0522] "Emotional data" refers to information that quantifies a user's emotional state, and is provided individually based on the user's preferences and tastes.

[0523] An "activity plan" is a guideline designed to facilitate appropriate behavioral choices, taking into account the user's time efficiency and emotional state.

[0524] The system of the present invention is mainly composed of an information processing device, a computer, an evaluation device, and a supply device. This allows the user to receive an optimal activity plan that takes their emotional state into consideration.

[0525] Information processing devices include smart glasses and smartphones. These devices provide an interface for users to input desired activities and their current emotional state. In particular, to acquire emotional data, cameras and microphones are used to detect the user's facial expressions and voice tone, and an emotion engine is used to analyze the data.

[0526] The computer system utilizes a standard server device and accesses an external information storage device based on data sent from the information processing device. The external information storage device contains data such as information on nearby shops, product information, and service hours, which are retrieved in real time as needed.

[0527] The evaluation method analyzes time efficiency and the user's emotional state based on information and emotional data. For this, the emotional engine may utilize, for example, Microsoft Azure's Face API, and Python libraries such as NumPy and Pandas may be used for analysis. Furthermore, a machine learning model is built using SciKit-Learn to provide optimal suggestions based on the user's emotional state and time efficiency.

[0528] The supply means presents the generated activity plan to the information processing device means. If smart glasses are used, recommended shopping routes and product information will be displayed on the screen.

[0529] For example, if a user is feeling down while shopping, the system will find items or specific shops that will cheer them up. By prompting the user with a question like, "What kind of products would help me feel better and enjoy shopping?", the system will provide appropriate suggestions.

[0530] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0531] Step 1:

[0532] The device starts up, and the user inputs activity information and emotional data. As an information processing device, smart glasses use an emotion engine to analyze facial expressions and voice tone from the camera and microphone, and generate emotional data. At this point, the input is the user's desired activity and emotional state, and the output is emotional data.

[0533] Step 2:

[0534] The device sends the activity information and emotion data it generates to the server. During this process, the data is securely transferred via HTTP communication. The input is the activity information and emotion data obtained in the previous step, and the output is the data packet sent to the server.

[0535] Step 3:

[0536] Based on the data received by the server, a computer system accesses an external information storage device to collect necessary information. Specifically, information such as nearby store information and product information is obtained via an API. The input is activity information and sentiment data, and the output is the acquired external data.

[0537] Step 4:

[0538] The server's evaluation method analyzes collected information and sentiment data. Here, data analysis is performed using Microsoft Azure's Face API, Python's NumPy, and Pandas, and a machine learning model using SciKit-Learn evaluates time efficiency and emotional state to generate an optimal action plan. The inputs are external data and sentiment data, and the outputs are the evaluation results and the optimal action plan.

[0539] Step 5:

[0540] The server sends the generated activity plan to the terminal. The terminal's supply mechanism displays it on the user's smart glasses, providing information to support the user's optimal shopping experience. The input is the optimal activity plan, and the output is the display on the terminal's screen.

[0541] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0542] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0543] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0544] [Fourth Embodiment]

[0545] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0546] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0547] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0548] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0549] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0550] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0551] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0552] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0553] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0554] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0555] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0556] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0557] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0558] This invention is a system that enables users to effectively utilize their time. The system begins with the user inputting desired activity information into a terminal. The terminal then transmits this information to a server. The server utilizes external databases and APIs to retrieve the necessary information in real time.

[0559] The server evaluates time performance using a dedicated evaluation tool based on the collected information. This evaluation takes into account factors such as waiting time, travel time, and service quality. Based on the evaluation results, the server generates an optimal activity plan and sends it to the terminal. Users can review the proposed plan and make the best choice to use their time as efficiently as possible.

[0560] As a concrete example, consider a case where a user wants to see a movie at a specific time. The user enters their request into a device. The device sends this information to a server. The server searches for information on nearby movie theaters and collects showtimes, seat availability, and review ratings for each theater. Based on this information, the server evaluates which theater and which movie would be the most efficient to see from a time-performance perspective. The optimal plan generated based on the evaluation results is sent to the user's device. The user can then decide which theater to choose based on the information received. This allows the user to avoid unnecessary waiting time and have a more fulfilling experience.

[0561] The following describes the processing flow.

[0562] Step 1:

[0563] The user uses their device and enters information about their desired activity (e.g., "I want to see a movie at 1pm") into the app.

[0564] Step 2:

[0565] The device sends the entered activity information to the server. Additional information, such as location and time constraints, is also sent at this time.

[0566] Step 3:

[0567] Based on the activity information received by the server, it accesses relevant external databases and APIs to retrieve the necessary information. This information includes movie theater locations, showtimes, reviews, and seat availability.

[0568] Step 4:

[0569] The server analyzes the collected information using evaluation tools and calculates the time performance of each option. The calculation takes into account factors such as travel time, waiting time, and review ratings.

[0570] Step 5:

[0571] The server generates an optimal activity plan based on the evaluation results. This plan includes movie theaters and time slots with high time-performance ratios.

[0572] Step 6:

[0573] The server generates a plan and sends it to the device. The user receives and views the proposed plan on their device.

[0574] Step 7:

[0575] The user reviews the proposed plan and makes the choice that best suits them. This choice will later be used as feedback.

[0576] Step 8:

[0577] The device feeds user selection information back to the server. This information is used to improve the accuracy of future suggestions.

[0578] (Example 1)

[0579] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0580] In modern society, it is a challenging task for users to effectively utilize their limited time and efficiently select activities that align with their objectives. In particular, selecting the optimal activity from multiple options requires a method for rapidly processing vast amounts of information and maximizing time efficiency. This invention aims to solve these problems and provide a method for optimizing users' time utilization.

[0581] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0582] In this invention, the server includes an information processing device means for receiving multiple activity information, a data collection device means for accessing external information sources and collecting necessary information, and an evaluation device means for evaluating time efficiency based on the collected information. This makes it possible to generate and provide users with an optimal activity plan for making the most effective use of their time.

[0583] An "information processing device" is a device that has the function of receiving activity information and selection information from a user and transmitting it to a server.

[0584] "Data collection device means" refers to a part of a server that has the function of accessing external information sources and collecting necessary data.

[0585] An "evaluation device" is a program that calculates time efficiency based on collected information and determines which activity is most effective.

[0586] "Plan generation device means" refers to a program or system that has the function of constructing an optimal activity plan based on evaluation results.

[0587] "Communication device means" refers to hardware or software that has the function of transmitting the activity plan generated by the server to an information processing device.

[0588] This invention is an information processing system designed to help users utilize their time more efficiently. In particular, it aims to propose the optimal activity from multiple options in response to user requests.

[0589] The user first enters activity information into a terminal. This terminal is an information processing device such as a computer or smartphone. The user's input is collected by the terminal and sent to the server. The terminal structures the data and sends it to the server in a standard data format, such as JSON.

[0590] The server accesses external information sources based on the received data and collects the necessary information. External APIs (Application Programming Interfaces) can be used for this process. For example, information about surrounding facilities can be obtained using the API of a map service that provides location information. Based on the information thus collected, the server performs calculations to evaluate time efficiency using an evaluation device. This evaluation takes into account factors such as waiting time and travel time.

[0591] Based on the evaluation results, the server uses a plan generation device to generate an optimal activity plan. This activity plan is structured with convenience and efficiency in mind, providing the user with the most beneficial options.

[0592] The generated activity plan is transmitted to the terminal via a communication device. The user can review the received information and select the most suitable activity from the suggested options.

[0593] As a concrete example, consider a scenario where a user wants to see a movie in their neighborhood at 3 PM. The user enters this information into a terminal, and the server collects information such as the schedules, seat availability, and review ratings of nearby movie theaters. Based on this information, the server evaluates which movie theater is the most efficient and suggests it to the user. This evaluation takes into account factors such as waiting time and travel time.

[0594] The following are specific examples of prompt statements for a generative AI model:

[0595] "The user wants to see a movie at 3:00 PM. Based on the specified geographical information, collect showtimes and seat availability for nearby movie theaters, and recommend the best theater considering waiting time and travel time."

[0596] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0597] Step 1:

[0598] The user inputs their activity preferences into an information processing device (terminal). For example, they might input, "I want to see a movie at 3 PM." The terminal reads this input, structures it in the required format (e.g., JSON), and prepares it as data to be used in the next processing step. The input is "activity preference information," and the output is "structured user activity information."

[0599] Step 2:

[0600] The terminal sends the user's activity requests to the server. This transmission takes place over the network, typically using the HTTP protocol. The server stores the received user activity information and prepares it for the next information collection step. The input is "structured user activity information," and the output is "received activity information."

[0601] Step 3:

[0602] The server accesses external information sources based on received activity information and collects the necessary relevant data. For example, it uses a movie theater API to obtain movie screenings, showtimes, and seat availability. The inputs are "received activity information" and "external API identifiers," and the output is "collected movie theater-related data."

[0603] Step 4:

[0604] The server evaluates time efficiency using collected movie theater-related data. A dedicated evaluation algorithm considers factors such as time, distance, and waiting time to calculate the most efficient option. The input is "collected movie theater-related data," and the output is "evaluated plan candidates."

[0605] Step 5:

[0606] The server generates the optimal action plan from the evaluated plan candidates. This plan includes the movie theater to choose, specific showtimes, estimated travel time, etc. The input is the "evaluated plan candidates," and the output is the "optimal action plan."

[0607] Step 6:

[0608] The server sends the optimal activity plan to the terminal. The terminal receives this plan and presents it visually to the user. The input is the "optimal activity plan," and the output is the "optimal activity plan displayed on the terminal."

[0609] Step 7:

[0610] The user can review the optimal activity plan displayed on the device and choose the option that best suits them from the suggested choices. This decision allows the user to use their time efficiently and achieve a fulfilling experience. The input is the "optimal activity plan displayed on the device," and the output is the "user's activity selection."

[0611] (Application Example 1)

[0612] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0613] Modern users want to minimize traffic congestion and wasted travel time, and manage their time optimally. However, current systems make it difficult to create efficient action plans based on real-time traffic conditions and the location of moving objects, resulting in wasted valuable time. To address these challenges, it is necessary to provide more efficient and precise planning.

[0614] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0615] In this invention, the server includes communication means for receiving multiple activity information; processing means for accessing external information sources and collecting necessary information based on the activity information; analysis means for evaluating time efficiency based on the collected information; planning means for generating an optimal action plan based on the evaluation results; transmission means for transmitting the generated action plan to a communication terminal; and adjustment means characterized in that the time efficiency takes into account traffic conditions and the location data of the moving object. This enables users to receive an efficient action plan in real time that minimizes traffic conditions and waiting times.

[0616] "Communication means" refers to devices and technologies for efficiently receiving multiple pieces of activity information.

[0617] "Processing means" refers to devices and technologies that access external information sources based on received activity information and collect necessary information.

[0618] "Analysis means" refers to devices and technologies used to evaluate time efficiency using collected information.

[0619] "Planning means" refers to devices and technologies for generating an optimal action plan based on the results of time efficiency evaluations.

[0620] "Means of transmission" refers to devices and technologies used to transmit the generated action plan to a communication terminal.

[0621] "Adjustment means" refers to devices or technologies that have the function of taking into account traffic conditions and the location data of moving objects when evaluating time efficiency.

[0622] This invention provides a system that enables users to efficiently utilize autonomous vehicles. The system receives activity information requested by the user via a smartphone using communication means. The received information is sent from the terminal to a server. The server uses processing means to collect data on current traffic conditions and the location of vehicles in real time from external information sources.

[0623] Next, the server utilizes analytical tools to evaluate time efficiency from the collected data. This evaluation includes traffic conditions, location data of moving objects, and waiting times. Based on the evaluation results, the planning tool generates an optimal action plan and transmits it to the user's communication terminal via a transmission tool.

[0624] As a concrete example, when a user uses an autonomous vehicle for shopping, they can receive a real-time action plan on their smartphone that reflects the optimal route, estimated travel time, and traffic conditions to their destination. This plan allows the user to act efficiently without wasting time. Furthermore, this system promotes effective use of time and improves user convenience.

[0625] An example of input to the generating AI model is a prompt such as, "Calculate the optimal route for an autonomous vehicle and generate a schedule and dispatch plan to reach the destination quickly, even in rainy weather."

[0626] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0627] Step 1:

[0628] The user enters desired activity information (e.g., destination, planned time) into the device via a smartphone application. The device then transmits this input information to the server via a communication method. The input consists of the user's desired information and is sent to the server as output.

[0629] Step 2:

[0630] Based on the user activity information received, the server accesses external information sources to obtain the latest traffic data and autonomous vehicle location data. The input for this process is the user's requested information, and the output is the collection of traffic data and location data. The system utilizes traffic APIs and map services to acquire this data.

[0631] Step 3:

[0632] The server uses analytical tools to evaluate time efficiency by using the collected traffic and location data. The input here is the data obtained in step 2, and the output is the evaluation result showing the optimal efficiency. A data analysis algorithm is used to perform analysis for time reduction and efficiency improvements.

[0633] Step 4:

[0634] The server uses planning tools to generate an optimal action plan based on the evaluation results. The input is the evaluation results from step 3, and the output is the specific action plan. Planning processing is performed to determine the optimal route and time allocation.

[0635] Step 5:

[0636] The server transmits the generated action plan to the communication terminal. Using a communication method, it conveys the specific details of the plan to the user. The input is the action plan from step 4, and the output is the plan information displayed on the user's terminal. The user can refer to the displayed information and receive instructions for efficiently carrying out their activities.

[0637] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0638] This invention provides a system that allows users to effectively utilize their time while receiving suggestions that take their emotional state into consideration. The system begins with the user inputting desired activity information into a terminal. The terminal then transmits this information to a server. Simultaneously, an emotion engine within the terminal recognizes the user's emotions and transmits that emotion data to the server.

[0639] The server uses external databases and APIs to acquire necessary information in real time based on user activity and sentiment data. The collected information is analyzed using evaluation tools, and an optimal activity plan is generated based on time performance and user sentiment. The generated plan is sent to the terminal, where the user reviews the proposed plan and makes the best choice.

[0640] As a concrete example, consider a scenario where a user wants to watch a movie at a specific time. The user inputs this request into the device. The device, through its emotion engine, recognizes the user's current emotional state (e.g., want to relax, want to feel energized). The device sends this information to a server. The server evaluates information about nearby movie theaters and which movies are suitable for the user's current emotional state, and generates an optimal plan considering time performance. This plan is then sent back to the device.

[0641] Based on the information received on their device, users can decide which movie to watch and at which theater. This selection information and emotional data are fed back to the server to make future recommendations more accurate. This allows users to maximize not only their time but also their emotional satisfaction.

[0642] The following describes the processing flow.

[0643] Step 1:

[0644] The user uses their device and enters information about their desired activity (e.g., "I want to see a movie at 1pm") into the app. Simultaneously, the device's emotion engine recognizes the user's emotions through the camera and sensors.

[0645] Step 2:

[0646] The device sends user input information and sentiment data to the server. Detailed information such as location and time constraints are also transmitted at this time.

[0647] Step 3:

[0648] Based on the activity and sentiment data received by the server, it accesses relevant external databases and APIs to retrieve information such as the cinema's location, showtimes, seat availability, movie reviews, and the emotional characteristics of the film.

[0649] Step 4:

[0650] The server analyzes the collected information using evaluation tools and evaluates each option based on time performance and user sentiment. This evaluation considers factors such as movie selection that matches the sentiment, travel time, waiting time, and review ratings.

[0651] Step 5:

[0652] The server generates an optimal activity plan based on the evaluation results. This plan includes movies and cinemas that offer high time performance and match the user's emotional state.

[0653] Step 6:

[0654] The server sends the generated plan to the device. The user reviews and views the proposed plan on their device.

[0655] Step 7:

[0656] Users review the proposed plans and make the choice that best suits them. This selection information and emotional data are later used as feedback.

[0657] Step 8:

[0658] The device sends user selection information and emotional feedback to the server. This information is used by the server to improve the accuracy of future suggestions.

[0659] (Example 2)

[0660] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0661] In today's busy lifestyle, it is difficult to maximize personal time while selecting the optimal activity based on one's emotional state at any given moment. In particular, the lack of systems that can suggest activities based on emotions is a major obstacle for users in improving time management and emotional satisfaction.

[0662] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0663] In this invention, the server includes terminal means for receiving multiple activity information and emotion data, server means for accessing external information sources and collecting necessary information, evaluation means for evaluating time performance and emotional suitability based on the information, generation means including a generation AI model, and transmission means. This makes it possible for the user to be offered an activity plan optimized for their current emotional state and schedule.

[0664] A "terminal device" is a device that receives activity information and emotion data entered by the user and transmits it to the server.

[0665] A "server device" is a device that has the function of accessing external information sources and collecting necessary information based on activity information and sentiment data received from users.

[0666] The "evaluation method" refers to a function that evaluates time performance and emotional compatibility based on information collected by the server.

[0667] "Generation means" refers to components, including a generative AI model, used to generate the optimal activity plan based on evaluation results.

[0668] The "transmission method" is a function that sends the generated activity plan to the terminal and provides feedback on the user's selections.

[0669] A "generative AI model" is a model that uses artificial intelligence technology to generate the optimal activity plan from the results of an evaluation method.

[0670] This invention is a system in which a user inputs activity information and the system proposes an optimal activity plan based on their emotional state at that time. To achieve this, a terminal, server, evaluation means, a generation AI model, and transmission means are used.

[0671] The user first enters information about their desired activity through a terminal. This terminal is equipped with an emotion engine that can recognize emotional data in real time from the user's voice and facial expressions. This information is encrypted and transmitted to the server in a secure state.

[0672] The server accesses external information sources based on the received activity and sentiment data to collect necessary data. Through this, the server obtains information such as nearby event information, facility opening hours, weather data, and transportation status.

[0673] The evaluation method analyzes information collected by the server and assesses time performance and emotional suitability in accordance with the user's desired activities and emotional state. Based on this evaluation, a generative AI model generates the optimal activity plan. This generative AI model improves the accuracy of information processing by using prompts that are tailored to the user's emotional state. An example of a prompt is, "The user wants to relax. Please recommend the optimal holiday plan."

[0674] Finally, the generated activity plan is sent to the device via a transmission method for the user to review. The user can review the proposed plan on the device and select the activity that best suits them. This selection information is fed back to the server to help improve the accuracy of future suggestions.

[0675] This system allows users to select more appropriate and meaningful activities that align with their emotional state, enabling them to effectively manage their time in daily life.

[0676] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0677] Step 1:

[0678] The user uses a device to input information about their desired activity. This information includes details such as the type of activity and the preferred time slot. Furthermore, the device's built-in emotion engine analyzes the user's voice and facial expressions to recognize emotional data in real time. The resulting activity information and emotional data are then processed as the system's initial input.

[0679] Step 2:

[0680] The device sends collected activity information and emotion data to the server. Security is ensured by encrypting this data during transmission. Successful transmission allows the server to perform further data processing. Once data transmission is complete, the server is ready to begin analyzing the data.

[0681] Step 3:

[0682] The server accesses external information sources based on the received activity and sentiment data. Specific data processing involves, for example, using APIs to obtain information on currently running local events and transportation status. This external data is aggregated to form a primary dataset for the next evaluation step.

[0683] Step 4:

[0684] The server analyzes the data aggregated by the evaluation method. This data processing includes calculating time performance and evaluating the compatibility between user sentiment data and collected external data. The output of this evaluation serves as the base data for activity plans proposed to users.

[0685] Step 5:

[0686] The server uses a generative AI model to generate an optimal activity plan based on the evaluation results. This step utilizes prompts, such as "The user wants to relax. Please recommend an optimal holiday plan," which is expected to improve the accuracy of the AI ​​model. The final output is a specific activity plan tailored to the user.

[0687] Step 6:

[0688] The server sends the generated activity plan to the terminal. The terminal displays the received plan for the user to review. The user uses this plan to decide which activities to actually select. This user selection information is then fed back to the server, contributing to the accuracy of future suggestions.

[0689] (Application Example 2)

[0690] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0691] Modern consumers are required to choose the best products and services from a wide range of options, and time efficiency and consideration of individual emotions are crucial in this process. However, traditional methods have made it difficult to receive optimal suggestions that take into account an individual's current emotional state. As a result, choices that do not meet user expectations are sometimes made, leading to decreased satisfaction.

[0692] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0693] In this invention, the server includes an information processing device means for receiving multiple activity information, a computer means for accessing an external information storage device and collecting necessary information based on the activity information and emotion data, and an evaluation means for evaluating time efficiency and emotional state based on the collected information and emotion data. This makes it possible to propose an optimal and time-efficient activity plan tailored to the individual circumstances of the user, thereby improving user satisfaction.

[0694] An "information processing device" is a device that has the function of receiving various input data from a user and transmitting that data to a computer.

[0695] "Electronic computing means" refers to a computing device that performs analysis based on received data and has the function of accessing an external information storage device to obtain necessary information.

[0696] An "evaluation tool" is a device that analyzes acquired information and emotional data to assess the optimal activity plan, taking into account time efficiency and the user's emotional state.

[0697] A "supplying device" is a device that has the function of presenting the generated activity plan to the user and providing information to encourage them to make a choice.

[0698] "Emotional data" refers to information that quantifies a user's emotional state, and is provided individually based on the user's preferences and tastes.

[0699] An "activity plan" is a guideline designed to facilitate appropriate behavioral choices, taking into account the user's time efficiency and emotional state.

[0700] The system of the present invention is mainly composed of an information processing device, a computer, an evaluation device, and a supply device. This allows the user to receive an optimal activity plan that takes their emotional state into consideration.

[0701] Information processing devices include smart glasses and smartphones. These devices provide an interface for users to input desired activities and their current emotional state. In particular, to acquire emotional data, cameras and microphones are used to detect the user's facial expressions and voice tone, and an emotion engine is used to analyze the data.

[0702] The computer system utilizes a standard server device and accesses an external information storage device based on data sent from the information processing device. The external information storage device contains data such as information on nearby shops, product information, and service hours, which are retrieved in real time as needed.

[0703] The evaluation method analyzes time efficiency and the user's emotional state based on information and emotional data. For this, the emotional engine may utilize, for example, Microsoft Azure's Face API, and Python libraries such as NumPy and Pandas may be used for analysis. Furthermore, a machine learning model is built using SciKit-Learn to provide optimal suggestions based on the user's emotional state and time efficiency.

[0704] The supply means presents the generated activity plan to the information processing device means. If smart glasses are used, recommended shopping routes and product information will be displayed on the screen.

[0705] For example, if a user is feeling down while shopping, the system will find items or specific shops that will cheer them up. By prompting the user with a question like, "What kind of products would help me feel better and enjoy shopping?", the system will provide appropriate suggestions.

[0706] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0707] Step 1:

[0708] The device starts up, and the user inputs activity information and emotional data. As an information processing device, smart glasses use an emotion engine to analyze facial expressions and voice tone from the camera and microphone, and generate emotional data. At this point, the input is the user's desired activity and emotional state, and the output is emotional data.

[0709] Step 2:

[0710] The device sends the activity information and emotion data it generates to the server. During this process, the data is securely transferred via HTTP communication. The input is the activity information and emotion data obtained in the previous step, and the output is the data packet sent to the server.

[0711] Step 3:

[0712] Based on the data received by the server, a computer system accesses an external information storage device to collect necessary information. Specifically, information such as nearby store information and product information is obtained via an API. The input is activity information and sentiment data, and the output is the acquired external data.

[0713] Step 4:

[0714] The server's evaluation method analyzes collected information and sentiment data. Here, data analysis is performed using Microsoft Azure's Face API, Python's NumPy, and Pandas, and a machine learning model using SciKit-Learn evaluates time efficiency and emotional state to generate an optimal action plan. The inputs are external data and sentiment data, and the outputs are the evaluation results and the optimal action plan.

[0715] Step 5:

[0716] The server sends the generated activity plan to the terminal. The terminal's supply mechanism displays it on the user's smart glasses, providing information to support the user's optimal shopping experience. The input is the optimal activity plan, and the output is the display on the terminal's screen.

[0717] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0718] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0719] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0720] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0721] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0722] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0723] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0724] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0725] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0726] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0727] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0728] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0729] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0730] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0731] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0732] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0733] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0734] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0735] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0736] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0737] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0738] The following is further disclosed regarding the embodiments described above.

[0739] (Claim 1)

[0740] A terminal means for receiving multiple activity information,

[0741] A server means that accesses an external database based on the aforementioned activity information and collects necessary information,

[0742] An evaluation means for evaluating time performance based on the information collected above,

[0743] A generation means for generating an optimal activity plan based on evaluation results,

[0744] A transmission means for sending the generated activity plan to a terminal,

[0745] A system that includes this.

[0746] (Claim 2)

[0747] The system according to claim 1, characterized in that the evaluation means evaluates time performance taking into account waiting time, travel time, and service evaluation.

[0748] (Claim 3)

[0749] The system according to claim 1, characterized in that the terminal means feeds back user selection information to the server means.

[0750] "Example 1"

[0751] (Claim 1)

[0752] Information processing device means for receiving multiple activity information,

[0753] A data collection device means that accesses external information sources and collects necessary information based on the aforementioned activity information,

[0754] An evaluation apparatus means for evaluating time efficiency based on the information collected above,

[0755] A plan generation device means that generates an optimal activity plan based on evaluation results,

[0756] A communication device means for transmitting the generated activity plan to an information processing device,

[0757] An information processing system that includes this.

[0758] (Claim 2)

[0759] The information processing system according to claim 1, characterized in that the evaluation device means evaluates time efficiency taking into account waiting time, travel time, and service evaluation.

[0760] (Claim 3)

[0761] The information processing system according to claim 1, characterized in that the information processing device feeds back user selection information to the data collection device.

[0762] "Application Example 1"

[0763] (Claim 1)

[0764] A communication means for receiving multiple activity information,

[0765] A processing means that accesses external information sources and collects necessary information based on the aforementioned activity information,

[0766] An analytical means for evaluating time efficiency based on the information collected,

[0767] A planning means for generating an optimal action plan based on evaluation results,

[0768] A transmission means for transmitting the generated action plan to a communication terminal,

[0769] The aforementioned time efficiency is characterized by taking into account traffic conditions and the location data of moving objects,

[0770] A system that includes this.

[0771] (Claim 2)

[0772] The system according to claim 1, characterized in that the analysis means evaluates time efficiency taking into account waiting time, travel time, and traffic conditions.

[0773] (Claim 3)

[0774] The system according to claim 1, characterized in that the communication means feeds back user selection information to the processing means.

[0775] "Example 2 of combining an emotion engine"

[0776] (Claim 1)

[0777] A terminal means for receiving multiple activity information and emotion data,

[0778] A server means that accesses external information sources and collects necessary information based on the aforementioned activity information and sentiment data,

[0779] An evaluation method for evaluating time performance and emotional compatibility based on the information collected above,

[0780] A generation means including a generation AI model that generates an optimal activity plan based on evaluation results,

[0781] A transmission means that sends the generated activity plan to the terminal and provides feedback on the user's selection information,

[0782] A system that includes this.

[0783] (Claim 2)

[0784] The system according to claim 1, characterized in that the evaluation means evaluates time performance taking into account waiting time, travel time, service evaluation, and the user's emotional state.

[0785] (Claim 3)

[0786] The system according to claim 1, characterized in that the generation AI model optimizes the activity plan based on multiple generation prompt sentences.

[0787] "Application example 2 of combining emotional engines"

[0788] (Claim 1)

[0789] Information processing device means for receiving multiple activity information,

[0790] A computer means accesses an external information storage device and collects necessary information based on the activity information and emotion data,

[0791] An evaluation means for evaluating time efficiency and emotional state based on the collected information and emotional data,

[0792] A generation means for generating an optimal activity plan based on evaluation results,

[0793] A supply means for providing the generated activity plan to an information processing device,

[0794] A system that includes this.

[0795] (Claim 2)

[0796] The system according to claim 1, characterized in that the evaluation means evaluates time efficiency taking into account waiting time, travel time, and evaluation of service content.

[0797] (Claim 3)

[0798] The system according to claim 1, characterized in that the information processing device returns the user's selection information to the computer device. [Explanation of symbols]

[0799] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A terminal means for receiving multiple activity information, A server means that accesses an external database based on the aforementioned activity information and collects necessary information, An evaluation means for evaluating time performance based on the information collected above, A generation means for generating an optimal activity plan based on evaluation results, A transmission means for sending the generated activity plan to a terminal, A system that includes this.

2. The system according to claim 1, characterized in that the evaluation means evaluates time performance taking into account waiting time, travel time, and service evaluation.

3. The system according to claim 1, characterized in that the terminal means feeds back user selection information to the server means.

Images